NNInput NNInputs_150.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 201034 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 52692 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 52692 Chosen entries: 52692 Signal fraction: 1 Background fraction: 0.355206 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 52692 Entries to split: 52692 Test with : 26346 Train with : 26346 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 52692 for Signal Prepared event 0 for Signal with 52692 events ====Entry 0 Variable Ht : 117.82 Variable LepAPt : 47.4738 Variable LepBPt : 12.5622 Variable MetSigLeptonsJets : 3.17918 Variable MetSpec : 29.8229 Variable SumEtLeptonsJets : 87.9972 Variable VSumJetLeptonsPt : 86.2262 Variable addEt : 89.8589 Variable dPhiLepSumMet : 2.58393 Variable dPhiLeptons : 0.475938 Variable dRLeptons : 0.613309 Variable lep1_E : 64.1505 Variable lep2_E : 22.7882 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2150 Ht = 117.82 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 47.4738 LepAPt = 47.4738 LepBEt = 12.5622 LepBPt = 12.5622 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 29.8229 MetDelPhi = 2.20584 MetSig = 2.18904 MetSigLeptonsJets = 3.17918 MetSpec = 29.8229 Mjj = 0 MostCentralJetEta = 0.309078 MtllMet = 98.8413 Njets = 1 SB = 0 SumEt = 185.606 SumEtJets = 0 SumEtLeptonsJets = 87.9972 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 86.2262 addEt = 89.8589 dPhiLepSumMet = 2.58393 dPhiLeptons = 0.475938 dRLeptons = 0.613309 diltype = 1 dimass = 14.9303 event = 29 jet1_Et = 27.9612 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 64.1504 lep2_E = 22.7882 rand = 0.999742 run = 167138 weight = 3.54438e-06 ===Show End Prepared event 10000 for Signal with 52692 events Prepared event 20000 for Signal with 52692 events Prepared event 30000 for Signal with 52692 events Prepared event 40000 for Signal with 52692 events Prepared event 50000 for Signal with 52692 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.319627 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4729 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 201034 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4729 negative weights. Signal fraction: 62.4409561 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.2801056 65.4778137 67.216713 68.4828949 69.5403442 70.5807266 71.3721466 72.2812729 73.1600342 73.9556885 74.5849915 75.2719269 75.9961319 76.6545258 77.2482605 77.993042 78.570076 79.1745911 79.7735977 80.5270309 81.1437607 81.8198776 82.6765976 83.4150848 84.3523636 85.3290558 86.2091217 87.2925568 88.5024414 89.5002213 90.9134674 92.1562881 93.3644867 94.5393829 95.723877 96.9715729 98.5414352 99.8237152 101.238205 102.508354 103.927917 104.945908 106.330162 107.766891 109.309395 110.774239 112.167511 113.615219 115.042046 116.475891 117.863365 119.350189 120.390686 121.805466 123.169525 124.57106 125.842369 127.187553 128.518463 129.810272 131.165909 132.543121 133.742126 135.058929 136.323364 137.646423 138.938995 140.37381 141.817566 143.310593 144.744568 146.227844 147.787964 149.388733 150.985046 152.97406 154.988312 157.064697 159.239548 161.924713 164.282104 166.697861 169.511642 172.308563 175.108704 178.245148 181.54068 185.375763 189.370728 194.006165 198.634583 204.319061 210.728882 219.134888 228.753052 240.952103 257.883057 282.530121 337.352325 836.977722 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.311409 20.6241646 20.9171219 21.1801014 21.4423809 21.6809006 21.9477844 22.146965 22.3689995 22.5927467 22.7893581 22.9481754 23.1432114 23.3268223 23.5440483 23.7540741 23.9482079 24.1916771 24.4132462 24.6252441 24.8413849 25.0450134 25.2525597 25.457222 25.6529007 25.8435993 26.0700722 26.2735691 26.4778137 26.6893883 26.9354897 27.1197109 27.2938652 27.5366821 27.7422485 27.9507732 28.1878548 28.4478874 28.6556702 28.8823128 29.1047859 29.318409 29.5392189 29.7493591 29.9894505 30.2931252 30.5502243 30.8589249 31.1102028 31.3709373 31.5763321 31.8335991 32.1142921 32.3769073 32.645752 32.951088 33.2275085 33.5148468 33.7985001 34.0970154 34.3822556 34.6816521 34.9575958 35.2782593 35.5818481 35.8804932 36.2008286 36.5253372 36.8474426 37.1798439 37.5203323 37.8731537 38.2497787 38.6070557 38.9849243 39.2640533 39.6759834 40.073185 40.5112915 40.8167267 41.2932281 41.825695 42.3489914 42.9163017 43.4835129 44.0983124 44.8158112 45.6067772 46.4912071 47.4488373 48.4109879 49.6552887 50.8055611 52.2401886 54.3188477 56.7087173 59.76754 64.8396072 74.3875885 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0006914 10.1205502 10.2675972 10.3762779 10.4885445 10.6077862 10.737442 10.8810043 11.0013981 11.1272593 11.2796907 11.4132118 11.5483418 11.6987524 11.8087234 11.9581318 12.103878 12.2358999 12.3819027 12.5487795 12.7128487 12.8583984 13.0369682 13.2121859 13.3814945 13.5368023 13.6879759 13.8367252 13.9935551 14.1660719 14.3562164 14.5296192 14.7459211 14.9636135 15.1740227 15.3601837 15.5462894 15.7596378 15.952467 16.1904449 16.4226265 16.634491 16.8314362 17.0454636 17.2851849 17.5389709 17.7581062 17.9862728 18.1895447 18.4475956 18.6956882 18.9719162 19.244854 19.5258884 19.7778587 20.063633 20.2325783 20.4153557 20.6691666 20.9402885 21.2119598 21.4728184 21.7128258 21.9440689 22.1373978 22.3997669 22.666832 22.9447746 23.2277126 23.5130825 23.7838364 24.0842247 24.3950844 24.7290001 25.0982628 25.4137802 25.7374878 26.0806236 26.3819885 26.7093449 27.0702248 27.4327316 27.8136292 28.1762409 28.5880623 28.9627972 29.4205322 29.8612709 30.3369656 30.8803825 31.4311295 32.0028381 32.6380196 33.3475723 34.1209259 35.2043076 36.4503822 38.3468552 41.0206146 45.9632759 102.012222 ------------------------------ Transdef: Tab for variable 5 1.07923043 2.65155578 3.07628059 3.38983035 3.66868973 3.90107632 4.06978798 4.1925106 4.33681059 4.44490862 4.5460062 4.64786911 4.72444057 4.81340981 4.90507507 4.97620487 5.04603958 5.12154484 5.19163227 5.25489902 5.31123352 5.36644888 5.42409611 5.46858978 5.52012348 5.55382586 5.59901714 5.64522839 5.70132637 5.74768353 5.79503059 5.84025192 5.88956261 5.93471193 5.9752779 6.01561785 6.05926228 6.10376787 6.1451993 6.19233131 6.23596239 6.27147293 6.3100009 6.35455418 6.40146303 6.45091772 6.48938036 6.52919102 6.57249784 6.61631584 6.66272163 6.715271 6.75651264 6.80036831 6.83702469 6.87465763 6.91248226 6.96736813 7.01157951 7.06223774 7.1169858 7.16660786 7.21129417 7.26078367 7.31141806 7.36280918 7.40694046 7.45500517 7.50139761 7.55456352 7.60978699 7.65715694 7.71426296 7.76489067 7.82564449 7.87978792 7.93503475 7.99316311 8.05553818 8.11284351 8.17129517 8.23360062 8.3017025 8.36721992 8.43822479 8.51154613 8.58567238 8.66550064 8.74940205 8.83840561 8.93261337 9.04814053 9.16403389 9.30241585 9.45262146 9.63007832 9.8666954 10.201932 10.7339554 11.6712694 24.4751568 ------------------------------ Transdef: Tab for variable 6 15.0050735 21.2171822 25.4955482 26.6593018 27.5263557 28.5179825 29.4648972 30.3059063 30.9382935 31.5194511 32.0993118 32.6802444 33.1871414 33.6623611 34.1593399 34.6792679 34.9803352 35.4256859 35.8527298 36.22966 36.5644608 36.9250031 37.2884254 37.6832962 37.9871063 38.3474884 38.6864014 39.0725937 39.4618645 39.8277779 40.1972046 40.5306702 40.9438896 41.3393364 41.7376251 42.1843719 42.5753288 42.9743271 43.3214111 43.7629738 44.1583939 44.6653671 45.1901588 45.6719971 46.1653938 46.7891006 47.2599182 47.8020325 48.4264297 49.0582809 49.6583328 50.2271156 50.7069397 51.3473587 52.0066071 52.6853256 53.310318 53.992424 54.492485 55.1784821 55.8023987 56.4634399 57.0735626 57.7481613 58.420681 58.9215508 59.6248055 60.2913284 60.9493942 61.6507187 62.3154831 62.9815292 63.6826019 64.3979645 65.1245651 65.8333206 66.5988464 67.3246918 68.0359573 68.783226 69.5082703 70.297554 71.0800934 71.8789215 72.7106018 73.5809708 74.5396957 75.5965195 76.7144775 77.6968079 79.1441193 80.6973114 82.4424133 84.4824524 86.9899597 89.9749451 93.6261292 98.7469482 106.343712 119.348473 274.186493 ------------------------------ Transdef: Tab for variable 7 30.1648712 32.55513 33.5348358 34.2488518 34.9544144 35.3929291 35.9277 36.3491821 36.7831955 37.1425705 37.4706421 37.8179512 38.172081 38.4981422 38.8040771 39.1596451 39.4721375 39.7722626 40.054306 40.330719 40.6683044 41.0329742 41.4148445 41.8062973 42.2370682 42.6734962 43.0776749 43.6093216 44.3335037 44.9055405 45.4372673 46.0495148 46.8156281 47.5575562 48.3923187 49.1414871 49.9705505 50.8157234 51.6976624 52.5362091 53.3285599 54.1123886 54.9721031 55.8515015 56.5195694 57.2708969 58.141655 58.8393555 59.5833817 60.3267593 61.0040283 61.4861755 62.2770691 63.0034561 63.7653465 64.5359497 65.2274323 66.0198669 66.8331146 67.6460724 68.447052 69.3961868 70.2577209 71.0405579 71.9328461 72.7798233 73.7917099 74.8839111 76.0822525 77.1496048 78.5209732 79.8795166 81.4532471 82.9314346 84.5106277 86.0246429 87.8487244 89.5521011 91.2777863 93.0990906 94.8145752 96.651123 98.6188812 100.85997 103.201057 105.595497 108.39827 111.423431 114.685684 118.25415 121.978195 126.096954 130.855042 136.249512 141.846313 150.023041 161.788681 175.508987 195.590454 237.195648 482.486786 ------------------------------ Transdef: Tab for variable 8 1.61999488 24.8617115 28.9684505 30.8971119 32.0609131 32.805687 33.2789574 33.8237686 34.2407837 34.7314835 35.1171913 35.5441132 35.8966141 36.1754532 36.5135193 36.8370056 37.1215858 37.3746262 37.6474228 37.8971825 38.1809998 38.4743881 38.7286186 39.0144043 39.2879486 39.5648575 39.8477859 40.1639748 40.4645538 40.8082581 41.1355515 41.4309959 41.8528442 42.2072639 42.5410194 42.9095764 43.3861046 43.7796707 44.2640686 44.7598457 45.1960373 45.6792221 46.273262 46.8096886 47.3778305 47.9996796 48.3662262 48.925087 49.4711761 50.0376205 50.62043 51.189827 51.8473701 52.4937057 53.0616913 53.6120682 54.1625977 54.7405396 55.3205795 55.9417038 56.5864868 57.1925354 57.823822 58.391243 58.9901886 59.5590935 60.1542282 60.8212204 61.2704353 61.8655014 62.5311432 63.1564178 63.8079567 64.4647369 65.0570221 65.6678162 66.2978058 66.9713593 67.6474304 68.3626938 69.0859222 69.7940826 70.5214233 71.2854462 72.1369629 73.0550003 74.0971222 75.1782837 76.2965393 77.6423416 79.2193451 80.9740753 83.0038834 85.5092316 88.646225 92.1535034 96.3563385 101.980469 111.41658 132.506927 349.597076 ------------------------------ Transdef: Tab for variable 9 49.2546883 62.8691864 65.0282745 66.6838303 67.8316498 68.8399048 69.8722153 70.7077942 71.4188232 72.2213898 73.0406189 73.7918549 74.3666382 74.964035 75.5540161 76.0978546 76.6940613 77.1520386 77.7539062 78.3243408 78.7809601 79.3473587 79.8169556 80.4909973 81.0328598 81.5802155 82.2966003 82.9721069 83.5694733 84.3719635 85.2435989 86.0355835 86.6900024 87.5406265 88.5259247 89.3448486 90.275856 91.289566 92.2798767 93.2048111 94.3215179 95.4091644 96.3231506 97.6067123 98.6927948 99.7226486 100.862518 101.931885 103.042816 104.18898 105.247627 106.337212 107.588814 108.820663 109.997437 111.076859 112.216881 113.33654 114.479767 115.580811 116.673218 117.699478 118.873711 119.720444 120.780121 121.794037 122.837608 123.897156 124.923698 125.884796 126.875885 127.932175 128.922577 130.009125 130.992981 132.002075 133.003448 133.97496 135.014877 136.020813 136.992889 138.049774 139.084854 140.18985 141.418854 142.609787 143.778809 145.010574 146.149551 147.464508 148.924255 150.343201 151.993271 154.149445 156.499268 159.716278 164.281982 171.172089 185.172729 215.7771 553.021301 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.902044654 1.29064131 1.51973867 1.69807839 1.82431459 1.93649971 2.03423214 2.10780406 2.17614031 2.23344946 2.27909255 2.32704949 2.37276053 2.40985823 2.44708824 2.48143625 2.51399755 2.54264641 2.57153487 2.5970757 2.61926746 2.64538789 2.66782784 2.68862987 2.71107769 2.73127556 2.74944782 2.76630116 2.78115487 2.79713631 2.81145501 2.82496452 2.83639908 2.84692526 2.85682821 2.86723423 2.87754464 2.88734102 2.89680481 2.90575027 2.91374111 2.92106509 2.93003392 2.93757677 2.94603062 2.952672 2.95977545 2.96620607 2.97202349 2.97739649 2.98290348 2.98728991 2.99184489 2.99556327 3.00109863 3.00551224 3.01008868 3.01451302 3.01949453 3.02397537 3.02824688 3.03198195 3.03571701 3.03966999 3.04301977 3.04675841 3.05058932 3.0541153 3.05744886 3.06071734 3.06427073 3.06759071 3.07053137 3.07321978 3.07629633 3.07917452 3.08227777 3.08505464 3.08810878 3.09124589 3.09429741 3.09697199 3.09966969 3.10243249 3.10501957 3.10782456 3.11015058 3.11283064 3.11534023 3.11814618 3.12105799 3.12337303 3.12570286 3.12806487 3.12997866 3.1319747 3.13386059 3.13615131 3.13884592 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00523793697 0.00999058783 0.0161010139 0.0220309496 0.0271934867 0.0341819525 0.0404690504 0.0470772684 0.0533903688 0.0606869459 0.0663582087 0.0732761621 0.079118371 0.0854492188 0.0918434188 0.0975679159 0.103778958 0.108406126 0.113979101 0.119369984 0.124885067 0.130239338 0.135774136 0.140867054 0.146721363 0.15250349 0.158336341 0.164090037 0.169736803 0.175063372 0.180815458 0.185995936 0.191492945 0.197154284 0.202458262 0.208013743 0.213433892 0.218927443 0.224148989 0.229744658 0.234612405 0.240762711 0.246738225 0.252441764 0.258084297 0.263107896 0.268393517 0.274978518 0.280827045 0.286842942 0.292822957 0.298453331 0.304260463 0.310917079 0.316005349 0.322073489 0.328036308 0.333737373 0.340190411 0.346397251 0.352386951 0.358326137 0.364265561 0.370100856 0.376377523 0.383012295 0.38864553 0.395002067 0.401589215 0.408530623 0.414492667 0.421607584 0.4283216 0.435179055 0.44129324 0.449007869 0.456546664 0.464550614 0.472819299 0.479682922 0.488497376 0.497795224 0.506843328 0.516683459 0.527262509 0.537952781 0.544825912 0.556450427 0.569548607 0.58119446 0.595939398 0.613075912 0.63193655 0.648004949 0.669746995 0.69807899 0.730713665 0.773105145 0.83896333 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.100060925 0.121496469 0.137820989 0.153278887 0.165633366 0.177016437 0.188487917 0.198735237 0.207854941 0.217683703 0.225878954 0.234433562 0.243236065 0.251120806 0.258771688 0.266204745 0.272884429 0.280252814 0.286726981 0.294135451 0.301793635 0.308531404 0.314687133 0.321177781 0.32765159 0.334388852 0.340849996 0.346971631 0.353075683 0.357707381 0.364083409 0.369679987 0.375694931 0.381295264 0.387627244 0.392764091 0.398509026 0.403349578 0.407910645 0.412239641 0.416276783 0.420414746 0.424513698 0.428727686 0.43283242 0.437376559 0.441153467 0.445195138 0.449358404 0.45371753 0.458142817 0.462434411 0.466514766 0.471077979 0.47558257 0.478733897 0.4828372 0.487081528 0.491842926 0.496271491 0.50078702 0.505688548 0.510721862 0.516034007 0.520981789 0.526398897 0.530998468 0.536756754 0.542231262 0.547426701 0.551417112 0.556619525 0.561480224 0.567213714 0.573238432 0.580211997 0.58664757 0.592387199 0.599046767 0.606481314 0.614372849 0.622218609 0.630270839 0.640282214 0.650083661 0.658239603 0.666535139 0.676203012 0.685470104 0.697666645 0.707830548 0.720928729 0.733234048 0.748053789 0.761790276 0.780402303 0.801930189 0.828402519 0.863029897 0.904334366 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0581474 21.5171242 22.2711449 22.9486885 23.513237 24.0062695 24.4695816 24.9342403 25.2661171 25.6360626 26.0583839 26.4341621 26.8289795 27.1572075 27.4737415 27.803669 28.1994076 28.5330315 28.896244 29.2662964 29.5955772 29.9120674 30.1969566 30.5407753 30.8728409 31.120369 31.42313 31.7213116 32.0546532 32.3557167 32.64785 32.954216 33.2576218 33.5777969 33.9057999 34.2194939 34.4783211 34.7924118 35.1157913 35.4508972 35.7998734 36.0628967 36.3196831 36.6850586 37.0272255 37.3628426 37.6870499 38.0335464 38.379158 38.6859131 39.0444946 39.4269562 39.7593193 40.0954514 40.4802094 40.8423767 41.2327423 41.6218948 42.0008011 42.4366913 42.8733826 43.2326126 43.6848412 44.1135406 44.568531 45.0648575 45.5315552 46.0750046 46.6049538 47.1791077 47.6453171 48.2418213 48.8216171 49.4718399 50.1019669 50.7262344 51.3576279 52.0752449 52.8217964 53.5946732 54.4414368 55.3622208 56.224823 57.2329254 58.2164764 59.2911263 60.5190239 61.8873672 63.2134171 64.6091766 66.490448 68.1421967 69.7662354 72.1045227 75.117363 78.427597 82.60849 87.257782 92.3906937 103.380959 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6908894 11.1232615 11.520853 11.7961407 12.1090488 12.3628674 12.6772327 12.951643 13.2505484 13.5403957 13.8014364 14.058424 14.3512459 14.6309547 14.8841743 15.1841736 15.4661179 15.7190399 16.0044537 16.2710381 16.460722 16.684494 16.933094 17.183527 17.4624939 17.7266312 17.9623547 18.2027397 18.4745369 18.7158508 19.0073509 19.2826004 19.5529385 19.8446217 20.1480255 20.4231777 20.6976547 20.9794235 21.2486725 21.5343475 21.7712326 22.0238609 22.2859154 22.5420532 22.8235703 23.0952759 23.3800774 23.6776886 23.9339752 24.2230339 24.5301819 24.8056984 25.0701065 25.3918991 25.6940269 25.9986076 26.3002968 26.5858097 26.9061356 27.2134285 27.5098343 27.8480759 28.0741673 28.417347 28.7358265 29.0891685 29.4008064 29.7139549 30.0732193 30.425499 30.8196106 31.225565 31.5732117 31.9772758 32.391449 32.8078232 33.2431488 33.5721512 34.0318604 34.4813347 35.0029068 35.528923 36.1042824 36.6545486 37.247982 37.9012299 38.6322479 39.5136108 40.2064285 41.1173401 42.0044556 43.1880417 44.2696075 45.7496567 47.5378036 49.6343842 52.7558327 56.897419 64.334198 124.81353 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 61.0 44.1 51.0 22.3 44.4 58.8 49.0 58.8 -26.1 -11.4 -21.3 13.6 27.3 2 61.0 100.0 65.1 60.1 31.8 67.2 94.6 74.0 91.9 -46.7 -19.7 -34.5 35.1 38.1 3 44.1 65.1 100.0 44.4 6.1 32.7 68.1 52.8 71.4 -15.6 -21.9 -39.5 67.2 27.7 4 51.0 60.1 44.4 100.0 12.5 36.3 60.9 51.3 66.4 -12.9 -26.8 -46.9 22.7 75.4 5 22.3 31.8 6.1 12.5 100.0 82.4 5.1 53.7 53.4 22.6 -4.7 -6.2 -4.1 4.4 6 44.4 67.2 32.7 36.3 82.4 100.0 46.7 77.1 78.5 -7.5 -13.0 -20.7 12.1 20.7 7 58.8 94.6 68.1 60.9 5.1 46.7 100.0 66.7 80.9 -54.1 -18.5 -33.9 39.4 40.0 8 49.0 74.0 52.8 51.3 53.7 77.1 66.7 100.0 82.3 -12.7 -19.7 -31.4 28.6 33.6 9 58.8 91.9 71.4 66.4 53.4 78.5 80.9 82.3 100.0 -23.1 -23.1 -40.7 40.2 43.6 10 -26.1 -46.7 -15.6 -12.9 22.6 -7.5 -54.1 -12.7 -23.1 100.0 1.0 4.4 -5.7 -6.4 11 -11.4 -19.7 -21.9 -26.8 -4.7 -13.0 -18.5 -19.7 -23.1 1.0 100.0 59.9 -9.0 -17.9 12 -21.3 -34.5 -39.5 -46.9 -6.2 -20.7 -33.9 -31.4 -40.7 4.4 59.9 100.0 -16.4 -26.1 13 13.6 35.1 67.2 22.7 -4.1 12.1 39.4 28.6 40.2 -5.7 -9.0 -16.4 100.0 47.8 14 27.3 38.1 27.7 75.4 4.4 20.7 40.0 33.6 43.6 -6.4 -17.9 -26.1 47.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 149.173413 TOTAL CORRELATION OF ALL VARIABLES 67.6645847 ROUND 1: MAX CORR ( 67.6639463) AFTER KILLING INPUT VARIABLE 8 CONTR 0.293936236 ROUND 2: MAX CORR ( 67.6631163) AFTER KILLING INPUT VARIABLE 11 CONTR 0.335142358 ROUND 3: MAX CORR ( 67.6175205) AFTER KILLING INPUT VARIABLE 14 CONTR 2.4835912 ROUND 4: MAX CORR ( 67.4906046) AFTER KILLING INPUT VARIABLE 10 CONTR 4.14093916 ROUND 5: MAX CORR ( 67.3437116) AFTER KILLING INPUT VARIABLE 7 CONTR 4.45041635 ROUND 6: MAX CORR ( 67.1658767) AFTER KILLING INPUT VARIABLE 6 CONTR 4.89085902 ROUND 7: MAX CORR ( 66.6264263) AFTER KILLING INPUT VARIABLE 12 CONTR 8.4955469 ROUND 8: MAX CORR ( 65.5638005) AFTER KILLING INPUT VARIABLE 9 CONTR 11.8519509 ROUND 9: MAX CORR ( 65.3966228) AFTER KILLING INPUT VARIABLE 5 CONTR 4.67906633 ROUND 10: MAX CORR ( 64.1989549) AFTER KILLING INPUT VARIABLE 3 CONTR 12.4584298 ROUND 11: MAX CORR ( 63.5976587) AFTER KILLING INPUT VARIABLE 13 CONTR 8.76604874 ROUND 12: MAX CORR ( 61.0138996) AFTER KILLING INPUT VARIABLE 4 CONTR 17.9434178 LAST REMAINING VARIABLE: 2 total correlation to target: 67.6645847 % total significance: 139.479907 sigma correlations of single variables to target: variable 2: 61.0138996 % , in sigma: 125.770565 variable 3: 44.1201435 % , in sigma: 90.9467418 variable 4: 51.0265851 % , in sigma: 105.183286 variable 5: 22.2845032 % , in sigma: 45.9360011 variable 6: 44.3793256 % , in sigma: 91.4810048 variable 7: 58.8188729 % , in sigma: 121.245862 variable 8: 48.9600024 % , in sigma: 100.92335 variable 9: 58.8262637 % , in sigma: 121.261097 variable 10: -26.1426101 % , in sigma: 53.8888821 variable 11: -11.4171913 % , in sigma: 23.5347456 variable 12: -21.2819569 % , in sigma: 43.8694094 variable 13: 13.5839497 % , in sigma: 28.0011774 variable 14: 27.2962174 % , in sigma: 56.2668621 variables sorted by significance: 1 most relevant variable 2 corr 61.0139008 , in sigma: 125.770567 2 most relevant variable 4 corr 17.9434185 , in sigma: 36.9875372 3 most relevant variable 13 corr 8.76604843 , in sigma: 18.0698311 4 most relevant variable 3 corr 12.4584293 , in sigma: 25.6810941 5 most relevant variable 5 corr 4.67906618 , in sigma: 9.64515955 6 most relevant variable 9 corr 11.8519506 , in sigma: 24.4309336 7 most relevant variable 12 corr 8.49554729 , in sigma: 17.5122356 8 most relevant variable 6 corr 4.89085913 , in sigma: 10.0817374 9 most relevant variable 7 corr 4.45041656 , in sigma: 9.1738343 10 most relevant variable 10 corr 4.14093924 , in sigma: 8.53589543 11 most relevant variable 14 corr 2.48359132 , in sigma: 5.11953317 12 most relevant variable 11 corr 0.335142344 , in sigma: 0.69084327 13 most relevant variable 8 corr 0.293936223 , in sigma: 0.605903327 global correlations between input variables: variable 2: 99.2070562 % variable 3: 93.0092338 % variable 4: 92.640465 % variable 5: 95.0269389 % variable 6: 94.1052339 % variable 7: 98.7731485 % variable 8: 89.1882907 % variable 9: 98.8988257 % variable 10: 71.5780389 % variable 11: 60.6425845 % variable 12: 71.0215528 % variable 13: 86.2104178 % variable 14: 89.3206345 % significance loss when removing single variables: variable 2: corr = 5.07242582 % , sigma = 10.4560086 variable 3: corr = 15.1911689 % , sigma = 31.3142072 variable 4: corr = 16.3409315 % , sigma = 33.6842622 variable 5: corr = 8.62719468 % , sigma = 17.7836059 variable 6: corr = 4.12975267 % , sigma = 8.51283607 variable 7: corr = 3.43574819 % , sigma = 7.08225492 variable 8: corr = 0.293936236 % , sigma = 0.605903354 variable 9: corr = 10.0244213 % , sigma = 20.663769 variable 10: corr = 4.17925998 % , sigma = 8.61488762 variable 11: corr = 0.351695821 % , sigma = 0.724965661 variable 12: corr = 6.77473294 % , sigma = 13.9650472 variable 13: corr = 8.26067116 % , sigma = 17.0280753 variable 14: corr = 2.44940813 % , sigma = 5.0490699 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 33.3228569 sigma out 15 active outputs RANK 2 NODE 1 --> 30.7653961 sigma out 15 active outputs RANK 3 NODE 2 --> 26.9119492 sigma out 15 active outputs RANK 4 NODE 12 --> 25.5258465 sigma out 15 active outputs RANK 5 NODE 4 --> 24.4300156 sigma out 15 active outputs RANK 6 NODE 10 --> 24.1244717 sigma out 15 active outputs RANK 7 NODE 8 --> 23.4986343 sigma out 15 active outputs RANK 8 NODE 9 --> 21.7670383 sigma out 15 active outputs RANK 9 NODE 5 --> 17.2632179 sigma out 15 active outputs RANK 10 NODE 3 --> 16.5253201 sigma out 15 active outputs RANK 11 NODE 11 --> 12.8322105 sigma out 15 active outputs RANK 12 NODE 7 --> 11.8807449 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 36.9235039 sigma in 12act. ( 36.122982 sig out 1act.) RANK 2 NODE 15 --> 29.8634796 sigma in 12act. ( 31.6542473 sig out 1act.) RANK 3 NODE 3 --> 27.9207363 sigma in 12act. ( 28.7827053 sig out 1act.) RANK 4 NODE 6 --> 27.1612968 sigma in 12act. ( 28.0394802 sig out 1act.) RANK 5 NODE 10 --> 25.5824547 sigma in 12act. ( 24.819788 sig out 1act.) RANK 6 NODE 2 --> 24.6318378 sigma in 12act. ( 24.7939835 sig out 1act.) RANK 7 NODE 7 --> 21.7677765 sigma in 12act. ( 20.3904343 sig out 1act.) RANK 8 NODE 4 --> 18.6722012 sigma in 12act. ( 18.2981606 sig out 1act.) RANK 9 NODE 1 --> 16.0815182 sigma in 12act. ( 17.7848282 sig out 1act.) RANK 10 NODE 8 --> 13.7565393 sigma in 12act. ( 12.5428457 sig out 1act.) RANK 11 NODE 9 --> 10.6083212 sigma in 12act. ( 11.919035 sig out 1act.) RANK 12 NODE 11 --> 8.49595165 sigma in 12act. ( 11.3321476 sig out 1act.) RANK 13 NODE 14 --> 3.64291096 sigma in 12act. ( 7.11321259 sig out 1act.) RANK 14 NODE 12 --> 3.25718427 sigma in 12act. ( 6.09557867 sig out 1act.) RANK 15 NODE 13 --> 1.36534905 sigma in 12act. ( 0.0544045344 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 36.122982 sigma out 1act.( 36.9235039 sig in 12act.) RANK 2 NODE 15 --> 31.6542473 sigma out 1act.( 29.8634796 sig in 12act.) RANK 3 NODE 3 --> 28.7827053 sigma out 1act.( 27.9207363 sig in 12act.) RANK 4 NODE 6 --> 28.0394802 sigma out 1act.( 27.1612968 sig in 12act.) RANK 5 NODE 10 --> 24.819788 sigma out 1act.( 25.5824547 sig in 12act.) RANK 6 NODE 2 --> 24.7939835 sigma out 1act.( 24.6318378 sig in 12act.) RANK 7 NODE 7 --> 20.3904343 sigma out 1act.( 21.7677765 sig in 12act.) RANK 8 NODE 4 --> 18.2981606 sigma out 1act.( 18.6722012 sig in 12act.) RANK 9 NODE 1 --> 17.7848282 sigma out 1act.( 16.0815182 sig in 12act.) RANK 10 NODE 8 --> 12.5428457 sigma out 1act.( 13.7565393 sig in 12act.) RANK 11 NODE 9 --> 11.919035 sigma out 1act.( 10.6083212 sig in 12act.) RANK 12 NODE 11 --> 11.3321476 sigma out 1act.( 8.49595165 sig in 12act.) RANK 13 NODE 14 --> 7.11321259 sigma out 1act.( 3.64291096 sig in 12act.) RANK 14 NODE 12 --> 6.09557867 sigma out 1act.( 3.25718427 sig in 12act.) RANK 15 NODE 13 --> 0.0544045344 sigma out 1act.( 1.36534905 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 82.0654297 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 31.8120689 sigma out 15 active outputs RANK 2 NODE 2 --> 31.320385 sigma out 15 active outputs RANK 3 NODE 1 --> 29.3897781 sigma out 15 active outputs RANK 4 NODE 12 --> 24.4244041 sigma out 15 active outputs RANK 5 NODE 8 --> 23.6847973 sigma out 15 active outputs RANK 6 NODE 10 --> 22.8916454 sigma out 15 active outputs RANK 7 NODE 4 --> 22.4700336 sigma out 15 active outputs RANK 8 NODE 9 --> 19.9633846 sigma out 15 active outputs RANK 9 NODE 5 --> 17.1485996 sigma out 15 active outputs RANK 10 NODE 3 --> 15.1772404 sigma out 15 active outputs RANK 11 NODE 11 --> 13.6170444 sigma out 15 active outputs RANK 12 NODE 7 --> 12.970644 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 37.6999207 sigma in 12act. ( 33.7296982 sig out 1act.) RANK 2 NODE 15 --> 28.5488205 sigma in 12act. ( 28.2997379 sig out 1act.) RANK 3 NODE 3 --> 26.392622 sigma in 12act. ( 25.8054981 sig out 1act.) RANK 4 NODE 2 --> 23.6783066 sigma in 12act. ( 22.608572 sig out 1act.) RANK 5 NODE 10 --> 22.8577862 sigma in 12act. ( 21.6560612 sig out 1act.) RANK 6 NODE 6 --> 22.409977 sigma in 12act. ( 24.0763264 sig out 1act.) RANK 7 NODE 4 --> 19.9390793 sigma in 12act. ( 16.8748093 sig out 1act.) RANK 8 NODE 7 --> 19.119297 sigma in 12act. ( 18.6539478 sig out 1act.) RANK 9 NODE 1 --> 15.772027 sigma in 12act. ( 16.3802509 sig out 1act.) RANK 10 NODE 12 --> 13.8083448 sigma in 12act. ( 7.95321894 sig out 1act.) RANK 11 NODE 14 --> 12.2294292 sigma in 12act. ( 8.6049099 sig out 1act.) RANK 12 NODE 11 --> 12.063962 sigma in 12act. ( 11.429204 sig out 1act.) RANK 13 NODE 8 --> 12.0549965 sigma in 12act. ( 10.7584095 sig out 1act.) RANK 14 NODE 9 --> 11.3465452 sigma in 12act. ( 10.7949734 sig out 1act.) RANK 15 NODE 13 --> 5.46456623 sigma in 12act. ( 0.286956161 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 33.7296982 sigma out 1act.( 37.6999207 sig in 12act.) RANK 2 NODE 15 --> 28.2997379 sigma out 1act.( 28.5488205 sig in 12act.) RANK 3 NODE 3 --> 25.8054981 sigma out 1act.( 26.392622 sig in 12act.) RANK 4 NODE 6 --> 24.0763264 sigma out 1act.( 22.409977 sig in 12act.) RANK 5 NODE 2 --> 22.608572 sigma out 1act.( 23.6783066 sig in 12act.) RANK 6 NODE 10 --> 21.6560612 sigma out 1act.( 22.8577862 sig in 12act.) RANK 7 NODE 7 --> 18.6539478 sigma out 1act.( 19.119297 sig in 12act.) RANK 8 NODE 4 --> 16.8748093 sigma out 1act.( 19.9390793 sig in 12act.) RANK 9 NODE 1 --> 16.3802509 sigma out 1act.( 15.772027 sig in 12act.) RANK 10 NODE 11 --> 11.429204 sigma out 1act.( 12.063962 sig in 12act.) RANK 11 NODE 9 --> 10.7949734 sigma out 1act.( 11.3465452 sig in 12act.) RANK 12 NODE 8 --> 10.7584095 sigma out 1act.( 12.0549965 sig in 12act.) RANK 13 NODE 14 --> 8.6049099 sigma out 1act.( 12.2294292 sig in 12act.) RANK 14 NODE 12 --> 7.95321894 sigma out 1act.( 13.8083448 sig in 12act.) RANK 15 NODE 13 --> 0.286956161 sigma out 1act.( 5.46456623 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 74.6030655 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.433273256 *** contribution from regularisation: 0.00421005022 *** contribution from error: -0.437483311 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.48184514 *** contribution from regularisation: 0.00300226733 *** contribution from error: -0.484847397 *********************************************** -----------------> Test sample ENTER BFGS code START -48443.6784 -0.344889373 0.586798251 EXIT FROM BFGS code FG_START 0. -0.344889373 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.504317522 *** contribution from regularisation: 0.00275000115 *** contribution from error: -0.507067502 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -50692.4835 -0.344889373 519.716064 EXIT FROM BFGS code FG_LNSRCH 0. -0.245059878 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.530336559 *** contribution from regularisation: 0.00321513624 *** contribution from error: -0.533551693 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53307.8409 -0.245059878 139.957993 EXIT FROM BFGS code NEW_X -53307.8409 -0.245059878 139.957993 ENTER BFGS code NEW_X -53307.8409 -0.245059878 139.957993 EXIT FROM BFGS code FG_LNSRCH 0. -0.220566332 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.532258391 *** contribution from regularisation: 0.003177915 *** contribution from error: -0.535436332 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53501.0148 -0.220566332 60.1042786 EXIT FROM BFGS code NEW_X -53501.0148 -0.220566332 60.1042786 ENTER BFGS code NEW_X -53501.0148 -0.220566332 60.1042786 EXIT FROM BFGS code FG_LNSRCH 0. -0.197242916 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.533167243 *** contribution from regularisation: 0.00318601239 *** contribution from error: -0.53635323 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53592.3723 -0.197242916 41.3573151 EXIT FROM BFGS code NEW_X -53592.3723 -0.197242916 41.3573151 ENTER BFGS code NEW_X -53592.3723 -0.197242916 41.3573151 EXIT FROM BFGS code FG_LNSRCH 0. -0.151621357 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.534060419 *** contribution from regularisation: 0.00319616892 *** contribution from error: -0.537256598 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53682.1494 -0.151621357 17.2342777 EXIT FROM BFGS code NEW_X -53682.1494 -0.151621357 17.2342777 ENTER BFGS code NEW_X -53682.1494 -0.151621357 17.2342777 EXIT FROM BFGS code FG_LNSRCH 0. -0.102910437 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.535002947 *** contribution from regularisation: 0.00320676668 *** contribution from error: -0.538209736 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53776.8888 -0.102910437 8.38101864 EXIT FROM BFGS code NEW_X -53776.8888 -0.102910437 8.38101864 ENTER BFGS code NEW_X -53776.8888 -0.102910437 8.38101864 EXIT FROM BFGS code FG_LNSRCH 0. 0.040649686 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.53664434 *** contribution from regularisation: 0.00328034931 *** contribution from error: -0.539924681 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53941.8805 0.040649686 -32.5122681 EXIT FROM BFGS code NEW_X -53941.8805 0.040649686 -32.5122681 ENTER BFGS code NEW_X -53941.8805 0.040649686 -32.5122681 EXIT FROM BFGS code FG_LNSRCH 0. 0.0907382965 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 41.3606377 sigma out 15 active outputs RANK 2 NODE 1 --> 24.2249985 sigma out 15 active outputs RANK 3 NODE 10 --> 22.2594986 sigma out 15 active outputs RANK 4 NODE 9 --> 19.5124664 sigma out 15 active outputs RANK 5 NODE 11 --> 19.1738224 sigma out 15 active outputs RANK 6 NODE 8 --> 17.0309544 sigma out 15 active outputs RANK 7 NODE 7 --> 16.2502785 sigma out 15 active outputs RANK 8 NODE 4 --> 14.112009 sigma out 15 active outputs RANK 9 NODE 6 --> 13.8134394 sigma out 15 active outputs RANK 10 NODE 12 --> 12.033474 sigma out 15 active outputs RANK 11 NODE 5 --> 11.5271158 sigma out 15 active outputs RANK 12 NODE 3 --> 10.9129477 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 29.7319145 sigma in 12act. ( 25.2762299 sig out 1act.) RANK 2 NODE 12 --> 28.0171757 sigma in 12act. ( 32.5468941 sig out 1act.) RANK 3 NODE 14 --> 24.6563683 sigma in 12act. ( 18.5572033 sig out 1act.) RANK 4 NODE 5 --> 23.7783375 sigma in 12act. ( 23.8706417 sig out 1act.) RANK 5 NODE 15 --> 21.2875156 sigma in 12act. ( 21.9575043 sig out 1act.) RANK 6 NODE 6 --> 17.2348194 sigma in 12act. ( 18.89534 sig out 1act.) RANK 7 NODE 2 --> 15.5244226 sigma in 12act. ( 12.3601894 sig out 1act.) RANK 8 NODE 11 --> 15.0568399 sigma in 12act. ( 14.282979 sig out 1act.) RANK 9 NODE 1 --> 14.5462303 sigma in 12act. ( 13.9386187 sig out 1act.) RANK 10 NODE 10 --> 13.7441072 sigma in 12act. ( 11.9876719 sig out 1act.) RANK 11 NODE 9 --> 11.7402592 sigma in 12act. ( 11.8044586 sig out 1act.) RANK 12 NODE 8 --> 10.2330799 sigma in 12act. ( 9.89068413 sig out 1act.) RANK 13 NODE 3 --> 10.1029415 sigma in 12act. ( 9.01104164 sig out 1act.) RANK 14 NODE 7 --> 7.81753778 sigma in 12act. ( 7.32547283 sig out 1act.) RANK 15 NODE 13 --> 3.97893858 sigma in 12act. ( 1.89766598 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 32.5468941 sigma out 1act.( 28.0171757 sig in 12act.) RANK 2 NODE 4 --> 25.2762299 sigma out 1act.( 29.7319145 sig in 12act.) RANK 3 NODE 5 --> 23.8706417 sigma out 1act.( 23.7783375 sig in 12act.) RANK 4 NODE 15 --> 21.9575043 sigma out 1act.( 21.2875156 sig in 12act.) RANK 5 NODE 6 --> 18.89534 sigma out 1act.( 17.2348194 sig in 12act.) RANK 6 NODE 14 --> 18.5572033 sigma out 1act.( 24.6563683 sig in 12act.) RANK 7 NODE 11 --> 14.282979 sigma out 1act.( 15.0568399 sig in 12act.) RANK 8 NODE 1 --> 13.9386187 sigma out 1act.( 14.5462303 sig in 12act.) RANK 9 NODE 2 --> 12.3601894 sigma out 1act.( 15.5244226 sig in 12act.) RANK 10 NODE 10 --> 11.9876719 sigma out 1act.( 13.7441072 sig in 12act.) RANK 11 NODE 9 --> 11.8044586 sigma out 1act.( 11.7402592 sig in 12act.) RANK 12 NODE 8 --> 9.89068413 sigma out 1act.( 10.2330799 sig in 12act.) RANK 13 NODE 3 --> 9.01104164 sigma out 1act.( 10.1029415 sig in 12act.) RANK 14 NODE 7 --> 7.32547283 sigma out 1act.( 7.81753778 sig in 12act.) RANK 15 NODE 13 --> 1.89766598 sigma out 1act.( 3.97893858 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 67.2453079 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.53723073 *** contribution from regularisation: 0.00327380234 *** contribution from error: -0.540504515 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54000.8204 0.0907382965 4.53710985 EXIT FROM BFGS code NEW_X -54000.8204 0.0907382965 4.53710985 ENTER BFGS code NEW_X -54000.8204 0.0907382965 4.53710985 EXIT FROM BFGS code FG_LNSRCH 0. 0.0847861096 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.537741661 *** contribution from regularisation: 0.00321089267 *** contribution from error: -0.540952563 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54052.1807 0.0847861096 -2.53969193 EXIT FROM BFGS code NEW_X -54052.1807 0.0847861096 -2.53969193 ENTER BFGS code NEW_X -54052.1807 0.0847861096 -2.53969193 EXIT FROM BFGS code FG_LNSRCH 0. 0.0797769427 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.537934959 *** contribution from regularisation: 0.00317784492 *** contribution from error: -0.541112781 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54071.6105 0.0797769427 -11.1140509 EXIT FROM BFGS code NEW_X -54071.6105 0.0797769427 -11.1140509 ENTER BFGS code NEW_X -54071.6105 0.0797769427 -11.1140509 EXIT FROM BFGS code FG_LNSRCH 0. 0.0651225299 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.538417935 *** contribution from regularisation: 0.00316935126 *** contribution from error: -0.541587293 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54120.158 0.0651225299 -16.2552528 EXIT FROM BFGS code NEW_X -54120.158 0.0651225299 -16.2552528 ENTER BFGS code NEW_X -54120.158 0.0651225299 -16.2552528 EXIT FROM BFGS code FG_LNSRCH 0. 0.0466632247 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.539005935 *** contribution from regularisation: 0.00323378528 *** contribution from error: -0.542239726 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54179.2602 0.0466632247 -38.168808 EXIT FROM BFGS code NEW_X -54179.2602 0.0466632247 -38.168808 ENTER BFGS code NEW_X -54179.2602 0.0466632247 -38.168808 EXIT FROM BFGS code FG_LNSRCH 0. -0.00354345655 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.539348304 *** contribution from regularisation: 0.0034923018 *** contribution from error: -0.5428406 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54213.6709 -0.00354345655 83.2319107 EXIT FROM BFGS code NEW_X -54213.6709 -0.00354345655 83.2319107 ENTER BFGS code NEW_X -54213.6709 -0.00354345655 83.2319107 EXIT FROM BFGS code FG_LNSRCH 0. 0.0121506909 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.540008008 *** contribution from regularisation: 0.0034106255 *** contribution from error: -0.543418646 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54279.9874 0.0121506909 -18.2452927 EXIT FROM BFGS code NEW_X -54279.9874 0.0121506909 -18.2452927 ENTER BFGS code NEW_X -54279.9874 0.0121506909 -18.2452927 EXIT FROM BFGS code FG_LNSRCH 0. 0.0120667564 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.540142119 *** contribution from regularisation: 0.00339406636 *** contribution from error: -0.543536186 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54293.4633 0.0120667564 -13.8566303 EXIT FROM BFGS code NEW_X -54293.4633 0.0120667564 -13.8566303 ENTER BFGS code NEW_X -54293.4633 0.0120667564 -13.8566303 EXIT FROM BFGS code FG_LNSRCH 0. -0.00571108097 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.540799558 *** contribution from regularisation: 0.00349571905 *** contribution from error: -0.544295251 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54359.5466 -0.00571108097 14.344183 EXIT FROM BFGS code NEW_X -54359.5466 -0.00571108097 14.344183 ENTER BFGS code NEW_X -54359.5466 -0.00571108097 14.344183 EXIT FROM BFGS code FG_LNSRCH 0. -0.0338439569 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.541381419 *** contribution from regularisation: 0.00375241693 *** contribution from error: -0.545133829 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54418.0356 -0.0338439569 7.90045118 EXIT FROM BFGS code NEW_X -54418.0356 -0.0338439569 7.90045118 ENTER BFGS code NEW_X -54418.0356 -0.0338439569 7.90045118 EXIT FROM BFGS code FG_LNSRCH 0. -0.0418276601 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 61.9776459 sigma out 15 active outputs RANK 2 NODE 10 --> 37.6082802 sigma out 15 active outputs RANK 3 NODE 1 --> 35.9265137 sigma out 15 active outputs RANK 4 NODE 4 --> 35.8512535 sigma out 15 active outputs RANK 5 NODE 6 --> 28.2063732 sigma out 15 active outputs RANK 6 NODE 9 --> 24.0272865 sigma out 15 active outputs RANK 7 NODE 11 --> 24.0014744 sigma out 15 active outputs RANK 8 NODE 12 --> 23.3537731 sigma out 15 active outputs RANK 9 NODE 8 --> 22.8815689 sigma out 15 active outputs RANK 10 NODE 7 --> 19.6349239 sigma out 15 active outputs RANK 11 NODE 3 --> 18.7027531 sigma out 15 active outputs RANK 12 NODE 5 --> 16.0781517 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 58.7284355 sigma in 12act. ( 53.6557999 sig out 1act.) RANK 2 NODE 12 --> 46.6653709 sigma in 12act. ( 56.510601 sig out 1act.) RANK 3 NODE 11 --> 40.391655 sigma in 12act. ( 41.076519 sig out 1act.) RANK 4 NODE 15 --> 28.0139866 sigma in 12act. ( 26.1906815 sig out 1act.) RANK 5 NODE 6 --> 27.1720676 sigma in 12act. ( 31.1680298 sig out 1act.) RANK 6 NODE 5 --> 24.1947384 sigma in 12act. ( 23.1151886 sig out 1act.) RANK 7 NODE 10 --> 21.6622639 sigma in 12act. ( 20.5038109 sig out 1act.) RANK 8 NODE 7 --> 21.2851486 sigma in 12act. ( 22.8309383 sig out 1act.) RANK 9 NODE 14 --> 21.2210979 sigma in 12act. ( 16.4934216 sig out 1act.) RANK 10 NODE 3 --> 20.2415428 sigma in 12act. ( 20.9741783 sig out 1act.) RANK 11 NODE 1 --> 15.8088913 sigma in 12act. ( 16.2329502 sig out 1act.) RANK 12 NODE 2 --> 14.7826071 sigma in 12act. ( 13.0744667 sig out 1act.) RANK 13 NODE 8 --> 11.2693424 sigma in 12act. ( 11.5606194 sig out 1act.) RANK 14 NODE 9 --> 8.5572319 sigma in 12act. ( 8.33114433 sig out 1act.) RANK 15 NODE 13 --> 5.0709691 sigma in 12act. ( 4.76505804 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 56.510601 sigma out 1act.( 46.6653709 sig in 12act.) RANK 2 NODE 4 --> 53.6557999 sigma out 1act.( 58.7284355 sig in 12act.) RANK 3 NODE 11 --> 41.076519 sigma out 1act.( 40.391655 sig in 12act.) RANK 4 NODE 6 --> 31.1680298 sigma out 1act.( 27.1720676 sig in 12act.) RANK 5 NODE 15 --> 26.1906815 sigma out 1act.( 28.0139866 sig in 12act.) RANK 6 NODE 5 --> 23.1151886 sigma out 1act.( 24.1947384 sig in 12act.) RANK 7 NODE 7 --> 22.8309383 sigma out 1act.( 21.2851486 sig in 12act.) RANK 8 NODE 3 --> 20.9741783 sigma out 1act.( 20.2415428 sig in 12act.) RANK 9 NODE 10 --> 20.5038109 sigma out 1act.( 21.6622639 sig in 12act.) RANK 10 NODE 14 --> 16.4934216 sigma out 1act.( 21.2210979 sig in 12act.) RANK 11 NODE 1 --> 16.2329502 sigma out 1act.( 15.8088913 sig in 12act.) RANK 12 NODE 2 --> 13.0744667 sigma out 1act.( 14.7826071 sig in 12act.) RANK 13 NODE 8 --> 11.5606194 sigma out 1act.( 11.2693424 sig in 12act.) RANK 14 NODE 9 --> 8.33114433 sigma out 1act.( 8.5572319 sig in 12act.) RANK 15 NODE 13 --> 4.76505804 sigma out 1act.( 5.0709691 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 110.748375 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.542077363 *** contribution from regularisation: 0.0036668398 *** contribution from error: -0.545744181 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54487.9927 -0.0418276601 0.945690095 EXIT FROM BFGS code NEW_X -54487.9927 -0.0418276601 0.945690095 ENTER BFGS code NEW_X -54487.9927 -0.0418276601 0.945690095 EXIT FROM BFGS code FG_LNSRCH 0. -0.0417686291 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.542281389 *** contribution from regularisation: 0.00358140701 *** contribution from error: -0.545862794 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54508.4982 -0.0417686291 -11.2681503 EXIT FROM BFGS code NEW_X -54508.4982 -0.0417686291 -11.2681503 ENTER BFGS code NEW_X -54508.4982 -0.0417686291 -11.2681503 EXIT FROM BFGS code FG_LNSRCH 0. -0.0517664328 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.542457283 *** contribution from regularisation: 0.00363641372 *** contribution from error: -0.546093702 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54526.1773 -0.0517664328 9.35508156 EXIT FROM BFGS code NEW_X -54526.1773 -0.0517664328 9.35508156 ENTER BFGS code NEW_X -54526.1773 -0.0517664328 9.35508156 EXIT FROM BFGS code FG_LNSRCH 0. -0.0572327748 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.542705834 *** contribution from regularisation: 0.00364843197 *** contribution from error: -0.546354294 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54551.1626 -0.0572327748 -24.2016621 EXIT FROM BFGS code NEW_X -54551.1626 -0.0572327748 -24.2016621 ENTER BFGS code NEW_X -54551.1626 -0.0572327748 -24.2016621 EXIT FROM BFGS code FG_LNSRCH 0. -0.074219428 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.543183267 *** contribution from regularisation: 0.00371075748 *** contribution from error: -0.546894014 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54599.15 -0.074219428 -25.1144886 EXIT FROM BFGS code NEW_X -54599.15 -0.074219428 -25.1144886 ENTER BFGS code NEW_X -54599.15 -0.074219428 -25.1144886 EXIT FROM BFGS code FG_LNSRCH 0. -0.114148505 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.540687501 *** contribution from regularisation: 0.0038543446 *** contribution from error: -0.544541836 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54348.2885 -0.114148505 12.4638596 EXIT FROM BFGS code FG_LNSRCH 0. -0.0808531418 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.543504655 *** contribution from regularisation: 0.00355256465 *** contribution from error: -0.547057211 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54631.4549 -0.0808531418 -25.422575 EXIT FROM BFGS code NEW_X -54631.4549 -0.0808531418 -25.422575 ENTER BFGS code NEW_X -54631.4549 -0.0808531418 -25.422575 EXIT FROM BFGS code FG_LNSRCH 0. -0.0948417112 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.543575406 *** contribution from regularisation: 0.00373115996 *** contribution from error: -0.547306538 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54638.5686 -0.0948417112 15.0242653 EXIT FROM BFGS code NEW_X -54638.5686 -0.0948417112 15.0242653 ENTER BFGS code NEW_X -54638.5686 -0.0948417112 15.0242653 EXIT FROM BFGS code FG_LNSRCH 0. -0.0931993872 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.543756425 *** contribution from regularisation: 0.00363527308 *** contribution from error: -0.547391713 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54656.764 -0.0931993872 -6.14031124 EXIT FROM BFGS code NEW_X -54656.764 -0.0931993872 -6.14031124 ENTER BFGS code NEW_X -54656.764 -0.0931993872 -6.14031124 EXIT FROM BFGS code FG_LNSRCH 0. -0.0929340497 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.544074655 *** contribution from regularisation: 0.00349395163 *** contribution from error: -0.547568619 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54688.7491 -0.0929340497 -13.2945385 EXIT FROM BFGS code NEW_X -54688.7491 -0.0929340497 -13.2945385 ENTER BFGS code NEW_X -54688.7491 -0.0929340497 -13.2945385 EXIT FROM BFGS code FG_LNSRCH 0. -0.0994124413 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 77.9946594 sigma out 15 active outputs RANK 2 NODE 1 --> 45.6660995 sigma out 15 active outputs RANK 3 NODE 10 --> 43.0357132 sigma out 15 active outputs RANK 4 NODE 4 --> 40.4970322 sigma out 15 active outputs RANK 5 NODE 12 --> 36.2787094 sigma out 15 active outputs RANK 6 NODE 6 --> 29.7510529 sigma out 15 active outputs RANK 7 NODE 11 --> 29.615881 sigma out 15 active outputs RANK 8 NODE 8 --> 29.4026451 sigma out 15 active outputs RANK 9 NODE 9 --> 26.6414585 sigma out 15 active outputs RANK 10 NODE 3 --> 25.6030769 sigma out 15 active outputs RANK 11 NODE 7 --> 22.6861897 sigma out 15 active outputs RANK 12 NODE 5 --> 19.9053574 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 69.903595 sigma in 12act. ( 66.5267792 sig out 1act.) RANK 2 NODE 11 --> 59.0229378 sigma in 12act. ( 56.9589691 sig out 1act.) RANK 3 NODE 12 --> 57.2298355 sigma in 12act. ( 61.3291779 sig out 1act.) RANK 4 NODE 10 --> 31.4633484 sigma in 12act. ( 31.8729763 sig out 1act.) RANK 5 NODE 15 --> 31.1736317 sigma in 12act. ( 30.1165466 sig out 1act.) RANK 6 NODE 7 --> 29.3975658 sigma in 12act. ( 31.837471 sig out 1act.) RANK 7 NODE 6 --> 29.3622475 sigma in 12act. ( 37.3401337 sig out 1act.) RANK 8 NODE 3 --> 28.1530361 sigma in 12act. ( 29.2376461 sig out 1act.) RANK 9 NODE 5 --> 24.9544525 sigma in 12act. ( 24.4798641 sig out 1act.) RANK 10 NODE 14 --> 17.6808453 sigma in 12act. ( 14.6178417 sig out 1act.) RANK 11 NODE 1 --> 17.1086998 sigma in 12act. ( 17.3538303 sig out 1act.) RANK 12 NODE 8 --> 14.0027122 sigma in 12act. ( 15.2978954 sig out 1act.) RANK 13 NODE 2 --> 13.3870811 sigma in 12act. ( 12.6853886 sig out 1act.) RANK 14 NODE 9 --> 9.73178768 sigma in 12act. ( 9.62531376 sig out 1act.) RANK 15 NODE 13 --> 7.44947815 sigma in 12act. ( 7.81744576 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 66.5267792 sigma out 1act.( 69.903595 sig in 12act.) RANK 2 NODE 12 --> 61.3291779 sigma out 1act.( 57.2298355 sig in 12act.) RANK 3 NODE 11 --> 56.9589691 sigma out 1act.( 59.0229378 sig in 12act.) RANK 4 NODE 6 --> 37.3401337 sigma out 1act.( 29.3622475 sig in 12act.) RANK 5 NODE 10 --> 31.8729763 sigma out 1act.( 31.4633484 sig in 12act.) RANK 6 NODE 7 --> 31.837471 sigma out 1act.( 29.3975658 sig in 12act.) RANK 7 NODE 15 --> 30.1165466 sigma out 1act.( 31.1736317 sig in 12act.) RANK 8 NODE 3 --> 29.2376461 sigma out 1act.( 28.1530361 sig in 12act.) RANK 9 NODE 5 --> 24.4798641 sigma out 1act.( 24.9544525 sig in 12act.) RANK 10 NODE 1 --> 17.3538303 sigma out 1act.( 17.1086998 sig in 12act.) RANK 11 NODE 8 --> 15.2978954 sigma out 1act.( 14.0027122 sig in 12act.) RANK 12 NODE 14 --> 14.6178417 sigma out 1act.( 17.6808453 sig in 12act.) RANK 13 NODE 2 --> 12.6853886 sigma out 1act.( 13.3870811 sig in 12act.) RANK 14 NODE 9 --> 9.62531376 sigma out 1act.( 9.73178768 sig in 12act.) RANK 15 NODE 13 --> 7.81744576 sigma out 1act.( 7.44947815 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 135.203003 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.543652177 *** contribution from regularisation: 0.00343709206 *** contribution from error: -0.547089279 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54646.2879 -0.0994124413 -76.6096497 EXIT FROM BFGS code FG_LNSRCH 0. -0.0946905836 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.543786347 *** contribution from regularisation: 0.00387885654 *** contribution from error: -0.547665179 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54659.7696 -0.0946905836 -29.8004036 EXIT FROM BFGS code FG_LNSRCH 0. -0.0930844694 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.543853104 *** contribution from regularisation: 0.00372920092 *** contribution from error: -0.547582328 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54666.481 -0.0930844694 -14.6339579 EXIT FROM BFGS code FG_LNSRCH 0. -0.0929360315 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.543894053 *** contribution from regularisation: 0.00367469015 *** contribution from error: -0.547568738 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54670.598 -0.0929360315 -13.2362452 EXIT FROM BFGS code FG_LNSRCH 0. -0.0929340497 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.543895125 *** contribution from regularisation: 0.0036734473 *** contribution from error: -0.54756856 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54670.7067 -0.0929340497 -13.1959133 EXIT FROM BFGS code FG_LNSRCH 0. -0.0929340497 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.543890715 *** contribution from regularisation: 0.00367785827 *** contribution from error: -0.54756856 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54670.2633 -0.0929340497 -13.1841888 EXIT FROM BFGS code FG_LNSRCH 0. -0.0929340497 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.543896794 *** contribution from regularisation: 0.00367178442 *** contribution from error: -0.54756856 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54670.8738 -0.0929340497 -13.1752434 EXIT FROM BFGS code FG_LNSRCH 0. -0.0929340497 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.543901861 *** contribution from regularisation: 0.00366670359 *** contribution from error: -0.54756856 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54671.3846 -0.0929340497 -13.1552992 EXIT FROM BFGS code NEW_X -54671.3846 -0.0929340497 -13.1552992 ENTER BFGS code NEW_X -54671.3846 -0.0929340497 -13.1552992 EXIT FROM BFGS code CONVERGENC -54671.3846 -0.0929340497 -13.1552992 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 115.180305 sigma out 15 active outputs RANK 2 NODE 10 --> 69.722496 sigma out 15 active outputs RANK 3 NODE 1 --> 65.7005463 sigma out 15 active outputs RANK 4 NODE 4 --> 58.7560234 sigma out 15 active outputs RANK 5 NODE 12 --> 55.5665321 sigma out 15 active outputs RANK 6 NODE 6 --> 47.2061081 sigma out 15 active outputs RANK 7 NODE 11 --> 43.0261917 sigma out 15 active outputs RANK 8 NODE 8 --> 41.7922249 sigma out 15 active outputs RANK 9 NODE 9 --> 39.1444893 sigma out 15 active outputs RANK 10 NODE 3 --> 34.5847969 sigma out 15 active outputs RANK 11 NODE 7 --> 32.8365784 sigma out 15 active outputs RANK 12 NODE 5 --> 29.4008636 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 109.504051 sigma in 12act. ( 99.9827423 sig out 1act.) RANK 2 NODE 11 --> 83.4750824 sigma in 12act. ( 82.7748032 sig out 1act.) RANK 3 NODE 12 --> 82.6739578 sigma in 12act. ( 96.3473053 sig out 1act.) RANK 4 NODE 15 --> 48.4217911 sigma in 12act. ( 45.9293747 sig out 1act.) RANK 5 NODE 6 --> 44.1301994 sigma in 12act. ( 53.7444077 sig out 1act.) RANK 6 NODE 10 --> 43.7147102 sigma in 12act. ( 44.1855316 sig out 1act.) RANK 7 NODE 3 --> 42.3493385 sigma in 12act. ( 44.1375122 sig out 1act.) RANK 8 NODE 7 --> 41.6693115 sigma in 12act. ( 46.3835716 sig out 1act.) RANK 9 NODE 5 --> 37.3808136 sigma in 12act. ( 36.3213463 sig out 1act.) RANK 10 NODE 14 --> 27.5050297 sigma in 12act. ( 22.3869476 sig out 1act.) RANK 11 NODE 1 --> 25.9106064 sigma in 12act. ( 26.946209 sig out 1act.) RANK 12 NODE 2 --> 20.7138977 sigma in 12act. ( 20.1702595 sig out 1act.) RANK 13 NODE 8 --> 19.9538345 sigma in 12act. ( 22.2561131 sig out 1act.) RANK 14 NODE 9 --> 13.9438934 sigma in 12act. ( 14.3665514 sig out 1act.) RANK 15 NODE 13 --> 10.3690252 sigma in 12act. ( 10.8073006 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 99.9827423 sigma out 1act.( 109.504051 sig in 12act.) RANK 2 NODE 12 --> 96.3473053 sigma out 1act.( 82.6739578 sig in 12act.) RANK 3 NODE 11 --> 82.7748032 sigma out 1act.( 83.4750824 sig in 12act.) RANK 4 NODE 6 --> 53.7444077 sigma out 1act.( 44.1301994 sig in 12act.) RANK 5 NODE 7 --> 46.3835716 sigma out 1act.( 41.6693115 sig in 12act.) RANK 6 NODE 15 --> 45.9293747 sigma out 1act.( 48.4217911 sig in 12act.) RANK 7 NODE 10 --> 44.1855316 sigma out 1act.( 43.7147102 sig in 12act.) RANK 8 NODE 3 --> 44.1375122 sigma out 1act.( 42.3493385 sig in 12act.) RANK 9 NODE 5 --> 36.3213463 sigma out 1act.( 37.3808136 sig in 12act.) RANK 10 NODE 1 --> 26.946209 sigma out 1act.( 25.9106064 sig in 12act.) RANK 11 NODE 14 --> 22.3869476 sigma out 1act.( 27.5050297 sig in 12act.) RANK 12 NODE 8 --> 22.2561131 sigma out 1act.( 19.9538345 sig in 12act.) RANK 13 NODE 2 --> 20.1702595 sigma out 1act.( 20.7138977 sig in 12act.) RANK 14 NODE 9 --> 14.3665514 sigma out 1act.( 13.9438934 sig in 12act.) RANK 15 NODE 13 --> 10.8073006 sigma out 1act.( 10.3690252 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 202.36795 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.543897748 *** contribution from regularisation: 0.00367083563 *** contribution from error: -0.54756856 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29884 Closing output file done