NNInput NNInputs_150.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 190403 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 48698 nbkg = 141705 Bkg Entries: 141705 Sig Entries: 48698 Chosen entries: 48698 Signal fraction: 1 Background fraction: 0.343658 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 141705 Actual Signal Entries: 48698 Entries to split: 48698 Test with : 24349 Train with : 24349 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 48698 for Signal Prepared event 0 for Signal with 48698 events ====Entry 0 Variable Ht : 117.82 Variable LepAPt : 47.4738 Variable LepBPt : 12.5622 Variable MetSigLeptonsJets : 3.17918 Variable MetSpec : 29.8229 Variable SumEtLeptonsJets : 87.9972 Variable VSumJetLeptonsPt : 86.2262 Variable addEt : 89.8589 Variable dPhiLepSumMet : 2.58393 Variable dPhiLeptons : 0.475938 Variable dRLeptons : 0.613309 Variable lep1_E : 64.1505 Variable lep2_E : 22.7882 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2150 Ht = 117.82 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 47.4738 LepAPt = 47.4738 LepBEt = 12.5622 LepBPt = 12.5622 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 29.8229 MetDelPhi = 2.20584 MetSig = 2.18904 MetSigLeptonsJets = 3.17918 MetSpec = 29.8229 Mjj = 0 MostCentralJetEta = 0.309078 MtllMet = 98.8413 Njets = 1 SB = 0 SumEt = 185.606 SumEtJets = 0 SumEtLeptonsJets = 87.9972 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 86.2262 addEt = 89.8589 dPhiLepSumMet = 2.58393 dPhiLeptons = 0.475938 dRLeptons = 0.613309 diltype = 1 dimass = 14.9303 event = 29 jet1_Et = 27.9612 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 64.1504 lep2_E = 22.7882 rand = 0.999742 run = 167138 weight = 3.54438e-06 ===Show End Prepared event 10000 for Signal with 48698 events Prepared event 20000 for Signal with 48698 events Prepared event 30000 for Signal with 48698 events Prepared event 40000 for Signal with 48698 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 141705 for Background Prepared event 0 for Background with 141705 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.276904 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 141705 events Prepared event 20000 for Background with 141705 events Prepared event 30000 for Background with 141705 events Prepared event 40000 for Background with 141705 events Prepared event 50000 for Background with 141705 events Prepared event 60000 for Background with 141705 events Prepared event 70000 for Background with 141705 events Prepared event 80000 for Background with 141705 events Prepared event 90000 for Background with 141705 events Prepared event 100000 for Background with 141705 events Prepared event 110000 for Background with 141705 events Prepared event 120000 for Background with 141705 events Prepared event 130000 for Background with 141705 events Prepared event 140000 for Background with 141705 events Warning: found 4500 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 190403 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4500 negative weights. Signal fraction: 63.3509445 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 62.283844 64.6791687 66.4043274 67.9214783 68.8223419 69.8001633 70.7014313 71.6187439 72.4570007 73.2617798 73.9556885 74.5106659 75.2757339 76.019516 76.7068024 77.2893524 77.9999084 78.5822754 79.2737427 79.8804626 80.6638947 81.531662 82.1891479 82.8581848 83.5592651 84.4541168 85.3853226 86.2340088 87.25383 88.5266266 89.3824768 90.7840576 92.1634979 93.5270386 94.9459686 96.3227997 97.6560745 98.9860611 100.182571 101.475357 102.735428 104.211731 105.52095 106.837555 108.30706 109.779259 111.042313 112.393997 113.769562 115.105316 116.760864 118.137924 119.489815 120.925583 122.283867 123.671066 125.041855 126.423874 127.688347 128.842316 130.074509 131.383331 132.602722 133.782043 135.180786 136.493362 137.875 139.190216 140.512222 141.952271 143.350769 144.825775 146.269165 147.843552 149.454193 151.057953 152.961014 154.782532 157.208664 159.683838 162.090897 164.407532 166.720825 169.495789 172.395782 175.418762 178.784119 182.237564 185.868774 190.132751 194.564804 199.509155 205.110886 211.62616 220.557938 231.241989 244.419449 265.123962 300.940704 836.977722 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3113708 20.5981178 20.8981285 21.1316738 21.4015465 21.5874977 21.8467789 22.0601254 22.2843647 22.4899025 22.6967621 22.8649063 23.0728798 23.295742 23.5165024 23.7348328 23.9384193 24.1501465 24.3847828 24.5617218 24.7607822 24.9669914 25.1446438 25.3230743 25.5124645 25.6925011 25.8838577 26.0791016 26.2958946 26.5158768 26.7362518 26.9591942 27.1477432 27.3744011 27.6339893 27.8495216 28.0681381 28.2637482 28.5120106 28.6925392 28.9458427 29.1674099 29.3885689 29.6406593 29.8118591 30.0463295 30.293026 30.5539379 30.8219166 31.0950928 31.3708153 31.6141701 31.8919945 32.1434326 32.406208 32.6959152 32.9585114 33.2031136 33.4485664 33.7385902 34.0305443 34.3066444 34.5994034 34.9212646 35.2165375 35.5094452 35.8380318 36.137928 36.4298935 36.7450714 37.097229 37.4562721 37.8023834 38.1801376 38.5232277 38.8984451 39.2884521 39.6774597 40.0617943 40.478363 40.9387283 41.4205627 41.9210052 42.4609604 43.0186615 43.6236877 44.2878761 44.9917679 45.7550621 46.6665955 47.7093315 48.806488 49.9119186 51.307106 53.095787 55.0266571 58.0818405 62.2413254 70.2645721 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.111824 10.2218075 10.3311348 10.4583626 10.5787363 10.7199593 10.8425293 10.9525738 11.0651588 11.2113743 11.3354349 11.4813099 11.6136303 11.7559462 11.9090023 12.0525932 12.207798 12.3601828 12.5127459 12.6540833 12.7964535 12.9430189 13.0842667 13.2621918 13.4415617 13.6116762 13.7790337 13.9409676 14.1305304 14.3068495 14.479311 14.69205 14.8785076 15.0610085 15.2809563 15.4343042 15.6245022 15.8278236 16.0370846 16.2730522 16.4628639 16.6777725 16.882843 17.1114368 17.3072319 17.5616264 17.7789497 18.0087433 18.2493687 18.4914799 18.7602596 19.0044136 19.2449398 19.4718151 19.7414703 20.0159054 20.2447147 20.461153 20.7037277 20.9594097 21.1959457 21.4406471 21.6888103 21.916132 22.1618958 22.4320793 22.6824493 22.9488869 23.2271423 23.5200596 23.8028736 24.0816116 24.3807068 24.726511 25.053381 25.390976 25.7301712 26.0613785 26.4072037 26.7394066 27.0938606 27.4702759 27.83358 28.2146111 28.5949402 28.9832478 29.457077 29.9049702 30.3827362 30.9273872 31.5092373 32.1259079 32.7572746 33.5163574 34.4524994 35.5934677 37.1061363 39.6695557 43.6755905 72.9396591 ------------------------------ Transdef: Tab for variable 5 1.04656506 2.53537893 2.93501616 3.19116354 3.43023825 3.66087675 3.83066177 3.99072814 4.12207985 4.24367332 4.36106205 4.45761538 4.55862284 4.65029335 4.74828339 4.83279228 4.91478634 4.98974228 5.05959558 5.12433338 5.18251371 5.24830627 5.2991581 5.35431767 5.40648079 5.46116447 5.5173111 5.56286383 5.61414719 5.66277885 5.71583843 5.76592636 5.81180763 5.85209942 5.89916992 5.94654369 5.99317646 6.03278637 6.07821465 6.12616158 6.17455101 6.21832895 6.26604605 6.3036232 6.34733963 6.3836956 6.42798996 6.47273779 6.51707363 6.558074 6.60799408 6.65126038 6.70205688 6.7441411 6.78703594 6.827981 6.8681078 6.90990353 6.96230221 6.99780893 7.04987621 7.10187531 7.1514225 7.19768047 7.24355125 7.28969955 7.34543514 7.39671421 7.44139147 7.49518681 7.54483986 7.60072136 7.65994263 7.71692514 7.77081633 7.83245707 7.89282799 7.94513798 7.9989996 8.06323814 8.12498951 8.1824646 8.25030136 8.3214016 8.39336681 8.46156883 8.54315376 8.62170029 8.70407009 8.78283024 8.87615776 8.98964787 9.11108208 9.23266888 9.38546944 9.56162262 9.77662659 10.0777893 10.4663486 11.1065331 18.8802528 ------------------------------ Transdef: Tab for variable 6 15.0001631 19.8550034 24.171627 25.7804604 26.6828041 27.5142937 28.278801 29.0574036 29.8472252 30.5356636 31.1163445 31.5990601 32.1767731 32.6911392 33.1396523 33.611393 34.0945396 34.619751 34.9866257 35.3730507 35.7773666 36.1472359 36.5233917 36.9092445 37.2442551 37.5715179 37.8859406 38.2784271 38.6259155 38.9494705 39.3149185 39.642868 40.0710869 40.4155922 40.8113403 41.2209625 41.6422844 42.0611382 42.4601288 42.9019852 43.3179131 43.8203392 44.237957 44.7525024 45.2837906 45.8404694 46.4048233 46.9789886 47.5439453 48.1502304 48.8164215 49.3607941 49.9117508 50.4549904 51.0583076 51.7234154 52.369175 53.0597191 53.710247 54.2903519 54.8987923 55.5369186 56.239994 56.8533173 57.5299835 58.2389145 58.9000092 59.6382675 60.3009224 61.0164871 61.7156105 62.4306183 63.1338577 63.862175 64.56604 65.3479462 66.0354767 66.7670288 67.5158386 68.2309113 68.9383621 69.6372375 70.4075775 71.2792358 72.1113281 72.9918137 73.9058228 74.9325409 76.0554047 77.2134552 78.5747833 80.0708313 81.8251648 83.6625977 85.9625092 88.9832458 92.8229523 97.8804321 104.301407 116.157974 232.877182 ------------------------------ Transdef: Tab for variable 7 30.1677856 32.4679184 33.4668007 34.0992432 34.7378807 35.3031693 35.7637024 36.1233826 36.5138359 36.9505844 37.3900032 37.7440491 38.0911026 38.4324837 38.7533875 39.0617447 39.2732735 39.5596809 39.8994598 40.2409172 40.5351906 40.8995132 41.2085419 41.5664444 41.9158249 42.3343925 42.7819214 43.3772354 44.0332565 44.6453552 45.1500931 45.7698822 46.4273605 47.0718956 47.8250504 48.524807 49.3236237 50.2818298 51.0969963 51.9949799 52.8631134 53.6176949 54.4963684 55.33815 56.0479355 56.8641129 57.6106186 58.3799667 59.1855888 59.9520378 60.7189255 61.5145493 62.2871628 63.075325 63.8189926 64.5605164 65.2792358 65.9894943 66.7336273 67.4940796 68.2888947 69.1598206 70.0310516 70.9021301 71.7497101 72.660202 73.5607224 74.5892868 75.7415466 76.8624115 78.1971283 79.5753479 81.0367126 82.5495758 83.9328461 85.3813934 87.0020523 88.7406158 90.4512711 92.1886292 93.8574829 95.6501236 97.4649963 99.6526337 101.765991 104.189323 106.737343 109.388519 112.649323 115.739716 119.15963 123.119949 127.43988 132.750061 138.294022 145.348724 154.788177 167.54071 182.721695 208.476929 482.486786 ------------------------------ Transdef: Tab for variable 8 1.50532949 23.1285057 27.9028111 29.8408775 31.1350422 31.9219284 32.6244431 33.1398582 33.6968613 34.1002655 34.4851074 34.9084778 35.2375488 35.5988655 35.9685211 36.300148 36.5914383 36.9242325 37.2327385 37.4971695 37.7797623 38.0789642 38.3316345 38.5946655 38.8613663 39.0895538 39.3395805 39.6629829 39.9508171 40.2314644 40.5083199 40.8412933 41.1771126 41.4843979 41.8514786 42.1923294 42.6571045 43.1525345 43.583622 43.9943466 44.4070282 44.8861618 45.29216 45.7615738 46.29142 46.7638779 47.3359375 47.8989792 48.4849396 49.0527954 49.5806084 50.1326141 50.7523193 51.3028793 51.9282227 52.5752487 53.2085152 53.8118744 54.3958511 54.9714279 55.5272522 56.1744881 56.8046494 57.4561081 58.0538025 58.634697 59.2431946 59.8410835 60.4548836 61.1018524 61.7190094 62.341835 63.0228462 63.6696968 64.2815857 64.8712769 65.512207 66.1459198 66.7645493 67.4625549 68.2466888 68.9292908 69.6982269 70.4936371 71.3167419 72.1166229 73.0593109 74.0765686 75.2812195 76.5327759 78.036232 79.5935211 81.4387207 83.4596252 86.2501373 89.4934845 93.4598694 98.6091309 105.660355 117.932968 349.597076 ------------------------------ Transdef: Tab for variable 9 47.1748543 61.7146606 63.7952805 65.6957092 67.0483551 68.090271 68.888092 69.7387161 70.4629517 71.3317413 71.9900818 72.7872696 73.4299164 73.957016 74.4966431 75.1509171 75.8154678 76.4407654 76.9592972 77.49263 78.086174 78.5839233 79.1880264 79.7041321 80.3459167 81.0538177 81.6676788 82.2084198 82.7518158 83.3825073 83.9840775 84.7588348 85.5128708 86.2457809 87.0592575 88.0635529 88.7687454 89.6460419 90.5669327 91.7658157 92.7593536 93.6712341 94.8175812 95.9514771 97.0147705 98.2179871 99.2489014 100.351196 101.557602 102.59227 103.681305 104.809311 105.874352 107.061478 108.24485 109.372231 110.507294 111.51976 112.635971 113.716858 114.777451 115.937698 117.088638 118.163239 119.220764 120.371284 121.433075 122.534821 123.631531 124.6586 125.649521 126.73642 127.732674 128.627594 129.695953 130.692352 131.67099 132.601547 133.550751 134.605835 135.761078 136.792557 137.871506 138.916153 140.015137 141.159302 142.326385 143.47789 144.712769 145.860016 147.20462 148.70343 150.152328 151.832886 153.975189 156.446381 159.946564 164.661392 172.903137 191.496643 425.772034 ------------------------------ Transdef: Tab for variable 10 0.0397654139 1.05686164 1.34938884 1.56396484 1.70802391 1.83296371 1.93379617 2.02442908 2.09094381 2.15217972 2.21293068 2.26397157 2.31641817 2.3597064 2.40124321 2.439744 2.4757762 2.5039382 2.53243732 2.56176376 2.58659816 2.61197424 2.63472223 2.65890098 2.67946243 2.7024045 2.72279024 2.74104357 2.75734782 2.77353024 2.78768706 2.80132365 2.81604624 2.8272748 2.8390193 2.84923458 2.86111164 2.87123108 2.88054729 2.89085674 2.90034008 2.91026497 2.91761017 2.9259181 2.93347025 2.94110394 2.94834614 2.95474243 2.96058202 2.96801662 2.9743824 2.97996449 2.98509741 2.98992538 2.99490571 3.00035095 3.00582075 3.01077223 3.01481724 3.01967669 3.02444053 3.02845526 3.03236604 3.03621674 3.04037666 3.04389 3.04756689 3.05103683 3.05442047 3.0579958 3.06130123 3.06444597 3.06803036 3.07116795 3.07460642 3.07744789 3.08067369 3.08350134 3.08607864 3.08894467 3.09225368 3.0946908 3.0972476 3.10040712 3.10335064 3.10532284 3.10815024 3.11071467 3.11354637 3.11595678 3.1180172 3.12042189 3.12303519 3.12520361 3.12760878 3.1298275 3.13198233 3.13385916 3.13655615 3.1390624 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.71661377E-05 0.00615137815 0.0114404298 0.0179824941 0.0241239667 0.0303750038 0.0376372337 0.046030283 0.0535455942 0.0607780814 0.0688377619 0.0765328407 0.0836267471 0.0914655924 0.0994696617 0.106828451 0.113867104 0.120775044 0.127989888 0.135248095 0.143213868 0.149385452 0.156886682 0.163189709 0.16939497 0.175724745 0.182311684 0.188922167 0.195443153 0.201832294 0.20694989 0.212494254 0.218227357 0.224199831 0.229597867 0.234412193 0.240147114 0.2458148 0.251984954 0.257006288 0.262153447 0.267474651 0.273318172 0.278901488 0.284522474 0.290075302 0.295238495 0.300299168 0.305130124 0.310323834 0.316003919 0.320913911 0.326363295 0.332190394 0.337706536 0.343399644 0.349131167 0.354970813 0.360299408 0.365874887 0.371685982 0.37739253 0.383643508 0.389792085 0.395333648 0.400330782 0.406836271 0.413477838 0.419150591 0.425605536 0.431643993 0.437439203 0.44355005 0.448883921 0.45560205 0.462357998 0.46982193 0.475819588 0.482856154 0.492361903 0.500792265 0.509525537 0.517427683 0.525162816 0.53441453 0.544138551 0.552355707 0.564858377 0.576011777 0.586729288 0.598976851 0.615021884 0.63193655 0.644220471 0.66353178 0.686121702 0.712426662 0.742034912 0.78386724 0.843769073 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.215182722 0.227679774 0.238145232 0.248749912 0.257750273 0.266283214 0.273951381 0.281594932 0.288599133 0.295688987 0.302856743 0.309759915 0.31624943 0.322214574 0.328890443 0.334911466 0.341286927 0.346731186 0.352315784 0.35841918 0.363485336 0.369170249 0.374333948 0.379176497 0.384976387 0.390541077 0.39559269 0.400394619 0.404634714 0.409205824 0.413045853 0.416559041 0.420199692 0.423960656 0.427301228 0.431379497 0.434961051 0.438126683 0.441962719 0.445374578 0.448513478 0.452517956 0.45642066 0.460227787 0.463908136 0.467773199 0.471400857 0.475729108 0.479129195 0.482850999 0.486373782 0.490217119 0.494320929 0.498510629 0.502943695 0.507860899 0.512006819 0.516595721 0.520801902 0.524788439 0.529563308 0.534427643 0.539350629 0.544590771 0.550205052 0.55500555 0.56009537 0.565033495 0.569907665 0.575235784 0.579997063 0.585665882 0.59128958 0.596926808 0.603251696 0.610767245 0.617013454 0.623120248 0.629567981 0.636508822 0.644541621 0.651676476 0.660016835 0.666884542 0.674304247 0.68335551 0.694568515 0.704347551 0.715203762 0.727066517 0.738382578 0.751188517 0.763155401 0.779477715 0.796477199 0.817492187 0.840702355 0.873431742 0.91994226 1.14129901 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3967152 22.231163 22.762207 23.342598 23.8869171 24.460659 24.8853951 25.2606926 25.6347427 26.0329666 26.4540024 26.8571625 27.2482643 27.5722733 27.9861259 28.2958202 28.6680851 29.0099907 29.3220024 29.6659775 29.9952641 30.3118839 30.5956097 30.9059124 31.1627102 31.4978676 31.7955589 32.1411285 32.4235458 32.7877731 33.1162262 33.4427681 33.7791214 34.1204338 34.4954987 34.8134613 35.1165543 35.4471893 35.7707825 36.0655975 36.3225174 36.6822891 37.0177689 37.3453102 37.698288 38.0485191 38.4165726 38.7239494 39.085762 39.4699478 39.802166 40.135025 40.5043564 40.8627396 41.2779999 41.6654854 42.0667496 42.4845734 42.8739815 43.27285 43.6584167 44.0763931 44.5440216 45.013092 45.4591751 45.9546204 46.4302063 47.0055428 47.5190468 48.0071945 48.5865173 49.1736259 49.7452469 50.3854752 51.023201 51.7233849 52.3580742 53.1688232 53.9270401 54.7410736 55.502079 56.3811417 57.3153191 58.3237991 59.4889488 60.6166534 61.8359146 63.175663 64.6657639 66.4581604 68.1412964 70.0509644 72.3405075 75.0381622 77.4670715 80.9015198 85.4459152 91.4157715 101.14563 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6391287 11.04883 11.3635035 11.7578745 12.1750259 12.4794159 12.82549 13.1596813 13.4507971 13.7124748 13.9964752 14.3023071 14.5686588 14.8624153 15.1843481 15.464798 15.7195024 16.0042725 16.2930069 16.5920258 16.8596439 17.1490479 17.4177742 17.6575184 17.8845081 18.1644478 18.4172287 18.659996 18.9710846 19.1734695 19.4482002 19.7398186 20.0027905 20.2698631 20.5581532 20.7986221 21.0636101 21.2959328 21.5435371 21.809288 22.0523415 22.3430557 22.621788 22.9008598 23.173851 23.405077 23.6862793 23.9690399 24.218338 24.497942 24.7881813 25.0570297 25.3729706 25.66922 25.9548912 26.2671089 26.5296059 26.8366432 27.1305199 27.4557343 27.7277031 28.0228844 28.3177032 28.6236954 28.9314003 29.2470512 29.5655785 29.8655586 30.2142029 30.5463371 30.9217529 31.2696457 31.5895481 31.9463806 32.389267 32.829361 33.240036 33.6428452 34.0921173 34.5689087 35.0094757 35.5299911 36.0951309 36.6226578 37.2002525 37.7910461 38.4901047 39.2668076 40.1296005 41.0258484 42.0669403 43.0936813 44.310997 45.7817192 47.5161514 49.7269974 52.644043 56.5765457 63.5825424 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 63.9 45.2 51.7 25.8 46.1 60.9 51.6 61.3 -27.7 -15.8 -36.3 9.2 22.2 2 63.9 100.0 64.8 59.9 30.9 66.3 94.4 72.0 90.8 -46.3 -23.9 -49.6 28.6 32.1 3 45.2 64.8 100.0 43.1 5.8 31.5 67.8 50.9 70.3 -16.3 -25.6 -54.5 62.4 22.6 4 51.7 59.9 43.1 100.0 14.6 36.5 60.1 51.2 66.0 -13.3 -29.1 -61.2 17.1 70.5 5 25.8 30.9 5.8 14.6 100.0 83.8 2.7 55.3 55.2 26.3 -5.6 -9.1 -7.1 3.2 6 46.1 66.3 31.5 36.5 83.8 100.0 44.2 77.8 79.3 -4.4 -13.7 -27.8 7.1 16.9 7 60.9 94.4 67.8 60.1 2.7 44.2 100.0 62.8 78.4 -54.8 -23.2 -49.8 33.3 34.0 8 51.6 72.0 50.9 51.2 55.3 77.8 62.8 100.0 82.0 -9.2 -22.5 -42.5 21.7 28.8 9 61.3 90.8 70.3 66.0 55.2 79.3 78.4 82.0 100.0 -20.4 -26.6 -55.4 33.3 37.7 10 -27.7 -46.3 -16.3 -13.3 26.3 -4.4 -54.8 -9.2 -20.4 100.0 3.7 9.7 -5.2 -4.6 11 -15.8 -23.9 -25.6 -29.1 -5.6 -13.7 -23.2 -22.5 -26.6 3.7 100.0 53.7 -10.4 -18.5 12 -36.3 -49.6 -54.5 -61.2 -9.1 -27.8 -49.8 -42.5 -55.4 9.7 53.7 100.0 -26.1 -36.3 13 9.2 28.6 62.4 17.1 -7.1 7.1 33.3 21.7 33.3 -5.2 -10.4 -26.1 100.0 46.0 14 22.2 32.1 22.6 70.5 3.2 16.9 34.0 28.8 37.7 -4.6 -18.5 -36.3 46.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 156.947298 TOTAL CORRELATION OF ALL VARIABLES 70.2461507 ROUND 1: MAX CORR ( 70.2395862) AFTER KILLING INPUT VARIABLE 6 CONTR 0.960326012 ROUND 2: MAX CORR ( 70.2164961) AFTER KILLING INPUT VARIABLE 11 CONTR 1.80087382 ROUND 3: MAX CORR ( 70.1764595) AFTER KILLING INPUT VARIABLE 8 CONTR 2.37083355 ROUND 4: MAX CORR ( 70.1102652) AFTER KILLING INPUT VARIABLE 14 CONTR 3.04732467 ROUND 5: MAX CORR ( 70.0359775) AFTER KILLING INPUT VARIABLE 2 CONTR 3.22663039 ROUND 6: MAX CORR ( 69.9411132) AFTER KILLING INPUT VARIABLE 12 CONTR 3.64401192 ROUND 7: MAX CORR ( 69.578406) AFTER KILLING INPUT VARIABLE 10 CONTR 7.11370022 ROUND 8: MAX CORR ( 68.7865596) AFTER KILLING INPUT VARIABLE 9 CONTR 10.467273 ROUND 9: MAX CORR ( 67.8878342) AFTER KILLING INPUT VARIABLE 3 CONTR 11.0829939 ROUND 10: MAX CORR ( 67.236808) AFTER KILLING INPUT VARIABLE 13 CONTR 9.37921523 ROUND 11: MAX CORR ( 65.4879412) AFTER KILLING INPUT VARIABLE 4 CONTR 15.2354162 ROUND 12: MAX CORR ( 60.8704095) AFTER KILLING INPUT VARIABLE 5 CONTR 24.1549931 LAST REMAINING VARIABLE: 7 total correlation to target: 70.2461507 % total significance: 138.137407 sigma correlations of single variables to target: variable 2: 63.8678195 % , in sigma: 125.594568 variable 3: 45.1930792 % , in sigma: 88.8711295 variable 4: 51.7082826 % , in sigma: 101.683124 variable 5: 25.8027916 % , in sigma: 50.740584 variable 6: 46.1004258 % , in sigma: 90.6554053 variable 7: 60.8704095 % , in sigma: 119.700232 variable 8: 51.6176574 % , in sigma: 101.504912 variable 9: 61.3281647 % , in sigma: 120.600396 variable 10: -27.6875925 % , in sigma: 54.4470008 variable 11: -15.8171223 % , in sigma: 31.1039998 variable 12: -36.3297602 % , in sigma: 71.4416207 variable 13: 9.15213785 % , in sigma: 17.9974643 variable 14: 22.2493041 % , in sigma: 43.7527342 variables sorted by significance: 1 most relevant variable 7 corr 60.8704109 , in sigma: 119.700234 2 most relevant variable 5 corr 24.1549931 , in sigma: 47.5002269 3 most relevant variable 4 corr 15.2354164 , in sigma: 29.9600888 4 most relevant variable 13 corr 9.37921524 , in sigma: 18.4440066 5 most relevant variable 3 corr 11.0829935 , in sigma: 21.7944466 6 most relevant variable 9 corr 10.4672728 , in sigma: 20.5836462 7 most relevant variable 10 corr 7.11370039 , in sigma: 13.9889249 8 most relevant variable 12 corr 3.64401197 , in sigma: 7.16586402 9 most relevant variable 2 corr 3.22663045 , in sigma: 6.34509305 10 most relevant variable 14 corr 3.04732466 , in sigma: 5.99249242 11 most relevant variable 8 corr 2.37083364 , in sigma: 4.6621887 12 most relevant variable 11 corr 1.80087388 , in sigma: 3.54137621 13 most relevant variable 6 corr 0.960326016 , in sigma: 1.88845857 global correlations between input variables: variable 2: 99.2158079 % variable 3: 92.6830752 % variable 4: 91.8706717 % variable 5: 95.4867393 % variable 6: 94.9227022 % variable 7: 98.8302788 % variable 8: 88.6019283 % variable 9: 98.7754947 % variable 10: 72.1695994 % variable 11: 54.7473271 % variable 12: 76.6761254 % variable 13: 84.6458309 % variable 14: 87.4386387 % significance loss when removing single variables: variable 2: corr = 4.00828487 % , sigma = 7.88219813 variable 3: corr = 14.2807739 % , sigma = 28.0828068 variable 4: corr = 15.972285 % , sigma = 31.4091236 variable 5: corr = 13.6731851 % , sigma = 26.8879976 variable 6: corr = 0.960326012 % , sigma = 1.88845856 variable 7: corr = 5.24922105 % , sigma = 10.32247 variable 8: corr = 2.64435732 % , sigma = 5.20006661 variable 9: corr = 10.6171465 % , sigma = 20.8783694 variable 10: corr = 6.54202809 % , sigma = 12.8647447 variable 11: corr = 1.83561154 % , sigma = 3.60968701 variable 12: corr = 2.73044164 % , sigma = 5.36934941 variable 13: corr = 7.22946505 % , sigma = 14.2165733 variable 14: corr = 2.9429111 % , sigma = 5.78716561 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 23.9789314 sigma out 15 active outputs RANK 2 NODE 8 --> 18.410368 sigma out 15 active outputs RANK 3 NODE 10 --> 17.0483971 sigma out 15 active outputs RANK 4 NODE 9 --> 16.5928497 sigma out 15 active outputs RANK 5 NODE 6 --> 15.9307032 sigma out 15 active outputs RANK 6 NODE 11 --> 13.2643957 sigma out 15 active outputs RANK 7 NODE 7 --> 13.162838 sigma out 15 active outputs RANK 8 NODE 2 --> 13.0195141 sigma out 15 active outputs RANK 9 NODE 1 --> 12.4117317 sigma out 15 active outputs RANK 10 NODE 12 --> 12.2080097 sigma out 15 active outputs RANK 11 NODE 4 --> 12.115695 sigma out 15 active outputs RANK 12 NODE 3 --> 9.56672382 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 30.5670338 sigma in 12act. ( 32.5797234 sig out 1act.) RANK 2 NODE 6 --> 21.2194252 sigma in 12act. ( 24.1389217 sig out 1act.) RANK 3 NODE 14 --> 15.201685 sigma in 12act. ( 13.0248375 sig out 1act.) RANK 4 NODE 5 --> 14.6101217 sigma in 12act. ( 14.7989407 sig out 1act.) RANK 5 NODE 4 --> 13.460063 sigma in 12act. ( 11.5640173 sig out 1act.) RANK 6 NODE 15 --> 13.4077759 sigma in 12act. ( 13.2651606 sig out 1act.) RANK 7 NODE 10 --> 11.8428278 sigma in 12act. ( 10.3120413 sig out 1act.) RANK 8 NODE 2 --> 11.5429831 sigma in 12act. ( 7.26790237 sig out 1act.) RANK 9 NODE 13 --> 10.9777517 sigma in 12act. ( 12.1590662 sig out 1act.) RANK 10 NODE 8 --> 10.8397331 sigma in 12act. ( 11.726408 sig out 1act.) RANK 11 NODE 7 --> 6.76026773 sigma in 12act. ( 9.3835783 sig out 1act.) RANK 12 NODE 9 --> 4.30663729 sigma in 12act. ( 4.14586782 sig out 1act.) RANK 13 NODE 11 --> 3.39715171 sigma in 12act. ( 6.04009533 sig out 1act.) RANK 14 NODE 12 --> 3.07285404 sigma in 12act. ( 1.80013132 sig out 1act.) RANK 15 NODE 3 --> 2.63974571 sigma in 12act. ( 3.31892729 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 32.5797234 sigma out 1act.( 30.5670338 sig in 12act.) RANK 2 NODE 6 --> 24.1389217 sigma out 1act.( 21.2194252 sig in 12act.) RANK 3 NODE 5 --> 14.7989407 sigma out 1act.( 14.6101217 sig in 12act.) RANK 4 NODE 15 --> 13.2651606 sigma out 1act.( 13.4077759 sig in 12act.) RANK 5 NODE 14 --> 13.0248375 sigma out 1act.( 15.201685 sig in 12act.) RANK 6 NODE 13 --> 12.1590662 sigma out 1act.( 10.9777517 sig in 12act.) RANK 7 NODE 8 --> 11.726408 sigma out 1act.( 10.8397331 sig in 12act.) RANK 8 NODE 4 --> 11.5640173 sigma out 1act.( 13.460063 sig in 12act.) RANK 9 NODE 10 --> 10.3120413 sigma out 1act.( 11.8428278 sig in 12act.) RANK 10 NODE 7 --> 9.3835783 sigma out 1act.( 6.76026773 sig in 12act.) RANK 11 NODE 2 --> 7.26790237 sigma out 1act.( 11.5429831 sig in 12act.) RANK 12 NODE 11 --> 6.04009533 sigma out 1act.( 3.39715171 sig in 12act.) RANK 13 NODE 9 --> 4.14586782 sigma out 1act.( 4.30663729 sig in 12act.) RANK 14 NODE 3 --> 3.31892729 sigma out 1act.( 2.63974571 sig in 12act.) RANK 15 NODE 12 --> 1.80013132 sigma out 1act.( 3.07285404 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.2490768 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 23.9092903 sigma out 15 active outputs RANK 2 NODE 2 --> 21.9076195 sigma out 15 active outputs RANK 3 NODE 8 --> 19.347683 sigma out 15 active outputs RANK 4 NODE 10 --> 18.0618172 sigma out 15 active outputs RANK 5 NODE 9 --> 16.1712112 sigma out 15 active outputs RANK 6 NODE 6 --> 15.9741583 sigma out 15 active outputs RANK 7 NODE 11 --> 15.2028084 sigma out 15 active outputs RANK 8 NODE 1 --> 13.4102173 sigma out 15 active outputs RANK 9 NODE 7 --> 13.1254492 sigma out 15 active outputs RANK 10 NODE 4 --> 12.354682 sigma out 15 active outputs RANK 11 NODE 12 --> 12.2938347 sigma out 15 active outputs RANK 12 NODE 3 --> 10.2633944 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 30.0497055 sigma in 12act. ( 30.7442055 sig out 1act.) RANK 2 NODE 6 --> 23.0360851 sigma in 12act. ( 22.8518105 sig out 1act.) RANK 3 NODE 11 --> 14.4995041 sigma in 12act. ( 9.63085938 sig out 1act.) RANK 4 NODE 5 --> 14.2497606 sigma in 12act. ( 13.65903 sig out 1act.) RANK 5 NODE 7 --> 13.9410286 sigma in 12act. ( 10.7503471 sig out 1act.) RANK 6 NODE 13 --> 13.1805983 sigma in 12act. ( 11.7519779 sig out 1act.) RANK 7 NODE 15 --> 12.6712427 sigma in 12act. ( 12.3052063 sig out 1act.) RANK 8 NODE 8 --> 12.219779 sigma in 12act. ( 11.9117374 sig out 1act.) RANK 9 NODE 4 --> 11.9232845 sigma in 12act. ( 9.81033993 sig out 1act.) RANK 10 NODE 14 --> 11.7539291 sigma in 12act. ( 10.803422 sig out 1act.) RANK 11 NODE 10 --> 11.1550207 sigma in 12act. ( 8.99530506 sig out 1act.) RANK 12 NODE 9 --> 9.30166245 sigma in 12act. ( 4.40029669 sig out 1act.) RANK 13 NODE 2 --> 9.29727459 sigma in 12act. ( 5.63101149 sig out 1act.) RANK 14 NODE 3 --> 9.2779665 sigma in 12act. ( 4.61683369 sig out 1act.) RANK 15 NODE 12 --> 8.5144701 sigma in 12act. ( 4.08309269 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 30.7442055 sigma out 1act.( 30.0497055 sig in 12act.) RANK 2 NODE 6 --> 22.8518105 sigma out 1act.( 23.0360851 sig in 12act.) RANK 3 NODE 5 --> 13.65903 sigma out 1act.( 14.2497606 sig in 12act.) RANK 4 NODE 15 --> 12.3052063 sigma out 1act.( 12.6712427 sig in 12act.) RANK 5 NODE 8 --> 11.9117374 sigma out 1act.( 12.219779 sig in 12act.) RANK 6 NODE 13 --> 11.7519779 sigma out 1act.( 13.1805983 sig in 12act.) RANK 7 NODE 14 --> 10.803422 sigma out 1act.( 11.7539291 sig in 12act.) RANK 8 NODE 7 --> 10.7503471 sigma out 1act.( 13.9410286 sig in 12act.) RANK 9 NODE 4 --> 9.81033993 sigma out 1act.( 11.9232845 sig in 12act.) RANK 10 NODE 11 --> 9.63085938 sigma out 1act.( 14.4995041 sig in 12act.) RANK 11 NODE 10 --> 8.99530506 sigma out 1act.( 11.1550207 sig in 12act.) RANK 12 NODE 2 --> 5.63101149 sigma out 1act.( 9.29727459 sig in 12act.) RANK 13 NODE 3 --> 4.61683369 sigma out 1act.( 9.2779665 sig in 12act.) RANK 14 NODE 9 --> 4.40029669 sigma out 1act.( 9.30166245 sig in 12act.) RANK 15 NODE 12 --> 4.08309269 sigma out 1act.( 8.5144701 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 51.736351 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.418589145 *** contribution from regularisation: 0.00478090812 *** contribution from error: -0.423370063 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.480916232 *** contribution from regularisation: 0.0026548116 *** contribution from error: -0.483571053 *********************************************** -----------------> Test sample ENTER BFGS code START -45793.2269 0.53251332 0.0108618531 EXIT FROM BFGS code FG_START 0. 0.53251332 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.512818694 *** contribution from regularisation: 0.00255057681 *** contribution from error: -0.515369296 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48820.8515 0.53251332 54.6116257 EXIT FROM BFGS code FG_LNSRCH 0. 0.542175651 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.546010911 *** contre NEW_X -51980.7842 0.542175651 -0.11744529 ENTER BFGS code NEW_X -51980.7842 0.542175651 -0.11744529 EXIT FROM BFGS code FG_LNSRCH 0. 0.54244101 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.547810435 *** contribution from regularisation: 0.00333386171 *** contribution from error: -0.551144302 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52152.1027 0.54244101 -3.1615696 EXIT FROM BFGS code NEW_X -52152.1027 0.54244101 -3.1615696 ENTER BFGS code NEW_X -52152.1027 0.54244101 -3.1615696 EXIT FROM BFGS code FG_LNSRCH 0. 0.540596128 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.549175501 *** contribution from regularisation: 0.00322249904 *** contribution from error: -0.552398026 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52282.0553 0.540596128 -9.94503212 EXIT FROM BFGS code NEW_X -52282.0553 0.540596128 -9.94503212 ENTER BFGS code NEW_X -52282.0553 0.540596128 -9.94503212 EXIT FROM BFGS code FG_LNSRCH 0. 0.533723474 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.5495224 *** contribution from regularisation: 0.00313250069 *** contribution from error: -0.552654922 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52315.0842 0.533723474 -13.6199198 EXIT FROM BFGS code NEW_X -52315.0842 0.533723474 -13.6199198 ENTER BFGS code NEW_X -52315.0842 0.533723474 -13.6199198 EXIT FROM BFGS code FG_LNSRCH 0. 0.517670751 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.549851775 *** contribution from regularisation: 0.00305901561 *** contribution from error: -0.552910805 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52346.4381 0.517670751 -13.9984751 EXIT FROM BFGS code NEW_X -52346.4381 0.517670751 -13.9984751 ENTER BFGS code NEW_X -52346.4381 0.517670751 -13.9984751 EXIT FROM BFGS code FG_LNSRCH 0. 0.424505085 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.550854146 *** contribution from regularisation: 0.00284092524 *** contribution from error: -0.553695083 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52441.8666 0.424505085 -18.2107944 EXIT FROM BFGS code NEW_X -52441.8666 0.424505085 -18.2107944 ENTER BFGS code NEW_X -52441.8666 0.424505085 -18.2107944 EXIT FROM BFGS code FG_LNSRCH 0. 0.323781252 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 48.1494179 sigma out 15 active outputs RANK 2 NODE 11 --> 28.772562 sigma out 15 active outputs RANK 3 NODE 1 --> 20.631794 sigma out 15 active outputs RANK 4 NODE 10 --> 16.8380604 sigma out 15 active outputs RANK 5 NODE 3 --> 16.6792908 sigma out 15 active outputs RANK 6 NODE 7 --> 16.4752007 sigma out 15 active outputs RANK 7 NODE 8 --> 16.3717709 sigma out 15 active outputs RANK 8 NODE 12 --> 12.4542189 sigma out 15 active outputs RANK 9 NODE 5 --> 10.6811638 sigma out 15 active outputs RANK 10 NODE 9 --> 7.54633474 sigma out 15 active outputs RANK 11 NODE 6 --> 7.53519821 sigma out 15 active outputs RANK 12 NODE 4 --> 6.23205853 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 48.3218994 sigma in 12act. ( 42.7579117 sig out 1act.) RANK 2 NODE 12 --> 24.9776173 sigma in 12act. ( 22.2759476 sig out 1act.) RANK 3 NODE 7 --> 23.0059929 sigma in 12act. ( 23.2593346 sig out 1act.) RANK 4 NODE 9 --> 22.9542503 sigma in 12act. ( 23.2807808 sig out 1act.) RANK 5 NODE 3 --> 19.0070744 sigma in 12act. ( 16.8796692 sig out 1act.) RANK 6 NODE 6 --> 13.8797817 sigma in 12act. ( 11.3010492 sig out 1act.) RANK 7 NODE 1 --> 10.7831507 sigma in 12act. ( 9.37432861 sig out 1act.) RANK 8 NODE 14 --> 10.0941229 sigma in 12act. ( 10.0706902 sig out 1act.) RANK 9 NODE 15 --> 9.7449789 sigma in 12act. ( 9.40297985 sig out 1act.) RANK 10 NODE 8 --> 8.06987095 sigma in 12act. ( 6.43664122 sig out 1act.) RANK 11 NODE 13 --> 7.91006231 sigma in 12act. ( 6.44330835 sig out 1act.) RANK 12 NODE 4 --> 5.71182394 sigma in 12act. ( 4.4366312 sig out 1act.) RANK 13 NODE 5 --> 5.69714832 sigma in 12act. ( 4.14770317 sig out 1act.) RANK 14 NODE 10 --> 3.59841847 sigma in 12act. ( 0.984439015 sig out 1act.) RANK 15 NODE 2 --> 2.64765882 sigma in 12act. ( 0.405722409 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 42.7579117 sigma out 1act.( 48.3218994 sig in 12act.) RANK 2 NODE 9 --> 23.2807808 sigma out 1act.( 22.9542503 sig in 12act.) RANK 3 NODE 7 --> 23.2593346 sigma out 1act.( 23.0059929 sig in 12act.) RANK 4 NODE 12 --> 22.2759476 sigma out 1act.( 24.9776173 sig in 12act.) RANK 5 NODE 3 --> 16.8796692 sigma out 1act.( 19.0070744 sig in 12act.) RANK 6 NODE 6 --> 11.3010492 sigma out 1act.( 13.8797817 sig in 12act.) RANK 7 NODE 14 --> 10.0706902 sigma out 1act.( 10.0941229 sig in 12act.) RANK 8 NODE 15 --> 9.40297985 sigma out 1act.( 9.7449789 sig in 12act.) RANK 9 NODE 1 --> 9.37432861 sigma out 1act.( 10.7831507 sig in 12act.) RANK 10 NODE 13 --> 6.44330835 sigma out 1act.( 7.91006231 sig in 12act.) RANK 11 NODE 8 --> 6.43664122 sigma out 1act.( 8.06987095 sig in 12act.) RANK 12 NODE 4 --> 4.4366312 sigma out 1act.( 5.71182394 sig in 12act.) RANK 13 NODE 5 --> 4.14770317 sigma out 1act.( 5.69714832 sig in 12act.) RANK 14 NODE 10 --> 0.984439015 sigma out 1act.( 3.59841847 sig in 12act.) RANK 15 NODE 2 --> 0.405722409 sigma out 1act.( 2.64765882 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.9520187 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.551324427 *** contribution from regularisation: 0.00321383588 *** contribution from error: -0.55453825 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52486.634 0.323781252 -5.90690279 EXIT FROM BFGS code NEW_X -52486.634 0.323781252 -5.90690279 ENTER BFGS code NEW_X -52486.634 0.323781252 -5.90690279 EXIT FROM BFGS code FG_LNSRCH 0. 0.336986363 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.552110016 *** contribution from regularisation: 0.00292947749 *** contribution from error: -0.555039465 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52561.4264 0.336986363 -10.5236397 EXIT FROM BFGS code NEW_X -52561.4264 0.336986363 -10.5236397 ENTER BFGS code NEW_X -52561.4264 0.336986363 -10.5236397 EXIT FROM BFGS code FG_LNSRCH 0. 0.32237497 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.552131116 *** contribution from regularisation: 0.00302383769 *** contribution from error: -0.555154979 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52563.4368 0.32237497 -10.1737356 EXIT FROM BFGS code NEW_X -52563.4368 0.32237497 -10.1737356 ENTER BFGS code NEW_X -52563.4368 0.32237497 -10.1737356 EXIT FROM BFGS code FG_LNSRCH 0. 0.318389684 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.552212477 *** contribution from regularisation: 0.00298466277 *** contribution from error: -0.55519712 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52571.1806 0.318389684 -9.53424931 EXIT FROM BFGS code NEW_X -52571.1806 0.318389684 -9.53424931 ENTER BFGS code NEW_X -52571.1806 0.318389684 -9.53424931 EXIT FROM BFGS code FG_LNSRCH 0. 0.293577611 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.552449703 *** contribution from regularisation: 0.00284292782 *** contribution from error: -0.555292606 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52593.7629 0.293577611 -6.55541658 EXIT FROM BFGS code NEW_X -52593.7629 0.293577611 -6.55541658 ENTER BFGS code NEW_X -52593.7629 0.293577611 -6.55541658 EXIT FROM BFGS code FG_LNSRCH 0. 0.266730458 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.552490056 *** contribution from regularisation: 0.0028946402 *** contribution from error: -0.555384696 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52597.6062 0.266730458 -5.09699249 EXIT FROM BFGS code NEW_X -52597.6062 0.266730458 -5.09699249 ENTER BFGS code NEW_X -52597.6062 0.266730458 -5.09699249 EXIT FROM BFGS code FG_LNSRCH 0. 0.172209248 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.551767588 *** contribution from regularisation: 0.00285346014 *** contribution from error: -0.554621041 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52528.8277 0.172209248 24.7527523 EXIT FROM BFGS code FG_LNSRCH 0. 0.244673356 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.552182794 *** contribution from regularisation: 0.00330026937 *** contribution from error: -0.555483043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52568.3525 0.244673356 -0.0418037511 EXIT FROM BFGS code FG_LNSRCH 0. 0.26491195 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.552370131 *** contribution from regularisation: 0.00302793924 *** contribution from error: -0.555398047 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52586.1891 0.26491195 -4.59570265 EXIT FROM BFGS code FG_LNSRCH 0. 0.266689867 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.552381694 *** contribution from regularisation: 0.00300338957 *** contribution from error: -0.555385113 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52587.2875 0.266689867 -4.93368435 EXIT FROM BFGS code FG_LNSRCH 0. 0.266730428 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 49.9749298 sigma out 15 active outputs RANK 2 NODE 11 --> 25.8678112 sigma out 15 active outputs RANK 3 NODE 1 --> 23.2136402 sigma out 15 active outputs RANK 4 NODE 3 --> 18.4169884 sigma out 15 active outputs RANK 5 NODE 10 --> 17.4965935 sigma out 15 active outputs RANK 6 NODE 7 --> 14.2570992 sigma out 15 active outputs RANK 7 NODE 8 --> 13.2487926 sigma out 15 active outputs RANK 8 NODE 12 --> 11.3249931 sigma out 15 active outputs RANK 9 NODE 5 --> 10.9031496 sigma out 15 active outputs RANK 10 NODE 4 --> 7.8668952 sigma out 15 active outputs RANK 11 NODE 9 --> 7.36413813 sigma out 15 active outputs RANK 12 NODE 6 --> 7.26097727 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 50.5576286 sigma in 12act. ( 47.0915794 sig out 1act.) RANK 2 NODE 12 --> 24.5742226 sigma in 12act. ( 21.9789276 sig out 1act.) RANK 3 NODE 7 --> 23.7105713 sigma in 12act. ( 22.7015915 sig out 1act.) RANK 4 NODE 9 --> 22.4098911 sigma in 12act. ( 23.1283875 sig out 1act.) RANK 5 NODE 3 --> 16.9887238 sigma in 12act. ( 15.0145187 sig out 1act.) RANK 6 NODE 6 --> 11.9863005 sigma in 12act. ( 9.61221218 sig out 1act.) RANK 7 NODE 15 --> 10.5641384 sigma in 12act. ( 10.5739479 sig out 1act.) RANK 8 NODE 14 --> 10.5530834 sigma in 12act. ( 10.6403809 sig out 1act.) RANK 9 NODE 1 --> 10.0065565 sigma in 12act. ( 8.92926025 sig out 1act.) RANK 10 NODE 13 --> 7.23653698 sigma in 12act. ( 6.12357473 sig out 1act.) RANK 11 NODE 8 --> 6.57102823 sigma in 12act. ( 5.06451035 sig out 1act.) RANK 12 NODE 5 --> 5.67738771 sigma in 12act. ( 4.41332769 sig out 1act.) RANK 13 NODE 4 --> 4.65469742 sigma in 12act. ( 3.18175626 sig out 1act.) RANK 14 NODE 10 --> 3.13241982 sigma in 12act. ( 1.09990299 sig out 1act.) RANK 15 NODE 2 --> 2.56724286 sigma in 12act. ( 1.24994016 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 47.0915794 sigma out 1act.( 50.5576286 sig in 12act.) RANK 2 NODE 9 --> 23.1283875 sigma out 1act.( 22.4098911 sig in 12act.) RANK 3 NODE 7 --> 22.7015915 sigma out 1act.( 23.7105713 sig in 12act.) RANK 4 NODE 12 --> 21.9789276 sigma out 1act.( 24.5742226 sig in 12act.) RANK 5 NODE 3 --> 15.0145187 sigma out 1act.( 16.9887238 sig in 12act.) RANK 6 NODE 14 --> 10.6403809 sigma out 1act.( 10.5530834 sig in 12act.) RANK 7 NODE 15 --> 10.5739479 sigma out 1act.( 10.5641384 sig in 12act.) RANK 8 NODE 6 --> 9.61221218 sigma out 1act.( 11.9863005 sig in 12act.) RANK 9 NODE 1 --> 8.92926025 sigma out 1act.( 10.0065565 sig in 12act.) RANK 10 NODE 13 --> 6.12357473 sigma out 1act.( 7.23653698 sig in 12act.) RANK 11 NODE 8 --> 5.06451035 sigma out 1act.( 6.57102823 sig in 12act.) RANK 12 NODE 5 --> 4.41332769 sigma out 1act.( 5.67738771 sig in 12act.) RANK 13 NODE 4 --> 3.18175626 sigma out 1act.( 4.65469742 sig in 12act.) RANK 14 NODE 2 --> 1.24994016 sigma out 1act.( 2.56724286 sig in 12act.) RANK 15 NODE 10 --> 1.09990299 sigma out 1act.( 3.13241982 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.8512039 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.552386701 *** contribution from regularisation: 0.00299802376 *** contribution from error: -0.555384696 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52587.764 0.266730428 -4.93090105 EXIT FROM BFGS code FG_LNSRCH 0. 0.266730458 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.552385449 *** contribution from regularisation: 0.00299925008 *** contribution from error: -0.555384696 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52587.6472 0.266730458 -4.9136076 EXIT FROM BFGS code FG_LNSRCH 0. 0.266730458 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.552379131 *** contribution from regularisation: 0.00300556328 *** contribution from error: -0.555384696 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52587.0462 0.266730458 -4.86431885 EXIT FROM BFGS code FG_LNSRCH 0. 0.266730458 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.552390814 *** contribution from regularisation: 0.00299385842 *** contribution from error: -0.555384696 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52588.1605 0.266730458 -4.90646172 EXIT FROM BFGS code NEW_X -52588.1605 0.266730458 -4.90646172 ENTER BFGS code NEW_X -52588.1605 0.266730458 -4.90646172 EXIT FROM BFGS code CONVERGENC -52588.1605 0.266730458 -4.90646172 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 76.2344437 sigma out 15 active outputs RANK 2 NODE 11 --> 39.7523842 sigma out 15 active outputs RANK 3 NODE 1 --> 35.3747673 sigma out 15 active outputs RANK 4 NODE 3 --> 28.8517513 sigma out 15 active outputs RANK 5 NODE 10 --> 26.3502121 sigma out 15 active outputs RANK 6 NODE 7 --> 22.1621857 sigma out 15 active outputs RANK 7 NODE 8 --> 19.4637222 sigma out 15 active outputs RANK 8 NODE 12 --> 17.0921993 sigma out 15 active outputs RANK 9 NODE 5 --> 16.5736275 sigma out 15 active outputs RANK 10 NODE 4 --> 11.9223833 sigma out 15 active outputs RANK 11 NODE 9 --> 11.1998224 sigma out 15 active outputs RANK 12 NODE 6 --> 10.9006081 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 77.6734619 sigma in 12act. ( 75.3655243 sig out 1act.) RANK 2 NODE 12 --> 37.8424072 sigma in 12act. ( 34.6738281 sig out 1act.) RANK 3 NODE 7 --> 36.0710602 sigma in 12act. ( 36.0570107 sig out 1act.) RANK 4 NODE 9 --> 34.7134743 sigma in 12act. ( 36.7043266 sig out 1act.) RANK 5 NODE 3 --> 25.8919125 sigma in 12act. ( 23.8687592 sig out 1act.) RANK 6 NODE 6 --> 17.8010616 sigma in 12act. ( 15.2430763 sig out 1act.) RANK 7 NODE 14 --> 16.1041603 sigma in 12act. ( 16.6477852 sig out 1act.) RANK 8 NODE 15 --> 15.8922977 sigma in 12act. ( 16.7509766 sig out 1act.) RANK 9 NODE 1 --> 14.6048336 sigma in 12act. ( 14.0127573 sig out 1act.) RANK 10 NODE 13 --> 10.4625425 sigma in 12act. ( 9.64381027 sig out 1act.) RANK 11 NODE 8 --> 9.32496738 sigma in 12act. ( 7.9994359 sig out 1act.) RANK 12 NODE 5 --> 7.64320517 sigma in 12act. ( 7.10539341 sig out 1act.) RANK 13 NODE 4 --> 5.91657877 sigma in 12act. ( 4.95872211 sig out 1act.) RANK 14 NODE 10 --> 3.39403749 sigma in 12act. ( 1.73642838 sig out 1act.) RANK 15 NODE 2 --> 2.84589601 sigma in 12act. ( 1.94679999 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 75.3655243 sigma out 1act.( 77.6734619 sig in 12act.) RANK 2 NODE 9 --> 36.7043266 sigma out 1act.( 34.7134743 sig in 12act.) RANK 3 NODE 7 --> 36.0570107 sigma out 1act.( 36.0710602 sig in 12act.) RANK 4 NODE 12 --> 34.6738281 sigma out 1act.( 37.8424072 sig in 12act.) RANK 5 NODE 3 --> 23.8687592 sigma out 1act.( 25.8919125 sig in 12act.) RANK 6 NODE 15 --> 16.7509766 sigma out 1act.( 15.8922977 sig in 12act.) RANK 7 NODE 14 --> 16.6477852 sigma out 1act.( 16.1041603 sig in 12act.) RANK 8 NODE 6 --> 15.2430763 sigma out 1act.( 17.8010616 sig in 12act.) RANK 9 NODE 1 --> 14.0127573 sigma out 1act.( 14.6048336 sig in 12act.) RANK 10 NODE 13 --> 9.64381027 sigma out 1act.( 10.4625425 sig in 12act.) RANK 11 NODE 8 --> 7.9994359 sigma out 1act.( 9.32496738 sig in 12act.) RANK 12 NODE 5 --> 7.10539341 sigma out 1act.( 7.64320517 sig in 12act.) RANK 13 NODE 4 --> 4.95872211 sigma out 1act.( 5.91657877 sig in 12act.) RANK 14 NODE 2 --> 1.94679999 sigma out 1act.( 2.84589601 sig in 12act.) RANK 15 NODE 10 --> 1.73642838 sigma out 1act.( 3.39403749 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 106.417091 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.55237782 *** contribution from regularisation: 0.00300685386 *** contribution from error: -0.555384696 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done