NNInput NNInputs_180.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 178431 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 38631 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 38631 Chosen entries: 38631 Signal fraction: 1 Background fraction: 0.27633 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 38631 Entries to split: 38631 Test with : 19315 Train with : 19315 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 38631 for Signal Prepared event 0 for Signal with 38631 events ====Entry 0 Variable Ht : 181.988 Variable LepAPt : 36.3125 Variable LepBPt : 33.3263 Variable MetSigLeptonsJets : 8.50337 Variable MetSpec : 84.1215 Variable SumEtLeptonsJets : 97.8662 Variable VSumJetLeptonsPt : 93.7481 Variable addEt : 153.761 Variable dPhiLepSumMet : 2.8992 Variable dPhiLeptons : 0.358494 Variable dRLeptons : 0.375835 Variable lep1_E : 49.7842 Variable lep2_E : 42.4469 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2180 Ht = 181.988 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.3125 LepAPt = 36.3125 LepBEt = 33.3264 LepBPt = 33.3263 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 84.1215 MetDelPhi = 2.72772 MetSig = 7.11556 MetSigLeptonsJets = 8.50337 MetSpec = 84.1215 Mjj = 0 MostCentralJetEta = -2.14636 MtllMet = 165.707 Njets = 1 SB = 0 SumEt = 139.764 SumEtJets = 0 SumEtLeptonsJets = 97.8662 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 93.7481 addEt = 153.761 dPhiLepSumMet = 2.8992 dPhiLeptons = 0.358494 dRLeptons = 0.375835 diltype = 49 dimass = 13.013 event = 182 jet1_Et = 28.2274 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 49.7842 lep2_E = 42.4469 rand = 0.999742 run = 167139 weight = 3.11806e-06 ===Show End Prepared event 10000 for Signal with 38631 events Prepared event 20000 for Signal with 38631 events Prepared event 30000 for Signal with 38631 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.223187 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4335 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 178431 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4335 negative weights. Signal fraction: 62.7999649 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 63.1624298 65.2457886 66.9072113 68.1489944 69.4156494 70.2926788 71.0697632 71.9986725 72.9014816 73.7422791 74.3886414 75.2117004 75.8278351 76.5848846 77.1062317 77.8614349 78.4995575 79.2051163 79.6785278 80.4967957 81.1439514 81.8075256 82.5493927 83.1583099 84.0261383 85.0562057 86.0555344 87.1969147 88.5437469 89.7531738 91.2905502 92.8397827 94.4760437 96.1434631 97.8355255 99.7285919 101.53418 103.282547 104.809311 106.38414 108.016342 109.579544 111.47435 113.364639 115.24762 117.09346 119.068405 120.508026 122.199074 123.892334 125.681335 127.628784 129.211761 130.789581 132.605835 134.128799 135.750427 137.415451 138.831696 140.47348 141.899887 143.312012 144.894531 146.484375 148.192276 149.749741 151.19751 152.799957 154.436584 156.152985 157.834961 159.569305 161.247253 163.192749 165.033203 166.895111 168.779404 170.860138 173.017456 175.248047 177.754913 180.112396 182.733887 185.674591 188.975861 192.279785 195.743958 199.300232 203.333755 207.552643 212.409424 217.794479 223.988754 231.449661 239.526062 248.637238 262.270782 282.207214 320.678955 787.769287 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3918228 20.6991348 21.0231686 21.326786 21.5631866 21.8464241 22.0842552 22.3180275 22.5646935 22.7494698 22.9583797 23.1756897 23.4182014 23.6501961 23.8609161 24.0743561 24.2989464 24.5407066 24.7839527 25.0133018 25.2200451 25.4140167 25.6146049 25.7839813 25.9986248 26.1960068 26.4033089 26.6322842 26.880888 27.1262665 27.3607521 27.6184788 27.8457222 28.0677338 28.2825165 28.5447788 28.8298225 29.0952206 29.3380108 29.6215363 29.8617744 30.1349545 30.4662437 30.7590714 31.1117287 31.4307175 31.7282066 32.0534821 32.3867722 32.7136612 33.057354 33.4269753 33.7789001 34.1152534 34.4928513 34.8555832 35.2339935 35.5905151 35.9476395 36.3644142 36.720974 37.1295471 37.5664825 37.9837685 38.4106445 38.8212471 39.2092133 39.6215324 40.0811501 40.5147324 40.989502 41.4916916 41.9790497 42.5299225 43.0191383 43.5445404 44.1335144 44.6473389 45.2795868 45.9080315 46.4800072 47.2002411 47.8417053 48.5154724 49.3435822 50.100502 50.9312439 51.8671989 52.8267822 53.8070488 54.9258652 56.0590363 57.4129562 58.7784195 60.2348633 62.3342743 64.7883301 68.3242416 75.4917145 162.429443 ------------------------------ Transdef: Tab for variable 4 10.000247 10.1261387 10.2665863 10.3906479 10.4935474 10.6312618 10.7608356 10.9009571 11.0137863 11.1602554 11.3112783 11.4366436 11.5959663 11.7473755 11.919302 12.0935135 12.2340012 12.3885918 12.5564499 12.707243 12.8563156 13.0591908 13.2399826 13.4442062 13.5775585 13.7456512 13.9123821 14.0812664 14.2657366 14.4556904 14.6880054 14.8805561 15.1480789 15.3561401 15.563592 15.8006725 15.9736958 16.2326202 16.4407845 16.6587429 16.8614845 17.1083775 17.3615761 17.6249943 17.8705025 18.137722 18.4026012 18.6660576 18.886816 19.1260223 19.381752 19.6805382 19.9351711 20.1975441 20.4342308 20.6942368 20.944973 21.2161961 21.4513454 21.6971245 21.9394684 22.1416321 22.4354668 22.6881371 22.9284668 23.2101784 23.481514 23.7525215 23.9923801 24.2721157 24.556797 24.8299065 25.1036568 25.3811264 25.6591949 25.9660816 26.2346172 26.5131588 26.856842 27.1705685 27.5004272 27.8038597 28.1134319 28.4477901 28.8393974 29.2433815 29.6205635 30.0147762 30.4618187 30.9394588 31.4512882 32.0552979 32.6371422 33.2649956 34.0067863 34.8703842 35.9040985 37.3578911 39.40625 43.1142197 72.314209 ------------------------------ Transdef: Tab for variable 5 1.06155312 2.70645618 3.13885927 3.46278954 3.73745441 3.98202729 4.14001369 4.27820635 4.40794039 4.53073597 4.63213825 4.72520256 4.81548929 4.90836143 4.98978519 5.05954742 5.12947273 5.19709206 5.2737875 5.33653498 5.38782692 5.45007706 5.50157833 5.54912472 5.5957098 5.64268255 5.68984127 5.74460411 5.79466629 5.84342384 5.88842726 5.93074751 5.98290157 6.03033447 6.07770586 6.11855793 6.17013359 6.21840286 6.27053356 6.3106761 6.35174942 6.40289497 6.44701099 6.49932766 6.53912926 6.59053326 6.64039946 6.68390894 6.73348713 6.77554893 6.82445812 6.86918354 6.90948105 6.96024609 7.00895119 7.0585146 7.11475658 7.16355801 7.21494675 7.25974846 7.3194685 7.38320541 7.4377017 7.49001503 7.55621004 7.61911678 7.68170643 7.74201775 7.80020094 7.85636616 7.91834402 7.98005867 8.04981995 8.11266327 8.17409706 8.24043846 8.30286217 8.37133884 8.44496441 8.51268768 8.58140755 8.64472389 8.71662903 8.79102898 8.86132812 8.93917751 9.02875996 9.12622929 9.22674751 9.32290077 9.42468834 9.53145409 9.6537323 9.79594421 9.94978905 10.1573505 10.3901939 10.6838799 11.1268673 11.9076271 19.7064457 ------------------------------ Transdef: Tab for variable 6 15.0025911 21.7522163 25.5359612 26.6495819 27.6492767 28.6612854 29.4108315 30.0800762 30.8040619 31.3784828 31.9817734 32.642662 33.1501198 33.5853729 34.09021 34.6137314 34.9391556 35.3562279 35.8401451 36.3099823 36.6242104 37.0388641 37.4002228 37.8193436 38.2112198 38.5742416 38.9931793 39.36203 39.6783142 40.0443192 40.4248734 40.7811546 41.1909332 41.6644707 42.1288109 42.4938354 42.9133034 43.3388176 43.817009 44.3595352 44.7605362 45.4283295 46.1103592 46.7801857 47.5537453 48.2360001 48.8827667 49.6088562 50.3031921 51.0411301 51.8026581 52.5924072 53.495285 54.2976685 55.2028275 56.0151329 56.8508148 57.6172562 58.3894882 59.0181732 59.8436508 60.643364 61.3646622 62.2370071 63.1485291 64.006073 64.835228 65.6566849 66.3865662 67.2374954 68.1427078 68.9547653 69.8466034 70.7284622 71.6172791 72.3967972 73.2688446 74.1700439 75.0922546 75.985199 76.9387207 77.935051 78.934021 79.8619766 80.8630371 82.0383759 83.1591034 84.4014969 85.6148529 86.8925018 88.4755173 90.4339905 92.3587723 94.7723541 97.3017273 100.682831 104.573059 109.696884 116.569153 129.660416 263.274963 ------------------------------ Transdef: Tab for variable 7 30.1877575 32.9169235 33.7961197 34.4527016 35.1292343 35.5750885 36.0674591 36.4647751 36.8853302 37.2495537 37.5988388 37.9325562 38.2530136 38.5516205 38.8255844 39.1404495 39.4202919 39.675293 40.0818787 40.3409805 40.6667404 40.9976311 41.3634415 41.7339478 42.1027756 42.6505699 43.1518097 43.6890945 44.4019508 44.9144516 45.5290756 46.4429474 47.288826 48.3532524 49.4006157 50.5367966 51.6672974 52.7181244 53.8144226 54.9821091 55.9562683 56.9386482 57.875061 58.9295425 59.8821678 60.8661423 61.6238403 62.514782 63.4039764 64.1871643 65.1274109 66.0970764 66.9772797 67.8592529 68.7541809 69.7357025 70.6446991 71.3928375 72.2186127 73.1041183 74.0189209 74.9300385 75.921875 76.8446426 77.8868637 78.9111176 80.1051788 81.1513367 82.3124847 83.5812149 84.7492981 85.9201965 87.4056854 89.0360947 90.5775909 92.3631287 93.8898468 95.594696 97.3918762 99.0489655 100.983749 102.761993 104.810974 106.762779 109.033974 111.562195 114.195061 116.851929 119.828461 122.975571 126.443054 130.431747 135.202271 140.239777 146.221878 153.652039 162.61348 173.582642 189.656265 217.886963 523.715759 ------------------------------ Transdef: Tab for variable 8 1.09349227 25.006628 29.5086575 31.1864166 32.2042465 32.8844452 33.4353065 33.8933945 34.4192734 34.9232063 35.2634888 35.6583786 35.9715767 36.2801971 36.5833244 36.9080086 37.2338486 37.5098343 37.7626419 38.0318451 38.2924728 38.5746155 38.8276558 39.0923958 39.3502655 39.698143 39.9956207 40.2800789 40.5563736 40.9030342 41.3010559 41.6735382 42.0646019 42.4824257 42.9426422 43.3511505 43.8081398 44.2898026 44.8390579 45.450531 46.1165581 46.7685738 47.593811 48.3147583 48.9061279 49.5276337 50.2950134 51.0393372 51.7575836 52.5171051 53.2711792 53.9757538 54.7255554 55.4900093 56.2320137 56.9708557 57.7212753 58.4909515 59.3023987 60.0569229 60.7910805 61.3825684 62.0907898 62.8101578 63.5533447 64.2793198 65.0059814 65.7574615 66.5350952 67.2984467 68.0102234 68.7819061 69.554863 70.2674026 71.0044708 71.766655 72.5061798 73.2810059 74.0387192 74.8031006 75.6004715 76.5039291 77.5316315 78.4372253 79.4367828 80.524353 81.7111282 82.8760834 84.0175018 85.3996735 86.8590393 88.7099075 90.5898895 93.0447388 95.3994446 98.8292542 102.900856 108.110703 116.329773 131.708038 329.840057 ------------------------------ Transdef: Tab for variable 9 49.4992676 62.8013802 64.7772141 66.3644028 67.4189758 68.7119217 69.7191849 70.4361725 71.2017975 72.0040741 72.8586731 73.5667877 74.2135239 74.9011536 75.5469513 76.1204834 76.7575378 77.2581406 77.9194336 78.4582062 78.9892349 79.5005035 80.0648804 80.7602692 81.3445358 81.8914185 82.5493927 83.0350342 83.7151184 84.5612793 85.4210358 86.2676773 87.1915817 88.3342743 89.1969986 90.2250671 91.3946991 92.4519424 93.5620499 94.9814148 96.2683945 97.8415375 99.3579102 100.898155 102.22142 103.914513 105.367332 106.942612 108.369797 109.832863 111.228981 112.692947 114.306396 115.611038 116.945908 118.411423 119.717735 120.92514 122.315414 123.665665 124.850861 126.22023 127.717941 128.889069 130.188965 131.564636 132.910614 134.104813 135.447205 136.737717 137.960602 139.132111 140.470047 141.541214 142.825012 143.949402 145.16333 146.412537 147.731796 148.912582 150.088165 151.311096 152.549622 153.952698 155.361557 156.643173 158.040848 159.651428 161.005814 162.683777 164.366211 166.227264 168.111404 170.418762 172.819916 175.32074 178.792755 183.247269 189.525803 204.679886 391.964661 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.10541177 1.41930854 1.62416363 1.78398454 1.91665697 2.01290751 2.0947876 2.1652751 2.22999263 2.2804544 2.32932687 2.38140488 2.42229795 2.4616847 2.49727082 2.52815771 2.55888796 2.58349514 2.60893297 2.63229775 2.65541053 2.6777873 2.69809341 2.71747899 2.73656154 2.75497437 2.77217722 2.78613877 2.80091929 2.81396532 2.82697487 2.83854222 2.84977627 2.86010742 2.8707931 2.88031197 2.8891902 2.89804292 2.90765381 2.91622972 2.92279816 2.9300015 2.93765306 2.94482684 2.95053196 2.95768857 2.96389246 2.96946383 2.97542477 2.98093128 2.98630953 2.99090648 2.99522543 3.00047302 3.00544906 3.01008749 3.01463699 3.01849174 3.02246785 3.02665043 3.03089094 3.03443003 3.03849602 3.04242921 3.04624939 3.05010819 3.05369949 3.05736709 3.06079388 3.0643158 3.06756735 3.0708797 3.07339668 3.07641745 3.07950974 3.0826211 3.08574438 3.08877563 3.09161091 3.09437943 3.09658527 3.09909201 3.10161066 3.10397673 3.10671806 3.10901737 3.11190748 3.11429691 3.11686516 3.11912489 3.12139153 3.12406516 3.12625766 3.12853146 3.13079381 3.1323328 3.13453364 3.13660836 3.13896585 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00504493341 0.0108911358 0.0176077485 0.0242137164 0.030685246 0.0375236273 0.0448114872 0.0509893894 0.0583627522 0.0646430999 0.0717636943 0.0787038356 0.0857392848 0.0925996304 0.0999468118 0.107886553 0.113506794 0.120438933 0.127874017 0.134183884 0.141743317 0.147862911 0.154468536 0.160785943 0.167008132 0.173612952 0.180108413 0.186816216 0.193066597 0.198322773 0.202871084 0.207714379 0.213137388 0.218072593 0.22327137 0.228072762 0.233545363 0.238312602 0.243893236 0.248565555 0.25313437 0.25854063 0.263379574 0.268431246 0.273972571 0.278511137 0.283872068 0.288997233 0.294463158 0.300203264 0.305682957 0.311539769 0.317149639 0.322809637 0.327814609 0.333660007 0.338652104 0.343831241 0.349864006 0.355018973 0.361217499 0.367049456 0.372920513 0.379304051 0.385396004 0.391375691 0.397267222 0.403561354 0.409118891 0.415365338 0.422543526 0.428902864 0.436213017 0.440963984 0.447587252 0.455001116 0.460706234 0.468357086 0.475820899 0.483094275 0.492342204 0.501563311 0.51173377 0.520786285 0.52934885 0.539076984 0.55009377 0.564243138 0.577535152 0.589289784 0.603965223 0.622269869 0.640512705 0.657600999 0.680284023 0.708369493 0.733414233 0.786093056 0.84398073 1.11161757 ------------------------------ Transdef: Tab for variable 12 0.20003137 0.211965859 0.223523796 0.232397199 0.239850998 0.246643394 0.25406903 0.261762887 0.26858601 0.274939358 0.281836599 0.287971437 0.294318348 0.300415218 0.30597499 0.311892539 0.316988051 0.321927786 0.327313215 0.33238256 0.337515503 0.342840075 0.347434163 0.352005124 0.357636303 0.362773925 0.367538184 0.372955501 0.377206564 0.382981926 0.388083637 0.392547488 0.397595823 0.401846051 0.406145692 0.409738064 0.41315639 0.416737705 0.420127571 0.423937201 0.427029967 0.430579841 0.43450433 0.437522143 0.441363275 0.445054173 0.448694408 0.452641964 0.456696302 0.460341692 0.46441412 0.468969703 0.472866654 0.476497591 0.481427014 0.485632122 0.490049005 0.493884921 0.498305351 0.502028108 0.506670833 0.511182308 0.515861988 0.520963311 0.524921894 0.529865324 0.53556478 0.540718615 0.546501756 0.552150488 0.557817936 0.563584924 0.569561124 0.575645387 0.581703663 0.58833611 0.59556967 0.602518559 0.609636247 0.616507411 0.623948038 0.631558836 0.640238881 0.648042917 0.658177972 0.666015863 0.674315691 0.684025645 0.694764376 0.704346299 0.717118979 0.729003608 0.743052006 0.754959822 0.769657969 0.789991975 0.807537317 0.827769637 0.859366298 0.903178811 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.670351 22.4570045 23.2179832 23.8685799 24.5413551 25.0686493 25.5540543 25.9582043 26.4231529 26.8785095 27.2790871 27.6826096 28.0775833 28.4574833 28.8595352 29.2393703 29.5801315 29.9045849 30.295578 30.639389 30.9495411 31.3190842 31.6748886 32.0584793 32.4160767 32.7732391 33.1339493 33.4935532 33.8779068 34.3350601 34.693924 35.0463753 35.4198532 35.799057 36.1899338 36.6119766 36.9929962 37.4330292 37.8209877 38.270401 38.6726608 39.125721 39.5930481 39.9938889 40.4407845 40.8288651 41.3384056 41.8291168 42.2512474 42.6934738 43.1094742 43.5613899 44.0406418 44.507637 44.9887848 45.4675407 45.9793243 46.5184021 47.0474091 47.5835266 48.1217766 48.5861855 49.0930328 49.6300812 50.2263527 50.8020706 51.3867493 52.0374527 52.6120682 53.2454758 53.8986816 54.4821777 55.2025604 55.8947144 56.5751839 57.348526 58.1835022 58.9677048 59.7641716 60.4898224 61.2957458 62.2504044 63.2486877 64.2152863 65.4607697 66.7014465 67.7239227 68.9574432 70.3210831 71.9574051 73.6095886 75.4455872 77.6857758 80.0326843 82.6067505 86.1237335 90.084259 95.671875 105.677422 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6933212 11.1575584 11.5458689 11.9208879 12.317812 12.704113 13.0312309 13.3886356 13.720808 14.0011854 14.3025894 14.5721836 14.9214287 15.2838478 15.5884876 15.8936205 16.2681828 16.5848885 16.8579025 17.1489792 17.429882 17.7186584 17.9795895 18.2508011 18.5517464 18.886982 19.1443996 19.404974 19.7375832 20.0664482 20.3617401 20.627058 20.9217548 21.2474575 21.4975586 21.7486534 22.0127316 22.271244 22.5659008 22.8632927 23.1325989 23.3840179 23.6684723 23.9264107 24.2158546 24.5130386 24.7463112 25.0153313 25.3004665 25.5557022 25.7935982 26.0529652 26.3254623 26.5683384 26.8663559 27.1465454 27.4599609 27.7156906 27.9770508 28.2185059 28.4956856 28.8026524 29.086937 29.3757935 29.6731033 30.0041199 30.3335762 30.6199932 30.9244823 31.2507172 31.5530167 31.8935623 32.2606964 32.5955963 32.9699707 33.3717957 33.6831436 34.0828629 34.5226707 34.9445839 35.4507713 35.9306068 36.5143547 37.0297356 37.5991821 38.2156296 38.792717 39.4715805 40.2513847 41.0227165 41.8973961 43.0056534 44.1981812 45.4196472 47.2141113 49.0705681 51.893425 55.6254959 62.1110535 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.7 54.1 54.8 34.0 52.4 65.2 57.9 66.5 -26.7 -19.8 -43.0 19.4 25.6 2 67.7 100.0 68.9 60.6 40.8 71.7 94.4 77.6 92.2 -43.1 -26.5 -53.0 35.3 32.7 3 54.1 68.9 100.0 48.2 18.7 41.5 71.1 59.4 75.9 -14.7 -28.8 -59.5 65.4 26.1 4 54.8 60.6 48.2 100.0 18.8 38.9 61.9 52.7 65.4 -12.7 -31.7 -64.0 23.4 70.6 5 34.0 40.8 18.7 18.8 100.0 85.2 13.8 60.7 61.0 22.2 -9.7 -16.9 3.0 5.6 6 52.4 71.7 41.5 38.9 85.2 100.0 51.3 80.8 81.7 -7.1 -17.7 -33.8 16.8 18.1 7 65.2 94.4 71.1 61.9 13.8 51.3 100.0 69.3 81.1 -52.0 -25.5 -53.1 38.6 35.4 8 57.9 77.6 59.4 52.7 60.7 80.8 69.3 100.0 85.1 -11.3 -26.0 -47.7 30.8 29.5 9 66.5 92.2 75.9 65.4 61.0 81.7 81.1 85.1 100.0 -19.5 -29.6 -59.1 41.3 36.9 10 -26.7 -43.1 -14.7 -12.7 22.2 -7.1 -52.0 -11.3 -19.5 100.0 3.7 9.3 -3.7 -3.9 11 -19.8 -26.5 -28.8 -31.7 -9.7 -17.7 -25.5 -26.0 -29.6 3.7 100.0 54.1 -14.3 -20.1 12 -43.0 -53.0 -59.5 -64.0 -16.9 -33.8 -53.1 -47.7 -59.1 9.3 54.1 100.0 -31.5 -37.9 13 19.4 35.3 65.4 23.4 3.0 16.8 38.6 30.8 41.3 -3.7 -14.3 -31.5 100.0 49.0 14 25.6 32.7 26.1 70.6 5.6 18.1 35.4 29.5 36.9 -3.9 -20.1 -37.9 49.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.424892 TOTAL CORRELATION OF ALL VARIABLES 74.2564871 ROUND 1: MAX CORR ( 74.2564518) AFTER KILLING INPUT VARIABLE 8 CONTR 0.0724470279 ROUND 2: MAX CORR ( 74.2549884) AFTER KILLING INPUT VARIABLE 6 CONTR 0.466189757 ROUND 3: MAX CORR ( 74.2418746) AFTER KILLING INPUT VARIABLE 11 CONTR 1.39547686 ROUND 4: MAX CORR ( 74.2247115) AFTER KILLING INPUT VARIABLE 2 CONTR 1.59629071 ROUND 5: MAX CORR ( 74.1903458) AFTER KILLING INPUT VARIABLE 14 CONTR 2.25840548 ROUND 6: MAX CORR ( 74.1397449) AFTER KILLING INPUT VARIABLE 12 CONTR 2.73964182 ROUND 7: MAX CORR ( 73.8161848) AFTER KILLING INPUT VARIABLE 10 CONTR 6.91900504 ROUND 8: MAX CORR ( 72.9205997) AFTER KILLING INPUT VARIABLE 13 CONTR 11.46365 ROUND 9: MAX CORR ( 71.8663269) AFTER KILLING INPUT VARIABLE 9 CONTR 12.3549552 ROUND 10: MAX CORR ( 71.5207472) AFTER KILLING INPUT VARIABLE 3 CONTR 7.03929425 ROUND 11: MAX CORR ( 69.8872378) AFTER KILLING INPUT VARIABLE 4 CONTR 15.1983972 ROUND 12: MAX CORR ( 65.1664301) AFTER KILLING INPUT VARIABLE 5 CONTR 25.2499979 LAST REMAINING VARIABLE: 7 total correlation to target: 74.2564871 % total significance: 130.412588 sigma correlations of single variables to target: variable 2: 67.726775 % , in sigma: 118.944814 variable 3: 54.1131192 % , in sigma: 95.0358982 variable 4: 54.7872507 % , in sigma: 96.2198383 variable 5: 33.9946276 % , in sigma: 59.7028967 variable 6: 52.3786467 % , in sigma: 91.9897394 variable 7: 65.1664301 % , in sigma: 114.448221 variable 8: 57.9191865 % , in sigma: 101.720285 variable 9: 66.4880783 % , in sigma: 116.769359 variable 10: -26.7043898 % , in sigma: 46.8994525 variable 11: -19.7773223 % , in sigma: 34.7338246 variable 12: -43.0172197 % , in sigma: 75.5487795 variable 13: 19.3704387 % , in sigma: 34.0192372 variable 14: 25.6159077 % , in sigma: 44.9878112 variables sorted by significance: 1 most relevant variable 7 corr 65.1664276 , in sigma: 114.448216 2 most relevant variable 5 corr 25.2499981 , in sigma: 44.3451843 3 most relevant variable 4 corr 15.1983976 , in sigma: 26.6921107 4 most relevant variable 3 corr 7.03929424 , in sigma: 12.3627257 5 most relevant variable 9 corr 12.3549557 , in sigma: 21.6983298 6 most relevant variable 13 corr 11.4636497 , in sigma: 20.1329782 7 most relevant variable 10 corr 6.91900492 , in sigma: 12.1514682 8 most relevant variable 12 corr 2.7396419 , in sigma: 4.81148255 9 most relevant variable 14 corr 2.25840545 , in sigma: 3.9663134 10 most relevant variable 2 corr 1.59629071 , in sigma: 2.80347766 11 most relevant variable 11 corr 1.39547682 , in sigma: 2.45079926 12 most relevant variable 6 corr 0.466189772 , in sigma: 0.818743482 13 most relevant variable 8 corr 0.0724470243 , in sigma: 0.127234728 global correlations between input variables: variable 2: 99.1994457 % variable 3: 93.4751253 % variable 4: 91.7769069 % variable 5: 95.5863484 % variable 6: 95.2190466 % variable 7: 98.8141493 % variable 8: 90.6789911 % variable 9: 98.8498085 % variable 10: 71.4902558 % variable 11: 54.9393477 % variable 12: 78.4908036 % variable 13: 85.7060069 % variable 14: 87.5445535 % significance loss when removing single variables: variable 2: corr = 1.571808 % , sigma = 2.76048003 variable 3: corr = 15.2460632 % , sigma = 26.7758231 variable 4: corr = 14.4027352 % , sigma = 25.2947325 variable 5: corr = 15.279396 % , sigma = 26.8343636 variable 6: corr = 0.460656484 % , sigma = 0.809025672 variable 7: corr = 7.89201485 % , sigma = 13.8603121 variable 8: corr = 0.0724470279 % , sigma = 0.127234735 variable 9: corr = 10.0299923 % , sigma = 17.6151245 variable 10: corr = 6.4391852 % , sigma = 11.3087872 variable 11: corr = 1.39750038 % , sigma = 2.45435313 variable 12: corr = 1.98304289 % , sigma = 3.48270928 variable 13: corr = 6.32873992 % , sigma = 11.1148182 variable 14: corr = 2.14987638 % , sigma = 3.77570977 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 33.0582581 sigma out 15 active outputs RANK 2 NODE 2 --> 31.1577377 sigma out 15 active outputs RANK 3 NODE 7 --> 28.1495304 sigma out 15 active outputs RANK 4 NODE 1 --> 26.2850914 sigma out 15 active outputs RANK 5 NODE 3 --> 22.2926235 sigma out 15 active outputs RANK 6 NODE 4 --> 17.0320702 sigma out 15 active outputs RANK 7 NODE 5 --> 16.6372032 sigma out 15 active outputs RANK 8 NODE 9 --> 12.4046698 sigma out 15 active outputs RANK 9 NODE 8 --> 12.3850727 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 40.052803 sigma in 9act. ( 43.3998604 sig out 1act.) RANK 2 NODE 1 --> 27.3841114 sigma in 9act. ( 27.5237465 sig out 1act.) RANK 3 NODE 8 --> 25.0585785 sigma in 9act. ( 22.3508415 sig out 1act.) RANK 4 NODE 13 --> 22.9446716 sigma in 9act. ( 25.1543236 sig out 1act.) RANK 5 NODE 3 --> 21.1478271 sigma in 9act. ( 26.7742271 sig out 1act.) RANK 6 NODE 2 --> 18.651392 sigma in 9act. ( 16.8995857 sig out 1act.) RANK 7 NODE 9 --> 15.8174057 sigma in 9act. ( 17.5845814 sig out 1act.) RANK 8 NODE 12 --> 11.6816711 sigma in 9act. ( 10.7882757 sig out 1act.) RANK 9 NODE 14 --> 11.511157 sigma in 9act. ( 13.9637032 sig out 1act.) RANK 10 NODE 6 --> 6.88186646 sigma in 9act. ( 6.13370752 sig out 1act.) RANK 11 NODE 11 --> 4.43617964 sigma in 9act. ( 6.07755089 sig out 1act.) RANK 12 NODE 5 --> 3.74377608 sigma in 9act. ( 3.84610343 sig out 1act.) RANK 13 NODE 7 --> 2.31103754 sigma in 9act. ( 4.15532923 sig out 1act.) RANK 14 NODE 10 --> 2.15474343 sigma in 9act. ( 2.79330397 sig out 1act.) RANK 15 NODE 4 --> 2.06406546 sigma in 9act. ( 2.11414719 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 43.3998604 sigma out 1act.( 40.052803 sig in 9act.) RANK 2 NODE 1 --> 27.5237465 sigma out 1act.( 27.3841114 sig in 9act.) RANK 3 NODE 3 --> 26.7742271 sigma out 1act.( 21.1478271 sig in 9act.) RANK 4 NODE 13 --> 25.1543236 sigma out 1act.( 22.9446716 sig in 9act.) RANK 5 NODE 8 --> 22.3508415 sigma out 1act.( 25.0585785 sig in 9act.) RANK 6 NODE 9 --> 17.5845814 sigma out 1act.( 15.8174057 sig in 9act.) RANK 7 NODE 2 --> 16.8995857 sigma out 1act.( 18.651392 sig in 9act.) RANK 8 NODE 14 --> 13.9637032 sigma out 1act.( 11.511157 sig in 9act.) RANK 9 NODE 12 --> 10.7882757 sigma out 1act.( 11.6816711 sig in 9act.) RANK 10 NODE 6 --> 6.13370752 sigma out 1act.( 6.88186646 sig in 9act.) RANK 11 NODE 11 --> 6.07755089 sigma out 1act.( 4.43617964 sig in 9act.) RANK 12 NODE 7 --> 4.15532923 sigma out 1act.( 2.31103754 sig in 9act.) RANK 13 NODE 5 --> 3.84610343 sigma out 1act.( 3.74377608 sig in 9act.) RANK 14 NODE 10 --> 2.79330397 sigma out 1act.( 2.15474343 sig in 9act.) RANK 15 NODE 4 --> 2.11414719 sigma out 1act.( 2.06406546 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 74.2653275 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 32.8035507 sigma out 15 active outputs RANK 2 NODE 6 --> 28.9896908 sigma out 15 active outputs RANK 3 NODE 7 --> 26.1970596 sigma out 15 active outputs RANK 4 NODE 1 --> 25.2215462 sigma out 15 active outputs RANK 5 NODE 3 --> 20.7556801 sigma out 15 active outputs RANK 6 NODE 4 --> 15.629632 sigma out 15 active outputs RANK 7 NODE 5 --> 15.2451334 sigma out 15 active outputs RANK 8 NODE 8 --> 13.9429693 sigma out 15 active outputs RANK 9 NODE 9 --> 11.6552429 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 33.0838966 sigma in 9act. ( 36.8672562 sig out 1act.) RANK 2 NODE 1 --> 26.8049049 sigma in 9act. ( 25.8736935 sig out 1act.) RANK 3 NODE 3 --> 24.2164974 sigma in 9act. ( 24.7654495 sig out 1act.) RANK 4 NODE 13 --> 21.1821136 sigma in 9act. ( 22.4314919 sig out 1act.) RANK 5 NODE 8 --> 19.6406097 sigma in 9act. ( 18.3440781 sig out 1act.) RANK 6 NODE 9 --> 16.7428608 sigma in 9act. ( 16.0864544 sig out 1act.) RANK 7 NODE 14 --> 14.9364538 sigma in 9act. ( 14.5028114 sig out 1act.) RANK 8 NODE 2 --> 13.1019173 sigma in 9act. ( 12.8301277 sig out 1act.) RANK 9 NODE 7 --> 11.9485807 sigma in 9act. ( 7.18840504 sig out 1act.) RANK 10 NODE 12 --> 11.3328362 sigma in 9act. ( 10.091157 sig out 1act.) RANK 11 NODE 6 --> 8.91641712 sigma in 9act. ( 5.21476793 sig out 1act.) RANK 12 NODE 10 --> 8.21198082 sigma in 9act. ( 3.74759865 sig out 1act.) RANK 13 NODE 11 --> 8.1931076 sigma in 9act. ( 6.91219282 sig out 1act.) RANK 14 NODE 4 --> 7.91893578 sigma in 9act. ( 2.93032861 sig out 1act.) RANK 15 NODE 5 --> 4.43352509 sigma in 9act. ( 3.54332757 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 36.8672562 sigma out 1act.( 33.0838966 sig in 9act.) RANK 2 NODE 1 --> 25.8736935 sigma out 1act.( 26.8049049 sig in 9act.) RANK 3 NODE 3 --> 24.7654495 sigma out 1act.( 24.2164974 sig in 9act.) RANK 4 NODE 13 --> 22.4314919 sigma out 1act.( 21.1821136 sig in 9act.) RANK 5 NODE 8 --> 18.3440781 sigma out 1act.( 19.6406097 sig in 9act.) RANK 6 NODE 9 --> 16.0864544 sigma out 1act.( 16.7428608 sig in 9act.) RANK 7 NODE 14 --> 14.5028114 sigma out 1act.( 14.9364538 sig in 9act.) RANK 8 NODE 2 --> 12.8301277 sigma out 1act.( 13.1019173 sig in 9act.) RANK 9 NODE 12 --> 10.091157 sigma out 1act.( 11.3328362 sig in 9act.) RANK 10 NODE 7 --> 7.18840504 sigma out 1act.( 11.9485807 sig in 9act.) RANK 11 NODE 11 --> 6.91219282 sigma out 1act.( 8.1931076 sig in 9act.) RANK 12 NODE 6 --> 5.21476793 sigma out 1act.( 8.91641712 sig in 9act.) RANK 13 NODE 10 --> 3.74759865 sigma out 1act.( 8.21198082 sig in 9act.) RANK 14 NODE 5 --> 3.54332757 sigma out 1act.( 4.43352509 sig in 9act.) RANK 15 NODE 4 --> 2.93032861 sigma out 1act.( 7.91893578 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.1742249 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.473448277 *** contribution from regularisation: 0.00389525457 *** contribution from error: -0.477343529 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.526011646 *** contribution from regularisation: 0.0024170957 *** contribution from error: -0.528428733 *********************************************** -----------------> Test sample ENTER BFGS code START -46937.0518 0.127656624 0.00769650238 EXIT FROM BFGS code FG_START 0. 0.127656624 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.551262796 *** contribution from regularisation: 0.00219292054 *** contribution from error: -0.55345571 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49180.9082 0.127656624 -65.8310089 EXIT FROM BFGS code FG_LNSRCH 0. 0.111044846 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.57951498 *** contribution from regularisation: 0.00266703102 *** contribution from error: -0.58218199 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51701.4279 0.111044846 -24.2019653 EXIT FROM BFGS code NEW_X -51701.4279 0.111044846 -24.2019653 ENTER BFGS code NEW_X -51701.4279 0.111044846 -24.2019653 EXIT FROM BFGS code FG_LNSRCH 0. 0.104204901 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.582208097 *** contribution from regularisation: 0.00269309967 *** contribution from error: -0.584901214 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51941.6935 0.104204901 -14.0490112 EXIT FROM BFGS code NEW_X -51941.6935 0.104204901 -14.0490112 ENTER BFGS code NEW_X -51941.6935 0.104204901 -14.0490112 EXIT FROM BFGS code FG_LNSRCH 0. 0.0944801122 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.5837515 *** contribution from regularisation: 0.00267694728 *** contribution from error: -0.586428463 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52079.3922 0.0944801122 -3.75289416 EXIT FROM BFGS code NEW_X -52079.3922 0.0944801122 -3.75289416 ENTER BFGS code NEW_X -52079.3922 0.0944801122 -3.75289416 EXIT FROM BFGS code FG_LNSRCH 0. 0.0901719779 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.583961308 *** contribution from regularisation: 0.00265165768 *** contribution from error: -0.58661294 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52098.1084 0.0901719779 0.995166361 EXIT FROM BFGS code NEW_X -52098.1084 0.0901719779 0.995166361 ENTER BFGS code NEW_X -52098.1084 0.0901719779 0.995166361 EXIT FROM BFGS code FG_LNSRCH 0. 0.0872826502 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.58416301 *** contribution from regularisation: 0.00258993101 *** contribution from error: -0.586752951 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52116.1006 0.0872826502 -1.52171052 EXIT FROM BFGS code NEW_X -52116.1006 0.0872826502 -1.52171052 ENTER BFGS code NEW_X -52116.1006 0.0872826502 -1.52171052 EXIT FROM BFGS code FG_LNSRCH 0. 0.0769277737 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.584547043 *** contribution from regularisation: 0.00241821399 *** contribution from error: -0.586965263 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52150.3623 0.0769277737 -1.22412443 EXIT FROM BFGS code NEW_X -52150.3623 0.0769277737 -1.22412443 ENTER BFGS code NEW_X -52150.3623 0.0769277737 -1.22412443 EXIT FROM BFGS code FG_LNSRCH 0. 0.0515321419 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 34.2365952 sigma out 15 active outputs RANK 2 NODE 1 --> 19.0520802 sigma out 15 active outputs RANK 3 NODE 8 --> 16.1535854 sigma out 15 active outputs RANK 4 NODE 6 --> 15.3072834 sigma out 15 active outputs RANK 5 NODE 7 --> 10.9989939 sigma out 15 active outputs RANK 6 NODE 4 --> 9.67823792 sigma out 15 active outputs RANK 7 NODE 5 --> 9.50383472 sigma out 15 active outputs RANK 8 NODE 3 --> 7.98743391 sigma out 15 active outputs RANK 9 NODE 9 --> 7.26223421 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 26.5953465 sigma in 9act. ( 26.6439934 sig out 1act.) RANK 2 NODE 14 --> 20.9546757 sigma in 9act. ( 15.1742783 sig out 1act.) RANK 3 NODE 3 --> 18.7683372 sigma in 9act. ( 14.6338921 sig out 1act.) RANK 4 NODE 1 --> 15.2015495 sigma in 9act. ( 14.5720005 sig out 1act.) RANK 5 NODE 10 --> 13.2033234 sigma in 9act. ( 10.4452677 sig out 1act.) RANK 6 NODE 4 --> 11.4210777 sigma in 9act. ( 8.12238312 sig out 1act.) RANK 7 NODE 11 --> 11.052887 sigma in 9act. ( 9.63814449 sig out 1act.) RANK 8 NODE 9 --> 11.0079069 sigma in 9act. ( 9.08707142 sig out 1act.) RANK 9 NODE 12 --> 7.29516745 sigma in 9act. ( 7.17662764 sig out 1act.) RANK 10 NODE 8 --> 6.37112236 sigma in 9act. ( 5.80353355 sig out 1act.) RANK 11 NODE 5 --> 4.7458272 sigma in 9act. ( 3.46363282 sig out 1act.) RANK 12 NODE 13 --> 4.04093933 sigma in 9act. ( 2.12533283 sig out 1act.) RANK 13 NODE 6 --> 3.90486836 sigma in 9act. ( 0.649479747 sig out 1act.) RANK 14 NODE 15 --> 3.82290602 sigma in 9act. ( 1.59903371 sig out 1act.) RANK 15 NODE 2 --> 3.39157772 sigma in 9act. ( 2.13897681 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 26.6439934 sigma out 1act.( 26.5953465 sig in 9act.) RANK 2 NODE 14 --> 15.1742783 sigma out 1act.( 20.9546757 sig in 9act.) RANK 3 NODE 3 --> 14.6338921 sigma out 1act.( 18.7683372 sig in 9act.) RANK 4 NODE 1 --> 14.5720005 sigma out 1act.( 15.2015495 sig in 9act.) RANK 5 NODE 10 --> 10.4452677 sigma out 1act.( 13.2033234 sig in 9act.) RANK 6 NODE 11 --> 9.63814449 sigma out 1act.( 11.052887 sig in 9act.) RANK 7 NODE 9 --> 9.08707142 sigma out 1act.( 11.0079069 sig in 9act.) RANK 8 NODE 4 --> 8.12238312 sigma out 1act.( 11.4210777 sig in 9act.) RANK 9 NODE 12 --> 7.17662764 sigma out 1act.( 7.29516745 sig in 9act.) RANK 10 NODE 8 --> 5.80353355 sigma out 1act.( 6.37112236 sig in 9act.) RANK 11 NODE 5 --> 3.46363282 sigma out 1act.( 4.7458272 sig in 9act.) RANK 12 NODE 2 --> 2.13897681 sigma out 1act.( 3.39157772 sig in 9act.) RANK 13 NODE 13 --> 2.12533283 sigma out 1act.( 4.04093933 sig in 9act.) RANK 14 NODE 15 --> 1.59903371 sigma out 1act.( 3.82290602 sig in 9act.) RANK 15 NODE 6 --> 0.649479747 sigma out 1act.( 3.90486836 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.7370262 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.584820509 *** contribution from regularisation: 0.0021333464 *** contribution from error: -0.586953878 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52174.7616 0.0515321419 -6.73217297 EXIT FROM BFGS code NEW_X -52174.7616 0.0515321419 -6.73217297 ENTER BFGS code NEW_X -52174.7616 0.0515321419 -6.73217297 EXIT FROM BFGS code FG_LNSRCH 0. 0.0359528698 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.585083067 *** contribution from regularisation: 0.00224769372 *** contribution from error: -0.587330759 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52198.185 0.0359528698 -5.32756042 EXIT FROM BFGS code NEW_X -52198.185 0.0359528698 -5.32756042 ENTER BFGS code NEW_X -52198.185 0.0359528698 -5.32756042 EXIT FROM BFGS code FG_LNSRCH 0. 0.0347131938 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.585391402 *** contribution from regularisation: 0.00222346815 *** contribution from error: -0.587614894 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52225.6931 0.0347131938 -0.29036364 EXIT FROM BFGS code NEW_X -52225.6931 0.0347131938 -0.29036364 ENTER BFGS code NEW_X -52225.6931 0.0347131938 -0.29036364 EXIT FROM BFGS code FG_LNSRCH 0. 0.028271392 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.585391581 *** contribution from regularisation: 0.00220443378 *** contribution from error: -0.587595999 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52225.7116 0.028271392 -1.57111406 EXIT FROM BFGS code NEW_X -52225.7116 0.028271392 -1.57111406 ENTER BFGS code NEW_X -52225.7116 0.028271392 -1.57111406 EXIT FROM BFGS code FG_LNSRCH 0. 0.0275221355 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.585383952 *** contribution from regularisation: 0.00224889163 *** contribution from error: -0.587632835 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52225.0307 0.0275221355 -3.25762057 EXIT FROM BFGS code FG_LNSRCH 0. 0.0281216484 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.58532995 *** contribution from regularisation: 0.00227492768 *** contribution from error: -0.58760488 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52220.2125 0.0281216484 -1.92027307 EXIT FROM BFGS code FG_LNSRCH 0. 0.0282674953 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.585327864 *** contribution from regularisation: 0.00226844219 *** contribution from error: -0.587596297 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52220.0254 0.0282674953 -1.59595287 EXIT FROM BFGS code FG_LNSRCH 0. 0.0282713883 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.585335076 *** contribution from regularisation: 0.00226096855 *** contribution from error: -0.587596059 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52220.6678 0.0282713883 -1.59372807 EXIT FROM BFGS code FG_LNSRCH 0. 0.028271392 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.585337996 *** contribution from regularisation: 0.00225801975 *** contribution from error: -0.587595999 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52220.9309 0.028271392 -1.60244894 EXIT FROM BFGS code FG_LNSRCH 0. 0.028271392 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.585322917 *** contribution from regularisation: 0.00227313512 *** contribution from error: -0.587596059 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52219.5824 0.028271392 -1.60488605 EXIT FROM BFGS code FG_LNSRCH 0. 0.028271392 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 35.168438 sigma out 15 active outputs RANK 2 NODE 1 --> 18.5601234 sigma out 15 active outputs RANK 3 NODE 6 --> 17.9030342 sigma out 15 active outputs RANK 4 NODE 8 --> 15.9105368 sigma out 15 active outputs RANK 5 NODE 4 --> 11.1943035 sigma out 15 active outputs RANK 6 NODE 5 --> 10.4042377 sigma out 15 active outputs RANK 7 NODE 7 --> 9.08699512 sigma out 15 active outputs RANK 8 NODE 9 --> 8.44691563 sigma out 15 active outputs RANK 9 NODE 3 --> 7.15105581 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 29.4006386 sigma in 9act. ( 31.4838181 sig out 1act.) RANK 2 NODE 14 --> 22.049078 sigma in 9act. ( 15.5045614 sig out 1act.) RANK 3 NODE 3 --> 17.862608 sigma in 9act. ( 15.5767546 sig out 1act.) RANK 4 NODE 1 --> 14.9719343 sigma in 9act. ( 14.3773432 sig out 1act.) RANK 5 NODE 10 --> 13.7750168 sigma in 9act. ( 11.3321285 sig out 1act.) RANK 6 NODE 11 --> 11.7291918 sigma in 9act. ( 10.3728342 sig out 1act.) RANK 7 NODE 9 --> 10.9229155 sigma in 9act. ( 8.20919895 sig out 1act.) RANK 8 NODE 4 --> 10.9010983 sigma in 9act. ( 7.69704723 sig out 1act.) RANK 9 NODE 12 --> 6.84651041 sigma in 9act. ( 6.93168688 sig out 1act.) RANK 10 NODE 8 --> 5.54011059 sigma in 9act. ( 4.79500103 sig out 1act.) RANK 11 NODE 5 --> 4.62300014 sigma in 9act. ( 3.4368751 sig out 1act.) RANK 12 NODE 6 --> 3.30611992 sigma in 9act. ( 0.591671169 sig out 1act.) RANK 13 NODE 15 --> 3.02174091 sigma in 9act. ( 0.819924891 sig out 1act.) RANK 14 NODE 13 --> 2.95036221 sigma in 9act. ( 0.151979163 sig out 1act.) RANK 15 NODE 2 --> 2.57240415 sigma in 9act. ( 1.33803487 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 31.4838181 sigma out 1act.( 29.4006386 sig in 9act.) RANK 2 NODE 3 --> 15.5767546 sigma out 1act.( 17.862608 sig in 9act.) RANK 3 NODE 14 --> 15.5045614 sigma out 1act.( 22.049078 sig in 9act.) RANK 4 NODE 1 --> 14.3773432 sigma out 1act.( 14.9719343 sig in 9act.) RANK 5 NODE 10 --> 11.3321285 sigma out 1act.( 13.7750168 sig in 9act.) RANK 6 NODE 11 --> 10.3728342 sigma out 1act.( 11.7291918 sig in 9act.) RANK 7 NODE 9 --> 8.20919895 sigma out 1act.( 10.9229155 sig in 9act.) RANK 8 NODE 4 --> 7.69704723 sigma out 1act.( 10.9010983 sig in 9act.) RANK 9 NODE 12 --> 6.93168688 sigma out 1act.( 6.84651041 sig in 9act.) RANK 10 NODE 8 --> 4.79500103 sigma out 1act.( 5.54011059 sig in 9act.) RANK 11 NODE 5 --> 3.4368751 sigma out 1act.( 4.62300014 sig in 9act.) RANK 12 NODE 2 --> 1.33803487 sigma out 1act.( 2.57240415 sig in 9act.) RANK 13 NODE 15 --> 0.819924891 sigma out 1act.( 3.02174091 sig in 9act.) RANK 14 NODE 6 --> 0.591671169 sigma out 1act.( 3.30611992 sig in 9act.) RANK 15 NODE 13 --> 0.151979163 sigma out 1act.( 2.95036221 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.1443634 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.585341394 *** contribution from regularisation: 0.00225465745 *** contribution from error: -0.587596059 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52221.2309 0.028271392 -1.60968792 EXIT FROM BFGS code NEW_X -52221.2309 0.028271392 -1.60968792 ENTER BFGS code NEW_X -52221.2309 0.028271392 -1.60968792 EXIT FROM BFGS code CONVERGENC -52221.2309 0.028271392 -1.60968792 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 58.1940308 sigma out 15 active outputs RANK 2 NODE 6 --> 30.9791794 sigma out 15 active outputs RANK 3 NODE 1 --> 30.7050056 sigma out 15 active outputs RANK 4 NODE 8 --> 26.3868484 sigma out 15 active outputs RANK 5 NODE 4 --> 18.6431503 sigma out 15 active outputs RANK 6 NODE 5 --> 17.2798824 sigma out 15 active outputs RANK 7 NODE 7 --> 14.9838009 sigma out 15 active outputs RANK 8 NODE 9 --> 13.7999668 sigma out 15 active outputs RANK 9 NODE 3 --> 11.5877399 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 50.1470871 sigma in 9act. ( 53.9023247 sig out 1act.) RANK 2 NODE 14 --> 37.1930962 sigma in 9act. ( 26.3020363 sig out 1act.) RANK 3 NODE 3 --> 29.8499203 sigma in 9act. ( 26.5594788 sig out 1act.) RANK 4 NODE 1 --> 24.5114288 sigma in 9act. ( 24.5392399 sig out 1act.) RANK 5 NODE 10 --> 22.7229519 sigma in 9act. ( 19.2327404 sig out 1act.) RANK 6 NODE 11 --> 19.1621761 sigma in 9act. ( 17.8115578 sig out 1act.) RANK 7 NODE 4 --> 17.7036915 sigma in 9act. ( 13.1909657 sig out 1act.) RANK 8 NODE 9 --> 17.6087475 sigma in 9act. ( 14.0805464 sig out 1act.) RANK 9 NODE 12 --> 11.0545855 sigma in 9act. ( 11.4972677 sig out 1act.) RANK 10 NODE 8 --> 8.33828926 sigma in 9act. ( 8.19457054 sig out 1act.) RANK 11 NODE 5 --> 7.16000319 sigma in 9act. ( 5.66318369 sig out 1act.) RANK 12 NODE 6 --> 3.4109621 sigma in 9act. ( 1.01552522 sig out 1act.) RANK 13 NODE 15 --> 3.24600434 sigma in 9act. ( 1.37852252 sig out 1act.) RANK 14 NODE 2 --> 3.14711642 sigma in 9act. ( 2.22682858 sig out 1act.) RANK 15 NODE 13 --> 2.95654106 sigma in 9act. ( 0.253283083 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 53.9023247 sigma out 1act.( 50.1470871 sig in 9act.) RANK 2 NODE 3 --> 26.5594788 sigma out 1act.( 29.8499203 sig in 9act.) RANK 3 NODE 14 --> 26.3020363 sigma out 1act.( 37.1930962 sig in 9act.) RANK 4 NODE 1 --> 24.5392399 sigma out 1act.( 24.5114288 sig in 9act.) RANK 5 NODE 10 --> 19.2327404 sigma out 1act.( 22.7229519 sig in 9act.) RANK 6 NODE 11 --> 17.8115578 sigma out 1act.( 19.1621761 sig in 9act.) RANK 7 NODE 9 --> 14.0805464 sigma out 1act.( 17.6087475 sig in 9act.) RANK 8 NODE 4 --> 13.1909657 sigma out 1act.( 17.7036915 sig in 9act.) RANK 9 NODE 12 --> 11.4972677 sigma out 1act.( 11.0545855 sig in 9act.) RANK 10 NODE 8 --> 8.19457054 sigma out 1act.( 8.33828926 sig in 9act.) RANK 11 NODE 5 --> 5.66318369 sigma out 1act.( 7.16000319 sig in 9act.) RANK 12 NODE 2 --> 2.22682858 sigma out 1act.( 3.14711642 sig in 9act.) RANK 13 NODE 15 --> 1.37852252 sigma out 1act.( 3.24600434 sig in 9act.) RANK 14 NODE 6 --> 1.01552522 sigma out 1act.( 3.4109621 sig in 9act.) RANK 15 NODE 13 --> 0.253283083 sigma out 1act.( 2.95654106 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 78.763031 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.585342765 *** contribution from regularisation: 0.00225324766 *** contribution from error: -0.587595999 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done