NNInput NNInputs_125.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 183063 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 46727 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 46727 Chosen entries: 46727 Signal fraction: 1 Background fraction: 0.342734 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 46727 Entries to split: 46727 Test with : 23363 Train with : 23363 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 46727 for Signal Prepared event 0 for Signal with 46727 events ====Entry 0 Variable Ht : 120.494 Variable LepAPt : 52.8932 Variable LepBPt : 13.787 Variable MetSigLeptonsJets : 6.59008 Variable MetSpec : 53.8132 Variable SumEtLeptonsJets : 66.6802 Variable VSumJetLeptonsPt : 66.139 Variable addEt : 120.494 Variable dPhiLepSumMet : 2.99118 Variable dPhiLeptons : 0.315251 Variable dRLeptons : 0.406645 Variable lep1_E : 70.3851 Variable lep2_E : 15.8115 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2125 Ht = 120.494 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 52.8933 LepAPt = 52.8932 LepBEt = 13.787 LepBPt = 13.787 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 53.8132 MetDelPhi = 2.92651 MetSig = 4.22058 MetSigLeptonsJets = 6.59008 MetSpec = 53.8132 Mjj = 0 MostCentralJetEta = 0 MtllMet = 129.103 Njets = 0 SB = 0 SumEt = 162.568 SumEtJets = 0 SumEtLeptonsJets = 66.6802 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 66.139 addEt = 120.494 dPhiLepSumMet = 2.99118 dPhiLeptons = 0.315251 dRLeptons = 0.406645 diltype = 49 dimass = 10.9671 event = 2092 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 70.3851 lep2_E = 15.8115 rand = 0.999742 run = 235158 weight = 1.4937e-06 ===Show End Prepared event 10000 for Signal with 46727 events Prepared event 20000 for Signal with 46727 events Prepared event 30000 for Signal with 46727 events Prepared event 40000 for Signal with 46727 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.344546 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4433 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 183063 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4433 negative weights. Signal fraction: 62.4121132 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 62.8013802 65.172287 66.837883 68.1521912 69.0625381 70.0747452 70.861618 71.6364288 72.4174347 73.1919174 73.9556885 74.5436249 75.2203064 75.819809 76.5247192 77.1142731 77.869278 78.4514084 79.0516586 79.6556396 80.3447342 80.9046783 81.5687561 82.2556381 82.9047852 83.7436218 84.6116638 85.3517914 86.2748566 87.2802429 88.2693329 89.0440674 89.8910065 90.8921509 91.8485413 92.931015 93.6699219 94.6103363 95.6188278 96.689949 97.6611862 98.5117035 99.529213 100.409195 101.43158 102.190735 103.173889 104.053856 104.71096 105.612595 106.423706 107.465805 108.368942 109.303726 110.344788 111.359421 112.278778 113.102379 113.984566 114.994568 116.016068 117.139877 118.119644 119.333221 120.581215 121.687729 122.846634 124.105347 125.432617 126.83844 128.337189 130.029205 131.67157 133.474762 135.280472 137.25351 139.265808 141.373184 143.460358 145.706085 148.075287 150.210892 153.075821 155.53302 158.37677 160.978912 164.315613 168.180573 172.159851 176.598846 181.784897 187.09967 193.538544 201.038818 210.263458 222.771545 239.529617 265.292725 315.467773 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3053455 20.5951614 20.8765259 21.1272011 21.3763981 21.5914936 21.8461761 22.0482864 22.2307625 22.424839 22.6105003 22.7896347 22.9730721 23.1572266 23.2998943 23.4920521 23.6970501 23.9073448 24.1140194 24.3167057 24.4968777 24.6812611 24.8634758 25.0541344 25.2174377 25.4075165 25.6029663 25.7627106 25.9291306 26.1332531 26.318779 26.5099239 26.7033195 26.9173965 27.1072445 27.2814312 27.503767 27.6963501 27.8869495 28.0786057 28.2577667 28.4560871 28.6345463 28.8371315 29.0243416 29.2330456 29.4424171 29.6659012 29.9020882 30.1292 30.358242 30.5768337 30.8019352 31.027359 31.2639942 31.513443 31.7318707 31.9365997 32.1953354 32.4483719 32.7118454 32.9870071 33.2398834 33.5055008 33.7983398 34.0881233 34.3574524 34.6729088 34.9882126 35.2990799 35.5991631 35.9407501 36.2856522 36.6303253 36.9910469 37.3739471 37.7337341 38.1950226 38.6836319 39.1707687 39.6484604 40.1511154 40.6738205 41.0281219 41.6801834 42.3286133 43.0252609 43.8237686 44.5951042 45.4652481 46.4654083 47.6718903 48.9559402 50.5166855 52.242897 54.639431 57.7041473 62.5971909 70.9400101 174.934341 ------------------------------ Transdef: Tab for variable 4 10.0002098 10.1119041 10.2161798 10.3467503 10.4404287 10.5477505 10.6443768 10.7583027 10.8532372 10.9639187 11.0809107 11.2019424 11.305892 11.4122581 11.5006447 11.6147003 11.7432823 11.8498821 11.9733028 12.095459 12.2215719 12.3342047 12.4608288 12.5936146 12.7214108 12.8300371 12.9487391 13.0820713 13.2315998 13.3660603 13.4957876 13.6308041 13.7715778 13.8826218 14.0052013 14.1420841 14.2664032 14.3971252 14.5345869 14.6881256 14.8358402 15.0117006 15.1721869 15.3240318 15.4621944 15.6268787 15.7879696 15.9415569 16.1094513 16.3172703 16.4715195 16.6338997 16.798687 16.9580841 17.1414566 17.3348293 17.5329933 17.7027931 17.8989983 18.0223999 18.2275467 18.423317 18.6282463 18.8464012 19.0415306 19.2330475 19.4663925 19.6820946 19.9122772 20.1338673 20.2907333 20.4491539 20.6610355 20.8946247 21.1311417 21.3478584 21.5626678 21.7873478 22.0469933 22.2879677 22.5571823 22.8374138 23.1555424 23.4592094 23.7660198 24.1099548 24.4635963 24.8456993 25.2458572 25.710125 26.175663 26.5981045 27.1336079 27.7907753 28.4427414 29.2507954 30.2908821 31.5975418 33.6924667 37.6440544 72.3692474 ------------------------------ Transdef: Tab for variable 5 1.12756646 2.40248609 2.81608677 3.09127569 3.31593227 3.51599455 3.70806932 3.86919808 4.00374937 4.11657047 4.21517277 4.31271362 4.40269327 4.4942441 4.57108974 4.64388943 4.71682262 4.79136992 4.86367893 4.93201876 5.0008707 5.05721903 5.11976051 5.17547035 5.23563194 5.28106308 5.33203125 5.37887621 5.42872334 5.47462749 5.52017307 5.55212402 5.59379387 5.63732529 5.68310452 5.72768688 5.76888275 5.81261444 5.85098505 5.89813328 5.94148731 5.98352337 6.0228548 6.06158543 6.10380936 6.14424849 6.18674088 6.21961832 6.25680256 6.28483915 6.32435465 6.36650991 6.40731049 6.44844103 6.48835182 6.52571201 6.56777382 6.60959148 6.63889599 6.67708397 6.7193408 6.7603631 6.79407167 6.83224583 6.87222147 6.91103601 6.95639038 6.9897933 7.03186321 7.07396221 7.12243176 7.16871548 7.21289825 7.25813341 7.30986547 7.35295105 7.39794683 7.44124222 7.49303722 7.54125023 7.59794283 7.64849377 7.70030212 7.76132011 7.82893801 7.88942766 7.9566164 8.02578926 8.10295296 8.1890173 8.26323986 8.37171555 8.47914505 8.60594368 8.73587799 8.90425491 9.13193893 9.40877342 9.81786823 10.6979179 17.7251911 ------------------------------ Transdef: Tab for variable 6 15.0050735 19.542984 23.9069061 25.65728 26.5358715 27.2834206 28.0296192 28.8050423 29.5034866 30.2062035 30.7375946 31.3462543 31.8925552 32.3432617 32.802887 33.2304001 33.5815468 33.9575272 34.3357697 34.7193985 35.0656509 35.4443512 35.8191452 36.1529999 36.4928589 36.7861557 37.1058617 37.4647064 37.8240356 38.1539307 38.4900284 38.8395844 39.1868668 39.516449 39.8610458 40.2007408 40.5098648 40.8321609 41.1764832 41.5455322 41.9090271 42.2315407 42.5945892 42.9155884 43.1560974 43.5725403 43.9297562 44.2709198 44.6817474 45.1018753 45.574337 45.9851837 46.4293976 46.8457565 47.2996902 47.6815948 48.1288605 48.5990677 49.0241394 49.4312515 49.8869095 50.2701874 50.6098938 51.0410614 51.5531921 52.0336494 52.4715958 52.9951477 53.4765701 53.9689407 54.5000916 54.9809608 55.4545937 55.9568939 56.4725914 56.8959084 57.3779907 57.9414673 58.4892197 59.083931 59.6752853 60.2652435 60.9352722 61.6579819 62.3710136 63.2537918 64.1275482 65.0892944 66.1411896 67.2965698 68.6472321 69.9902039 71.7199402 73.6121063 75.958725 77.5434418 80.9659805 84.6347504 90.7047501 100.502747 211.489212 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.9022598 33.6419983 34.259922 34.8337402 35.3559952 35.8143921 36.2962646 36.7422943 37.050705 37.4440002 37.7768402 38.098114 38.3822784 38.6740112 38.9254379 39.2347374 39.5595284 39.8358917 40.137764 40.4174385 40.7712097 41.0971031 41.4502144 41.7843933 42.0866661 42.4936409 42.942482 43.3142853 43.7762527 44.3122482 44.7373276 45.1811333 45.5937576 46.0602684 46.5682755 47.2003098 47.8721313 48.3388672 48.9468765 49.3877068 49.9622574 50.5795898 51.1139832 51.7054749 52.2827377 52.819313 53.396122 54.009552 54.6201706 55.1929398 55.8575439 56.4145126 57.0108452 57.6780014 58.3154144 58.9644547 59.6996422 60.3977242 61.0040283 61.6994553 62.6005325 63.6587219 64.471962 65.5076675 66.5841675 67.9259415 68.970932 70.3962173 71.5628204 72.9165039 74.2174149 75.6072388 76.7894287 78.27742 79.7636719 81.3626862 82.921524 84.5873337 86.3980789 88.2185211 90.1653061 92.2924194 94.3204956 96.7647095 99.2957687 102.162918 105.306335 108.699738 112.170059 115.634079 119.961449 124.901123 130.704224 137.450211 145.011688 155.441162 168.651031 189.279602 226.026093 475.479645 ------------------------------ Transdef: Tab for variable 8 2.53947878 21.7487946 26.501503 28.9173851 30.6477146 31.6810646 32.3688736 32.9515228 33.4352875 33.8399887 34.2552605 34.613327 34.9541779 35.2732162 35.6119766 35.9761047 36.2649078 36.5583801 36.8246613 37.0727539 37.3436432 37.6087151 37.840889 38.0964775 38.3119545 38.5946007 38.8501968 39.0776672 39.3317261 39.6041107 39.8446541 40.1190681 40.3959427 40.6817856 41.0133476 41.283905 41.5905457 41.8730545 42.1846771 42.4970322 42.8739204 43.1811523 43.5896912 43.8768921 44.2308578 44.5172348 44.8797951 45.277771 45.666626 46.0340271 46.4612694 46.8399086 47.2837448 47.7566681 48.0533524 48.3478546 48.7590637 49.2012405 49.5701981 50.0102463 50.4462738 50.8807831 51.2718811 51.6673584 52.1375847 52.5886879 53.0259552 53.4210701 53.9181137 54.4057503 54.8494301 55.3481216 55.8101807 56.3062782 56.8505173 57.3510971 57.8741913 58.3820839 58.9507828 59.5280228 60.1327896 60.7890244 61.4070206 62.1852875 63.0051575 63.8152237 64.7863617 65.767334 66.9346313 68.3531113 69.9773865 71.7349091 73.629631 75.6854706 78.1161194 80.9699402 84.9039841 90.2050934 98.0304108 116.218613 326.868286 ------------------------------ Transdef: Tab for variable 9 49.2546883 62.3699341 64.3705902 66.1102676 67.3123169 68.3629913 69.1985855 69.9402161 70.7077942 71.3891602 72.0287018 72.7352295 73.3865356 73.9987335 74.5436249 75.1422729 75.622963 76.1919708 76.7072449 77.2044449 77.8330078 78.3585358 78.8153839 79.3626862 79.8667603 80.4138031 80.9046783 81.4430084 82.0051804 82.54319 83.1300354 83.7581482 84.4401093 84.9638977 85.6673431 86.3250885 86.8784637 87.5716095 88.4087219 88.9645691 89.5395279 90.2857742 91.0629807 91.8042297 92.5689621 93.1838379 93.918869 94.6074677 95.3963928 96.1361923 96.8651199 97.6109009 98.3541718 99.057663 99.8089142 100.597427 101.336739 101.982437 102.661133 103.332504 104.111755 104.800797 105.478661 106.194839 106.888458 107.610947 108.331757 109.093643 109.830017 110.585892 111.320267 112.047546 112.76165 113.423058 114.149498 114.902237 115.639618 116.492706 117.280045 118.062004 118.930206 119.823883 120.712875 121.61908 122.555702 123.55304 124.638885 125.820595 127.036774 128.528397 130.133636 131.984375 134.104767 136.651566 139.857178 143.477997 148.581055 155.447021 167.500153 192.944946 385.645142 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.769207835 1.09907997 1.32126021 1.49905705 1.62834942 1.73779774 1.84139693 1.92103016 1.99996781 2.07119799 2.13495731 2.19060278 2.24130201 2.28860497 2.3286252 2.37191844 2.4123311 2.44511104 2.47949123 2.51211071 2.54266644 2.57287979 2.60082102 2.62354517 2.64581156 2.66865349 2.69146705 2.71286011 2.73182249 2.75189137 2.76935148 2.78585815 2.80140829 2.81680131 2.82944822 2.84135962 2.85192108 2.86283445 2.87422299 2.88361001 2.89369774 2.90259743 2.91320229 2.91993999 2.92814302 2.93639684 2.94393158 2.95084572 2.95796251 2.96480942 2.97072363 2.97719479 2.98302126 2.98839188 2.99322605 2.99681854 3.00225449 3.00661349 3.01174855 3.01626205 3.02128172 3.02577066 3.02956581 3.03343558 3.03734684 3.04152584 3.04511452 3.04908252 3.05264282 3.0566926 3.05990744 3.06340265 3.06697798 3.07005072 3.0732944 3.07633257 3.07964134 3.08273935 3.08580709 3.08918262 3.09200668 3.09495449 3.09807491 3.10099888 3.10343027 3.10588431 3.10883427 3.1113987 3.11369157 3.11602187 3.11878681 3.12167192 3.12428331 3.1270771 3.12926579 3.13169765 3.13395596 3.13640356 3.13882518 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00478481594 0.00943368487 0.015770806 0.0221768618 0.0295724198 0.0381808877 0.0470746011 0.0562753677 0.0633871853 0.0719355345 0.0803762078 0.0891005844 0.098611474 0.108016729 0.11576426 0.124064565 0.13251844 0.142530322 0.15070641 0.158779621 0.166106939 0.174592733 0.181570768 0.188559055 0.195404172 0.20326221 0.209892154 0.216962814 0.223289013 0.230339706 0.23634842 0.242973059 0.249122977 0.254860699 0.26055789 0.266142219 0.271768838 0.277799249 0.283390254 0.288764358 0.294220924 0.300651431 0.307043552 0.312934399 0.318813086 0.324270606 0.331084132 0.33639586 0.342176616 0.347364664 0.352814853 0.358325481 0.36377424 0.369159937 0.3751477 0.381166458 0.386220664 0.391106367 0.396809459 0.40276292 0.409221709 0.414770186 0.420534402 0.426208735 0.432339609 0.4383986 0.445107996 0.451331556 0.456677824 0.462303668 0.469676375 0.475448608 0.482019603 0.488868713 0.495522976 0.502126217 0.509165525 0.516378522 0.52335012 0.530208528 0.538282394 0.543175042 0.55122757 0.560401678 0.570764422 0.580627918 0.591038704 0.602546573 0.614130199 0.628066301 0.640086412 0.651998937 0.666100502 0.683366418 0.706240952 0.726518691 0.756392479 0.7925722 0.848261833 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.225262374 0.242647856 0.257369339 0.269989252 0.281674683 0.292363763 0.302756906 0.310634077 0.319154024 0.327555835 0.335916311 0.343653798 0.349871665 0.355825603 0.362670183 0.369586796 0.375445515 0.381974399 0.388713658 0.39500618 0.400422066 0.404942155 0.409954309 0.413655818 0.417691261 0.421667039 0.425654978 0.429976344 0.433836222 0.437675208 0.441592157 0.445944726 0.449863732 0.45431 0.458073795 0.461821496 0.465831161 0.47007367 0.474007547 0.477774948 0.481789798 0.485106945 0.488776326 0.49208051 0.496112406 0.499681234 0.503795505 0.507902861 0.511936188 0.516535759 0.521287262 0.524878979 0.52875191 0.532988191 0.537390113 0.541562557 0.546068311 0.549170971 0.5532583 0.557793081 0.561871409 0.567051768 0.57139802 0.576435089 0.580410838 0.585263968 0.589517355 0.594066143 0.598940015 0.604059517 0.609144509 0.614569902 0.619871795 0.62483567 0.631086051 0.637067199 0.643991768 0.650490522 0.657530308 0.664242983 0.670423627 0.677817822 0.683559418 0.691205144 0.699289024 0.708030462 0.715802073 0.723838925 0.733895779 0.743539929 0.753850818 0.763445854 0.775433779 0.792134881 0.807246089 0.825338066 0.849404812 0.876755357 0.915812492 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0293255 21.4026642 22.1672173 22.752861 23.250288 23.7643166 24.237114 24.6889191 25.0538502 25.4249916 25.8228531 26.2105522 26.5733757 26.916214 27.2311325 27.5772724 27.8737373 28.2137642 28.5028324 28.830822 29.0958519 29.4259834 29.6933575 30.0012074 30.278368 30.5496979 30.8370705 31.0656395 31.3309326 31.6063728 31.9084854 32.1948738 32.4112396 32.6694641 33.0061951 33.3046799 33.5998421 33.9197769 34.2418365 34.4732666 34.7870522 35.1113701 35.4128647 35.7611732 36.0832062 36.3207474 36.6782913 37.0286179 37.3573151 37.6871948 38.0803833 38.4380188 38.7246132 39.1036568 39.5429878 39.8758545 40.2850952 40.6898537 41.1436081 41.5524635 42.0505867 42.5154953 42.9235115 43.3938065 43.8384781 44.3899651 44.8797417 45.4467964 46.0502777 46.6017227 47.2230301 47.8410034 48.5039177 49.1924706 49.8992386 50.5916595 51.3021088 52.1019058 52.9330673 53.8069458 54.7112885 55.605545 56.7277794 57.7216949 58.7709656 60.0276451 61.27314 62.7792778 64.4001617 65.9674759 67.4752884 68.8457718 71.0172882 73.3840942 76.3685379 79.3631287 83.5527954 88.3145294 93.8651733 104.821007 248.743759 ------------------------------ Transdef: Tab for variable 14 10.0065498 10.6320944 10.9723301 11.3135529 11.5217104 11.83109 12.0997229 12.3120346 12.5296669 12.7639008 13.0216312 13.2533283 13.5164337 13.7499266 13.9452534 14.1729984 14.3841934 14.581274 14.8012238 15.0350647 15.2362118 15.4351082 15.6658878 15.8965597 16.1203957 16.307209 16.4729614 16.6596298 16.8589058 17.0564575 17.2668076 17.5086174 17.7188721 17.9286041 18.1341553 18.3181267 18.5529194 18.7461472 18.9801254 19.1711426 19.4175377 19.6606178 19.8866997 20.1307755 20.3614388 20.5890999 20.7778091 21.0159168 21.2463531 21.4544582 21.6821918 21.8827744 22.0862427 22.2990971 22.5638161 22.8049393 23.0412216 23.2790031 23.5310364 23.785778 24.0356865 24.314106 24.5686169 24.8360901 25.112812 25.4092293 25.7228374 26.012207 26.3127022 26.6172237 26.9749603 27.2846489 27.5881844 27.9497452 28.1789398 28.5868988 28.9943352 29.3933315 29.7571354 30.2474365 30.7490807 31.2436218 31.701004 32.2370415 32.8662033 33.4665985 34.1168518 34.8456497 35.6733131 36.4985199 37.3508759 38.4265633 39.5523987 40.3340836 41.8175964 43.6546173 45.4585037 48.2069702 52.2206802 59.141983 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 52.2 36.5 32.2 7.0 31.0 50.8 35.3 47.5 -28.6 -8.3 -21.5 3.7 2.0 2 52.2 100.0 61.7 47.5 18.1 58.5 94.2 64.0 89.7 -52.7 -18.9 -41.0 28.5 19.1 3 36.5 61.7 100.0 24.6 -5.6 23.4 65.1 44.0 67.6 -20.0 -20.2 -45.4 62.9 5.9 4 32.2 47.5 24.6 100.0 0.4 22.8 48.9 36.8 52.8 -13.8 -24.2 -51.4 7.3 67.3 5 7.0 18.1 -5.6 0.4 100.0 80.2 -9.5 46.5 45.7 27.5 1.2 2.2 -11.8 -5.8 6 31.0 58.5 23.4 22.8 80.2 100.0 36.1 71.5 74.7 -4.4 -8.6 -18.0 3.7 5.0 7 50.8 94.2 65.1 48.9 -9.5 36.1 100.0 56.7 77.2 -59.6 -18.4 -41.7 33.3 22.1 8 35.3 64.0 44.0 36.8 46.5 71.5 56.7 100.0 76.2 -11.4 -16.6 -31.7 20.3 16.3 9 47.5 89.7 67.6 52.8 45.7 74.7 77.2 76.2 100.0 -26.8 -21.1 -46.6 33.0 23.5 10 -28.6 -52.7 -20.0 -13.8 27.5 -4.4 -59.6 -11.4 -26.8 100.0 4.0 10.7 -8.0 -3.7 11 -8.3 -18.9 -20.2 -24.2 1.2 -8.6 -18.4 -16.6 -21.1 4.0 100.0 54.3 -9.2 -15.9 12 -21.5 -41.0 -45.4 -51.4 2.2 -18.0 -41.7 -31.7 -46.6 10.7 54.3 100.0 -21.2 -27.1 13 3.7 28.5 62.9 7.3 -11.8 3.7 33.3 20.3 33.0 -8.0 -9.2 -21.2 100.0 38.1 14 2.0 19.1 5.9 67.3 -5.8 5.0 22.1 16.3 23.5 -3.7 -15.9 -27.1 38.1 100.0 TOTAL CORRELATION TO TARGET (diagonal) 116.452449 TOTAL CORRELATION OF ALL VARIABLES 58.1287055 ROUND 1: MAX CORR ( 58.1265484) AFTER KILLING INPUT VARIABLE 7 CONTR 0.500773379 ROUND 2: MAX CORR ( 58.1228924) AFTER KILLING INPUT VARIABLE 11 CONTR 0.6519351 ROUND 3: MAX CORR ( 58.110124) AFTER KILLING INPUT VARIABLE 5 CONTR 1.21823656 ROUND 4: MAX CORR ( 58.0734711) AFTER KILLING INPUT VARIABLE 8 CONTR 2.06360568 ROUND 5: MAX CORR ( 57.9663905) AFTER KILLING INPUT VARIABLE 10 CONTR 3.52499858 ROUND 6: MAX CORR ( 57.532793) AFTER KILLING INPUT VARIABLE 12 CONTR 7.07673382 ROUND 7: MAX CORR ( 57.0794857) AFTER KILLING INPUT VARIABLE 13 CONTR 7.20795282 ROUND 8: MAX CORR ( 56.495428) AFTER KILLING INPUT VARIABLE 6 CONTR 8.14458722 ROUND 9: MAX CORR ( 56.3666226) AFTER KILLING INPUT VARIABLE 9 CONTR 3.81277394 ROUND 10: MAX CORR ( 56.126034) AFTER KILLING INPUT VARIABLE 3 CONTR 5.20235053 ROUND 11: MAX CORR ( 52.9085711) AFTER KILLING INPUT VARIABLE 14 CONTR 18.7300506 ROUND 12: MAX CORR ( 52.2259411) AFTER KILLING INPUT VARIABLE 4 CONTR 8.47159776 LAST REMAINING VARIABLE: 2 total correlation to target: 58.1287055 % total significance: 112.802275 sigma correlations of single variables to target: variable 2: 52.2259411 % , in sigma: 101.347603 variable 3: 36.4771188 % , in sigma: 70.7860592 variable 4: 32.2436167 % , in sigma: 62.5706919 variable 5: 6.97822437 % , in sigma: 13.5416672 variable 6: 31.0287456 % , in sigma: 60.2131611 variable 7: 50.7941805 % , in sigma: 98.5691851 variable 8: 35.3498125 % , in sigma: 68.5984531 variable 9: 47.4903201 % , in sigma: 92.1578438 variable 10: -28.6018591 % , in sigma: 55.5036407 variable 11: -8.32228307 % , in sigma: 16.1498946 variable 12: -21.4880422 % , in sigma: 41.6988479 variable 13: 3.72717058 % , in sigma: 7.23280035 variable 14: 1.99282759 % , in sigma: 3.86720269 variables sorted by significance: 1 most relevant variable 2 corr 52.2259407 , in sigma: 101.347603 2 most relevant variable 4 corr 8.47159767 , in sigma: 16.4396486 3 most relevant variable 14 corr 18.730051 , in sigma: 36.346799 4 most relevant variable 3 corr 5.20235062 , in sigma: 10.0954766 5 most relevant variable 9 corr 3.81277394 , in sigma: 7.39891887 6 most relevant variable 6 corr 8.14458752 , in sigma: 15.8050656 7 most relevant variable 13 corr 7.20795298 , in sigma: 13.9874695 8 most relevant variable 12 corr 7.07673359 , in sigma: 13.7328303 9 most relevant variable 10 corr 3.52499866 , in sigma: 6.8404735 10 most relevant variable 8 corr 2.06360579 , in sigma: 4.00455207 11 most relevant variable 5 corr 1.21823657 , in sigma: 2.36406187 12 most relevant variable 11 corr 0.651935101 , in sigma: 1.26511957 13 most relevant variable 7 corr 0.50077337 , in sigma: 0.971781069 global correlations between input variables: variable 2: 99.0736994 % variable 3: 93.413348 % variable 4: 90.3024337 % variable 5: 94.9825226 % variable 6: 93.0372564 % variable 7: 98.5939363 % variable 8: 85.5269815 % variable 9: 98.8263618 % variable 10: 72.5341601 % variable 11: 55.6306461 % variable 12: 73.1226128 % variable 13: 84.02366 % variable 14: 85.8350586 % significance loss when removing single variables: variable 2: corr = 6.10962431 % , sigma = 11.8560962 variable 3: corr = 11.8613059 % , sigma = 23.0175828 variable 4: corr = 14.1672068 % , sigma = 27.4923232 variable 5: corr = 1.32444361 % , sigma = 2.57016308 variable 6: corr = 5.51602942 % , sigma = 10.7041893 variable 7: corr = 0.500773379 % , sigma = 0.971781086 variable 8: corr = 1.73882255 % , sigma = 3.37429053 variable 9: corr = 6.10676662 % , sigma = 11.8505507 variable 10: corr = 3.67690239 % , sigma = 7.13525189 variable 11: corr = 0.609612927 % , sigma = 1.18299082 variable 12: corr = 5.71040209 % , sigma = 11.0813813 variable 13: corr = 7.35417868 % , sigma = 14.2712294 variable 14: corr = 8.05865459 % , sigma = 15.6383075 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 18.9044685 sigma out 15 active outputs RANK 2 NODE 7 --> 17.3110943 sigma out 15 active outputs RANK 3 NODE 10 --> 16.733202 sigma out 15 active outputs RANK 4 NODE 2 --> 14.504364 sigma out 15 active outputs RANK 5 NODE 9 --> 13.091795 sigma out 15 active outputs RANK 6 NODE 4 --> 12.2884216 sigma out 15 active outputs RANK 7 NODE 6 --> 12.0781498 sigma out 15 active outputs RANK 8 NODE 1 --> 11.4815178 sigma out 15 active outputs RANK 9 NODE 11 --> 11.3809977 sigma out 15 active outputs RANK 10 NODE 8 --> 9.99879074 sigma out 15 active outputs RANK 11 NODE 5 --> 7.53343248 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 23.4695854 sigma in 11act. ( 24.8778381 sig out 1act.) RANK 2 NODE 4 --> 22.3209057 sigma in 11act. ( 21.5815716 sig out 1act.) RANK 3 NODE 9 --> 18.9307537 sigma in 11act. ( 21.3078461 sig out 1act.) RANK 4 NODE 3 --> 12.5911617 sigma in 11act. ( 14.0479736 sig out 1act.) RANK 5 NODE 8 --> 11.8613768 sigma in 11act. ( 8.89949226 sig out 1act.) RANK 6 NODE 14 --> 8.47746468 sigma in 11act. ( 6.42399311 sig out 1act.) RANK 7 NODE 13 --> 8.22648811 sigma in 11act. ( 8.29967213 sig out 1act.) RANK 8 NODE 2 --> 6.90291119 sigma in 11act. ( 8.8864994 sig out 1act.) RANK 9 NODE 5 --> 6.64380741 sigma in 11act. ( 7.19294548 sig out 1act.) RANK 10 NODE 15 --> 5.49800682 sigma in 11act. ( 5.22372723 sig out 1act.) RANK 11 NODE 6 --> 5.30286884 sigma in 11act. ( 2.47241902 sig out 1act.) RANK 12 NODE 7 --> 3.83207011 sigma in 11act. ( 1.57049465 sig out 1act.) RANK 13 NODE 12 --> 3.03979754 sigma in 11act. ( 4.68985987 sig out 1act.) RANK 14 NODE 1 --> 2.67198372 sigma in 11act. ( 3.1816082 sig out 1act.) RANK 15 NODE 10 --> 2.52963281 sigma in 11act. ( 4.5158515 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 24.8778381 sigma out 1act.( 23.4695854 sig in 11act.) RANK 2 NODE 4 --> 21.5815716 sigma out 1act.( 22.3209057 sig in 11act.) RANK 3 NODE 9 --> 21.3078461 sigma out 1act.( 18.9307537 sig in 11act.) RANK 4 NODE 3 --> 14.0479736 sigma out 1act.( 12.5911617 sig in 11act.) RANK 5 NODE 8 --> 8.89949226 sigma out 1act.( 11.8613768 sig in 11act.) RANK 6 NODE 2 --> 8.8864994 sigma out 1act.( 6.90291119 sig in 11act.) RANK 7 NODE 13 --> 8.29967213 sigma out 1act.( 8.22648811 sig in 11act.) RANK 8 NODE 5 --> 7.19294548 sigma out 1act.( 6.64380741 sig in 11act.) RANK 9 NODE 14 --> 6.42399311 sigma out 1act.( 8.47746468 sig in 11act.) RANK 10 NODE 15 --> 5.22372723 sigma out 1act.( 5.49800682 sig in 11act.) RANK 11 NODE 12 --> 4.68985987 sigma out 1act.( 3.03979754 sig in 11act.) RANK 12 NODE 10 --> 4.5158515 sigma out 1act.( 2.52963281 sig in 11act.) RANK 13 NODE 1 --> 3.1816082 sigma out 1act.( 2.67198372 sig in 11act.) RANK 14 NODE 6 --> 2.47241902 sigma out 1act.( 5.30286884 sig in 11act.) RANK 15 NODE 7 --> 1.57049465 sigma out 1act.( 3.83207011 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.3085251 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 19.3675461 sigma out 15 active outputs RANK 2 NODE 2 --> 18.525547 sigma out 15 active outputs RANK 3 NODE 7 --> 18.0621128 sigma out 15 active outputs RANK 4 NODE 10 --> 17.783659 sigma out 15 active outputs RANK 5 NODE 9 --> 15.2334213 sigma out 15 active outputs RANK 6 NODE 1 --> 14.7467594 sigma out 15 active outputs RANK 7 NODE 4 --> 13.937439 sigma out 15 active outputs RANK 8 NODE 6 --> 13.4732161 sigma out 15 active outputs RANK 9 NODE 11 --> 13.2920675 sigma out 15 active outputs RANK 10 NODE 8 --> 10.4410448 sigma out 15 active outputs RANK 11 NODE 5 --> 9.43500519 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 23.028326 sigma in 11act. ( 24.3421574 sig out 1act.) RANK 2 NODE 4 --> 21.1261597 sigma in 11act. ( 20.9244289 sig out 1act.) RANK 3 NODE 9 --> 19.6651554 sigma in 11act. ( 19.8097897 sig out 1act.) RANK 4 NODE 3 --> 16.2646809 sigma in 11act. ( 14.4680195 sig out 1act.) RANK 5 NODE 2 --> 11.4630556 sigma in 11act. ( 9.07823086 sig out 1act.) RANK 6 NODE 8 --> 10.8919621 sigma in 11act. ( 7.9489255 sig out 1act.) RANK 7 NODE 12 --> 10.8179922 sigma in 11act. ( 7.03835869 sig out 1act.) RANK 8 NODE 10 --> 10.1303244 sigma in 11act. ( 6.05018806 sig out 1act.) RANK 9 NODE 5 --> 9.99911594 sigma in 11act. ( 7.76985645 sig out 1act.) RANK 10 NODE 13 --> 9.91660213 sigma in 11act. ( 8.26599407 sig out 1act.) RANK 11 NODE 15 --> 8.17630386 sigma in 11act. ( 5.34128523 sig out 1act.) RANK 12 NODE 6 --> 7.83050299 sigma in 11act. ( 1.9135679 sig out 1act.) RANK 13 NODE 1 --> 7.75780773 sigma in 11act. ( 4.67553329 sig out 1act.) RANK 14 NODE 14 --> 7.15853834 sigma in 11act. ( 5.34780121 sig out 1act.) RANK 15 NODE 7 --> 5.03289461 sigma in 11act. ( 0.92942512 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 24.3421574 sigma out 1act.( 23.028326 sig in 11act.) RANK 2 NODE 4 --> 20.9244289 sigma out 1act.( 21.1261597 sig in 11act.) RANK 3 NODE 9 --> 19.8097897 sigma out 1act.( 19.6651554 sig in 11act.) RANK 4 NODE 3 --> 14.4680195 sigma out 1act.( 16.2646809 sig in 11act.) RANK 5 NODE 2 --> 9.07823086 sigma out 1act.( 11.4630556 sig in 11act.) RANK 6 NODE 13 --> 8.26599407 sigma out 1act.( 9.91660213 sig in 11act.) RANK 7 NODE 8 --> 7.9489255 sigma out 1act.( 10.8919621 sig in 11act.) RANK 8 NODE 5 --> 7.76985645 sigma out 1act.( 9.99911594 sig in 11act.) RANK 9 NODE 12 --> 7.03835869 sigma out 1act.( 10.8179922 sig in 11act.) RANK 10 NODE 10 --> 6.05018806 sigma out 1act.( 10.1303244 sig in 11act.) RANK 11 NODE 14 --> 5.34780121 sigma out 1act.( 7.15853834 sig in 11act.) RANK 12 NODE 15 --> 5.34128523 sigma out 1act.( 8.17630386 sig in 11act.) RANK 13 NODE 1 --> 4.67553329 sigma out 1act.( 7.75780773 sig in 11act.) RANK 14 NODE 6 --> 1.9135679 sigma out 1act.( 7.83050299 sig in 11act.) RANK 15 NODE 7 --> 0.92942512 sigma out 1act.( 5.03289461 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 45.5640068 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.409616947 *** contribution from regularisation: 0.0042388523 *** contribution from error: -0.413855791 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.448346823 *** contribution from regularisation: 0.00225155475 *** contribution from error: -0.450598389 *********************************************** -----------------> Test sample ENTER BFGS code START -41046.7872 -0.132708341 -0.295703232 EXIT FROM BFGS code FG_START 0. -0.132708341 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.468618989 *** contribution from regularisation: 0.00210988545 *** contribution from error: -0.470728874 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -42893.1636 -0.132708341 -123.976326 EXIT FROM BFGS code FG_LNSRCH 0. -0.155809522 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.49890846 *** contribution from regularisation: 0.00305064884 *** contribution from error: -0.501959085 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45665.5898 -0.155809522 -53.8983994 EXIT FROM BFGS code NEW_X -45665.5898 -0.155809522 -53.8983994 ENTER BFGS code NEW_X -45665.5898 -0.155809522 -53.8983994 EXIT FROM BFGS code FG_LNSRCH 0. -0.16516906 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.500488579 *** contribution from regularisation: 0.00298059965 *** contribution from error: -0.503469169 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45810.2224 -0.16516906 -52.9583969 EXIT FROM BFGS code NEW_X -45810.2224 -0.16516906 -52.9583969 ENTER BFGS code NEW_X -45810.2224 -0.16516906 -52.9583969 EXIT FROM BFGS code FG_LNSRCH 0. -0.187389255 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.501560688 *** contribution from regularisation: 0.00283508375 *** contribution from error: -0.504395783 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45908.3495 -0.187389255 -51.9156761 EXIT FROM BFGS code NEW_X -45908.3495 -0.187389255 -51.9156761 ENTER BFGS code NEW_X -45908.3495 -0.187389255 -51.9156761 EXIT FROM BFGS code FG_LNSRCH 0. -0.230877861 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.502219081 *** contribution from regularisation: 0.00278012943 *** contribution from error: -0.50499922 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45968.6154 -0.230877861 -44.2835884 EXIT FROM BFGS code NEW_X -45968.6154 -0.230877861 -44.2835884 ENTER BFGS code NEW_X -45968.6154 -0.230877861 -44.2835884 EXIT FROM BFGS code FG_LNSRCH 0. -0.30102241 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.502986431 *** contribution from regularisation: 0.00283409515 *** contribution from error: -0.505820513 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46038.8497 -0.30102241 -32.2726974 EXIT FROM BFGS code NEW_X -46038.8497 -0.30102241 -32.2726974 ENTER BFGS code NEW_X -46038.8497 -0.30102241 -32.2726974 EXIT FROM BFGS code FG_LNSRCH 0. -0.652925432 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.505578578 *** contribution from regularisation: 0.00331165758 *** contribution from error: -0.508890212 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46276.1124 -0.652925432 -57.5477715 EXIT FROM BFGS code NEW_X -46276.1124 -0.652925432 -57.5477715 ENTER BFGS code NEW_X -46276.1124 -0.652925432 -57.5477715 EXIT FROM BFGS code FG_LNSRCH 0. -0.914342344 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 46.9325638 sigma out 15 active outputs RANK 2 NODE 1 --> 31.7910862 sigma out 15 active outputs RANK 3 NODE 6 --> 29.6366062 sigma out 15 active outputs RANK 4 NODE 10 --> 24.16366 sigma out 15 active outputs RANK 5 NODE 9 --> 23.9770203 sigma out 15 active outputs RANK 6 NODE 4 --> 19.7209587 sigma out 15 active outputs RANK 7 NODE 11 --> 18.7949867 sigma out 15 active outputs RANK 8 NODE 5 --> 14.7241716 sigma out 15 active outputs RANK 9 NODE 7 --> 13.4455824 sigma out 15 active outputs RANK 10 NODE 8 --> 10.258112 sigma out 15 active outputs RANK 11 NODE 3 --> 7.54793549 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 53.2446709 sigma in 11act. ( 47.4995804 sig out 1act.) RANK 2 NODE 4 --> 27.0659733 sigma in 11act. ( 23.4850483 sig out 1act.) RANK 3 NODE 1 --> 23.8059273 sigma in 11act. ( 22.9907627 sig out 1act.) RANK 4 NODE 13 --> 21.4901352 sigma in 11act. ( 22.6555481 sig out 1act.) RANK 5 NODE 3 --> 20.2448997 sigma in 11act. ( 16.179924 sig out 1act.) RANK 6 NODE 2 --> 19.5954533 sigma in 11act. ( 15.848443 sig out 1act.) RANK 7 NODE 9 --> 18.7247944 sigma in 11act. ( 21.5019131 sig out 1act.) RANK 8 NODE 8 --> 16.8122902 sigma in 11act. ( 19.7270184 sig out 1act.) RANK 9 NODE 5 --> 13.1286278 sigma in 11act. ( 9.99852848 sig out 1act.) RANK 10 NODE 10 --> 11.6904097 sigma in 11act. ( 8.5117712 sig out 1act.) RANK 11 NODE 15 --> 10.0544519 sigma in 11act. ( 9.88500786 sig out 1act.) RANK 12 NODE 11 --> 6.85118818 sigma in 11act. ( 2.9196043 sig out 1act.) RANK 13 NODE 14 --> 5.94351006 sigma in 11act. ( 5.96987438 sig out 1act.) RANK 14 NODE 6 --> 5.46093559 sigma in 11act. ( 4.31211138 sig out 1act.) RANK 15 NODE 7 --> 2.64122581 sigma in 11act. ( 1.93470442 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 47.4995804 sigma out 1act.( 53.2446709 sig in 11act.) RANK 2 NODE 4 --> 23.4850483 sigma out 1act.( 27.0659733 sig in 11act.) RANK 3 NODE 1 --> 22.9907627 sigma out 1act.( 23.8059273 sig in 11act.) RANK 4 NODE 13 --> 22.6555481 sigma out 1act.( 21.4901352 sig in 11act.) RANK 5 NODE 9 --> 21.5019131 sigma out 1act.( 18.7247944 sig in 11act.) RANK 6 NODE 8 --> 19.7270184 sigma out 1act.( 16.8122902 sig in 11act.) RANK 7 NODE 3 --> 16.179924 sigma out 1act.( 20.2448997 sig in 11act.) RANK 8 NODE 2 --> 15.848443 sigma out 1act.( 19.5954533 sig in 11act.) RANK 9 NODE 5 --> 9.99852848 sigma out 1act.( 13.1286278 sig in 11act.) RANK 10 NODE 15 --> 9.88500786 sigma out 1act.( 10.0544519 sig in 11act.) RANK 11 NODE 10 --> 8.5117712 sigma out 1act.( 11.6904097 sig in 11act.) RANK 12 NODE 14 --> 5.96987438 sigma out 1act.( 5.94351006 sig in 11act.) RANK 13 NODE 6 --> 4.31211138 sigma out 1act.( 5.46093559 sig in 11act.) RANK 14 NODE 11 --> 2.9196043 sigma out 1act.( 6.85118818 sig in 11act.) RANK 15 NODE 7 --> 1.93470442 sigma out 1act.( 2.64122581 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 74.5029678 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.506625056 *** contribution from regularisation: 0.00368437544 *** contribution from error: -0.510309458 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -46371.9 -0.914342344 74.5664444 EXIT FROM BFGS code NEW_X -46371.9 -0.914342344 74.5664444 ENTER BFGS code NEW_X -46371.9 -0.914342344 74.5664444 EXIT FROM BFGS code FG_LNSRCH 0. -0.789183795 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.508241534 *** contribution from regularisation: 0.00283178035 *** contribution from error: -0.511073291 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46519.8533 -0.789183795 37.7530098 EXIT FROM BFGS code NEW_X -46519.8533 -0.789183795 37.7530098 ENTER BFGS code NEW_X -46519.8533 -0.789183795 37.7530098 EXIT FROM BFGS code FG_LNSRCH 0. -0.839257598 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.50831759 *** contribution from regularisation: 0.00329529587 *** contribution from error: -0.511612892 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46526.8189 -0.839257598 -22.0848198 EXIT FROM BFGS code NEW_X -46526.8189 -0.839257598 -22.0848198 ENTER BFGS code NEW_X -46526.8189 -0.839257598 -22.0848198 EXIT FROM BFGS code FG_LNSRCH 0. -0.857271016 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.508952081 *** contribution from regularisation: 0.0031704437 *** contribution from error: -0.512122512 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46584.8913 -0.857271016 0.524010718 EXIT FROM BFGS code NEW_X -46584.8913 -0.857271016 0.524010718 ENTER BFGS code NEW_X -46584.8913 -0.857271016 0.524010718 EXIT FROM BFGS code FG_LNSRCH 0. -0.950984716 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.51015532 *** contribution from regularisation: 0.00354773365 *** contribution from error: -0.513703048 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46695.0277 -0.950984716 55.0363121 EXIT FROM BFGS code NEW_X -46695.0277 -0.950984716 55.0363121 ENTER BFGS code NEW_X -46695.0277 -0.950984716 55.0363121 EXIT FROM BFGS code FG_LNSRCH 0. -1.04992938 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.511528969 *** contribution from regularisation: 0.00382866734 *** contribution from error: -0.515357614 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46820.7578 -1.04992938 70.2597427 EXIT FROM BFGS code NEW_X -46820.7578 -1.04992938 70.2597427 ENTER BFGS code NEW_X -46820.7578 -1.04992938 70.2597427 EXIT FROM BFGS code FG_LNSRCH 0. -1.14774036 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.511762857 *** contribution from regularisation: 0.00427129259 *** contribution from error: -0.516034126 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46842.1638 -1.14774036 -22.4777451 EXIT FROM BFGS code FG_LNSRCH 0. -1.09301579 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.513242602 *** contribution from regularisation: 0.00316045666 *** contribution from error: -0.516403079 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46977.6079 -1.09301579 41.8503036 EXIT FROM BFGS code NEW_X -46977.6079 -1.09301579 41.8503036 ENTER BFGS code NEW_X -46977.6079 -1.09301579 41.8503036 EXIT FROM BFGS code FG_LNSRCH 0. -1.10355592 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.513492584 *** contribution from regularisation: 0.00372832105 *** contribution from error: -0.517220914 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47000.4901 -1.10355592 4.58749342 EXIT FROM BFGS code NEW_X -47000.4901 -1.10355592 4.58749342 ENTER BFGS code NEW_X -47000.4901 -1.10355592 4.58749342 EXIT FROM BFGS code FG_LNSRCH 0. -1.05900621 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.514150679 *** contribution from regularisation: 0.00336839654 *** contribution from error: -0.517519057 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47060.7265 -1.05900621 0.175596729 EXIT FROM BFGS code NEW_X -47060.7265 -1.05900621 0.175596729 ENTER BFGS code NEW_X -47060.7265 -1.05900621 0.175596729 EXIT FROM BFGS code FG_LNSRCH 0. -0.988102317 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 68.5926895 sigma out 15 active outputs RANK 2 NODE 10 --> 34.3852768 sigma out 15 active outputs RANK 3 NODE 6 --> 31.6287403 sigma out 15 active outputs RANK 4 NODE 1 --> 29.5704784 sigma out 15 active outputs RANK 5 NODE 4 --> 26.6455956 sigma out 15 active outputs RANK 6 NODE 11 --> 23.3747807 sigma out 15 active outputs RANK 7 NODE 9 --> 20.511076 sigma out 15 active outputs RANK 8 NODE 8 --> 17.9867001 sigma out 15 active outputs RANK 9 NODE 7 --> 14.9483681 sigma out 15 active outputs RANK 10 NODE 5 --> 14.7576103 sigma out 15 active outputs RANK 11 NODE 3 --> 11.6571465 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 68.0985107 sigma in 11act. ( 89.1841049 sig out 1act.) RANK 2 NODE 2 --> 35.2777138 sigma in 11act. ( 29.1346569 sig out 1act.) RANK 3 NODE 4 --> 32.5168953 sigma in 11act. ( 30.4383678 sig out 1act.) RANK 4 NODE 1 --> 26.3270416 sigma in 11act. ( 24.9604759 sig out 1act.) RANK 5 NODE 8 --> 24.8025188 sigma in 11act. ( 30.4312649 sig out 1act.) RANK 6 NODE 13 --> 22.8291874 sigma in 11act. ( 25.3273678 sig out 1act.) RANK 7 NODE 9 --> 18.8053913 sigma in 11act. ( 19.4189167 sig out 1act.) RANK 8 NODE 14 --> 18.1253376 sigma in 11act. ( 20.0471172 sig out 1act.) RANK 9 NODE 3 --> 17.2690659 sigma in 11act. ( 14.7480249 sig out 1act.) RANK 10 NODE 11 --> 14.2444839 sigma in 11act. ( 11.0731173 sig out 1act.) RANK 11 NODE 10 --> 11.3582106 sigma in 11act. ( 8.21283817 sig out 1act.) RANK 12 NODE 15 --> 10.3485508 sigma in 11act. ( 10.7689123 sig out 1act.) RANK 13 NODE 5 --> 8.90497017 sigma in 11act. ( 6.37238932 sig out 1act.) RANK 14 NODE 7 --> 6.69055605 sigma in 11act. ( 6.82209587 sig out 1act.) RANK 15 NODE 6 --> 5.25692892 sigma in 11act. ( 5.01250935 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 89.1841049 sigma out 1act.( 68.0985107 sig in 11act.) RANK 2 NODE 4 --> 30.4383678 sigma out 1act.( 32.5168953 sig in 11act.) RANK 3 NODE 8 --> 30.4312649 sigma out 1act.( 24.8025188 sig in 11act.) RANK 4 NODE 2 --> 29.1346569 sigma out 1act.( 35.2777138 sig in 11act.) RANK 5 NODE 13 --> 25.3273678 sigma out 1act.( 22.8291874 sig in 11act.) RANK 6 NODE 1 --> 24.9604759 sigma out 1act.( 26.3270416 sig in 11act.) RANK 7 NODE 14 --> 20.0471172 sigma out 1act.( 18.1253376 sig in 11act.) RANK 8 NODE 9 --> 19.4189167 sigma out 1act.( 18.8053913 sig in 11act.) RANK 9 NODE 3 --> 14.7480249 sigma out 1act.( 17.2690659 sig in 11act.) RANK 10 NODE 11 --> 11.0731173 sigma out 1act.( 14.2444839 sig in 11act.) RANK 11 NODE 15 --> 10.7689123 sigma out 1act.( 10.3485508 sig in 11act.) RANK 12 NODE 10 --> 8.21283817 sigma out 1act.( 11.3582106 sig in 11act.) RANK 13 NODE 7 --> 6.82209587 sigma out 1act.( 6.69055605 sig in 11act.) RANK 14 NODE 5 --> 6.37238932 sigma out 1act.( 8.90497017 sig in 11act.) RANK 15 NODE 6 --> 5.01250935 sigma out 1act.( 5.25692892 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 115.475037 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.515530407 *** contribution from regularisation: 0.00351347611 *** contribution from error: -0.519043863 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47187.0164 -0.988102317 -0.676342607 EXIT FROM BFGS code NEW_X -47187.0164 -0.988102317 -0.676342607 ENTER BFGS code NEW_X -47187.0164 -0.988102317 -0.676342607 EXIT FROM BFGS code FG_LNSRCH 0. -0.930019915 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.515555739 *** contribution from regularisation: 0.00357830618 *** contribution from error: -0.519134045 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47189.3334 -0.930019915 -99.8640137 EXIT FROM BFGS code FG_LNSRCH 0. -0.958992124 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.515941024 *** contribution from regularisation: 0.00359103782 *** contribution from error: -0.519532084 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47224.5991 -0.958992124 -48.1938324 EXIT FROM BFGS code NEW_X -47224.5991 -0.958992124 -48.1938324 ENTER BFGS code NEW_X -47224.5991 -0.958992124 -48.1938324 EXIT FROM BFGS code FG_LNSRCH 0. -0.969502747 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.516274393 *** contribution from regularisation: 0.00364273135 *** contribution from error: -0.51991713 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47255.1099 -0.969502747 -4.97280645 EXIT FROM BFGS code NEW_X -47255.1099 -0.969502747 -4.97280645 ENTER BFGS code NEW_X -47255.1099 -0.969502747 -4.97280645 EXIT FROM BFGS code FG_LNSRCH 0. -0.97137028 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.516521156 *** contribution from regularisation: 0.00360915042 *** contribution from error: -0.520130277 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47277.6966 -0.97137028 -6.0986805 EXIT FROM BFGS code NEW_X -47277.6966 -0.97137028 -6.0986805 ENTER BFGS code NEW_X -47277.6966 -0.97137028 -6.0986805 EXIT FROM BFGS code FG_LNSRCH 0. -0.994302154 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.517509401 *** contribution from regularisation: 0.00376074668 *** contribution from error: -0.521270156 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47368.1538 -0.994302154 -37.9636536 EXIT FROM BFGS code NEW_X -47368.1538 -0.994302154 -37.9636536 ENTER BFGS code NEW_X -47368.1538 -0.994302154 -37.9636536 EXIT FROM BFGS code FG_LNSRCH 0. -1.0150696 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.518175662 *** contribution from regularisation: 0.00372644607 *** contribution from error: -0.521902084 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47429.1348 -1.0150696 29.2564163 EXIT FROM BFGS code NEW_X -47429.1348 -1.0150696 29.2564163 ENTER BFGS code NEW_X -47429.1348 -1.0150696 29.2564163 EXIT FROM BFGS code FG_LNSRCH 0. -1.02955389 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.51862818 *** contribution from regularisation: 0.00377703272 *** contribution from error: -0.522405207 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47470.5548 -1.02955389 -59.3517303 EXIT FROM BFGS code NEW_X -47470.5548 -1.02955389 -59.3517303 ENTER BFGS code NEW_X -47470.5548 -1.02955389 -59.3517303 EXIT FROM BFGS code FG_LNSRCH 0. -1.03194237 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.518927813 *** contribution from regularisation: 0.00362398173 *** contribution from error: -0.522551775 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47497.9797 -1.03194237 10.9363651 EXIT FROM BFGS code NEW_X -47497.9797 -1.03194237 10.9363651 ENTER BFGS code NEW_X -47497.9797 -1.03194237 10.9363651 EXIT FROM BFGS code FG_LNSRCH 0. -1.03343856 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.519080162 *** contribution from regularisation: 0.00362164341 *** contribution from error: -0.5227018 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47511.9264 -1.03343856 36.5364647 EXIT FROM BFGS code NEW_X -47511.9264 -1.03343856 36.5364647 ENTER BFGS code NEW_X -47511.9264 -1.03343856 36.5364647 EXIT FROM BFGS code FG_LNSRCH 0. -1.04435968 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 78.4703064 sigma out 15 active outputs RANK 2 NODE 1 --> 48.1058311 sigma out 15 active outputs RANK 3 NODE 10 --> 39.5499802 sigma out 15 active outputs RANK 4 NODE 6 --> 36.2001877 sigma out 15 active outputs RANK 5 NODE 4 --> 31.1402607 sigma out 15 active outputs RANK 6 NODE 11 --> 29.9027805 sigma out 15 active outputs RANK 7 NODE 9 --> 27.9802856 sigma out 15 active outputs RANK 8 NODE 8 --> 24.9718266 sigma out 15 active outputs RANK 9 NODE 7 --> 23.596014 sigma out 15 active outputs RANK 10 NODE 3 --> 21.5312424 sigma out 15 active outputs RANK 11 NODE 5 --> 19.7720604 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 63.3613167 sigma in 11act. ( 103.963249 sig out 1act.) RANK 2 NODE 2 --> 58.0952644 sigma in 11act. ( 49.1863365 sig out 1act.) RANK 3 NODE 4 --> 45.4734726 sigma in 11act. ( 42.938652 sig out 1act.) RANK 4 NODE 1 --> 40.4580269 sigma in 11act. ( 40.9704361 sig out 1act.) RANK 5 NODE 8 --> 37.1125946 sigma in 11act. ( 47.5502167 sig out 1act.) RANK 6 NODE 14 --> 34.133606 sigma in 11act. ( 37.5713196 sig out 1act.) RANK 7 NODE 13 --> 27.9004688 sigma in 11act. ( 31.0262566 sig out 1act.) RANK 8 NODE 9 --> 19.6590729 sigma in 11act. ( 20.0686855 sig out 1act.) RANK 9 NODE 15 --> 18.55513 sigma in 11act. ( 20.7475109 sig out 1act.) RANK 10 NODE 11 --> 15.5051489 sigma in 11act. ( 13.6592655 sig out 1act.) RANK 11 NODE 3 --> 14.114069 sigma in 11act. ( 11.5422897 sig out 1act.) RANK 12 NODE 10 --> 13.7432127 sigma in 11act. ( 11.2395353 sig out 1act.) RANK 13 NODE 7 --> 12.7427111 sigma in 11act. ( 13.905365 sig out 1act.) RANK 14 NODE 6 --> 7.31925488 sigma in 11act. ( 7.14083862 sig out 1act.) RANK 15 NODE 5 --> 6.13147545 sigma in 11act. ( 3.85525918 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 103.963249 sigma out 1act.( 63.3613167 sig in 11act.) RANK 2 NODE 2 --> 49.1863365 sigma out 1act.( 58.0952644 sig in 11act.) RANK 3 NODE 8 --> 47.5502167 sigma out 1act.( 37.1125946 sig in 11act.) RANK 4 NODE 4 --> 42.938652 sigma out 1act.( 45.4734726 sig in 11act.) RANK 5 NODE 1 --> 40.9704361 sigma out 1act.( 40.4580269 sig in 11act.) RANK 6 NODE 14 --> 37.5713196 sigma out 1act.( 34.133606 sig in 11act.) RANK 7 NODE 13 --> 31.0262566 sigma out 1act.( 27.9004688 sig in 11act.) RANK 8 NODE 15 --> 20.7475109 sigma out 1act.( 18.55513 sig in 11act.) RANK 9 NODE 9 --> 20.0686855 sigma out 1act.( 19.6590729 sig in 11act.) RANK 10 NODE 7 --> 13.905365 sigma out 1act.( 12.7427111 sig in 11act.) RANK 11 NODE 11 --> 13.6592655 sigma out 1act.( 15.5051489 sig in 11act.) RANK 12 NODE 3 --> 11.5422897 sigma out 1act.( 14.114069 sig in 11act.) RANK 13 NODE 10 --> 11.2395353 sigma out 1act.( 13.7432127 sig in 11act.) RANK 14 NODE 6 --> 7.14083862 sigma out 1act.( 7.31925488 sig in 11act.) RANK 15 NODE 5 --> 3.85525918 sigma out 1act.( 6.13147545 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 151.40596 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.519578755 *** contribution from regularisation: 0.00357768405 *** contribution from error: -0.523156464 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47557.5631 -1.04435968 83.8905945 EXIT FROM BFGS code NEW_X -47557.5631 -1.04435968 83.8905945 ENTER BFGS code NEW_X -47557.5631 -1.04435968 83.8905945 EXIT FROM BFGS code FG_LNSRCH 0. -1.05037856 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.519929886 *** contribution from regularisation: 0.00358903781 *** contribution from error: -0.52351892 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47589.7027 -1.05037856 1.22227228 EXIT FROM BFGS code NEW_X -47589.7027 -1.05037856 1.22227228 ENTER BFGS code NEW_X -47589.7027 -1.05037856 1.22227228 EXIT FROM BFGS code FG_LNSRCH 0. -1.06526101 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.519931197 *** contribution from regularisation: 0.00363000948 *** contribution from error: -0.52356118 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47589.8229 -1.06526101 58.4511604 EXIT FROM BFGS code NEW_X -47589.8229 -1.06526101 58.4511604 ENTER BFGS code NEW_X -47589.8229 -1.06526101 58.4511604 EXIT FROM BFGS code FG_LNSRCH 0. -1.05881166 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.520139098 *** contribution from regularisation: 0.00365245505 *** contribution from error: -0.523791552 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47608.8497 -1.05881166 -12.6224051 EXIT FROM BFGS code NEW_X -47608.8497 -1.05881166 -12.6224051 ENTER BFGS code NEW_X -47608.8497 -1.05881166 -12.6224051 EXIT FROM BFGS code FG_LNSRCH 0. -1.06040943 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.520296454 *** contribution from regularisation: 0.00364208268 *** contribution from error: -0.523938537 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47623.2528 -1.06040943 -24.3703136 EXIT FROM BFGS code NEW_X -47623.2528 -1.06040943 -24.3703136 ENTER BFGS code NEW_X -47623.2528 -1.06040943 -24.3703136 EXIT FROM BFGS code FG_LNSRCH 0. -1.07005048 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.520592988 *** contribution from regularisation: 0.00365707162 *** contribution from error: -0.524250031 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47650.398 -1.07005048 -50.2231216 EXIT FROM BFGS code NEW_X -47650.398 -1.07005048 -50.2231216 ENTER BFGS code NEW_X -47650.398 -1.07005048 -50.2231216 EXIT FROM BFGS code FG_LNSRCH 0. -1.08300924 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.520878971 *** contribution from regularisation: 0.00367182423 *** contribution from error: -0.524550796 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47676.573 -1.08300924 -3.75737214 EXIT FROM BFGS code NEW_X -47676.573 -1.08300924 -3.75737214 ENTER BFGS code NEW_X -47676.573 -1.08300924 -3.75737214 EXIT FROM BFGS code FG_LNSRCH 0. -1.07470381 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.520666659 *** contribution from regularisation: 0.00367196882 *** contribution from error: -0.524338603 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47657.1385 -1.07470381 -146.441925 EXIT FROM BFGS code FG_LNSRCH 0. -1.08029735 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.520973563 *** contribution from regularisation: 0.00366295758 *** contribution from error: -0.524636507 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47685.2311 -1.08029735 -46.532711 EXIT FROM BFGS code NEW_X -47685.2311 -1.08029735 -46.532711 ENTER BFGS code NEW_X -47685.2311 -1.08029735 -46.532711 EXIT FROM BFGS code FG_LNSRCH 0. -1.08236778 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.521101356 *** contribution from regularisation: 0.00366026838 *** contribution from error: -0.524761617 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47696.927 -1.08236778 44.468956 EXIT FROM BFGS code NEW_X -47696.927 -1.08236778 44.468956 ENTER BFGS code NEW_X -47696.927 -1.08236778 44.468956 EXIT FROM BFGS code FG_LNSRCH 0. -1.07694829 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 85.9011002 sigma out 15 active outputs RANK 2 NODE 1 --> 70.4989471 sigma out 15 active outputs RANK 3 NODE 10 --> 48.5354004 sigma out 15 active outputs RANK 4 NODE 11 --> 42.5161133 sigma out 15 active outputs RANK 5 NODE 6 --> 41.2577171 sigma out 15 active outputs RANK 6 NODE 4 --> 40.7216606 sigma out 15 active outputs RANK 7 NODE 9 --> 36.0652161 sigma out 15 active outputs RANK 8 NODE 7 --> 33.5101776 sigma out 15 active outputs RANK 9 NODE 3 --> 31.3145905 sigma out 15 active outputs RANK 10 NODE 8 --> 30.4844055 sigma out 15 active outputs RANK 11 NODE 5 --> 26.8965816 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 74.9604645 sigma in 11act. ( 63.7673225 sig out 1act.) RANK 2 NODE 4 --> 62.8466263 sigma in 11act. ( 63.9360733 sig out 1act.) RANK 3 NODE 12 --> 60.8473282 sigma in 11act. ( 107.611732 sig out 1act.) RANK 4 NODE 1 --> 53.1107597 sigma in 11act. ( 55.9968987 sig out 1act.) RANK 5 NODE 14 --> 51.969223 sigma in 11act. ( 53.2275238 sig out 1act.) RANK 6 NODE 8 --> 50.040966 sigma in 11act. ( 62.6478882 sig out 1act.) RANK 7 NODE 13 --> 32.9839401 sigma in 11act. ( 35.9004631 sig out 1act.) RANK 8 NODE 15 --> 30.1499977 sigma in 11act. ( 33.6751022 sig out 1act.) RANK 9 NODE 9 --> 26.4483929 sigma in 11act. ( 27.9236832 sig out 1act.) RANK 10 NODE 7 --> 16.5501881 sigma in 11act. ( 18.4139328 sig out 1act.) RANK 11 NODE 11 --> 15.1660185 sigma in 11act. ( 14.5357933 sig out 1act.) RANK 12 NODE 10 --> 14.2829304 sigma in 11act. ( 11.8660202 sig out 1act.) RANK 13 NODE 3 --> 12.0110807 sigma in 11act. ( 10.4307032 sig out 1act.) RANK 14 NODE 6 --> 7.97378254 sigma in 11act. ( 8.38963509 sig out 1act.) RANK 15 NODE 5 --> 4.55567026 sigma in 11act. ( 2.68744755 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 107.611732 sigma out 1act.( 60.8473282 sig in 11act.) RANK 2 NODE 4 --> 63.9360733 sigma out 1act.( 62.8466263 sig in 11act.) RANK 3 NODE 2 --> 63.7673225 sigma out 1act.( 74.9604645 sig in 11act.) RANK 4 NODE 8 --> 62.6478882 sigma out 1act.( 50.040966 sig in 11act.) RANK 5 NODE 1 --> 55.9968987 sigma out 1act.( 53.1107597 sig in 11act.) RANK 6 NODE 14 --> 53.2275238 sigma out 1act.( 51.969223 sig in 11act.) RANK 7 NODE 13 --> 35.9004631 sigma out 1act.( 32.9839401 sig in 11act.) RANK 8 NODE 15 --> 33.6751022 sigma out 1act.( 30.1499977 sig in 11act.) RANK 9 NODE 9 --> 27.9236832 sigma out 1act.( 26.4483929 sig in 11act.) RANK 10 NODE 7 --> 18.4139328 sigma out 1act.( 16.5501881 sig in 11act.) RANK 11 NODE 11 --> 14.5357933 sigma out 1act.( 15.1660185 sig in 11act.) RANK 12 NODE 10 --> 11.8660202 sigma out 1act.( 14.2829304 sig in 11act.) RANK 13 NODE 3 --> 10.4307032 sigma out 1act.( 12.0110807 sig in 11act.) RANK 14 NODE 6 --> 8.38963509 sigma out 1act.( 7.97378254 sig in 11act.) RANK 15 NODE 5 --> 2.68744755 sigma out 1act.( 4.55567026 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 183.597702 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.521154046 *** contribution from regularisation: 0.00365415309 *** contribution from error: -0.524808228 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47701.7507 -1.07694829 50.083889 EXIT FROM BFGS code NEW_X -47701.7507 -1.07694829 50.083889 ENTER BFGS code NEW_X -47701.7507 -1.07694829 50.083889 EXIT FROM BFGS code FG_LNSRCH 0. -1.01703525 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.521528482 *** contribution from regularisation: 0.00358939823 *** contribution from error: -0.525117874 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47736.024 -1.01703525 75.4083405 EXIT FROM BFGS code NEW_X -47736.024 -1.01703525 75.4083405 ENTER BFGS code NEW_X -47736.024 -1.01703525 75.4083405 EXIT FROM BFGS code FG_LNSRCH 0. -0.954226196 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.521489084 *** contribution from regularisation: 0.00359850586 *** contribution from error: -0.525087595 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47732.4181 -0.954226196 98.2709579 EXIT FROM BFGS code FG_LNSRCH 0. -0.992404282 0. --------------------------------------------------- Iteration : 43 *********************************************** *** Learn Path 43 *** loss function: -0.5214836 *** contribution from regularisation: 0.00372114708 *** contribution from error: -0.525204718 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47731.9147 -0.992404282 84.8032227 EXIT FROM BFGS code FG_LNSRCH 0. -1.01245236 0. --------------------------------------------------- Iteration : 44 *********************************************** *** Learn Path 44 *** loss function: -0.521451533 *** contribution from regularisation: 0.00368988072 *** contribution from error: -0.525141418 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47728.9799 -1.01245236 77.1767197 EXIT FROM BFGS code FG_LNSRCH 0. -1.01681566 0. --------------------------------------------------- Iteration : 45 *********************************************** *** Learn Path 45 *** loss function: -0.521446407 *** contribution from regularisation: 0.00367291458 *** contribution from error: -0.525119305 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47728.5128 -1.01681566 75.4874344 EXIT FROM BFGS code FG_LNSRCH 0. -1.01703465 0. --------------------------------------------------- Iteration : 46 *********************************************** *** Learn Path 46 *** loss function: -0.521445811 *** contribution from regularisation: 0.00367209665 *** contribution from error: -0.525117934 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47728.4547 -1.01703465 75.3782578 EXIT FROM BFGS code FG_LNSRCH 0. -1.01703525 0. --------------------------------------------------- Iteration : 47 *********************************************** *** Learn Path 47 *** loss function: -0.52145195 *** contribution from regularisation: 0.00366593502 *** contribution from error: -0.525117874 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47729.0185 -1.01703525 75.380661 EXIT FROM BFGS code FG_LNSRCH 0. -1.01703525 0. --------------------------------------------------- Iteration : 48 *********************************************** *** Learn Path 48 *** loss function: -0.5214504 *** contribution from regularisation: 0.00366746355 *** contribution from error: -0.525117874 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47728.8785 -1.01703525 75.3931198 EXIT FROM BFGS code FG_LNSRCH 0. -1.01703525 0. --------------------------------------------------- Iteration : 49 *********************************************** *** Learn Path 49 *** loss function: -0.521444857 *** contribution from regularisation: 0.00367305242 *** contribution from error: -0.525117934 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47728.367 -1.01703525 75.369278 EXIT FROM BFGS code NEW_X -47728.367 -1.01703525 75.369278 ENTER BFGS code NEW_X -47728.367 -1.01703525 75.369278 EXIT FROM BFGS code CONVERGENC -47728.367 -1.01703525 75.369278 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 135.936966 sigma out 15 active outputs RANK 2 NODE 1 --> 115.17009 sigma out 15 active outputs RANK 3 NODE 10 --> 75.4239655 sigma out 15 active outputs RANK 4 NODE 11 --> 66.0447388 sigma out 15 active outputs RANK 5 NODE 4 --> 65.652504 sigma out 15 active outputs RANK 6 NODE 6 --> 65.493309 sigma out 15 active outputs RANK 7 NODE 9 --> 55.7799225 sigma out 15 active outputs RANK 8 NODE 7 --> 51.0155029 sigma out 15 active outputs RANK 9 NODE 3 --> 48.6970749 sigma out 15 active outputs RANK 10 NODE 8 --> 45.3582764 sigma out 15 active outputs RANK 11 NODE 5 --> 42.482811 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 118.428886 sigma in 11act. ( 99.3289871 sig out 1act.) RANK 2 NODE 4 --> 101.738068 sigma in 11act. ( 101.969093 sig out 1act.) RANK 3 NODE 12 --> 91.7013474 sigma in 11act. ( 171.518509 sig out 1act.) RANK 4 NODE 14 --> 83.6081924 sigma in 11act. ( 89.3779449 sig out 1act.) RANK 5 NODE 1 --> 82.9716415 sigma in 11act. ( 89.7751236 sig out 1act.) RANK 6 NODE 8 --> 80.8582306 sigma in 11act. ( 102.862305 sig out 1act.) RANK 7 NODE 15 --> 51.0703812 sigma in 11act. ( 56.4044228 sig out 1act.) RANK 8 NODE 13 --> 50.7644768 sigma in 11act. ( 55.4925804 sig out 1act.) RANK 9 NODE 9 --> 41.9681244 sigma in 11act. ( 44.9461021 sig out 1act.) RANK 10 NODE 7 --> 26.7688389 sigma in 11act. ( 31.2498798 sig out 1act.) RANK 11 NODE 11 --> 22.840435 sigma in 11act. ( 22.5078144 sig out 1act.) RANK 12 NODE 10 --> 21.6479912 sigma in 11act. ( 18.135458 sig out 1act.) RANK 13 NODE 3 --> 17.5662537 sigma in 11act. ( 15.1943674 sig out 1act.) RANK 14 NODE 6 --> 12.4115152 sigma in 11act. ( 13.5044413 sig out 1act.) RANK 15 NODE 5 --> 5.19279528 sigma in 11act. ( 3.54701471 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 171.518509 sigma out 1act.( 91.7013474 sig in 11act.) RANK 2 NODE 8 --> 102.862305 sigma out 1act.( 80.8582306 sig in 11act.) RANK 3 NODE 4 --> 101.969093 sigma out 1act.( 101.738068 sig in 11act.) RANK 4 NODE 2 --> 99.3289871 sigma out 1act.( 118.428886 sig in 11act.) RANK 5 NODE 1 --> 89.7751236 sigma out 1act.( 82.9716415 sig in 11act.) RANK 6 NODE 14 --> 89.3779449 sigma out 1act.( 83.6081924 sig in 11act.) RANK 7 NODE 15 --> 56.4044228 sigma out 1act.( 51.0703812 sig in 11act.) RANK 8 NODE 13 --> 55.4925804 sigma out 1act.( 50.7644768 sig in 11act.) RANK 9 NODE 9 --> 44.9461021 sigma out 1act.( 41.9681244 sig in 11act.) RANK 10 NODE 7 --> 31.2498798 sigma out 1act.( 26.7688389 sig in 11act.) RANK 11 NODE 11 --> 22.5078144 sigma out 1act.( 22.840435 sig in 11act.) RANK 12 NODE 10 --> 18.135458 sigma out 1act.( 21.6479912 sig in 11act.) RANK 13 NODE 3 --> 15.1943674 sigma out 1act.( 17.5662537 sig in 11act.) RANK 14 NODE 6 --> 13.5044413 sigma out 1act.( 12.4115152 sig in 11act.) RANK 15 NODE 5 --> 3.54701471 sigma out 1act.( 5.19279528 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 294.669464 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.521452188 *** contribution from regularisation: 0.00366571732 *** contribution from error: -0.525117934 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30761 Closing output file done