NNInput NNInputs_125.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 186527 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 46727 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 46727 Chosen entries: 46727 Signal fraction: 1 Background fraction: 0.334242 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 46727 Entries to split: 46727 Test with : 23363 Train with : 23363 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 46727 for Signal Prepared event 0 for Signal with 46727 events ====Entry 0 Variable Ht : 120.494 Variable LepAPt : 52.8932 Variable LepBPt : 13.787 Variable MetSigLeptonsJets : 6.59008 Variable MetSpec : 53.8132 Variable SumEtLeptonsJets : 66.6802 Variable VSumJetLeptonsPt : 66.139 Variable addEt : 120.494 Variable dPhiLepSumMet : 2.99118 Variable dPhiLeptons : 0.315251 Variable dRLeptons : 0.406645 Variable lep1_E : 70.3851 Variable lep2_E : 15.8115 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2125 Ht = 120.494 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 52.8933 LepAPt = 52.8932 LepBEt = 13.787 LepBPt = 13.787 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 53.8132 MetDelPhi = 2.92651 MetSig = 4.22058 MetSigLeptonsJets = 6.59008 MetSpec = 53.8132 Mjj = 0 MostCentralJetEta = 0 MtllMet = 129.103 Njets = 0 SB = 0 SumEt = 162.568 SumEtJets = 0 SumEtLeptonsJets = 66.6802 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 66.139 addEt = 120.494 dPhiLepSumMet = 2.99118 dPhiLeptons = 0.315251 dRLeptons = 0.406645 diltype = 49 dimass = 10.9671 event = 2092 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 70.3851 lep2_E = 15.8115 rand = 0.999742 run = 235158 weight = 1.4937e-06 ===Show End Prepared event 10000 for Signal with 46727 events Prepared event 20000 for Signal with 46727 events Prepared event 30000 for Signal with 46727 events Prepared event 40000 for Signal with 46727 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.277074 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4388 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 186527 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4388 negative weights. Signal fraction: 62.3412666 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 62.8430901 64.8018341 66.3703232 67.5907288 68.6997986 69.5886688 70.4352417 71.2021637 72.0096436 72.7599869 73.5082855 74.165863 74.9044724 75.4832077 76.096077 76.8231354 77.3639526 77.9978867 78.5550461 79.1107178 79.5864105 80.2305145 80.9223709 81.5261383 82.1782303 82.7839279 83.6173859 84.4116669 85.1084518 85.895813 86.6327362 87.5678101 88.6287308 89.6082458 90.5535431 91.6540146 92.5685806 93.687706 94.772377 95.8121796 96.853363 97.8792114 98.8938141 99.8757858 100.893143 101.860062 102.809082 103.766685 104.487518 105.444008 106.271088 107.220856 108.127151 109.028961 110.024506 110.995697 111.927856 112.854645 113.74157 114.738068 115.744797 116.762833 117.805817 118.9505 119.78968 121.060806 122.168243 123.341858 124.748932 125.96254 127.453186 128.922089 130.608521 132.239334 134.074387 135.907593 137.816223 139.910522 142.134308 144.261597 146.648926 149.016022 151.447159 154.070755 157.017548 159.68692 162.945236 166.520859 170.687653 175.243393 180.191193 186.234589 192.947617 200.173309 210.331879 222.472351 238.714432 264.60968 311.941101 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2802315 20.540863 20.7761841 21.0459709 21.3124161 21.5416527 21.7958336 21.9798584 22.1607132 22.366785 22.5641098 22.7519436 22.9569206 23.1394806 23.2914886 23.4980869 23.6887016 23.8603477 24.0519905 24.2324638 24.4356232 24.5979118 24.8059044 25.0051918 25.172554 25.3299103 25.5219231 25.6828041 25.8661575 26.0537453 26.2344456 26.4166832 26.5982952 26.8020554 26.9932823 27.203371 27.4135056 27.6077042 27.7866325 27.9707413 28.1560516 28.3387794 28.555706 28.7521172 28.9536629 29.1423607 29.3423939 29.5793762 29.7841148 29.988224 30.1960335 30.4313412 30.6615372 30.9027195 31.1531639 31.4034081 31.6214256 31.8494415 32.072731 32.3120499 32.5577583 32.853508 33.1587906 33.4260941 33.7294731 34.0150146 34.2581406 34.5915565 34.8959732 35.2029495 35.5399857 35.892395 36.2385483 36.6032639 36.9572411 37.358284 37.7814293 38.2284393 38.6689911 39.1147766 39.487339 39.9839134 40.4810562 40.8789215 41.5386581 42.1481705 42.8278503 43.5958405 44.4366264 45.2740822 46.3090973 47.413784 48.6613731 50.2469635 51.9236603 54.2491837 57.1522751 61.9254456 70.6527405 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1117973 10.2080755 10.3203812 10.4272575 10.5032682 10.6103992 10.7241344 10.8108654 10.9095392 11.0127878 11.1202984 11.2275829 11.336277 11.4573956 11.5521984 11.6611462 11.7573109 11.8775806 11.9958477 12.1045818 12.2339668 12.3691349 12.4996471 12.6292181 12.7651157 12.8809719 13.000473 13.1414328 13.2754993 13.4102898 13.5505791 13.6724634 13.7946472 13.9242611 14.0506344 14.1861134 14.3168144 14.4558697 14.6023378 14.7707176 14.9299459 15.0894318 15.2556362 15.383131 15.5255489 15.6677513 15.8182564 15.9608212 16.1316528 16.3104916 16.4980354 16.680994 16.8391991 17.0166016 17.2178307 17.3842583 17.5921097 17.7686615 17.9420471 18.0922127 18.2926521 18.4738026 18.6539116 18.8862457 19.0844307 19.2842388 19.5056973 19.7472897 19.9960747 20.1974545 20.3440151 20.5583878 20.788044 21.0427303 21.2776108 21.507555 21.7408009 21.9804688 22.198967 22.4741077 22.7421074 23.0561066 23.3598156 23.6993446 24.0833206 24.4439125 24.8044701 25.1998558 25.6338253 26.0839272 26.5575314 27.1131783 27.7598629 28.3707848 29.230999 30.2049828 31.5212822 33.4116898 37.3578415 72.3692474 ------------------------------ Transdef: Tab for variable 5 0.976250172 2.42344999 2.8362112 3.07927227 3.30941916 3.51447153 3.69333696 3.85381937 3.99556112 4.11592865 4.20968342 4.29466152 4.39477539 4.48355722 4.56303596 4.64148855 4.72239113 4.79136992 4.86318636 4.93750334 5.00306129 5.06511354 5.12863064 5.18283558 5.23518467 5.29364443 5.34035206 5.3896184 5.43946743 5.48135948 5.52014542 5.55617237 5.5969677 5.63850117 5.68267059 5.73051834 5.78261948 5.82312298 5.86680651 5.90529585 5.94896412 5.98540115 6.02147293 6.06018066 6.09927464 6.13648891 6.17679024 6.21165895 6.2482667 6.28689289 6.3215003 6.35871124 6.40301943 6.43918133 6.48227072 6.5194664 6.55378199 6.59725761 6.63358402 6.67094135 6.70563745 6.74353981 6.77693939 6.82003832 6.85660791 6.88949585 6.92454529 6.97309971 7.02131653 7.06255341 7.10715532 7.15464687 7.19235849 7.23849487 7.28542423 7.33322716 7.38605881 7.44152546 7.48362541 7.52934217 7.58521938 7.63587713 7.69051933 7.74560881 7.80841064 7.87117147 7.93012142 8.00610542 8.08202934 8.16597843 8.25418472 8.35335159 8.46539402 8.59296036 8.7286644 8.88771629 9.10182953 9.38273621 9.7823658 10.5916328 17.7251911 ------------------------------ Transdef: Tab for variable 6 15.0050735 19.8760509 23.8098202 25.6340599 26.5353813 27.2578945 28.0727692 28.8051319 29.4414749 30.0269871 30.6644802 31.1652527 31.7247276 32.1814728 32.6592445 33.0220146 33.4618149 33.8342514 34.2269554 34.5726471 34.9207611 35.3403168 35.6830788 36.0489693 36.3965645 36.6997223 37.0183029 37.3106995 37.6521835 37.98629 38.2895508 38.630127 38.9834938 39.3222122 39.6216507 39.9029922 40.2289352 40.5064316 40.8593178 41.186676 41.5774918 41.9399719 42.3011627 42.6158028 42.956604 43.2089233 43.5816879 43.9235229 44.3700943 44.7601624 45.1923103 45.6957893 46.1000786 46.534584 47.0025902 47.4062729 47.845459 48.2845612 48.7291412 49.2215767 49.7017174 50.1026802 50.5045128 50.96418 51.4204178 51.931675 52.4061241 52.9006729 53.3873672 53.9048615 54.3701057 54.8894653 55.3629303 55.9020157 56.4118576 56.8753052 57.3357658 57.9047813 58.4370651 58.8826447 59.4515076 60.0322571 60.7139282 61.434761 62.1548767 63.0169678 63.8786621 64.7597122 65.7692871 66.8693237 68.2407379 69.5730896 71.2270355 73.1016846 75.4300385 77.4047241 80.8047943 84.6950989 90.9612579 101.10083 201.618698 ------------------------------ Transdef: Tab for variable 7 30.1484737 32.8248901 33.7206345 34.3348389 34.9445381 35.4084663 35.818882 36.2034454 36.5552063 36.8809738 37.2208977 37.5398674 37.7992401 38.1590691 38.3865967 38.6728554 38.9194107 39.2117424 39.4698563 39.7441711 40.0846863 40.3709869 40.6681404 41.0471191 41.3795586 41.6589584 41.993042 42.3458214 42.7475739 43.1141281 43.5712891 44.0618591 44.5006638 44.9693947 45.4194336 45.9767914 46.5408173 47.1713715 47.7217102 48.2669296 48.7959366 49.42099 50.0343781 50.706913 51.2839737 51.8921318 52.5096436 53.0546036 53.6674042 54.2710724 54.9190521 55.5930405 56.1520081 56.7296257 57.4234924 58.093914 58.8130035 59.4511642 60.202652 60.9568787 61.3180313 62.1161957 62.9944382 63.9991226 64.9635849 66.1155167 67.3061676 68.4157715 69.6367569 70.9176483 72.1719666 73.4607849 74.7548828 76.2082672 77.4817657 78.9882812 80.6066895 82.113678 83.5864105 85.4287109 87.2357178 89.2240295 91.4198761 93.6782837 96.0878296 98.5906219 101.268463 104.290314 107.2211 110.87175 114.513031 118.780106 124.014999 129.344437 136.185837 144.345703 154.694107 168.000153 187.263916 223.830582 475.479645 ------------------------------ Transdef: Tab for variable 8 2.53947878 21.4399643 26.0881367 28.7487812 30.3894844 31.4956551 32.2861519 32.918335 33.4027786 33.8043365 34.149353 34.5204544 34.919323 35.2118263 35.5025215 35.7748947 36.0578651 36.3494263 36.5606689 36.8523331 37.1324387 37.3501816 37.5944138 37.865387 38.1301918 38.3779449 38.579422 38.818367 38.9970016 39.2685318 39.5657196 39.8252525 40.1047516 40.3462257 40.6302757 40.9297028 41.2427483 41.4934921 41.7924347 42.096489 42.4626083 42.7844696 43.1460953 43.4905319 43.8258896 44.1847916 44.5267258 44.8800507 45.2484207 45.6871376 46.0737762 46.5038872 46.9622269 47.4170227 47.8740616 48.1943474 48.636116 49.0010834 49.38451 49.8262024 50.3212547 50.7948532 51.1936035 51.6455193 52.0830917 52.5427475 53.0187759 53.4260826 53.882309 54.3479233 54.8092194 55.2975197 55.777317 56.2597313 56.7387009 57.2998734 57.8498154 58.3934441 58.9353027 59.5694122 60.1966019 60.897625 61.3745728 62.1277008 62.9148178 63.7319489 64.6007538 65.5992126 66.6806335 67.9150162 69.3152924 70.9532089 72.7283478 74.7342758 77.0953217 80.0577393 83.9918213 89.1026154 97.5763092 114.75441 326.868286 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.4818497 64.1896667 65.7352371 66.9031525 67.8827209 68.8260803 69.558815 70.2664337 70.8635559 71.6153946 72.2890167 72.9444962 73.5666504 74.1420975 74.8115311 75.3220291 75.789917 76.3899384 76.9746933 77.4874802 78.0487289 78.493927 78.9640198 79.3938751 79.7740021 80.3627167 80.9619904 81.4583435 81.9862518 82.5161819 83.0899048 83.7356567 84.3505173 84.9055099 85.4639816 86.1503906 86.6895142 87.3768616 88.0680847 88.768692 89.4867401 90.1803284 90.9484253 91.7340622 92.4132919 93.1631241 94.0114288 94.7915802 95.5455933 96.3259277 97.1295319 97.9161301 98.6860046 99.469574 100.272301 101.051788 101.81826 102.517731 103.299118 104.012802 104.771095 105.423225 106.163498 106.847275 107.567505 108.215645 108.932404 109.66481 110.432465 111.137222 111.828743 112.540855 113.29097 113.978653 114.726891 115.456787 116.222153 117.008812 117.778641 118.604706 119.456543 120.124237 121.046486 121.958054 122.973892 124.084778 125.263748 126.448715 127.837845 129.446121 131.276001 133.520081 136.204224 139.461365 143.170776 148.396973 155.60672 166.846786 191.289307 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.791448474 1.12923217 1.33063281 1.502455 1.63685763 1.75320697 1.84739304 1.93140244 2.01997471 2.08808279 2.14576173 2.20119095 2.24788547 2.29532981 2.33857727 2.383322 2.42076826 2.45388508 2.48615265 2.51910448 2.54810596 2.57920504 2.60681105 2.62995505 2.65401459 2.67905927 2.70278955 2.72353482 2.74267006 2.76018286 2.77653956 2.79256368 2.8084445 2.82208586 2.83315182 2.84512758 2.85667133 2.86585426 2.87705374 2.88729477 2.89862776 2.90944886 2.91698265 2.92516184 2.93257189 2.94076443 2.94863439 2.95521164 2.96126509 2.96780324 2.97494292 2.98022532 2.98500776 2.98980045 2.99381447 2.99838209 3.00371051 3.00769091 3.01290774 3.017169 3.02216339 3.02677464 3.03112268 3.03495193 3.03892374 3.04302883 3.04706192 3.05066872 3.05414295 3.05775785 3.06102753 3.06485844 3.06760049 3.07163596 3.07478905 3.07758737 3.08078623 3.08378196 3.08701468 3.08985281 3.09279776 3.09538221 3.09819007 3.1008656 3.10337162 3.10588408 3.10885262 3.11184335 3.11436081 3.11684895 3.11943245 3.12239885 3.12497926 3.12768459 3.12984538 3.13177395 3.13400412 3.13641119 3.13873601 3.14159155 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00632857997 0.0114417076 0.0182235315 0.0245544016 0.031619668 0.040417552 0.0489501953 0.0576687753 0.0667691231 0.0756959468 0.0835309029 0.0930353403 0.102053568 0.108931303 0.116161466 0.124034256 0.13212502 0.141218662 0.149077535 0.156743318 0.163934559 0.172000572 0.178655013 0.185899377 0.192710876 0.198990107 0.205812335 0.212545633 0.219714105 0.225824177 0.232307971 0.237711072 0.244343773 0.251228988 0.257063508 0.262835234 0.268795967 0.27444005 0.280387729 0.286246657 0.292212725 0.29805994 0.303980827 0.31021595 0.316116393 0.321359187 0.327177167 0.33337605 0.339244962 0.344899178 0.350768447 0.356213242 0.361635655 0.367445946 0.372870505 0.378341496 0.384819508 0.390138149 0.39623481 0.402276158 0.408712566 0.414117157 0.420334578 0.426179171 0.432600021 0.438851237 0.445915401 0.452253163 0.45883441 0.464612842 0.471290648 0.477730244 0.484277368 0.492011905 0.498518586 0.505647898 0.512009501 0.518158197 0.525158882 0.532678843 0.539795578 0.545734882 0.554599762 0.565070033 0.573931098 0.583075702 0.593853712 0.604167342 0.616532207 0.628748059 0.641490817 0.654467344 0.67224133 0.693425298 0.71226716 0.731666744 0.766533971 0.802830458 0.856786013 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.225773543 0.244313478 0.256992161 0.269994676 0.281964779 0.292552769 0.302208662 0.311091959 0.319360912 0.327116847 0.335439622 0.342978179 0.349874377 0.35582599 0.362527221 0.36946857 0.375638515 0.382846534 0.389446497 0.395730078 0.401480556 0.4064188 0.410877615 0.414421648 0.418734252 0.422955155 0.42705512 0.430956304 0.435269177 0.439349145 0.443513513 0.44730252 0.451431572 0.455428928 0.459573984 0.464184284 0.46820581 0.472133398 0.476134956 0.478828132 0.482777059 0.486232519 0.489808857 0.493110418 0.496680737 0.500299513 0.504542172 0.508793116 0.512904167 0.517453194 0.52127409 0.524758935 0.52896142 0.533484042 0.53785181 0.542172551 0.546570718 0.549480915 0.553703427 0.5576967 0.561405897 0.566320896 0.570900083 0.5758183 0.579970241 0.584003568 0.588845849 0.593880653 0.598398387 0.603623807 0.608984351 0.614798069 0.620272994 0.62609148 0.632221282 0.638171196 0.645241737 0.651346207 0.658843637 0.666098833 0.673549652 0.679441988 0.688265085 0.696963131 0.704044342 0.714259803 0.721159101 0.729943752 0.740961194 0.751626372 0.760311842 0.771317482 0.784692466 0.79846096 0.814095736 0.830075622 0.85571444 0.881370306 0.922434211 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0277634 21.3566399 22.158741 22.7530441 23.3240108 23.8502083 24.3363113 24.8045387 25.184597 25.5870781 25.9177208 26.2254868 26.6154785 26.990366 27.3184814 27.6527405 27.9238529 28.2644672 28.5986443 28.8650131 29.1775703 29.4266586 29.6945934 30.0196037 30.2893715 30.538578 30.8140373 31.0430984 31.3235035 31.5837402 31.8799763 32.140831 32.4145126 32.7302094 33.0559235 33.3674088 33.7230835 34.0220261 34.34478 34.566246 34.8996048 35.2058411 35.5243378 35.8514252 36.1523819 36.4537048 36.8469276 37.2000122 37.5070763 37.8901291 38.2580338 38.6139755 38.9565964 39.358429 39.7635918 40.1571846 40.5515594 40.8859406 41.3257637 41.832119 42.3335648 42.7710648 43.2512512 43.6908035 44.2048645 44.6463013 45.1868172 45.7097549 46.32938 46.9147034 47.4826508 48.0358429 48.6111221 49.3192978 49.9816971 50.7069702 51.5986214 52.3951263 53.1092453 54.0434456 54.9263916 55.8309631 56.9299164 57.9280701 58.9555206 60.141716 61.5082703 62.7783432 64.4050293 66.0340271 67.8062592 69.2537231 71.473877 74.0897141 76.8456345 80.2906036 84.3872833 88.4031067 94.9131088 104.628922 230.5327 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.5166626 10.9019146 11.2360058 11.4768085 11.7327118 11.9913158 12.2728052 12.4804459 12.7413149 12.9730206 13.2051907 13.4319353 13.6849031 13.886858 14.0993309 14.3122597 14.5168686 14.7059288 14.929739 15.1544895 15.3681755 15.5423222 15.7648983 15.9753752 16.1921921 16.3809738 16.5858212 16.7812424 16.9702148 17.1868477 17.3992023 17.6221657 17.8329563 18.0420303 18.2507362 18.4807777 18.6846466 18.885601 19.0807533 19.2638588 19.4863701 19.7400284 19.9699364 20.2378273 20.4728279 20.6883545 20.9035435 21.1332245 21.3596153 21.6126194 21.8260899 22.0787449 22.3324814 22.5999432 22.8475246 23.0994473 23.3343277 23.5891533 23.8375206 24.0958881 24.3853397 24.64118 24.9125023 25.2082558 25.4868813 25.7480927 26.0217628 26.3459206 26.6424847 27.0021133 27.3564262 27.6697807 27.9611931 28.3110809 28.7272453 29.0993443 29.4736938 29.8779049 30.3308563 30.7890091 31.2631989 31.6901951 32.2709198 32.856636 33.4472351 34.0156326 34.7178078 35.5022316 36.4099274 37.2515106 38.2447433 39.4122009 40.388031 41.8493118 43.6778336 45.6638489 48.4395523 52.5294418 59.4732513 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 54.5 38.6 34.5 9.2 33.5 52.9 38.1 50.5 -28.7 -8.2 -23.1 3.6 3.0 2 54.5 100.0 62.4 48.1 19.0 59.2 94.0 64.0 89.8 -51.9 -19.2 -41.2 27.6 18.5 3 38.6 62.4 100.0 25.1 -4.5 24.9 65.8 45.3 68.1 -20.0 -20.3 -45.0 61.4 5.0 4 34.5 48.1 25.1 100.0 0.4 22.9 49.9 37.3 53.1 -13.2 -25.1 -52.0 7.7 67.0 5 9.2 19.0 -4.5 0.4 100.0 80.5 -8.9 46.6 46.2 27.1 0.7 1.2 -11.6 -6.0 6 33.5 59.2 24.9 22.9 80.5 100.0 36.7 71.8 75.3 -4.5 -8.6 -18.6 3.9 4.7 7 52.9 94.0 65.8 49.9 -8.9 36.7 100.0 56.9 77.2 -58.4 -18.4 -41.9 32.5 21.8 8 38.1 64.0 45.3 37.3 46.6 71.8 56.9 100.0 76.3 -10.5 -16.7 -32.5 20.4 16.2 9 50.5 89.8 68.1 53.1 46.2 75.3 77.2 76.3 100.0 -26.2 -21.6 -47.0 32.1 22.9 10 -28.7 -51.9 -20.0 -13.2 27.1 -4.5 -58.4 -10.5 -26.2 100.0 3.3 10.0 -6.4 -2.2 11 -8.2 -19.2 -20.3 -25.1 0.7 -8.6 -18.4 -16.7 -21.6 3.3 100.0 54.3 -9.4 -14.9 12 -23.1 -41.2 -45.0 -52.0 1.2 -18.6 -41.9 -32.5 -47.0 10.0 54.3 100.0 -20.9 -26.6 13 3.6 27.6 61.4 7.7 -11.6 3.9 32.5 20.4 32.1 -6.4 -9.4 -20.9 100.0 38.7 14 3.0 18.5 5.0 67.0 -6.0 4.7 21.8 16.2 22.9 -2.2 -14.9 -26.6 38.7 100.0 TOTAL CORRELATION TO TARGET (diagonal) 122.866295 TOTAL CORRELATION OF ALL VARIABLES 60.3394071 ROUND 1: MAX CORR ( 60.3254744) AFTER KILLING INPUT VARIABLE 7 CONTR 1.29660443 ROUND 2: MAX CORR ( 60.3047491) AFTER KILLING INPUT VARIABLE 5 CONTR 1.58117218 ROUND 3: MAX CORR ( 60.2687708) AFTER KILLING INPUT VARIABLE 11 CONTR 2.08279279 ROUND 4: MAX CORR ( 60.2120695) AFTER KILLING INPUT VARIABLE 8 CONTR 2.61369809 ROUND 5: MAX CORR ( 60.1011335) AFTER KILLING INPUT VARIABLE 10 CONTR 3.65336427 ROUND 6: MAX CORR ( 59.6956124) AFTER KILLING INPUT VARIABLE 12 CONTR 6.969943 ROUND 7: MAX CORR ( 59.3087967) AFTER KILLING INPUT VARIABLE 14 CONTR 6.7847455 ROUND 8: MAX CORR ( 58.816484) AFTER KILLING INPUT VARIABLE 9 CONTR 7.62591496 ROUND 9: MAX CORR ( 58.7628823) AFTER KILLING INPUT VARIABLE 6 CONTR 2.51047022 ROUND 10: MAX CORR ( 58.0097283) AFTER KILLING INPUT VARIABLE 4 CONTR 9.37804608 ROUND 11: MAX CORR ( 55.7654909) AFTER KILLING INPUT VARIABLE 3 CONTR 15.9793181 ROUND 12: MAX CORR ( 54.4860815) AFTER KILLING INPUT VARIABLE 13 CONTR 11.8767377 LAST REMAINING VARIABLE: 2 total correlation to target: 60.3394071 % total significance: 117.04907 sigma correlations of single variables to target: variable 2: 54.4860815 % , in sigma: 105.694528 variable 3: 38.6192536 % , in sigma: 74.9153488 variable 4: 34.5059502 % , in sigma: 66.9361796 variable 5: 9.1713968 % , in sigma: 17.7910841 variable 6: 33.515976 % , in sigma: 65.0157835 variable 7: 52.8534484 % , in sigma: 102.527474 variable 8: 38.071638 % , in sigma: 73.8530597 variable 9: 50.4761479 % , in sigma: 97.9158807 variable 10: -28.7206059 % , in sigma: 55.7135109 variable 11: -8.16483408 % , in sigma: 15.8385089 variable 12: -23.093543 % , in sigma: 44.7978836 variable 13: 3.62139825 % , in sigma: 7.02494968 variable 14: 3.0180779 % , in sigma: 5.85460198 variables sorted by significance: 1 most relevant variable 2 corr 54.4860802 , in sigma: 105.694526 2 most relevant variable 13 corr 11.8767376 , in sigma: 23.0390248 3 most relevant variable 3 corr 15.9793177 , in sigma: 30.9973924 4 most relevant variable 4 corr 9.37804604 , in sigma: 18.1919515 5 most relevant variable 6 corr 2.51047015 , in sigma: 4.86992186 6 most relevant variable 9 corr 7.62591505 , in sigma: 14.7930898 7 most relevant variable 14 corr 6.78474569 , in sigma: 13.161352 8 most relevant variable 12 corr 6.96994305 , in sigma: 13.5206061 9 most relevant variable 10 corr 3.65336418 , in sigma: 7.08695862 10 most relevant variable 8 corr 2.61369801 , in sigma: 5.07016785 11 most relevant variable 11 corr 2.08279276 , in sigma: 4.04029419 12 most relevant variable 5 corr 1.58117223 , in sigma: 3.06722834 13 most relevant variable 7 corr 1.29660439 , in sigma: 2.51521098 global correlations between input variables: variable 2: 99.0428252 % variable 3: 93.3302422 % variable 4: 90.4039783 % variable 5: 94.8281173 % variable 6: 93.3446933 % variable 7: 98.4997304 % variable 8: 85.5349842 % variable 9: 98.8114426 % variable 10: 72.0721864 % variable 11: 55.4725359 % variable 12: 73.0162138 % variable 13: 83.6915907 % variable 14: 85.9583511 % significance loss when removing single variables: variable 2: corr = 5.25403655 % , sigma = 10.1920142 variable 3: corr = 11.9183303 % , sigma = 23.1197082 variable 4: corr = 13.707651 % , sigma = 26.5907121 variable 5: corr = 1.904895 % , sigma = 3.6952002 variable 6: corr = 4.96598184 % , sigma = 9.63323283 variable 7: corr = 1.29660443 % , sigma = 2.51521105 variable 8: corr = 1.92607836 % , sigma = 3.73629262 variable 9: corr = 5.34729622 % , sigma = 10.3729234 variable 10: corr = 3.81122923 % , sigma = 7.39319227 variable 11: corr = 1.97811038 % , sigma = 3.83722664 variable 12: corr = 4.91393963 % , sigma = 9.53227903 variable 13: corr = 8.16249523 % , sigma = 15.8339719 variable 14: corr = 7.06502187 % , sigma = 13.7050442 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 20.8525829 sigma out 15 active outputs RANK 2 NODE 7 --> 19.2589302 sigma out 15 active outputs RANK 3 NODE 4 --> 19.1709118 sigma out 15 active outputs RANK 4 NODE 12 --> 18.1311817 sigma out 15 active outputs RANK 5 NODE 6 --> 14.9591341 sigma out 15 active outputs RANK 6 NODE 8 --> 14.8601818 sigma out 15 active outputs RANK 7 NODE 1 --> 13.7130737 sigma out 15 active outputs RANK 8 NODE 2 --> 13.4193172 sigma out 15 active outputs RANK 9 NODE 5 --> 13.3471336 sigma out 15 active outputs RANK 10 NODE 11 --> 11.6260862 sigma out 15 active outputs RANK 11 NODE 10 --> 10.9642544 sigma out 15 active outputs RANK 12 NODE 3 --> 10.2073669 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 39.5363541 sigma in 12act. ( 40.9950333 sig out 1act.) RANK 2 NODE 4 --> 16.9952927 sigma in 12act. ( 14.931838 sig out 1act.) RANK 3 NODE 14 --> 14.2387047 sigma in 12act. ( 8.40280247 sig out 1act.) RANK 4 NODE 6 --> 14.1705751 sigma in 12act. ( 15.2078238 sig out 1act.) RANK 5 NODE 9 --> 12.8379087 sigma in 12act. ( 15.0741539 sig out 1act.) RANK 6 NODE 15 --> 9.66685963 sigma in 12act. ( 11.2307453 sig out 1act.) RANK 7 NODE 1 --> 8.31529617 sigma in 12act. ( 8.11691952 sig out 1act.) RANK 8 NODE 7 --> 7.19903946 sigma in 12act. ( 7.64656448 sig out 1act.) RANK 9 NODE 13 --> 7.14876747 sigma in 12act. ( 6.85405207 sig out 1act.) RANK 10 NODE 3 --> 6.84388733 sigma in 12act. ( 7.70627737 sig out 1act.) RANK 11 NODE 10 --> 5.76346779 sigma in 12act. ( 0.198090553 sig out 1act.) RANK 12 NODE 5 --> 5.40515471 sigma in 12act. ( 5.49767351 sig out 1act.) RANK 13 NODE 2 --> 5.23711634 sigma in 12act. ( 1.35547483 sig out 1act.) RANK 14 NODE 12 --> 4.76203394 sigma in 12act. ( 5.27289248 sig out 1act.) RANK 15 NODE 8 --> 2.68767953 sigma in 12act. ( 1.17719626 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 40.9950333 sigma out 1act.( 39.5363541 sig in 12act.) RANK 2 NODE 6 --> 15.2078238 sigma out 1act.( 14.1705751 sig in 12act.) RANK 3 NODE 9 --> 15.0741539 sigma out 1act.( 12.8379087 sig in 12act.) RANK 4 NODE 4 --> 14.931838 sigma out 1act.( 16.9952927 sig in 12act.) RANK 5 NODE 15 --> 11.2307453 sigma out 1act.( 9.66685963 sig in 12act.) RANK 6 NODE 14 --> 8.40280247 sigma out 1act.( 14.2387047 sig in 12act.) RANK 7 NODE 1 --> 8.11691952 sigma out 1act.( 8.31529617 sig in 12act.) RANK 8 NODE 3 --> 7.70627737 sigma out 1act.( 6.84388733 sig in 12act.) RANK 9 NODE 7 --> 7.64656448 sigma out 1act.( 7.19903946 sig in 12act.) RANK 10 NODE 13 --> 6.85405207 sigma out 1act.( 7.14876747 sig in 12act.) RANK 11 NODE 5 --> 5.49767351 sigma out 1act.( 5.40515471 sig in 12act.) RANK 12 NODE 12 --> 5.27289248 sigma out 1act.( 4.76203394 sig in 12act.) RANK 13 NODE 2 --> 1.35547483 sigma out 1act.( 5.23711634 sig in 12act.) RANK 14 NODE 8 --> 1.17719626 sigma out 1act.( 2.68767953 sig in 12act.) RANK 15 NODE 10 --> 0.198090553 sigma out 1act.( 5.76346779 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.3929482 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 19.7483273 sigma out 15 active outputs RANK 2 NODE 7 --> 19.2392979 sigma out 15 active outputs RANK 3 NODE 4 --> 17.655962 sigma out 15 active outputs RANK 4 NODE 12 --> 17.3499622 sigma out 15 active outputs RANK 5 NODE 2 --> 16.6529236 sigma out 15 active outputs RANK 6 NODE 8 --> 16.4781151 sigma out 15 active outputs RANK 7 NODE 6 --> 15.7051983 sigma out 15 active outputs RANK 8 NODE 5 --> 13.9702559 sigma out 15 active outputs RANK 9 NODE 1 --> 13.8820534 sigma out 15 active outputs RANK 10 NODE 10 --> 13.0940838 sigma out 15 active outputs RANK 11 NODE 11 --> 12.7673826 sigma out 15 active outputs RANK 12 NODE 3 --> 11.8048592 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 35.9141464 sigma in 12act. ( 35.9663773 sig out 1act.) RANK 2 NODE 4 --> 16.8912621 sigma in 12act. ( 14.1783152 sig out 1act.) RANK 3 NODE 6 --> 16.3338203 sigma in 12act. ( 15.0714931 sig out 1act.) RANK 4 NODE 9 --> 15.380909 sigma in 12act. ( 15.0874147 sig out 1act.) RANK 5 NODE 15 --> 13.6498775 sigma in 12act. ( 11.2167416 sig out 1act.) RANK 6 NODE 14 --> 11.1567059 sigma in 12act. ( 6.77986479 sig out 1act.) RANK 7 NODE 7 --> 10.7020855 sigma in 12act. ( 7.66178703 sig out 1act.) RANK 8 NODE 3 --> 9.99136734 sigma in 12act. ( 8.46613216 sig out 1act.) RANK 9 NODE 12 --> 9.60203934 sigma in 12act. ( 5.40471601 sig out 1act.) RANK 10 NODE 1 --> 8.95796871 sigma in 12act. ( 7.25304604 sig out 1act.) RANK 11 NODE 5 --> 8.43576431 sigma in 12act. ( 5.1393671 sig out 1act.) RANK 12 NODE 2 --> 7.61100101 sigma in 12act. ( 0.550738275 sig out 1act.) RANK 13 NODE 13 --> 7.5722127 sigma in 12act. ( 6.66147852 sig out 1act.) RANK 14 NODE 10 --> 6.33299255 sigma in 12act. ( 1.11892688 sig out 1act.) RANK 15 NODE 8 --> 5.24013042 sigma in 12act. ( 0.842596591 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 35.9663773 sigma out 1act.( 35.9141464 sig in 12act.) RANK 2 NODE 9 --> 15.0874147 sigma out 1act.( 15.380909 sig in 12act.) RANK 3 NODE 6 --> 15.0714931 sigma out 1act.( 16.3338203 sig in 12act.) RANK 4 NODE 4 --> 14.1783152 sigma out 1act.( 16.8912621 sig in 12act.) RANK 5 NODE 15 --> 11.2167416 sigma out 1act.( 13.6498775 sig in 12act.) RANK 6 NODE 3 --> 8.46613216 sigma out 1act.( 9.99136734 sig in 12act.) RANK 7 NODE 7 --> 7.66178703 sigma out 1act.( 10.7020855 sig in 12act.) RANK 8 NODE 1 --> 7.25304604 sigma out 1act.( 8.95796871 sig in 12act.) RANK 9 NODE 14 --> 6.77986479 sigma out 1act.( 11.1567059 sig in 12act.) RANK 10 NODE 13 --> 6.66147852 sigma out 1act.( 7.5722127 sig in 12act.) RANK 11 NODE 12 --> 5.40471601 sigma out 1act.( 9.60203934 sig in 12act.) RANK 12 NODE 5 --> 5.1393671 sigma out 1act.( 8.43576431 sig in 12act.) RANK 13 NODE 10 --> 1.11892688 sigma out 1act.( 6.33299255 sig in 12act.) RANK 14 NODE 8 --> 0.842596591 sigma out 1act.( 5.24013042 sig in 12act.) RANK 15 NODE 2 --> 0.550738275 sigma out 1act.( 7.61100101 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 49.0552368 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.413148969 *** contribution from regularisation: 0.00408816803 *** contribution from error: -0.417237133 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.45234254 *** contribution from regularisation: 0.00228862558 *** contribution from error: -0.45463118 *********************************************** -----------------> Test sample ENTER BFGS code START -42196.149 -0.239050269 -0.00183292117 EXIT FROM BFGS code FG_START 0. -0.239050269 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.474702299 *** contribution from regularisation: 0.00207937183 *** contribution from error: -0.476781666 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -44272.1605 -0.239050269 -4.75526428 EXIT FROM BFGS code FG_LNSRCH 0. -0.240002021 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.506492674 *** contribution from regularisation: 0.00282498379 *** contribution from error: -0.509317636 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47237.0241 -0.240002021 -23.2380733 EXIT FROM BFGS code NEW_X -47237.0241 -0.240002021 -23.2380733 ENTER BFGS code NEW_X -47237.0241 -0.240002021 -23.2380733 EXIT FROM BFGS code FG_LNSRCH 0. -0.244532168 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.511051059 *** contribution from regularisation: 0.00303538609 *** contribution from error: -0.514086425 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47662.1545 -0.244532168 4.32612944 EXIT FROM BFGS code NEW_X -47662.1545 -0.244532168 4.32612944 ENTER BFGS code NEW_X -47662.1545 -0.244532168 4.32612944 EXIT FROM BFGS code FG_LNSRCH 0. -0.241473392 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.512380898 *** contribution from regularisation: 0.00309476699 *** contribution from error: -0.51547569 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47786.1802 -0.241473392 11.6752167 EXIT FROM BFGS code NEW_X -47786.1802 -0.241473392 11.6752167 ENTER BFGS code NEW_X -47786.1802 -0.241473392 11.6752167 EXIT FROM BFGS code FG_LNSRCH 0. -0.235406563 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.512747705 *** contribution from regularisation: 0.00310585042 *** contribution from error: -0.515853584 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47820.3903 -0.235406563 18.9419823 EXIT FROM BFGS code NEW_X -47820.3903 -0.235406563 18.9419823 ENTER BFGS code NEW_X -47820.3903 -0.235406563 18.9419823 EXIT FROM BFGS code FG_LNSRCH 0. -0.214793414 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.513605893 *** contribution from regularisation: 0.00300162076 *** contribution from error: -0.516607523 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47900.4284 -0.214793414 20.8537025 EXIT FROM BFGS code NEW_X -47900.4284 -0.214793414 20.8537025 ENTER BFGS code NEW_X -47900.4284 -0.214793414 20.8537025 EXIT FROM BFGS code FG_LNSRCH 0. -0.149180949 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.515256226 *** contribution from regularisation: 0.00303805945 *** contribution from error: -0.518294275 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48054.3431 -0.149180949 17.5190163 EXIT FROM BFGS code NEW_X -48054.3431 -0.149180949 17.5190163 ENTER BFGS code NEW_X -48054.3431 -0.149180949 17.5190163 EXIT FROM BFGS code FG_LNSRCH 0. -0.10211657 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 39.6111717 sigma out 15 active outputs RANK 2 NODE 10 --> 26.8384476 sigma out 15 active outputs RANK 3 NODE 8 --> 22.6919689 sigma out 15 active outputs RANK 4 NODE 1 --> 22.3405399 sigma out 15 active outputs RANK 5 NODE 7 --> 18.6642303 sigma out 15 active outputs RANK 6 NODE 12 --> 16.3295403 sigma out 15 active outputs RANK 7 NODE 4 --> 14.1920805 sigma out 15 active outputs RANK 8 NODE 6 --> 14.0128212 sigma out 15 active outputs RANK 9 NODE 11 --> 11.3988094 sigma out 15 active outputs RANK 10 NODE 9 --> 10.8918276 sigma out 15 active outputs RANK 11 NODE 5 --> 10.3956413 sigma out 15 active outputs RANK 12 NODE 3 --> 6.23702002 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 37.3010864 sigma in 12act. ( 37.5103569 sig out 1act.) RANK 2 NODE 9 --> 30.1776142 sigma in 12act. ( 22.6979904 sig out 1act.) RANK 3 NODE 11 --> 28.2980537 sigma in 12act. ( 25.263443 sig out 1act.) RANK 4 NODE 3 --> 18.6633415 sigma in 12act. ( 13.6830769 sig out 1act.) RANK 5 NODE 13 --> 15.3988943 sigma in 12act. ( 10.9043179 sig out 1act.) RANK 6 NODE 12 --> 15.2066059 sigma in 12act. ( 12.541132 sig out 1act.) RANK 7 NODE 4 --> 14.4379549 sigma in 12act. ( 11.6023111 sig out 1act.) RANK 8 NODE 1 --> 14.0122337 sigma in 12act. ( 14.6450949 sig out 1act.) RANK 9 NODE 7 --> 13.4339943 sigma in 12act. ( 14.0656395 sig out 1act.) RANK 10 NODE 10 --> 8.06537247 sigma in 12act. ( 6.70362473 sig out 1act.) RANK 11 NODE 15 --> 7.05862808 sigma in 12act. ( 2.92746639 sig out 1act.) RANK 12 NODE 2 --> 5.56617689 sigma in 12act. ( 3.11692095 sig out 1act.) RANK 13 NODE 14 --> 4.96333075 sigma in 12act. ( 2.80900216 sig out 1act.) RANK 14 NODE 5 --> 4.77693558 sigma in 12act. ( 0.664950728 sig out 1act.) RANK 15 NODE 8 --> 3.68539715 sigma in 12act. ( 2.18483901 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 37.5103569 sigma out 1act.( 37.3010864 sig in 12act.) RANK 2 NODE 11 --> 25.263443 sigma out 1act.( 28.2980537 sig in 12act.) RANK 3 NODE 9 --> 22.6979904 sigma out 1act.( 30.1776142 sig in 12act.) RANK 4 NODE 1 --> 14.6450949 sigma out 1act.( 14.0122337 sig in 12act.) RANK 5 NODE 7 --> 14.0656395 sigma out 1act.( 13.4339943 sig in 12act.) RANK 6 NODE 3 --> 13.6830769 sigma out 1act.( 18.6633415 sig in 12act.) RANK 7 NODE 12 --> 12.541132 sigma out 1act.( 15.2066059 sig in 12act.) RANK 8 NODE 4 --> 11.6023111 sigma out 1act.( 14.4379549 sig in 12act.) RANK 9 NODE 13 --> 10.9043179 sigma out 1act.( 15.3988943 sig in 12act.) RANK 10 NODE 10 --> 6.70362473 sigma out 1act.( 8.06537247 sig in 12act.) RANK 11 NODE 2 --> 3.11692095 sigma out 1act.( 5.56617689 sig in 12act.) RANK 12 NODE 15 --> 2.92746639 sigma out 1act.( 7.05862808 sig in 12act.) RANK 13 NODE 14 --> 2.80900216 sigma out 1act.( 4.96333075 sig in 12act.) RANK 14 NODE 8 --> 2.18483901 sigma out 1act.( 3.68539715 sig in 12act.) RANK 15 NODE 5 --> 0.664950728 sigma out 1act.( 4.77693558 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.3915749 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.517268181 *** contribution from regularisation: 0.00317043159 *** contribution from error: -0.520438612 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48241.9821 -0.10211657 19.0068779 EXIT FROM BFGS code NEW_X -48241.9821 -0.10211657 19.0068779 ENTER BFGS code NEW_X -48241.9821 -0.10211657 19.0068779 EXIT FROM BFGS code FG_LNSRCH 0. -0.0295612793 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.519093692 *** contribution from regularisation: 0.00349291367 *** contribution from error: -0.522586584 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48412.2327 -0.0295612793 -5.29174852 EXIT FROM BFGS code NEW_X -48412.2327 -0.0295612793 -5.29174852 ENTER BFGS code NEW_X -48412.2327 -0.0295612793 -5.29174852 EXIT FROM BFGS code FG_LNSRCH 0. -0.0169907622 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.520341098 *** contribution from regularisation: 0.00313852145 *** contribution from error: -0.52347964 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48528.5711 -0.0169907622 4.64386082 EXIT FROM BFGS code NEW_X -48528.5711 -0.0169907622 4.64386082 ENTER BFGS code NEW_X -48528.5711 -0.0169907622 4.64386082 EXIT FROM BFGS code FG_LNSRCH 0. 0.0124966055 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.521690011 *** contribution from regularisation: 0.00347014074 *** contribution from error: -0.525160134 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48654.3753 0.0124966055 4.14516973 EXIT FROM BFGS code NEW_X -48654.3753 0.0124966055 4.14516973 ENTER BFGS code NEW_X -48654.3753 0.0124966055 4.14516973 EXIT FROM BFGS code FG_LNSRCH 0. 0.0459078215 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.523319721 *** contribution from regularisation: 0.00376020023 *** contribution from error: -0.52707994 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48806.3674 0.0459078215 14.1724195 EXIT FROM BFGS code NEW_X -48806.3674 0.0459078215 14.1724195 ENTER BFGS code NEW_X -48806.3674 0.0459078215 14.1724195 EXIT FROM BFGS code FG_LNSRCH 0. 0.0441473164 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.524814963 *** contribution from regularisation: 0.00323696807 *** contribution from error: -0.528051913 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48945.818 0.0441473164 -3.85248256 EXIT FROM BFGS code NEW_X -48945.818 0.0441473164 -3.85248256 ENTER BFGS code NEW_X -48945.818 0.0441473164 -3.85248256 EXIT FROM BFGS code FG_LNSRCH 0. 0.0269544777 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.525240302 *** contribution from regularisation: 0.00300176349 *** contribution from error: -0.528242052 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48985.4849 0.0269544777 -0.760845602 EXIT FROM BFGS code NEW_X -48985.4849 0.0269544777 -0.760845602 ENTER BFGS code NEW_X -48985.4849 0.0269544777 -0.760845602 EXIT FROM BFGS code FG_LNSRCH 0. 0.0200576615 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.525336266 *** contribution from regularisation: 0.00314906449 *** contribution from error: -0.528485358 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48994.4386 0.0200576615 -0.136982575 EXIT FROM BFGS code NEW_X -48994.4386 0.0200576615 -0.136982575 ENTER BFGS code NEW_X -48994.4386 0.0200576615 -0.136982575 EXIT FROM BFGS code FG_LNSRCH 0. 0.00537757063 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.525844336 *** contribution from regularisation: 0.0030515762 *** contribution from error: -0.528895915 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49041.8199 0.00537757063 4.6915884 EXIT FROM BFGS code NEW_X -49041.8199 0.00537757063 4.6915884 ENTER BFGS code NEW_X -49041.8199 0.00537757063 4.6915884 EXIT FROM BFGS code FG_LNSRCH 0. -0.00894119311 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.525965989 *** contribution from regularisation: 0.00307721389 *** contribution from error: -0.529043198 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49053.1669 -0.00894119311 -1.40454233 EXIT FROM BFGS code NEW_X -49053.1669 -0.00894119311 -1.40454233 ENTER BFGS code NEW_X -49053.1669 -0.00894119311 -1.40454233 EXIT FROM BFGS code FG_LNSRCH 0. -0.00859931763 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 67.2696915 sigma out 15 active outputs RANK 2 NODE 1 --> 32.2044067 sigma out 15 active outputs RANK 3 NODE 10 --> 31.8985634 sigma out 15 active outputs RANK 4 NODE 8 --> 31.8820152 sigma out 15 active outputs RANK 5 NODE 7 --> 29.9804993 sigma out 15 active outputs RANK 6 NODE 12 --> 24.2309303 sigma out 15 active outputs RANK 7 NODE 6 --> 18.910799 sigma out 15 active outputs RANK 8 NODE 11 --> 18.318018 sigma out 15 active outputs RANK 9 NODE 9 --> 18.2429848 sigma out 15 active outputs RANK 10 NODE 4 --> 16.1808872 sigma out 15 active outputs RANK 11 NODE 3 --> 12.2537041 sigma out 15 active outputs RANK 12 NODE 5 --> 7.82405663 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 73.1303864 sigma in 12act. ( 98.6338272 sig out 1act.) RANK 2 NODE 11 --> 46.7297325 sigma in 12act. ( 46.1350784 sig out 1act.) RANK 3 NODE 9 --> 29.1380901 sigma in 12act. ( 26.7342701 sig out 1act.) RANK 4 NODE 4 --> 28.9111786 sigma in 12act. ( 28.61866 sig out 1act.) RANK 5 NODE 1 --> 19.4208889 sigma in 12act. ( 21.1895466 sig out 1act.) RANK 6 NODE 7 --> 17.59025 sigma in 12act. ( 20.5731068 sig out 1act.) RANK 7 NODE 12 --> 15.3467903 sigma in 12act. ( 13.2473316 sig out 1act.) RANK 8 NODE 3 --> 11.9238567 sigma in 12act. ( 8.15275764 sig out 1act.) RANK 9 NODE 13 --> 10.494031 sigma in 12act. ( 7.02844095 sig out 1act.) RANK 10 NODE 14 --> 7.57969618 sigma in 12act. ( 8.16261101 sig out 1act.) RANK 11 NODE 10 --> 7.57496119 sigma in 12act. ( 7.20986557 sig out 1act.) RANK 12 NODE 15 --> 5.42496538 sigma in 12act. ( 1.93663526 sig out 1act.) RANK 13 NODE 8 --> 5.04696035 sigma in 12act. ( 5.19403267 sig out 1act.) RANK 14 NODE 2 --> 3.5622406 sigma in 12act. ( 2.07939982 sig out 1act.) RANK 15 NODE 5 --> 2.8295145 sigma in 12act. ( 0.315833926 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 98.6338272 sigma out 1act.( 73.1303864 sig in 12act.) RANK 2 NODE 11 --> 46.1350784 sigma out 1act.( 46.7297325 sig in 12act.) RANK 3 NODE 4 --> 28.61866 sigma out 1act.( 28.9111786 sig in 12act.) RANK 4 NODE 9 --> 26.7342701 sigma out 1act.( 29.1380901 sig in 12act.) RANK 5 NODE 1 --> 21.1895466 sigma out 1act.( 19.4208889 sig in 12act.) RANK 6 NODE 7 --> 20.5731068 sigma out 1act.( 17.59025 sig in 12act.) RANK 7 NODE 12 --> 13.2473316 sigma out 1act.( 15.3467903 sig in 12act.) RANK 8 NODE 14 --> 8.16261101 sigma out 1act.( 7.57969618 sig in 12act.) RANK 9 NODE 3 --> 8.15275764 sigma out 1act.( 11.9238567 sig in 12act.) RANK 10 NODE 10 --> 7.20986557 sigma out 1act.( 7.57496119 sig in 12act.) RANK 11 NODE 13 --> 7.02844095 sigma out 1act.( 10.494031 sig in 12act.) RANK 12 NODE 8 --> 5.19403267 sigma out 1act.( 5.04696035 sig in 12act.) RANK 13 NODE 2 --> 2.07939982 sigma out 1act.( 3.5622406 sig in 12act.) RANK 14 NODE 15 --> 1.93663526 sigma out 1act.( 5.42496538 sig in 12act.) RANK 15 NODE 5 --> 0.315833926 sigma out 1act.( 2.8295145 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 121.277359 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.526322484 *** contribution from regularisation: 0.00321444776 *** contribution from error: -0.529536903 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49086.4159 -0.00859931763 7.4811306 EXIT FROM BFGS code NEW_X -49086.4159 -0.00859931763 7.4811306 ENTER BFGS code NEW_X -49086.4159 -0.00859931763 7.4811306 EXIT FROM BFGS code FG_LNSRCH 0. -0.00545135885 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.526653886 *** contribution from regularisation: 0.003227334 *** contribution from error: -0.529881239 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49117.3204 -0.00545135885 11.2997589 EXIT FROM BFGS code NEW_X -49117.3204 -0.00545135885 11.2997589 ENTER BFGS code NEW_X -49117.3204 -0.00545135885 11.2997589 EXIT FROM BFGS code FG_LNSRCH 0. -0.00120420894 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.527061701 *** contribution from regularisation: 0.00327223679 *** contribution from error: -0.530333936 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49155.3581 -0.00120420894 14.5234728 EXIT FROM BFGS code NEW_X -49155.3581 -0.00120420894 14.5234728 ENTER BFGS code NEW_X -49155.3581 -0.00120420894 14.5234728 EXIT FROM BFGS code FG_LNSRCH 0. 0.0110679138 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.527526677 *** contribution from regularisation: 0.00334618823 *** contribution from error: -0.530872881 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49198.7183 0.0110679138 -4.49115419 EXIT FROM BFGS code NEW_X -49198.7183 0.0110679138 -4.49115419 ENTER BFGS code NEW_X -49198.7183 0.0110679138 -4.49115419 EXIT FROM BFGS code FG_LNSRCH 0. 0.0149637386 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.527703106 *** contribution from regularisation: 0.00340757775 *** contribution from error: -0.531110704 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49215.1769 0.0149637386 18.2169819 EXIT FROM BFGS code NEW_X -49215.1769 0.0149637386 18.2169819 ENTER BFGS code NEW_X -49215.1769 0.0149637386 18.2169819 EXIT FROM BFGS code FG_LNSRCH 0. 0.0148597071 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.527972877 *** contribution from regularisation: 0.00337843271 *** contribution from error: -0.531351328 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49240.3359 0.0148597071 4.18614149 EXIT FROM BFGS code NEW_X -49240.3359 0.0148597071 4.18614149 ENTER BFGS code NEW_X -49240.3359 0.0148597071 4.18614149 EXIT FROM BFGS code FG_LNSRCH 0. 0.0177350882 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.528212249 *** contribution from regularisation: 0.00337223336 *** contribution from error: -0.531584501 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49262.6614 0.0177350882 -2.8616581 EXIT FROM BFGS code NEW_X -49262.6614 0.0177350882 -2.8616581 ENTER BFGS code NEW_X -49262.6614 0.0177350882 -2.8616581 EXIT FROM BFGS code FG_LNSRCH 0. 0.0270074196 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.528600633 *** contribution from regularisation: 0.00339579768 *** contribution from error: -0.531996429 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49298.8799 0.0270074196 -11.4754457 EXIT FROM BFGS code NEW_X -49298.8799 0.0270074196 -11.4754457 ENTER BFGS code NEW_X -49298.8799 0.0270074196 -11.4754457 EXIT FROM BFGS code FG_LNSRCH 0. 0.0328402035 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.52875334 *** contribution from regularisation: 0.00343653141 *** contribution from error: -0.532189846 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49313.1207 0.0328402035 2.6102922 EXIT FROM BFGS code NEW_X -49313.1207 0.0328402035 2.6102922 ENTER BFGS code NEW_X -49313.1207 0.0328402035 2.6102922 EXIT FROM BFGS code FG_LNSRCH 0. 0.0358147733 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.528929532 *** contribution from regularisation: 0.0034634138 *** contribution from error: -0.532392919 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49329.5526 0.0358147733 7.22759199 EXIT FROM BFGS code NEW_X -49329.5526 0.0358147733 7.22759199 ENTER BFGS code NEW_X -49329.5526 0.0358147733 7.22759199 EXIT FROM BFGS code FG_LNSRCH 0. 0.0392691158 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 83.4459915 sigma out 15 active outputs RANK 2 NODE 1 --> 60.9408531 sigma out 15 active outputs RANK 3 NODE 8 --> 42.1765976 sigma out 15 active outputs RANK 4 NODE 7 --> 37.0165482 sigma out 15 active outputs RANK 5 NODE 10 --> 36.2404404 sigma out 15 active outputs RANK 6 NODE 12 --> 35.8931351 sigma out 15 active outputs RANK 7 NODE 6 --> 31.3465805 sigma out 15 active outputs RANK 8 NODE 9 --> 27.1829109 sigma out 15 active outputs RANK 9 NODE 3 --> 22.3187008 sigma out 15 active outputs RANK 10 NODE 4 --> 21.8661213 sigma out 15 active outputs RANK 11 NODE 11 --> 20.9381123 sigma out 15 active outputs RANK 12 NODE 5 --> 6.68766642 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 86.4551315 sigma in 12act. ( 121.687592 sig out 1act.) RANK 2 NODE 11 --> 67.1605377 sigma in 12act. ( 67.0357666 sig out 1act.) RANK 3 NODE 9 --> 48.5839348 sigma in 12act. ( 47.4550171 sig out 1act.) RANK 4 NODE 4 --> 44.9175148 sigma in 12act. ( 46.9204559 sig out 1act.) RANK 5 NODE 1 --> 37.5866737 sigma in 12act. ( 41.7939911 sig out 1act.) RANK 6 NODE 7 --> 24.62327 sigma in 12act. ( 28.8109074 sig out 1act.) RANK 7 NODE 12 --> 21.338253 sigma in 12act. ( 17.2444439 sig out 1act.) RANK 8 NODE 14 --> 13.8847647 sigma in 12act. ( 15.8955727 sig out 1act.) RANK 9 NODE 3 --> 12.8926601 sigma in 12act. ( 9.5891037 sig out 1act.) RANK 10 NODE 13 --> 12.3928127 sigma in 12act. ( 9.7528944 sig out 1act.) RANK 11 NODE 10 --> 11.5028925 sigma in 12act. ( 11.7532806 sig out 1act.) RANK 12 NODE 8 --> 9.29337788 sigma in 12act. ( 10.441267 sig out 1act.) RANK 13 NODE 2 --> 5.02467394 sigma in 12act. ( 4.16918516 sig out 1act.) RANK 14 NODE 15 --> 3.25075293 sigma in 12act. ( 0.633547902 sig out 1act.) RANK 15 NODE 5 --> 2.05334878 sigma in 12act. ( 0.497543275 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 121.687592 sigma out 1act.( 86.4551315 sig in 12act.) RANK 2 NODE 11 --> 67.0357666 sigma out 1act.( 67.1605377 sig in 12act.) RANK 3 NODE 9 --> 47.4550171 sigma out 1act.( 48.5839348 sig in 12act.) RANK 4 NODE 4 --> 46.9204559 sigma out 1act.( 44.9175148 sig in 12act.) RANK 5 NODE 1 --> 41.7939911 sigma out 1act.( 37.5866737 sig in 12act.) RANK 6 NODE 7 --> 28.8109074 sigma out 1act.( 24.62327 sig in 12act.) RANK 7 NODE 12 --> 17.2444439 sigma out 1act.( 21.338253 sig in 12act.) RANK 8 NODE 14 --> 15.8955727 sigma out 1act.( 13.8847647 sig in 12act.) RANK 9 NODE 10 --> 11.7532806 sigma out 1act.( 11.5028925 sig in 12act.) RANK 10 NODE 8 --> 10.441267 sigma out 1act.( 9.29337788 sig in 12act.) RANK 11 NODE 13 --> 9.7528944 sigma out 1act.( 12.3928127 sig in 12act.) RANK 12 NODE 3 --> 9.5891037 sigma out 1act.( 12.8926601 sig in 12act.) RANK 13 NODE 2 --> 4.16918516 sigma out 1act.( 5.02467394 sig in 12act.) RANK 14 NODE 15 --> 0.633547902 sigma out 1act.( 3.25075293 sig in 12act.) RANK 15 NODE 5 --> 0.497543275 sigma out 1act.( 2.05334878 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 165.330826 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.529105067 *** contribution from regularisation: 0.00344403344 *** contribution from error: -0.532549083 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49345.9274 0.0392691158 11.8819284 EXIT FROM BFGS code NEW_X -49345.9274 0.0392691158 11.8819284 ENTER BFGS code NEW_X -49345.9274 0.0392691158 11.8819284 EXIT FROM BFGS code FG_LNSRCH 0. 0.0499685034 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.529379785 *** contribution from regularisation: 0.00342281349 *** contribution from error: -0.532802582 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49371.5483 0.0499685034 9.50054836 EXIT FROM BFGS code NEW_X -49371.5483 0.0499685034 9.50054836 ENTER BFGS code NEW_X -49371.5483 0.0499685034 9.50054836 EXIT FROM BFGS code FG_LNSRCH 0. 0.0640515387 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.529501855 *** contribution from regularisation: 0.00342605729 *** contribution from error: -0.53292793 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49382.9314 0.0640515387 53.5575676 EXIT FROM BFGS code NEW_X -49382.9314 0.0640515387 53.5575676 ENTER BFGS code NEW_X -49382.9314 0.0640515387 53.5575676 EXIT FROM BFGS code FG_LNSRCH 0. 0.0737140626 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.529620588 *** contribution from regularisation: 0.00347465719 *** contribution from error: -0.533095241 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49394.0025 0.0737140626 -0.983914733 EXIT FROM BFGS code NEW_X -49394.0025 0.0737140626 -0.983914733 ENTER BFGS code NEW_X -49394.0025 0.0737140626 -0.983914733 EXIT FROM BFGS code FG_LNSRCH 0. 0.0723778084 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.529702842 *** contribution from regularisation: 0.00349013042 *** contribution from error: -0.533192992 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49401.6775 0.0723778084 2.49379015 EXIT FROM BFGS code NEW_X -49401.6775 0.0723778084 2.49379015 ENTER BFGS code NEW_X -49401.6775 0.0723778084 2.49379015 EXIT FROM BFGS code FG_LNSRCH 0. 0.090815261 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.530059338 *** contribution from regularisation: 0.00340883364 *** contribution from error: -0.533468187 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49434.9241 0.090815261 -4.19187117 EXIT FROM BFGS code NEW_X -49434.9241 0.090815261 -4.19187117 ENTER BFGS code NEW_X -49434.9241 0.090815261 -4.19187117 EXIT FROM BFGS code FG_LNSRCH 0. 0.122307271 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.529937088 *** contribution from regularisation: 0.00340313162 *** contribution from error: -0.533340216 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49423.5233 0.122307271 -11.1266146 EXIT FROM BFGS code FG_LNSRCH 0. 0.102239534 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.52993077 *** contribution from regularisation: 0.0036413616 *** contribution from error: -0.533572137 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49422.9334 0.102239534 -5.34899473 EXIT FROM BFGS code FG_LNSRCH 0. 0.0922983065 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.529940248 *** contribution from regularisation: 0.00355245313 *** contribution from error: -0.533492684 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49423.8189 0.0922983065 -4.28275633 EXIT FROM BFGS code FG_LNSRCH 0. 0.0908593535 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.529957533 *** contribution from regularisation: 0.00351135852 *** contribution from error: -0.533468902 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49425.4284 0.0908593535 -4.19759655 EXIT FROM BFGS code FG_LNSRCH 0. 0.0908153132 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 91.7857971 sigma out 15 active outputs RANK 2 NODE 1 --> 81.2169495 sigma out 15 active outputs RANK 3 NODE 8 --> 45.8822136 sigma out 15 active outputs RANK 4 NODE 7 --> 40.6372185 sigma out 15 active outputs RANK 5 NODE 6 --> 38.0864716 sigma out 15 active outputs RANK 6 NODE 12 --> 36.5760689 sigma out 15 active outputs RANK 7 NODE 10 --> 36.0261269 sigma out 15 active outputs RANK 8 NODE 9 --> 30.2429237 sigma out 15 active outputs RANK 9 NODE 3 --> 26.2743149 sigma out 15 active outputs RANK 10 NODE 4 --> 23.9358559 sigma out 15 active outputs RANK 11 NODE 11 --> 22.2106113 sigma out 15 active outputs RANK 12 NODE 5 --> 9.35292244 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 91.7992172 sigma in 12act. ( 128.301285 sig out 1act.) RANK 2 NODE 11 --> 77.4849472 sigma in 12act. ( 78.3252716 sig out 1act.) RANK 3 NODE 9 --> 55.521225 sigma in 12act. ( 57.6586533 sig out 1act.) RANK 4 NODE 1 --> 53.5323639 sigma in 12act. ( 56.5412292 sig out 1act.) RANK 5 NODE 4 --> 51.357399 sigma in 12act. ( 53.6757126 sig out 1act.) RANK 6 NODE 7 --> 28.9970665 sigma in 12act. ( 33.6050644 sig out 1act.) RANK 7 NODE 12 --> 26.6192665 sigma in 12act. ( 20.1646404 sig out 1act.) RANK 8 NODE 14 --> 16.6834431 sigma in 12act. ( 19.1250362 sig out 1act.) RANK 9 NODE 10 --> 14.5391102 sigma in 12act. ( 14.5699663 sig out 1act.) RANK 10 NODE 3 --> 14.2543774 sigma in 12act. ( 10.6354027 sig out 1act.) RANK 11 NODE 13 --> 13.1007099 sigma in 12act. ( 10.4494028 sig out 1act.) RANK 12 NODE 8 --> 12.0729265 sigma in 12act. ( 13.1048117 sig out 1act.) RANK 13 NODE 2 --> 6.23654938 sigma in 12act. ( 5.61146784 sig out 1act.) RANK 14 NODE 15 --> 2.17697549 sigma in 12act. ( 0.458911389 sig out 1act.) RANK 15 NODE 5 --> 1.44357073 sigma in 12act. ( 0.0684836656 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 128.301285 sigma out 1act.( 91.7992172 sig in 12act.) RANK 2 NODE 11 --> 78.3252716 sigma out 1act.( 77.4849472 sig in 12act.) RANK 3 NODE 9 --> 57.6586533 sigma out 1act.( 55.521225 sig in 12act.) RANK 4 NODE 1 --> 56.5412292 sigma out 1act.( 53.5323639 sig in 12act.) RANK 5 NODE 4 --> 53.6757126 sigma out 1act.( 51.357399 sig in 12act.) RANK 6 NODE 7 --> 33.6050644 sigma out 1act.( 28.9970665 sig in 12act.) RANK 7 NODE 12 --> 20.1646404 sigma out 1act.( 26.6192665 sig in 12act.) RANK 8 NODE 14 --> 19.1250362 sigma out 1act.( 16.6834431 sig in 12act.) RANK 9 NODE 10 --> 14.5699663 sigma out 1act.( 14.5391102 sig in 12act.) RANK 10 NODE 8 --> 13.1048117 sigma out 1act.( 12.0729265 sig in 12act.) RANK 11 NODE 3 --> 10.6354027 sigma out 1act.( 14.2543774 sig in 12act.) RANK 12 NODE 13 --> 10.4494028 sigma out 1act.( 13.1007099 sig in 12act.) RANK 13 NODE 2 --> 5.61146784 sigma out 1act.( 6.23654938 sig in 12act.) RANK 14 NODE 15 --> 0.458911389 sigma out 1act.( 2.17697549 sig in 12act.) RANK 15 NODE 5 --> 0.0684836656 sigma out 1act.( 1.44357073 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 185.844788 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.52996254 *** contribution from regularisation: 0.00350564695 *** contribution from error: -0.533468187 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49425.8951 0.0908153132 -4.19478703 EXIT FROM BFGS code FG_LNSRCH 0. 0.090815261 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.529968143 *** contribution from regularisation: 0.00350003084 *** contribution from error: -0.533468187 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49426.4188 0.090815261 -4.19522715 EXIT FROM BFGS code FG_LNSRCH 0. 0.090815261 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.529959321 *** contribution from regularisation: 0.00350887491 *** contribution from error: -0.533468187 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49425.594 0.090815261 -4.19478559 EXIT FROM BFGS code FG_LNSRCH 0. 0.090815261 0. --------------------------------------------------- Iteration : 43 *********************************************** *** Learn Path 43 *** loss function: -0.529967606 *** contribution from regularisation: 0.0035005419 *** contribution from error: -0.533468127 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49426.3711 0.090815261 -4.19434786 EXIT FROM BFGS code NEW_X -49426.3711 0.090815261 -4.19434786 ENTER BFGS code NEW_X -49426.3711 0.090815261 -4.19434786 EXIT FROM BFGS code CONVERGENC -49426.3711 0.090815261 -4.19434786 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 142.973969 sigma out 15 active outputs RANK 2 NODE 1 --> 130.278656 sigma out 15 active outputs RANK 3 NODE 8 --> 71.5673065 sigma out 15 active outputs RANK 4 NODE 7 --> 63.3160706 sigma out 15 active outputs RANK 5 NODE 6 --> 59.8685799 sigma out 15 active outputs RANK 6 NODE 10 --> 58.755806 sigma out 15 active outputs RANK 7 NODE 12 --> 57.5599556 sigma out 15 active outputs RANK 8 NODE 9 --> 48.5146523 sigma out 15 active outputs RANK 9 NODE 3 --> 42.6619301 sigma out 15 active outputs RANK 10 NODE 4 --> 38.1791496 sigma out 15 active outputs RANK 11 NODE 11 --> 35.0805435 sigma out 15 active outputs RANK 12 NODE 5 --> 14.9902496 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 141.537354 sigma in 12act. ( 208.037064 sig out 1act.) RANK 2 NODE 11 --> 124.257195 sigma in 12act. ( 125.616745 sig out 1act.) RANK 3 NODE 9 --> 89.702858 sigma in 12act. ( 91.5982056 sig out 1act.) RANK 4 NODE 1 --> 84.9830933 sigma in 12act. ( 90.4200516 sig out 1act.) RANK 5 NODE 4 --> 82.2878036 sigma in 12act. ( 83.6559982 sig out 1act.) RANK 6 NODE 7 --> 45.9974747 sigma in 12act. ( 53.3583603 sig out 1act.) RANK 7 NODE 12 --> 42.0423431 sigma in 12act. ( 32.1906624 sig out 1act.) RANK 8 NODE 14 --> 26.2786064 sigma in 12act. ( 31.2586288 sig out 1act.) RANK 9 NODE 10 --> 22.9170151 sigma in 12act. ( 23.5374126 sig out 1act.) RANK 10 NODE 3 --> 22.1719913 sigma in 12act. ( 16.8229961 sig out 1act.) RANK 11 NODE 13 --> 20.4028606 sigma in 12act. ( 16.5219707 sig out 1act.) RANK 12 NODE 8 --> 19.1338139 sigma in 12act. ( 21.2102604 sig out 1act.) RANK 13 NODE 2 --> 9.39585018 sigma in 12act. ( 9.07920074 sig out 1act.) RANK 14 NODE 15 --> 2.26331711 sigma in 12act. ( 0.735106289 sig out 1act.) RANK 15 NODE 5 --> 1.44647062 sigma in 12act. ( 0.109560147 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 208.037064 sigma out 1act.( 141.537354 sig in 12act.) RANK 2 NODE 11 --> 125.616745 sigma out 1act.( 124.257195 sig in 12act.) RANK 3 NODE 9 --> 91.5982056 sigma out 1act.( 89.702858 sig in 12act.) RANK 4 NODE 1 --> 90.4200516 sigma out 1act.( 84.9830933 sig in 12act.) RANK 5 NODE 4 --> 83.6559982 sigma out 1act.( 82.2878036 sig in 12act.) RANK 6 NODE 7 --> 53.3583603 sigma out 1act.( 45.9974747 sig in 12act.) RANK 7 NODE 12 --> 32.1906624 sigma out 1act.( 42.0423431 sig in 12act.) RANK 8 NODE 14 --> 31.2586288 sigma out 1act.( 26.2786064 sig in 12act.) RANK 9 NODE 10 --> 23.5374126 sigma out 1act.( 22.9170151 sig in 12act.) RANK 10 NODE 8 --> 21.2102604 sigma out 1act.( 19.1338139 sig in 12act.) RANK 11 NODE 3 --> 16.8229961 sigma out 1act.( 22.1719913 sig in 12act.) RANK 12 NODE 13 --> 16.5219707 sigma out 1act.( 20.4028606 sig in 12act.) RANK 13 NODE 2 --> 9.07920074 sigma out 1act.( 9.39585018 sig in 12act.) RANK 14 NODE 15 --> 0.735106289 sigma out 1act.( 2.26331711 sig in 12act.) RANK 15 NODE 5 --> 0.109560147 sigma out 1act.( 1.44647062 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 298.540863 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.529964626 *** contribution from regularisation: 0.00350355846 *** contribution from error: -0.533468187 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 31601 Closing output file done