NNInput NNInputs_195.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 161875 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 25539 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 25539 Chosen entries: 25539 Signal fraction: 1 Background fraction: 0.187324 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 25539 Entries to split: 25539 Test with : 12769 Train with : 12769 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 25539 for Signal Prepared event 0 for Signal with 25539 events ====Entry 0 Variable Ht : 225.901 Variable LepAPt : 63.638 Variable LepBPt : 23.389 Variable MetSigLeptonsJets : 9.51092 Variable MetSpec : 104.705 Variable SumEtLeptonsJets : 121.196 Variable VSumJetLeptonsPt : 96.1224 Variable addEt : 191.732 Variable dPhiLepSumMet : 2.687 Variable dPhiLeptons : 0.342211 Variable dRLeptons : 0.346978 Variable lep1_E : 71.8454 Variable lep2_E : 25.7459 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2195 Ht = 225.901 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 63.6382 LepAPt = 63.638 LepBEt = 23.389 LepBPt = 23.389 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 104.705 MetDelPhi = 2.13998 MetSig = 7.54777 MetSigLeptonsJets = 9.51092 MetSpec = 104.705 Mjj = 0 MostCentralJetEta = 2.45448 MtllMet = 197.429 Njets = 1 SB = 0 SumEt = 192.44 SumEtJets = 0 SumEtLeptonsJets = 121.196 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 96.1224 addEt = 191.732 dPhiLepSumMet = 2.687 dPhiLeptons = 0.342211 dRLeptons = 0.346978 diltype = 47 dimass = 13.3241 event = 561 jet1_Et = 34.1693 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.8454 lep2_E = 25.7459 rand = 0.999742 run = 228576 weight = 1.92787e-06 ===Show End Prepared event 10000 for Signal with 25539 events Prepared event 20000 for Signal with 25539 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.184243 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4364 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 161875 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4364 negative weights. Signal fraction: 62.5389709 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.4231644 65.6944122 67.2040405 68.5075989 69.7782135 70.6767654 71.5281982 72.388443 73.3813477 74.1016998 74.7864838 75.5147705 76.1779938 76.9523087 77.5677567 78.3612518 78.8822174 79.6494446 80.3289566 81.1513824 81.9250488 82.6951065 83.5922394 84.6362 85.5836945 86.8157425 88.1727295 89.0804443 90.506485 91.966568 93.2371368 94.6133041 96.0080719 97.6460495 99.2586975 100.758652 102.341965 103.957611 105.316513 106.981964 108.630539 110.573898 112.345337 113.933716 115.667892 117.501938 119.211884 120.455017 122.225204 123.759766 125.343742 127.308884 128.774567 130.303452 131.943573 133.712372 135.161804 136.792099 138.3116 140.00647 141.56369 143.416458 144.893509 146.58197 148.204514 149.80658 151.571075 153.391632 155.359741 157.14505 159.188232 161.239685 163.378906 165.283569 167.271759 169.336212 171.426712 173.276337 175.637238 178.110504 180.681335 183.096054 185.997772 189.088715 192.679108 196.076782 199.516541 203.55191 207.719543 212.312408 217.49913 223.69014 230.604584 238.018738 247.427216 261.1409 276.099121 298.30719 353.853638 811.421753 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3484421 20.7135696 21.0584831 21.3752823 21.6535645 21.9310875 22.1495819 22.3642292 22.5847206 22.7804871 22.9899254 23.2230167 23.3844337 23.6205864 23.8543854 24.0841484 24.3108101 24.5404091 24.7754478 25.0068455 25.2017517 25.41008 25.6656628 25.8855686 26.131382 26.3628597 26.5576248 26.7689342 27.025959 27.270195 27.5371132 27.8000298 28.0070534 28.2672863 28.5319176 28.7411385 28.9785614 29.2697639 29.5489788 29.7960777 30.1385651 30.4652901 30.7290268 31.047224 31.370924 31.6148815 31.8733406 32.1636276 32.50317 32.8317261 33.1640816 33.5305939 33.8875732 34.2791977 34.659462 35.0479126 35.4228592 35.85495 36.2188797 36.6723709 37.1189194 37.5406036 37.9432564 38.3653336 38.8984985 39.314476 39.8301125 40.3623619 40.8137054 41.194519 41.7825165 42.3904037 43.0062256 43.6184692 44.2785187 44.9346161 45.6728439 46.3276138 46.9513321 47.6794014 48.4921722 49.427536 50.2910156 51.2323151 52.2364883 53.1333466 54.151207 55.3285217 56.5336456 57.8059158 59.2313766 60.7421913 62.4460335 64.2592392 66.1861267 68.8184662 72.3133392 76.3199768 83.1157684 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1267719 10.285676 10.3952589 10.4935818 10.6183281 10.7756023 10.9433804 11.0923157 11.2569342 11.3977203 11.5166912 11.6602125 11.7860298 11.9461193 12.1008415 12.2495461 12.3740959 12.5426216 12.720808 12.8956881 13.0746288 13.2542019 13.42416 13.5935402 13.7641325 13.9393311 14.1046886 14.2906799 14.4478321 14.6557989 14.8791733 15.0945807 15.2880096 15.4575748 15.6346493 15.8401556 16.0284119 16.2854328 16.486969 16.6998672 16.8938751 17.0857658 17.3228474 17.5660877 17.802433 17.9862728 18.2013893 18.4528427 18.6824303 18.8865948 19.1045418 19.3447781 19.5628815 19.7779846 19.9951153 20.1827126 20.2983437 20.4756508 20.6618423 20.8827858 21.0501633 21.258894 21.477787 21.6865788 21.901762 22.0322037 22.2446556 22.4932442 22.7250919 22.9426517 23.1655617 23.3865547 23.6434765 23.8977375 24.1306801 24.3528137 24.6278591 24.9222584 25.2031746 25.4670067 25.7910957 26.0908432 26.4009666 26.703228 27.0652618 27.4795303 27.8516083 28.2675018 28.7299252 29.2210197 29.7355194 30.2817307 30.9526787 31.6905956 32.4594574 33.5522308 34.8848038 36.9556351 40.6834679 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.32896101 2.68953323 3.09363794 3.43104553 3.71380472 3.94894075 4.12207127 4.24138927 4.3633852 4.46598864 4.59321976 4.68246412 4.78973293 4.88140392 4.96882153 5.04410553 5.1243453 5.18487549 5.26044941 5.32009125 5.37044811 5.43405819 5.49623632 5.53086567 5.58890533 5.64582348 5.69823647 5.7486372 5.80587864 5.8518548 5.90700102 5.95021772 5.99986601 6.0448885 6.09324551 6.13086987 6.18503571 6.23088932 6.27202702 6.31104279 6.35964966 6.40784931 6.4519372 6.49920559 6.54949999 6.59801483 6.63966274 6.68492365 6.73533249 6.7791338 6.82818985 6.86767864 6.91348743 6.96975803 7.02129745 7.07932758 7.13864231 7.19891644 7.2547226 7.30576515 7.35553312 7.41257954 7.47178221 7.50582981 7.56568289 7.6361146 7.69054031 7.75821209 7.82446003 7.88504314 7.94513702 8.0097847 8.07272243 8.12814522 8.18678379 8.24338722 8.30289364 8.36854553 8.42831039 8.50273895 8.57433319 8.63979912 8.71401024 8.80071831 8.88167 8.95735455 9.04748344 9.15410805 9.25705338 9.37259483 9.47463989 9.58939934 9.717556 9.85772705 10.0354424 10.2399511 10.4971037 10.8184452 11.3826065 12.3634758 17.6440296 ------------------------------ Transdef: Tab for variable 6 15.0050735 21.4540386 25.4461231 26.534626 27.4711533 28.4688416 29.3012295 30.1313534 30.849369 31.6391411 32.2233696 32.8125916 33.3659973 33.8272247 34.3435287 34.7529144 35.22892 35.6903152 36.0452118 36.469902 36.8531342 37.2322235 37.6707344 38.0410461 38.3989563 38.7525101 39.2105331 39.6273918 40.0099716 40.3593216 40.8018417 41.2227325 41.7508469 42.1803894 42.6958923 43.1150589 43.4560127 43.9577141 44.4521828 44.9299088 45.5883179 46.1626358 46.8162308 47.3933563 47.9235382 48.6352005 49.2384567 49.9573669 50.4950676 51.2521286 52.1578064 52.9529419 53.5944214 54.5014648 55.2717133 56.0402451 56.8636398 57.5840721 58.364994 58.9845467 59.882225 60.6157684 61.426899 62.1937408 63.0794601 63.894104 64.7377625 65.5602112 66.4724655 67.2782059 68.1378632 69.044632 69.9084778 70.7167587 71.5924911 72.4609528 73.3243866 74.2766647 75.1694489 76.0931473 76.7963104 77.8162842 78.9069366 80.079895 81.1922455 82.4641418 83.7014542 85.0063705 86.4352341 88.0946198 89.7937775 91.7264252 93.8775558 96.1328735 98.9872589 102.104698 106.331238 112.035858 120.664825 134.572617 252.419907 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.9080582 33.8599472 34.7457771 35.2839737 35.7198181 36.20998 36.6749573 37.0769157 37.5049744 37.8536758 38.1969566 38.509201 38.8387451 39.1713409 39.4799957 39.7796593 40.135643 40.4430122 40.8148727 41.1891785 41.5409355 41.9245796 42.422554 42.8435097 43.3499336 44.0583191 44.6874542 45.2597504 45.9886475 46.9759521 47.6621094 48.6849442 49.6835938 50.5786057 51.5923157 52.6262627 53.5191154 54.6834412 55.7564392 56.7330208 57.6828117 58.5666428 59.5204849 60.4442902 61.1811562 61.7826385 62.6622849 63.4631004 64.3290558 65.2968445 66.2356415 67.267189 68.0397491 69.0500031 69.9643097 70.7720337 71.5519104 72.431572 73.5133591 74.6037903 75.6789856 76.6838989 77.717453 78.9624863 80.0628967 81.2149124 82.4530945 83.6373291 85.0005875 86.2831116 87.5514984 89.0987549 90.4874725 92.0486145 93.5201492 95.242218 96.6698151 98.5716095 100.475349 102.299881 104.311928 106.382584 108.606384 110.631195 113.333542 116.159882 119.188103 122.245422 126.200912 129.967361 134.860992 139.318298 145.134583 151.210693 157.916962 168.142548 181.605377 203.108063 239.005005 533.67572 ------------------------------ Transdef: Tab for variable 8 3.66914892 25.3684769 29.3346024 31.273756 32.2434692 32.9847145 33.6455383 34.0889053 34.4834518 34.8996696 35.3012886 35.6991272 36.0727768 36.4149399 36.7202377 37.0347137 37.3344421 37.6094475 37.8776932 38.1658783 38.4537582 38.7493629 39.0363998 39.3326569 39.6035004 39.9115219 40.2162781 40.5813446 40.9639397 41.3180695 41.7013321 42.1068268 42.5694733 42.9852905 43.4899864 43.9556541 44.4877472 45.0431786 45.443676 46.1801987 46.951107 47.6360321 48.1106186 48.6755562 49.2242126 49.9587822 50.6656494 51.3397141 52.133007 52.8050461 53.4715805 54.1977158 54.9900513 55.7061195 56.4702873 57.1819878 57.9687119 58.6187592 59.3747177 60.1540985 60.8602676 61.3516235 62.0554199 62.7389145 63.373024 64.1849976 64.9841614 65.7185059 66.4050446 67.1360474 67.8693771 68.6635742 69.4443512 70.1978455 71.0320282 71.8382034 72.747345 73.592865 74.6215515 75.4287109 76.4362488 77.4526825 78.416153 79.3658752 80.4653168 81.7384262 82.9522171 84.3699646 85.7763672 87.2144012 89.031662 91.1671219 93.5547638 95.8334045 98.8627014 102.663696 107.669342 114.432755 124.544876 143.952667 296.803314 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7756805 65.039917 66.5550003 67.8023453 68.855278 69.9384232 70.7602081 71.5401764 72.3186035 73.1819305 73.8710632 74.4431915 75.0573883 75.7058868 76.3443298 76.9858856 77.5145264 78.140274 78.6924438 79.2068787 79.7738037 80.3874054 81.0975189 81.7397614 82.4738617 83.1999741 83.9326935 84.7471313 85.5079346 86.4247437 87.2690506 88.3658447 89.1046295 90.2270889 91.5464935 92.6775513 93.8633118 95.0564117 96.1046982 97.4725113 98.9168167 100.368675 101.633385 102.952431 104.333885 105.832031 107.179695 108.484024 109.873672 111.232498 112.664703 113.95752 115.411469 116.704102 118.090744 119.458008 120.334824 121.68071 122.879242 124.290756 125.49469 126.922913 128.192291 129.307556 130.590912 131.912689 133.143494 134.288376 135.369537 136.542068 137.735687 138.938278 140.12944 141.457184 142.927383 144.228302 145.455627 146.87381 148.241821 149.774323 151.297913 152.66069 154.301025 155.892426 157.572815 159.416168 161.521927 163.455322 165.544525 167.674149 169.934601 172.753723 175.38974 178.622314 182.289841 186.745407 193.107315 202.395294 228.433716 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.924047053 1.30913281 1.53002059 1.69751072 1.8284173 1.94219041 2.04714227 2.12382245 2.19248629 2.24997067 2.30131054 2.34634161 2.38786077 2.42572284 2.45806336 2.48859692 2.51890182 2.54700518 2.57479906 2.60216355 2.62295723 2.64927912 2.67194319 2.69335556 2.71296048 2.73004103 2.74902177 2.76506424 2.77894068 2.79440498 2.80866098 2.82256603 2.83233356 2.84377289 2.8535614 2.86361217 2.87299514 2.8826704 2.89264393 2.90207386 2.91142488 2.91934013 2.92741847 2.93399405 2.94255733 2.94991636 2.95649385 2.9634645 2.96964073 2.97578216 2.98202944 2.98693705 2.99196911 2.99559879 3.00080848 3.00586629 3.01108885 3.01475954 3.01922512 3.02379274 3.02838159 3.03230572 3.0362165 3.03991294 3.04368401 3.04796696 3.0519681 3.0554719 3.05874085 3.06254816 3.06593466 3.0687418 3.07202864 3.07483864 3.07787514 3.08106089 3.08362103 3.08659172 3.08951521 3.09223485 3.09496403 3.09740305 3.10017967 3.10297036 3.10518003 3.10789728 3.11057663 3.11318398 3.11541653 3.11832952 3.12065244 3.12298536 3.1255908 3.12794447 3.13032007 3.1321342 3.1342895 3.13623142 3.13905859 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00616455078 0.0102815768 0.0167659428 0.0239651799 0.0298705101 0.0374727249 0.0451129675 0.054007709 0.0614533126 0.0687173009 0.0756596327 0.0844541118 0.0924613476 0.0997225046 0.107195258 0.111934185 0.119227231 0.126519501 0.134465933 0.142994642 0.149413437 0.156175077 0.162884116 0.17066896 0.177477121 0.183814049 0.189061642 0.196169674 0.201788515 0.207246482 0.212288499 0.21826303 0.223441839 0.228480816 0.233235657 0.238838553 0.244271696 0.248717785 0.254050076 0.259243608 0.264377773 0.268125772 0.27357614 0.278871596 0.283748984 0.289300919 0.294044197 0.298794746 0.304153323 0.30979085 0.314944029 0.320768088 0.325873941 0.331374168 0.336075485 0.342217743 0.346840858 0.352011442 0.358323336 0.362871528 0.368374348 0.375190616 0.381664574 0.386822581 0.392249107 0.398216248 0.404257923 0.410775065 0.417462826 0.423431754 0.429689169 0.435974538 0.442253888 0.448551565 0.455863476 0.462055564 0.470220089 0.476996422 0.485273004 0.493895829 0.50229919 0.511443019 0.520544171 0.529184759 0.539784372 0.546330094 0.556116641 0.568212509 0.580750823 0.595466495 0.609355211 0.625277758 0.640131414 0.655641973 0.679093242 0.70834446 0.735518217 0.777271867 0.837022781 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200064167 0.213050902 0.223575607 0.232854649 0.241675407 0.25077185 0.25825873 0.265149742 0.271930546 0.278345525 0.284724295 0.290595949 0.296731532 0.302537143 0.308690101 0.314966559 0.320712 0.325961769 0.331509054 0.337302625 0.343264759 0.348330617 0.353150487 0.357437909 0.362912565 0.368326485 0.373682976 0.378400028 0.383832902 0.388883859 0.394126832 0.398895353 0.402511984 0.406444311 0.410269409 0.413908064 0.417253852 0.420845687 0.424580097 0.427913696 0.431374937 0.435456634 0.43907845 0.442664087 0.446372688 0.450198978 0.454470336 0.457919657 0.461192071 0.464819312 0.468732834 0.473062545 0.476502419 0.479898036 0.483776957 0.488174647 0.492354333 0.4966636 0.5006724 0.505930185 0.510487497 0.515200853 0.520636678 0.525649071 0.530235052 0.535637498 0.540780604 0.546069145 0.549315453 0.555122852 0.560028255 0.565616727 0.571143627 0.577043533 0.583981991 0.589173317 0.595389962 0.601691008 0.609003603 0.616009891 0.622855306 0.631799161 0.640568495 0.649426818 0.658472061 0.667153358 0.678235948 0.686867952 0.697640896 0.709052086 0.719957948 0.730175436 0.743162036 0.754111409 0.769568682 0.787663162 0.807841718 0.835729182 0.863447905 0.902295589 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0123215 21.5693588 22.3977337 23.1109238 23.7330837 24.3156815 24.8111038 25.2406597 25.743 26.1662903 26.677166 27.1592426 27.598175 28.0484314 28.4709396 28.8214149 29.2159348 29.5742264 29.8957787 30.2825985 30.6677818 31.0178757 31.3820648 31.7273178 32.0988998 32.4520493 32.8605042 33.2332687 33.591362 33.9856796 34.34478 34.6573181 35.0604897 35.5085907 35.9460144 36.1896896 36.5550079 37.0277939 37.4922676 37.8630333 38.2640419 38.6680489 39.1002121 39.5606995 40.013504 40.4704514 40.9491577 41.3396301 41.822937 42.3493042 42.8777237 43.3174019 43.8501091 44.3839035 44.8893356 45.4239502 46.008667 46.5293121 47.1063194 47.635582 48.2344055 48.803627 49.4719009 50.0282211 50.7586555 51.306839 52.0418358 52.7224312 53.4494247 54.1376572 54.868927 55.5050087 56.2946396 57.1062431 57.8599167 58.6180725 59.4248924 60.2883873 61.2862663 62.1575165 63.1957855 64.2515717 65.2453461 66.2371979 67.1837234 68.1423798 69.2680817 70.5923615 71.9333572 73.3516083 75.039978 77.0444946 79.232048 81.0772247 83.9138794 87.4841919 89.9549942 93.8900452 99.9434509 111.868782 230.5327 ------------------------------ Transdef: Tab for variable 14 10.0093269 10.7093153 11.2470036 11.5831947 11.9399204 12.3030539 12.5330782 12.8416481 13.1973991 13.4921608 13.8231163 14.1386862 14.4712982 14.7526951 15.1065674 15.4052315 15.6738548 15.9455986 16.227684 16.4831963 16.7569008 16.9835091 17.2841644 17.593998 17.8780479 18.1518669 18.4285812 18.6768951 18.9319916 19.1588364 19.399437 19.662796 19.9138794 20.1963768 20.4700871 20.6731834 20.9079456 21.122715 21.3364162 21.6015892 21.805418 22.0127316 22.2395668 22.4867039 22.7217178 22.9685326 23.1998425 23.4466705 23.6576118 23.8792763 24.1480751 24.3735199 24.5847816 24.8742828 25.1072273 25.3740044 25.5917435 25.8237476 26.0736771 26.3217545 26.5398903 26.7550182 27.0570488 27.2992954 27.596096 27.889452 28.0368595 28.3389244 28.6027412 28.9039288 29.2538528 29.5904808 29.9274101 30.2442436 30.5653515 30.9539948 31.3319302 31.6846943 32.0791626 32.477005 32.9699249 33.4220886 33.7518082 34.1586189 34.6448936 35.2029953 35.7736855 36.4495964 37.184288 37.9526176 38.75103 39.7301903 40.5799561 41.7245026 43.2382355 44.775177 47.1466446 49.5736465 53.4795799 60.8292542 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 62.8 49.8 49.6 29.7 49.4 60.8 52.7 61.1 -24.3 -19.9 -39.2 19.7 19.2 2 62.8 100.0 69.2 54.2 43.0 72.1 94.7 78.3 92.5 -43.6 -26.0 -51.4 40.5 26.8 3 49.8 69.2 100.0 41.4 22.3 44.7 70.3 60.4 77.1 -11.4 -28.3 -58.5 70.1 18.4 4 49.6 54.2 41.4 100.0 13.5 33.3 56.5 45.5 57.4 -12.2 -31.4 -60.2 20.9 69.4 5 29.7 43.0 22.3 13.5 100.0 85.0 16.8 63.2 62.9 19.7 -9.5 -16.2 8.5 1.2 6 49.4 72.1 44.7 33.3 85.0 100.0 52.4 80.9 82.1 -6.7 -18.6 -34.0 22.4 12.4 7 60.8 94.7 70.3 56.5 16.8 52.4 100.0 70.1 81.6 -52.2 -25.1 -51.5 43.1 30.1 8 52.7 78.3 60.4 45.5 63.2 80.9 70.1 100.0 85.8 -12.5 -25.3 -45.8 36.2 22.8 9 61.1 92.5 77.1 57.4 62.9 82.1 81.6 85.8 100.0 -19.8 -28.8 -57.4 47.6 29.3 10 -24.3 -43.6 -11.4 -12.2 19.7 -6.7 -52.2 -12.5 -19.8 100.0 1.5 7.4 -3.1 -4.3 11 -19.9 -26.0 -28.3 -31.4 -9.5 -18.6 -25.1 -25.3 -28.8 1.5 100.0 54.6 -16.1 -20.1 12 -39.2 -51.4 -58.5 -60.2 -16.2 -34.0 -51.5 -45.8 -57.4 7.4 54.6 100.0 -33.9 -32.9 13 19.7 40.5 70.1 20.9 8.5 22.4 43.1 36.2 47.6 -3.1 -16.1 -33.9 100.0 43.0 14 19.2 26.8 18.4 69.4 1.2 12.4 30.1 22.8 29.3 -4.3 -20.1 -32.9 43.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 160.300659 TOTAL CORRELATION OF ALL VARIABLES 69.4664167 ROUND 1: MAX CORR ( 69.4644773) AFTER KILLING INPUT VARIABLE 11 CONTR 0.519070017 ROUND 2: MAX CORR ( 69.4396301) AFTER KILLING INPUT VARIABLE 2 CONTR 1.85779023 ROUND 3: MAX CORR ( 69.3721812) AFTER KILLING INPUT VARIABLE 8 CONTR 3.0598536 ROUND 4: MAX CORR ( 69.2842877) AFTER KILLING INPUT VARIABLE 12 CONTR 3.49098822 ROUND 5: MAX CORR ( 69.1454646) AFTER KILLING INPUT VARIABLE 10 CONTR 4.38374868 ROUND 6: MAX CORR ( 68.998983) AFTER KILLING INPUT VARIABLE 14 CONTR 4.49840104 ROUND 7: MAX CORR ( 68.6790676) AFTER KILLING INPUT VARIABLE 6 CONTR 6.63666551 ROUND 8: MAX CORR ( 68.0866846) AFTER KILLING INPUT VARIABLE 9 CONTR 9.00098364 ROUND 9: MAX CORR ( 66.6473304) AFTER KILLING INPUT VARIABLE 13 CONTR 13.9258743 ROUND 10: MAX CORR ( 66.3114648) AFTER KILLING INPUT VARIABLE 3 CONTR 6.68253521 ROUND 11: MAX CORR ( 63.9455322) AFTER KILLING INPUT VARIABLE 4 CONTR 17.5550359 ROUND 12: MAX CORR ( 60.8030906) AFTER KILLING INPUT VARIABLE 5 CONTR 19.799375 LAST REMAINING VARIABLE: 7 total correlation to target: 69.4664167 % total significance: 99.3657351 sigma correlations of single variables to target: variable 2: 62.7819129 % , in sigma: 89.8041273 variable 3: 49.8366414 % , in sigma: 71.2870297 variable 4: 49.609799 % , in sigma: 70.9625511 variable 5: 29.7194601 % , in sigma: 42.5111318 variable 6: 49.3932565 % , in sigma: 70.6528057 variable 7: 60.8030906 % , in sigma: 86.9735922 variable 8: 52.6942754 % , in sigma: 75.3746293 variable 9: 61.0887821 % , in sigma: 87.3822493 variable 10: -24.2946347 % , in sigma: 34.7513856 variable 11: -19.8821627 % , in sigma: 28.4397239 variable 12: -39.2333909 % , in sigma: 56.1199917 variable 13: 19.7028853 % , in sigma: 28.183283 variable 14: 19.1946766 % , in sigma: 27.4563341 variables sorted by significance: 1 most relevant variable 7 corr 60.8030891 , in sigma: 86.9735901 2 most relevant variable 5 corr 19.7993755 , in sigma: 28.321304 3 most relevant variable 4 corr 17.5550365 , in sigma: 25.1109701 4 most relevant variable 3 corr 6.68253517 , in sigma: 9.55879188 5 most relevant variable 13 corr 13.9258747 , in sigma: 19.9197662 6 most relevant variable 9 corr 9.00098324 , in sigma: 12.8751325 7 most relevant variable 6 corr 6.63666534 , in sigma: 9.49317904 8 most relevant variable 14 corr 4.49840117 , in sigma: 6.43457601 9 most relevant variable 10 corr 4.38374853 , in sigma: 6.27057528 10 most relevant variable 12 corr 3.49098825 , in sigma: 4.99355848 11 most relevant variable 8 corr 3.05985355 , in sigma: 4.37685737 12 most relevant variable 2 corr 1.85779023 , in sigma: 2.65740916 13 most relevant variable 11 corr 0.519070029 , in sigma: 0.742485038 global correlations between input variables: variable 2: 99.2894185 % variable 3: 94.4126079 % variable 4: 90.7574871 % variable 5: 95.848439 % variable 6: 94.3698463 % variable 7: 98.8785594 % variable 8: 91.2249161 % variable 9: 99.050767 % variable 10: 71.8981934 % variable 11: 55.6397324 % variable 12: 77.9240871 % variable 13: 87.1475333 % variable 14: 86.9815023 % significance loss when removing single variables: variable 2: corr = 1.81434073 % , sigma = 2.59525838 variable 3: corr = 13.5910688 % , sigma = 19.4408551 variable 4: corr = 16.4983702 % , sigma = 23.5994998 variable 5: corr = 8.76208357 % , sigma = 12.533407 variable 6: corr = 6.16948343 % , sigma = 8.82491548 variable 7: corr = 6.27208782 % , sigma = 8.97168223 variable 8: corr = 1.97846315 % , sigma = 2.8300214 variable 9: corr = 8.5238149 % , sigma = 12.1925842 variable 10: corr = 3.48667474 % , sigma = 4.98738836 variable 11: corr = 0.519070017 % , sigma = 0.742485021 variable 12: corr = 3.27641347 % , sigma = 4.6866277 variable 13: corr = 5.71859867 % , sigma = 8.17996361 variable 14: corr = 4.6480623 % , sigma = 6.6486534 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 7 --> 13.4447565 sigma out 15 active outputs RANK 2 NODE 8 --> 10.784152 sigma out 15 active outputs RANK 3 NODE 12 --> 10.7298899 sigma out 15 active outputs RANK 4 NODE 11 --> 10.5772696 sigma out 15 active outputs RANK 5 NODE 1 --> 10.4355927 sigma out 15 active outputs RANK 6 NODE 4 --> 10.0476789 sigma out 15 active outputs RANK 7 NODE 6 --> 9.67241573 sigma out 15 active outputs RANK 8 NODE 2 --> 9.49106789 sigma out 15 active outputs RANK 9 NODE 3 --> 8.67311954 sigma out 15 active outputs RANK 10 NODE 10 --> 7.22677135 sigma out 15 active outputs RANK 11 NODE 9 --> 6.65847254 sigma out 15 active outputs RANK 12 NODE 5 --> 5.50906801 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 18.5579872 sigma in 12act. ( 20.0411758 sig out 1act.) RANK 2 NODE 1 --> 15.2241964 sigma in 12act. ( 17.3211765 sig out 1act.) RANK 3 NODE 10 --> 13.3264198 sigma in 12act. ( 12.7090168 sig out 1act.) RANK 4 NODE 12 --> 10.5094509 sigma in 12act. ( 11.4731321 sig out 1act.) RANK 5 NODE 3 --> 7.86972094 sigma in 12act. ( 7.10943365 sig out 1act.) RANK 6 NODE 13 --> 7.15677309 sigma in 12act. ( 8.52156544 sig out 1act.) RANK 7 NODE 6 --> 6.92874765 sigma in 12act. ( 6.68558121 sig out 1act.) RANK 8 NODE 8 --> 5.76830006 sigma in 12act. ( 2.85399055 sig out 1act.) RANK 9 NODE 7 --> 5.05913639 sigma in 12act. ( 3.9379034 sig out 1act.) RANK 10 NODE 5 --> 2.65007758 sigma in 12act. ( 2.09250855 sig out 1act.) RANK 11 NODE 2 --> 2.53191352 sigma in 12act. ( 4.43835354 sig out 1act.) RANK 12 NODE 9 --> 2.48698139 sigma in 12act. ( 3.53459406 sig out 1act.) RANK 13 NODE 14 --> 2.44516897 sigma in 12act. ( 2.55639052 sig out 1act.) RANK 14 NODE 4 --> 2.36811924 sigma in 12act. ( 2.9498961 sig out 1act.) RANK 15 NODE 11 --> 2.06064653 sigma in 12act. ( 1.26583612 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 20.0411758 sigma out 1act.( 18.5579872 sig in 12act.) RANK 2 NODE 1 --> 17.3211765 sigma out 1act.( 15.2241964 sig in 12act.) RANK 3 NODE 10 --> 12.7090168 sigma out 1act.( 13.3264198 sig in 12act.) RANK 4 NODE 12 --> 11.4731321 sigma out 1act.( 10.5094509 sig in 12act.) RANK 5 NODE 13 --> 8.52156544 sigma out 1act.( 7.15677309 sig in 12act.) RANK 6 NODE 3 --> 7.10943365 sigma out 1act.( 7.86972094 sig in 12act.) RANK 7 NODE 6 --> 6.68558121 sigma out 1act.( 6.92874765 sig in 12act.) RANK 8 NODE 2 --> 4.43835354 sigma out 1act.( 2.53191352 sig in 12act.) RANK 9 NODE 7 --> 3.9379034 sigma out 1act.( 5.05913639 sig in 12act.) RANK 10 NODE 9 --> 3.53459406 sigma out 1act.( 2.48698139 sig in 12act.) RANK 11 NODE 4 --> 2.9498961 sigma out 1act.( 2.36811924 sig in 12act.) RANK 12 NODE 8 --> 2.85399055 sigma out 1act.( 5.76830006 sig in 12act.) RANK 13 NODE 14 --> 2.55639052 sigma out 1act.( 2.44516897 sig in 12act.) RANK 14 NODE 5 --> 2.09250855 sigma out 1act.( 2.65007758 sig in 12act.) RANK 15 NODE 11 --> 1.26583612 sigma out 1act.( 2.06064653 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 35.2100067 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 23.1212502 sigma out 15 active outputs RANK 2 NODE 7 --> 14.542695 sigma out 15 active outputs RANK 3 NODE 8 --> 12.7835865 sigma out 15 active outputs RANK 4 NODE 11 --> 12.3956709 sigma out 15 active outputs RANK 5 NODE 3 --> 11.9750414 sigma out 15 active outputs RANK 6 NODE 1 --> 11.8176394 sigma out 15 active outputs RANK 7 NODE 4 --> 11.6641207 sigma out 15 active outputs RANK 8 NODE 6 --> 11.3248577 sigma out 15 active outputs RANK 9 NODE 2 --> 10.7253733 sigma out 15 active outputs RANK 10 NODE 10 --> 9.48790932 sigma out 15 active outputs RANK 11 NODE 5 --> 8.23135948 sigma out 15 active outputs RANK 12 NODE 9 --> 7.60660315 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 18.7666988 sigma in 12act. ( 19.1921101 sig out 1act.) RANK 2 NODE 1 --> 18.0214081 sigma in 12act. ( 17.5868263 sig out 1act.) RANK 3 NODE 9 --> 12.8439598 sigma in 12act. ( 6.61357355 sig out 1act.) RANK 4 NODE 2 --> 12.8296423 sigma in 12act. ( 7.82118607 sig out 1act.) RANK 5 NODE 12 --> 12.3263836 sigma in 12act. ( 11.4501534 sig out 1act.) RANK 6 NODE 13 --> 11.9317274 sigma in 12act. ( 8.64212513 sig out 1act.) RANK 7 NODE 10 --> 11.5867329 sigma in 12act. ( 10.4327927 sig out 1act.) RANK 8 NODE 4 --> 9.11643887 sigma in 12act. ( 4.12877274 sig out 1act.) RANK 9 NODE 11 --> 9.11273861 sigma in 12act. ( 2.41318583 sig out 1act.) RANK 10 NODE 3 --> 8.53543472 sigma in 12act. ( 6.08919144 sig out 1act.) RANK 11 NODE 7 --> 8.41946316 sigma in 12act. ( 3.21620703 sig out 1act.) RANK 12 NODE 6 --> 7.93637133 sigma in 12act. ( 6.32442522 sig out 1act.) RANK 13 NODE 14 --> 7.49180317 sigma in 12act. ( 3.47711062 sig out 1act.) RANK 14 NODE 5 --> 6.25338697 sigma in 12act. ( 2.44390249 sig out 1act.) RANK 15 NODE 8 --> 6.16370249 sigma in 12act. ( 1.32420123 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 19.1921101 sigma out 1act.( 18.7666988 sig in 12act.) RANK 2 NODE 1 --> 17.5868263 sigma out 1act.( 18.0214081 sig in 12act.) RANK 3 NODE 12 --> 11.4501534 sigma out 1act.( 12.3263836 sig in 12act.) RANK 4 NODE 10 --> 10.4327927 sigma out 1act.( 11.5867329 sig in 12act.) RANK 5 NODE 13 --> 8.64212513 sigma out 1act.( 11.9317274 sig in 12act.) RANK 6 NODE 2 --> 7.82118607 sigma out 1act.( 12.8296423 sig in 12act.) RANK 7 NODE 9 --> 6.61357355 sigma out 1act.( 12.8439598 sig in 12act.) RANK 8 NODE 6 --> 6.32442522 sigma out 1act.( 7.93637133 sig in 12act.) RANK 9 NODE 3 --> 6.08919144 sigma out 1act.( 8.53543472 sig in 12act.) RANK 10 NODE 4 --> 4.12877274 sigma out 1act.( 9.11643887 sig in 12act.) RANK 11 NODE 14 --> 3.47711062 sigma out 1act.( 7.49180317 sig in 12act.) RANK 12 NODE 7 --> 3.21620703 sigma out 1act.( 8.41946316 sig in 12act.) RANK 13 NODE 5 --> 2.44390249 sigma out 1act.( 6.25338697 sig in 12act.) RANK 14 NODE 11 --> 2.41318583 sigma out 1act.( 9.11273861 sig in 12act.) RANK 15 NODE 8 --> 1.32420123 sigma out 1act.( 6.16370249 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 35.03265 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.524903834 *** contribution from regularisation: 0.00564829446 *** contribution from error: -0.530552149 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.563767254 *** contribution from regularisation: 0.00222555874 *** contribution from error: -0.565992832 *********************************************** -----------------> Test sample ENTER BFGS code START -45637.7224 -0.364011019 -0.205997542 EXIT FROM BFGS code FG_START 0. -0.364011019 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.579163671 *** contribution from regularisation: 0.00193482358 *** contribution from error: -0.581098497 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46875.7676 -0.364011019 -41.8364677 EXIT FROM BFGS code FG_LNSRCH 0. -0.38543278 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.59665972 *** contribution from regularisation: 0.00276127178 *** contribution from error: -0.599420965 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48291.8489 -0.38543278 -58.0358353 EXIT FROM BFGS code NEW_X -48291.8489 -0.38543278 -58.0358353 ENTER BFGS code NEW_X -48291.8489 -0.38543278 -58.0358353 EXIT FROM BFGS code FG_LNSRCH 0. -0.40751633 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.598307669 *** contribution from regularisation: 0.00284339231 *** contribution from error: -0.601151049 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48425.2282 -0.40751633 -33.9982986 EXIT FROM BFGS code NEW_X -48425.2282 -0.40751633 -33.9982986 ENTER BFGS code NEW_X -48425.2282 -0.40751633 -33.9982986 EXIT FROM BFGS code FG_LNSRCH 0. -0.441208065 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.599494219 *** contribution from regularisation: 0.00287887361 *** contribution from error: -0.602373064 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48521.2623 -0.441208065 -10.8760738 EXIT FROM BFGS code NEW_X -48521.2623 -0.441208065 -10.8760738 ENTER BFGS code NEW_X -48521.2623 -0.441208065 -10.8760738 EXIT FROM BFGS code FG_LNSRCH 0. -0.479105204 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.600212157 *** contribution from regularisation: 0.00288290693 *** contribution from error: -0.603095055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48579.371 -0.479105204 20.7007027 EXIT FROM BFGS code NEW_X -48579.371 -0.479105204 20.7007027 ENTER BFGS code NEW_X -48579.371 -0.479105204 20.7007027 EXIT FROM BFGS code FG_LNSRCH 0. -0.482729942 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.60099566 *** contribution from regularisation: 0.00280324928 *** contribution from error: -0.603798926 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48642.7857 -0.482729942 21.3232288 EXIT FROM BFGS code NEW_X -48642.7857 -0.482729942 21.3232288 ENTER BFGS code NEW_X -48642.7857 -0.482729942 21.3232288 EXIT FROM BFGS code FG_LNSRCH 0. -0.498636663 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.602144361 *** contribution from regularisation: 0.00268242531 *** contribution from error: -0.604826808 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48735.7597 -0.498636663 30.3307915 EXIT FROM BFGS code NEW_X -48735.7597 -0.498636663 30.3307915 ENTER BFGS code NEW_X -48735.7597 -0.498636663 30.3307915 EXIT FROM BFGS code FG_LNSRCH 0. -0.458315045 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 27.6638985 sigma out 15 active outputs RANK 2 NODE 4 --> 15.899682 sigma out 15 active outputs RANK 3 NODE 3 --> 15.8202362 sigma out 15 active outputs RANK 4 NODE 10 --> 15.284915 sigma out 15 active outputs RANK 5 NODE 1 --> 13.4500408 sigma out 15 active outputs RANK 6 NODE 11 --> 8.74870777 sigma out 15 active outputs RANK 7 NODE 6 --> 8.11913204 sigma out 15 active outputs RANK 8 NODE 5 --> 7.56254482 sigma out 15 active outputs RANK 9 NODE 8 --> 7.42260742 sigma out 15 active outputs RANK 10 NODE 7 --> 6.24518108 sigma out 15 active outputs RANK 11 NODE 2 --> 6.11454582 sigma out 15 active outputs RANK 12 NODE 9 --> 4.73468447 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 27.4190826 sigma in 12act. ( 18.6223106 sig out 1act.) RANK 2 NODE 12 --> 20.6583576 sigma in 12act. ( 12.9312525 sig out 1act.) RANK 3 NODE 9 --> 15.627162 sigma in 12act. ( 13.2753286 sig out 1act.) RANK 4 NODE 1 --> 14.6520805 sigma in 12act. ( 11.3272858 sig out 1act.) RANK 5 NODE 11 --> 9.24154758 sigma in 12act. ( 6.49893618 sig out 1act.) RANK 6 NODE 4 --> 9.10791492 sigma in 12act. ( 7.04651499 sig out 1act.) RANK 7 NODE 14 --> 8.37718773 sigma in 12act. ( 6.59067011 sig out 1act.) RANK 8 NODE 13 --> 6.42351532 sigma in 12act. ( 3.78351665 sig out 1act.) RANK 9 NODE 15 --> 4.90689325 sigma in 12act. ( 2.51207304 sig out 1act.) RANK 10 NODE 8 --> 4.76933718 sigma in 12act. ( 3.45354676 sig out 1act.) RANK 11 NODE 10 --> 4.68766594 sigma in 12act. ( 3.71750164 sig out 1act.) RANK 12 NODE 3 --> 3.89715242 sigma in 12act. ( 2.29620504 sig out 1act.) RANK 13 NODE 6 --> 3.7933569 sigma in 12act. ( 1.4850328 sig out 1act.) RANK 14 NODE 7 --> 3.54064703 sigma in 12act. ( 1.10878372 sig out 1act.) RANK 15 NODE 5 --> 2.87772202 sigma in 12act. ( 1.01779795 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 18.6223106 sigma out 1act.( 27.4190826 sig in 12act.) RANK 2 NODE 9 --> 13.2753286 sigma out 1act.( 15.627162 sig in 12act.) RANK 3 NODE 12 --> 12.9312525 sigma out 1act.( 20.6583576 sig in 12act.) RANK 4 NODE 1 --> 11.3272858 sigma out 1act.( 14.6520805 sig in 12act.) RANK 5 NODE 4 --> 7.04651499 sigma out 1act.( 9.10791492 sig in 12act.) RANK 6 NODE 14 --> 6.59067011 sigma out 1act.( 8.37718773 sig in 12act.) RANK 7 NODE 11 --> 6.49893618 sigma out 1act.( 9.24154758 sig in 12act.) RANK 8 NODE 13 --> 3.78351665 sigma out 1act.( 6.42351532 sig in 12act.) RANK 9 NODE 10 --> 3.71750164 sigma out 1act.( 4.68766594 sig in 12act.) RANK 10 NODE 8 --> 3.45354676 sigma out 1act.( 4.76933718 sig in 12act.) RANK 11 NODE 15 --> 2.51207304 sigma out 1act.( 4.90689325 sig in 12act.) RANK 12 NODE 3 --> 2.29620504 sigma out 1act.( 3.89715242 sig in 12act.) RANK 13 NODE 6 --> 1.4850328 sigma out 1act.( 3.7933569 sig in 12act.) RANK 14 NODE 7 --> 1.10878372 sigma out 1act.( 3.54064703 sig in 12act.) RANK 15 NODE 5 --> 1.01779795 sigma out 1act.( 2.87772202 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 31.7803612 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.60251087 *** contribution from regularisation: 0.0027571409 *** contribution from error: -0.605268002 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48765.4225 -0.458315045 16.2000637 EXIT FROM BFGS code NEW_X -48765.4225 -0.458315045 16.2000637 ENTER BFGS code NEW_X -48765.4225 -0.458315045 16.2000637 EXIT FROM BFGS code FG_LNSRCH 0. -0.451088458 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.60314858 *** contribution from regularisation: 0.00274673733 *** contribution from error: -0.60589534 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48817.0388 -0.451088458 9.58619976 EXIT FROM BFGS code NEW_X -48817.0388 -0.451088458 9.58619976 ENTER BFGS code NEW_X -48817.0388 -0.451088458 9.58619976 EXIT FROM BFGS code FG_LNSRCH 0. -0.438153833 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.60326618 *** contribution from regularisation: 0.00267240428 *** contribution from error: -0.605938613 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48826.5533 -0.438153833 2.1929729 EXIT FROM BFGS code NEW_X -48826.5533 -0.438153833 2.1929729 ENTER BFGS code NEW_X -48826.5533 -0.438153833 2.1929729 EXIT FROM BFGS code FG_LNSRCH 0. -0.388329983 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.603326678 *** contribution from regularisation: 0.00235839933 *** contribution from error: -0.605685055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48831.4505 -0.388329983 -14.627017 EXIT FROM BFGS code NEW_X -48831.4505 -0.388329983 -14.627017 ENTER BFGS code NEW_X -48831.4505 -0.388329983 -14.627017 EXIT FROM BFGS code FG_LNSRCH 0. -0.354906023 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.603114128 *** contribution from regularisation: 0.00244556204 *** contribution from error: -0.605559707 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48814.2497 -0.354906023 -22.6081867 EXIT FROM BFGS code FG_LNSRCH 0. -0.38366279 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.602595747 *** contribution from regularisation: 0.00308808335 *** contribution from error: -0.605683804 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48772.2927 -0.38366279 -17.1821442 EXIT FROM BFGS code FG_LNSRCH 0. -0.38827309 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.603057742 *** contribution from regularisation: 0.00262730313 *** contribution from error: -0.605685055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48809.6847 -0.38827309 -15.4041004 EXIT FROM BFGS code FG_LNSRCH 0. -0.388329953 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.60296005 *** contribution from regularisation: 0.00272500585 *** contribution from error: -0.605685055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48801.7785 -0.388329953 -15.7153778 EXIT FROM BFGS code FG_LNSRCH 0. -0.388329983 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.602984965 *** contribution from regularisation: 0.00270008738 *** contribution from error: -0.605685055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48803.7953 -0.388329983 -15.7355232 EXIT FROM BFGS code FG_LNSRCH 0. -0.388329983 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.602964818 *** contribution from regularisation: 0.00272024213 *** contribution from error: -0.605685055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48802.164 -0.388329983 -15.8743038 EXIT FROM BFGS code FG_LNSRCH 0. -0.388329983 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 26.6400719 sigma out 15 active outputs RANK 2 NODE 4 --> 14.4229336 sigma out 15 active outputs RANK 3 NODE 3 --> 14.2556086 sigma out 15 active outputs RANK 4 NODE 10 --> 13.647439 sigma out 15 active outputs RANK 5 NODE 1 --> 12.1481333 sigma out 15 active outputs RANK 6 NODE 11 --> 8.32637215 sigma out 15 active outputs RANK 7 NODE 5 --> 7.21492624 sigma out 15 active outputs RANK 8 NODE 6 --> 7.14758921 sigma out 15 active outputs RANK 9 NODE 8 --> 6.8498559 sigma out 15 active outputs RANK 10 NODE 2 --> 6.46049833 sigma out 15 active outputs RANK 11 NODE 9 --> 5.55358601 sigma out 15 active outputs RANK 12 NODE 7 --> 5.02245474 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 26.3016911 sigma in 12act. ( 18.4313602 sig out 1act.) RANK 2 NODE 12 --> 19.3904076 sigma in 12act. ( 12.317606 sig out 1act.) RANK 3 NODE 9 --> 13.695344 sigma in 12act. ( 11.9066401 sig out 1act.) RANK 4 NODE 1 --> 13.1790028 sigma in 12act. ( 10.1907864 sig out 1act.) RANK 5 NODE 11 --> 8.80399513 sigma in 12act. ( 5.68630791 sig out 1act.) RANK 6 NODE 4 --> 8.3051815 sigma in 12act. ( 6.52921486 sig out 1act.) RANK 7 NODE 14 --> 7.80987835 sigma in 12act. ( 6.33147526 sig out 1act.) RANK 8 NODE 13 --> 5.58264065 sigma in 12act. ( 3.21755147 sig out 1act.) RANK 9 NODE 10 --> 5.02938032 sigma in 12act. ( 4.33741283 sig out 1act.) RANK 10 NODE 15 --> 4.45849419 sigma in 12act. ( 1.76416183 sig out 1act.) RANK 11 NODE 8 --> 4.26967669 sigma in 12act. ( 3.13903046 sig out 1act.) RANK 12 NODE 6 --> 3.49402833 sigma in 12act. ( 1.1517086 sig out 1act.) RANK 13 NODE 3 --> 3.48206019 sigma in 12act. ( 1.8009491 sig out 1act.) RANK 14 NODE 7 --> 3.29658055 sigma in 12act. ( 1.58121109 sig out 1act.) RANK 15 NODE 5 --> 2.38725662 sigma in 12act. ( 0.464958757 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 18.4313602 sigma out 1act.( 26.3016911 sig in 12act.) RANK 2 NODE 12 --> 12.317606 sigma out 1act.( 19.3904076 sig in 12act.) RANK 3 NODE 9 --> 11.9066401 sigma out 1act.( 13.695344 sig in 12act.) RANK 4 NODE 1 --> 10.1907864 sigma out 1act.( 13.1790028 sig in 12act.) RANK 5 NODE 4 --> 6.52921486 sigma out 1act.( 8.3051815 sig in 12act.) RANK 6 NODE 14 --> 6.33147526 sigma out 1act.( 7.80987835 sig in 12act.) RANK 7 NODE 11 --> 5.68630791 sigma out 1act.( 8.80399513 sig in 12act.) RANK 8 NODE 10 --> 4.33741283 sigma out 1act.( 5.02938032 sig in 12act.) RANK 9 NODE 13 --> 3.21755147 sigma out 1act.( 5.58264065 sig in 12act.) RANK 10 NODE 8 --> 3.13903046 sigma out 1act.( 4.26967669 sig in 12act.) RANK 11 NODE 3 --> 1.8009491 sigma out 1act.( 3.48206019 sig in 12act.) RANK 12 NODE 15 --> 1.76416183 sigma out 1act.( 4.45849419 sig in 12act.) RANK 13 NODE 7 --> 1.58121109 sigma out 1act.( 3.29658055 sig in 12act.) RANK 14 NODE 6 --> 1.1517086 sigma out 1act.( 3.49402833 sig in 12act.) RANK 15 NODE 5 --> 0.464958757 sigma out 1act.( 2.38725662 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 30.0254707 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.603000164 *** contribution from regularisation: 0.00268493034 *** contribution from error: -0.605685115 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48805.0221 -0.388329983 -15.8217344 EXIT FROM BFGS code NEW_X -48805.0221 -0.388329983 -15.8217344 ENTER BFGS code NEW_X -48805.0221 -0.388329983 -15.8217344 EXIT FROM BFGS code CONVERGENC -48805.0221 -0.388329983 -15.8217344 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 49.430069 sigma out 15 active outputs RANK 2 NODE 4 --> 27.8015785 sigma out 15 active outputs RANK 3 NODE 3 --> 26.4489136 sigma out 15 active outputs RANK 4 NODE 10 --> 25.5839424 sigma out 15 active outputs RANK 5 NODE 1 --> 22.1628761 sigma out 15 active outputs RANK 6 NODE 11 --> 15.3328438 sigma out 15 active outputs RANK 7 NODE 6 --> 12.9287548 sigma out 15 active outputs RANK 8 NODE 5 --> 12.763957 sigma out 15 active outputs RANK 9 NODE 8 --> 12.1037741 sigma out 15 active outputs RANK 10 NODE 2 --> 11.2681532 sigma out 15 active outputs RANK 11 NODE 9 --> 10.1501207 sigma out 15 active outputs RANK 12 NODE 7 --> 8.50009251 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 49.6346817 sigma in 12act. ( 40.051857 sig out 1act.) RANK 2 NODE 12 --> 37.3931084 sigma in 12act. ( 26.5916672 sig out 1act.) RANK 3 NODE 1 --> 25.2858353 sigma in 12act. ( 21.5543118 sig out 1act.) RANK 4 NODE 9 --> 25.1724377 sigma in 12act. ( 25.5374908 sig out 1act.) RANK 5 NODE 4 --> 15.1736584 sigma in 12act. ( 13.6483011 sig out 1act.) RANK 6 NODE 11 --> 14.5458431 sigma in 12act. ( 12.6827774 sig out 1act.) RANK 7 NODE 14 --> 14.1868963 sigma in 12act. ( 13.0538597 sig out 1act.) RANK 8 NODE 10 --> 8.73931217 sigma in 12act. ( 8.97028732 sig out 1act.) RANK 9 NODE 13 --> 8.69595146 sigma in 12act. ( 6.92907286 sig out 1act.) RANK 10 NODE 8 --> 7.09261799 sigma in 12act. ( 6.51777697 sig out 1act.) RANK 11 NODE 15 --> 5.55925894 sigma in 12act. ( 3.84396148 sig out 1act.) RANK 12 NODE 3 --> 4.71989012 sigma in 12act. ( 3.96005845 sig out 1act.) RANK 13 NODE 6 --> 4.2308383 sigma in 12act. ( 2.64748025 sig out 1act.) RANK 14 NODE 7 --> 4.21512556 sigma in 12act. ( 3.09872246 sig out 1act.) RANK 15 NODE 5 --> 2.51812291 sigma in 12act. ( 0.903270006 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 40.051857 sigma out 1act.( 49.6346817 sig in 12act.) RANK 2 NODE 12 --> 26.5916672 sigma out 1act.( 37.3931084 sig in 12act.) RANK 3 NODE 9 --> 25.5374908 sigma out 1act.( 25.1724377 sig in 12act.) RANK 4 NODE 1 --> 21.5543118 sigma out 1act.( 25.2858353 sig in 12act.) RANK 5 NODE 4 --> 13.6483011 sigma out 1act.( 15.1736584 sig in 12act.) RANK 6 NODE 14 --> 13.0538597 sigma out 1act.( 14.1868963 sig in 12act.) RANK 7 NODE 11 --> 12.6827774 sigma out 1act.( 14.5458431 sig in 12act.) RANK 8 NODE 10 --> 8.97028732 sigma out 1act.( 8.73931217 sig in 12act.) RANK 9 NODE 13 --> 6.92907286 sigma out 1act.( 8.69595146 sig in 12act.) RANK 10 NODE 8 --> 6.51777697 sigma out 1act.( 7.09261799 sig in 12act.) RANK 11 NODE 3 --> 3.96005845 sigma out 1act.( 4.71989012 sig in 12act.) RANK 12 NODE 15 --> 3.84396148 sigma out 1act.( 5.55925894 sig in 12act.) RANK 13 NODE 7 --> 3.09872246 sigma out 1act.( 4.21512556 sig in 12act.) RANK 14 NODE 6 --> 2.64748025 sigma out 1act.( 4.2308383 sig in 12act.) RANK 15 NODE 5 --> 0.903270006 sigma out 1act.( 2.51812291 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.532135 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.603007376 *** contribution from regularisation: 0.00267767184 *** contribution from error: -0.605685055 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done