NNInput NNInputs_160.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 211035 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 62693 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 62693 Chosen entries: 62693 Signal fraction: 1 Background fraction: 0.422625 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 62693 Entries to split: 62693 Test with : 31346 Train with : 31346 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 62693 for Signal Prepared event 0 for Signal with 62693 events ====Entry 0 Variable Ht : 120.598 Variable LepAPt : 29.9056 Variable LepBPt : 13.5082 Variable MetSigLeptonsJets : 11.7141 Variable MetSpec : 77.1834 Variable SumEtLeptonsJets : 43.4138 Variable VSumJetLeptonsPt : 43.304 Variable addEt : 120.598 Variable dPhiLepSumMet : 2.82377 Variable dPhiLeptons : 0.153702 Variable dRLeptons : 0.732968 Variable lep1_E : 40.451 Variable lep2_E : 32.7603 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2160 Ht = 120.598 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 29.9058 LepAPt = 29.9056 LepBEt = 13.5084 LepBPt = 13.5082 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 77.1834 MetDelPhi = 2.77599 MetSig = 6.78472 MetSigLeptonsJets = 11.7141 MetSpec = 77.1834 Mjj = 0 MostCentralJetEta = 0 MtllMet = 139.14 Njets = 0 SB = 0 SumEt = 129.415 SumEtJets = 0 SumEtLeptonsJets = 43.4138 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 43.304 addEt = 120.598 dPhiLepSumMet = 2.82377 dPhiLeptons = 0.153702 dRLeptons = 0.732968 diltype = 34 dimass = 15.0375 event = 2600 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.451 lep2_E = 32.7603 rand = 0.999742 run = 233650 weight = 2.30027e-06 ===Show End Prepared event 10000 for Signal with 62693 events Prepared event 20000 for Signal with 62693 events Prepared event 30000 for Signal with 62693 events Prepared event 40000 for Signal with 62693 events Prepared event 50000 for Signal with 62693 events Prepared event 60000 for Signal with 62693 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.381263 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4749 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 211035 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4749 negative weights. Signal fraction: 63.0318222 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 63.3308105 65.6596069 67.4563141 68.6104507 69.778717 70.6482544 71.4564667 72.4596786 73.354393 74.0411987 74.8189774 75.4986115 76.2453308 76.9129333 77.5808868 78.2791672 78.9673462 79.5197678 80.1858063 80.8825684 81.4796295 82.4934235 83.2708435 84.2121582 85.0917053 86.3345337 87.5252533 88.7829285 90.3551178 91.9178391 93.5405502 95.1659698 96.7787704 98.4011765 99.9141541 101.633385 103.106857 104.884087 106.384079 107.988792 109.725281 111.434067 113.242249 114.938675 116.564018 118.283051 120.136169 121.856743 123.624695 125.357742 127.103531 128.494583 130.092331 131.691406 133.338562 134.860809 136.351624 137.925934 139.415283 140.858109 142.316666 143.789368 145.194504 146.643921 148.000031 149.246155 150.656616 152.013062 153.384323 154.754486 156.176483 157.618378 159.175858 160.71489 162.466431 164.365601 166.522949 168.680405 171.030609 173.44397 176.05069 178.528961 181.571991 184.675476 187.801651 190.908249 194.093628 197.867706 201.627136 206.219421 210.950226 216.889099 223.105499 230.960754 239.959106 251.602936 268.95929 290.996704 341.102753 880.686707 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3542252 20.6910286 20.9983711 21.2866154 21.5759048 21.8641777 22.0897408 22.3517151 22.5718403 22.779129 22.9893188 23.2080212 23.4424095 23.6636772 23.8964043 24.1548386 24.4059792 24.6403503 24.8607979 25.1071358 25.3360558 25.5666142 25.7742958 26.0250549 26.2407494 26.4818001 26.7381668 26.995491 27.2224045 27.4692917 27.7262001 27.9583817 28.1630974 28.4094925 28.6419659 28.9231873 29.143013 29.4129753 29.6769714 29.9206543 30.2207642 30.5404778 30.7876167 31.0942249 31.4061623 31.6920509 31.9663963 32.1929703 32.4812546 32.7659798 33.0893784 33.3467178 33.6491165 33.9169083 34.2026749 34.5017014 34.8300018 35.155323 35.4446259 35.7553406 36.0545197 36.3764038 36.686615 37.0203552 37.3268814 37.6192436 37.9307365 38.2511826 38.5752945 38.8770561 39.1910439 39.5315247 39.8653488 40.2141647 40.5607033 40.8138657 41.2017403 41.6001205 41.9899445 42.3857269 42.7871017 43.2499847 43.7110901 44.2401276 44.8069916 45.3802795 45.9824142 46.7159042 47.441452 48.2284431 49.2436638 50.283226 51.4693947 52.9572449 54.5866318 56.8949738 59.7629776 64.3171234 72.3397369 201.695786 ------------------------------ Transdef: Tab for variable 4 10.0008297 10.1464176 10.2856598 10.3913641 10.477663 10.6309128 10.7663689 10.8976345 11.0360489 11.1749058 11.3135967 11.4518318 11.6002903 11.744051 11.9183273 12.1054802 12.2589741 12.4203167 12.5813284 12.7673454 12.9135494 13.0992889 13.3232021 13.5030651 13.6832285 13.8405476 14.0171413 14.2241354 14.4447718 14.6832733 14.9195251 15.1650848 15.3907242 15.604249 15.829567 16.0891075 16.3389053 16.6174679 16.8562355 17.1575203 17.4366531 17.727417 17.9862728 18.2474785 18.5577011 18.8248978 19.1138668 19.4186916 19.7611732 20.0954514 20.3613167 20.6551971 20.9928265 21.2844181 21.5834026 21.9092865 22.2069359 22.5630264 22.9035454 23.2475624 23.5790443 23.9310455 24.2865696 24.6198349 24.990551 25.3665199 25.7231903 26.0913754 26.4541721 26.8360271 27.1758251 27.5598602 27.9249573 28.2441273 28.5995426 29.0040283 29.4211426 29.8314304 30.2131615 30.624136 31.0305595 31.4465542 31.8936729 32.3164787 32.7677231 33.2090454 33.656044 34.1390343 34.6373367 35.1845932 35.7480164 36.3989105 37.0900116 37.8602982 38.8001099 39.91222 41.4543495 43.37043 46.2729187 51.5132675 118.205795 ------------------------------ Transdef: Tab for variable 5 1.05821753 2.70626593 3.12971687 3.47053146 3.76582813 3.98105764 4.13565159 4.27626991 4.40425348 4.52534056 4.63616514 4.73126316 4.82744408 4.91496754 5.00351334 5.07692909 5.1473012 5.21895504 5.28344822 5.33397055 5.39288473 5.45189667 5.50619221 5.55837154 5.61383343 5.66145992 5.7116375 5.76283741 5.80905819 5.85578775 5.90654469 5.95102787 5.99465036 6.03817511 6.09025383 6.13091564 6.17907906 6.22251081 6.26147127 6.30547047 6.35049057 6.39781809 6.44282246 6.49446487 6.53595448 6.58342934 6.62897778 6.67024517 6.71998215 6.76513004 6.80916214 6.85018063 6.89435959 6.94534302 6.99784946 7.04737186 7.1016531 7.15837193 7.2097702 7.26358509 7.31640816 7.37216091 7.41725969 7.47464085 7.532969 7.59010792 7.64318705 7.700881 7.76053953 7.82114029 7.87787247 7.93546867 7.99629831 8.06004524 8.12032127 8.17567825 8.23721695 8.29122925 8.35001945 8.41381931 8.48131847 8.54602814 8.61219406 8.6762619 8.74372864 8.813797 8.88900757 8.97265053 9.06074715 9.15652466 9.26171589 9.37684155 9.50351906 9.64521599 9.82144642 10.0115747 10.2586079 10.5914745 11.1316566 12.2092667 19.7316513 ------------------------------ Transdef: Tab for variable 6 15.0022345 21.9422913 25.5985355 26.8072338 27.7101021 28.7283401 29.5691872 30.3840981 31.1824417 31.8444862 32.4769974 32.9895859 33.4721565 33.9996414 34.4850998 34.8680725 35.2862968 35.7233582 36.0909424 36.4876823 36.8427429 37.2255478 37.6925201 38.0504074 38.4238777 38.7728729 39.1736908 39.5783615 39.9324532 40.3261223 40.70047 41.1302185 41.5588112 42.0270462 42.4876785 42.9099083 43.3580551 43.8359299 44.3168793 44.9358597 45.5363693 46.1212921 46.8185959 47.4376984 48.1208878 48.7901421 49.4312515 50.16008 50.8712311 51.5912857 52.4177246 53.2606659 54.019104 54.7917595 55.5604248 56.2598572 56.98349 57.7589722 58.3927193 59.2002831 59.9326096 60.6944046 61.4734344 62.2383881 63.0687485 63.8650131 64.7031403 65.5169678 66.2924042 67.0217743 67.8005676 68.5642242 69.2992706 70.0187378 70.7491989 71.5182571 72.235405 72.9624634 73.7237701 74.5390396 75.2831421 76.080719 76.7151642 77.5144348 78.3843765 79.3084564 80.2680054 81.3043137 82.4660339 83.7351227 85.2097321 86.7662811 88.7139893 91.2122803 93.6812057 96.6760178 100.44194 105.194 112.98555 127.253448 281.100128 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.7251358 33.773407 34.3916168 35.0503387 35.5822067 36.0526237 36.5468826 36.9168777 37.3062363 37.6551056 38.0238876 38.3209381 38.6402321 38.8664551 39.234848 39.5437965 39.8886719 40.1962013 40.4976006 40.9145508 41.29879 41.6639404 42.1164246 42.6304741 43.0891266 43.6219788 44.3781509 44.9564934 45.8060989 46.7852707 47.7467422 48.7294846 49.7384758 50.8073616 51.7936478 52.7393341 53.7425842 54.7646561 55.8123779 56.7816849 57.6548424 58.6600113 59.4763756 60.4299393 61.3180313 62.2634315 63.1170082 63.9083023 64.8281403 65.6896057 66.5997086 67.4989471 68.3018494 69.2303848 70.1098938 70.940712 71.7184601 72.5355377 73.3964996 74.2657471 75.0665741 75.9886627 76.844635 77.72966 78.6212158 79.5505981 80.6348267 81.8300323 82.9864883 84.3781281 85.7793884 87.213974 88.7443085 90.4574661 92.0521393 93.7301941 95.5427856 97.2659988 99.0300446 100.89502 102.71183 104.940186 107.089172 109.450882 111.920303 114.759598 117.75338 120.739105 124.10907 128.193451 132.638763 137.683701 142.894409 149.647873 157.865265 167.477631 180.220108 199.613327 240.304428 653.932312 ------------------------------ Transdef: Tab for variable 8 2.50452757 26.0727406 29.7049313 31.3820839 32.4692917 33.0441208 33.720047 34.1091423 34.6235886 35.0537643 35.4543686 35.8350906 36.1523056 36.5171127 36.8086662 37.0933876 37.4224701 37.7205811 38.0146751 38.259346 38.5193634 38.7672501 39.0643272 39.3177719 39.5912476 39.8701286 40.1746597 40.5678711 40.975441 41.3083725 41.6664886 42.0962067 42.4886742 42.9263687 43.3970871 43.9033737 44.4285927 45.0278587 45.6957779 46.3862 47.0080261 47.7141647 48.3747559 49.0439301 49.6368752 50.3260269 51.0206299 51.7517776 52.4683609 53.1134109 53.8329659 54.5257797 55.2686272 55.9660225 56.7271233 57.4507446 58.1549988 58.7835426 59.4282112 60.176136 60.8563232 61.5309296 62.161747 62.8684845 63.5224991 64.2466431 64.9443817 65.5940857 66.2869263 66.9598618 67.6551971 68.3242035 69.0565338 69.716507 70.4100494 71.1191254 71.8491974 72.5914764 73.289917 73.9855652 74.7406464 75.5023651 76.2892151 77.1471786 78.0163727 78.8706741 79.839035 81.0076904 82.3092651 83.6559601 85.0737228 86.861557 88.8942566 91.2483673 94.013031 97.5335922 102.019394 107.828064 116.917076 137.819885 296.803314 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.9220276 65.1767349 66.8589478 68.1548462 69.1396027 70.0947571 70.8237076 71.6864166 72.5770416 73.3811798 74.0358124 74.7071915 75.3070755 75.9646225 76.6087952 77.117569 77.7037811 78.3084564 78.8882065 79.3852234 79.8427277 80.5289154 81.0418396 81.6567841 82.5006332 83.1674194 83.8163376 84.6219025 85.38797 86.3741913 87.3390808 88.483963 89.4298706 90.5408173 91.8355713 93.160408 94.5667572 95.9324646 97.3839951 98.8344116 100.171181 101.633385 102.898758 104.207581 105.675369 106.977287 108.299545 109.681023 111.067108 112.370239 113.783051 115.100388 116.433182 117.838013 119.22142 120.537125 121.814789 123.12674 124.403961 125.745972 127.045715 128.192505 129.415222 130.750656 132.004181 133.217773 134.433609 135.638321 136.806412 137.940887 139.173874 140.317657 141.514603 142.705704 143.817642 144.859543 146.030823 147.039871 148.146606 149.140442 150.201523 151.223358 152.305756 153.363159 154.47113 155.560394 156.734482 157.930725 159.268341 160.557343 161.925659 163.469574 165.506165 167.872162 170.654678 174.723846 181.007812 191.996429 222.41214 540.805664 ------------------------------ Transdef: Tab for variable 10 0.0405564234 1.01469135 1.39268374 1.62683058 1.78479481 1.91696763 2.00786448 2.09451842 2.16955924 2.23572874 2.28864956 2.33210802 2.37732029 2.41877222 2.45266914 2.48683262 2.51660919 2.54483843 2.57296515 2.59924126 2.61926079 2.64358091 2.6637888 2.68395424 2.7036643 2.72087097 2.73909569 2.75598431 2.77128506 2.78700781 2.80139494 2.81552124 2.82786655 2.83995819 2.85038042 2.86158276 2.87211418 2.88076878 2.89073563 2.89957428 2.90924382 2.91668558 2.92456722 2.93260169 2.94028854 2.94755793 2.95430684 2.96087742 2.96633816 2.9725132 2.97843504 2.98398423 2.98896456 2.9939785 2.99913836 3.00358534 3.0085218 3.01376653 3.01782703 3.02231359 3.02676773 3.03104067 3.03498793 3.03916454 3.04297328 3.04682302 3.05080509 3.05460072 3.05795503 3.06135321 3.06433105 3.06741571 3.0707407 3.07347345 3.07629633 3.07913685 3.08176184 3.08413649 3.08714342 3.09003544 3.09294319 3.09591341 3.09862232 3.10146427 3.10396266 3.10619164 3.10888863 3.11152315 3.11375928 3.11607552 3.11823201 3.12085462 3.12292814 3.12536955 3.12798405 3.13010502 3.13235784 3.13451242 3.13666153 3.13907647 3.1415906 ------------------------------ Transdef: Tab for variable 11 2.8014183E-06 0.00462591648 0.0100153685 0.0161368251 0.0220434945 0.0276062135 0.0334717222 0.0393608771 0.0457485318 0.0521059036 0.0587034672 0.0645205081 0.0707100034 0.0770261362 0.0829791427 0.0888381004 0.0944089815 0.0992732644 0.105203509 0.110815525 0.115628809 0.120571077 0.125896573 0.130940914 0.136145294 0.141134143 0.14624995 0.151712537 0.15649724 0.161432147 0.165984511 0.170969605 0.175998449 0.1809268 0.185787559 0.1907897 0.195738673 0.201126635 0.206159234 0.211199522 0.215941072 0.221111238 0.226678491 0.231431603 0.23576352 0.240909755 0.246109605 0.251133293 0.25655508 0.261898518 0.267573833 0.272919089 0.278435588 0.28279537 0.28793025 0.293545663 0.299427152 0.304487705 0.310227215 0.315479279 0.322235703 0.328564823 0.33490181 0.340838432 0.347488165 0.354018956 0.360132456 0.365613282 0.372665495 0.378806949 0.385526776 0.390426755 0.397706568 0.405063272 0.412337035 0.419105768 0.42648387 0.434258938 0.440734029 0.448691249 0.457486272 0.465644658 0.474984407 0.484498024 0.495813847 0.505906224 0.515823603 0.526807785 0.539795578 0.548897624 0.561825514 0.577951193 0.593929708 0.611445427 0.63193655 0.65344274 0.680893183 0.712736487 0.760222554 0.828727543 1.1246134 ------------------------------ Transdef: Tab for variable 12 0.100083143 0.117743582 0.133188769 0.14543438 0.157226682 0.167501062 0.177262455 0.186578691 0.195567995 0.203865036 0.211274147 0.21925357 0.226779267 0.233440995 0.239230484 0.245762795 0.252131462 0.257970393 0.26465404 0.270493925 0.276784003 0.282177538 0.288305104 0.294259936 0.299832165 0.305141509 0.310120553 0.31583935 0.321377367 0.326789737 0.33217755 0.338070184 0.344216526 0.34975177 0.355336577 0.361219943 0.366436422 0.372115523 0.377199113 0.382531047 0.387924641 0.392871439 0.398173213 0.40259552 0.406653464 0.411042094 0.414972931 0.41915828 0.423567533 0.42743215 0.43198514 0.436495185 0.440132916 0.444007039 0.448292106 0.453371286 0.457871139 0.462700397 0.467189461 0.471799254 0.476221055 0.481084526 0.485795528 0.490798831 0.495456815 0.500721216 0.506056905 0.511639476 0.51760149 0.522693157 0.52969873 0.535965323 0.5420627 0.547426462 0.552657247 0.558676481 0.564999223 0.572260141 0.579785645 0.588251829 0.596080959 0.604651213 0.613864064 0.622701168 0.632346869 0.642875552 0.652481794 0.663808107 0.672780097 0.682851732 0.695517659 0.707563162 0.721173763 0.735461473 0.750204325 0.769434154 0.788496912 0.814548373 0.849431574 0.892276049 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.5713902 22.4426651 23.2433319 23.7834167 24.3714161 24.8867207 25.3561497 25.8701534 26.3421097 26.8185768 27.1738777 27.5989876 28.0313263 28.4591751 28.8446999 29.2187309 29.5638561 29.8854294 30.2914772 30.6049843 30.9134941 31.2213211 31.5952034 31.8972321 32.2440491 32.5435715 32.8788795 33.2437057 33.5869751 33.8901291 34.2169037 34.5182419 34.8414383 35.1812668 35.4994164 35.8469048 36.1719971 36.5198898 36.9084587 37.2562103 37.5742722 37.899765 38.2022247 38.5522804 38.8803062 39.2296906 39.5734138 39.8710098 40.2378845 40.573616 40.9224548 41.3052444 41.6709747 42.0666199 42.4400101 42.8373489 43.1865501 43.5533218 43.9390793 44.3792648 44.8408737 45.2590485 45.7163925 46.1603088 46.5952339 47.038372 47.5091057 47.9499512 48.4507599 48.9557953 49.4944916 50.0111237 50.6000748 51.1177597 51.7445831 52.3325653 52.9993401 53.7410469 54.5015221 55.2121353 56.0362778 56.8433838 57.7560768 58.6182861 59.70158 60.649292 61.7905121 63.1304932 64.5087357 66.155899 67.9130783 69.2599411 71.2652893 73.795311 77.0739975 80.8782043 85.3559875 91.1929016 101.602936 381.504089 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6772346 11.2277451 11.5680723 11.908123 12.2654314 12.5158424 12.8544159 13.2322302 13.5400753 13.85777 14.1123095 14.4258413 14.7365732 15.0534868 15.3492584 15.6636992 15.9672279 16.3043613 16.5718651 16.8538799 17.1326656 17.4886246 17.786869 18.0962372 18.3596306 18.6646309 19.0120144 19.3708992 19.6986256 19.9920597 20.3321495 20.656311 21.0321999 21.3784695 21.699379 21.9941406 22.3463688 22.6697216 23.0124092 23.3736267 23.7024269 24.0120201 24.3844566 24.7494812 25.0622997 25.4138603 25.7375717 26.0531273 26.4187279 26.7586346 27.1177425 27.4760895 27.8267193 28.0615959 28.3901405 28.7538528 29.1096859 29.509201 29.8738117 30.2655487 30.612648 30.9992981 31.3922653 31.7317982 32.087738 32.4485474 32.8475647 33.2309685 33.6263466 34.0039024 34.4011612 34.8026619 35.2166977 35.6564178 36.0766411 36.535881 36.9936714 37.4446869 37.9168816 38.4565773 39.0136833 39.5487671 40.126339 40.6727562 41.3134384 41.9649086 42.6786499 43.4658127 44.2937584 45.2622452 46.1945992 47.3724403 48.6124878 50.1170807 51.9979286 54.1951065 57.0508041 61.7560654 69.4084015 131.775269 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 64.7 51.2 57.7 29.3 49.8 62.5 54.7 63.7 -23.4 -15.5 -27.5 19.6 37.8 2 64.7 100.0 68.2 65.2 36.5 68.9 94.8 76.8 92.5 -45.1 -22.1 -38.2 37.2 46.1 3 51.2 68.2 100.0 54.5 9.4 35.1 71.7 55.2 73.1 -17.2 -25.6 -43.8 66.6 38.6 4 57.7 65.2 54.5 100.0 18.8 41.2 65.6 56.8 72.1 -12.0 -29.8 -51.8 28.7 78.5 5 29.3 36.5 9.4 18.8 100.0 83.6 10.5 58.9 56.2 21.5 -6.6 -9.8 -2.8 10.4 6 49.8 68.9 35.1 41.2 83.6 100.0 49.1 79.2 78.7 -7.8 -14.9 -23.8 12.9 27.1 7 62.5 94.8 71.7 65.6 10.5 49.1 100.0 68.8 82.2 -52.9 -20.9 -37.6 41.9 47.6 8 54.7 76.8 55.2 56.8 58.9 79.2 68.8 100.0 84.3 -13.0 -21.5 -34.8 29.6 40.9 9 63.7 92.5 73.1 72.1 56.2 78.7 82.2 84.3 100.0 -22.1 -25.7 -44.3 41.0 52.3 10 -23.4 -45.1 -17.2 -12.0 21.5 -7.8 -52.9 -13.0 -22.1 100.0 1.3 3.7 -8.5 -7.3 11 -15.5 -22.1 -25.6 -29.8 -6.6 -14.9 -20.9 -21.5 -25.7 1.3 100.0 59.9 -8.9 -20.4 12 -27.5 -38.2 -43.8 -51.8 -9.8 -23.8 -37.6 -34.8 -44.3 3.7 59.9 100.0 -17.7 -32.0 13 19.6 37.2 66.6 28.7 -2.8 12.9 41.9 29.6 41.0 -8.5 -8.9 -17.7 100.0 52.8 14 37.8 46.1 38.6 78.5 10.4 27.1 47.6 40.9 52.3 -7.3 -20.4 -32.0 52.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 166.705889 TOTAL CORRELATION OF ALL VARIABLES 72.3273337 ROUND 1: MAX CORR ( 72.3239513) AFTER KILLING INPUT VARIABLE 11 CONTR 0.699476015 ROUND 2: MAX CORR ( 72.3201129) AFTER KILLING INPUT VARIABLE 14 CONTR 0.74511634 ROUND 3: MAX CORR ( 72.2937206) AFTER KILLING INPUT VARIABLE 8 CONTR 1.95363613 ROUND 4: MAX CORR ( 72.2340097) AFTER KILLING INPUT VARIABLE 10 CONTR 2.93766553 ROUND 5: MAX CORR ( 72.1335948) AFTER KILLING INPUT VARIABLE 2 CONTR 3.8074481 ROUND 6: MAX CORR ( 71.9209297) AFTER KILLING INPUT VARIABLE 6 CONTR 5.53492293 ROUND 7: MAX CORR ( 71.6021864) AFTER KILLING INPUT VARIABLE 12 CONTR 6.76365508 ROUND 8: MAX CORR ( 70.7307465) AFTER KILLING INPUT VARIABLE 13 CONTR 11.1370818 ROUND 9: MAX CORR ( 69.444493) AFTER KILLING INPUT VARIABLE 3 CONTR 13.427617 ROUND 10: MAX CORR ( 69.1345615) AFTER KILLING INPUT VARIABLE 9 CONTR 6.55362633 ROUND 11: MAX CORR ( 66.5432818) AFTER KILLING INPUT VARIABLE 4 CONTR 18.7504464 ROUND 12: MAX CORR ( 62.5096875) AFTER KILLING INPUT VARIABLE 5 CONTR 22.815506 LAST REMAINING VARIABLE: 7 total correlation to target: 72.3273337 % total significance: 161.79063 sigma correlations of single variables to target: variable 2: 64.6788335 % , in sigma: 144.681529 variable 3: 51.1793144 % , in sigma: 114.484153 variable 4: 57.6945576 % , in sigma: 129.058246 variable 5: 29.2554847 % , in sigma: 65.4422476 variable 6: 49.8139508 % , in sigma: 111.42994 variable 7: 62.5096875 % , in sigma: 139.829317 variable 8: 54.726331 % , in sigma: 122.418553 variable 9: 63.7319624 % , in sigma: 142.563451 variable 10: -23.3601483 % , in sigma: 52.254838 variable 11: -15.4918431 % , in sigma: 34.65405 variable 12: -27.514216 % , in sigma: 61.5471648 variable 13: 19.6066691 % , in sigma: 43.8585965 variable 14: 37.8267358 % , in sigma: 84.6154709 variables sorted by significance: 1 most relevant variable 7 corr 62.5096893 , in sigma: 139.829321 2 most relevant variable 5 corr 22.815506 , in sigma: 51.0365154 3 most relevant variable 4 corr 18.7504463 , in sigma: 41.9432925 4 most relevant variable 9 corr 6.55362654 , in sigma: 14.6599537 5 most relevant variable 3 corr 13.4276171 , in sigma: 30.0365368 6 most relevant variable 13 corr 11.1370821 , in sigma: 24.9127879 7 most relevant variable 12 corr 6.76365519 , in sigma: 15.1297715 8 most relevant variable 6 corr 5.53492308 , in sigma: 12.3811932 9 most relevant variable 2 corr 3.80744815 , in sigma: 8.51696588 10 most relevant variable 10 corr 2.93766546 , in sigma: 6.57132954 11 most relevant variable 8 corr 1.95363617 , in sigma: 4.37013242 12 most relevant variable 14 corr 0.745116353 , in sigma: 1.66676743 13 most relevant variable 11 corr 0.699476004 , in sigma: 1.56467351 global correlations between input variables: variable 2: 99.2054805 % variable 3: 92.7413679 % variable 4: 93.5976944 % variable 5: 95.0284401 % variable 6: 94.0622479 % variable 7: 98.8213087 % variable 8: 90.2261348 % variable 9: 98.7935633 % variable 10: 71.9249312 % variable 11: 60.7088436 % variable 12: 72.1014329 % variable 13: 86.3781547 % variable 14: 90.6738616 % significance loss when removing single variables: variable 2: corr = 2.25703347 % , sigma = 5.04880863 variable 3: corr = 16.9167748 % , sigma = 37.8415117 variable 4: corr = 14.5974829 % , sigma = 32.6534358 variable 5: corr = 12.3700252 % , sigma = 27.6707859 variable 6: corr = 5.11631768 % , sigma = 11.4448054 variable 7: corr = 7.29726874 % , sigma = 16.3234236 variable 8: corr = 1.91799223 % , sigma = 4.2903997 variable 9: corr = 11.8722172 % , sigma = 26.557228 variable 10: corr = 2.63506574 % , sigma = 5.89443746 variable 11: corr = 0.699476015 % , sigma = 1.56467353 variable 12: corr = 5.34970462 % , sigma = 11.9668739 variable 13: corr = 8.58906271 % , sigma = 19.2130664 variable 14: corr = 0.804353894 % , sigma = 1.79927721 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 23.9394226 sigma out 15 active outputs RANK 2 NODE 5 --> 18.7362385 sigma out 15 active outputs RANK 3 NODE 12 --> 16.8669415 sigma out 15 active outputs RANK 4 NODE 9 --> 16.3810654 sigma out 15 active outputs RANK 5 NODE 8 --> 14.7481976 sigma out 15 active outputs RANK 6 NODE 4 --> 13.1007824 sigma out 15 active outputs RANK 7 NODE 2 --> 13.0808172 sigma out 15 active outputs RANK 8 NODE 6 --> 12.5741091 sigma out 15 active outputs RANK 9 NODE 3 --> 12.3174763 sigma out 15 active outputs RANK 10 NODE 1 --> 12.0109873 sigma out 15 active outputs RANK 11 NODE 11 --> 10.4637146 sigma out 15 active outputs RANK 12 NODE 7 --> 5.43724966 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 35.5644913 sigma in 12act. ( 39.3108482 sig out 1act.) RANK 2 NODE 9 --> 23.2059422 sigma in 12act. ( 27.5211792 sig out 1act.) RANK 3 NODE 15 --> 19.4758797 sigma in 12act. ( 21.8886127 sig out 1act.) RANK 4 NODE 3 --> 13.1110477 sigma in 12act. ( 10.2267313 sig out 1act.) RANK 5 NODE 13 --> 9.09869003 sigma in 12act. ( 10.7077465 sig out 1act.) RANK 6 NODE 2 --> 6.86311436 sigma in 12act. ( 0.516521215 sig out 1act.) RANK 7 NODE 8 --> 6.78619528 sigma in 12act. ( 6.58874035 sig out 1act.) RANK 8 NODE 7 --> 5.42440128 sigma in 12act. ( 8.277318 sig out 1act.) RANK 9 NODE 14 --> 4.44170809 sigma in 12act. ( 4.17161465 sig out 1act.) RANK 10 NODE 10 --> 3.72133183 sigma in 12act. ( 4.8441534 sig out 1act.) RANK 11 NODE 5 --> 2.91747475 sigma in 12act. ( 1.77522659 sig out 1act.) RANK 12 NODE 1 --> 2.86807323 sigma in 12act. ( 2.93877602 sig out 1act.) RANK 13 NODE 4 --> 2.79639864 sigma in 12act. ( 5.55838013 sig out 1act.) RANK 14 NODE 12 --> 2.74292684 sigma in 12act. ( 3.28335381 sig out 1act.) RANK 15 NODE 6 --> 2.18793821 sigma in 12act. ( 0.594401598 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 39.3108482 sigma out 1act.( 35.5644913 sig in 12act.) RANK 2 NODE 9 --> 27.5211792 sigma out 1act.( 23.2059422 sig in 12act.) RANK 3 NODE 15 --> 21.8886127 sigma out 1act.( 19.4758797 sig in 12act.) RANK 4 NODE 13 --> 10.7077465 sigma out 1act.( 9.09869003 sig in 12act.) RANK 5 NODE 3 --> 10.2267313 sigma out 1act.( 13.1110477 sig in 12act.) RANK 6 NODE 7 --> 8.277318 sigma out 1act.( 5.42440128 sig in 12act.) RANK 7 NODE 8 --> 6.58874035 sigma out 1act.( 6.78619528 sig in 12act.) RANK 8 NODE 4 --> 5.55838013 sigma out 1act.( 2.79639864 sig in 12act.) RANK 9 NODE 10 --> 4.8441534 sigma out 1act.( 3.72133183 sig in 12act.) RANK 10 NODE 14 --> 4.17161465 sigma out 1act.( 4.44170809 sig in 12act.) RANK 11 NODE 12 --> 3.28335381 sigma out 1act.( 2.74292684 sig in 12act.) RANK 12 NODE 1 --> 2.93877602 sigma out 1act.( 2.86807323 sig in 12act.) RANK 13 NODE 5 --> 1.77522659 sigma out 1act.( 2.91747475 sig in 12act.) RANK 14 NODE 6 --> 0.594401598 sigma out 1act.( 2.18793821 sig in 12act.) RANK 15 NODE 2 --> 0.516521215 sigma out 1act.( 6.86311436 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 56.6391106 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 32.8354759 sigma out 15 active outputs RANK 2 NODE 5 --> 19.9671688 sigma out 15 active outputs RANK 3 NODE 9 --> 19.9162064 sigma out 15 active outputs RANK 4 NODE 12 --> 18.7398739 sigma out 15 active outputs RANK 5 NODE 8 --> 16.3509769 sigma out 15 active outputs RANK 6 NODE 1 --> 14.6805468 sigma out 15 active outputs RANK 7 NODE 2 --> 14.48458 sigma out 15 active outputs RANK 8 NODE 4 --> 14.3543596 sigma out 15 active outputs RANK 9 NODE 3 --> 13.5813265 sigma out 15 active outputs RANK 10 NODE 6 --> 13.4320927 sigma out 15 active outputs RANK 11 NODE 11 --> 11.7024374 sigma out 15 active outputs RANK 12 NODE 7 --> 10.1837797 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 38.0094337 sigma in 12act. ( 38.3307648 sig out 1act.) RANK 2 NODE 9 --> 26.4902954 sigma in 12act. ( 26.916069 sig out 1act.) RANK 3 NODE 15 --> 19.8240929 sigma in 12act. ( 20.8312664 sig out 1act.) RANK 4 NODE 4 --> 13.1445646 sigma in 12act. ( 8.08833504 sig out 1act.) RANK 5 NODE 7 --> 12.2080183 sigma in 12act. ( 8.851861 sig out 1act.) RANK 6 NODE 12 --> 12.1190271 sigma in 12act. ( 5.58903551 sig out 1act.) RANK 7 NODE 13 --> 12.1114187 sigma in 12act. ( 11.0333796 sig out 1act.) RANK 8 NODE 3 --> 10.597558 sigma in 12act. ( 8.54098034 sig out 1act.) RANK 9 NODE 1 --> 10.3869419 sigma in 12act. ( 4.0929184 sig out 1act.) RANK 10 NODE 5 --> 8.81284809 sigma in 12act. ( 2.46370673 sig out 1act.) RANK 11 NODE 10 --> 8.69248009 sigma in 12act. ( 5.53103685 sig out 1act.) RANK 12 NODE 14 --> 7.93744755 sigma in 12act. ( 4.25367928 sig out 1act.) RANK 13 NODE 8 --> 7.44069767 sigma in 12act. ( 6.2848115 sig out 1act.) RANK 14 NODE 6 --> 6.51852942 sigma in 12act. ( 0.56422174 sig out 1act.) RANK 15 NODE 2 --> 6.31246328 sigma in 12act. ( 1.67556286 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 38.3307648 sigma out 1act.( 38.0094337 sig in 12act.) RANK 2 NODE 9 --> 26.916069 sigma out 1act.( 26.4902954 sig in 12act.) RANK 3 NODE 15 --> 20.8312664 sigma out 1act.( 19.8240929 sig in 12act.) RANK 4 NODE 13 --> 11.0333796 sigma out 1act.( 12.1114187 sig in 12act.) RANK 5 NODE 7 --> 8.851861 sigma out 1act.( 12.2080183 sig in 12act.) RANK 6 NODE 3 --> 8.54098034 sigma out 1act.( 10.597558 sig in 12act.) RANK 7 NODE 4 --> 8.08833504 sigma out 1act.( 13.1445646 sig in 12act.) RANK 8 NODE 8 --> 6.2848115 sigma out 1act.( 7.44069767 sig in 12act.) RANK 9 NODE 12 --> 5.58903551 sigma out 1act.( 12.1190271 sig in 12act.) RANK 10 NODE 10 --> 5.53103685 sigma out 1act.( 8.69248009 sig in 12act.) RANK 11 NODE 14 --> 4.25367928 sigma out 1act.( 7.93744755 sig in 12act.) RANK 12 NODE 1 --> 4.0929184 sigma out 1act.( 10.3869419 sig in 12act.) RANK 13 NODE 5 --> 2.46370673 sigma out 1act.( 8.81284809 sig in 12act.) RANK 14 NODE 2 --> 1.67556286 sigma out 1act.( 6.31246328 sig in 12act.) RANK 15 NODE 6 --> 0.56422174 sigma out 1act.( 6.51852942 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.7807693 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.41088599 *** contribution from regularisation: 0.00453532347 *** contribution from error: -0.415421307 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.469336897 *** contribution from regularisation: 0.0019231675 *** contribution from error: -0.471260071 *********************************************** -----------------> Test sample ENTER BFGS code START -49533.5724 0.376659155 -0.0176035278 EXIT FROM BFGS code FG_START 0. 0.376659155 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.488652229 *** contribution from regularisation: 0.0021292509 *** contribution from error: -0.490781486 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -51561.1183 0.376659155 71.1014175 EXIT FROM BFGS code FG_LNSRCH 0. 0.383779883 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.532898188 *** contribution from regularisation: 0.00275065983 *** contribution from error: -0.535648823 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56229.8205 0.383779883 40.6440239 EXIT FROM BFGS code NEW_X -56229.8205 0.383779883 40.6440239 ENTER BFGS code NEW_X -56229.8205 0.383779883 40.6440239 EXIT FROM BFGS code FG_LNSRCH 0. 0.387907088 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.533732295 *** contribution from regularisation: 0.00283992081 *** contribution from error: -0.536572218 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56317.829 0.387907088 26.0015221 EXIT FROM BFGS code NEW_X -56317.829 0.387907088 26.0015221 ENTER BFGS code NEW_X -56317.829 0.387907088 26.0015221 EXIT FROM BFGS code FG_LNSRCH 0. 0.397283942 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.535310328 *** contribution from regularisation: 0.00291987113 *** contribution from error: -0.538230181 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56484.337 0.397283942 0.922793865 EXIT FROM BFGS code NEW_X -56484.337 0.397283942 0.922793865 ENTER BFGS code NEW_X -56484.337 0.397283942 0.922793865 EXIT FROM BFGS code FG_LNSRCH 0. 0.406212777 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.536568224 *** contribution from regularisation: 0.00297769392 *** contribution from error: -0.539545894 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56617.0716 0.406212777 -34.6748199 EXIT FROM BFGS code NEW_X -56617.0716 0.406212777 -34.6748199 ENTER BFGS code NEW_X -56617.0716 0.406212777 -34.6748199 EXIT FROM BFGS code FG_LNSRCH 0. 0.401457578 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.537907302 *** contribution from regularisation: 0.00285469717 *** contribution from error: -0.540762007 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56758.3636 0.401457578 -16.9264908 EXIT FROM BFGS code NEW_X -56758.3636 0.401457578 -16.9264908 ENTER BFGS code NEW_X -56758.3636 0.401457578 -16.9264908 EXIT FROM BFGS code FG_LNSRCH 0. 0.383668602 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.540864468 *** contribution from regularisation: 0.00336287636 *** contribution from error: -0.544227362 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57070.3965 0.383668602 18.1965446 EXIT FROM BFGS code NEW_X -57070.3965 0.383668602 18.1965446 ENTER BFGS code NEW_X -57070.3965 0.383668602 18.1965446 EXIT FROM BFGS code FG_LNSRCH 0. 0.379443556 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 51.8961067 sigma out 15 active outputs RANK 2 NODE 1 --> 31.0971775 sigma out 15 active outputs RANK 3 NODE 9 --> 28.5750389 sigma out 15 active outputs RANK 4 NODE 8 --> 26.0017452 sigma out 15 active outputs RANK 5 NODE 11 --> 24.6905994 sigma out 15 active outputs RANK 6 NODE 7 --> 23.3337841 sigma out 15 active outputs RANK 7 NODE 4 --> 19.915863 sigma out 15 active outputs RANK 8 NODE 5 --> 18.6312275 sigma out 15 active outputs RANK 9 NODE 12 --> 16.4260044 sigma out 15 active outputs RANK 10 NODE 6 --> 13.2481384 sigma out 15 active outputs RANK 11 NODE 2 --> 12.2673092 sigma out 15 active outputs RANK 12 NODE 3 --> 11.4305534 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 38.4186401 sigma in 12act. ( 35.3008003 sig out 1act.) RANK 2 NODE 11 --> 36.7096138 sigma in 12act. ( 36.5971603 sig out 1act.) RANK 3 NODE 4 --> 35.2314987 sigma in 12act. ( 32.2507591 sig out 1act.) RANK 4 NODE 9 --> 31.2212734 sigma in 12act. ( 26.1242371 sig out 1act.) RANK 5 NODE 12 --> 30.1801052 sigma in 12act. ( 28.4043198 sig out 1act.) RANK 6 NODE 1 --> 21.885704 sigma in 12act. ( 18.6799488 sig out 1act.) RANK 7 NODE 13 --> 19.5244255 sigma in 12act. ( 15.91856 sig out 1act.) RANK 8 NODE 7 --> 16.320961 sigma in 12act. ( 14.4399986 sig out 1act.) RANK 9 NODE 8 --> 15.6256084 sigma in 12act. ( 14.7622204 sig out 1act.) RANK 10 NODE 2 --> 14.5206251 sigma in 12act. ( 10.5959864 sig out 1act.) RANK 11 NODE 10 --> 9.04581642 sigma in 12act. ( 6.61761999 sig out 1act.) RANK 12 NODE 5 --> 7.12123585 sigma in 12act. ( 5.76293516 sig out 1act.) RANK 13 NODE 14 --> 6.98317146 sigma in 12act. ( 3.57674003 sig out 1act.) RANK 14 NODE 3 --> 6.41952133 sigma in 12act. ( 6.17932367 sig out 1act.) RANK 15 NODE 6 --> 4.75974464 sigma in 12act. ( 3.65667629 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 36.5971603 sigma out 1act.( 36.7096138 sig in 12act.) RANK 2 NODE 15 --> 35.3008003 sigma out 1act.( 38.4186401 sig in 12act.) RANK 3 NODE 4 --> 32.2507591 sigma out 1act.( 35.2314987 sig in 12act.) RANK 4 NODE 12 --> 28.4043198 sigma out 1act.( 30.1801052 sig in 12act.) RANK 5 NODE 9 --> 26.1242371 sigma out 1act.( 31.2212734 sig in 12act.) RANK 6 NODE 1 --> 18.6799488 sigma out 1act.( 21.885704 sig in 12act.) RANK 7 NODE 13 --> 15.91856 sigma out 1act.( 19.5244255 sig in 12act.) RANK 8 NODE 8 --> 14.7622204 sigma out 1act.( 15.6256084 sig in 12act.) RANK 9 NODE 7 --> 14.4399986 sigma out 1act.( 16.320961 sig in 12act.) RANK 10 NODE 2 --> 10.5959864 sigma out 1act.( 14.5206251 sig in 12act.) RANK 11 NODE 10 --> 6.61761999 sigma out 1act.( 9.04581642 sig in 12act.) RANK 12 NODE 3 --> 6.17932367 sigma out 1act.( 6.41952133 sig in 12act.) RANK 13 NODE 5 --> 5.76293516 sigma out 1act.( 7.12123585 sig in 12act.) RANK 14 NODE 6 --> 3.65667629 sigma out 1act.( 4.75974464 sig in 12act.) RANK 15 NODE 14 --> 3.57674003 sigma out 1act.( 6.98317146 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 79.9831009 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.542118371 *** contribution from regularisation: 0.00330437487 *** contribution from error: -0.545422733 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -57202.7047 0.379443556 -69.9731216 EXIT FROM BFGS code NEW_X -57202.7047 0.379443556 -69.9731216 ENTER BFGS code NEW_X -57202.7047 0.379443556 -69.9731216 EXIT FROM BFGS code FG_LNSRCH 0. 0.368102282 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.543088436 *** contribution from regularisation: 0.00300480914 *** contribution from error: -0.546093225 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57305.061 0.368102282 -23.534977 EXIT FROM BFGS code NEW_X -57305.061 0.368102282 -23.534977 ENTER BFGS code NEW_X -57305.061 0.368102282 -23.534977 EXIT FROM BFGS code FG_LNSRCH 0. 0.354732484 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.543466151 *** contribution from regularisation: 0.00310674356 *** contribution from error: -0.546572924 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57344.9151 0.354732484 0.308322966 EXIT FROM BFGS code NEW_X -57344.9151 0.354732484 0.308322966 ENTER BFGS code NEW_X -57344.9151 0.354732484 0.308322966 EXIT FROM BFGS code FG_LNSRCH 0. 0.319237858 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.544547021 *** contribution from regularisation: 0.00317512266 *** contribution from error: -0.547722161 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57458.9652 0.319237858 27.4959221 EXIT FROM BFGS code NEW_X -57458.9652 0.319237858 27.4959221 ENTER BFGS code NEW_X -57458.9652 0.319237858 27.4959221 EXIT FROM BFGS code FG_LNSRCH 0. 0.277304649 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.545669258 *** contribution from regularisation: 0.0032591247 *** contribution from error: -0.54892838 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57577.3843 0.277304649 19.6939888 EXIT FROM BFGS code NEW_X -57577.3843 0.277304649 19.6939888 ENTER BFGS code NEW_X -57577.3843 0.277304649 19.6939888 EXIT FROM BFGS code FG_LNSRCH 0. 0.231886014 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.545426846 *** contribution from regularisation: 0.00341516337 *** contribution from error: -0.548842013 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57551.8027 0.231886014 -0.570154488 EXIT FROM BFGS code FG_LNSRCH 0. 0.256930918 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.546302855 *** contribution from regularisation: 0.0030982988 *** contribution from error: -0.549401164 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57644.2404 0.256930918 11.1777287 EXIT FROM BFGS code NEW_X -57644.2404 0.256930918 11.1777287 ENTER BFGS code NEW_X -57644.2404 0.256930918 11.1777287 EXIT FROM BFGS code FG_LNSRCH 0. 0.254550874 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.546542823 *** contribution from regularisation: 0.00320293405 *** contribution from error: -0.549745739 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57669.5588 0.254550874 -13.9691124 EXIT FROM BFGS code NEW_X -57669.5588 0.254550874 -13.9691124 ENTER BFGS code NEW_X -57669.5588 0.254550874 -13.9691124 EXIT FROM BFGS code FG_LNSRCH 0. 0.250281066 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.546772659 *** contribution from regularisation: 0.00316727045 *** contribution from error: -0.54993993 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57693.8095 0.250281066 -23.7611771 EXIT FROM BFGS code NEW_X -57693.8095 0.250281066 -23.7611771 ENTER BFGS code NEW_X -57693.8095 0.250281066 -23.7611771 EXIT FROM BFGS code FG_LNSRCH 0. 0.215622619 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.547342062 *** contribution from regularisation: 0.00318198069 *** contribution from error: -0.550524056 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57753.8953 0.215622619 -30.5128193 EXIT FROM BFGS code NEW_X -57753.8953 0.215622619 -30.5128193 ENTER BFGS code NEW_X -57753.8953 0.215622619 -30.5128193 EXIT FROM BFGS code FG_LNSRCH 0. 0.137690783 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 74.7937012 sigma out 15 active outputs RANK 2 NODE 1 --> 43.7511101 sigma out 15 active outputs RANK 3 NODE 11 --> 34.7809296 sigma out 15 active outputs RANK 4 NODE 8 --> 34.2180786 sigma out 15 active outputs RANK 5 NODE 4 --> 30.6671829 sigma out 15 active outputs RANK 6 NODE 12 --> 30.1517391 sigma out 15 active outputs RANK 7 NODE 7 --> 29.0680485 sigma out 15 active outputs RANK 8 NODE 9 --> 29.0497799 sigma out 15 active outputs RANK 9 NODE 5 --> 26.2012444 sigma out 15 active outputs RANK 10 NODE 6 --> 16.4275703 sigma out 15 active outputs RANK 11 NODE 2 --> 14.3762121 sigma out 15 active outputs RANK 12 NODE 3 --> 13.9520493 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 65.6103439 sigma in 12act. ( 64.5840836 sig out 1act.) RANK 2 NODE 4 --> 58.1943016 sigma in 12act. ( 57.7160263 sig out 1act.) RANK 3 NODE 15 --> 47.8312416 sigma in 12act. ( 49.9188004 sig out 1act.) RANK 4 NODE 11 --> 32.6452637 sigma in 12act. ( 34.5118256 sig out 1act.) RANK 5 NODE 8 --> 30.4519291 sigma in 12act. ( 36.4350052 sig out 1act.) RANK 6 NODE 9 --> 28.6885262 sigma in 12act. ( 30.4002934 sig out 1act.) RANK 7 NODE 13 --> 27.0682316 sigma in 12act. ( 31.8456421 sig out 1act.) RANK 8 NODE 1 --> 21.9989414 sigma in 12act. ( 22.0214272 sig out 1act.) RANK 9 NODE 7 --> 17.8254719 sigma in 12act. ( 18.8839245 sig out 1act.) RANK 10 NODE 5 --> 12.5236616 sigma in 12act. ( 12.0684795 sig out 1act.) RANK 11 NODE 2 --> 10.7732697 sigma in 12act. ( 9.97149467 sig out 1act.) RANK 12 NODE 6 --> 8.10739613 sigma in 12act. ( 7.897717 sig out 1act.) RANK 13 NODE 10 --> 7.51653337 sigma in 12act. ( 6.79212999 sig out 1act.) RANK 14 NODE 3 --> 6.41540432 sigma in 12act. ( 6.90099239 sig out 1act.) RANK 15 NODE 14 --> 4.37373734 sigma in 12act. ( 1.75612676 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 64.5840836 sigma out 1act.( 65.6103439 sig in 12act.) RANK 2 NODE 4 --> 57.7160263 sigma out 1act.( 58.1943016 sig in 12act.) RANK 3 NODE 15 --> 49.9188004 sigma out 1act.( 47.8312416 sig in 12act.) RANK 4 NODE 8 --> 36.4350052 sigma out 1act.( 30.4519291 sig in 12act.) RANK 5 NODE 11 --> 34.5118256 sigma out 1act.( 32.6452637 sig in 12act.) RANK 6 NODE 13 --> 31.8456421 sigma out 1act.( 27.0682316 sig in 12act.) RANK 7 NODE 9 --> 30.4002934 sigma out 1act.( 28.6885262 sig in 12act.) RANK 8 NODE 1 --> 22.0214272 sigma out 1act.( 21.9989414 sig in 12act.) RANK 9 NODE 7 --> 18.8839245 sigma out 1act.( 17.8254719 sig in 12act.) RANK 10 NODE 5 --> 12.0684795 sigma out 1act.( 12.5236616 sig in 12act.) RANK 11 NODE 2 --> 9.97149467 sigma out 1act.( 10.7732697 sig in 12act.) RANK 12 NODE 6 --> 7.897717 sigma out 1act.( 8.10739613 sig in 12act.) RANK 13 NODE 3 --> 6.90099239 sigma out 1act.( 6.41540432 sig in 12act.) RANK 14 NODE 10 --> 6.79212999 sigma out 1act.( 7.51653337 sig in 12act.) RANK 15 NODE 14 --> 1.75612676 sigma out 1act.( 4.37373734 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 125.28714 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.547404408 *** contribution from regularisation: 0.00326380087 *** contribution from error: -0.55066818 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -57760.4708 0.137690783 -19.6473141 EXIT FROM BFGS code FG_LNSRCH 0. 0.17489621 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.547691107 *** contribution from regularisation: 0.00323352311 *** contribution from error: -0.550924659 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57790.7197 0.17489621 -26.6647339 EXIT FROM BFGS code NEW_X -57790.7197 0.17489621 -26.6647339 ENTER BFGS code NEW_X -57790.7197 0.17489621 -26.6647339 EXIT FROM BFGS code FG_LNSRCH 0. 0.126016408 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.548002183 *** contribution from regularisation: 0.00327889156 *** contribution from error: -0.551281095 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57823.5495 0.126016408 -7.30023289 EXIT FROM BFGS code NEW_X -57823.5495 0.126016408 -7.30023289 ENTER BFGS code NEW_X -57823.5495 0.126016408 -7.30023289 EXIT FROM BFGS code FG_LNSRCH 0. 0.118451893 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.548188925 *** contribution from regularisation: 0.00325570209 *** contribution from error: -0.55144465 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57843.2531 0.118451893 -12.6877308 EXIT FROM BFGS code NEW_X -57843.2531 0.118451893 -12.6877308 ENTER BFGS code NEW_X -57843.2531 0.118451893 -12.6877308 EXIT FROM BFGS code FG_LNSRCH 0. 0.110329367 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.548259974 *** contribution from regularisation: 0.00326915411 *** contribution from error: -0.551529109 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57850.7455 0.110329367 -13.2678213 EXIT FROM BFGS code NEW_X -57850.7455 0.110329367 -13.2678213 ENTER BFGS code NEW_X -57850.7455 0.110329367 -13.2678213 EXIT FROM BFGS code FG_LNSRCH 0. 0.0694715902 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.548611164 *** contribution from regularisation: 0.00327115343 *** contribution from error: -0.551882327 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57887.8061 0.0694715902 -10.3980293 EXIT FROM BFGS code NEW_X -57887.8061 0.0694715902 -10.3980293 ENTER BFGS code NEW_X -57887.8061 0.0694715902 -10.3980293 EXIT FROM BFGS code FG_LNSRCH 0. 0.021759849 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.548938751 *** contribution from regularisation: 0.00335023319 *** contribution from error: -0.552289009 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57922.3702 0.021759849 -8.1656723 EXIT FROM BFGS code NEW_X -57922.3702 0.021759849 -8.1656723 ENTER BFGS code NEW_X -57922.3702 0.021759849 -8.1656723 EXIT FROM BFGS code FG_LNSRCH 0. -0.0932611749 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.54601723 *** contribution from regularisation: 0.00351426355 *** contribution from error: -0.549531519 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57614.1028 -0.0932611749 135.530029 EXIT FROM BFGS code FG_LNSRCH 0. 0.00171297044 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.549102902 *** contribution from regularisation: 0.00335538201 *** contribution from error: -0.552458286 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57939.6939 0.00171297044 13.0677137 EXIT FROM BFGS code NEW_X -57939.6939 0.00171297044 13.0677137 ENTER BFGS code NEW_X -57939.6939 0.00171297044 13.0677137 EXIT FROM BFGS code FG_LNSRCH 0. -0.0348521583 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.549340725 *** contribution from regularisation: 0.00341623463 *** contribution from error: -0.552756965 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57964.7833 -0.0348521583 1.52360773 EXIT FROM BFGS code NEW_X -57964.7833 -0.0348521583 1.52360773 ENTER BFGS code NEW_X -57964.7833 -0.0348521583 1.52360773 EXIT FROM BFGS code FG_LNSRCH 0. -0.0366040245 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 87.8070374 sigma out 15 active outputs RANK 2 NODE 1 --> 52.2388039 sigma out 15 active outputs RANK 3 NODE 11 --> 41.5696793 sigma out 15 active outputs RANK 4 NODE 4 --> 38.6990089 sigma out 15 active outputs RANK 5 NODE 8 --> 34.4867325 sigma out 15 active outputs RANK 6 NODE 7 --> 33.7050552 sigma out 15 active outputs RANK 7 NODE 12 --> 32.2396469 sigma out 15 active outputs RANK 8 NODE 5 --> 32.1171608 sigma out 15 active outputs RANK 9 NODE 6 --> 27.8237514 sigma out 15 active outputs RANK 10 NODE 9 --> 26.7178726 sigma out 15 active outputs RANK 11 NODE 2 --> 21.1956806 sigma out 15 active outputs RANK 12 NODE 3 --> 17.4701424 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 76.4026489 sigma in 12act. ( 74.9459763 sig out 1act.) RANK 2 NODE 4 --> 69.5315094 sigma in 12act. ( 71.9693146 sig out 1act.) RANK 3 NODE 15 --> 55.3637047 sigma in 12act. ( 62.3248062 sig out 1act.) RANK 4 NODE 8 --> 37.3926277 sigma in 12act. ( 47.8824577 sig out 1act.) RANK 5 NODE 9 --> 34.3439064 sigma in 12act. ( 36.8706512 sig out 1act.) RANK 6 NODE 13 --> 33.9049034 sigma in 12act. ( 40.8442001 sig out 1act.) RANK 7 NODE 11 --> 31.198534 sigma in 12act. ( 32.9764175 sig out 1act.) RANK 8 NODE 1 --> 23.7367134 sigma in 12act. ( 24.6384621 sig out 1act.) RANK 9 NODE 7 --> 22.0938225 sigma in 12act. ( 25.1174831 sig out 1act.) RANK 10 NODE 5 --> 19.4850655 sigma in 12act. ( 20.0904026 sig out 1act.) RANK 11 NODE 6 --> 12.1476898 sigma in 12act. ( 12.6363573 sig out 1act.) RANK 12 NODE 2 --> 10.5707712 sigma in 12act. ( 10.9688959 sig out 1act.) RANK 13 NODE 3 --> 9.18884182 sigma in 12act. ( 10.6749964 sig out 1act.) RANK 14 NODE 10 --> 8.63488865 sigma in 12act. ( 8.63315487 sig out 1act.) RANK 15 NODE 14 --> 4.01022911 sigma in 12act. ( 2.40964317 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 74.9459763 sigma out 1act.( 76.4026489 sig in 12act.) RANK 2 NODE 4 --> 71.9693146 sigma out 1act.( 69.5315094 sig in 12act.) RANK 3 NODE 15 --> 62.3248062 sigma out 1act.( 55.3637047 sig in 12act.) RANK 4 NODE 8 --> 47.8824577 sigma out 1act.( 37.3926277 sig in 12act.) RANK 5 NODE 13 --> 40.8442001 sigma out 1act.( 33.9049034 sig in 12act.) RANK 6 NODE 9 --> 36.8706512 sigma out 1act.( 34.3439064 sig in 12act.) RANK 7 NODE 11 --> 32.9764175 sigma out 1act.( 31.198534 sig in 12act.) RANK 8 NODE 7 --> 25.1174831 sigma out 1act.( 22.0938225 sig in 12act.) RANK 9 NODE 1 --> 24.6384621 sigma out 1act.( 23.7367134 sig in 12act.) RANK 10 NODE 5 --> 20.0904026 sigma out 1act.( 19.4850655 sig in 12act.) RANK 11 NODE 6 --> 12.6363573 sigma out 1act.( 12.1476898 sig in 12act.) RANK 12 NODE 2 --> 10.9688959 sigma out 1act.( 10.5707712 sig in 12act.) RANK 13 NODE 3 --> 10.6749964 sigma out 1act.( 9.18884182 sig in 12act.) RANK 14 NODE 10 --> 8.63315487 sigma out 1act.( 8.63488865 sig in 12act.) RANK 15 NODE 14 --> 2.40964317 sigma out 1act.( 4.01022911 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 152.330505 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.549476802 *** contribution from regularisation: 0.00339895929 *** contribution from error: -0.552875757 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -57979.1422 -0.0366040245 3.25061989 EXIT FROM BFGS code NEW_X -57979.1422 -0.0366040245 3.25061989 ENTER BFGS code NEW_X -57979.1422 -0.0366040245 3.25061989 EXIT FROM BFGS code FG_LNSRCH 0. -0.044041805 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.549634576 *** contribution from regularisation: 0.00339071476 *** contribution from error: -0.553025305 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57995.7931 -0.044041805 -19.2217236 EXIT FROM BFGS code NEW_X -57995.7931 -0.044041805 -19.2217236 ENTER BFGS code NEW_X -57995.7931 -0.044041805 -19.2217236 EXIT FROM BFGS code FG_LNSRCH 0. -0.0728090256 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.549884021 *** contribution from regularisation: 0.00338279386 *** contribution from error: -0.553266823 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58022.1129 -0.0728090256 -10.3574972 EXIT FROM BFGS code NEW_X -58022.1129 -0.0728090256 -10.3574972 ENTER BFGS code NEW_X -58022.1129 -0.0728090256 -10.3574972 EXIT FROM BFGS code FG_LNSRCH 0. -0.111686349 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.550114751 *** contribution from regularisation: 0.00341076939 *** contribution from error: -0.553525507 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58046.4564 -0.111686349 -23.2375813 EXIT FROM BFGS code NEW_X -58046.4564 -0.111686349 -23.2375813 ENTER BFGS code NEW_X -58046.4564 -0.111686349 -23.2375813 EXIT FROM BFGS code FG_LNSRCH 0. -0.139451414 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.549917281 *** contribution from regularisation: 0.00345900375 *** contribution from error: -0.553376257 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58025.62 -0.139451414 46.322319 EXIT FROM BFGS code FG_LNSRCH 0. -0.120143138 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.550086796 *** contribution from regularisation: 0.00351358973 *** contribution from error: -0.553600371 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58043.5101 -0.120143138 -3.52784204 EXIT FROM BFGS code FG_LNSRCH 0. -0.113451682 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.550057292 *** contribution from regularisation: 0.00349053065 *** contribution from error: -0.5535478 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58040.3958 -0.113451682 -19.2517433 EXIT FROM BFGS code FG_LNSRCH 0. -0.111784697 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.550048709 *** contribution from regularisation: 0.00347722741 *** contribution from error: -0.553525925 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58039.4906 -0.111784697 -23.031847 EXIT FROM BFGS code FG_LNSRCH 0. -0.111686699 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.550049186 *** contribution from regularisation: 0.00347629888 *** contribution from error: -0.553525507 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58039.5423 -0.111686699 -23.2131462 EXIT FROM BFGS code FG_LNSRCH 0. -0.111686349 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.550045073 *** contribution from regularisation: 0.00348044257 *** contribution from error: -0.553525507 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58039.1047 -0.111686349 -23.2182369 EXIT FROM BFGS code FG_LNSRCH 0. -0.111686349 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 93.5240784 sigma out 15 active outputs RANK 2 NODE 1 --> 59.3181877 sigma out 15 active outputs RANK 3 NODE 4 --> 46.1035538 sigma out 15 active outputs RANK 4 NODE 11 --> 45.4256706 sigma out 15 active outputs RANK 5 NODE 5 --> 38.9731178 sigma out 15 active outputs RANK 6 NODE 7 --> 37.4635506 sigma out 15 active outputs RANK 7 NODE 12 --> 37.3363876 sigma out 15 active outputs RANK 8 NODE 8 --> 37.1829872 sigma out 15 active outputs RANK 9 NODE 6 --> 36.864193 sigma out 15 active outputs RANK 10 NODE 9 --> 31.0298901 sigma out 15 active outputs RANK 11 NODE 2 --> 24.2792263 sigma out 15 active outputs RANK 12 NODE 3 --> 24.1719284 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 83.18853 sigma in 12act. ( 79.6662521 sig out 1act.) RANK 2 NODE 4 --> 81.8330231 sigma in 12act. ( 79.5578995 sig out 1act.) RANK 3 NODE 15 --> 59.8278236 sigma in 12act. ( 65.9014053 sig out 1act.) RANK 4 NODE 8 --> 41.6910973 sigma in 12act. ( 51.6766663 sig out 1act.) RANK 5 NODE 13 --> 40.3625717 sigma in 12act. ( 44.4572983 sig out 1act.) RANK 6 NODE 9 --> 38.2450752 sigma in 12act. ( 39.2794914 sig out 1act.) RANK 7 NODE 11 --> 31.5492439 sigma in 12act. ( 31.6915035 sig out 1act.) RANK 8 NODE 5 --> 26.8731422 sigma in 12act. ( 28.2970123 sig out 1act.) RANK 9 NODE 7 --> 25.5431614 sigma in 12act. ( 28.933588 sig out 1act.) RANK 10 NODE 1 --> 25.4033909 sigma in 12act. ( 25.9458389 sig out 1act.) RANK 11 NODE 6 --> 15.4883156 sigma in 12act. ( 16.8185406 sig out 1act.) RANK 12 NODE 3 --> 11.3258867 sigma in 12act. ( 13.1009293 sig out 1act.) RANK 13 NODE 2 --> 10.8206272 sigma in 12act. ( 11.4430275 sig out 1act.) RANK 14 NODE 10 --> 10.5286865 sigma in 12act. ( 11.0424757 sig out 1act.) RANK 15 NODE 14 --> 3.36073494 sigma in 12act. ( 2.37801647 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 79.6662521 sigma out 1act.( 83.18853 sig in 12act.) RANK 2 NODE 4 --> 79.5578995 sigma out 1act.( 81.8330231 sig in 12act.) RANK 3 NODE 15 --> 65.9014053 sigma out 1act.( 59.8278236 sig in 12act.) RANK 4 NODE 8 --> 51.6766663 sigma out 1act.( 41.6910973 sig in 12act.) RANK 5 NODE 13 --> 44.4572983 sigma out 1act.( 40.3625717 sig in 12act.) RANK 6 NODE 9 --> 39.2794914 sigma out 1act.( 38.2450752 sig in 12act.) RANK 7 NODE 11 --> 31.6915035 sigma out 1act.( 31.5492439 sig in 12act.) RANK 8 NODE 7 --> 28.933588 sigma out 1act.( 25.5431614 sig in 12act.) RANK 9 NODE 5 --> 28.2970123 sigma out 1act.( 26.8731422 sig in 12act.) RANK 10 NODE 1 --> 25.9458389 sigma out 1act.( 25.4033909 sig in 12act.) RANK 11 NODE 6 --> 16.8185406 sigma out 1act.( 15.4883156 sig in 12act.) RANK 12 NODE 3 --> 13.1009293 sigma out 1act.( 11.3258867 sig in 12act.) RANK 13 NODE 2 --> 11.4430275 sigma out 1act.( 10.8206272 sig in 12act.) RANK 14 NODE 10 --> 11.0424757 sigma out 1act.( 10.5286865 sig in 12act.) RANK 15 NODE 14 --> 2.37801647 sigma out 1act.( 3.36073494 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 165.037613 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.550050318 *** contribution from regularisation: 0.00347516336 *** contribution from error: -0.553525507 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -58039.6617 -0.111686349 -23.2098465 EXIT FROM BFGS code FG_LNSRCH 0. -0.111686349 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.550047457 *** contribution from regularisation: 0.00347807351 *** contribution from error: -0.553525507 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58039.3547 -0.111686349 -23.1957817 EXIT FROM BFGS code FG_LNSRCH 0. -0.111686349 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.550039351 *** contribution from regularisation: 0.00348617462 *** contribution from error: -0.553525507 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -58038.4999 -0.111686349 -23.1971035 EXIT FROM BFGS code NEW_X -58038.4999 -0.111686349 -23.1971035 ENTER BFGS code NEW_X -58038.4999 -0.111686349 -23.1971035 EXIT FROM BFGS code CONVERGENC -58038.4999 -0.111686349 -23.1971035 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 135.044525 sigma out 15 active outputs RANK 2 NODE 1 --> 86.130661 sigma out 15 active outputs RANK 3 NODE 4 --> 66.5095367 sigma out 15 active outputs RANK 4 NODE 11 --> 65.0563278 sigma out 15 active outputs RANK 5 NODE 5 --> 57.3919868 sigma out 15 active outputs RANK 6 NODE 7 --> 55.587471 sigma out 15 active outputs RANK 7 NODE 12 --> 53.9155312 sigma out 15 active outputs RANK 8 NODE 8 --> 53.5146332 sigma out 15 active outputs RANK 9 NODE 6 --> 52.6856766 sigma out 15 active outputs RANK 10 NODE 9 --> 44.1652832 sigma out 15 active outputs RANK 11 NODE 2 --> 35.7266884 sigma out 15 active outputs RANK 12 NODE 3 --> 34.9281387 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 120.819496 sigma in 12act. ( 117.106209 sig out 1act.) RANK 2 NODE 4 --> 117.002937 sigma in 12act. ( 117.17083 sig out 1act.) RANK 3 NODE 15 --> 87.8471527 sigma in 12act. ( 96.2665024 sig out 1act.) RANK 4 NODE 8 --> 60.6549492 sigma in 12act. ( 76.9257126 sig out 1act.) RANK 5 NODE 13 --> 58.7454491 sigma in 12act. ( 65.9562531 sig out 1act.) RANK 6 NODE 9 --> 55.4302902 sigma in 12act. ( 57.5218353 sig out 1act.) RANK 7 NODE 11 --> 44.8069267 sigma in 12act. ( 46.6854401 sig out 1act.) RANK 8 NODE 5 --> 38.8421745 sigma in 12act. ( 41.5307121 sig out 1act.) RANK 9 NODE 7 --> 37.227375 sigma in 12act. ( 41.6794701 sig out 1act.) RANK 10 NODE 1 --> 36.6498756 sigma in 12act. ( 38.0108948 sig out 1act.) RANK 11 NODE 6 --> 22.2868404 sigma in 12act. ( 24.3535366 sig out 1act.) RANK 12 NODE 3 --> 16.2466145 sigma in 12act. ( 19.3096485 sig out 1act.) RANK 13 NODE 2 --> 15.2190218 sigma in 12act. ( 16.578619 sig out 1act.) RANK 14 NODE 10 --> 14.9748812 sigma in 12act. ( 16.208683 sig out 1act.) RANK 15 NODE 14 --> 4.45821047 sigma in 12act. ( 3.39932156 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 117.17083 sigma out 1act.( 117.002937 sig in 12act.) RANK 2 NODE 12 --> 117.106209 sigma out 1act.( 120.819496 sig in 12act.) RANK 3 NODE 15 --> 96.2665024 sigma out 1act.( 87.8471527 sig in 12act.) RANK 4 NODE 8 --> 76.9257126 sigma out 1act.( 60.6549492 sig in 12act.) RANK 5 NODE 13 --> 65.9562531 sigma out 1act.( 58.7454491 sig in 12act.) RANK 6 NODE 9 --> 57.5218353 sigma out 1act.( 55.4302902 sig in 12act.) RANK 7 NODE 11 --> 46.6854401 sigma out 1act.( 44.8069267 sig in 12act.) RANK 8 NODE 7 --> 41.6794701 sigma out 1act.( 37.227375 sig in 12act.) RANK 9 NODE 5 --> 41.5307121 sigma out 1act.( 38.8421745 sig in 12act.) RANK 10 NODE 1 --> 38.0108948 sigma out 1act.( 36.6498756 sig in 12act.) RANK 11 NODE 6 --> 24.3535366 sigma out 1act.( 22.2868404 sig in 12act.) RANK 12 NODE 3 --> 19.3096485 sigma out 1act.( 16.2466145 sig in 12act.) RANK 13 NODE 2 --> 16.578619 sigma out 1act.( 15.2190218 sig in 12act.) RANK 14 NODE 10 --> 16.208683 sigma out 1act.( 14.9748812 sig in 12act.) RANK 15 NODE 14 --> 3.39932156 sigma out 1act.( 4.45821047 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 242.668655 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.550043643 *** contribution from regularisation: 0.00348187098 *** contribution from error: -0.553525507 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 31601 Closing output file done