NNInput NNInputs_195.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 70335 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 11645 nbkg = 58690 Bkg Entries: 58690 Sig Entries: 11645 Chosen entries: 11645 Signal fraction: 1 Background fraction: 0.198415 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 58690 Actual Signal Entries: 11645 Entries to split: 11645 Test with : 5822 Train with : 5822 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 11645 for Signal Prepared event 0 for Signal with 11645 events ====Entry 0 Variable Ht : 225.901 Variable LepAPt : 63.638 Variable LepBPt : 23.389 Variable MetSigLeptonsJets : 9.51092 Variable MetSpec : 104.705 Variable SumEtLeptonsJets : 121.196 Variable VSumJetLeptonsPt : 96.1224 Variable addEt : 191.732 Variable dPhiLepSumMet : 2.687 Variable dPhiLeptons : 0.342211 Variable dRLeptons : 0.346978 Variable lep1_E : 71.8454 Variable lep2_E : 25.7459 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2195 Ht = 225.901 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 63.6382 LepAPt = 63.638 LepBEt = 23.389 LepBPt = 23.389 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 104.705 MetDelPhi = 2.13998 MetSig = 7.54777 MetSigLeptonsJets = 9.51092 MetSpec = 104.705 Mjj = 0 MostCentralJetEta = 2.45448 MtllMet = 197.429 Njets = 1 SB = 0 SumEt = 192.44 SumEtJets = 0 SumEtLeptonsJets = 121.196 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 96.1224 addEt = 191.732 dPhiLepSumMet = 2.687 dPhiLeptons = 0.342211 dRLeptons = 0.346978 diltype = 47 dimass = 13.3241 event = 561 jet1_Et = 34.1693 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.8454 lep2_E = 25.7459 rand = 0.999742 run = 228576 weight = 1.92787e-06 ===Show End Prepared event 10000 for Signal with 11645 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 58690 for Background Prepared event 0 for Background with 58690 events ====Entry 0 Variable Ht : 65.1543 Variable LepAPt : 20.8407 Variable LepBPt : 10.82 Variable MetSigLeptonsJets : 5.95247 Variable MetSpec : 33.4933 Variable SumEtLeptonsJets : 31.6607 Variable VSumJetLeptonsPt : 31.4507 Variable addEt : 65.1543 Variable dPhiLepSumMet : 3.01433 Variable dPhiLeptons : 0.243032 Variable dRLeptons : 0.763155 Variable lep1_E : 24.0883 Variable lep2_E : 10.9808 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 65.1543 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 20.8411 LepAPt = 20.8407 LepBEt = 10.82 LepBPt = 10.82 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 33.4933 MetDelPhi = 2.93145 MetSig = 3.89076 MetSigLeptonsJets = 5.95247 MetSpec = 33.4933 Mjj = 0 MostCentralJetEta = 0 MtllMet = 67.7985 Njets = 0 SB = 0 SumEt = 74.1048 SumEtJets = 0 SumEtLeptonsJets = 31.6607 Target = 0 TrainWeight = 0.581763 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 31.4507 addEt = 65.1543 dPhiLepSumMet = 3.01433 dPhiLeptons = 0.243032 dRLeptons = 0.763155 diltype = 110 dimass = 11.6846 event = 12144548 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 24.0883 lep2_E = 10.9808 rand = 0.999742 run = 272126 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 58690 events Prepared event 20000 for Background with 58690 events Prepared event 30000 for Background with 58690 events Prepared event 40000 for Background with 58690 events Prepared event 50000 for Background with 58690 events Warning: found 1976 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 70335 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 1976 negative weights. Signal fraction: 63.2238083 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 48.6484184 60.6283417 63.6991196 65.2733459 67.3656769 68.2318344 69.4085846 70.1130371 71.288063 72.0039902 72.8505096 73.6638031 74.3139038 74.9037323 75.6428986 76.3420792 76.9958725 77.5633087 78.2849274 78.8539886 79.5942001 80.2372894 81.2411041 81.8910828 82.683075 83.4826965 84.3364563 85.515358 86.5225372 87.8974304 89.3096466 90.9489746 92.7034302 94.8176422 96.5807571 98.3599167 100.421646 101.725342 103.741898 105.563187 107.490982 109.056244 110.690308 112.181808 113.978256 115.972031 117.794098 119.531906 121.393463 123.180992 124.920822 126.842461 128.447662 130.054672 131.986481 133.905991 135.170258 136.660202 138.175751 139.837997 141.245163 142.753799 144.405518 146.082016 147.659973 149.291122 151.322998 152.993134 154.762268 156.62912 158.737793 160.460144 162.333344 164.281158 165.938782 167.809387 169.724976 172.014633 174.411972 176.51889 179.488373 181.682098 184.28717 187.252045 189.860962 192.625671 195.639282 199.034943 203.166702 207.835312 211.979889 217.235138 222.756058 228.084396 234.872925 244.592545 255.872925 269.569885 290.212982 327.887207 757.571411 ------------------------------ Transdef: Tab for variable 3 20.000988 20.2039089 20.4729538 20.7735729 20.9926186 21.1917191 21.3638725 21.6023407 21.7989101 21.9791965 22.2087479 22.4270401 22.622776 22.8204422 23.0664139 23.233181 23.5138149 23.7125549 23.9185219 24.144556 24.3605633 24.5481529 24.7603951 25.0085335 25.2468052 25.4024582 25.7039852 25.931221 26.1466331 26.3614979 26.6493149 26.9542809 27.2230873 27.4947338 27.7756519 28.0348625 28.2939816 28.6846313 28.9524994 29.2214165 29.5218277 29.8896599 30.2891006 30.6099262 30.904007 31.2746334 31.65868 31.9617691 32.2705574 32.6978531 33.0709953 33.492363 33.8446045 34.3140335 34.7335663 35.1787338 35.5981216 35.9932098 36.4476776 36.867321 37.4105835 37.9186058 38.3983459 38.9098206 39.4150848 39.8299789 40.2131729 40.8209076 41.2736626 42.02705 42.5757599 43.0637436 43.6441345 44.2315903 44.8527069 45.4982376 46.1395874 46.6207123 47.2441826 47.9904022 48.7878418 49.6890182 50.4803238 51.4067612 52.2663574 53.075531 54.0368118 54.9674759 56.0490189 57.3604355 58.5926323 59.9652405 61.775856 63.665947 65.2596893 67.2312851 70.0539551 73.2558441 76.7177811 84.3930435 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1057968 10.2435026 10.3890133 10.5238237 10.6542263 10.7884598 10.9319248 11.0502348 11.2001305 11.3666191 11.5207901 11.6515875 11.8557129 12.0090065 12.1893511 12.3223572 12.4911528 12.6624384 12.848196 13.0009537 13.202446 13.3732872 13.5541306 13.7602587 13.9696007 14.102726 14.2981415 14.47896 14.6624603 14.8478203 15.0660934 15.3021717 15.4885483 15.6763668 15.8742065 16.105896 16.3603649 16.5749874 16.7894802 16.9795322 17.2196655 17.4308014 17.6455536 17.8262768 18.063818 18.275034 18.4718304 18.653389 18.8465157 19.0580139 19.2719402 19.4960098 19.729414 19.9318352 20.128418 20.3017235 20.489418 20.7122631 20.907383 21.11026 21.332737 21.5522804 21.7756729 21.985527 22.2026691 22.4957123 22.722229 22.9671097 23.1928177 23.3921509 23.6433105 23.9264793 24.1589737 24.3992157 24.6562004 24.9479256 25.2460556 25.5004921 25.8235703 26.0271015 26.4103718 26.7384453 27.0810909 27.4353867 27.7747879 28.2605495 28.6957741 29.024868 29.4729252 29.9293289 30.5666866 31.2429924 31.9652138 32.7731171 33.787323 34.836834 35.9923477 38.0400238 41.4333 67.7732315 ------------------------------ Transdef: Tab for variable 5 1.1656847 2.22721052 2.71127391 2.99671602 3.17884207 3.39603519 3.61735296 3.79549384 3.97356176 4.13032103 4.27172852 4.41237354 4.5428896 4.63223076 4.7522583 4.8521595 4.96891594 5.05883217 5.12979031 5.23080921 5.28034163 5.35063648 5.41318417 5.45985174 5.51008701 5.55784321 5.59987545 5.65144539 5.7004776 5.7621479 5.82095623 5.86070728 5.90194941 5.94990253 5.99729967 6.04314232 6.08079529 6.12476158 6.16852856 6.21519947 6.25640678 6.2974968 6.33955956 6.38467312 6.42235899 6.47422886 6.52678633 6.58163071 6.62910366 6.67223358 6.71597433 6.75931358 6.80805826 6.86030912 6.91057253 6.95742655 7.00938892 7.08112812 7.13597298 7.18569756 7.24394608 7.29596901 7.36044264 7.42048073 7.48242426 7.55505753 7.62210464 7.6795969 7.74151945 7.8062377 7.86673927 7.92949486 7.98318291 8.05053711 8.11540794 8.18052292 8.22637367 8.30299377 8.37656784 8.44947433 8.52083015 8.58491516 8.66668034 8.72974873 8.81204891 8.90069675 8.98823547 9.06779099 9.17603683 9.27515316 9.38150597 9.48054886 9.60876846 9.74820518 9.90905762 10.1386776 10.4065228 10.7545052 11.172286 11.9046745 17.6440296 ------------------------------ Transdef: Tab for variable 6 15.0050735 17.4355793 19.4971523 21.1813736 23.1191788 25.1784649 26.7580528 27.7467499 28.7860184 29.713295 30.5868111 31.2945747 32.0501709 32.6256332 33.1394005 33.5497742 34.0274506 34.4672699 34.8830986 35.2404861 35.6547241 36.1256752 36.5112839 36.8831482 37.251049 37.5827255 37.9508972 38.3087921 38.6615448 39.0800858 39.5055161 39.7949524 40.1469574 40.4569359 40.834053 41.2198563 41.6423607 42.1418839 42.6911011 43.1696548 43.7349243 44.330986 44.964035 45.461483 46.1138306 46.830658 47.5973282 48.379921 49.0684891 49.7084084 50.3849335 51.1994934 52.0418129 52.8818893 53.6411591 54.6226273 55.4567032 56.2422676 57.0993118 57.9549561 58.8408966 59.7532883 60.5623474 61.508831 62.2406693 63.1655121 63.9915428 64.8767242 65.7231522 66.4971695 67.3317642 68.2381668 69.1940308 70.0410919 70.951149 72.0440521 72.8632812 73.8191376 74.8092651 75.759491 76.9167633 77.9361343 78.9510651 80.2412796 81.3634644 82.584549 83.9292374 85.3321075 86.6286316 88.4019318 89.9580994 91.8623505 93.8581848 95.7292404 98.4981995 101.550232 105.596931 110.668854 118.5168 130.260193 236.562576 ------------------------------ Transdef: Tab for variable 7 30.1484737 32.3107796 33.2479744 33.8745346 34.5526886 35.1101494 35.5525398 35.9683723 36.2612801 36.5869865 36.9695511 37.301754 37.6426392 37.902565 38.3028793 38.6376495 39.023243 39.2309265 39.5059814 39.7636719 40.1917114 40.5518494 40.9523201 41.480648 41.9317284 42.4228554 42.9376297 43.5401688 44.2038651 44.99403 45.9063644 46.7829361 47.9301834 48.9935646 50.1846771 51.2565994 52.5774651 53.6321259 54.7453651 55.7632637 56.6090012 57.7553406 58.7533035 59.6028786 60.7631721 61.7535782 62.6711349 63.6593857 64.7439423 65.5725861 66.6759262 67.8440857 68.8060989 69.7835083 70.7576904 71.6148071 72.6161194 73.5117264 74.334198 75.3598938 76.4118195 77.3769302 78.6938705 79.6899185 80.5115204 81.5635147 82.9259338 84.2855225 85.6817398 86.9710541 88.2787933 89.4438858 90.5733032 92.1436386 93.6575165 95.3815002 97.1074982 98.72052 100.952347 102.518433 104.12516 105.76886 107.525314 109.693527 112.139725 114.731155 117.541626 120.336433 123.565826 127.140656 131.92865 136.771973 141.969635 146.988586 153.037781 159.018585 169.476562 180.67514 198.070312 229.333984 487.670013 ------------------------------ Transdef: Tab for variable 8 3.10723281 19.9876537 25.643177 29.2090912 30.7524529 31.7232742 32.5344429 33.1464806 33.5704117 34.0475693 34.4371796 34.881134 35.1300316 35.3899918 35.7120285 36.0256386 36.2809601 36.6373253 36.9725342 37.2465286 37.5071297 37.8434982 38.1652298 38.4598999 38.6899338 38.9864883 39.2668419 39.5767746 39.9479103 40.2414856 40.454586 40.8878632 41.2986679 41.6547394 42.0893211 42.520668 43.0058861 43.5664406 44.1634521 44.7343979 45.444458 46.0821915 46.7440071 47.3961868 48.1611099 48.8879547 49.6641922 50.4087677 51.0480194 51.8641777 52.7779732 53.4542503 54.1383438 54.8981476 55.5890274 56.3544846 57.2868919 57.9771729 58.6802902 59.3988914 60.3153763 61.1802025 61.8343124 62.5643387 63.3716507 64.2109604 64.9758759 65.573288 66.3935547 67.3721161 68.0765228 68.8431931 69.8357849 70.4969482 71.4117889 72.040741 72.8088531 73.6893768 74.7087708 75.583786 76.4198914 77.4813766 78.391922 79.3744659 80.4566803 81.7208862 82.9452744 84.2302246 85.6032562 87.0885925 88.525589 90.2535858 92.5398865 94.8555756 97.164505 99.8324203 103.320099 109.252747 115.98555 131.381531 275.161804 ------------------------------ Transdef: Tab for variable 9 48.6484184 59.7897797 62.5454178 64.4879608 66.0037308 67.3816452 68.2331238 69.1604233 69.8780136 70.7393341 71.5742569 72.3524857 73.0272522 73.8615494 74.3886414 74.9275665 75.582077 76.2222748 76.8836975 77.2637711 77.8663635 78.4043808 78.912735 79.5354919 80.0000458 80.8070984 81.4523163 82.0714951 82.6956482 83.4352264 84.1807404 84.9956055 85.9835358 86.7005463 87.8535004 88.9330444 90.1569977 91.6700897 92.8205261 94.4608841 95.8676605 97.2095337 98.9293671 100.428299 101.585037 103.126343 104.672829 106.44445 107.927147 109.253578 110.740456 112.11734 113.611351 115.080009 116.562469 117.941139 119.372177 120.699112 122.046371 123.704178 125.023918 126.449966 127.828506 129.357513 130.679169 131.986481 133.376892 134.424225 135.484222 136.647491 137.970337 139.272583 140.482803 141.711182 142.849915 144.217865 145.539856 147.046875 148.316177 149.438293 150.787399 152.223145 153.61499 155.246262 156.735977 158.647369 160.454697 162.275543 164.269012 166.427734 168.432892 170.44046 172.926285 175.704834 178.89978 182.453247 186.823303 191.312469 197.581757 212.331253 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0335818008 0.969424367 1.32587039 1.52143955 1.68079853 1.80964792 1.91956425 2.0080409 2.0931735 2.15341139 2.2115674 2.27101088 2.3193326 2.35975933 2.40082097 2.44190311 2.47886753 2.50934076 2.53963709 2.5683372 2.58913136 2.61654782 2.64084387 2.66475868 2.68330526 2.7035327 2.72400618 2.7438333 2.75978374 2.77684736 2.79298925 2.80841684 2.82013893 2.82946348 2.84167242 2.85380769 2.8636477 2.87342286 2.88329411 2.89327192 2.90218067 2.91146874 2.92033339 2.929075 2.93570042 2.94337893 2.95055246 2.95798397 2.96451259 2.97111011 2.97645617 2.98285675 2.98806047 2.99389887 2.99877882 3.00314641 3.00704718 3.01199365 3.01630664 3.02024794 3.02477789 3.02865434 3.03236604 3.03626013 3.04042077 3.04545307 3.04895663 3.05229235 3.05635309 3.05916333 3.06251073 3.06594086 3.06863403 3.07181597 3.07482958 3.07740831 3.08068991 3.08337259 3.08636093 3.08907485 3.0920248 3.09509706 3.09807372 3.10039711 3.10292816 3.10537338 3.10810518 3.11099386 3.1134243 3.11540556 3.11832857 3.12029552 3.12221289 3.12459135 3.12664938 3.1293416 3.13142347 3.13381124 3.13613153 3.13868022 3.1415906 ------------------------------ Transdef: Tab for variable 11 3.9100647E-05 0.00499224383 0.0102690458 0.0143092871 0.0194611549 0.0249626935 0.0306185484 0.037123438 0.0437757969 0.0495297983 0.0567104816 0.0633310676 0.0693292618 0.0767016262 0.0836496353 0.0913453102 0.0974743366 0.104374766 0.110509515 0.116880417 0.122663736 0.129601717 0.135451257 0.140355468 0.145676762 0.15234971 0.157720566 0.162908748 0.169793695 0.176113844 0.180524141 0.185208321 0.190032125 0.194211856 0.198382139 0.202102602 0.206179783 0.210483193 0.215408921 0.219764471 0.22489816 0.229305625 0.233593106 0.237717673 0.243095636 0.248102739 0.252797246 0.256248236 0.26033926 0.264906108 0.269856513 0.274699509 0.278178543 0.282772183 0.28792429 0.293192387 0.298002124 0.303421497 0.307826579 0.311978966 0.316461146 0.3214477 0.325828433 0.331000447 0.336385906 0.342358232 0.347319603 0.352553129 0.356984735 0.362792492 0.368925393 0.375095606 0.382423699 0.388428807 0.395786613 0.401417851 0.40912652 0.416771322 0.423392177 0.430531561 0.438641429 0.447335362 0.455830425 0.465936899 0.476861 0.486833632 0.499741763 0.509920895 0.520587206 0.534033418 0.548000336 0.564448357 0.579329014 0.592467785 0.608321428 0.633422375 0.661383986 0.699946404 0.74299407 0.813307047 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200026914 0.206425488 0.213607311 0.219929978 0.225408345 0.230276853 0.234645844 0.240034759 0.245397449 0.249832705 0.254707068 0.25914374 0.263732255 0.267691255 0.272714943 0.276896328 0.281380951 0.286627829 0.290742099 0.295596361 0.299010247 0.303499848 0.309847206 0.313312769 0.316620499 0.320928514 0.325221688 0.330046445 0.334144682 0.338655889 0.34297514 0.346940339 0.35091114 0.354842573 0.359532714 0.364401847 0.368955553 0.373676002 0.377963603 0.382717639 0.387491226 0.391756743 0.395981073 0.400191963 0.403907716 0.408627272 0.411820352 0.41506958 0.418897927 0.422822535 0.426359892 0.430769742 0.433972329 0.438050717 0.441928506 0.447216749 0.451270103 0.455707073 0.460795909 0.465065718 0.46894896 0.473992646 0.479834974 0.484254658 0.489451766 0.494978726 0.49816978 0.504970431 0.511296928 0.515838385 0.52113539 0.52745831 0.533407211 0.539231956 0.545456886 0.552377999 0.559010148 0.565836787 0.573718905 0.583476663 0.590117097 0.598382175 0.605021417 0.614139795 0.625339985 0.631049752 0.641973138 0.650132775 0.661123753 0.671418846 0.68560487 0.70119679 0.719690442 0.739394546 0.758868933 0.777223051 0.802791953 0.82692349 0.85199672 0.896716356 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0471687 21.2748299 21.9861641 22.3700943 23.0463409 23.4506874 23.81394 24.24123 24.6878777 25.1430206 25.5805588 25.8582592 26.2629547 26.6795273 27.148037 27.5074348 27.8031044 28.1598167 28.4889297 28.8530159 29.1865768 29.5119457 29.9108448 30.2476654 30.4836864 30.7659454 31.1408997 31.5409889 31.7871628 32.0888367 32.3363647 32.7775879 33.1240654 33.508358 33.9034882 34.2895699 34.6641769 35.1154823 35.464325 35.8693428 36.1989975 36.5852966 36.9268951 37.4391937 37.9054794 38.4103546 38.9132385 39.2756996 39.7195892 40.0698166 40.4728394 40.9012642 41.3635406 41.8431549 42.3741226 42.8667603 43.2823143 43.8492813 44.3658676 44.868824 45.3941498 46.0135231 46.5799255 47.1071014 47.6617813 48.1519165 48.7469482 49.3145103 49.8873558 50.6228027 51.3482513 52.1319618 52.8162537 53.4930344 54.3125687 55.0814514 55.8195381 56.5754623 57.5004578 58.2421455 59.1957703 60.2927589 61.2660904 62.2176971 63.4930038 64.7136078 66.1175308 67.5456085 68.9405823 70.4733276 72.0093613 73.3485718 74.9146729 77.1895142 79.7808685 82.470459 85.9333344 89.6999207 95.315239 104.466858 230.5327 ------------------------------ Transdef: Tab for variable 14 10.0116768 10.6893425 11.0772705 11.3492155 11.7415504 12.1320267 12.4761295 12.7027302 12.9955025 13.2585516 13.566267 13.8422337 14.0506248 14.3090515 14.5641289 14.7976942 15.0239506 15.2627535 15.5161495 15.7465973 16.0271454 16.2899628 16.5855103 16.8514328 17.1308136 17.3770943 17.6279564 17.8533287 18.0837002 18.4233246 18.6523781 18.8490753 19.0844536 19.2387581 19.5923271 19.8075485 20.0556507 20.244915 20.5356369 20.7229958 20.9557171 21.1467133 21.4002724 21.6145077 21.876812 22.0924969 22.3569164 22.6033249 22.8871384 23.0884399 23.3407688 23.5242271 23.8018379 24.0371323 24.2961998 24.5284081 24.7791443 25.0231171 25.2966709 25.5294704 25.7645454 26.0105209 26.20681 26.4484749 26.7130013 26.9505806 27.280035 27.5520515 27.8478546 28.1380806 28.4441395 28.7714729 29.1415939 29.4354515 29.7197704 30.0301247 30.3816376 30.7289448 31.0901451 31.3622303 31.7249107 32.1318207 32.527401 32.9597626 33.4755363 33.9821243 34.4277077 35.0609665 35.6149445 36.2711792 37.0538979 37.8164444 38.5871582 39.6482162 41.0283012 42.6535645 44.2437592 46.6781158 49.6160202 55.4889526 115.518631 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.7 55.8 52.4 28.8 47.2 66.2 55.0 64.5 -28.9 -11.1 -29.3 41.1 34.7 2 67.7 100.0 72.5 58.6 38.9 68.0 94.4 74.8 91.5 -42.2 -17.6 -40.1 57.3 41.3 3 55.8 72.5 100.0 45.5 22.4 43.6 73.1 60.6 79.0 -13.9 -22.0 -46.4 82.7 30.5 4 52.4 58.6 45.5 100.0 13.2 32.6 60.7 45.6 60.1 -15.0 -20.3 -46.2 35.9 80.8 5 28.8 38.9 22.4 13.2 100.0 86.1 11.0 65.1 61.6 26.8 -5.0 -11.6 14.0 5.1 6 47.2 68.0 43.6 32.6 86.1 100.0 46.2 82.7 80.5 -1.6 -10.4 -24.2 31.9 20.1 7 66.2 94.4 73.1 60.7 11.0 46.2 100.0 63.6 79.2 -52.5 -17.0 -39.5 59.0 44.2 8 55.0 74.8 60.6 45.6 65.1 82.7 63.6 100.0 84.9 -6.4 -17.1 -34.2 47.4 30.9 9 64.5 91.5 79.0 60.1 61.6 80.5 79.2 84.9 100.0 -15.7 -20.1 -44.7 63.0 42.2 10 -28.9 -42.2 -13.9 -15.0 26.8 -1.6 -52.5 -6.4 -15.7 100.0 1.3 6.2 -11.1 -10.6 11 -11.1 -17.6 -22.0 -20.3 -5.0 -10.4 -17.0 -17.1 -20.1 1.3 100.0 51.0 -17.6 -19.0 12 -29.3 -40.1 -46.4 -46.2 -11.6 -24.2 -39.5 -34.2 -44.7 6.2 51.0 100.0 -33.8 -28.7 13 41.1 57.3 82.7 35.9 14.0 31.9 59.0 47.4 63.0 -11.1 -17.6 -33.8 100.0 44.1 14 34.7 41.3 30.5 80.8 5.1 20.1 44.2 30.9 42.2 -10.6 -19.0 -28.7 44.1 100.0 TOTAL CORRELATION TO TARGET (diagonal) 172.571336 TOTAL CORRELATION OF ALL VARIABLES 72.9873552 ROUND 1: MAX CORR ( 72.9828351) AFTER KILLING INPUT VARIABLE 11 CONTR 0.812281648 ROUND 2: MAX CORR ( 72.9749389) AFTER KILLING INPUT VARIABLE 2 CONTR 1.07355142 ROUND 3: MAX CORR ( 72.9623639) AFTER KILLING INPUT VARIABLE 6 CONTR 1.35467969 ROUND 4: MAX CORR ( 72.9561525) AFTER KILLING INPUT VARIABLE 8 CONTR 0.952029256 ROUND 5: MAX CORR ( 72.9359831) AFTER KILLING INPUT VARIABLE 13 CONTR 1.71538716 ROUND 6: MAX CORR ( 72.8053127) AFTER KILLING INPUT VARIABLE 12 CONTR 4.36395213 ROUND 7: MAX CORR ( 72.5644687) AFTER KILLING INPUT VARIABLE 14 CONTR 5.91704573 ROUND 8: MAX CORR ( 72.170242) AFTER KILLING INPUT VARIABLE 10 CONTR 7.5536944 ROUND 9: MAX CORR ( 71.2504057) AFTER KILLING INPUT VARIABLE 9 CONTR 11.4857959 ROUND 10: MAX CORR ( 70.9597648) AFTER KILLING INPUT VARIABLE 3 CONTR 6.42900376 ROUND 11: MAX CORR ( 69.6301972) AFTER KILLING INPUT VARIABLE 4 CONTR 13.6720102 ROUND 12: MAX CORR ( 66.176158) AFTER KILLING INPUT VARIABLE 5 CONTR 21.6582658 LAST REMAINING VARIABLE: 7 total correlation to target: 72.9873552 % total significance: 70.3396707 sigma correlations of single variables to target: variable 2: 67.7403527 % , in sigma: 65.2830082 variable 3: 55.8382817 % , in sigma: 53.8126959 variable 4: 52.4136444 % , in sigma: 50.5122905 variable 5: 28.7868883 % , in sigma: 27.7426171 variable 6: 47.2276022 % , in sigma: 45.5143768 variable 7: 66.176158 % , in sigma: 63.7755561 variable 8: 54.9840636 % , in sigma: 52.9894654 variable 9: 64.4985484 % , in sigma: 62.1588034 variable 10: -28.8735454 % , in sigma: 27.8261306 variable 11: -11.0969891 % , in sigma: 10.6944354 variable 12: -29.2720316 % , in sigma: 28.2101613 variable 13: 41.0728931 % , in sigma: 39.5829356 variable 14: 34.7076711 % , in sigma: 33.4486179 variables sorted by significance: 1 most relevant variable 7 corr 66.1761551 , in sigma: 63.7755533 2 most relevant variable 5 corr 21.6582661 , in sigma: 20.8725922 3 most relevant variable 4 corr 13.6720104 , in sigma: 13.1760455 4 most relevant variable 3 corr 6.42900372 , in sigma: 6.1957856 5 most relevant variable 9 corr 11.485796 , in sigma: 11.069138 6 most relevant variable 10 corr 7.55369425 , in sigma: 7.27967694 7 most relevant variable 14 corr 5.91704559 , in sigma: 5.70239924 8 most relevant variable 12 corr 4.36395216 , in sigma: 4.20564572 9 most relevant variable 13 corr 1.71538711 , in sigma: 1.65315984 10 most relevant variable 8 corr 0.952029228 , in sigma: 0.917493479 11 most relevant variable 6 corr 1.3546797 , in sigma: 1.30553743 12 most relevant variable 2 corr 1.07355142 , in sigma: 1.03460734 13 most relevant variable 11 corr 0.812281668 , in sigma: 0.782815392 global correlations between input variables: variable 2: 99.2674796 % variable 3: 94.7730069 % variable 4: 92.0489209 % variable 5: 95.7307186 % variable 6: 95.0812513 % variable 7: 98.9199885 % variable 8: 90.9301128 % variable 9: 98.8517439 % variable 10: 73.295383 % variable 11: 53.2330609 % variable 12: 68.6571034 % variable 13: 89.8156723 % variable 14: 89.2186802 % significance loss when removing single variables: variable 2: corr = 1.10842191 % , sigma = 1.06821287 variable 3: corr = 11.5714839 % , sigma = 11.1517175 variable 4: corr = 14.3596758 % , sigma = 13.8387651 variable 5: corr = 14.053041 % , sigma = 13.5432538 variable 6: corr = 1.5782045 % , sigma = 1.52095366 variable 7: corr = 7.5472496 % , sigma = 7.27346608 variable 8: corr = 1.73492333 % , sigma = 1.67198736 variable 9: corr = 8.76706914 % , sigma = 8.44903552 variable 10: corr = 7.49641838 % , sigma = 7.2244788 variable 11: corr = 0.812281648 % , sigma = 0.782815373 variable 12: corr = 3.53016719 % , sigma = 3.40210708 variable 13: corr = 1.73118754 % , sigma = 1.66838709 variable 14: corr = 3.93690314 % , sigma = 3.7940883 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 13.2593384 sigma out 15 active outputs RANK 2 NODE 9 --> 11.8133469 sigma out 15 active outputs RANK 3 NODE 8 --> 9.38134575 sigma out 15 active outputs RANK 4 NODE 2 --> 9.29439831 sigma out 15 active outputs RANK 5 NODE 5 --> 8.78974342 sigma out 15 active outputs RANK 6 NODE 6 --> 8.74979115 sigma out 15 active outputs RANK 7 NODE 3 --> 8.20185375 sigma out 15 active outputs RANK 8 NODE 1 --> 8.00751877 sigma out 15 active outputs RANK 9 NODE 7 --> 6.84902811 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 16.7200146 sigma in 9act. ( 17.6870823 sig out 1act.) RANK 2 NODE 8 --> 14.3875589 sigma in 9act. ( 13.8904009 sig out 1act.) RANK 3 NODE 15 --> 10.9904528 sigma in 9act. ( 11.7498131 sig out 1act.) RANK 4 NODE 5 --> 9.34022808 sigma in 9act. ( 10.6022291 sig out 1act.) RANK 5 NODE 3 --> 6.85481119 sigma in 9act. ( 7.19484043 sig out 1act.) RANK 6 NODE 4 --> 5.41590118 sigma in 9act. ( 5.98097897 sig out 1act.) RANK 7 NODE 12 --> 4.99367476 sigma in 9act. ( 5.13327408 sig out 1act.) RANK 8 NODE 10 --> 3.09239888 sigma in 9act. ( 2.59299302 sig out 1act.) RANK 9 NODE 6 --> 2.1673224 sigma in 9act. ( 2.34055567 sig out 1act.) RANK 10 NODE 7 --> 1.87077117 sigma in 9act. ( 2.16266203 sig out 1act.) RANK 11 NODE 9 --> 1.8687048 sigma in 9act. ( 1.64763808 sig out 1act.) RANK 12 NODE 11 --> 1.24071717 sigma in 9act. ( 0.927934408 sig out 1act.) RANK 13 NODE 13 --> 1.21550214 sigma in 9act. ( 0.26008898 sig out 1act.) RANK 14 NODE 2 --> 1.08935022 sigma in 9act. ( 0.808596015 sig out 1act.) RANK 15 NODE 1 --> 0.758730352 sigma in 9act. ( 0.448038429 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 17.6870823 sigma out 1act.( 16.7200146 sig in 9act.) RANK 2 NODE 8 --> 13.8904009 sigma out 1act.( 14.3875589 sig in 9act.) RANK 3 NODE 15 --> 11.7498131 sigma out 1act.( 10.9904528 sig in 9act.) RANK 4 NODE 5 --> 10.6022291 sigma out 1act.( 9.34022808 sig in 9act.) RANK 5 NODE 3 --> 7.19484043 sigma out 1act.( 6.85481119 sig in 9act.) RANK 6 NODE 4 --> 5.98097897 sigma out 1act.( 5.41590118 sig in 9act.) RANK 7 NODE 12 --> 5.13327408 sigma out 1act.( 4.99367476 sig in 9act.) RANK 8 NODE 10 --> 2.59299302 sigma out 1act.( 3.09239888 sig in 9act.) RANK 9 NODE 6 --> 2.34055567 sigma out 1act.( 2.1673224 sig in 9act.) RANK 10 NODE 7 --> 2.16266203 sigma out 1act.( 1.87077117 sig in 9act.) RANK 11 NODE 9 --> 1.64763808 sigma out 1act.( 1.8687048 sig in 9act.) RANK 12 NODE 11 --> 0.927934408 sigma out 1act.( 1.24071717 sig in 9act.) RANK 13 NODE 2 --> 0.808596015 sigma out 1act.( 1.08935022 sig in 9act.) RANK 14 NODE 1 --> 0.448038429 sigma out 1act.( 0.758730352 sig in 9act.) RANK 15 NODE 13 --> 0.26008898 sigma out 1act.( 1.21550214 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 29.8581104 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 17.0910301 sigma out 15 active outputs RANK 2 NODE 4 --> 13.3903465 sigma out 15 active outputs RANK 3 NODE 9 --> 12.4578094 sigma out 15 active outputs RANK 4 NODE 6 --> 10.9473314 sigma out 15 active outputs RANK 5 NODE 8 --> 10.1386623 sigma out 15 active outputs RANK 6 NODE 1 --> 9.44825172 sigma out 15 active outputs RANK 7 NODE 5 --> 9.43025398 sigma out 15 active outputs RANK 8 NODE 3 --> 9.09335518 sigma out 15 active outputs RANK 9 NODE 7 --> 7.4660778 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 15.6170359 sigma in 9act. ( 15.1965904 sig out 1act.) RANK 2 NODE 8 --> 14.6735592 sigma in 9act. ( 12.875268 sig out 1act.) RANK 3 NODE 15 --> 12.5667372 sigma in 9act. ( 12.0666494 sig out 1act.) RANK 4 NODE 5 --> 9.43168449 sigma in 9act. ( 9.287673 sig out 1act.) RANK 5 NODE 12 --> 8.647542 sigma in 9act. ( 5.44609165 sig out 1act.) RANK 6 NODE 4 --> 8.54866028 sigma in 9act. ( 7.10538387 sig out 1act.) RANK 7 NODE 9 --> 8.07591534 sigma in 9act. ( 2.86475539 sig out 1act.) RANK 8 NODE 7 --> 7.61976194 sigma in 9act. ( 3.55020475 sig out 1act.) RANK 9 NODE 1 --> 7.61149216 sigma in 9act. ( 2.13535905 sig out 1act.) RANK 10 NODE 6 --> 6.65429926 sigma in 9act. ( 3.2558403 sig out 1act.) RANK 11 NODE 3 --> 6.50737715 sigma in 9act. ( 6.66067696 sig out 1act.) RANK 12 NODE 10 --> 3.92971468 sigma in 9act. ( 1.6300683 sig out 1act.) RANK 13 NODE 13 --> 3.43734431 sigma in 9act. ( 0.0495048724 sig out 1act.) RANK 14 NODE 2 --> 3.11645794 sigma in 9act. ( 0.764448404 sig out 1act.) RANK 15 NODE 11 --> 2.66695118 sigma in 9act. ( 0.563573301 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 15.1965904 sigma out 1act.( 15.6170359 sig in 9act.) RANK 2 NODE 8 --> 12.875268 sigma out 1act.( 14.6735592 sig in 9act.) RANK 3 NODE 15 --> 12.0666494 sigma out 1act.( 12.5667372 sig in 9act.) RANK 4 NODE 5 --> 9.287673 sigma out 1act.( 9.43168449 sig in 9act.) RANK 5 NODE 4 --> 7.10538387 sigma out 1act.( 8.54866028 sig in 9act.) RANK 6 NODE 3 --> 6.66067696 sigma out 1act.( 6.50737715 sig in 9act.) RANK 7 NODE 12 --> 5.44609165 sigma out 1act.( 8.647542 sig in 9act.) RANK 8 NODE 7 --> 3.55020475 sigma out 1act.( 7.61976194 sig in 9act.) RANK 9 NODE 6 --> 3.2558403 sigma out 1act.( 6.65429926 sig in 9act.) RANK 10 NODE 9 --> 2.86475539 sigma out 1act.( 8.07591534 sig in 9act.) RANK 11 NODE 1 --> 2.13535905 sigma out 1act.( 7.61149216 sig in 9act.) RANK 12 NODE 10 --> 1.6300683 sigma out 1act.( 3.92971468 sig in 9act.) RANK 13 NODE 2 --> 0.764448404 sigma out 1act.( 3.11645794 sig in 9act.) RANK 14 NODE 11 --> 0.563573301 sigma out 1act.( 2.66695118 sig in 9act.) RANK 15 NODE 13 --> 0.0495048724 sigma out 1act.( 3.43734431 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 28.1534615 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.503210723 *** contribution from regularisation: 0.00781400409 *** contribution from error: -0.511024714 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.548137605 *** contribution from regularisation: 0.00359588419 *** contribution from error: -0.551733494 *********************************************** -----------------> Test sample ENTER BFGS code START -19279.8713 -0.191485375 -0.151893452 EXIT FROM BFGS code FG_START 0. -0.191485375 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.568468273 *** contribution from regularisation: 0.0027236396 *** contribution from error: -0.571191907 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -19991.3238 -0.191485375 -17.4780426 EXIT FROM BFGS code FG_LNSRCH 0. -0.207270473 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.599361539 *** contribution from regularisation: 0.00418819208 *** contribution from error: -0.603549719 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21077.7478 -0.207270473 -21.4029179 EXIT FROM BFGS code NEW_X -21077.7478 -0.207270473 -21.4029179 ENTER BFGS code NEW_X -21077.7478 -0.207270473 -21.4029179 EXIT FROM BFGS code FG_LNSRCH 0. -0.231579781 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.60280931 *** contribution from regularisation: 0.00458843634 *** contribution from error: -0.607397735 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21198.9959 -0.231579781 -11.5302219 EXIT FROM BFGS code NEW_X -21198.9959 -0.231579781 -11.5302219 ENTER BFGS code NEW_X -21198.9959 -0.231579781 -11.5302219 EXIT FROM BFGS code FG_LNSRCH 0. -0.265213311 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.605708838 *** contribution from regularisation: 0.00455742422 *** contribution from error: -0.610266268 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21300.9619 -0.265213311 2.6030159 EXIT FROM BFGS code NEW_X -21300.9619 -0.265213311 2.6030159 ENTER BFGS code NEW_X -21300.9619 -0.265213311 2.6030159 EXIT FROM BFGS code FG_LNSRCH 0. -0.26583007 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.606124222 *** contribution from regularisation: 0.00430501206 *** contribution from error: -0.610429227 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21315.5707 -0.26583007 5.85234928 EXIT FROM BFGS code NEW_X -21315.5707 -0.26583007 5.85234928 ENTER BFGS code NEW_X -21315.5707 -0.26583007 5.85234928 EXIT FROM BFGS code FG_LNSRCH 0. -0.252310246 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.606310725 *** contribution from regularisation: 0.00399932731 *** contribution from error: -0.610310078 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21322.129 -0.252310246 5.94817591 EXIT FROM BFGS code NEW_X -21322.129 -0.252310246 5.94817591 ENTER BFGS code NEW_X -21322.129 -0.252310246 5.94817591 EXIT FROM BFGS code FG_LNSRCH 0. -0.10758929 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.570947826 *** contribution from regularisation: 0.00314268237 *** contribution from error: -0.574090481 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20078.5215 -0.10758929 -56.3812675 EXIT FROM BFGS code FG_LNSRCH 0. -0.240203246 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.7497921 sigma out 15 active outputs RANK 2 NODE 4 --> 11.907938 sigma out 15 active outputs RANK 3 NODE 1 --> 10.7700176 sigma out 15 active outputs RANK 4 NODE 9 --> 8.65761948 sigma out 15 active outputs RANK 5 NODE 6 --> 8.11665058 sigma out 15 active outputs RANK 6 NODE 8 --> 7.01342297 sigma out 15 active outputs RANK 7 NODE 5 --> 5.38864231 sigma out 15 active outputs RANK 8 NODE 3 --> 4.95795965 sigma out 15 active outputs RANK 9 NODE 7 --> 4.68236732 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 13.1302671 sigma in 9act. ( 7.46354246 sig out 1act.) RANK 2 NODE 1 --> 12.7688637 sigma in 9act. ( 7.00075626 sig out 1act.) RANK 3 NODE 7 --> 11.9278269 sigma in 9act. ( 6.66436434 sig out 1act.) RANK 4 NODE 6 --> 11.5601625 sigma in 9act. ( 6.63097811 sig out 1act.) RANK 5 NODE 4 --> 11.1102476 sigma in 9act. ( 6.53263807 sig out 1act.) RANK 6 NODE 8 --> 8.8619051 sigma in 9act. ( 4.75454426 sig out 1act.) RANK 7 NODE 15 --> 8.77292442 sigma in 9act. ( 4.68107462 sig out 1act.) RANK 8 NODE 12 --> 7.18995476 sigma in 9act. ( 3.09959126 sig out 1act.) RANK 9 NODE 5 --> 6.05974007 sigma in 9act. ( 2.80670071 sig out 1act.) RANK 10 NODE 14 --> 6.05282736 sigma in 9act. ( 1.59900224 sig out 1act.) RANK 11 NODE 3 --> 5.05681944 sigma in 9act. ( 2.19653249 sig out 1act.) RANK 12 NODE 2 --> 4.57130098 sigma in 9act. ( 1.90970862 sig out 1act.) RANK 13 NODE 10 --> 3.22138476 sigma in 9act. ( 0.473853528 sig out 1act.) RANK 14 NODE 13 --> 2.86411905 sigma in 9act. ( 0.123730682 sig out 1act.) RANK 15 NODE 11 --> 2.64878535 sigma in 9act. ( 0.456494033 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 7.46354246 sigma out 1act.( 13.1302671 sig in 9act.) RANK 2 NODE 1 --> 7.00075626 sigma out 1act.( 12.7688637 sig in 9act.) RANK 3 NODE 7 --> 6.66436434 sigma out 1act.( 11.9278269 sig in 9act.) RANK 4 NODE 6 --> 6.63097811 sigma out 1act.( 11.5601625 sig in 9act.) RANK 5 NODE 4 --> 6.53263807 sigma out 1act.( 11.1102476 sig in 9act.) RANK 6 NODE 8 --> 4.75454426 sigma out 1act.( 8.8619051 sig in 9act.) RANK 7 NODE 15 --> 4.68107462 sigma out 1act.( 8.77292442 sig in 9act.) RANK 8 NODE 12 --> 3.09959126 sigma out 1act.( 7.18995476 sig in 9act.) RANK 9 NODE 5 --> 2.80670071 sigma out 1act.( 6.05974007 sig in 9act.) RANK 10 NODE 3 --> 2.19653249 sigma out 1act.( 5.05681944 sig in 9act.) RANK 11 NODE 2 --> 1.90970862 sigma out 1act.( 4.57130098 sig in 9act.) RANK 12 NODE 14 --> 1.59900224 sigma out 1act.( 6.05282736 sig in 9act.) RANK 13 NODE 10 --> 0.473853528 sigma out 1act.( 3.22138476 sig in 9act.) RANK 14 NODE 11 --> 0.456494033 sigma out 1act.( 2.64878535 sig in 9act.) RANK 15 NODE 13 --> 0.123730682 sigma out 1act.( 2.86411905 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 17.585619 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.600817919 *** contribution from regularisation: 0.00930811651 *** contribution from error: -0.610126019 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -21128.963 -0.240203246 4.9013133 EXIT FROM BFGS code FG_LNSRCH 0. -0.252132446 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.606795073 *** contribution from regularisation: 0.00351375621 *** contribution from error: -0.610308826 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21339.1627 -0.252132446 5.75805664 EXIT FROM BFGS code FG_LNSRCH 0. -0.251966447 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.60563308 *** contribution from regularisation: 0.00467371754 *** contribution from error: -0.610306799 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21298.2975 -0.251966447 5.6705575 EXIT FROM BFGS code FG_LNSRCH 0. -0.252132297 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.605985224 *** contribution from regularisation: 0.00432361336 *** contribution from error: -0.610308826 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21310.6824 -0.252132297 5.57526398 EXIT FROM BFGS code FG_LNSRCH 0. -0.252132446 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.60594362 *** contribution from regularisation: 0.00436521834 *** contribution from error: -0.610308826 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21309.2194 -0.252132446 5.7383852 EXIT FROM BFGS code NEW_X -21309.2194 -0.252132446 5.7383852 ENTER BFGS code NEW_X -21309.2194 -0.252132446 5.7383852 EXIT FROM BFGS code CONVERGENC -21309.2194 -0.252132446 5.7383852 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 30.7389107 sigma out 15 active outputs RANK 2 NODE 4 --> 18.276022 sigma out 15 active outputs RANK 3 NODE 1 --> 17.0537319 sigma out 15 active outputs RANK 4 NODE 9 --> 11.0003042 sigma out 15 active outputs RANK 5 NODE 6 --> 10.4809027 sigma out 15 active outputs RANK 6 NODE 8 --> 9.65006351 sigma out 15 active outputs RANK 7 NODE 5 --> 8.36532116 sigma out 15 active outputs RANK 8 NODE 7 --> 6.54220581 sigma out 15 active outputs RANK 9 NODE 3 --> 6.12068176 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 19.0464344 sigma in 9act. ( 14.388833 sig out 1act.) RANK 2 NODE 1 --> 18.6471901 sigma in 9act. ( 13.7031937 sig out 1act.) RANK 3 NODE 6 --> 18.2640018 sigma in 9act. ( 13.6157608 sig out 1act.) RANK 4 NODE 7 --> 16.8129711 sigma in 9act. ( 13.4022341 sig out 1act.) RANK 5 NODE 4 --> 15.7959757 sigma in 9act. ( 12.6812649 sig out 1act.) RANK 6 NODE 8 --> 11.4384518 sigma in 9act. ( 9.85714149 sig out 1act.) RANK 7 NODE 15 --> 10.7378283 sigma in 9act. ( 9.91570187 sig out 1act.) RANK 8 NODE 12 --> 8.43421268 sigma in 9act. ( 6.94795704 sig out 1act.) RANK 9 NODE 5 --> 6.8345027 sigma in 9act. ( 6.03678656 sig out 1act.) RANK 10 NODE 3 --> 5.8396554 sigma in 9act. ( 4.49097633 sig out 1act.) RANK 11 NODE 14 --> 5.48413849 sigma in 9act. ( 3.92420006 sig out 1act.) RANK 12 NODE 2 --> 5.12387657 sigma in 9act. ( 3.73140883 sig out 1act.) RANK 13 NODE 10 --> 2.36269903 sigma in 9act. ( 0.943567216 sig out 1act.) RANK 14 NODE 13 --> 1.97941232 sigma in 9act. ( 0.236675665 sig out 1act.) RANK 15 NODE 11 --> 1.9443686 sigma in 9act. ( 0.946444333 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 14.388833 sigma out 1act.( 19.0464344 sig in 9act.) RANK 2 NODE 1 --> 13.7031937 sigma out 1act.( 18.6471901 sig in 9act.) RANK 3 NODE 6 --> 13.6157608 sigma out 1act.( 18.2640018 sig in 9act.) RANK 4 NODE 7 --> 13.4022341 sigma out 1act.( 16.8129711 sig in 9act.) RANK 5 NODE 4 --> 12.6812649 sigma out 1act.( 15.7959757 sig in 9act.) RANK 6 NODE 15 --> 9.91570187 sigma out 1act.( 10.7378283 sig in 9act.) RANK 7 NODE 8 --> 9.85714149 sigma out 1act.( 11.4384518 sig in 9act.) RANK 8 NODE 12 --> 6.94795704 sigma out 1act.( 8.43421268 sig in 9act.) RANK 9 NODE 5 --> 6.03678656 sigma out 1act.( 6.8345027 sig in 9act.) RANK 10 NODE 3 --> 4.49097633 sigma out 1act.( 5.8396554 sig in 9act.) RANK 11 NODE 14 --> 3.92420006 sigma out 1act.( 5.48413849 sig in 9act.) RANK 12 NODE 2 --> 3.73140883 sigma out 1act.( 5.12387657 sig in 9act.) RANK 13 NODE 11 --> 0.946444333 sigma out 1act.( 1.9443686 sig in 9act.) RANK 14 NODE 10 --> 0.943567216 sigma out 1act.( 2.36269903 sig in 9act.) RANK 15 NODE 13 --> 0.236675665 sigma out 1act.( 1.97941232 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 35.3860741 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.605888784 *** contribution from regularisation: 0.00442003924 *** contribution from error: -0.610308826 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25010 Closing output file done