NNInput NNInputs_195.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 176506 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 28164 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 28164 Chosen entries: 28164 Signal fraction: 1 Background fraction: 0.189859 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 28164 Entries to split: 28164 Test with : 14082 Train with : 14082 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 28164 for Signal Prepared event 0 for Signal with 28164 events ====Entry 0 Variable Ht : 225.901 Variable LepAPt : 63.638 Variable LepBPt : 23.389 Variable MetSigLeptonsJets : 9.51092 Variable MetSpec : 104.705 Variable SumEtLeptonsJets : 121.196 Variable VSumJetLeptonsPt : 96.1224 Variable addEt : 191.732 Variable dPhiLepSumMet : 2.687 Variable dPhiLeptons : 0.342211 Variable dRLeptons : 0.346978 Variable lep1_E : 71.8454 Variable lep2_E : 25.7459 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2195 Ht = 225.901 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 63.6382 LepAPt = 63.638 LepBEt = 23.389 LepBPt = 23.389 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 104.705 MetDelPhi = 2.13998 MetSig = 7.54777 MetSigLeptonsJets = 9.51092 MetSpec = 104.705 Mjj = 0 MostCentralJetEta = 2.45448 MtllMet = 197.429 Njets = 1 SB = 0 SumEt = 192.44 SumEtJets = 0 SumEtLeptonsJets = 121.196 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 96.1224 addEt = 191.732 dPhiLepSumMet = 2.687 dPhiLeptons = 0.342211 dRLeptons = 0.346978 diltype = 47 dimass = 13.3241 event = 561 jet1_Et = 34.1693 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.8454 lep2_E = 25.7459 rand = 0.999742 run = 228576 weight = 1.92787e-06 ===Show End Prepared event 10000 for Signal with 28164 events Prepared event 20000 for Signal with 28164 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.169889 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4683 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 176506 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4683 negative weights. Signal fraction: 62.0458603 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0054131 62.7101555 65.2190247 67.0041504 68.2242966 69.1881638 70.2961121 71.1743774 72.0931549 72.9927826 73.7573395 74.4014435 75.0802307 75.666687 76.4527817 77.0414429 77.6842422 78.426506 79.0586166 79.6758728 80.4368057 81.0802612 81.825943 82.6833191 83.597374 84.5342255 85.3951111 86.4705887 87.6812897 88.7835236 90.0577087 91.6276245 93.0309448 94.5702667 95.9558029 97.5715332 99.1340027 100.765503 102.39595 103.983673 105.865891 107.83374 109.375183 111.289299 113.313324 114.87442 116.753754 118.639771 120.133362 122.065979 123.631042 125.504776 127.494728 128.995697 130.431793 132.112106 133.85289 135.49826 137.204132 138.85614 140.619629 142.252609 143.899017 145.465057 147.252533 148.942841 150.856689 152.735413 154.698395 156.590179 158.529968 160.49559 162.507935 164.630371 166.552765 168.510925 170.584686 172.941772 175.16713 177.682404 180.230728 182.417694 185.245956 187.965576 190.886353 194.100067 197.801636 201.894531 205.991745 210.240585 215.472351 220.891602 226.879883 233.629578 242.503128 252.644104 265.448944 282.478271 306.562988 363.060364 850.621887 ------------------------------ Transdef: Tab for variable 3 20.0005035 20.3227844 20.6569824 20.9556999 21.2683678 21.5149364 21.8064461 22.0218658 22.2593117 22.4506302 22.6581039 22.8581238 23.0619068 23.3046131 23.5241299 23.7567673 23.9652939 24.2080212 24.4149876 24.6362343 24.8610001 25.0812359 25.2827339 25.4935093 25.7011929 25.9344749 26.1700478 26.395607 26.6274319 26.8861694 27.1264076 27.3652592 27.6315804 27.8670006 28.0784378 28.3261738 28.5860138 28.8381119 29.1047325 29.4150352 29.7231121 30.0154228 30.3400726 30.6006355 30.9490757 31.2583733 31.6216469 31.866066 32.1963997 32.578476 32.9494057 33.2705383 33.6772614 34.0846443 34.4479103 34.8738937 35.314415 35.6677094 36.1134186 36.6124725 36.988945 37.4988708 37.9155197 38.3904419 38.900177 39.3233833 39.8486328 40.3377876 40.8138657 41.2752914 41.8457451 42.515358 43.0259476 43.6095886 44.2754898 44.8629608 45.5295944 46.2034721 46.8536987 47.6335449 48.4337463 49.3156281 50.1682243 51.2595558 52.228981 53.1292763 54.2288437 55.3144989 56.5358467 57.7192078 59.1219788 60.5789452 62.1675797 63.8201752 65.6996613 67.9337769 70.8098602 73.9928894 78.3247681 88.8432007 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1173582 10.2785015 10.3761559 10.4782028 10.602417 10.7370176 10.844202 10.9677715 11.0949745 11.2458763 11.3907385 11.515152 11.6749344 11.7977629 11.9544373 12.0839148 12.226757 12.4046135 12.5524912 12.7175999 12.8995066 13.0963058 13.2812328 13.469656 13.6241837 13.784565 13.9211617 14.1038265 14.3023243 14.4729071 14.685029 14.8992929 15.123024 15.327343 15.5090828 15.7126255 15.9409103 16.1364899 16.3719997 16.5878105 16.7895699 16.997282 17.2129021 17.4548645 17.6951637 17.9116802 18.0887718 18.3471146 18.5659714 18.7807121 19.0158463 19.2400417 19.4568119 19.6851425 19.9194374 20.1336899 20.3005943 20.4920578 20.7003326 20.921608 21.1296234 21.3488808 21.5581532 21.7773685 21.9717102 22.1379967 22.369318 22.5810738 22.8105373 23.0578804 23.2782001 23.5063744 23.7749386 24.0197639 24.2907963 24.5543938 24.8287621 25.1473141 25.4265823 25.7139015 26.0228367 26.3390903 26.6936226 27.0320892 27.3720131 27.8139572 28.2032318 28.667057 29.1091728 29.6659622 30.2061405 30.839098 31.5520515 32.2706642 33.1994781 34.385376 36.0144539 38.3549919 42.9304962 86.878418 ------------------------------ Transdef: Tab for variable 5 1.14696336 2.72594976 3.1348877 3.4573431 3.76811743 4.02076864 4.18083286 4.3054533 4.42600346 4.53089237 4.63226843 4.72551298 4.81298637 4.90723133 4.98854923 5.0656848 5.14242077 5.20911312 5.28068304 5.33577919 5.39742947 5.45387268 5.51256847 5.55695438 5.61000443 5.66593981 5.72025299 5.77145386 5.82202959 5.86641979 5.9120388 5.96029377 6.00487947 6.04932785 6.10120201 6.14237738 6.19338989 6.23231077 6.27421045 6.31405973 6.36194801 6.40683365 6.44922256 6.48899364 6.5303483 6.58038807 6.62716818 6.66598654 6.71813631 6.76107788 6.80732632 6.85344362 6.90593338 6.96414661 7.01708603 7.07472038 7.12977886 7.18206215 7.23773956 7.28569984 7.34019518 7.39668894 7.44590425 7.49256372 7.54930782 7.60925198 7.66554308 7.73353624 7.80001259 7.86613417 7.93070316 7.99168015 8.05924416 8.11911678 8.18034172 8.24375916 8.31222725 8.38188362 8.44118881 8.50826836 8.57554626 8.65722656 8.7286911 8.80827522 8.87734795 8.95711422 9.04316902 9.14211273 9.24872208 9.34662437 9.44728661 9.55942822 9.68833542 9.83734131 10.0239706 10.2412977 10.472477 10.8216991 11.3712292 12.3671551 17.6440296 ------------------------------ Transdef: Tab for variable 6 15.0119848 22.6012306 25.7155342 26.7642632 27.6280594 28.690834 29.4999752 30.3058853 31.1192684 31.7471371 32.2984467 32.863205 33.3775711 33.8509941 34.358448 34.7294312 35.0257149 35.5004921 35.9161224 36.3376846 36.6401138 37.0053406 37.4301834 37.806633 38.1696777 38.5746841 38.9239388 39.3751907 39.8027267 40.2077026 40.5964394 40.9370995 41.3652344 41.821991 42.3059464 42.824028 43.1892433 43.701683 44.0031166 44.5654221 45.1217079 45.783371 46.4615288 47.1396484 47.7208672 48.4350967 49.1908455 49.782692 50.4127426 51.0536003 51.8541641 52.6841774 53.4201698 54.2462425 55.0800476 55.8442383 56.6495285 57.3975677 58.2129288 58.8315811 59.68396 60.5618134 61.3546753 62.1437759 62.983448 63.8578033 64.6905823 65.5075531 66.318985 67.1556702 68.1048431 68.9535065 69.8004608 70.691246 71.5985413 72.5170364 73.4464569 74.4412079 75.407547 76.4328918 77.1130524 78.1497955 79.1593475 80.3830261 81.6265106 82.86866 84.0883865 85.4891052 86.9818726 88.5324249 90.3749847 92.0019226 94.2001801 96.4925079 99.1815491 102.379913 106.553543 112.135468 120.680481 134.985229 280.646332 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.6105118 33.5728226 34.2139282 34.835434 35.3338203 35.813427 36.2956238 36.7353821 37.1541748 37.5031281 37.8179512 38.1815567 38.4961243 38.7640038 39.0336151 39.3279495 39.6434326 39.9314041 40.2504539 40.588253 40.9811859 41.3948784 41.7643852 42.1842575 42.6130829 43.0620956 43.7337418 44.4517403 45.0413666 45.679306 46.5354958 47.4682617 48.4953842 49.4057159 50.4723892 51.5014839 52.6370163 53.589119 54.7048874 55.7477112 56.8127594 57.7805328 58.8062744 59.6615677 60.5916061 61.3432465 62.2739906 63.2497559 64.1519012 65.0654449 66.0950165 67.01371 67.9403763 68.8651123 69.8802338 70.8581696 71.7063599 72.6776123 73.6949005 74.6824341 75.8758392 76.8418503 77.9752197 79.1945038 80.331543 81.6825104 82.9272461 84.1480484 85.4772186 86.7487946 88.0332336 89.475502 91.1579437 92.6911774 94.2197876 95.9262924 97.7274246 99.6997986 101.501709 103.538452 105.609756 107.909882 110.150238 112.450439 115.255844 118.131744 121.37571 125.116959 128.820984 132.983444 137.489777 142.5 148.13446 153.928253 162.097672 173.034393 185.681137 209.075714 247.179138 527.622864 ------------------------------ Transdef: Tab for variable 8 3.10723281 26.4259243 30.0288181 31.6034546 32.4904556 32.989975 33.5432358 34.0393372 34.3909264 34.8317947 35.223774 35.616394 35.982605 36.3418236 36.6528587 36.9653282 37.2523537 37.5623016 37.8276672 38.1316681 38.3919525 38.6301498 38.8854065 39.1748962 39.4379196 39.7089386 39.9923859 40.3466377 40.6748924 41.0174866 41.3427429 41.7636375 42.2119446 42.6454849 43.0533905 43.5644455 43.9856682 44.4718018 45.1248474 45.7200203 46.4510841 47.145874 47.8435287 48.4234695 49.075592 49.6620903 50.4181519 51.1406784 52.0084229 52.7658691 53.3889275 54.0866013 54.8920059 55.6315231 56.4663925 57.1766739 58.00811 58.6941757 59.3097343 60.1212616 60.9041367 61.4700775 62.2288513 62.8980484 63.6397057 64.4054947 65.2088165 65.9428558 66.650856 67.4167938 68.1239243 68.9526596 69.7882996 70.5933838 71.4326935 72.1761475 73.0184631 73.936554 74.9589996 75.829834 76.8221512 77.764328 78.7566452 79.9037933 81.1583557 82.3566666 83.6876144 85.0275574 86.4205933 87.9456482 89.8146896 91.8851089 93.9923096 96.6291504 99.5166321 103.18145 108.238693 114.120453 124.614563 144.352661 363.807129 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.4853973 64.6157379 66.5189972 67.6105347 68.6103973 69.669075 70.5478134 71.3083191 72.1583405 72.9915771 73.7019958 74.3200836 74.9120255 75.4048004 75.9679871 76.6542969 77.0716553 77.6314392 78.3041534 78.8205872 79.384613 79.8675461 80.567276 81.1545029 81.8024139 82.583046 83.3299408 84.0922546 84.7821808 85.6049271 86.507309 87.4160156 88.4311447 89.3588562 90.4793625 91.838707 92.9788208 94.202301 95.5263748 96.8675308 98.4013367 99.5642853 100.911972 102.341187 103.896042 105.347961 106.845734 108.2677 109.764023 111.276642 112.860001 114.272141 115.873428 117.224686 118.6539 119.742004 121.17041 122.431808 123.885483 125.286331 126.730377 127.975113 129.181412 130.384842 131.746201 132.947937 134.127258 135.320251 136.573944 137.784454 139.006241 140.207993 141.628464 142.830383 144.230499 145.429428 146.803406 148.328766 149.734131 151.33873 152.752991 154.320648 155.946716 157.7061 159.324265 161.152374 163.252075 165.344986 167.402847 169.455383 172.056519 174.42923 177.632111 180.714661 184.907944 189.43956 194.866058 204.822723 237.455795 582.80835 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.924980223 1.30110955 1.53363824 1.70989561 1.84220815 1.94592214 2.03570318 2.11635947 2.18382144 2.2418263 2.29414463 2.33713841 2.37606573 2.41972971 2.45614195 2.48746443 2.52060652 2.55151749 2.57795095 2.60464525 2.62916327 2.65529203 2.67721152 2.69809723 2.71719742 2.73664832 2.7552352 2.77178621 2.7878933 2.80244589 2.81638837 2.82867861 2.84020972 2.85072279 2.85912967 2.86934352 2.87871933 2.88890219 2.89684916 2.9048872 2.91321731 2.91936636 2.92724991 2.9353466 2.94309807 2.95048714 2.95727491 2.96399069 2.97050762 2.97615409 2.98093748 2.98771477 2.99244642 2.99761295 3.00237226 3.00666332 3.01213121 3.01665044 3.02167702 3.02603769 3.02961016 3.03385353 3.03723812 3.04099464 3.04479599 3.04861569 3.05223703 3.0559659 3.05880022 3.06230879 3.06577492 3.06870413 3.0719986 3.07458377 3.07758999 3.08071327 3.08361197 3.08635187 3.08936667 3.09231806 3.09523034 3.09776092 3.10041142 3.10334635 3.10563612 3.10855103 3.11149502 3.11385918 3.11615705 3.11861277 3.12101483 3.12333298 3.12582302 3.12821102 3.13031125 3.13223362 3.1343255 3.13653231 3.13892937 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00533723878 0.0111572146 0.0165155884 0.0225834306 0.0281404238 0.0341911912 0.0405930318 0.0470731705 0.0531798005 0.0599911213 0.0658449233 0.0717356205 0.0772627667 0.0842581987 0.0908490419 0.096768856 0.102158621 0.10746792 0.111552 0.116769314 0.122663736 0.128031731 0.133970618 0.139577806 0.144598097 0.150199249 0.155614853 0.160252109 0.165813327 0.171440601 0.177265525 0.183031827 0.187715888 0.193240285 0.199438155 0.204543293 0.209709764 0.214245528 0.219923884 0.225418568 0.230357766 0.235318661 0.240692556 0.246333003 0.25182569 0.256970823 0.261591911 0.266627789 0.271746993 0.277252734 0.28125602 0.288285196 0.293708265 0.299475133 0.305112839 0.311060071 0.316493154 0.322591811 0.32855165 0.334109843 0.340136468 0.345799685 0.351594567 0.358323336 0.364777386 0.370727658 0.376623392 0.383917987 0.388900459 0.395021677 0.40114069 0.408977985 0.415725946 0.422160387 0.428902984 0.436856389 0.444151014 0.452304602 0.461520493 0.470011532 0.478438914 0.488985181 0.498267472 0.508321524 0.517851412 0.527423143 0.539795578 0.547650874 0.558953762 0.573675632 0.590781689 0.606055796 0.625703335 0.644906282 0.666787982 0.692653298 0.723437786 0.768584371 0.822230458 1.11657131 ------------------------------ Transdef: Tab for variable 12 0.100055709 0.119534299 0.137473136 0.151035666 0.163270503 0.173111379 0.18440789 0.195677772 0.204081804 0.213353157 0.220958322 0.228231996 0.235997945 0.243826151 0.250745118 0.258115172 0.264010608 0.270370364 0.276663393 0.281960577 0.288658917 0.294574827 0.300163358 0.306630135 0.312555015 0.318511903 0.324356407 0.32924816 0.335528553 0.34132722 0.346918523 0.351753473 0.358014405 0.363761604 0.369717956 0.375068367 0.380981237 0.386542022 0.392277598 0.397746205 0.402243793 0.406557202 0.410900384 0.414788723 0.419160277 0.422934651 0.427103043 0.431038141 0.435617596 0.439511418 0.444054306 0.447887123 0.452706903 0.457185328 0.461597174 0.465481967 0.470413268 0.474521041 0.47807461 0.481846362 0.48658675 0.491707444 0.496622294 0.501671553 0.506967843 0.512777686 0.519070268 0.524496794 0.530115247 0.536470413 0.542384624 0.547421694 0.552533567 0.558147669 0.56413269 0.569847465 0.577055633 0.583881319 0.590297341 0.597527564 0.604353786 0.612337589 0.621396303 0.630292535 0.640527308 0.650794923 0.66165483 0.671322465 0.681224763 0.694004416 0.705981374 0.720147371 0.732941628 0.747592568 0.759904385 0.779141545 0.798173964 0.82548368 0.86005801 0.905236959 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0123215 21.468071 22.3515739 23.0504913 23.6251984 24.1399193 24.6794472 25.1095428 25.5188828 25.9492321 26.4027863 26.8575287 27.2389984 27.6149178 28.0460548 28.4692535 28.8194199 29.1819878 29.5568676 29.8773804 30.2202473 30.5640697 30.9213848 31.2746544 31.7067261 32.0552559 32.3927917 32.7732468 33.1905212 33.5732574 33.9655609 34.3954887 34.7285919 35.144001 35.5187454 35.9811974 36.2745819 36.6971397 37.1249313 37.5158348 37.9290619 38.3528137 38.7839279 39.15382 39.6474838 40.1445999 40.6141586 41.107048 41.5919495 42.0791588 42.6181183 43.0649414 43.5394249 44.0593109 44.6565704 45.2287674 45.8425446 46.3613396 46.883667 47.4217148 47.9872437 48.5575981 49.1468773 49.7219391 50.3635101 50.9359589 51.5689545 52.2780762 52.9638138 53.754776 54.479126 55.1238861 55.7940598 56.6693115 57.4515305 58.2197418 59.0777359 60.0286331 60.8996964 61.9173737 62.9149094 63.9588089 64.9164429 66.0127411 67.0088196 68.1423798 69.1515656 70.4636765 71.8514786 73.2498474 74.9786987 77.0422592 79.2038879 81.3471527 84.3530121 87.5984421 90.2878799 94.5348358 100.81218 112.951416 381.504089 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7269821 11.2050247 11.5549335 11.9015293 12.2500458 12.4767857 12.7870474 13.0881224 13.4137201 13.6979408 13.9787922 14.235693 14.5085974 14.7739906 15.0801859 15.3704052 15.6543217 15.90977 16.2017937 16.4196281 16.7112656 16.9594612 17.2498608 17.5901146 17.8274193 18.0681152 18.2807732 18.566658 18.7981148 19.0608482 19.3176727 19.5658989 19.832737 20.0693169 20.3331299 20.5964928 20.8329468 21.0739098 21.2931175 21.5618134 21.7540073 21.9816723 22.204113 22.4499817 22.6960907 22.9403992 23.182827 23.4103088 23.6146278 23.826498 24.0857162 24.3486156 24.551899 24.8339233 25.0699692 25.318882 25.5251236 25.7740993 26.0371742 26.2931633 26.5428658 26.806736 27.0775642 27.3341904 27.605751 27.8928051 28.0836391 28.3572426 28.6223869 28.9554062 29.2851105 29.6214218 29.9685669 30.3005066 30.6879044 31.0393009 31.4033394 31.7612247 32.1484222 32.6099472 33.1018333 33.4890938 33.9899826 34.4547882 35.0323792 35.5905151 36.2074394 36.957386 37.7233391 38.5933533 39.5417862 40.6129341 41.8692017 43.2108879 44.7251587 46.8404083 49.5678406 53.404007 60.568203 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.0 52.4 52.5 29.8 50.4 63.1 55.0 63.4 -26.2 -13.9 -26.1 25.6 25.3 2 65.0 100.0 71.0 57.3 41.3 71.6 94.9 78.9 93.0 -43.8 -21.5 -38.5 45.8 32.9 3 52.4 71.0 100.0 44.6 21.7 45.5 72.3 63.1 78.7 -12.7 -24.9 -44.6 74.3 24.6 4 52.5 57.3 44.6 100.0 12.7 34.3 59.9 48.2 60.0 -15.0 -26.9 -46.8 25.8 72.7 5 29.8 41.3 21.7 12.7 100.0 84.2 15.9 61.1 60.4 19.8 -8.0 -12.2 9.6 1.7 6 50.4 71.6 45.5 34.3 84.2 100.0 52.6 80.6 81.2 -8.0 -15.4 -26.0 25.7 15.5 7 63.1 94.9 72.3 59.9 15.9 52.6 100.0 71.7 82.8 -52.1 -20.0 -37.6 48.3 36.4 8 55.0 78.9 63.1 48.2 61.1 80.6 71.7 100.0 86.1 -13.6 -22.0 -36.0 41.2 27.3 9 63.4 93.0 78.7 60.0 60.4 81.2 82.8 86.1 100.0 -20.8 -24.8 -44.1 52.7 34.9 10 -26.2 -43.8 -12.7 -15.0 19.8 -8.0 -52.1 -13.6 -20.8 100.0 0.5 3.9 -5.6 -8.4 11 -13.9 -21.5 -24.9 -26.9 -8.0 -15.4 -20.0 -22.0 -24.8 0.5 100.0 60.1 -13.1 -15.7 12 -26.1 -38.5 -44.6 -46.8 -12.2 -26.0 -37.6 -36.0 -44.1 3.9 60.1 100.0 -23.9 -22.7 13 25.6 45.8 74.3 25.8 9.6 25.7 48.3 41.2 52.7 -5.6 -13.1 -23.9 100.0 44.9 14 25.3 32.9 24.6 72.7 1.7 15.5 36.4 27.3 34.9 -8.4 -15.7 -22.7 44.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 164.442866 TOTAL CORRELATION OF ALL VARIABLES 71.6443583 ROUND 1: MAX CORR ( 71.6440462) AFTER KILLING INPUT VARIABLE 11 CONTR 0.21146118 ROUND 2: MAX CORR ( 71.6259992) AFTER KILLING INPUT VARIABLE 8 CONTR 1.60797923 ROUND 3: MAX CORR ( 71.53105) AFTER KILLING INPUT VARIABLE 2 CONTR 3.68682078 ROUND 4: MAX CORR ( 71.3664114) AFTER KILLING INPUT VARIABLE 14 CONTR 4.85040592 ROUND 5: MAX CORR ( 71.1717182) AFTER KILLING INPUT VARIABLE 10 CONTR 5.26794055 ROUND 6: MAX CORR ( 70.9173702) AFTER KILLING INPUT VARIABLE 6 CONTR 6.01166221 ROUND 7: MAX CORR ( 70.5259679) AFTER KILLING INPUT VARIABLE 12 CONTR 7.44051395 ROUND 8: MAX CORR ( 69.9855295) AFTER KILLING INPUT VARIABLE 9 CONTR 8.71423047 ROUND 9: MAX CORR ( 68.8257233) AFTER KILLING INPUT VARIABLE 13 CONTR 12.688347 ROUND 10: MAX CORR ( 68.5079821) AFTER KILLING INPUT VARIABLE 3 CONTR 6.60579899 ROUND 11: MAX CORR ( 66.2007537) AFTER KILLING INPUT VARIABLE 4 CONTR 17.6296289 ROUND 12: MAX CORR ( 63.0831234) AFTER KILLING INPUT VARIABLE 5 CONTR 20.0763376 LAST REMAINING VARIABLE: 7 total correlation to target: 71.6443583 % total significance: 108.037297 sigma correlations of single variables to target: variable 2: 64.9580832 % , in sigma: 97.954618 variable 3: 52.4235721 % , in sigma: 79.0529942 variable 4: 52.5179314 % , in sigma: 79.1952849 variable 5: 29.8474239 % , in sigma: 45.0089174 variable 6: 50.3974783 % , in sigma: 75.9977125 variable 7: 63.0831234 % , in sigma: 95.1272412 variable 8: 55.0146595 % , in sigma: 82.9602673 variable 9: 63.3978841 % , in sigma: 95.6018898 variable 10: -26.2372231 % , in sigma: 39.5648553 variable 11: -13.9455618 % , in sigma: 21.0294409 variable 12: -26.13574 % , in sigma: 39.4118222 variable 13: 25.5871506 % , in sigma: 38.5845677 variable 14: 25.2731159 % , in sigma: 38.1110138 variables sorted by significance: 1 most relevant variable 7 corr 63.0831223 , in sigma: 95.1272395 2 most relevant variable 5 corr 20.0763378 , in sigma: 30.2744463 3 most relevant variable 4 corr 17.6296291 , in sigma: 26.5848914 4 most relevant variable 3 corr 6.6057992 , in sigma: 9.96132436 5 most relevant variable 13 corr 12.6883469 , in sigma: 19.1336029 6 most relevant variable 9 corr 8.71423054 , in sigma: 13.1407683 7 most relevant variable 12 corr 7.44051409 , in sigma: 11.2200465 8 most relevant variable 6 corr 6.01166201 , in sigma: 9.06538534 9 most relevant variable 10 corr 5.26794052 , in sigma: 7.9438782 10 most relevant variable 14 corr 4.85040569 , in sigma: 7.31424964 11 most relevant variable 2 corr 3.68682075 , in sigma: 5.55960243 12 most relevant variable 8 corr 1.60797918 , in sigma: 2.42477885 13 most relevant variable 11 corr 0.211461186 , in sigma: 0.3188764 global correlations between input variables: variable 2: 99.2900541 % variable 3: 94.6798521 % variable 4: 91.4077281 % variable 5: 95.3260338 % variable 6: 94.2389366 % variable 7: 98.8939361 % variable 8: 91.6104468 % variable 9: 99.0441241 % variable 10: 72.0081642 % variable 11: 60.876033 % variable 12: 72.1629155 % variable 13: 88.6137894 % variable 14: 88.0365812 % significance loss when removing single variables: variable 2: corr = 2.61359182 % , sigma = 3.9412091 variable 3: corr = 14.0767427 % , sigma = 21.2272574 variable 4: corr = 17.2328473 % , sigma = 25.9865577 variable 5: corr = 8.91566618 % , sigma = 13.4445266 variable 6: corr = 5.1965046 % , sigma = 7.83615522 variable 7: corr = 5.06764773 % , sigma = 7.64184337 variable 8: corr = 1.58944926 % , sigma = 2.39683635 variable 9: corr = 8.22111258 % , sigma = 12.3971629 variable 10: corr = 4.3683268 % , sigma = 6.58729078 variable 11: corr = 0.21146118 % , sigma = 0.318876391 variable 12: corr = 6.56139961 % , sigma = 9.89437126 variable 13: corr = 5.41026337 % , sigma = 8.15849629 variable 14: corr = 4.81135573 % , sigma = 7.2553636 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 16.3075352 sigma out 15 active outputs RANK 2 NODE 8 --> 15.7595425 sigma out 15 active outputs RANK 3 NODE 7 --> 15.4756517 sigma out 15 active outputs RANK 4 NODE 5 --> 13.9508858 sigma out 15 active outputs RANK 5 NODE 6 --> 13.9385662 sigma out 15 active outputs RANK 6 NODE 3 --> 13.5230455 sigma out 15 active outputs RANK 7 NODE 12 --> 12.8559256 sigma out 15 active outputs RANK 8 NODE 11 --> 12.2718058 sigma out 15 active outputs RANK 9 NODE 10 --> 11.5376368 sigma out 15 active outputs RANK 10 NODE 2 --> 11.2834835 sigma out 15 active outputs RANK 11 NODE 1 --> 10.8883028 sigma out 15 active outputs RANK 12 NODE 4 --> 10.6589041 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 26.5745602 sigma in 12act. ( 28.1634159 sig out 1act.) RANK 2 NODE 8 --> 21.3732662 sigma in 12act. ( 21.760313 sig out 1act.) RANK 3 NODE 10 --> 14.279707 sigma in 12act. ( 15.5637426 sig out 1act.) RANK 4 NODE 7 --> 12.2071104 sigma in 12act. ( 12.2711334 sig out 1act.) RANK 5 NODE 12 --> 11.7090158 sigma in 12act. ( 11.3516817 sig out 1act.) RANK 6 NODE 4 --> 11.5429907 sigma in 12act. ( 12.7362967 sig out 1act.) RANK 7 NODE 1 --> 9.63072681 sigma in 12act. ( 10.687273 sig out 1act.) RANK 8 NODE 14 --> 9.1835022 sigma in 12act. ( 9.01700115 sig out 1act.) RANK 9 NODE 9 --> 8.06858063 sigma in 12act. ( 7.39739132 sig out 1act.) RANK 10 NODE 3 --> 6.63839531 sigma in 12act. ( 6.67351627 sig out 1act.) RANK 11 NODE 13 --> 4.37665462 sigma in 12act. ( 5.63624001 sig out 1act.) RANK 12 NODE 6 --> 4.25057364 sigma in 12act. ( 2.82593012 sig out 1act.) RANK 13 NODE 2 --> 3.99982429 sigma in 12act. ( 3.12502384 sig out 1act.) RANK 14 NODE 15 --> 2.25180531 sigma in 12act. ( 2.44751334 sig out 1act.) RANK 15 NODE 5 --> 1.79248607 sigma in 12act. ( 1.98299003 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 28.1634159 sigma out 1act.( 26.5745602 sig in 12act.) RANK 2 NODE 8 --> 21.760313 sigma out 1act.( 21.3732662 sig in 12act.) RANK 3 NODE 10 --> 15.5637426 sigma out 1act.( 14.279707 sig in 12act.) RANK 4 NODE 4 --> 12.7362967 sigma out 1act.( 11.5429907 sig in 12act.) RANK 5 NODE 7 --> 12.2711334 sigma out 1act.( 12.2071104 sig in 12act.) RANK 6 NODE 12 --> 11.3516817 sigma out 1act.( 11.7090158 sig in 12act.) RANK 7 NODE 1 --> 10.687273 sigma out 1act.( 9.63072681 sig in 12act.) RANK 8 NODE 14 --> 9.01700115 sigma out 1act.( 9.1835022 sig in 12act.) RANK 9 NODE 9 --> 7.39739132 sigma out 1act.( 8.06858063 sig in 12act.) RANK 10 NODE 3 --> 6.67351627 sigma out 1act.( 6.63839531 sig in 12act.) RANK 11 NODE 13 --> 5.63624001 sigma out 1act.( 4.37665462 sig in 12act.) RANK 12 NODE 2 --> 3.12502384 sigma out 1act.( 3.99982429 sig in 12act.) RANK 13 NODE 6 --> 2.82593012 sigma out 1act.( 4.25057364 sig in 12act.) RANK 14 NODE 15 --> 2.44751334 sigma out 1act.( 2.25180531 sig in 12act.) RANK 15 NODE 5 --> 1.98299003 sigma out 1act.( 1.79248607 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 48.0082932 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 25.3870716 sigma out 15 active outputs RANK 2 NODE 8 --> 17.1490059 sigma out 15 active outputs RANK 3 NODE 9 --> 16.769268 sigma out 15 active outputs RANK 4 NODE 7 --> 16.1312656 sigma out 15 active outputs RANK 5 NODE 5 --> 14.6770048 sigma out 15 active outputs RANK 6 NODE 6 --> 14.0049114 sigma out 15 active outputs RANK 7 NODE 3 --> 13.5813618 sigma out 15 active outputs RANK 8 NODE 1 --> 13.0164518 sigma out 15 active outputs RANK 9 NODE 10 --> 12.4046516 sigma out 15 active outputs RANK 10 NODE 11 --> 12.3385363 sigma out 15 active outputs RANK 11 NODE 4 --> 12.0874186 sigma out 15 active outputs RANK 12 NODE 2 --> 11.842062 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 24.3431606 sigma in 12act. ( 24.8630867 sig out 1act.) RANK 2 NODE 8 --> 20.7023144 sigma in 12act. ( 20.6386471 sig out 1act.) RANK 3 NODE 10 --> 17.9865761 sigma in 12act. ( 16.1252117 sig out 1act.) RANK 4 NODE 4 --> 16.8551025 sigma in 12act. ( 14.0712862 sig out 1act.) RANK 5 NODE 5 --> 13.8344097 sigma in 12act. ( 6.71063805 sig out 1act.) RANK 6 NODE 15 --> 11.8876562 sigma in 12act. ( 5.6645155 sig out 1act.) RANK 7 NODE 7 --> 11.8755121 sigma in 12act. ( 10.7699585 sig out 1act.) RANK 8 NODE 13 --> 11.7956209 sigma in 12act. ( 8.35450268 sig out 1act.) RANK 9 NODE 1 --> 11.7843752 sigma in 12act. ( 10.5140438 sig out 1act.) RANK 10 NODE 12 --> 11.5110893 sigma in 12act. ( 9.79537773 sig out 1act.) RANK 11 NODE 14 --> 10.4817467 sigma in 12act. ( 7.97131538 sig out 1act.) RANK 12 NODE 9 --> 8.53674126 sigma in 12act. ( 6.68955994 sig out 1act.) RANK 13 NODE 2 --> 7.85269594 sigma in 12act. ( 3.2827642 sig out 1act.) RANK 14 NODE 6 --> 7.55671453 sigma in 12act. ( 2.52437854 sig out 1act.) RANK 15 NODE 3 --> 4.83315516 sigma in 12act. ( 4.20341206 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 24.8630867 sigma out 1act.( 24.3431606 sig in 12act.) RANK 2 NODE 8 --> 20.6386471 sigma out 1act.( 20.7023144 sig in 12act.) RANK 3 NODE 10 --> 16.1252117 sigma out 1act.( 17.9865761 sig in 12act.) RANK 4 NODE 4 --> 14.0712862 sigma out 1act.( 16.8551025 sig in 12act.) RANK 5 NODE 7 --> 10.7699585 sigma out 1act.( 11.8755121 sig in 12act.) RANK 6 NODE 1 --> 10.5140438 sigma out 1act.( 11.7843752 sig in 12act.) RANK 7 NODE 12 --> 9.79537773 sigma out 1act.( 11.5110893 sig in 12act.) RANK 8 NODE 13 --> 8.35450268 sigma out 1act.( 11.7956209 sig in 12act.) RANK 9 NODE 14 --> 7.97131538 sigma out 1act.( 10.4817467 sig in 12act.) RANK 10 NODE 5 --> 6.71063805 sigma out 1act.( 13.8344097 sig in 12act.) RANK 11 NODE 9 --> 6.68955994 sigma out 1act.( 8.53674126 sig in 12act.) RANK 12 NODE 15 --> 5.6645155 sigma out 1act.( 11.8876562 sig in 12act.) RANK 13 NODE 3 --> 4.20341206 sigma out 1act.( 4.83315516 sig in 12act.) RANK 14 NODE 2 --> 3.2827642 sigma out 1act.( 7.85269594 sig in 12act.) RANK 15 NODE 6 --> 2.52437854 sigma out 1act.( 7.55671453 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 45.9854736 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.527061999 *** contribution from regularisation: 0.00576563133 *** contribution from error: -0.532827616 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.579973638 *** contribution from regularisation: 0.00258658011 *** contribution from error: -0.582560241 *********************************************** -----------------> Test sample ENTER BFGS code START -51193.2409 -0.111422256 -0.0380828455 EXIT FROM BFGS code FG_START 0. -0.111422256 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.601077139 *** contribution from regularisation: 0.00231401366 *** contribution from error: -0.603391171 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -53046.8591 -0.111422256 -19.1773262 EXIT FROM BFGS code FG_LNSRCH 0. -0.137243629 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.600522339 *** contribution from regularisation: 0.00307466812 *** contribution from error: -0.603596985 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52997.8962 -0.137243629 7.5086484 EXIT FROM BFGS code FG_LNSRCH 0. -0.122646265 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.604444444 *** contribution from regularisation: 0.00281685777 *** contribution from error: -0.6072613 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53344.0347 -0.122646265 -9.47522736 EXIT FROM BFGS code NEW_X -53344.0347 -0.122646265 -9.47522736 ENTER BFGS code NEW_X -53344.0347 -0.122646265 -9.47522736 EXIT FROM BFGS code FG_LNSRCH 0. -0.128584012 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.605050623 *** contribution from regularisation: 0.00281375065 *** contribution from error: -0.60786438 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53397.5328 -0.128584012 -6.00338078 EXIT FROM BFGS code NEW_X -53397.5328 -0.128584012 -6.00338078 ENTER BFGS code NEW_X -53397.5328 -0.128584012 -6.00338078 EXIT FROM BFGS code FG_LNSRCH 0. -0.150680736 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.605531931 *** contribution from regularisation: 0.0027368546 *** contribution from error: -0.608268797 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53440.0118 -0.150680736 4.96178627 EXIT FROM BFGS code NEW_X -53440.0118 -0.150680736 4.96178627 ENTER BFGS code NEW_X -53440.0118 -0.150680736 4.96178627 EXIT FROM BFGS code FG_LNSRCH 0. -0.146548167 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.60609901 *** contribution from regularisation: 0.0027842368 *** contribution from error: -0.608883262 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53490.0542 -0.146548167 0.614461303 EXIT FROM BFGS code NEW_X -53490.0542 -0.146548167 0.614461303 ENTER BFGS code NEW_X -53490.0542 -0.146548167 0.614461303 EXIT FROM BFGS code FG_LNSRCH 0. -0.150363818 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.606577456 *** contribution from regularisation: 0.00264379033 *** contribution from error: -0.60922122 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53532.2776 -0.150363818 -0.981086612 EXIT FROM BFGS code NEW_X -53532.2776 -0.150363818 -0.981086612 ENTER BFGS code NEW_X -53532.2776 -0.150363818 -0.981086612 EXIT FROM BFGS code FG_LNSRCH 0. -0.174033597 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 24.7683029 sigma out 15 active outputs RANK 2 NODE 9 --> 11.6934671 sigma out 15 active outputs RANK 3 NODE 1 --> 11.6664114 sigma out 15 active outputs RANK 4 NODE 10 --> 9.87933064 sigma out 15 active outputs RANK 5 NODE 7 --> 9.06426239 sigma out 15 active outputs RANK 6 NODE 8 --> 8.37912178 sigma out 15 active outputs RANK 7 NODE 2 --> 8.16821289 sigma out 15 active outputs RANK 8 NODE 6 --> 6.65460682 sigma out 15 active outputs RANK 9 NODE 4 --> 6.61219025 sigma out 15 active outputs RANK 10 NODE 5 --> 5.94657755 sigma out 15 active outputs RANK 11 NODE 3 --> 4.83810043 sigma out 15 active outputs RANK 12 NODE 11 --> 4.27487946 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 17.6610241 sigma in 12act. ( 14.9598789 sig out 1act.) RANK 2 NODE 10 --> 15.7557278 sigma in 12act. ( 13.2406673 sig out 1act.) RANK 3 NODE 13 --> 12.3897772 sigma in 12act. ( 11.6157331 sig out 1act.) RANK 4 NODE 8 --> 11.5074987 sigma in 12act. ( 12.4304752 sig out 1act.) RANK 5 NODE 4 --> 11.2917099 sigma in 12act. ( 8.66207027 sig out 1act.) RANK 6 NODE 11 --> 10.7391129 sigma in 12act. ( 11.0762119 sig out 1act.) RANK 7 NODE 15 --> 9.25000668 sigma in 12act. ( 7.52711487 sig out 1act.) RANK 8 NODE 1 --> 6.8992672 sigma in 12act. ( 5.05742168 sig out 1act.) RANK 9 NODE 2 --> 6.16865206 sigma in 12act. ( 5.48405266 sig out 1act.) RANK 10 NODE 9 --> 5.64913702 sigma in 12act. ( 4.05862427 sig out 1act.) RANK 11 NODE 7 --> 4.99946499 sigma in 12act. ( 4.05757713 sig out 1act.) RANK 12 NODE 12 --> 4.00072861 sigma in 12act. ( 1.94886029 sig out 1act.) RANK 13 NODE 6 --> 3.73189044 sigma in 12act. ( 1.7809931 sig out 1act.) RANK 14 NODE 14 --> 3.6334877 sigma in 12act. ( 0.844425261 sig out 1act.) RANK 15 NODE 3 --> 2.80690145 sigma in 12act. ( 2.53030539 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 14.9598789 sigma out 1act.( 17.6610241 sig in 12act.) RANK 2 NODE 10 --> 13.2406673 sigma out 1act.( 15.7557278 sig in 12act.) RANK 3 NODE 8 --> 12.4304752 sigma out 1act.( 11.5074987 sig in 12act.) RANK 4 NODE 13 --> 11.6157331 sigma out 1act.( 12.3897772 sig in 12act.) RANK 5 NODE 11 --> 11.0762119 sigma out 1act.( 10.7391129 sig in 12act.) RANK 6 NODE 4 --> 8.66207027 sigma out 1act.( 11.2917099 sig in 12act.) RANK 7 NODE 15 --> 7.52711487 sigma out 1act.( 9.25000668 sig in 12act.) RANK 8 NODE 2 --> 5.48405266 sigma out 1act.( 6.16865206 sig in 12act.) RANK 9 NODE 1 --> 5.05742168 sigma out 1act.( 6.8992672 sig in 12act.) RANK 10 NODE 9 --> 4.05862427 sigma out 1act.( 5.64913702 sig in 12act.) RANK 11 NODE 7 --> 4.05757713 sigma out 1act.( 4.99946499 sig in 12act.) RANK 12 NODE 3 --> 2.53030539 sigma out 1act.( 2.80690145 sig in 12act.) RANK 13 NODE 12 --> 1.94886029 sigma out 1act.( 4.00072861 sig in 12act.) RANK 14 NODE 6 --> 1.7809931 sigma out 1act.( 3.73189044 sig in 12act.) RANK 15 NODE 14 --> 0.844425261 sigma out 1act.( 3.6334877 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 32.3357506 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.607352912 *** contribution from regularisation: 0.0023977845 *** contribution from error: -0.609750688 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53600.7143 -0.174033597 -6.10112715 EXIT FROM BFGS code NEW_X -53600.7143 -0.174033597 -6.10112715 ENTER BFGS code NEW_X -53600.7143 -0.174033597 -6.10112715 EXIT FROM BFGS code FG_LNSRCH 0. -0.197583869 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.607611001 *** contribution from regularisation: 0.00258302549 *** contribution from error: -0.610194027 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53623.4953 -0.197583869 -1.5115279 EXIT FROM BFGS code NEW_X -53623.4953 -0.197583869 -1.5115279 ENTER BFGS code NEW_X -53623.4953 -0.197583869 -1.5115279 EXIT FROM BFGS code FG_LNSRCH 0. -0.222061798 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.607505679 *** contribution from regularisation: 0.00249533029 *** contribution from error: -0.610001028 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53614.2001 -0.222061798 -5.9830451 EXIT FROM BFGS code FG_LNSRCH 0. -0.206133634 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.607490957 *** contribution from regularisation: 0.00280246767 *** contribution from error: -0.610293448 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53612.8988 -0.206133634 -4.16822338 EXIT FROM BFGS code FG_LNSRCH 0. -0.19862631 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.607544184 *** contribution from regularisation: 0.00266801356 *** contribution from error: -0.610212207 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53617.5969 -0.19862631 -2.04325199 EXIT FROM BFGS code FG_LNSRCH 0. -0.197626993 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.607529342 *** contribution from regularisation: 0.00266551995 *** contribution from error: -0.610194862 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53616.2881 -0.197626993 -1.96269262 EXIT FROM BFGS code FG_LNSRCH 0. -0.197583944 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.607552826 *** contribution from regularisation: 0.0026412122 *** contribution from error: -0.610194027 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53618.3603 -0.197583944 -1.91708243 EXIT FROM BFGS code FG_LNSRCH 0. -0.197583869 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.60752821 *** contribution from regularisation: 0.00266581704 *** contribution from error: -0.610194027 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53616.1887 -0.197583869 -1.92716742 EXIT FROM BFGS code FG_LNSRCH 0. -0.197583869 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.607526898 *** contribution from regularisation: 0.0026671614 *** contribution from error: -0.610194087 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53616.07 -0.197583869 -1.93347871 EXIT FROM BFGS code FG_LNSRCH 0. -0.197583869 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.607569575 *** contribution from regularisation: 0.00262448308 *** contribution from error: -0.610194087 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53619.8365 -0.197583869 -1.94897687 EXIT FROM BFGS code NEW_X -53619.8365 -0.197583869 -1.94897687 ENTER BFGS code NEW_X -53619.8365 -0.197583869 -1.94897687 EXIT FROM BFGS code CONVERGENC -53619.8365 -0.197583869 -1.94897687 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 48.3530426 sigma out 15 active outputs RANK 2 NODE 9 --> 23.5270443 sigma out 15 active outputs RANK 3 NODE 1 --> 22.700264 sigma out 15 active outputs RANK 4 NODE 10 --> 21.8724937 sigma out 15 active outputs RANK 5 NODE 2 --> 18.6942539 sigma out 15 active outputs RANK 6 NODE 7 --> 18.3981533 sigma out 15 active outputs RANK 7 NODE 8 --> 16.7280579 sigma out 15 active outputs RANK 8 NODE 4 --> 13.7716789 sigma out 15 active outputs RANK 9 NODE 6 --> 13.7480907 sigma out 15 active outputs RANK 10 NODE 5 --> 11.6372204 sigma out 15 active outputs RANK 11 NODE 11 --> 8.02642536 sigma out 15 active outputs RANK 12 NODE 3 --> 7.00498247 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 38.3631172 sigma in 12act. ( 31.4406643 sig out 1act.) RANK 2 NODE 10 --> 34.7339973 sigma in 12act. ( 26.498764 sig out 1act.) RANK 3 NODE 13 --> 26.2744122 sigma in 12act. ( 24.9167709 sig out 1act.) RANK 4 NODE 8 --> 22.1359119 sigma in 12act. ( 24.6541634 sig out 1act.) RANK 5 NODE 11 --> 21.6629219 sigma in 12act. ( 20.8586903 sig out 1act.) RANK 6 NODE 4 --> 19.7458897 sigma in 12act. ( 14.2850962 sig out 1act.) RANK 7 NODE 15 --> 16.2695637 sigma in 12act. ( 14.1154938 sig out 1act.) RANK 8 NODE 2 --> 12.257308 sigma in 12act. ( 11.6787672 sig out 1act.) RANK 9 NODE 1 --> 11.7190828 sigma in 12act. ( 7.84936905 sig out 1act.) RANK 10 NODE 9 --> 9.61762238 sigma in 12act. ( 6.92215061 sig out 1act.) RANK 11 NODE 7 --> 6.63037252 sigma in 12act. ( 4.71903276 sig out 1act.) RANK 12 NODE 3 --> 5.3506031 sigma in 12act. ( 4.42465067 sig out 1act.) RANK 13 NODE 6 --> 4.43859005 sigma in 12act. ( 3.05781579 sig out 1act.) RANK 14 NODE 12 --> 3.86476207 sigma in 12act. ( 1.93210268 sig out 1act.) RANK 15 NODE 14 --> 3.30445743 sigma in 12act. ( 0.272063911 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 31.4406643 sigma out 1act.( 38.3631172 sig in 12act.) RANK 2 NODE 10 --> 26.498764 sigma out 1act.( 34.7339973 sig in 12act.) RANK 3 NODE 13 --> 24.9167709 sigma out 1act.( 26.2744122 sig in 12act.) RANK 4 NODE 8 --> 24.6541634 sigma out 1act.( 22.1359119 sig in 12act.) RANK 5 NODE 11 --> 20.8586903 sigma out 1act.( 21.6629219 sig in 12act.) RANK 6 NODE 4 --> 14.2850962 sigma out 1act.( 19.7458897 sig in 12act.) RANK 7 NODE 15 --> 14.1154938 sigma out 1act.( 16.2695637 sig in 12act.) RANK 8 NODE 2 --> 11.6787672 sigma out 1act.( 12.257308 sig in 12act.) RANK 9 NODE 1 --> 7.84936905 sigma out 1act.( 11.7190828 sig in 12act.) RANK 10 NODE 9 --> 6.92215061 sigma out 1act.( 9.61762238 sig in 12act.) RANK 11 NODE 7 --> 4.71903276 sigma out 1act.( 6.63037252 sig in 12act.) RANK 12 NODE 3 --> 4.42465067 sigma out 1act.( 5.3506031 sig in 12act.) RANK 13 NODE 6 --> 3.05781579 sigma out 1act.( 4.43859005 sig in 12act.) RANK 14 NODE 12 --> 1.93210268 sigma out 1act.( 3.86476207 sig in 12act.) RANK 15 NODE 14 --> 0.272063911 sigma out 1act.( 3.30445743 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.7078934 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.607516706 *** contribution from regularisation: 0.00267732097 *** contribution from error: -0.610194027 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done