NNInput NNInputs_150.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 80730 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 22040 nbkg = 58690 Bkg Entries: 58690 Sig Entries: 22040 Chosen entries: 22040 Signal fraction: 1 Background fraction: 0.375532 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 58690 Actual Signal Entries: 22040 Entries to split: 22040 Test with : 11020 Train with : 11020 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 22040 for Signal Prepared event 0 for Signal with 22040 events ====Entry 0 Variable Ht : 123.202 Variable LepAPt : 35.3549 Variable LepBPt : 15.4229 Variable MetSigLeptonsJets : 6.14436 Variable MetSpec : 51.8876 Variable SumEtLeptonsJets : 71.3137 Variable VSumJetLeptonsPt : 55.6499 Variable addEt : 102.666 Variable dPhiLepSumMet : 3.02296 Variable dPhiLeptons : 0.207091 Variable dRLeptons : 0.361572 Variable lep1_E : 35.3896 Variable lep2_E : 15.9161 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2150 Ht = 123.202 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 35.3552 LepAPt = 35.3549 LepBEt = 15.4229 LepBPt = 15.4229 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 51.8876 MetDelPhi = 1.75247 MetSig = 4.4771 MetSigLeptonsJets = 6.14436 MetSpec = 51.8876 Mjj = 0 MostCentralJetEta = -0.791713 MtllMet = 103.166 Njets = 1 SB = 0 SumEt = 134.318 SumEtJets = 0 SumEtLeptonsJets = 71.3137 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 55.6499 addEt = 102.666 dPhiLepSumMet = 3.02296 dPhiLeptons = 0.207091 dRLeptons = 0.361572 diltype = 47 dimass = 8.46066 event = 150 jet1_Et = 20.5359 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 35.3896 lep2_E = 15.9161 rand = 0.999742 run = 167138 weight = 3.15999e-06 ===Show End Prepared event 10000 for Signal with 22040 events Prepared event 20000 for Signal with 22040 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 58690 for Background Prepared event 0 for Background with 58690 events ====Entry 0 Variable Ht : 65.1543 Variable LepAPt : 20.8407 Variable LepBPt : 10.82 Variable MetSigLeptonsJets : 5.95247 Variable MetSpec : 33.4933 Variable SumEtLeptonsJets : 31.6607 Variable VSumJetLeptonsPt : 31.4507 Variable addEt : 65.1543 Variable dPhiLepSumMet : 3.01433 Variable dPhiLeptons : 0.243032 Variable dRLeptons : 0.763155 Variable lep1_E : 24.0883 Variable lep2_E : 10.9808 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 65.1543 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 20.8411 LepAPt = 20.8407 LepBEt = 10.82 LepBPt = 10.82 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 33.4933 MetDelPhi = 2.93145 MetSig = 3.89076 MetSigLeptonsJets = 5.95247 MetSpec = 33.4933 Mjj = 0 MostCentralJetEta = 0 MtllMet = 67.7985 Njets = 0 SB = 0 SumEt = 74.1048 SumEtJets = 0 SumEtLeptonsJets = 31.6607 Target = 0 TrainWeight = 1.09202 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 31.4507 addEt = 65.1543 dPhiLepSumMet = 3.01433 dPhiLeptons = 0.243032 dRLeptons = 0.763155 diltype = 110 dimass = 11.6846 event = 12144548 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 24.0883 lep2_E = 10.9808 rand = 0.999742 run = 272126 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 58690 events Prepared event 20000 for Background with 58690 events Prepared event 30000 for Background with 58690 events Prepared event 40000 for Background with 58690 events Prepared event 50000 for Background with 58690 events Warning: found 1937 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 80730 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 1937 negative weights. Signal fraction: 63.5555382 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 60.5636063 63.8260422 66.0043488 67.415741 68.4260712 69.4085846 70.2959061 71.2362061 71.8747025 72.5900803 73.359108 73.9572144 74.6126251 75.4486542 76.0440979 76.7787323 77.2109985 78.0089264 78.6964951 79.3229828 79.9641724 80.8374481 81.6371002 82.4128418 83.3883286 84.1099854 85.2447357 86.2947693 87.1749268 88.4811707 90.1053314 91.8120499 93.3448181 94.8644409 96.4395218 98.2245102 99.6770172 101.076035 102.654526 104.191193 105.621033 107.175201 108.378418 109.766991 110.943848 112.369293 113.639359 115.03154 116.613449 118.040314 119.37706 120.734818 121.937408 123.182312 124.585587 125.903915 127.235664 128.434052 129.531204 130.885193 132.136047 133.337967 134.638321 135.985992 137.279785 138.684082 140.023804 141.42247 142.763336 144.09024 145.57692 146.891022 148.483307 150.067383 151.706573 153.483704 155.183838 156.970215 159.149384 161.50383 163.743469 166.122284 168.468079 171.130615 174.170898 177.134552 180.459579 183.698975 187.47525 192.081436 196.814056 201.462555 206.550171 213.587784 221.386536 232.833374 245.920624 263.301788 297.247375 782.079102 ------------------------------ Transdef: Tab for variable 3 20.000988 20.2920265 20.5739441 20.7766342 21.0522785 21.278244 21.4807053 21.7178688 21.939579 22.1153431 22.3349915 22.5313416 22.7050934 22.948719 23.1651917 23.340992 23.5389042 23.6975002 23.8787918 24.12286 24.348074 24.5448647 24.7518234 24.9972191 25.1780891 25.3492165 25.5885696 25.8277931 25.9878483 26.1963577 26.3839111 26.5575218 26.8178024 27.086195 27.3529701 27.6011429 27.7859974 28.011282 28.2305012 28.5222816 28.7924252 29.0272388 29.2733688 29.5381584 29.8293076 30.0471191 30.3406391 30.5677319 30.8503456 31.1516571 31.4216156 31.6788292 31.9909439 32.2479172 32.5141678 32.8126717 33.0883179 33.4103851 33.7140045 33.9999886 34.2786865 34.5926933 34.9210472 35.2297058 35.5200729 35.8791046 36.228363 36.5250778 36.8446121 37.1770401 37.5323563 37.8792191 38.2542572 38.6399269 39.0038834 39.3438263 39.6852722 40.0499344 40.4452286 40.8421707 41.2278442 41.7489014 42.248764 42.7295761 43.2174072 43.8312378 44.4974861 45.221096 46.0073242 46.8607025 47.7629623 48.7771454 49.7146988 51.032959 52.3639526 54.0734673 56.2767181 59.2008514 64.0382156 71.7787476 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.0871849 10.2071228 10.3989677 10.529129 10.6485186 10.7735729 10.9013405 11.0286446 11.1928711 11.3162403 11.4609842 11.5787935 11.7347374 11.9072418 12.0714111 12.2073336 12.3638954 12.4750843 12.6550436 12.7936764 12.9609871 13.1278629 13.3111563 13.4833031 13.6702805 13.8855419 14.0443611 14.1646862 14.3442593 14.5561352 14.7603331 14.9431667 15.1458588 15.3792744 15.5690727 15.7665253 15.980361 16.2075748 16.4491634 16.6391754 16.8803959 17.1114044 17.3336926 17.569725 17.774929 18.0442963 18.2672768 18.5164509 18.7553864 18.9704857 19.2135811 19.4413052 19.7117748 20.0031967 20.2251968 20.4380302 20.68993 20.9347305 21.1952705 21.4359665 21.6863346 21.9502335 22.1828442 22.4253235 22.7083168 22.9901123 23.3105412 23.5952263 23.8690033 24.1705742 24.4825077 24.803875 25.1265259 25.4888573 25.8108521 26.1004066 26.4256973 26.7451134 27.1129379 27.4815998 27.8238068 28.2235985 28.6149693 28.9816818 29.4178715 29.8112488 30.2472153 30.7132797 31.2048492 31.6822414 32.20298 32.839447 33.5407486 34.3767166 35.3156052 36.4595184 38.113121 40.5814896 44.9352493 70.9372711 ------------------------------ Transdef: Tab for variable 5 1.04656506 2.25731182 2.64866257 2.90550661 3.09542561 3.31403351 3.51244402 3.66080666 3.8041234 3.99709225 4.13255072 4.27826309 4.38964558 4.485425 4.59657288 4.70454788 4.77349424 4.88996315 4.97988367 5.05783844 5.12947273 5.19306374 5.2567873 5.29898834 5.35553646 5.40344429 5.45819283 5.5074029 5.55720901 5.61743212 5.66649675 5.71088409 5.76226425 5.80503416 5.8483777 5.89060211 5.93211699 5.97211647 6.01659966 6.05411482 6.09232616 6.1293149 6.17741108 6.21710587 6.26328802 6.30236435 6.34605026 6.39162111 6.43109226 6.48193789 6.5218029 6.5745573 6.62344265 6.66316366 6.70257616 6.75061703 6.78909636 6.82912827 6.86908627 6.91087627 6.95800877 7.00707531 7.05250692 7.10481501 7.16297817 7.21332169 7.26913118 7.32379913 7.37318897 7.42538691 7.48452091 7.54380894 7.61088371 7.66470814 7.72315359 7.78609562 7.85084057 7.90759993 7.97158623 8.04010105 8.10638428 8.17006969 8.23547745 8.3039093 8.38023186 8.45263481 8.52890587 8.59816742 8.67998505 8.76083183 8.84211159 8.9399786 9.05197239 9.19041443 9.33219528 9.51770306 9.72994423 10.0224705 10.454422 11.1184597 20.7162266 ------------------------------ Transdef: Tab for variable 6 15.0001631 17.0143681 18.9108849 20.7208252 22.7794113 24.4916382 25.8771782 26.8936043 27.9686966 28.9641056 29.7094536 30.5114861 31.2157822 31.9685287 32.5217247 32.8895874 33.3469543 33.7734413 34.1528587 34.5263443 34.9089127 35.2579079 35.6554909 36.0068817 36.3612518 36.7717438 37.110466 37.4517517 37.740181 38.1893311 38.5059929 38.8709106 39.2262115 39.6167068 39.9504929 40.27845 40.558876 41.0159912 41.4673157 41.9826813 42.469326 42.9366951 43.3809891 43.8611526 44.3482361 44.8782616 45.3445663 45.901432 46.5879288 47.2637825 47.7973099 48.487587 49.1680336 49.8106003 50.5470581 51.2017822 51.8575668 52.5013199 53.1898499 53.9268494 54.6182632 55.3522453 55.9748535 56.650177 57.3750801 58.0774384 58.7664413 59.5150681 60.2554779 60.9558029 61.6456184 62.3512917 63.0265808 63.8484573 64.5790939 65.3097687 65.8983307 66.6442261 67.3590622 68.066452 68.7460175 69.5144958 70.2818756 71.0886307 71.8699646 72.7810974 73.6716919 74.6772079 75.6798477 76.743927 78.1325684 79.5066681 81.3451233 83.2268677 85.4785156 88.4479675 92.4893875 97.6025085 104.263626 115.10894 232.877182 ------------------------------ Transdef: Tab for variable 7 30.1484737 32.4147568 33.332489 34.0109177 34.5870857 35.1469574 35.5613937 35.9127045 36.2791672 36.6945343 37.0761032 37.3969154 37.7426224 38.0161362 38.3348618 38.6413956 38.9517059 39.216198 39.5090027 39.7347183 40.1693497 40.5997849 40.9853363 41.3687477 41.8205223 42.2698402 42.7999802 43.4014091 44.0906372 44.6314545 45.3903275 46.4525146 47.1708603 48.1596222 49.0669136 49.944725 50.923317 51.7593536 52.7369385 53.5549431 54.4696121 55.3517876 56.0679626 56.8575974 57.6553726 58.5176773 59.4477425 60.1286659 60.9747849 61.7379227 62.5749741 63.3378563 64.115509 64.8252563 65.542923 66.26297 67.0935822 67.8946838 68.6943436 69.5615387 70.443573 71.3402252 72.176033 73.0583267 74.0189209 74.966713 75.9085236 76.8139725 78.1474152 79.4534683 80.8862152 82.3722839 83.7600708 85.0575562 86.6156464 88.302536 89.9549789 91.4927368 93.139595 94.4278564 96.1916504 98.0982361 100.159889 102.174538 104.334557 106.829514 109.248718 111.976974 115.360992 118.819893 122.550751 126.505997 130.717163 135.802826 141.969208 148.998566 158.819336 170.035263 185.679199 209.91098 458.64209 ------------------------------ Transdef: Tab for variable 8 1.19986558 20.746727 25.2324181 28.701334 30.4095707 31.5265465 32.2192879 32.8027878 33.3306732 33.7628021 34.1642456 34.639389 34.9447327 35.2621689 35.6096802 35.9115448 36.198761 36.4764671 36.7822495 37.137413 37.3601685 37.7162476 37.952919 38.2250443 38.5123062 38.7132645 38.9724731 39.1978111 39.5077591 39.7567749 40.142662 40.4043655 40.7220764 41.0923996 41.4567986 41.8773422 42.2692642 42.7044373 43.1536331 43.6761322 44.1411591 44.5619736 45.0800705 45.7770462 46.3288574 46.863102 47.4815292 48.1006012 48.702137 49.2581329 49.9274063 50.4520493 51.0677757 51.6811905 52.3523102 53.0072021 53.6067886 54.2047729 54.843132 55.386795 55.989769 56.6085892 57.2521515 57.9197311 58.4935303 59.1148643 59.674614 60.2864609 60.8767395 61.4908981 62.0887871 62.6758614 63.3494186 64.0618896 64.5661011 65.1457062 65.8110657 66.4899139 67.1757355 67.9858398 68.6521759 69.4214172 70.0643616 70.7881012 71.5274887 72.419136 73.2882385 74.2464142 75.3866577 76.5888596 78.1740646 79.719101 81.5723648 83.7766724 86.5185547 89.4343567 93.3919601 98.0682373 104.912231 117.334549 326.868286 ------------------------------ Transdef: Tab for variable 9 47.1748543 59.9765091 62.6161957 64.9276276 66.1436157 67.415741 68.4006042 69.2558289 69.892662 70.7466507 71.5342865 72.0570526 72.8768463 73.4758148 74.0079575 74.6142731 75.2611008 75.8575592 76.4522247 76.9455795 77.4278564 78.1573792 78.6972351 79.2829895 79.7739487 80.4647369 81.2592163 81.7586441 82.5203705 83.2693939 83.8508911 84.5519867 85.4875412 86.1591034 86.9778595 87.7211761 88.745636 89.7919769 91.0415802 92.2595215 93.2297821 94.3321533 95.3898849 96.775528 98.0410233 99.2683945 100.428986 101.613739 102.917625 104.046631 105.335953 106.42308 107.536438 108.683411 109.751579 110.769989 112.024124 113.267754 114.250839 115.342812 116.338104 117.473541 118.664963 119.894417 120.900406 121.833054 122.840973 123.899284 124.887672 125.934448 126.966721 127.991577 128.86911 129.875671 130.808075 131.687042 132.736877 133.621368 134.636703 135.725662 136.643631 137.615753 138.723038 139.765137 140.96492 142.003677 143.059937 144.225937 145.406128 146.69519 147.903259 149.415894 150.969543 152.583252 154.796661 157.296539 160.775909 165.460114 172.637482 191.256744 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.933298469 1.28593326 1.50696325 1.67222428 1.80149221 1.89704466 1.97897601 2.05591035 2.12146616 2.1884737 2.23984051 2.29030728 2.33071947 2.37200809 2.40802884 2.44661808 2.48189235 2.50980902 2.53613472 2.56318855 2.58639407 2.61086416 2.63076735 2.65626383 2.67691803 2.6981225 2.71894407 2.73814583 2.75468206 2.77206898 2.78927374 2.80286026 2.81602859 2.82512355 2.83627224 2.8490212 2.86014462 2.8712945 2.88325739 2.8941915 2.90292478 2.9129467 2.92387915 2.9327631 2.93897676 2.94688487 2.95450211 2.96164513 2.96698666 2.97315454 2.97873592 2.98341799 2.98890281 2.99285698 2.99888992 3.00409126 3.00799608 3.01347208 3.01797485 3.02208996 3.02721691 3.03072715 3.03427076 3.03808975 3.04163122 3.0451932 3.04854298 3.0525918 3.05643415 3.06022 3.06378555 3.06758261 3.07105517 3.07403946 3.07735634 3.08013058 3.08278608 3.08550882 3.08847666 3.09107089 3.09382606 3.09676886 3.09921312 3.10183144 3.10479879 3.10692072 3.10973167 3.11219549 3.11443853 3.11729765 3.11987877 3.12249565 3.12494969 3.12766647 3.12961221 3.13201952 3.13468289 3.13689566 3.13912106 3.14157534 ------------------------------ Transdef: Tab for variable 11 3.24249268E-05 0.00590747595 0.0114197731 0.0155244395 0.0214259624 0.0269137621 0.033182025 0.0410439968 0.0480215549 0.0550425053 0.06238693 0.0690773726 0.0764058828 0.082819514 0.0899950266 0.0961042941 0.102694869 0.10899508 0.115438104 0.122708201 0.129518032 0.135480046 0.140764654 0.147331238 0.153478622 0.159011364 0.165371135 0.171103239 0.176786184 0.181394935 0.186300397 0.190580428 0.196072042 0.20133543 0.2051633 0.20972079 0.214276344 0.219225049 0.223934054 0.227524877 0.230947018 0.234975338 0.240823299 0.24619168 0.252071857 0.256741762 0.261190981 0.265399635 0.270785421 0.27515161 0.279777646 0.284708053 0.289871871 0.294747353 0.299318671 0.305969656 0.311461747 0.316414744 0.320729643 0.325835347 0.330462664 0.335674763 0.340879083 0.347399294 0.352888644 0.357940733 0.363493055 0.369241595 0.375997692 0.382713884 0.390531719 0.396737516 0.403145403 0.410948366 0.417600036 0.424565911 0.431041777 0.438821644 0.445783079 0.454841197 0.461881995 0.470886111 0.47813797 0.487332463 0.496447623 0.506612241 0.516459525 0.52914685 0.542886376 0.554918289 0.568066359 0.58223176 0.595600545 0.611276984 0.631301403 0.654602826 0.679112077 0.720268726 0.769612491 0.822560072 1.11372733 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.207689703 0.214436322 0.221893832 0.227504402 0.232554182 0.237975597 0.244142443 0.249521852 0.255158544 0.260071039 0.265475333 0.270822048 0.276033819 0.280859053 0.286257505 0.291399896 0.296976388 0.302433491 0.30756855 0.312777251 0.316892177 0.322537303 0.327977061 0.332662582 0.337946951 0.343637168 0.348241687 0.352577329 0.357678503 0.362732202 0.36752525 0.371562093 0.37598142 0.380620599 0.385391623 0.389646769 0.393621564 0.398366332 0.402850538 0.406942904 0.411182523 0.415606678 0.419934183 0.424398541 0.427192509 0.431613088 0.435521901 0.439429939 0.443832695 0.447316766 0.45204246 0.45577687 0.460260749 0.464914799 0.469292849 0.473273098 0.477065295 0.481414378 0.484906137 0.48948133 0.494412303 0.498133957 0.503105879 0.508962452 0.512654483 0.517410874 0.522892952 0.52879405 0.534830749 0.540342152 0.546872497 0.553186893 0.559047341 0.565223813 0.571872115 0.579494715 0.58520788 0.590356052 0.598431587 0.605991244 0.614371896 0.621299446 0.628354311 0.636609435 0.644760907 0.653197289 0.662268698 0.674048781 0.686200619 0.700083554 0.713630795 0.731140673 0.745634794 0.762077689 0.780652165 0.806343138 0.834688723 0.867531121 0.901632786 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.2906075 21.8446274 22.5240135 23.0971832 23.5514183 23.9056549 24.2689724 24.6235275 25.0083485 25.4023476 25.7629089 26.0438957 26.381115 26.7824707 27.1678257 27.5139084 27.7737446 28.06707 28.4692802 28.7796249 29.1140575 29.4622421 29.7778893 30.1014519 30.3842926 30.6446514 30.8093796 31.0894222 31.3644524 31.6545849 31.9150219 32.1876678 32.4629517 32.8380661 33.0827713 33.3562698 33.7303848 34.0668793 34.3761597 34.7277451 35.0531235 35.4046135 35.7033615 36.0180206 36.2980881 36.6484756 36.9811821 37.2957039 37.6515961 38.0014992 38.3118439 38.6930122 39.0650558 39.4467926 39.7895813 40.1579018 40.503212 40.7912903 41.2056732 41.5566101 41.9035873 42.2882423 42.6563721 43.0188675 43.3765717 43.7922821 44.1682434 44.5975266 45.0215302 45.5181656 46.0447197 46.4966125 47.0871811 47.6337509 48.1296463 48.7588272 49.3702545 49.909771 50.5449066 51.2307663 52.0570602 52.7649612 53.538578 54.4239426 55.3964119 56.3122482 57.3673096 58.3587532 59.6119919 61.0655441 62.5106697 64.2593384 66.484787 69.0070496 71.8947678 75.0906525 79.7260895 85.3533325 94.7227478 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6085634 10.9642544 11.2821541 11.6646519 12.0343933 12.3672457 12.6732464 12.9293613 13.1560831 13.3888912 13.6378441 13.8810349 14.0871449 14.2735205 14.5111799 14.7796459 15.0442333 15.251606 15.4891052 15.7550001 16.0023575 16.2543221 16.4992409 16.7870865 17.0318451 17.2912178 17.5198956 17.800766 18.0755615 18.3644142 18.6231499 18.9183083 19.1249199 19.3360214 19.6356926 19.9321003 20.1704826 20.4455376 20.7062263 20.9749088 21.2496605 21.5303421 21.8140411 22.0842857 22.3784256 22.6610107 22.9379997 23.1915016 23.3982811 23.6627464 23.9053116 24.1653366 24.438797 24.7221451 24.996294 25.3951283 25.6813965 26.0034447 26.2990036 26.5318985 26.8258629 27.0769672 27.380991 27.7331352 28.000082 28.3253746 28.7157326 29.0594482 29.400404 29.7139473 30.0155296 30.4062347 30.7449303 31.1432953 31.5249367 31.8832283 32.3074646 32.7661324 33.2211609 33.7094116 34.1949463 34.6461182 35.0572395 35.5544853 36.1441498 36.6479492 37.3721046 37.9600906 38.7470856 39.615963 40.6126747 41.6627731 42.8233795 44.0669212 45.5776711 47.3083267 49.6421432 53.6411057 60.0770531 115.518631 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 64.4 48.3 51.2 22.2 41.5 62.1 50.0 60.7 -28.4 -6.8 -24.2 29.9 36.7 2 64.4 100.0 66.6 60.9 28.4 60.5 94.2 69.2 90.1 -45.0 -16.1 -37.7 46.8 45.6 3 48.3 66.6 100.0 45.6 3.9 27.9 70.0 49.4 70.7 -16.5 -19.0 -42.9 77.0 33.5 4 51.2 60.9 45.6 100.0 13.4 33.5 60.8 49.3 66.6 -12.8 -20.6 -46.9 32.6 82.8 5 22.2 28.4 3.9 13.4 100.0 84.3 -0.5 57.9 54.4 29.2 -2.5 -5.5 -2.7 8.2 6 41.5 60.5 27.9 33.5 84.3 100.0 37.2 78.0 75.6 0.3 -7.6 -18.4 15.4 23.9 7 62.1 94.2 70.0 60.8 -0.5 37.2 100.0 57.8 77.0 -54.5 -15.1 -37.1 51.0 46.4 8 50.0 69.2 49.4 49.3 57.9 78.0 57.8 100.0 81.3 -5.7 -14.3 -30.2 33.8 37.7 9 60.7 90.1 70.7 66.6 54.4 75.6 77.0 81.3 100.0 -17.5 -18.5 -42.3 50.2 50.9 10 -28.4 -45.0 -16.5 -12.8 29.2 0.3 -54.5 -5.7 -17.5 100.0 1.4 6.9 -11.4 -8.3 11 -6.8 -16.1 -19.0 -20.6 -2.5 -7.6 -15.1 -14.3 -18.5 1.4 100.0 52.0 -12.2 -17.5 12 -24.2 -37.7 -42.9 -46.9 -5.5 -18.4 -37.1 -30.2 -42.3 6.9 52.0 100.0 -27.0 -31.4 13 29.9 46.8 77.0 32.6 -2.7 15.4 51.0 33.8 50.2 -11.4 -12.2 -27.0 100.0 45.9 14 36.7 45.6 33.5 82.8 8.2 23.9 46.4 37.7 50.9 -8.3 -17.5 -31.4 45.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 158.174126 TOTAL CORRELATION OF ALL VARIABLES 69.7826891 ROUND 1: MAX CORR ( 69.7692809) AFTER KILLING INPUT VARIABLE 14 CONTR 1.36789656 ROUND 2: MAX CORR ( 69.7439056) AFTER KILLING INPUT VARIABLE 6 CONTR 1.88153602 ROUND 3: MAX CORR ( 69.6754267) AFTER KILLING INPUT VARIABLE 11 CONTR 3.08986932 ROUND 4: MAX CORR ( 69.5847931) AFTER KILLING INPUT VARIABLE 8 CONTR 3.5526969 ROUND 5: MAX CORR ( 69.5007806) AFTER KILLING INPUT VARIABLE 2 CONTR 3.41832044 ROUND 6: MAX CORR ( 69.2407812) AFTER KILLING INPUT VARIABLE 12 CONTR 6.00605821 ROUND 7: MAX CORR ( 68.9510052) AFTER KILLING INPUT VARIABLE 13 CONTR 6.32808428 ROUND 8: MAX CORR ( 68.5409458) AFTER KILLING INPUT VARIABLE 10 CONTR 7.5086532 ROUND 9: MAX CORR ( 67.5536604) AFTER KILLING INPUT VARIABLE 3 CONTR 11.5915581 ROUND 10: MAX CORR ( 67.3465628) AFTER KILLING INPUT VARIABLE 9 CONTR 5.28559442 ROUND 11: MAX CORR ( 66.0329048) AFTER KILLING INPUT VARIABLE 4 CONTR 13.2368808 ROUND 12: MAX CORR ( 62.0608615) AFTER KILLING INPUT VARIABLE 5 CONTR 22.5564621 LAST REMAINING VARIABLE: 7 total correlation to target: 69.7826891 % total significance: 91.9053078 sigma correlations of single variables to target: variable 2: 64.3630053 % , in sigma: 84.7674673 variable 3: 48.285196 % , in sigma: 63.5926454 variable 4: 51.1858181 % , in sigma: 67.4128274 variable 5: 22.2209029 % , in sigma: 29.2654088 variable 6: 41.4969091 % , in sigma: 54.652325 variable 7: 62.0608615 % , in sigma: 81.7354942 variable 8: 49.9554792 % , in sigma: 65.7924444 variable 9: 60.6773767 % , in sigma: 79.9134149 variable 10: -28.3763759 % , in sigma: 37.3722997 variable 11: -6.77463017 % , in sigma: 8.92233418 variable 12: -24.1501494 % , in sigma: 31.8062681 variable 13: 29.9383657 % , in sigma: 39.4294739 variable 14: 36.7389869 % , in sigma: 48.3860388 variables sorted by significance: 1 most relevant variable 7 corr 62.0608597 , in sigma: 81.7354919 2 most relevant variable 5 corr 22.5564613 , in sigma: 29.7073465 3 most relevant variable 4 corr 13.2368813 , in sigma: 17.4332584 4 most relevant variable 9 corr 5.28559446 , in sigma: 6.96124201 5 most relevant variable 3 corr 11.5915585 , in sigma: 15.2663327 6 most relevant variable 10 corr 7.50865316 , in sigma: 9.8890583 7 most relevant variable 13 corr 6.32808447 , in sigma: 8.33422385 8 most relevant variable 12 corr 6.00605822 , in sigma: 7.91010832 9 most relevant variable 2 corr 3.41832042 , in sigma: 4.50200178 10 most relevant variable 8 corr 3.55269694 , in sigma: 4.67897856 11 most relevant variable 11 corr 3.08986926 , in sigma: 4.06942452 12 most relevant variable 6 corr 1.88153601 , in sigma: 2.47802354 13 most relevant variable 14 corr 1.36789656 , in sigma: 1.80154929 global correlations between input variables: variable 2: 99.1620788 % variable 3: 93.3752623 % variable 4: 92.9867497 % variable 5: 95.266821 % variable 6: 93.883565 % variable 7: 98.7892956 % variable 8: 88.2479555 % variable 9: 98.6674488 % variable 10: 72.658841 % variable 11: 53.3842395 % variable 12: 68.1193812 % variable 13: 86.9293069 % variable 14: 90.2539161 % significance loss when removing single variables: variable 2: corr = 4.82950664 % , sigma = 6.3605645 variable 3: corr = 14.1547291 % , sigma = 18.6420838 variable 4: corr = 13.9243922 % , sigma = 18.3387251 variable 5: corr = 14.3734709 % , sigma = 18.9301714 variable 6: corr = 1.87104873 % , sigma = 2.46421157 variable 7: corr = 4.91422575 % , sigma = 6.47214139 variable 8: corr = 4.12957098 % , sigma = 5.43873412 variable 9: corr = 11.6995914 % , sigma = 15.4086144 variable 10: corr = 7.26297091 % , sigma = 9.56548947 variable 11: corr = 2.96840493 % , sigma = 3.90945337 variable 12: corr = 4.18448655 % , sigma = 5.51105912 variable 13: corr = 4.48150552 % , sigma = 5.90223951 variable 14: corr = 1.36789656 % , sigma = 1.8015493 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 12.546876 sigma out 15 active outputs RANK 2 NODE 10 --> 11.875145 sigma out 15 active outputs RANK 3 NODE 9 --> 11.3529224 sigma out 15 active outputs RANK 4 NODE 1 --> 9.74770927 sigma out 15 active outputs RANK 5 NODE 2 --> 9.37729549 sigma out 15 active outputs RANK 6 NODE 5 --> 8.95105171 sigma out 15 active outputs RANK 7 NODE 3 --> 8.86159801 sigma out 15 active outputs RANK 8 NODE 11 --> 8.30989742 sigma out 15 active outputs RANK 9 NODE 6 --> 8.07634354 sigma out 15 active outputs RANK 10 NODE 12 --> 7.90554714 sigma out 15 active outputs RANK 11 NODE 8 --> 6.37062597 sigma out 15 active outputs RANK 12 NODE 7 --> 4.96171856 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 19.8204651 sigma in 12act. ( 20.0486221 sig out 1act.) RANK 2 NODE 8 --> 11.8278589 sigma in 12act. ( 12.4518032 sig out 1act.) RANK 3 NODE 5 --> 11.2069206 sigma in 12act. ( 11.8775063 sig out 1act.) RANK 4 NODE 1 --> 8.94652939 sigma in 12act. ( 10.4325008 sig out 1act.) RANK 5 NODE 14 --> 7.97648335 sigma in 12act. ( 8.08969593 sig out 1act.) RANK 6 NODE 2 --> 7.25716352 sigma in 12act. ( 8.10685825 sig out 1act.) RANK 7 NODE 12 --> 7.13272285 sigma in 12act. ( 6.47120571 sig out 1act.) RANK 8 NODE 15 --> 5.71851063 sigma in 12act. ( 5.8871026 sig out 1act.) RANK 9 NODE 13 --> 4.8544693 sigma in 12act. ( 4.88415813 sig out 1act.) RANK 10 NODE 3 --> 4.11511326 sigma in 12act. ( 3.74218512 sig out 1act.) RANK 11 NODE 4 --> 3.85287857 sigma in 12act. ( 3.22054601 sig out 1act.) RANK 12 NODE 10 --> 3.41287923 sigma in 12act. ( 2.91668224 sig out 1act.) RANK 13 NODE 6 --> 3.38986659 sigma in 12act. ( 4.90712786 sig out 1act.) RANK 14 NODE 11 --> 3.21737504 sigma in 12act. ( 3.54576135 sig out 1act.) RANK 15 NODE 9 --> 1.95657563 sigma in 12act. ( 1.92226696 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 20.0486221 sigma out 1act.( 19.8204651 sig in 12act.) RANK 2 NODE 8 --> 12.4518032 sigma out 1act.( 11.8278589 sig in 12act.) RANK 3 NODE 5 --> 11.8775063 sigma out 1act.( 11.2069206 sig in 12act.) RANK 4 NODE 1 --> 10.4325008 sigma out 1act.( 8.94652939 sig in 12act.) RANK 5 NODE 2 --> 8.10685825 sigma out 1act.( 7.25716352 sig in 12act.) RANK 6 NODE 14 --> 8.08969593 sigma out 1act.( 7.97648335 sig in 12act.) RANK 7 NODE 12 --> 6.47120571 sigma out 1act.( 7.13272285 sig in 12act.) RANK 8 NODE 15 --> 5.8871026 sigma out 1act.( 5.71851063 sig in 12act.) RANK 9 NODE 6 --> 4.90712786 sigma out 1act.( 3.38986659 sig in 12act.) RANK 10 NODE 13 --> 4.88415813 sigma out 1act.( 4.8544693 sig in 12act.) RANK 11 NODE 3 --> 3.74218512 sigma out 1act.( 4.11511326 sig in 12act.) RANK 12 NODE 11 --> 3.54576135 sigma out 1act.( 3.21737504 sig in 12act.) RANK 13 NODE 4 --> 3.22054601 sigma out 1act.( 3.85287857 sig in 12act.) RANK 14 NODE 10 --> 2.91668224 sigma out 1act.( 3.41287923 sig in 12act.) RANK 15 NODE 9 --> 1.92226696 sigma out 1act.( 1.95657563 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 33.3420296 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 18.5997181 sigma out 15 active outputs RANK 2 NODE 4 --> 13.9340267 sigma out 15 active outputs RANK 3 NODE 10 --> 13.1618137 sigma out 15 active outputs RANK 4 NODE 9 --> 12.4813433 sigma out 15 active outputs RANK 5 NODE 12 --> 12.2633095 sigma out 15 active outputs RANK 6 NODE 3 --> 11.2711678 sigma out 15 active outputs RANK 7 NODE 1 --> 10.5800047 sigma out 15 active outputs RANK 8 NODE 11 --> 10.1248693 sigma out 15 active outputs RANK 9 NODE 5 --> 9.32309341 sigma out 15 active outputs RANK 10 NODE 8 --> 9.06681347 sigma out 15 active outputs RANK 11 NODE 6 --> 9.03809261 sigma out 15 active outputs RANK 12 NODE 7 --> 6.94494152 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 17.8534508 sigma in 12act. ( 18.2970219 sig out 1act.) RANK 2 NODE 1 --> 13.5178909 sigma in 12act. ( 10.511178 sig out 1act.) RANK 3 NODE 8 --> 13.0180902 sigma in 12act. ( 12.4894657 sig out 1act.) RANK 4 NODE 2 --> 12.0342684 sigma in 12act. ( 8.17221642 sig out 1act.) RANK 5 NODE 6 --> 11.6917152 sigma in 12act. ( 6.70825195 sig out 1act.) RANK 6 NODE 12 --> 10.1310511 sigma in 12act. ( 6.08843374 sig out 1act.) RANK 7 NODE 5 --> 10.1284676 sigma in 12act. ( 10.6262913 sig out 1act.) RANK 8 NODE 9 --> 9.32260132 sigma in 12act. ( 3.06736112 sig out 1act.) RANK 9 NODE 14 --> 9.11389256 sigma in 12act. ( 7.88380718 sig out 1act.) RANK 10 NODE 13 --> 8.33421707 sigma in 12act. ( 5.02534199 sig out 1act.) RANK 11 NODE 4 --> 8.07525158 sigma in 12act. ( 3.15218902 sig out 1act.) RANK 12 NODE 15 --> 8.03320217 sigma in 12act. ( 5.78702021 sig out 1act.) RANK 13 NODE 11 --> 7.5280304 sigma in 12act. ( 4.19696379 sig out 1act.) RANK 14 NODE 10 --> 7.09662342 sigma in 12act. ( 3.07002044 sig out 1act.) RANK 15 NODE 3 --> 5.11329317 sigma in 12act. ( 3.24919319 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 18.2970219 sigma out 1act.( 17.8534508 sig in 12act.) RANK 2 NODE 8 --> 12.4894657 sigma out 1act.( 13.0180902 sig in 12act.) RANK 3 NODE 5 --> 10.6262913 sigma out 1act.( 10.1284676 sig in 12act.) RANK 4 NODE 1 --> 10.511178 sigma out 1act.( 13.5178909 sig in 12act.) RANK 5 NODE 2 --> 8.17221642 sigma out 1act.( 12.0342684 sig in 12act.) RANK 6 NODE 14 --> 7.88380718 sigma out 1act.( 9.11389256 sig in 12act.) RANK 7 NODE 6 --> 6.70825195 sigma out 1act.( 11.6917152 sig in 12act.) RANK 8 NODE 12 --> 6.08843374 sigma out 1act.( 10.1310511 sig in 12act.) RANK 9 NODE 15 --> 5.78702021 sigma out 1act.( 8.03320217 sig in 12act.) RANK 10 NODE 13 --> 5.02534199 sigma out 1act.( 8.33421707 sig in 12act.) RANK 11 NODE 11 --> 4.19696379 sigma out 1act.( 7.5280304 sig in 12act.) RANK 12 NODE 3 --> 3.24919319 sigma out 1act.( 5.11329317 sig in 12act.) RANK 13 NODE 4 --> 3.15218902 sigma out 1act.( 8.07525158 sig in 12act.) RANK 14 NODE 10 --> 3.07002044 sigma out 1act.( 7.09662342 sig in 12act.) RANK 15 NODE 9 --> 3.06736112 sigma out 1act.( 9.32260132 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 32.2624435 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.397976279 *** contribution from regularisation: 0.0102574499 *** contribution from error: -0.408233732 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.45850119 *** contribution from regularisation: 0.00472636474 *** contribution from error: -0.46322754 *********************************************** -----------------> Test sample ENTER BFGS code START -18511.4366 -0.00919638202 -0.674271703 EXIT FROM BFGS code FG_START 0. -0.00919638202 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.484755844 *** contribution from regularisation: 0.00446726847 *** contribution from error: -0.489223123 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -19567.1691 -0.00919638202 -126.747742 EXIT FROM BFGS code FG_LNSRCH 0. -0.052719526 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 0.052719526 -145.071716 EXIT FROM BFGS code NEW_X -21298.9738 -0.052719526 -145.071716 ENTER BFGS code NEW_X -21298.9738 -0.052719526 -145.071716 EXIT FROM BFGS code FG_LNSRCH 0. -0.112684123 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.532726109 *** contribution from regularisation: 0.00676798588 *** contribution from error: -0.539494097 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21503.4898 -0.112684123 -61.3613319 EXIT FROM BFGS code NEW_X -21503.4898 -0.112684123 -61.3613319 ENTER BFGS code NEW_X -21503.4898 -0.112684123 -61.3613319 EXIT FROM BFGS code FG_LNSRCH 0. -0.161528558 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.534684658 *** contribution from regularisation: 0.00673003448 *** contribution from error: -0.541414678 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21582.5463 -0.161528558 -8.56418228 EXIT FROM BFGS code NEW_X -21582.5463 -0.161528558 -8.56418228 ENTER BFGS code NEW_X -21582.5463 -0.161528558 -8.56418228 EXIT FROM BFGS code FG_LNSRCH 0. -0.184659824 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.535217106 *** contribution from regularisation: 0.00650085509 *** contribution from error: -0.541717947 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21604.0397 -0.184659824 5.40491009 EXIT FROM BFGS code NEW_X -21604.0397 -0.184659824 5.40491009 ENTER BFGS code NEW_X -21604.0397 -0.184659824 5.40491009 EXIT FROM BFGS code FG_LNSRCH 0. -0.221603751 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.535862207 *** contribution from regularisation: 0.00613027532 *** contribution from error: -0.541992486 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21630.0791 -0.221603751 18.3236542 EXIT FROM BFGS code NEW_X -21630.0791 -0.221603751 18.3236542 ENTER BFGS code NEW_X -21630.0791 -0.221603751 18.3236542 EXIT FROM BFGS code FG_LNSRCH 0. -0.316936284 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.536659777 *** contribution from regularisation: 0.00503895292 *** contribution from error: -0.541698754 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21662.2709 -0.316936284 26.5836067 EXIT FROM BFGS code NEW_X -21662.2709 -0.316936284 26.5836067 ENTER BFGS code NEW_X -21662.2709 -0.316936284 26.5836067 EXIT FROM BFGS code FG_LNSRCH 0. -0.396162122 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 32.111393 sigma out 15 active outputs RANK 2 NODE 1 --> 20.7657642 sigma out 15 active outputs RANK 3 NODE 3 --> 15.2850037 sigma out 15 active outputs RANK 4 NODE 8 --> 12.8054247 sigma out 15 active outputs RANK 5 NODE 12 --> 10.4352446 sigma out 15 active outputs RANK 6 NODE 5 --> 9.60894394 sigma out 15 active outputs RANK 7 NODE 11 --> 8.79828453 sigma out 15 active outputs RANK 8 NODE 4 --> 7.2724185 sigma out 15 active outputs RANK 9 NODE 10 --> 7.04823208 sigma out 15 active outputs RANK 10 NODE 7 --> 6.93218756 sigma out 15 active outputs RANK 11 NODE 6 --> 5.66357803 sigma out 15 active outputs RANK 12 NODE 9 --> 3.05321836 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 34.9266396 sigma in 12act. ( 32.6226349 sig out 1act.) RANK 2 NODE 1 --> 16.8203793 sigma in 12act. ( 14.11619 sig out 1act.) RANK 3 NODE 11 --> 13.09021 sigma in 12act. ( 10.7847738 sig out 1act.) RANK 4 NODE 2 --> 12.0713139 sigma in 12act. ( 10.1024952 sig out 1act.) RANK 5 NODE 8 --> 11.5128689 sigma in 12act. ( 8.60536385 sig out 1act.) RANK 6 NODE 9 --> 9.18585491 sigma in 12act. ( 6.93552971 sig out 1act.) RANK 7 NODE 10 --> 8.5687561 sigma in 12act. ( 6.9792614 sig out 1act.) RANK 8 NODE 14 --> 7.07589769 sigma in 12act. ( 5.65105009 sig out 1act.) RANK 9 NODE 13 --> 6.48228264 sigma in 12act. ( 4.95091343 sig out 1act.) RANK 10 NODE 5 --> 6.26711226 sigma in 12act. ( 4.64008856 sig out 1act.) RANK 11 NODE 7 --> 5.30764723 sigma in 12act. ( 3.39633179 sig out 1act.) RANK 12 NODE 15 --> 4.84322882 sigma in 12act. ( 2.88876176 sig out 1act.) RANK 13 NODE 12 --> 3.75777793 sigma in 12act. ( 1.3376528 sig out 1act.) RANK 14 NODE 4 --> 3.74710155 sigma in 12act. ( 1.95332932 sig out 1act.) RANK 15 NODE 3 --> 3.04201722 sigma in 12act. ( 1.53405333 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 32.6226349 sigma out 1act.( 34.9266396 sig in 12act.) RANK 2 NODE 1 --> 14.11619 sigma out 1act.( 16.8203793 sig in 12act.) RANK 3 NODE 11 --> 10.7847738 sigma out 1act.( 13.09021 sig in 12act.) RANK 4 NODE 2 --> 10.1024952 sigma out 1act.( 12.0713139 sig in 12act.) RANK 5 NODE 8 --> 8.60536385 sigma out 1act.( 11.5128689 sig in 12act.) RANK 6 NODE 10 --> 6.9792614 sigma out 1act.( 8.5687561 sig in 12act.) RANK 7 NODE 9 --> 6.93552971 sigma out 1act.( 9.18585491 sig in 12act.) RANK 8 NODE 14 --> 5.65105009 sigma out 1act.( 7.07589769 sig in 12act.) RANK 9 NODE 13 --> 4.95091343 sigma out 1act.( 6.48228264 sig in 12act.) RANK 10 NODE 5 --> 4.64008856 sigma out 1act.( 6.26711226 sig in 12act.) RANK 11 NODE 7 --> 3.39633179 sigma out 1act.( 5.30764723 sig in 12act.) RANK 12 NODE 15 --> 2.88876176 sigma out 1act.( 4.84322882 sig in 12act.) RANK 13 NODE 4 --> 1.95332932 sigma out 1act.( 3.74710155 sig in 12act.) RANK 14 NODE 3 --> 1.53405333 sigma out 1act.( 3.04201722 sig in 12act.) RANK 15 NODE 12 --> 1.3376528 sigma out 1act.( 3.75777793 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 41.9351082 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.536719561 *** contribution from regularisation: 0.00556852715 *** contribution from error: -0.542288065 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -21664.6845 -0.396162122 49.3354568 EXIT FROM BFGS code NEW_X -21664.6845 -0.396162122 49.3354568 ENTER BFGS code NEW_X -21664.6845 -0.396162122 49.3354568 EXIT FROM BFGS code FG_LNSRCH 0. -0.378531635 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.536896825 *** contribution from regularisation: 0.00600194559 *** contribution from error: -0.542898774 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21671.8413 -0.378531635 -16.8676109 EXIT FROM BFGS code NEW_X -21671.8413 -0.378531635 -16.8676109 ENTER BFGS code NEW_X -21671.8413 -0.378531635 -16.8676109 EXIT FROM BFGS code FG_LNSRCH 0. -0.391200483 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.537268698 *** contribution from regularisation: 0.00581907295 *** contribution from error: -0.54308778 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21686.8513 -0.391200483 9.55793476 EXIT FROM BFGS code NEW_X -21686.8513 -0.391200483 9.55793476 ENTER BFGS code NEW_X -21686.8513 -0.391200483 9.55793476 EXIT FROM BFGS code FG_LNSRCH 0. -0.380668551 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.537415981 *** contribution from regularisation: 0.00572760124 *** contribution from error: -0.54314357 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21692.7968 -0.380668551 16.4564476 EXIT FROM BFGS code NEW_X -21692.7968 -0.380668551 16.4564476 ENTER BFGS code NEW_X -21692.7968 -0.380668551 16.4564476 EXIT FROM BFGS code FG_LNSRCH 0. -0.28965342 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.538080335 *** contribution from regularisation: 0.00479347026 *** contribution from error: -0.5428738 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21719.6127 -0.28965342 22.4474354 EXIT FROM BFGS code NEW_X -21719.6127 -0.28965342 22.4474354 ENTER BFGS code NEW_X -21719.6127 -0.28965342 22.4474354 EXIT FROM BFGS code FG_LNSRCH 0. -0.219300941 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.536574721 *** contribution from regularisation: 0.00478869537 *** contribution from error: -0.541363418 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21658.8377 -0.219300941 59.7193527 EXIT FROM BFGS code FG_LNSRCH 0. -0.280087203 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.535754085 *** contribution from regularisation: 0.00708454568 *** contribution from error: -0.542838633 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21625.7146 -0.280087203 25.9674587 EXIT FROM BFGS code FG_LNSRCH 0. -0.289530426 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.537492454 *** contribution from regularisation: 0.00538088754 *** contribution from error: -0.542873323 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21695.8828 -0.289530426 21.8826752 EXIT FROM BFGS code FG_LNSRCH 0. -0.289653331 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.537058353 *** contribution from regularisation: 0.00581543613 *** contribution from error: -0.5428738 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21678.361 -0.289653331 21.6327419 EXIT FROM BFGS code FG_LNSRCH 0. -0.28965342 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.537243307 *** contribution from regularisation: 0.00563050993 *** contribution from error: -0.5428738 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21685.8256 -0.28965342 21.4862671 EXIT FROM BFGS code FG_LNSRCH 0. -0.28965342 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 32.0985031 sigma out 15 active outputs RANK 2 NODE 1 --> 17.416069 sigma out 15 active outputs RANK 3 NODE 3 --> 11.5898514 sigma out 15 active outputs RANK 4 NODE 8 --> 11.4706612 sigma out 15 active outputs RANK 5 NODE 11 --> 9.7033205 sigma out 15 active outputs RANK 6 NODE 12 --> 9.51108742 sigma out 15 active outputs RANK 7 NODE 5 --> 8.06059265 sigma out 15 active outputs RANK 8 NODE 7 --> 6.5069232 sigma out 15 active outputs RANK 9 NODE 10 --> 6.35660076 sigma out 15 active outputs RANK 10 NODE 4 --> 6.19294691 sigma out 15 active outputs RANK 11 NODE 6 --> 5.25790644 sigma out 15 active outputs RANK 12 NODE 9 --> 4.18003798 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 33.6003609 sigma in 12act. ( 33.6771126 sig out 1act.) RANK 2 NODE 1 --> 14.2739887 sigma in 12act. ( 11.4725409 sig out 1act.) RANK 3 NODE 11 --> 12.1548405 sigma in 12act. ( 9.78138828 sig out 1act.) RANK 4 NODE 2 --> 11.9753876 sigma in 12act. ( 9.76268291 sig out 1act.) RANK 5 NODE 8 --> 9.83412075 sigma in 12act. ( 6.82095432 sig out 1act.) RANK 6 NODE 9 --> 8.19071484 sigma in 12act. ( 5.84248304 sig out 1act.) RANK 7 NODE 10 --> 7.64065456 sigma in 12act. ( 6.10933828 sig out 1act.) RANK 8 NODE 14 --> 6.48452759 sigma in 12act. ( 4.94583988 sig out 1act.) RANK 9 NODE 13 --> 5.51171875 sigma in 12act. ( 3.73336315 sig out 1act.) RANK 10 NODE 5 --> 5.46378851 sigma in 12act. ( 3.97522688 sig out 1act.) RANK 11 NODE 7 --> 4.30605555 sigma in 12act. ( 2.61338115 sig out 1act.) RANK 12 NODE 15 --> 4.15854883 sigma in 12act. ( 2.27465463 sig out 1act.) RANK 13 NODE 12 --> 3.4005053 sigma in 12act. ( 1.03335297 sig out 1act.) RANK 14 NODE 4 --> 3.39719939 sigma in 12act. ( 1.49210989 sig out 1act.) RANK 15 NODE 3 --> 2.83900166 sigma in 12act. ( 1.38838243 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 33.6771126 sigma out 1act.( 33.6003609 sig in 12act.) RANK 2 NODE 1 --> 11.4725409 sigma out 1act.( 14.2739887 sig in 12act.) RANK 3 NODE 11 --> 9.78138828 sigma out 1act.( 12.1548405 sig in 12act.) RANK 4 NODE 2 --> 9.76268291 sigma out 1act.( 11.9753876 sig in 12act.) RANK 5 NODE 8 --> 6.82095432 sigma out 1act.( 9.83412075 sig in 12act.) RANK 6 NODE 10 --> 6.10933828 sigma out 1act.( 7.64065456 sig in 12act.) RANK 7 NODE 9 --> 5.84248304 sigma out 1act.( 8.19071484 sig in 12act.) RANK 8 NODE 14 --> 4.94583988 sigma out 1act.( 6.48452759 sig in 12act.) RANK 9 NODE 5 --> 3.97522688 sigma out 1act.( 5.46378851 sig in 12act.) RANK 10 NODE 13 --> 3.73336315 sigma out 1act.( 5.51171875 sig in 12act.) RANK 11 NODE 7 --> 2.61338115 sigma out 1act.( 4.30605555 sig in 12act.) RANK 12 NODE 15 --> 2.27465463 sigma out 1act.( 4.15854883 sig in 12act.) RANK 13 NODE 4 --> 1.49210989 sigma out 1act.( 3.39719939 sig in 12act.) RANK 14 NODE 3 --> 1.38838243 sigma out 1act.( 2.83900166 sig in 12act.) RANK 15 NODE 12 --> 1.03335297 sigma out 1act.( 3.4005053 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 40.5729446 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.537197232 *** contribution from regularisation: 0.00567654241 *** contribution from error: -0.5428738 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -21683.9675 -0.28965342 21.5864773 EXIT FROM BFGS code FG_LNSRCH 0. -0.28965342 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.537156999 *** contribution from regularisation: 0.00571678393 *** contribution from error: -0.5428738 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21682.3431 -0.28965342 21.4606266 EXIT FROM BFGS code NEW_X -21682.3431 -0.28965342 21.4606266 ENTER BFGS code NEW_X -21682.3431 -0.28965342 21.4606266 EXIT FROM BFGS code CONVERGENC -21682.3431 -0.28965342 21.4606266 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 44.2252121 sigma out 15 active outputs RANK 2 NODE 1 --> 25.6111107 sigma out 15 active outputs RANK 3 NODE 3 --> 17.528904 sigma out 15 active outputs RANK 4 NODE 8 --> 16.5231304 sigma out 15 active outputs RANK 5 NODE 12 --> 14.1923695 sigma out 15 active outputs RANK 6 NODE 11 --> 14.0543642 sigma out 15 active outputs RANK 7 NODE 5 --> 11.5099468 sigma out 15 active outputs RANK 8 NODE 7 --> 9.24323368 sigma out 15 active outputs RANK 9 NODE 10 --> 8.7640152 sigma out 15 active outputs RANK 10 NODE 4 --> 8.62615299 sigma out 15 active outputs RANK 11 NODE 6 --> 7.38742924 sigma out 15 active outputs RANK 12 NODE 9 --> 5.68002224 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 48.6871223 sigma in 12act. ( 49.9354897 sig out 1act.) RANK 2 NODE 1 --> 20.420681 sigma in 12act. ( 16.8422203 sig out 1act.) RANK 3 NODE 11 --> 17.3465157 sigma in 12act. ( 14.8925295 sig out 1act.) RANK 4 NODE 2 --> 16.5938568 sigma in 12act. ( 14.1918488 sig out 1act.) RANK 5 NODE 8 --> 13.4919252 sigma in 12act. ( 9.84796619 sig out 1act.) RANK 6 NODE 9 --> 10.9922113 sigma in 12act. ( 8.6795702 sig out 1act.) RANK 7 NODE 10 --> 10.4886036 sigma in 12act. ( 8.90301991 sig out 1act.) RANK 8 NODE 14 --> 8.6107626 sigma in 12act. ( 7.60969973 sig out 1act.) RANK 9 NODE 5 --> 7.40529203 sigma in 12act. ( 6.15125847 sig out 1act.) RANK 10 NODE 13 --> 7.06563282 sigma in 12act. ( 5.48787022 sig out 1act.) RANK 11 NODE 7 --> 5.44626617 sigma in 12act. ( 3.93216372 sig out 1act.) RANK 12 NODE 15 --> 4.96217012 sigma in 12act. ( 3.25221157 sig out 1act.) RANK 13 NODE 4 --> 3.80181265 sigma in 12act. ( 2.19478512 sig out 1act.) RANK 14 NODE 12 --> 3.54039407 sigma in 12act. ( 1.53727925 sig out 1act.) RANK 15 NODE 3 --> 3.20080805 sigma in 12act. ( 1.91244054 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 49.9354897 sigma out 1act.( 48.6871223 sig in 12act.) RANK 2 NODE 1 --> 16.8422203 sigma out 1act.( 20.420681 sig in 12act.) RANK 3 NODE 11 --> 14.8925295 sigma out 1act.( 17.3465157 sig in 12act.) RANK 4 NODE 2 --> 14.1918488 sigma out 1act.( 16.5938568 sig in 12act.) RANK 5 NODE 8 --> 9.84796619 sigma out 1act.( 13.4919252 sig in 12act.) RANK 6 NODE 10 --> 8.90301991 sigma out 1act.( 10.4886036 sig in 12act.) RANK 7 NODE 9 --> 8.6795702 sigma out 1act.( 10.9922113 sig in 12act.) RANK 8 NODE 14 --> 7.60969973 sigma out 1act.( 8.6107626 sig in 12act.) RANK 9 NODE 5 --> 6.15125847 sigma out 1act.( 7.40529203 sig in 12act.) RANK 10 NODE 13 --> 5.48787022 sigma out 1act.( 7.06563282 sig in 12act.) RANK 11 NODE 7 --> 3.93216372 sigma out 1act.( 5.44626617 sig in 12act.) RANK 12 NODE 15 --> 3.25221157 sigma out 1act.( 4.96217012 sig in 12act.) RANK 13 NODE 4 --> 2.19478512 sigma out 1act.( 3.80181265 sig in 12act.) RANK 14 NODE 3 --> 1.91244054 sigma out 1act.( 3.20080805 sig in 12act.) RANK 15 NODE 12 --> 1.53727925 sigma out 1act.( 3.54039407 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.1226158 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.537185729 *** contribution from regularisation: 0.00568805542 *** contribution from error: -0.5428738 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done