NNInput NNInputs_185.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 169739 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 33403 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 33403 Chosen entries: 33403 Signal fraction: 1 Background fraction: 0.245005 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 33403 Entries to split: 33403 Test with : 16701 Train with : 16701 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 33403 for Signal Prepared event 0 for Signal with 33403 events ====Entry 0 Variable Ht : 147.006 Variable LepAPt : 30.5393 Variable LepBPt : 15.4876 Variable MetSigLeptonsJets : 2.11691 Variable MetSpec : 17.0117 Variable SumEtLeptonsJets : 123.482 Variable VSumJetLeptonsPt : 38.8269 Variable addEt : 69.5511 Variable dPhiLepSumMet : 0.952509 Variable dPhiLeptons : 0.431247 Variable dRLeptons : 0.583611 Variable lep1_E : 46.6216 Variable lep2_E : 18.2884 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2185 Ht = 147.006 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.5393 LepAPt = 30.5393 LepBEt = 15.4881 LepBPt = 15.4876 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 23.5237 MetDelPhi = 0.808389 MetSig = 1.71418 MetSigLeptonsJets = 2.11691 MetSpec = 17.0117 Mjj = 0 MostCentralJetEta = -1.43393 MtllMet = 76.1567 Njets = 1 SB = 0 SumEt = 188.32 SumEtJets = 0 SumEtLeptonsJets = 123.482 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 38.8269 addEt = 69.5511 dPhiLepSumMet = 0.952509 dPhiLeptons = 0.431247 dRLeptons = 0.583611 diltype = 52 dimass = 12.6791 event = 96 jet1_Et = 77.4552 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.6216 lep2_E = 18.2884 rand = 0.999742 run = 231298 weight = 2.74614e-06 ===Show End Prepared event 10000 for Signal with 33403 events Prepared event 20000 for Signal with 33403 events Prepared event 30000 for Signal with 33403 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.242535 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4448 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 169739 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4448 negative weights. Signal fraction: 62.4202919 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.298584 65.6737747 67.2044678 68.5121155 69.5391388 70.4078522 71.2725296 72.2383423 73.1419373 73.9272003 74.6122131 75.3559647 76.1282501 76.8529205 77.484787 78.2763824 78.9498367 79.7041855 80.3912888 81.0806732 81.8955383 82.6923752 83.3991013 84.5328674 85.472435 86.5542374 87.6760483 88.8281097 90.0300293 91.4292603 92.8397827 94.278595 95.5653839 96.9924698 98.496109 100.226799 101.973648 103.628693 105.269066 106.780037 108.687149 110.550903 112.406631 114.111664 115.876854 117.84259 119.641769 121.035263 122.801132 124.412094 126.072266 127.812515 129.382095 130.945511 132.508301 134.055817 135.744568 137.243454 138.920517 140.502319 142.060913 143.448822 145.04715 146.577682 148.107605 149.647476 151.239929 152.993561 154.903625 156.531372 158.333832 159.973923 161.734436 163.70668 165.556091 167.540955 169.67746 171.84198 174.092896 176.469635 178.932068 181.283447 184.138458 186.96283 189.880264 192.866119 196.519638 200.58374 204.692551 209.196762 213.583344 218.872253 225.19931 232.731827 240.7659 251.51236 266.995789 290.924988 345.357391 803.538147 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.4029694 20.7615948 21.1007633 21.3690605 21.6201687 21.9080982 22.1480713 22.3876686 22.614975 22.8420448 23.0567284 23.2738724 23.4853172 23.719326 23.9535828 24.1896687 24.4072685 24.6097603 24.8510246 25.1063156 25.3022652 25.5299168 25.7347012 25.9523296 26.1786652 26.4127998 26.6088104 26.8393593 27.0851192 27.2979851 27.5763092 27.7850475 28.0197468 28.263401 28.5397453 28.7864876 29.0486584 29.2946205 29.5945206 29.8387413 30.1379738 30.4458733 30.7458878 31.0545921 31.352951 31.5920982 31.8495102 32.1602783 32.5162048 32.8791046 33.2145081 33.598587 33.9197769 34.3287735 34.7010155 35.0691376 35.5151596 35.8506203 36.2571144 36.6285439 37.0601196 37.4854431 37.8249474 38.2756882 38.7347336 39.1704369 39.6161575 40.0628128 40.5626144 40.8937645 41.4607048 41.9205017 42.4494705 42.9236526 43.4663849 44.0509071 44.6320152 45.1992912 45.8631058 46.6249466 47.3156738 47.9541092 48.7427406 49.5670853 50.3876572 51.2627945 52.2011757 53.1321793 54.2545319 55.3712006 56.5736198 57.8445358 59.1736908 60.5661392 62.350853 64.4801331 66.9552231 70.3552704 77.8922424 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0003643 10.1463242 10.2909317 10.3979702 10.5029774 10.6214066 10.7587318 10.8886671 11.0347185 11.165741 11.3224545 11.4565878 11.5767069 11.7050476 11.8537903 12.0334406 12.1874809 12.3241482 12.4972095 12.6727734 12.8299484 12.9901047 13.199213 13.3677654 13.5254631 13.7452679 13.8747358 14.0400372 14.2310343 14.4249029 14.6584501 14.8693638 15.0667896 15.271677 15.481102 15.6868095 15.8824024 16.1226234 16.3698502 16.5841446 16.8061256 17.0321293 17.2939034 17.5388031 17.7790031 17.9862728 18.1862259 18.443264 18.6866341 18.9418602 19.1368484 19.4181747 19.6852417 19.9574451 20.1827126 20.3522205 20.5991249 20.8516045 21.0772285 21.2730618 21.5085564 21.7326393 21.9536629 22.1066608 22.3469296 22.5770473 22.833786 23.0755768 23.3206406 23.5501785 23.7866249 24.0402908 24.2910786 24.5534725 24.8248005 25.0995369 25.3805332 25.6808395 25.9752045 26.2611809 26.5744934 26.9054146 27.2731247 27.5952702 27.9255486 28.3018417 28.7070694 29.1173 29.5380402 30.0409622 30.5578213 31.155117 31.7684517 32.4305801 33.0803452 33.8823013 34.9402466 36.3830338 38.354393 41.6343994 68.4152985 ------------------------------ Transdef: Tab for variable 5 1.0227313 2.72354746 3.18529844 3.46966696 3.75479174 3.97642279 4.12218142 4.24628162 4.380867 4.50339079 4.60656929 4.69988441 4.79140663 4.88899326 4.95922565 5.03445625 5.10946846 5.17167377 5.24062347 5.31421137 5.37877512 5.44099522 5.48994732 5.55085754 5.59599304 5.65316105 5.71062279 5.76297188 5.81213236 5.8598671 5.91096783 5.96176577 6.01365852 6.05403233 6.10042667 6.1454339 6.19365311 6.23584652 6.27834225 6.31902027 6.3734827 6.42033958 6.46997452 6.51078558 6.55437279 6.60803699 6.65873384 6.70563602 6.7564373 6.8039875 6.84804773 6.8930707 6.94268322 6.98729181 7.04301834 7.09931087 7.15856552 7.2066226 7.24901581 7.30576515 7.35997772 7.41799688 7.48126316 7.52219534 7.57967424 7.63348341 7.69824648 7.76141691 7.82714176 7.88628578 7.95015669 8.01402473 8.07991982 8.14066792 8.19586086 8.25979996 8.3227005 8.38205528 8.44299698 8.50971413 8.57914639 8.65328217 8.732584 8.80778694 8.88239288 8.96797943 9.05359077 9.13794327 9.23356438 9.32701302 9.42724419 9.55002308 9.68073845 9.82606125 10.002718 10.1873856 10.4670486 10.8272724 11.3819933 12.4203243 20.66782 ------------------------------ Transdef: Tab for variable 6 15.0042896 21.8469734 25.4987869 26.6050797 27.5715752 28.6099815 29.3848343 30.1284142 30.7738209 31.3942375 32.0630569 32.6337318 33.1254044 33.535244 33.9644966 34.5546761 34.9803543 35.4327164 35.8495674 36.2660789 36.6883163 37.0847588 37.501503 37.857254 38.2272415 38.603363 39.0000458 39.4519882 39.8288116 40.2364349 40.5968857 41.039566 41.46521 41.9949722 42.4682388 42.8981667 43.3624573 43.8208466 44.299942 44.7932434 45.3654556 45.9208374 46.6129379 47.21175 47.8730392 48.6170044 49.3152161 50.0726624 50.5882339 51.3499641 52.1855812 53.0416718 53.806694 54.7054138 55.5134544 56.318943 56.9740677 57.7749901 58.534893 59.2360382 60.0923691 60.9780922 61.8319931 62.6738815 63.5282135 64.3378906 65.1160812 65.937561 66.7351074 67.5841217 68.4266663 69.2409439 70.0332489 70.851387 71.6632538 72.5656891 73.4341888 74.3506012 75.2666626 76.2721405 76.8069153 77.7378387 78.7809906 79.799324 80.9237976 81.9846954 82.973175 84.3218155 85.7159958 87.0482559 88.4603882 90.219986 92.0354004 94.3066101 96.8384628 100.016975 103.830688 109.050095 116.54509 128.078781 252.779892 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.8443451 33.7202682 34.4934616 35.1299362 35.6507454 36.1005135 36.5911865 36.9948616 37.3923187 37.7676811 38.0611877 38.370575 38.7452774 39.0564575 39.3912201 39.7520866 40.0542412 40.3922844 40.7882881 41.1717453 41.52314 41.9144135 42.3329201 42.7840881 43.2293587 43.9491577 44.6079369 45.1993179 45.946373 46.7602921 47.5079727 48.4340057 49.2767181 50.1734047 51.1264572 52.223114 53.0351257 54.1057358 55.1625671 56.1687584 57.2329826 58.2392883 59.2975273 60.3044662 61.1811562 61.7698975 62.6793251 63.6828003 64.5439148 65.4354401 66.3117676 67.1944275 68.1435852 69.0450668 69.9467316 70.7750244 71.6531296 72.5009613 73.369751 74.282486 75.2866669 76.29216 77.1967926 78.2835541 79.3331528 80.5416489 81.6547775 82.8380432 83.9636154 85.1453552 86.5955811 87.8924561 89.3911057 90.840271 92.3428497 94.0349884 95.635231 97.4711456 99.0679016 100.93483 102.884605 105.012955 107.136703 109.709702 111.876404 114.53511 117.486412 120.298943 123.670456 127.666595 132.004715 136.340637 141.836807 148.148148 155.409561 165.07016 178.707642 197.498474 236.392807 522.386658 ------------------------------ Transdef: Tab for variable 8 2.89562607 25.3029976 28.9543934 30.9301147 32.113224 32.8750839 33.4353065 33.9002838 34.3773003 34.8317261 35.22789 35.6102753 36.0097008 36.3204498 36.6414413 36.9866562 37.3059387 37.5779495 37.8769379 38.1110001 38.4044571 38.7066803 39.0007477 39.2686462 39.5572433 39.8321304 40.1863937 40.5222931 40.9021759 41.2425308 41.5765152 42.027916 42.4428101 42.8161888 43.2421112 43.6837921 44.272644 44.7912865 45.2521057 45.9297714 46.5703087 47.2374115 47.958374 48.4500961 49.1651154 49.7260857 50.4498482 51.1510544 51.8349838 52.557373 53.2686462 53.991703 54.813591 55.5810623 56.3761749 57.1452065 57.9643555 58.6355743 59.3470154 60.1348953 60.831955 61.2910233 62.0284538 62.7898903 63.4765167 64.136261 64.8698196 65.5594788 66.2442017 66.9708252 67.755249 68.504631 69.2751617 70.0303192 70.7029877 71.5249481 72.3207703 73.0896149 73.8612061 74.6461182 75.6141663 76.4687347 77.521759 78.4991531 79.5177765 80.6123047 81.8706818 83.1943665 84.5180664 86.125824 87.4382629 89.1447372 91.1901855 93.4652557 96.428421 100.217209 104.600998 110.430191 119.258507 138.772293 323.817322 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.8013802 65.039917 66.7139282 67.9299774 68.8097687 69.8722153 70.5666504 71.3218536 72.1886673 72.9593201 73.7211304 74.3534698 75.0463409 75.6444092 76.3298416 76.9756012 77.4738464 78.1147461 78.7110062 79.3518372 79.8951569 80.5361481 81.1576462 81.8238297 82.5562439 83.1960907 83.8631439 84.7047806 85.4175568 86.2704163 87.2651978 88.3708038 89.2182159 90.0955658 91.234993 92.3363419 93.4849548 94.7405624 95.9082642 97.0526123 98.5374298 100.038452 101.541519 102.82 104.398003 105.698929 106.975754 108.317291 109.858841 111.307846 112.56292 113.958031 115.433624 116.831703 118.278519 119.715721 120.717453 122.157715 123.429535 124.845802 126.167847 127.530869 128.764572 130.039032 131.33989 132.563873 133.851837 135.178101 136.336609 137.65036 138.95813 140.184006 141.413681 142.614777 143.885986 145.066925 146.290543 147.539444 148.677704 150.025482 151.393341 152.697998 154.113876 155.742828 156.921341 158.463593 160.065704 161.723541 163.48114 165.303619 167.470474 169.886597 171.97171 174.890259 178.059875 181.799805 186.88858 193.740021 216.950989 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.943826675 1.32897794 1.56072211 1.72867703 1.86553037 1.96314263 2.05111361 2.13017845 2.19614172 2.25731325 2.31316853 2.36448288 2.40637827 2.44493103 2.47942162 2.51040721 2.5408752 2.56571889 2.59144735 2.61715221 2.64007187 2.66036558 2.6825068 2.70280933 2.7209444 2.73959398 2.75527143 2.7699616 2.78457594 2.79865694 2.81332588 2.82664013 2.83954692 2.84985876 2.86116934 2.86967897 2.87878227 2.88780212 2.89653683 2.90403318 2.91208076 2.91930056 2.92643666 2.93351364 2.94163895 2.94877338 2.95539474 2.96159458 2.9676075 2.97332954 2.979141 2.98456216 2.98922157 2.99463534 3.00084186 3.00516748 3.01013327 3.01472855 3.01935577 3.0233674 3.02823019 3.03169894 3.03534651 3.03890848 3.042243 3.04589891 3.049788 3.05365157 3.05708647 3.06086063 3.06404018 3.06736374 3.07080269 3.07393217 3.07738972 3.0802989 3.08303976 3.08587956 3.08917332 3.09190702 3.0946784 3.09705591 3.0999229 3.10242033 3.10478497 3.10755301 3.10993481 3.11257458 3.1152091 3.11782694 3.12056136 3.12273526 3.12521648 3.12777185 3.12991858 3.13213158 3.13444185 3.13660908 3.13914776 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00751625979 0.0132425427 0.0208080411 0.0270478725 0.0339490175 0.0411831141 0.0485610366 0.0562132001 0.0619596168 0.0693528056 0.0766017437 0.084076874 0.0919619203 0.0999448299 0.107394248 0.112036586 0.119385839 0.12654531 0.1340698 0.141208649 0.148006558 0.154289603 0.161154419 0.168101475 0.17384243 0.180294871 0.186150074 0.19191429 0.197688639 0.203806221 0.20871231 0.213781238 0.219368443 0.224681735 0.230348989 0.234359711 0.239177048 0.244686782 0.249197513 0.254397392 0.258761644 0.263732672 0.26861465 0.27421242 0.278905392 0.283787251 0.289050609 0.294014573 0.299883604 0.305808783 0.310796469 0.316225886 0.322262436 0.328081012 0.333696246 0.339328587 0.34504807 0.350086242 0.355482459 0.360194385 0.365721583 0.372244924 0.377952576 0.384024024 0.388998985 0.394404769 0.400706351 0.407485902 0.41344741 0.419998348 0.426347733 0.432515621 0.439055204 0.445632994 0.452447683 0.459528685 0.466857672 0.474892408 0.482570261 0.490689039 0.498897016 0.508265972 0.517352104 0.526235282 0.536750972 0.544793606 0.553701997 0.564269781 0.578368664 0.593194008 0.607235909 0.622808099 0.639928579 0.654467344 0.675506055 0.701775789 0.736021519 0.779116273 0.839678526 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.212759644 0.222827166 0.232049227 0.240164861 0.248418599 0.255517125 0.262609601 0.269749761 0.276764393 0.282714367 0.288588464 0.295283318 0.301214159 0.306587219 0.311938703 0.31779176 0.323564142 0.329146832 0.334845901 0.340613365 0.346173406 0.350299895 0.355291665 0.36038661 0.365585417 0.370865375 0.375487953 0.380565792 0.385015517 0.389677763 0.394711763 0.39925766 0.4029513 0.407173395 0.411201715 0.414549023 0.418301463 0.421723843 0.425412506 0.428967535 0.432469428 0.436615437 0.440053463 0.443417311 0.447251499 0.45126313 0.455649495 0.459790647 0.462761819 0.466949344 0.470902801 0.474586666 0.477941513 0.482238024 0.485887587 0.490600914 0.494909257 0.499097764 0.503082991 0.508399308 0.513111353 0.518805861 0.523848653 0.52897048 0.534507215 0.540410876 0.545986652 0.549320698 0.554945171 0.559888363 0.565334737 0.571171224 0.578021526 0.583243251 0.589115858 0.596277237 0.603479624 0.61008662 0.617774308 0.624460101 0.63277173 0.642206013 0.650391698 0.658384919 0.667373955 0.675553203 0.685445786 0.697149098 0.706462383 0.718914092 0.72887969 0.741909921 0.754675388 0.769870341 0.788458407 0.804653704 0.83044064 0.860045075 0.897742629 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.7275314 22.5211678 23.2751331 23.8719082 24.4354935 24.9434223 25.4001694 25.9636574 26.4696121 27.0169945 27.3563118 27.7732391 28.1631851 28.6086426 28.9583435 29.3178368 29.6999931 30.1139832 30.4780693 30.7794876 31.1490211 31.4949493 31.8569641 32.2396774 32.5480614 32.9288254 33.3110504 33.6955032 34.0814896 34.504818 34.8977203 35.2726746 35.6555824 36.0508003 36.4041748 36.8563995 37.2556648 37.5967712 38.0485077 38.4713821 38.8439713 39.3225632 39.7497597 40.1889076 40.6400261 41.1385269 41.613533 42.1559029 42.6266632 43.0649414 43.4457169 43.8721466 44.3717728 44.8775406 45.3684311 45.8919373 46.4355965 46.914093 47.4553146 47.9362755 48.4697037 49.0169373 49.6099625 50.215435 50.7575073 51.2528076 51.9414673 52.5054245 53.1447525 53.8456841 54.5093575 55.1558685 55.8395691 56.5361481 57.2978439 58.0867081 58.7520905 59.6462059 60.4174194 61.2136765 62.2065353 63.1298523 64.1437683 65.1935883 66.3304749 67.434906 68.1588898 69.4137878 70.8480225 72.3690948 74.013092 76.2591858 78.2485123 80.8257828 83.8897858 87.6026688 90.794754 96.3636475 107.223404 316.641113 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7159224 11.0963421 11.4992046 11.8219099 12.2425632 12.5105686 12.8671627 13.2051907 13.576622 13.8842649 14.2330379 14.544899 14.82728 15.1062927 15.4389391 15.7430754 16.0456123 16.3691998 16.5913124 16.8482933 17.1037292 17.3976326 17.7217522 18.0054398 18.2541237 18.5144157 18.7922459 19.080883 19.4110107 19.6816216 19.9511261 20.2411842 20.5269947 20.7794762 21.0596294 21.307827 21.5981884 21.8524132 22.081749 22.3409004 22.5973816 22.8717098 23.1202793 23.3634701 23.5943489 23.8436642 24.0972977 24.3279152 24.6043148 24.8782349 25.1339855 25.383522 25.5978928 25.848156 26.1139603 26.3920212 26.6841908 26.9873562 27.2521038 27.5548725 27.805069 27.9934521 28.2954559 28.5330658 28.7918968 29.1000195 29.40732 29.7567234 30.1051292 30.4221611 30.7615089 31.1266422 31.4872475 31.8761864 32.2799149 32.697464 33.095932 33.4473915 33.7293739 34.1168442 34.5962219 35.0820084 35.610733 36.1692734 36.7478447 37.3254929 37.9718857 38.6347961 39.4724197 40.3344002 41.1870499 42.0553665 43.2498016 44.3761253 45.9913025 47.8357391 50.3419495 53.9933929 59.9925537 115.483475 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 63.3 50.4 52.0 29.8 49.1 61.4 53.1 61.5 -24.1 -21.3 -41.0 18.2 22.9 2 63.3 100.0 68.5 58.1 41.9 71.0 94.7 77.6 92.3 -43.6 -25.8 -51.5 37.4 30.1 3 50.4 68.5 100.0 45.0 20.2 42.3 70.1 59.4 75.9 -12.2 -30.0 -59.3 67.2 21.6 4 52.0 58.1 45.0 100.0 16.5 36.4 59.7 49.6 61.9 -11.5 -31.6 -62.3 22.4 70.3 5 29.8 41.9 20.2 16.5 100.0 84.7 15.6 62.5 62.2 19.8 -10.8 -16.8 5.9 4.1 6 49.1 71.0 42.3 36.4 84.7 100.0 51.1 80.4 81.2 -6.7 -19.3 -33.8 19.1 15.8 7 61.4 94.7 70.1 59.7 15.6 51.1 100.0 69.2 81.4 -52.2 -24.6 -51.5 40.1 32.6 8 53.1 77.6 59.4 49.6 62.5 80.4 69.2 100.0 85.5 -11.6 -25.4 -46.5 33.5 26.8 9 61.5 92.3 75.9 61.9 62.2 81.2 81.4 85.5 100.0 -19.9 -29.5 -57.7 44.1 33.6 10 -24.1 -43.6 -12.2 -11.5 19.8 -6.7 -52.2 -11.6 -19.9 100.0 0.8 6.6 -3.0 -4.0 11 -21.3 -25.8 -30.0 -31.6 -10.8 -19.3 -24.6 -25.4 -29.5 0.8 100.0 55.3 -16.1 -20.3 12 -41.0 -51.5 -59.3 -62.3 -16.8 -33.8 -51.5 -46.5 -57.7 6.6 55.3 100.0 -33.0 -35.9 13 18.2 37.4 67.2 22.4 5.9 19.1 40.1 33.5 44.1 -3.0 -16.1 -33.0 100.0 45.8 14 22.9 30.1 21.6 70.3 4.1 15.8 32.6 26.8 33.6 -4.0 -20.3 -35.9 45.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 162.769621 TOTAL CORRELATION OF ALL VARIABLES 70.1973188 ROUND 1: MAX CORR ( 70.1931901) AFTER KILLING INPUT VARIABLE 11 CONTR 0.761334886 ROUND 2: MAX CORR ( 70.1740236) AFTER KILLING INPUT VARIABLE 8 CONTR 1.64022917 ROUND 3: MAX CORR ( 70.143662) AFTER KILLING INPUT VARIABLE 14 CONTR 2.06404118 ROUND 4: MAX CORR ( 70.110604) AFTER KILLING INPUT VARIABLE 12 CONTR 2.15326153 ROUND 5: MAX CORR ( 70.042048) AFTER KILLING INPUT VARIABLE 2 CONTR 3.09972508 ROUND 6: MAX CORR ( 69.9026456) AFTER KILLING INPUT VARIABLE 10 CONTR 4.41685712 ROUND 7: MAX CORR ( 69.6310832) AFTER KILLING INPUT VARIABLE 6 CONTR 6.15565777 ROUND 8: MAX CORR ( 68.7331) AFTER KILLING INPUT VARIABLE 9 CONTR 11.1466905 ROUND 9: MAX CORR ( 67.3806271) AFTER KILLING INPUT VARIABLE 13 CONTR 13.5679816 ROUND 10: MAX CORR ( 67.0160905) AFTER KILLING INPUT VARIABLE 3 CONTR 6.99946632 ROUND 11: MAX CORR ( 64.7396263) AFTER KILLING INPUT VARIABLE 4 CONTR 17.3186942 ROUND 12: MAX CORR ( 61.4137953) AFTER KILLING INPUT VARIABLE 5 CONTR 20.483285 LAST REMAINING VARIABLE: 7 total correlation to target: 70.1973188 % total significance: 115.162818 sigma correlations of single variables to target: variable 2: 63.3231815 % , in sigma: 103.885392 variable 3: 50.4274013 % , in sigma: 82.7291086 variable 4: 51.9776898 % , in sigma: 85.2724479 variable 5: 29.8205309 % , in sigma: 48.9223296 variable 6: 49.063828 % , in sigma: 80.4920868 variable 7: 61.4137953 % , in sigma: 100.752932 variable 8: 53.107406 % , in sigma: 87.1258135 variable 9: 61.4877963 % , in sigma: 100.874335 variable 10: -24.108413 % , in sigma: 39.5512652 variable 11: -21.335725 % , in sigma: 35.0025079 variable 12: -40.9697397 % , in sigma: 67.2132602 variable 13: 18.2410434 % , in sigma: 29.9255014 variable 14: 22.8585667 % , in sigma: 37.500819 variables sorted by significance: 1 most relevant variable 7 corr 61.4137955 , in sigma: 100.752933 2 most relevant variable 5 corr 20.4832859 , in sigma: 33.6040316 3 most relevant variable 4 corr 17.3186951 , in sigma: 28.4123348 4 most relevant variable 3 corr 6.99946642 , in sigma: 11.4830351 5 most relevant variable 13 corr 13.5679817 , in sigma: 22.2590696 6 most relevant variable 9 corr 11.1466904 , in sigma: 18.2867991 7 most relevant variable 6 corr 6.15565777 , in sigma: 10.0987175 8 most relevant variable 10 corr 4.41685724 , in sigma: 7.24611329 9 most relevant variable 2 corr 3.09972501 , in sigma: 5.08528063 10 most relevant variable 12 corr 2.15326142 , in sigma: 3.53255162 11 most relevant variable 14 corr 2.06404114 , in sigma: 3.38618051 12 most relevant variable 8 corr 1.64022923 , in sigma: 2.69089222 13 most relevant variable 11 corr 0.761334896 , in sigma: 1.24901454 global correlations between input variables: variable 2: 99.2418741 % variable 3: 93.7943401 % variable 4: 91.4383255 % variable 5: 95.5549646 % variable 6: 94.1096244 % variable 7: 98.858755 % variable 8: 90.8455496 % variable 9: 98.9234795 % variable 10: 71.7817301 % variable 11: 56.1620689 % variable 12: 78.5473062 % variable 13: 86.1799885 % variable 14: 87.4244852 % significance loss when removing single variables: variable 2: corr = 2.08831509 % , sigma = 3.42600336 variable 3: corr = 15.630691 % , sigma = 25.6430651 variable 4: corr = 15.1032828 % , sigma = 24.777821 variable 5: corr = 10.7540879 % , sigma = 17.6427118 variable 6: corr = 5.58921369 % , sigma = 9.16943279 variable 7: corr = 6.77111774 % , sigma = 11.1084157 variable 8: corr = 1.67276837 % , sigma = 2.74427459 variable 9: corr = 10.5869032 % , sigma = 17.3684355 variable 10: corr = 3.63256466 % , sigma = 5.95943533 variable 11: corr = 0.761334886 % , sigma = 1.24901452 variable 12: corr = 2.27085772 % , sigma = 3.72547525 variable 13: corr = 7.11848774 % , sigma = 11.6782965 variable 14: corr = 2.07094783 % , sigma = 3.39751134 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 21.7123699 sigma out 15 active outputs RANK 2 NODE 9 --> 16.519434 sigma out 15 active outputs RANK 3 NODE 10 --> 16.3171616 sigma out 15 active outputs RANK 4 NODE 3 --> 15.5077972 sigma out 15 active outputs RANK 5 NODE 2 --> 14.9151697 sigma out 15 active outputs RANK 6 NODE 7 --> 14.5664101 sigma out 15 active outputs RANK 7 NODE 5 --> 14.2353859 sigma out 15 active outputs RANK 8 NODE 1 --> 12.1711626 sigma out 15 active outputs RANK 9 NODE 4 --> 9.70737267 sigma out 15 active outputs RANK 10 NODE 8 --> 7.91168976 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 24.921175 sigma in 10act. ( 24.2540359 sig out 1act.) RANK 2 NODE 4 --> 20.8360996 sigma in 10act. ( 24.2131329 sig out 1act.) RANK 3 NODE 10 --> 17.7577801 sigma in 10act. ( 17.8927898 sig out 1act.) RANK 4 NODE 3 --> 14.3198442 sigma in 10act. ( 15.4028187 sig out 1act.) RANK 5 NODE 9 --> 13.1273022 sigma in 10act. ( 13.4041719 sig out 1act.) RANK 6 NODE 6 --> 11.4167604 sigma in 10act. ( 12.8757448 sig out 1act.) RANK 7 NODE 1 --> 10.3287525 sigma in 10act. ( 9.2885952 sig out 1act.) RANK 8 NODE 5 --> 9.46875381 sigma in 10act. ( 11.1130676 sig out 1act.) RANK 9 NODE 15 --> 7.33581734 sigma in 10act. ( 6.80245304 sig out 1act.) RANK 10 NODE 14 --> 5.18683147 sigma in 10act. ( 4.15859175 sig out 1act.) RANK 11 NODE 12 --> 5.02599621 sigma in 10act. ( 2.68172717 sig out 1act.) RANK 12 NODE 7 --> 2.61147261 sigma in 10act. ( 2.84465456 sig out 1act.) RANK 13 NODE 8 --> 1.63232553 sigma in 10act. ( 1.26328993 sig out 1act.) RANK 14 NODE 13 --> 1.58923435 sigma in 10act. ( 0.913042665 sig out 1act.) RANK 15 NODE 2 --> 0.844092131 sigma in 10act. ( 1.16348636 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 24.2540359 sigma out 1act.( 24.921175 sig in 10act.) RANK 2 NODE 4 --> 24.2131329 sigma out 1act.( 20.8360996 sig in 10act.) RANK 3 NODE 10 --> 17.8927898 sigma out 1act.( 17.7577801 sig in 10act.) RANK 4 NODE 3 --> 15.4028187 sigma out 1act.( 14.3198442 sig in 10act.) RANK 5 NODE 9 --> 13.4041719 sigma out 1act.( 13.1273022 sig in 10act.) RANK 6 NODE 6 --> 12.8757448 sigma out 1act.( 11.4167604 sig in 10act.) RANK 7 NODE 5 --> 11.1130676 sigma out 1act.( 9.46875381 sig in 10act.) RANK 8 NODE 1 --> 9.2885952 sigma out 1act.( 10.3287525 sig in 10act.) RANK 9 NODE 15 --> 6.80245304 sigma out 1act.( 7.33581734 sig in 10act.) RANK 10 NODE 14 --> 4.15859175 sigma out 1act.( 5.18683147 sig in 10act.) RANK 11 NODE 7 --> 2.84465456 sigma out 1act.( 2.61147261 sig in 10act.) RANK 12 NODE 12 --> 2.68172717 sigma out 1act.( 5.02599621 sig in 10act.) RANK 13 NODE 8 --> 1.26328993 sigma out 1act.( 1.63232553 sig in 10act.) RANK 14 NODE 2 --> 1.16348636 sigma out 1act.( 0.844092131 sig in 10act.) RANK 15 NODE 13 --> 0.913042665 sigma out 1act.( 1.58923435 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 48.6806107 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 24.8285809 sigma out 15 active outputs RANK 2 NODE 6 --> 23.0097103 sigma out 15 active outputs RANK 3 NODE 2 --> 17.6487904 sigma out 15 active outputs RANK 4 NODE 9 --> 17.0509758 sigma out 15 active outputs RANK 5 NODE 7 --> 16.1611881 sigma out 15 active outputs RANK 6 NODE 3 --> 15.6896372 sigma out 15 active outputs RANK 7 NODE 5 --> 15.3169928 sigma out 15 active outputs RANK 8 NODE 8 --> 13.7388582 sigma out 15 active outputs RANK 9 NODE 1 --> 13.2385473 sigma out 15 active outputs RANK 10 NODE 4 --> 10.127593 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 25.8587074 sigma in 10act. ( 24.9927025 sig out 1act.) RANK 2 NODE 4 --> 22.5794945 sigma in 10act. ( 24.3326225 sig out 1act.) RANK 3 NODE 3 --> 17.7399445 sigma in 10act. ( 15.7429132 sig out 1act.) RANK 4 NODE 10 --> 17.2747784 sigma in 10act. ( 17.6367073 sig out 1act.) RANK 5 NODE 2 --> 16.7797985 sigma in 10act. ( 9.63068104 sig out 1act.) RANK 6 NODE 6 --> 14.7833424 sigma in 10act. ( 11.9892578 sig out 1act.) RANK 7 NODE 9 --> 13.3857927 sigma in 10act. ( 12.4830265 sig out 1act.) RANK 8 NODE 5 --> 11.8631668 sigma in 10act. ( 11.8542938 sig out 1act.) RANK 9 NODE 1 --> 9.94042206 sigma in 10act. ( 8.02438068 sig out 1act.) RANK 10 NODE 15 --> 8.19774151 sigma in 10act. ( 5.95770025 sig out 1act.) RANK 11 NODE 14 --> 7.03722286 sigma in 10act. ( 3.62934613 sig out 1act.) RANK 12 NODE 7 --> 6.6508007 sigma in 10act. ( 3.84726119 sig out 1act.) RANK 13 NODE 12 --> 5.78151369 sigma in 10act. ( 1.3859489 sig out 1act.) RANK 14 NODE 13 --> 5.146595 sigma in 10act. ( 1.19374359 sig out 1act.) RANK 15 NODE 8 --> 5.03250933 sigma in 10act. ( 1.67886257 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 24.9927025 sigma out 1act.( 25.8587074 sig in 10act.) RANK 2 NODE 4 --> 24.3326225 sigma out 1act.( 22.5794945 sig in 10act.) RANK 3 NODE 10 --> 17.6367073 sigma out 1act.( 17.2747784 sig in 10act.) RANK 4 NODE 3 --> 15.7429132 sigma out 1act.( 17.7399445 sig in 10act.) RANK 5 NODE 9 --> 12.4830265 sigma out 1act.( 13.3857927 sig in 10act.) RANK 6 NODE 6 --> 11.9892578 sigma out 1act.( 14.7833424 sig in 10act.) RANK 7 NODE 5 --> 11.8542938 sigma out 1act.( 11.8631668 sig in 10act.) RANK 8 NODE 2 --> 9.63068104 sigma out 1act.( 16.7797985 sig in 10act.) RANK 9 NODE 1 --> 8.02438068 sigma out 1act.( 9.94042206 sig in 10act.) RANK 10 NODE 15 --> 5.95770025 sigma out 1act.( 8.19774151 sig in 10act.) RANK 11 NODE 7 --> 3.84726119 sigma out 1act.( 6.6508007 sig in 10act.) RANK 12 NODE 14 --> 3.62934613 sigma out 1act.( 7.03722286 sig in 10act.) RANK 13 NODE 8 --> 1.67886257 sigma out 1act.( 5.03250933 sig in 10act.) RANK 14 NODE 12 --> 1.3859489 sigma out 1act.( 5.78151369 sig in 10act.) RANK 15 NODE 13 --> 1.19374359 sigma out 1act.( 5.146595 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 49.4213486 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.497036159 *** contribution from regularisation: 0.00484175421 *** contribution from error: -0.501877904 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.541752517 *** contribution from regularisation: 0.00222475687 *** contribution from error: -0.543977261 *********************************************** -----------------> Test sample ENTER BFGS code START -45986.4835 0.273920625 0.136595935 EXIT FROM BFGS code FG_START 0. 0.273920625 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.562628806 *** contribution from regularisation: 0.00215407833 *** contribution from error: -0.564782858 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47749.7428 0.273920625 48.6095428 EXIT FROM BFGS code FG_LNSRCH 0. 0.296934843 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.575735092 *** contribution from regularisation: 0.002804599 *** contribution from error: -0.57853967 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48862.062 0.296934843 79.4232635 EXIT FROM BFGS code NEW_X -48862.062 0.296934843 79.4232635 ENTER BFGS code NEW_X -48862.062 0.296934843 79.4232635 EXIT FROM BFGS code FG_LNSRCH 0. 0.32046923 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.578528047 *** contribution from regularisation: 0.00276727648 *** contribution from error: -0.581295311 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49099.0961 0.32046923 21.1444263 EXIT FROM BFGS code NEW_X -49099.0961 0.32046923 21.1444263 ENTER BFGS code NEW_X -49099.0961 0.32046923 21.1444263 EXIT FROM BFGS code FG_LNSRCH 0. 0.333312809 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.57935369 *** contribution from regularisation: 0.00273058284 *** contribution from error: -0.582084298 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49169.1707 0.333312809 -2.91545749 EXIT FROM BFGS code NEW_X -49169.1707 0.333312809 -2.91545749 ENTER BFGS code NEW_X -49169.1707 0.333312809 -2.91545749 EXIT FROM BFGS code FG_LNSRCH 0. 0.342463493 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.579933524 *** contribution from regularisation: 0.00268580625 *** contribution from error: -0.582619309 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49218.3807 0.342463493 -22.0730648 EXIT FROM BFGS code NEW_X -49218.3807 0.342463493 -22.0730648 ENTER BFGS code NEW_X -49218.3807 0.342463493 -22.0730648 EXIT FROM BFGS code FG_LNSRCH 0. 0.339067519 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.580382705 *** contribution from regularisation: 0.00280793803 *** contribution from error: -0.58319062 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49256.5007 0.339067519 -23.5202446 EXIT FROM BFGS code NEW_X -49256.5007 0.339067519 -23.5202446 ENTER BFGS code NEW_X -49256.5007 0.339067519 -23.5202446 EXIT FROM BFGS code FG_LNSRCH 0. 0.31271717 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.582020879 *** contribution from regularisation: 0.00261746161 *** contribution from error: -0.584638357 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49395.5296 0.31271717 -29.4905987 EXIT FROM BFGS code NEW_X -49395.5296 0.31271717 -29.4905987 ENTER BFGS code NEW_X -49395.5296 0.31271717 -29.4905987 EXIT FROM BFGS code FG_LNSRCH 0. 0.215830922 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 32.1671486 sigma out 15 active outputs RANK 2 NODE 8 --> 19.5497761 sigma out 15 active outputs RANK 3 NODE 6 --> 17.2825584 sigma out 15 active outputs RANK 4 NODE 2 --> 15.9451799 sigma out 15 active outputs RANK 5 NODE 1 --> 13.0968266 sigma out 15 active outputs RANK 6 NODE 9 --> 12.1527376 sigma out 15 active outputs RANK 7 NODE 7 --> 9.94185734 sigma out 15 active outputs RANK 8 NODE 5 --> 9.05290413 sigma out 15 active outputs RANK 9 NODE 4 --> 8.51733208 sigma out 15 active outputs RANK 10 NODE 3 --> 8.0181942 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 29.9097042 sigma in 10act. ( 24.6482048 sig out 1act.) RANK 2 NODE 2 --> 24.6280231 sigma in 10act. ( 32.5923004 sig out 1act.) RANK 3 NODE 11 --> 18.138401 sigma in 10act. ( 15.6833229 sig out 1act.) RANK 4 NODE 3 --> 12.556942 sigma in 10act. ( 13.7694778 sig out 1act.) RANK 5 NODE 10 --> 11.8760977 sigma in 10act. ( 9.65119553 sig out 1act.) RANK 6 NODE 5 --> 10.8285189 sigma in 10act. ( 8.00431252 sig out 1act.) RANK 7 NODE 15 --> 8.90685177 sigma in 10act. ( 8.10437965 sig out 1act.) RANK 8 NODE 8 --> 8.81610584 sigma in 10act. ( 8.04515648 sig out 1act.) RANK 9 NODE 7 --> 7.21760082 sigma in 10act. ( 5.16511154 sig out 1act.) RANK 10 NODE 9 --> 6.90539503 sigma in 10act. ( 5.7029295 sig out 1act.) RANK 11 NODE 6 --> 5.85697174 sigma in 10act. ( 3.91487455 sig out 1act.) RANK 12 NODE 13 --> 5.26908731 sigma in 10act. ( 3.49625993 sig out 1act.) RANK 13 NODE 14 --> 4.26241112 sigma in 10act. ( 2.77074695 sig out 1act.) RANK 14 NODE 1 --> 4.08251953 sigma in 10act. ( 3.23633528 sig out 1act.) RANK 15 NODE 12 --> 2.61901164 sigma in 10act. ( 1.00466788 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 32.5923004 sigma out 1act.( 24.6280231 sig in 10act.) RANK 2 NODE 4 --> 24.6482048 sigma out 1act.( 29.9097042 sig in 10act.) RANK 3 NODE 11 --> 15.6833229 sigma out 1act.( 18.138401 sig in 10act.) RANK 4 NODE 3 --> 13.7694778 sigma out 1act.( 12.556942 sig in 10act.) RANK 5 NODE 10 --> 9.65119553 sigma out 1act.( 11.8760977 sig in 10act.) RANK 6 NODE 15 --> 8.10437965 sigma out 1act.( 8.90685177 sig in 10act.) RANK 7 NODE 8 --> 8.04515648 sigma out 1act.( 8.81610584 sig in 10act.) RANK 8 NODE 5 --> 8.00431252 sigma out 1act.( 10.8285189 sig in 10act.) RANK 9 NODE 9 --> 5.7029295 sigma out 1act.( 6.90539503 sig in 10act.) RANK 10 NODE 7 --> 5.16511154 sigma out 1act.( 7.21760082 sig in 10act.) RANK 11 NODE 6 --> 3.91487455 sigma out 1act.( 5.85697174 sig in 10act.) RANK 12 NODE 13 --> 3.49625993 sigma out 1act.( 5.26908731 sig in 10act.) RANK 13 NODE 1 --> 3.23633528 sigma out 1act.( 4.08251953 sig in 10act.) RANK 14 NODE 14 --> 2.77074695 sigma out 1act.( 4.26241112 sig in 10act.) RANK 15 NODE 12 --> 1.00466788 sigma out 1act.( 2.61901164 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 49.9888916 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.578999817 *** contribution from regularisation: 0.00259255804 *** contribution from error: -0.581592381 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49139.1377 0.215830922 145.85936 EXIT FROM BFGS code FG_LNSRCH 0. 0.301550239 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.581915677 *** contribution from regularisation: 0.00290047447 *** contribution from error: -0.584816158 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49386.604 0.301550239 -12.0410643 EXIT FROM BFGS code FG_LNSRCH 0. 0.311224908 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.582057118 *** contribution from regularisation: 0.00261289813 *** contribution from error: -0.584670007 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49398.6068 0.311224908 -27.2614861 EXIT FROM BFGS code FG_LNSRCH 0. 0.310899407 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.58199662 *** contribution from regularisation: 0.00268028374 *** contribution from error: -0.584676921 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49393.4709 0.310899407 -26.622654 EXIT FROM BFGS code FG_LNSRCH 0. 0.311220855 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.581976235 *** contribution from regularisation: 0.00269390363 *** contribution from error: -0.584670126 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49391.7388 0.311220855 -27.0325546 EXIT FROM BFGS code FG_LNSRCH 0. 0.311224908 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.582037151 *** contribution from regularisation: 0.00263285148 *** contribution from error: -0.584670007 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49396.9134 0.311224908 -27.0169353 EXIT FROM BFGS code NEW_X -49396.9134 0.311224908 -27.0169353 ENTER BFGS code NEW_X -49396.9134 0.311224908 -27.0169353 EXIT FROM BFGS code FG_LNSRCH 0. 0.280418456 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.582451522 *** contribution from regularisation: 0.00263015158 *** contribution from error: -0.585081697 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49432.0779 0.280418456 7.77023411 EXIT FROM BFGS code NEW_X -49432.0779 0.280418456 7.77023411 ENTER BFGS code NEW_X -49432.0779 0.280418456 7.77023411 EXIT FROM BFGS code FG_LNSRCH 0. 0.271231472 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.582557142 *** contribution from regularisation: 0.00263662403 *** contribution from error: -0.585193753 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49441.04 0.271231472 20.5730457 EXIT FROM BFGS code NEW_X -49441.04 0.271231472 20.5730457 ENTER BFGS code NEW_X -49441.04 0.271231472 20.5730457 EXIT FROM BFGS code FG_LNSRCH 0. 0.262070537 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.583007634 *** contribution from regularisation: 0.00239257794 *** contribution from error: -0.585400224 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49479.2751 0.262070537 27.4228764 EXIT FROM BFGS code NEW_X -49479.2751 0.262070537 27.4228764 ENTER BFGS code NEW_X -49479.2751 0.262070537 27.4228764 EXIT FROM BFGS code FG_LNSRCH 0. 0.269051433 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.582897186 *** contribution from regularisation: 0.002517435 *** contribution from error: -0.585414648 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49469.9025 0.269051433 25.1097298 EXIT FROM BFGS code FG_LNSRCH 0. 0.263910681 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 32.0265465 sigma out 15 active outputs RANK 2 NODE 8 --> 18.9633827 sigma out 15 active outputs RANK 3 NODE 2 --> 18.2165108 sigma out 15 active outputs RANK 4 NODE 6 --> 17.8432312 sigma out 15 active outputs RANK 5 NODE 1 --> 14.6941853 sigma out 15 active outputs RANK 6 NODE 9 --> 12.9810467 sigma out 15 active outputs RANK 7 NODE 7 --> 10.7249718 sigma out 15 active outputs RANK 8 NODE 5 --> 10.4534216 sigma out 15 active outputs RANK 9 NODE 4 --> 9.97082806 sigma out 15 active outputs RANK 10 NODE 3 --> 6.79363394 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 30.2360649 sigma in 10act. ( 26.1349354 sig out 1act.) RANK 2 NODE 2 --> 25.2853336 sigma in 10act. ( 30.6902561 sig out 1act.) RANK 3 NODE 11 --> 20.173912 sigma in 10act. ( 17.87467 sig out 1act.) RANK 4 NODE 5 --> 12.801362 sigma in 10act. ( 9.21374607 sig out 1act.) RANK 5 NODE 10 --> 12.0290432 sigma in 10act. ( 9.19729519 sig out 1act.) RANK 6 NODE 3 --> 11.5384235 sigma in 10act. ( 11.5083179 sig out 1act.) RANK 7 NODE 9 --> 8.65651417 sigma in 10act. ( 7.52566767 sig out 1act.) RANK 8 NODE 15 --> 8.62358856 sigma in 10act. ( 7.80959892 sig out 1act.) RANK 9 NODE 8 --> 8.42543793 sigma in 10act. ( 7.45630217 sig out 1act.) RANK 10 NODE 7 --> 7.70998287 sigma in 10act. ( 5.18419027 sig out 1act.) RANK 11 NODE 13 --> 6.01965904 sigma in 10act. ( 3.99104714 sig out 1act.) RANK 12 NODE 6 --> 5.87122488 sigma in 10act. ( 3.66669965 sig out 1act.) RANK 13 NODE 14 --> 4.24327803 sigma in 10act. ( 2.48609257 sig out 1act.) RANK 14 NODE 1 --> 3.49103403 sigma in 10act. ( 1.7887404 sig out 1act.) RANK 15 NODE 12 --> 2.6329124 sigma in 10act. ( 1.20100498 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 30.6902561 sigma out 1act.( 25.2853336 sig in 10act.) RANK 2 NODE 4 --> 26.1349354 sigma out 1act.( 30.2360649 sig in 10act.) RANK 3 NODE 11 --> 17.87467 sigma out 1act.( 20.173912 sig in 10act.) RANK 4 NODE 3 --> 11.5083179 sigma out 1act.( 11.5384235 sig in 10act.) RANK 5 NODE 5 --> 9.21374607 sigma out 1act.( 12.801362 sig in 10act.) RANK 6 NODE 10 --> 9.19729519 sigma out 1act.( 12.0290432 sig in 10act.) RANK 7 NODE 15 --> 7.80959892 sigma out 1act.( 8.62358856 sig in 10act.) RANK 8 NODE 9 --> 7.52566767 sigma out 1act.( 8.65651417 sig in 10act.) RANK 9 NODE 8 --> 7.45630217 sigma out 1act.( 8.42543793 sig in 10act.) RANK 10 NODE 7 --> 5.18419027 sigma out 1act.( 7.70998287 sig in 10act.) RANK 11 NODE 13 --> 3.99104714 sigma out 1act.( 6.01965904 sig in 10act.) RANK 12 NODE 6 --> 3.66669965 sigma out 1act.( 5.87122488 sig in 10act.) RANK 13 NODE 14 --> 2.48609257 sigma out 1act.( 4.24327803 sig in 10act.) RANK 14 NODE 1 --> 1.7887404 sigma out 1act.( 3.49103403 sig in 10act.) RANK 15 NODE 12 --> 1.20100498 sigma out 1act.( 2.6329124 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 49.8663063 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.582409739 *** contribution from regularisation: 0.00308389287 *** contribution from error: -0.585493624 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49428.53 0.263910681 28.9357986 EXIT FROM BFGS code FG_LNSRCH 0. 0.262144834 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.582696438 *** contribution from regularisation: 0.00270869676 *** contribution from error: -0.585405111 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49452.8655 0.262144834 28.4399395 EXIT FROM BFGS code FG_LNSRCH 0. 0.262070805 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.582705915 *** contribution from regularisation: 0.00269433879 *** contribution from error: -0.585400283 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49453.6666 0.262070805 28.5166397 EXIT FROM BFGS code FG_LNSRCH 0. 0.262070537 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.582708716 *** contribution from regularisation: 0.00269151269 *** contribution from error: -0.585400224 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49453.9048 0.262070537 28.5468559 EXIT FROM BFGS code FG_LNSRCH 0. 0.262070537 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.582724094 *** contribution from regularisation: 0.00267611281 *** contribution from error: -0.585400224 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49455.2118 0.262070537 28.5330753 EXIT FROM BFGS code FG_LNSRCH 0. 0.262070537 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.582713306 *** contribution from regularisation: 0.00268692104 *** contribution from error: -0.585400224 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49454.2945 0.262070537 28.45364 EXIT FROM BFGS code FG_LNSRCH 0. 0.262070537 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.58268404 *** contribution from regularisation: 0.00271619344 *** contribution from error: -0.585400224 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49451.8102 0.262070537 28.6151485 EXIT FROM BFGS code NEW_X -49451.8102 0.262070537 28.6151485 ENTER BFGS code NEW_X -49451.8102 0.262070537 28.6151485 EXIT FROM BFGS code CONVERGENC -49451.8102 0.262070537 28.6151485 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 54.6447906 sigma out 15 active outputs RANK 2 NODE 8 --> 30.8742046 sigma out 15 active outputs RANK 3 NODE 2 --> 30.1114273 sigma out 15 active outputs RANK 4 NODE 6 --> 30.0081768 sigma out 15 active outputs RANK 5 NODE 1 --> 24.4215984 sigma out 15 active outputs RANK 6 NODE 9 --> 22.623991 sigma out 15 active outputs RANK 7 NODE 7 --> 17.9782753 sigma out 15 active outputs RANK 8 NODE 5 --> 17.543869 sigma out 15 active outputs RANK 9 NODE 4 --> 16.14505 sigma out 15 active outputs RANK 10 NODE 3 --> 12.0995588 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 53.2443275 sigma in 10act. ( 46.5022163 sig out 1act.) RANK 2 NODE 2 --> 42.5061646 sigma in 10act. ( 54.2995491 sig out 1act.) RANK 3 NODE 11 --> 34.2380409 sigma in 10act. ( 30.6223888 sig out 1act.) RANK 4 NODE 5 --> 20.5757446 sigma in 10act. ( 16.7093143 sig out 1act.) RANK 5 NODE 10 --> 20.4380226 sigma in 10act. ( 17.0646763 sig out 1act.) RANK 6 NODE 3 --> 18.387661 sigma in 10act. ( 20.7379093 sig out 1act.) RANK 7 NODE 15 --> 14.3415318 sigma in 10act. ( 13.5860615 sig out 1act.) RANK 8 NODE 8 --> 13.9153681 sigma in 10act. ( 13.3563986 sig out 1act.) RANK 9 NODE 9 --> 13.7052774 sigma in 10act. ( 12.620594 sig out 1act.) RANK 10 NODE 7 --> 11.4019375 sigma in 10act. ( 9.3588295 sig out 1act.) RANK 11 NODE 13 --> 8.52951241 sigma in 10act. ( 7.0247426 sig out 1act.) RANK 12 NODE 6 --> 7.25570154 sigma in 10act. ( 6.20566511 sig out 1act.) RANK 13 NODE 14 --> 5.61495209 sigma in 10act. ( 4.7312417 sig out 1act.) RANK 14 NODE 1 --> 4.00992012 sigma in 10act. ( 3.08750033 sig out 1act.) RANK 15 NODE 12 --> 3.07712364 sigma in 10act. ( 2.12693143 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 54.2995491 sigma out 1act.( 42.5061646 sig in 10act.) RANK 2 NODE 4 --> 46.5022163 sigma out 1act.( 53.2443275 sig in 10act.) RANK 3 NODE 11 --> 30.6223888 sigma out 1act.( 34.2380409 sig in 10act.) RANK 4 NODE 3 --> 20.7379093 sigma out 1act.( 18.387661 sig in 10act.) RANK 5 NODE 10 --> 17.0646763 sigma out 1act.( 20.4380226 sig in 10act.) RANK 6 NODE 5 --> 16.7093143 sigma out 1act.( 20.5757446 sig in 10act.) RANK 7 NODE 15 --> 13.5860615 sigma out 1act.( 14.3415318 sig in 10act.) RANK 8 NODE 8 --> 13.3563986 sigma out 1act.( 13.9153681 sig in 10act.) RANK 9 NODE 9 --> 12.620594 sigma out 1act.( 13.7052774 sig in 10act.) RANK 10 NODE 7 --> 9.3588295 sigma out 1act.( 11.4019375 sig in 10act.) RANK 11 NODE 13 --> 7.0247426 sigma out 1act.( 8.52951241 sig in 10act.) RANK 12 NODE 6 --> 6.20566511 sigma out 1act.( 7.25570154 sig in 10act.) RANK 13 NODE 14 --> 4.7312417 sigma out 1act.( 5.61495209 sig in 10act.) RANK 14 NODE 1 --> 3.08750033 sigma out 1act.( 4.00992012 sig in 10act.) RANK 15 NODE 12 --> 2.12693143 sigma out 1act.( 3.07712364 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 88.2226334 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.582714796 *** contribution from regularisation: 0.00268544466 *** contribution from error: -0.585400224 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26967 Closing output file done