NNInput NNInputs_130.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 195899 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 48964 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 48964 Chosen entries: 48964 Signal fraction: 1 Background fraction: 0.333236 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 48964 Entries to split: 48964 Test with : 24482 Train with : 24482 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 48964 for Signal Prepared event 0 for Signal with 48964 events ====Entry 0 Variable Ht : 151.435 Variable LepAPt : 41.3573 Variable LepBPt : 14.9662 Variable MetSigLeptonsJets : 5.83672 Variable MetSpec : 56.7846 Variable SumEtLeptonsJets : 94.6508 Variable VSumJetLeptonsPt : 42.3463 Variable addEt : 113.108 Variable dPhiLepSumMet : 2.38762 Variable dPhiLeptons : 0.421366 Variable dRLeptons : 0.581604 Variable lep1_E : 44.5356 Variable lep2_E : 14.9672 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2130 Ht = 151.435 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 41.3573 LepAPt = 41.3573 LepBEt = 14.9662 LepBPt = 14.9662 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 56.7846 MetDelPhi = 1.62286 MetSig = 5.01275 MetSigLeptonsJets = 5.83672 MetSpec = 56.7846 Mjj = 0 MostCentralJetEta = 2.41678 MtllMet = 115.132 Njets = 1 SB = 0 SumEt = 128.324 SumEtJets = 0 SumEtLeptonsJets = 94.6508 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 42.3463 addEt = 113.108 dPhiLepSumMet = 2.38762 dPhiLeptons = 0.421366 dRLeptons = 0.581604 diltype = 55 dimass = 14.4601 event = 2096 jet1_Et = 38.3273 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 44.5356 lep2_E = 14.9672 rand = 0.999742 run = 195245 weight = 2.27324e-06 ===Show End Prepared event 10000 for Signal with 48964 events Prepared event 20000 for Signal with 48964 events Prepared event 30000 for Signal with 48964 events Prepared event 40000 for Signal with 48964 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.261452 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4555 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 195899 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4555 negative weights. Signal fraction: 62.2886658 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 48.8991051 61.9843941 64.4863892 66.1649017 67.4658966 68.5706711 69.7165146 70.4707184 71.3085861 72.0223694 72.9011993 73.6273193 74.225769 74.8423615 75.4103394 75.8934631 76.580246 77.1087723 77.6034851 78.1649323 78.702774 79.2063599 79.7836609 80.3838043 81.115097 81.7989731 82.3985443 83.022583 83.6426544 84.5036163 85.2788315 86.0560913 86.8803558 87.9499054 88.8128662 89.8239212 90.9449997 92.0751038 93.2896271 94.4554443 95.531723 96.593895 97.7810516 98.9259949 99.9042969 101.012611 102.049416 103.146851 104.189621 105.325272 106.271011 107.287888 108.254509 109.24855 110.309113 111.219574 112.27594 113.435562 114.442108 115.589989 116.56926 117.694145 118.733215 119.902451 120.999779 122.050186 123.339767 124.645782 125.86097 127.218086 128.505615 130.013153 131.608215 133.050018 134.72406 136.562744 138.417252 140.316513 142.288055 144.448914 146.677917 148.809662 151.106018 153.374176 155.883484 158.934235 162.09256 165.268921 168.8974 172.788025 176.681732 181.583527 187.065628 193.129623 199.988556 208.874939 220.618896 233.116806 253.044586 288.74585 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3010101 20.5615273 20.8355598 21.0745926 21.3098907 21.5018311 21.6985035 21.8926544 22.077774 22.27071 22.4417419 22.6291447 22.8150139 23.0089035 23.160408 23.34338 23.5508957 23.7073975 23.8834724 24.0843887 24.2911873 24.4866066 24.6684074 24.8791656 25.0853615 25.2607708 25.4156513 25.5719738 25.7132263 25.8945618 26.0924568 26.277235 26.4792633 26.6749344 26.8628426 27.0531807 27.2342224 27.4388924 27.6215153 27.7922153 27.9643764 28.1560516 28.3422546 28.5527096 28.7503681 28.9399757 29.1367073 29.3128281 29.5390587 29.7437477 29.9767647 30.2031879 30.4708672 30.6931763 30.9429874 31.192955 31.4419708 31.6866837 31.9425106 32.1766891 32.4602432 32.7219696 32.9850998 33.2415237 33.531456 33.8075981 34.126976 34.4103394 34.7326584 35.068531 35.3926888 35.6855392 36.0416336 36.4194183 36.7877274 37.1628723 37.5778732 38.0174408 38.4704208 38.9036064 39.3806458 39.9008331 40.4231873 40.9792175 41.5702057 42.210743 42.9288521 43.6789436 44.5568542 45.492733 46.4397774 47.525238 48.7566376 50.2999268 51.9647217 54.4704285 57.5850372 62.2395782 70.1743622 168.389603 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.0999222 10.204031 10.312892 10.409255 10.5029774 10.6237783 10.7263098 10.8408623 10.949729 11.0519104 11.1583729 11.271265 11.3788052 11.4895439 11.6135044 11.7314577 11.8468399 11.9773941 12.0949593 12.2334785 12.3560514 12.4769382 12.6024113 12.7474976 12.8784981 12.9879694 13.1269722 13.2585812 13.4085884 13.5472584 13.6619081 13.7900543 13.9078007 14.0435505 14.1922445 14.3250103 14.4719124 14.627737 14.7806816 14.9516821 15.1071205 15.2644634 15.3962269 15.5274372 15.6671886 15.8227844 15.9686279 16.1685104 16.3482628 16.5183411 16.7261429 16.8824196 17.0671692 17.2616463 17.4441528 17.6633987 17.8287659 18.0510044 18.2738075 18.4690571 18.6711731 18.8670044 19.0844193 19.2958794 19.5226479 19.7638721 20.0011673 20.2024136 20.4037132 20.6382179 20.854599 21.0896149 21.3197746 21.5731697 21.8197861 22.0630016 22.3422146 22.6026554 22.8682709 23.1662941 23.4706955 23.8167076 24.1301479 24.4562798 24.8112125 25.1936531 25.5920029 26.0258808 26.4513779 26.9218197 27.4503136 28.0139923 28.5601845 29.349102 30.2766628 31.2875938 32.675312 34.8391418 38.9211121 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.12534201 2.42436981 2.80381775 3.05602407 3.26587486 3.43678784 3.61820889 3.76714516 3.89083099 4.02887583 4.12657452 4.25300598 4.35951424 4.45559025 4.54467487 4.62852383 4.70812321 4.78624058 4.85996819 4.9311924 4.99695301 5.06865025 5.12950325 5.18872595 5.24758101 5.29811764 5.3535037 5.39900064 5.45003033 5.49085522 5.53273439 5.58381939 5.62931538 5.67980051 5.72611809 5.77143097 5.81061077 5.8465023 5.88635159 5.92510462 5.96640587 6.01033163 6.04797363 6.08620548 6.12324238 6.15919209 6.1908083 6.23196888 6.27166843 6.30546856 6.34212112 6.38171577 6.41784334 6.45543671 6.49631548 6.53021526 6.57009029 6.60879898 6.64894199 6.6895113 6.72961712 6.76430225 6.80826092 6.84380627 6.88787603 6.92988014 6.97026634 7.01598358 7.05872202 7.10458374 7.15461922 7.19717407 7.24676418 7.29362679 7.33490181 7.38664722 7.43431664 7.48439646 7.53502464 7.59292698 7.64672375 7.70423794 7.75816107 7.81160164 7.87113762 7.93847084 8.01322556 8.08448887 8.15719414 8.23934746 8.32353306 8.41959572 8.52970982 8.65194893 8.79807854 8.9614048 9.1704216 9.40877342 9.78730679 10.4292612 20.0349483 ------------------------------ Transdef: Tab for variable 6 15.0343132 19.01647 22.6268616 25.322937 26.2032394 26.949028 27.6012383 28.4753056 29.1994553 29.7738495 30.4598522 30.9574394 31.4551964 31.9583912 32.4636536 32.9117432 33.3635864 33.8560333 34.2619095 34.6345367 34.9344254 35.2854424 35.6337357 36.0134659 36.3184052 36.5653992 36.9189606 37.2652435 37.5639267 37.8417053 38.162674 38.5097961 38.8317757 39.13694 39.4324341 39.7485237 40.0505981 40.3536148 40.6235123 40.9897614 41.3220673 41.7146683 42.0812836 42.425724 42.8102417 43.1286926 43.4880753 43.8288116 44.2331696 44.6924667 45.147438 45.6344681 46.0460205 46.5219002 47.0060387 47.5439453 47.9982796 48.4570122 48.900238 49.3517456 49.8453903 50.3781891 50.8515549 51.4258347 51.9416504 52.4752808 53.0336189 53.5424805 54.1090813 54.6172409 55.1618195 55.6952934 56.2594833 56.8048553 57.3479614 57.9001312 58.4523354 59.0226212 59.6436539 60.248394 60.8952484 61.5222626 62.3283882 63.0703049 63.8513603 64.6150818 65.4842224 66.3227386 67.3348465 68.4528961 69.6769867 71.0661926 72.8080292 74.6985931 77.0219574 79.8057404 82.9320221 86.8469696 92.9454498 103.813156 214.544067 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.4988861 33.3435287 34.0515366 34.7227859 35.2291679 35.7492676 36.1276855 36.4984589 36.8653336 37.191761 37.5289803 37.8288155 38.1591949 38.4100723 38.6882401 38.9638519 39.1985397 39.4155235 39.6335297 39.9664383 40.2225571 40.4630051 40.7972183 41.067852 41.3820877 41.6528702 41.981842 42.3632202 42.7821808 43.289917 43.7412224 44.3171082 44.8431664 45.2622795 45.7704849 46.4421806 46.947113 47.647274 48.2970581 48.904129 49.5957222 50.2506027 50.925354 51.6489334 52.3722191 53.0279999 53.6563873 54.3301506 55.0066071 55.6577148 56.1791382 56.8205719 57.4123306 58.0686646 58.7296638 59.2888794 59.9632339 60.7644272 61.5417328 62.330658 63.1211472 63.9302979 64.9029846 65.8766479 66.9591217 68.1806793 69.2792816 70.5446777 71.7704163 73.0658875 74.2911911 75.7081909 77.1444016 78.6170349 80.2474213 81.8400879 83.4928513 85.1469955 86.8914795 88.771759 90.667572 92.4868011 94.6811676 96.9697571 99.2746124 102.076881 104.891571 107.880951 111.62738 114.924355 118.905853 123.525635 128.898071 134.876526 141.571808 149.993118 161.548889 179.253372 206.834106 458.64209 ------------------------------ Transdef: Tab for variable 8 0.678276479 21.47649 26.7067719 29.3797436 30.7523689 31.6117249 32.3178787 32.8907776 33.3637161 33.8007965 34.1981087 34.6558685 34.9645958 35.2509689 35.6781006 35.9768066 36.2704277 36.5254936 36.8102303 37.0671692 37.3303223 37.5501175 37.7907639 38.0109634 38.2123566 38.4583588 38.6601715 38.9027748 39.1576347 39.3892517 39.6435623 39.8692169 40.1162415 40.3544693 40.5956764 40.864006 41.1240311 41.372364 41.6937943 41.9481583 42.3100967 42.6699524 43.0231781 43.3930588 43.7600441 44.1402473 44.4882584 44.880394 45.3092842 45.7553329 46.1868439 46.6432724 47.0187912 47.4971733 47.9741859 48.4536552 48.8414917 49.2945595 49.7951736 50.2711029 50.7244186 51.22118 51.7794952 52.241394 52.7331848 53.1422653 53.6125641 54.0460892 54.5094223 54.9895248 55.5290451 56.0181274 56.513237 57.0229416 57.5525818 58.0891571 58.6203613 59.2242889 59.8126831 60.3998299 61.1147156 61.7453384 62.4931984 63.2327271 64.0064926 64.9087296 65.8651962 66.8829651 67.9604492 69.2914581 70.5771484 72.2034073 74.1577911 76.2308044 78.6374359 81.5995331 84.9359665 89.436615 96.6130676 110.945602 326.868286 ------------------------------ Transdef: Tab for variable 9 48.2450905 61.1271591 63.7209091 65.4396515 66.5896225 67.6628113 68.6065063 69.5815582 70.2565994 70.7938766 71.5603638 72.2094727 72.9219208 73.5195389 74.0494614 74.5558624 75.1727905 75.5822754 76.052269 76.5910339 77.0652161 77.4610443 78.0335388 78.4779282 78.901474 79.3626328 79.8202744 80.3199463 80.9418259 81.5117798 81.9861298 82.4649353 83.050705 83.5397491 84.1393585 84.7602997 85.3674927 86.0589294 86.6835938 87.5623245 88.3962097 89.0277634 89.8285065 90.5758057 91.5001907 92.2554626 93.2105408 94.1612854 94.9972534 95.8761826 96.7221375 97.6234741 98.5075836 99.2643661 100.067429 100.969826 101.753281 102.601082 103.400406 104.203331 105.022072 105.82135 106.591202 107.471291 108.259773 109.070236 109.83931 110.521797 111.306519 112.106705 112.968567 113.763824 114.552444 115.366333 116.140625 116.898743 117.794907 118.625946 119.485107 120.330711 121.189499 121.994896 122.868401 123.841026 124.90419 125.870087 126.943619 128.085327 129.254318 130.603485 131.957977 133.395096 135.185455 137.491074 140.104706 143.358459 148.000702 153.386902 162.498596 182.387299 385.645142 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.964106083 1.23330975 1.43287003 1.58673072 1.71627283 1.8203963 1.89956307 1.98368835 2.06132054 2.12292767 2.18446493 2.23345184 2.28459263 2.32697868 2.36845613 2.40819478 2.44292545 2.4770298 2.50739622 2.53496599 2.56585598 2.59257793 2.61690021 2.64001417 2.6640594 2.68446207 2.70495462 2.7244091 2.74398947 2.7619276 2.77895093 2.79384494 2.80826139 2.82210612 2.8324213 2.84555459 2.85675001 2.86720514 2.87822771 2.88826561 2.89905143 2.90822315 2.91660166 2.92503071 2.93257189 2.93945742 2.94723129 2.95461273 2.9612031 2.96779871 2.97382307 2.97919059 2.98463011 2.98992538 2.99484587 2.99946451 3.00415945 3.00870347 3.01341462 3.01820898 3.02275801 3.02693415 3.03073025 3.03462934 3.03830671 3.04209113 3.0459497 3.04984975 3.05345774 3.05707312 3.06021404 3.06357408 3.06695724 3.07043266 3.07388377 3.07679272 3.07970166 3.08282733 3.08596373 3.08877659 3.09185743 3.09500504 3.09760642 3.10038042 3.10309505 3.10534525 3.10821223 3.11124873 3.11396837 3.11635494 3.11884999 3.12120247 3.12406492 3.12673998 3.12892962 3.13159204 3.13386059 3.13636827 3.13891506 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.0054382016 0.0102421045 0.0167279243 0.0238284934 0.0308264494 0.0388264656 0.0463995934 0.0540908873 0.0621659756 0.0697173178 0.0778884888 0.0852699876 0.0919152498 0.0985065699 0.106193006 0.114522114 0.122104526 0.129636765 0.137637049 0.145473242 0.153204799 0.159517288 0.166150421 0.17295289 0.179504707 0.185923517 0.192201078 0.198631763 0.203656197 0.208956063 0.214929223 0.220464408 0.225548029 0.230349705 0.235802621 0.242208004 0.247427464 0.252725184 0.258280158 0.262943029 0.268300712 0.273895502 0.279583931 0.285340309 0.291790605 0.29800868 0.303090334 0.309345245 0.315250874 0.321772605 0.327660978 0.333863378 0.339593351 0.34518528 0.350584984 0.356577933 0.361798584 0.368691564 0.375244409 0.381172121 0.386861026 0.393330932 0.399065971 0.405453146 0.411417246 0.417852074 0.424328446 0.430174112 0.436579645 0.442255795 0.448535681 0.454774916 0.46049571 0.467271447 0.47453016 0.480794549 0.488467753 0.496469498 0.505227208 0.512773514 0.52068007 0.528326988 0.537094474 0.546662927 0.554833412 0.566072106 0.576966345 0.587228775 0.598789454 0.611056805 0.626676023 0.640501738 0.656479597 0.678016245 0.700386763 0.718458772 0.753279924 0.797467947 0.856826544 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.200005442 0.211464524 0.22051692 0.230231121 0.238751382 0.24736771 0.254870415 0.26134935 0.269195974 0.276678592 0.283648491 0.291366577 0.298694521 0.306350291 0.313589931 0.321042299 0.328443676 0.335778713 0.343435943 0.34959954 0.356151462 0.362911403 0.369318247 0.376568347 0.383109331 0.389367878 0.395520866 0.401035994 0.406230748 0.411040455 0.414924145 0.419123471 0.423792243 0.427633345 0.431680322 0.435549885 0.439550459 0.443748057 0.447712928 0.45217818 0.456690669 0.460661054 0.464846194 0.468896687 0.472667098 0.476595819 0.480446577 0.484325886 0.487812459 0.491846442 0.495865613 0.50014317 0.503957272 0.508312702 0.5124259 0.516917408 0.521381974 0.524958014 0.529406905 0.534144759 0.538787127 0.543474197 0.54856652 0.552734733 0.557952404 0.562602937 0.567336202 0.572462678 0.577528715 0.582723439 0.58823657 0.593825579 0.599174857 0.605007052 0.611263514 0.617252707 0.624011278 0.629945517 0.636769891 0.643447876 0.649997473 0.657761455 0.664405227 0.671334684 0.679243922 0.688975453 0.697412491 0.705981374 0.715072155 0.725375772 0.735851824 0.747231126 0.757478297 0.76887691 0.782505393 0.800925374 0.82084316 0.84353888 0.873183489 0.923032999 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3963165 22.1205845 22.6495132 23.1421928 23.572094 23.9666367 24.4314766 24.8639278 25.2662926 25.6109924 25.9271202 26.2600288 26.5764542 26.9530602 27.2551823 27.5722618 27.8771324 28.2174854 28.5297298 28.845293 29.1018105 29.3516235 29.5984058 29.8672256 30.1610031 30.4287167 30.6715298 30.9307175 31.2069702 31.5207005 31.7835026 32.0632324 32.390274 32.6722527 32.9826851 33.2425423 33.5321579 33.8510361 34.187439 34.509491 34.7712746 35.0822601 35.38694 35.6838379 36.0013466 36.2646484 36.5966873 36.940567 37.2653732 37.5777397 37.9592361 38.2976608 38.6556625 39.0729485 39.4882278 39.8511963 40.2472687 40.6470604 41.1198845 41.5353546 41.9704475 42.4484634 42.9448586 43.4375305 43.9066467 44.4482918 44.9760056 45.5227203 46.1102142 46.6597519 47.2818146 47.9105453 48.5291367 49.2195282 49.8389587 50.6112404 51.5132828 52.2839813 53.0730438 54.0164719 54.9605598 55.8478851 56.8755035 57.991951 59.1431427 60.3771667 61.6097641 62.934639 64.6001282 66.5679169 68.4199524 70.6195068 73.3358917 76.0062561 79.0931854 82.9496155 87.7696609 93.3710938 103.960648 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.5953035 11.0168037 11.3317833 11.5722046 11.8285599 12.1365919 12.3518639 12.5918236 12.8303471 13.0580349 13.3084173 13.5352383 13.7316465 13.9627581 14.1914749 14.404315 14.6211205 14.8392649 15.0653191 15.2620916 15.4648647 15.6738548 15.9167042 16.1176147 16.3372116 16.5494976 16.7739372 16.9817352 17.216711 17.4122295 17.6327858 17.8305435 18.0296288 18.2508621 18.4892845 18.692091 18.9194126 19.0996685 19.3144913 19.5373116 19.7969379 20.0240479 20.2750206 20.5054283 20.7285328 20.940094 21.1812363 21.3879318 21.5904312 21.8151093 22.0153351 22.264679 22.4925041 22.7352467 22.9946804 23.2223206 23.4752541 23.7255726 23.9712753 24.24683 24.5215836 24.7819347 25.044487 25.3402557 25.6504822 25.9269447 26.2595062 26.5449677 26.865303 27.2125206 27.5363541 27.8381729 28.1766777 28.5076733 28.9152641 29.3066654 29.6441002 30.0570583 30.5251007 30.9682655 31.4047318 31.8735237 32.4304428 33.0086479 33.6366539 34.2452583 34.9197769 35.6302414 36.4896889 37.3946228 38.3738937 39.5531578 40.7929077 42.2989502 44.2189026 46.2847824 49.1390915 53.4410172 60.5829201 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 59.0 40.7 39.4 14.2 37.4 56.8 43.9 55.1 -29.7 -6.5 -17.7 7.2 9.7 2 59.0 100.0 62.4 51.1 20.1 60.5 94.0 66.0 89.7 -49.5 -17.8 -34.1 29.7 24.2 3 40.7 62.4 100.0 28.3 -3.7 25.1 66.2 46.6 67.8 -18.3 -18.7 -37.6 63.8 10.4 4 39.4 51.1 28.3 100.0 3.5 25.5 52.2 40.0 56.3 -13.9 -21.2 -43.3 9.9 68.9 5 14.2 20.1 -3.7 3.5 100.0 81.6 -8.4 47.6 47.6 30.0 -0.1 1.5 -10.0 -2.6 6 37.4 60.5 25.1 25.5 81.6 100.0 37.4 73.3 76.3 -3.1 -7.7 -13.9 6.1 9.4 7 56.8 94.0 66.2 52.2 -8.4 37.4 100.0 58.0 76.7 -57.0 -17.1 -34.7 34.3 26.4 8 43.9 66.0 46.6 40.0 47.6 73.3 58.0 100.0 77.8 -8.9 -15.3 -26.7 21.8 19.6 9 55.1 89.7 67.8 56.3 47.6 76.3 76.7 77.8 100.0 -22.7 -19.5 -38.3 34.4 29.0 10 -29.7 -49.5 -18.3 -13.9 30.0 -3.1 -57.0 -8.9 -22.7 100.0 4.4 8.2 -5.5 -3.4 11 -6.5 -17.8 -18.7 -21.2 -0.1 -7.7 -17.1 -15.3 -19.5 4.4 100.0 54.8 -6.7 -10.8 12 -17.7 -34.1 -37.6 -43.3 1.5 -13.9 -34.7 -26.7 -38.3 8.2 54.8 100.0 -13.8 -19.1 13 7.2 29.7 63.8 9.9 -10.0 6.1 34.3 21.8 34.4 -5.5 -6.7 -13.8 100.0 40.2 14 9.7 24.2 10.4 68.9 -2.6 9.4 26.4 19.6 29.0 -3.4 -10.8 -19.1 40.2 100.0 TOTAL CORRELATION TO TARGET (diagonal) 133.649145 TOTAL CORRELATION OF ALL VARIABLES 64.9294716 ROUND 1: MAX CORR ( 64.9263377) AFTER KILLING INPUT VARIABLE 6 CONTR 0.637922841 ROUND 2: MAX CORR ( 64.8829469) AFTER KILLING INPUT VARIABLE 11 CONTR 2.37329562 ROUND 3: MAX CORR ( 64.8276546) AFTER KILLING INPUT VARIABLE 7 CONTR 2.6780592 ROUND 4: MAX CORR ( 64.5402682) AFTER KILLING INPUT VARIABLE 8 CONTR 6.09742375 ROUND 5: MAX CORR ( 64.2830811) AFTER KILLING INPUT VARIABLE 10 CONTR 5.75601426 ROUND 6: MAX CORR ( 63.9615425) AFTER KILLING INPUT VARIABLE 14 CONTR 6.42149559 ROUND 7: MAX CORR ( 63.4640169) AFTER KILLING INPUT VARIABLE 9 CONTR 7.9622533 ROUND 8: MAX CORR ( 63.3709558) AFTER KILLING INPUT VARIABLE 5 CONTR 3.43560823 ROUND 9: MAX CORR ( 62.5727449) AFTER KILLING INPUT VARIABLE 12 CONTR 10.0264463 ROUND 10: MAX CORR ( 61.7053047) AFTER KILLING INPUT VARIABLE 4 CONTR 10.3828602 ROUND 11: MAX CORR ( 59.9615389) AFTER KILLING INPUT VARIABLE 3 CONTR 14.5656607 ROUND 12: MAX CORR ( 58.982544) AFTER KILLING INPUT VARIABLE 13 CONTR 10.7909987 LAST REMAINING VARIABLE: 2 total correlation to target: 64.9294716 % total significance: 129.259574 sigma correlations of single variables to target: variable 2: 58.982544 % , in sigma: 117.420615 variable 3: 40.715202 % , in sigma: 81.0545584 variable 4: 39.4283683 % , in sigma: 78.4927699 variable 5: 14.2373152 % , in sigma: 28.3432044 variable 6: 37.4020977 % , in sigma: 74.4589334 variable 7: 56.7651073 % , in sigma: 113.006211 variable 8: 43.9133287 % , in sigma: 87.4212896 variable 9: 55.0559461 % , in sigma: 109.603666 variable 10: -29.7289274 % , in sigma: 59.1834246 variable 11: -6.50950392 % , in sigma: 12.9589181 variable 12: -17.7303404 % , in sigma: 35.2970105 variable 13: 7.22005361 % , in sigma: 14.3734583 variable 14: 9.73239383 % , in sigma: 19.3749471 variables sorted by significance: 1 most relevant variable 2 corr 58.9825439 , in sigma: 117.420615 2 most relevant variable 13 corr 10.7909985 , in sigma: 21.4823843 3 most relevant variable 3 corr 14.5656605 , in sigma: 28.9968641 4 most relevant variable 4 corr 10.3828602 , in sigma: 20.6698753 5 most relevant variable 12 corr 10.0264463 , in sigma: 19.9603377 6 most relevant variable 5 corr 3.43560815 , in sigma: 6.8395019 7 most relevant variable 9 corr 7.96225309 , in sigma: 15.8510059 8 most relevant variable 14 corr 6.42149544 , in sigma: 12.7837135 9 most relevant variable 10 corr 5.75601435 , in sigma: 11.4588944 10 most relevant variable 8 corr 6.09742355 , in sigma: 12.1385613 11 most relevant variable 7 corr 2.6780591 , in sigma: 5.33139681 12 most relevant variable 11 corr 2.37329555 , in sigma: 4.72468299 13 most relevant variable 6 corr 0.637922823 , in sigma: 1.26995693 global correlations between input variables: variable 2: 99.1034286 % variable 3: 93.1437012 % variable 4: 90.5644056 % variable 5: 95.2377744 % variable 6: 94.4204523 % variable 7: 98.6437428 % variable 8: 86.4788392 % variable 9: 98.7449594 % variable 10: 72.3369424 % variable 11: 55.3855978 % variable 12: 67.9245794 % variable 13: 84.7356756 % variable 14: 86.6813077 % significance loss when removing single variables: variable 2: corr = 5.93666903 % , sigma = 11.8185361 variable 3: corr = 13.3620209 % , sigma = 26.6006958 variable 4: corr = 15.256188 % , sigma = 30.3715449 variable 5: corr = 8.66529744 % , sigma = 17.2506048 variable 6: corr = 0.637922841 % , sigma = 1.26995696 variable 7: corr = 2.43924611 % , sigma = 4.85597534 variable 8: corr = 4.18459962 % , sigma = 8.33057083 variable 9: corr = 7.76841559 % , sigma = 15.4651203 variable 10: corr = 5.9945821 % , sigma = 11.9338277 variable 11: corr = 2.38813142 % , sigma = 4.75421779 variable 12: corr = 6.96410635 % , sigma = 13.8639264 variable 13: corr = 7.41282003 % , sigma = 14.7572117 variable 14: corr = 6.27991441 % , sigma = 12.5018584 Keep only 12 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 13 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 20.3554173 sigma out 15 active outputs RANK 2 NODE 11 --> 16.9408417 sigma out 15 active outputs RANK 3 NODE 7 --> 16.7127094 sigma out 15 active outputs RANK 4 NODE 9 --> 13.5938187 sigma out 15 active outputs RANK 5 NODE 10 --> 13.5794563 sigma out 15 active outputs RANK 6 NODE 4 --> 13.4505663 sigma out 15 active outputs RANK 7 NODE 8 --> 12.8310747 sigma out 15 active outputs RANK 8 NODE 2 --> 12.3360653 sigma out 15 active outputs RANK 9 NODE 5 --> 11.9154539 sigma out 15 active outputs RANK 10 NODE 1 --> 11.3340168 sigma out 15 active outputs RANK 11 NODE 12 --> 10.9519491 sigma out 15 active outputs RANK 12 NODE 13 --> 9.03228092 sigma out 15 active outputs RANK 13 NODE 3 --> 8.55059528 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 23.4206123 sigma in 13act. ( 24.0301723 sig out 1act.) RANK 2 NODE 7 --> 21.9947052 sigma in 13act. ( 23.1331387 sig out 1act.) RANK 3 NODE 2 --> 20.0195141 sigma in 13act. ( 19.9786739 sig out 1act.) RANK 4 NODE 6 --> 16.0091152 sigma in 13act. ( 14.3059359 sig out 1act.) RANK 5 NODE 11 --> 13.2298336 sigma in 13act. ( 12.7819052 sig out 1act.) RANK 6 NODE 12 --> 12.934515 sigma in 13act. ( 14.2856503 sig out 1act.) RANK 7 NODE 14 --> 10.1329784 sigma in 13act. ( 5.60725975 sig out 1act.) RANK 8 NODE 1 --> 8.96522617 sigma in 13act. ( 12.9108915 sig out 1act.) RANK 9 NODE 3 --> 7.21996784 sigma in 13act. ( 5.81975794 sig out 1act.) RANK 10 NODE 9 --> 6.23832321 sigma in 13act. ( 5.48232508 sig out 1act.) RANK 11 NODE 4 --> 5.7883811 sigma in 13act. ( 3.35283303 sig out 1act.) RANK 12 NODE 5 --> 4.7290287 sigma in 13act. ( 4.27506256 sig out 1act.) RANK 13 NODE 8 --> 3.65880919 sigma in 13act. ( 1.30759227 sig out 1act.) RANK 14 NODE 15 --> 3.57253122 sigma in 13act. ( 5.4640336 sig out 1act.) RANK 15 NODE 10 --> 2.20068693 sigma in 13act. ( 3.82284737 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 24.0301723 sigma out 1act.( 23.4206123 sig in 13act.) RANK 2 NODE 7 --> 23.1331387 sigma out 1act.( 21.9947052 sig in 13act.) RANK 3 NODE 2 --> 19.9786739 sigma out 1act.( 20.0195141 sig in 13act.) RANK 4 NODE 6 --> 14.3059359 sigma out 1act.( 16.0091152 sig in 13act.) RANK 5 NODE 12 --> 14.2856503 sigma out 1act.( 12.934515 sig in 13act.) RANK 6 NODE 1 --> 12.9108915 sigma out 1act.( 8.96522617 sig in 13act.) RANK 7 NODE 11 --> 12.7819052 sigma out 1act.( 13.2298336 sig in 13act.) RANK 8 NODE 3 --> 5.81975794 sigma out 1act.( 7.21996784 sig in 13act.) RANK 9 NODE 14 --> 5.60725975 sigma out 1act.( 10.1329784 sig in 13act.) RANK 10 NODE 9 --> 5.48232508 sigma out 1act.( 6.23832321 sig in 13act.) RANK 11 NODE 15 --> 5.4640336 sigma out 1act.( 3.57253122 sig in 13act.) RANK 12 NODE 5 --> 4.27506256 sigma out 1act.( 4.7290287 sig in 13act.) RANK 13 NODE 10 --> 3.82284737 sigma out 1act.( 2.20068693 sig in 13act.) RANK 14 NODE 4 --> 3.35283303 sigma out 1act.( 5.7883811 sig in 13act.) RANK 15 NODE 8 --> 1.30759227 sigma out 1act.( 3.65880919 sig in 13act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 49.2098618 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 19.083643 sigma out 15 active outputs RANK 2 NODE 11 --> 17.188633 sigma out 15 active outputs RANK 3 NODE 9 --> 16.5167942 sigma out 15 active outputs RANK 4 NODE 7 --> 16.0354443 sigma out 15 active outputs RANK 5 NODE 12 --> 15.9054003 sigma out 15 active outputs RANK 6 NODE 10 --> 14.4903984 sigma out 15 active outputs RANK 7 NODE 5 --> 13.7853689 sigma out 15 active outputs RANK 8 NODE 4 --> 13.5329218 sigma out 15 active outputs RANK 9 NODE 8 --> 13.4361162 sigma out 15 active outputs RANK 10 NODE 1 --> 13.3718491 sigma out 15 active outputs RANK 11 NODE 2 --> 12.9970665 sigma out 15 active outputs RANK 12 NODE 13 --> 10.3380432 sigma out 15 active outputs RANK 13 NODE 3 --> 8.98060799 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 21.8414516 sigma in 13act. ( 22.1218834 sig out 1act.) RANK 2 NODE 7 --> 21.2234383 sigma in 13act. ( 21.0454292 sig out 1act.) RANK 3 NODE 2 --> 18.4101582 sigma in 13act. ( 18.0397015 sig out 1act.) RANK 4 NODE 1 --> 16.169405 sigma in 13act. ( 12.9865484 sig out 1act.) RANK 5 NODE 12 --> 16.0772076 sigma in 13act. ( 14.019722 sig out 1act.) RANK 6 NODE 6 --> 14.6243639 sigma in 13act. ( 12.8017044 sig out 1act.) RANK 7 NODE 11 --> 12.1574516 sigma in 13act. ( 11.6498957 sig out 1act.) RANK 8 NODE 10 --> 11.822278 sigma in 13act. ( 5.91018581 sig out 1act.) RANK 9 NODE 15 --> 11.5005388 sigma in 13act. ( 6.64050341 sig out 1act.) RANK 10 NODE 9 --> 9.80892277 sigma in 13act. ( 5.35592794 sig out 1act.) RANK 11 NODE 14 --> 7.62340736 sigma in 13act. ( 3.97583771 sig out 1act.) RANK 12 NODE 5 --> 7.36781502 sigma in 13act. ( 4.17020178 sig out 1act.) RANK 13 NODE 3 --> 6.49748707 sigma in 13act. ( 4.85141993 sig out 1act.) RANK 14 NODE 8 --> 6.27529716 sigma in 13act. ( 0.930157423 sig out 1act.) RANK 15 NODE 4 --> 5.58833122 sigma in 13act. ( 2.51815462 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 22.1218834 sigma out 1act.( 21.8414516 sig in 13act.) RANK 2 NODE 7 --> 21.0454292 sigma out 1act.( 21.2234383 sig in 13act.) RANK 3 NODE 2 --> 18.0397015 sigma out 1act.( 18.4101582 sig in 13act.) RANK 4 NODE 12 --> 14.019722 sigma out 1act.( 16.0772076 sig in 13act.) RANK 5 NODE 1 --> 12.9865484 sigma out 1act.( 16.169405 sig in 13act.) RANK 6 NODE 6 --> 12.8017044 sigma out 1act.( 14.6243639 sig in 13act.) RANK 7 NODE 11 --> 11.6498957 sigma out 1act.( 12.1574516 sig in 13act.) RANK 8 NODE 15 --> 6.64050341 sigma out 1act.( 11.5005388 sig in 13act.) RANK 9 NODE 10 --> 5.91018581 sigma out 1act.( 11.822278 sig in 13act.) RANK 10 NODE 9 --> 5.35592794 sigma out 1act.( 9.80892277 sig in 13act.) RANK 11 NODE 3 --> 4.85141993 sigma out 1act.( 6.49748707 sig in 13act.) RANK 12 NODE 5 --> 4.17020178 sigma out 1act.( 7.36781502 sig in 13act.) RANK 13 NODE 14 --> 3.97583771 sigma out 1act.( 7.62340736 sig in 13act.) RANK 14 NODE 4 --> 2.51815462 sigma out 1act.( 5.58833122 sig in 13act.) RANK 15 NODE 8 --> 0.930157423 sigma out 1act.( 6.27529716 sig in 13act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 45.7621918 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.403946161 *** contribution from regularisation: 0.00459086476 *** contribution from error: -0.40853703 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.448223799 *** contribution from regularisation: 0.0023717864 *** contribution from error: -0.450595587 *********************************************** -----------------> Test sample ENTER BFGS code START -43912.8677 -0.0611594245 0.91055578 EXIT FROM BFGS code FG_START 0. -0.0611594245 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.474855989 *** contribution from regularisation: 0.00213325187 *** contribution from error: -0.476989239 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46511.6686 -0.0611594245 426.055817 EXIT FROM BFGS code FG_LNSRCH 0. 0.00219012401 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.519688845 *** contribution from regularisation: 0.00305544981 *** contribution from error: -0.522744298 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50903.0027 0.00219012401 117.879616 EXIT FROM BFGS code NEW_X -50903.0027 0.00219012401 117.879616 ENTER BFGS code NEW_X -50903.0027 0.00219012401 117.879616 EXIT FROM BFGS code FG_LNSRCH 0. 0.0284003317 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.525352836 *** contribution from regularisation: 0.00335051375 *** contribution from error: -0.528703332 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51457.7825 0.0284003317 31.1895084 EXIT FROM BFGS code NEW_X -51457.7825 0.0284003317 31.1895084 ENTER BFGS code NEW_X -51457.7825 0.0284003317 31.1895084 EXIT FROM BFGS code FG_LNSRCH 0. 0.0414292105 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.527119577 *** contribution from regularisation: 0.0032386512 *** contribution from error: -0.530358255 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51630.8328 0.0414292105 15.6313696 EXIT FROM BFGS code NEW_X -51630.8328 0.0414292105 15.6313696 ENTER BFGS code NEW_X -51630.8328 0.0414292105 15.6313696 EXIT FROM BFGS code FG_LNSRCH 0. 0.0557975657 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.52782625 *** contribution from regularisation: 0.00305767637 *** contribution from error: -0.530883908 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51700.0522 0.0557975657 -5.3565464 EXIT FROM BFGS code NEW_X -51700.0522 0.0557975657 -5.3565464 ENTER BFGS code NEW_X -51700.0522 0.0557975657 -5.3565464 EXIT FROM BFGS code FG_LNSRCH 0. 0.0619285144 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.528287649 *** contribution from regularisation: 0.00299439882 *** contribution from error: -0.531282067 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51745.2462 0.0619285144 -4.01331949 EXIT FROM BFGS code FG_LNSRCH 0. 0.0864523053 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.529353738 *** contribution from regularisation: 0.00292717619 *** contribution from error: -0.532280922 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51849.6719 0.0864523053 1.78704667 EXIT FROM BFGS code NEW_X -51849.6719 0.0864523053 1.78704667 ENTER BFGS code NEW_X -51849.6719 0.0864523053 1.78704667 EXIT FROM BFGS code FG_LNSRCH 0. 0.131777897 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 44.4323845 sigma out 15 active outputs RANK 2 NODE 1 --> 28.2139378 sigma out 15 active outputs RANK 3 NODE 3 --> 23.8105125 sigma out 15 active outputs RANK 4 NODE 9 --> 16.8519402 sigma out 15 active outputs RANK 5 NODE 10 --> 15.2079496 sigma out 15 active outputs RANK 6 NODE 11 --> 14.0569277 sigma out 15 active outputs RANK 7 NODE 8 --> 12.2479162 sigma out 15 active outputs RANK 8 NODE 2 --> 11.4965372 sigma out 15 active outputs RANK 9 NODE 6 --> 11.4689331 sigma out 15 active outputs RANK 10 NODE 7 --> 10.7637587 sigma out 15 active outputs RANK 11 NODE 4 --> 9.93705845 sigma out 15 active outputs RANK 12 NODE 5 --> 9.08516979 sigma out 15 active outputs RANK 13 NODE 13 --> 7.58714724 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 45.2064667 sigma in 13act. ( 55.3079414 sig out 1act.) RANK 2 NODE 15 --> 34.6143456 sigma in 13act. ( 28.9633312 sig out 1act.) RANK 3 NODE 1 --> 21.232008 sigma in 13act. ( 24.5441036 sig out 1act.) RANK 4 NODE 13 --> 15.2793436 sigma in 13act. ( 14.1079168 sig out 1act.) RANK 5 NODE 7 --> 13.8869448 sigma in 13act. ( 12.3366404 sig out 1act.) RANK 6 NODE 12 --> 12.7177277 sigma in 13act. ( 9.95839882 sig out 1act.) RANK 7 NODE 5 --> 11.9645157 sigma in 13act. ( 10.5815611 sig out 1act.) RANK 8 NODE 2 --> 9.75012398 sigma in 13act. ( 7.60745192 sig out 1act.) RANK 9 NODE 9 --> 8.97584438 sigma in 13act. ( 7.93439531 sig out 1act.) RANK 10 NODE 11 --> 8.48252869 sigma in 13act. ( 8.00263023 sig out 1act.) RANK 11 NODE 3 --> 7.74348831 sigma in 13act. ( 7.10844135 sig out 1act.) RANK 12 NODE 14 --> 5.27831459 sigma in 13act. ( 4.52107525 sig out 1act.) RANK 13 NODE 4 --> 4.57540512 sigma in 13act. ( 3.96870208 sig out 1act.) RANK 14 NODE 6 --> 4.41993856 sigma in 13act. ( 1.98854923 sig out 1act.) RANK 15 NODE 8 --> 4.34164 sigma in 13act. ( 2.7784667 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 55.3079414 sigma out 1act.( 45.2064667 sig in 13act.) RANK 2 NODE 15 --> 28.9633312 sigma out 1act.( 34.6143456 sig in 13act.) RANK 3 NODE 1 --> 24.5441036 sigma out 1act.( 21.232008 sig in 13act.) RANK 4 NODE 13 --> 14.1079168 sigma out 1act.( 15.2793436 sig in 13act.) RANK 5 NODE 7 --> 12.3366404 sigma out 1act.( 13.8869448 sig in 13act.) RANK 6 NODE 5 --> 10.5815611 sigma out 1act.( 11.9645157 sig in 13act.) RANK 7 NODE 12 --> 9.95839882 sigma out 1act.( 12.7177277 sig in 13act.) RANK 8 NODE 11 --> 8.00263023 sigma out 1act.( 8.48252869 sig in 13act.) RANK 9 NODE 9 --> 7.93439531 sigma out 1act.( 8.97584438 sig in 13act.) RANK 10 NODE 2 --> 7.60745192 sigma out 1act.( 9.75012398 sig in 13act.) RANK 11 NODE 3 --> 7.10844135 sigma out 1act.( 7.74348831 sig in 13act.) RANK 12 NODE 14 --> 4.52107525 sigma out 1act.( 5.27831459 sig in 13act.) RANK 13 NODE 4 --> 3.96870208 sigma out 1act.( 4.57540512 sig in 13act.) RANK 14 NODE 8 --> 2.7784667 sigma out 1act.( 4.34164 sig in 13act.) RANK 15 NODE 6 --> 1.98854923 sigma out 1act.( 4.41993856 sig in 13act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 73.1155624 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.531352818 *** contribution from regularisation: 0.00328727905 *** contribution from error: -0.534640074 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52045.4748 0.131777897 -13.0690317 EXIT FROM BFGS code NEW_X -52045.4748 0.131777897 -13.0690317 ENTER BFGS code NEW_X -52045.4748 0.131777897 -13.0690317 EXIT FROM BFGS code FG_LNSRCH 0. 0.170831442 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.528036952 *** contribution from regularisation: 0.00447182078 *** contribution from error: -0.53250879 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51720.6932 0.170831442 84.3325195 EXIT FROM BFGS code FG_LNSRCH 0. 0.14386943 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.533357263 *** contribution from regularisation: 0.00275175064 *** contribution from error: -0.53610903 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52241.808 0.14386943 19.8057384 EXIT FROM BFGS code NEW_X -52241.808 0.14386943 19.8057384 ENTER BFGS code NEW_X -52241.808 0.14386943 19.8057384 EXIT FROM BFGS code FG_LNSRCH 0. 0.160807744 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.533627808 *** contribution from regularisation: 0.0036882977 *** contribution from error: -0.537316084 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52268.3115 0.160807744 5.93624353 EXIT FROM BFGS code NEW_X -52268.3115 0.160807744 5.93624353 ENTER BFGS code NEW_X -52268.3115 0.160807744 5.93624353 EXIT FROM BFGS code FG_LNSRCH 0. 0.161472112 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.534224749 *** contribution from regularisation: 0.00334286806 *** contribution from error: -0.537567616 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52326.778 0.161472112 -9.01016521 EXIT FROM BFGS code NEW_X -52326.778 0.161472112 -9.01016521 ENTER BFGS code NEW_X -52326.778 0.161472112 -9.01016521 EXIT FROM BFGS code FG_LNSRCH 0. 0.153290182 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.535120487 *** contribution from regularisation: 0.0033832537 *** contribution from error: -0.538503766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52414.5193 0.153290182 -25.1586285 EXIT FROM BFGS code NEW_X -52414.5193 0.153290182 -25.1586285 ENTER BFGS code NEW_X -52414.5193 0.153290182 -25.1586285 EXIT FROM BFGS code FG_LNSRCH 0. 0.147156879 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.535476685 *** contribution from regularisation: 0.00354356808 *** contribution from error: -0.53902024 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52449.4062 0.147156879 -82.4136124 EXIT FROM BFGS code NEW_X -52449.4062 0.147156879 -82.4136124 ENTER BFGS code NEW_X -52449.4062 0.147156879 -82.4136124 EXIT FROM BFGS code FG_LNSRCH 0. 0.130322978 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.536080182 *** contribution from regularisation: 0.00349219725 *** contribution from error: -0.539572358 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52508.5195 0.130322978 -19.5316257 EXIT FROM BFGS code NEW_X -52508.5195 0.130322978 -19.5316257 ENTER BFGS code NEW_X -52508.5195 0.130322978 -19.5316257 EXIT FROM BFGS code FG_LNSRCH 0. 0.125227019 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.53623724 *** contribution from regularisation: 0.00344939181 *** contribution from error: -0.53968662 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52523.9004 0.125227019 1.51894915 EXIT FROM BFGS code NEW_X -52523.9004 0.125227019 1.51894915 ENTER BFGS code NEW_X -52523.9004 0.125227019 1.51894915 EXIT FROM BFGS code FG_LNSRCH 0. 0.115735404 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.536395848 *** contribution from regularisation: 0.00349960662 *** contribution from error: -0.539895475 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52539.4376 0.115735404 -0.411926597 EXIT FROM BFGS code NEW_X -52539.4376 0.115735404 -0.411926597 ENTER BFGS code NEW_X -52539.4376 0.115735404 -0.411926597 EXIT FROM BFGS code FG_LNSRCH 0. 0.0938253999 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 70.4087219 sigma out 15 active outputs RANK 2 NODE 3 --> 46.8204308 sigma out 15 active outputs RANK 3 NODE 1 --> 30.9429226 sigma out 15 active outputs RANK 4 NODE 9 --> 16.4224777 sigma out 15 active outputs RANK 5 NODE 11 --> 15.0521278 sigma out 15 active outputs RANK 6 NODE 2 --> 14.460248 sigma out 15 active outputs RANK 7 NODE 10 --> 13.8781567 sigma out 15 active outputs RANK 8 NODE 8 --> 12.0757771 sigma out 15 active outputs RANK 9 NODE 6 --> 11.7521191 sigma out 15 active outputs RANK 10 NODE 7 --> 10.8438921 sigma out 15 active outputs RANK 11 NODE 13 --> 10.0469627 sigma out 15 active outputs RANK 12 NODE 4 --> 9.4329319 sigma out 15 active outputs RANK 13 NODE 5 --> 7.07311964 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 80.2282028 sigma in 13act. ( 96.8379669 sig out 1act.) RANK 2 NODE 15 --> 34.8675957 sigma in 13act. ( 32.207428 sig out 1act.) RANK 3 NODE 1 --> 25.756628 sigma in 13act. ( 27.54076 sig out 1act.) RANK 4 NODE 13 --> 20.1164455 sigma in 13act. ( 21.680727 sig out 1act.) RANK 5 NODE 7 --> 13.1209497 sigma in 13act. ( 13.164341 sig out 1act.) RANK 6 NODE 5 --> 12.7425365 sigma in 13act. ( 14.1890306 sig out 1act.) RANK 7 NODE 12 --> 12.7050457 sigma in 13act. ( 12.8052349 sig out 1act.) RANK 8 NODE 9 --> 10.3282089 sigma in 13act. ( 11.4151583 sig out 1act.) RANK 9 NODE 3 --> 9.93470097 sigma in 13act. ( 10.491559 sig out 1act.) RANK 10 NODE 2 --> 7.59857798 sigma in 13act. ( 6.60057354 sig out 1act.) RANK 11 NODE 4 --> 7.06959724 sigma in 13act. ( 7.94307327 sig out 1act.) RANK 12 NODE 11 --> 6.50747347 sigma in 13act. ( 6.45067167 sig out 1act.) RANK 13 NODE 8 --> 6.04972982 sigma in 13act. ( 6.0298562 sig out 1act.) RANK 14 NODE 14 --> 5.74862051 sigma in 13act. ( 5.99122906 sig out 1act.) RANK 15 NODE 6 --> 2.24266601 sigma in 13act. ( 0.50593847 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 96.8379669 sigma out 1act.( 80.2282028 sig in 13act.) RANK 2 NODE 15 --> 32.207428 sigma out 1act.( 34.8675957 sig in 13act.) RANK 3 NODE 1 --> 27.54076 sigma out 1act.( 25.756628 sig in 13act.) RANK 4 NODE 13 --> 21.680727 sigma out 1act.( 20.1164455 sig in 13act.) RANK 5 NODE 5 --> 14.1890306 sigma out 1act.( 12.7425365 sig in 13act.) RANK 6 NODE 7 --> 13.164341 sigma out 1act.( 13.1209497 sig in 13act.) RANK 7 NODE 12 --> 12.8052349 sigma out 1act.( 12.7050457 sig in 13act.) RANK 8 NODE 9 --> 11.4151583 sigma out 1act.( 10.3282089 sig in 13act.) RANK 9 NODE 3 --> 10.491559 sigma out 1act.( 9.93470097 sig in 13act.) RANK 10 NODE 4 --> 7.94307327 sigma out 1act.( 7.06959724 sig in 13act.) RANK 11 NODE 2 --> 6.60057354 sigma out 1act.( 7.59857798 sig in 13act.) RANK 12 NODE 11 --> 6.45067167 sigma out 1act.( 6.50747347 sig in 13act.) RANK 13 NODE 8 --> 6.0298562 sigma out 1act.( 6.04972982 sig in 13act.) RANK 14 NODE 14 --> 5.99122906 sigma out 1act.( 5.74862051 sig in 13act.) RANK 15 NODE 6 --> 0.50593847 sigma out 1act.( 2.24266601 sig in 13act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 112.44207 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.536760628 *** contribution from regularisation: 0.00356508768 *** contribution from error: -0.540325701 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52575.1669 0.0938253999 -6.26639462 EXIT FROM BFGS code NEW_X -52575.1669 0.0938253999 -6.26639462 ENTER BFGS code NEW_X -52575.1669 0.0938253999 -6.26639462 EXIT FROM BFGS code FG_LNSRCH 0. 0.0528672375 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.537175655 *** contribution from regularisation: 0.00366498041 *** contribution from error: -0.540840626 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52615.8167 0.0528672375 -2.02584076 EXIT FROM BFGS code NEW_X -52615.8167 0.0528672375 -2.02584076 ENTER BFGS code NEW_X -52615.8167 0.0528672375 -2.02584076 EXIT FROM BFGS code FG_LNSRCH 0. 0.0328479521 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.537142038 *** contribution from regularisation: 0.00364338467 *** contribution from error: -0.540785432 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52612.5238 0.0328479521 -17.4665852 EXIT FROM BFGS code FG_LNSRCH 0. 0.0433769934 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.53732729 *** contribution from regularisation: 0.00365904113 *** contribution from error: -0.540986359 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52630.6703 0.0433769934 -9.54275703 EXIT FROM BFGS code NEW_X -52630.6703 0.0433769934 -9.54275703 ENTER BFGS code NEW_X -52630.6703 0.0433769934 -9.54275703 EXIT FROM BFGS code FG_LNSRCH 0. 0.0422052667 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.537404001 *** contribution from regularisation: 0.00360967964 *** contribution from error: -0.541013658 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52638.1854 0.0422052667 -3.39325285 EXIT FROM BFGS code NEW_X -52638.1854 0.0422052667 -3.39325285 ENTER BFGS code NEW_X -52638.1854 0.0422052667 -3.39325285 EXIT FROM BFGS code FG_LNSRCH 0. 0.0302657001 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.537508368 *** contribution from regularisation: 0.00356249604 *** contribution from error: -0.541070879 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52648.4093 0.0302657001 -5.97659636 EXIT FROM BFGS code NEW_X -52648.4093 0.0302657001 -5.97659636 ENTER BFGS code NEW_X -52648.4093 0.0302657001 -5.97659636 EXIT FROM BFGS code FG_LNSRCH 0. -0.00721744448 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.537633359 *** contribution from regularisation: 0.00342897861 *** contribution from error: -0.541062355 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52660.648 -0.00721744448 19.0958557 EXIT FROM BFGS code NEW_X -52660.648 -0.00721744448 19.0958557 ENTER BFGS code NEW_X -52660.648 -0.00721744448 19.0958557 EXIT FROM BFGS code FG_LNSRCH 0. -0.0341800936 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.53731966 *** contribution from regularisation: 0.00348342699 *** contribution from error: -0.540803075 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52629.9262 -0.0341800936 -45.3538971 EXIT FROM BFGS code FG_LNSRCH 0. -0.0116235102 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.537123621 *** contribution from regularisation: 0.0039557633 *** contribution from error: -0.541079402 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52610.7201 -0.0116235102 9.86765957 EXIT FROM BFGS code FG_LNSRCH 0. -0.00730088307 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.537372351 *** contribution from regularisation: 0.00369047024 *** contribution from error: -0.541062832 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52635.0836 -0.00730088307 18.9538727 EXIT FROM BFGS code FG_LNSRCH 0. -0.00721750781 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 95.0952911 sigma out 15 active outputs RANK 2 NODE 3 --> 58.0995064 sigma out 15 active outputs RANK 3 NODE 1 --> 38.9986725 sigma out 15 active outputs RANK 4 NODE 8 --> 20.7810631 sigma out 15 active outputs RANK 5 NODE 2 --> 19.2574234 sigma out 15 active outputs RANK 6 NODE 10 --> 18.7549438 sigma out 15 active outputs RANK 7 NODE 6 --> 17.8307381 sigma out 15 active outputs RANK 8 NODE 9 --> 15.9788837 sigma out 15 active outputs RANK 9 NODE 11 --> 14.05686 sigma out 15 active outputs RANK 10 NODE 7 --> 13.3323889 sigma out 15 active outputs RANK 11 NODE 4 --> 11.5932331 sigma out 15 active outputs RANK 12 NODE 13 --> 9.336483 sigma out 15 active outputs RANK 13 NODE 5 --> 7.5512042 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 109.147346 sigma in 13act. ( 122.113731 sig out 1act.) RANK 2 NODE 15 --> 36.8889847 sigma in 13act. ( 36.3471489 sig out 1act.) RANK 3 NODE 1 --> 34.8288651 sigma in 13act. ( 34.6944542 sig out 1act.) RANK 4 NODE 13 --> 26.6887436 sigma in 13act. ( 28.003933 sig out 1act.) RANK 5 NODE 5 --> 15.1696138 sigma in 13act. ( 17.0841064 sig out 1act.) RANK 6 NODE 7 --> 13.4687462 sigma in 13act. ( 14.3841524 sig out 1act.) RANK 7 NODE 12 --> 12.0778322 sigma in 13act. ( 13.4305992 sig out 1act.) RANK 8 NODE 9 --> 11.6391459 sigma in 13act. ( 12.8107681 sig out 1act.) RANK 9 NODE 3 --> 11.173419 sigma in 13act. ( 12.0876694 sig out 1act.) RANK 10 NODE 4 --> 9.61838055 sigma in 13act. ( 10.7749805 sig out 1act.) RANK 11 NODE 8 --> 7.84522581 sigma in 13act. ( 8.25258636 sig out 1act.) RANK 12 NODE 2 --> 7.36518431 sigma in 13act. ( 7.25933409 sig out 1act.) RANK 13 NODE 11 --> 6.98197651 sigma in 13act. ( 7.07357693 sig out 1act.) RANK 14 NODE 14 --> 6.7481761 sigma in 13act. ( 6.98728037 sig out 1act.) RANK 15 NODE 6 --> 1.27636135 sigma in 13act. ( 0.476118833 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 122.113731 sigma out 1act.( 109.147346 sig in 13act.) RANK 2 NODE 15 --> 36.3471489 sigma out 1act.( 36.8889847 sig in 13act.) RANK 3 NODE 1 --> 34.6944542 sigma out 1act.( 34.8288651 sig in 13act.) RANK 4 NODE 13 --> 28.003933 sigma out 1act.( 26.6887436 sig in 13act.) RANK 5 NODE 5 --> 17.0841064 sigma out 1act.( 15.1696138 sig in 13act.) RANK 6 NODE 7 --> 14.3841524 sigma out 1act.( 13.4687462 sig in 13act.) RANK 7 NODE 12 --> 13.4305992 sigma out 1act.( 12.0778322 sig in 13act.) RANK 8 NODE 9 --> 12.8107681 sigma out 1act.( 11.6391459 sig in 13act.) RANK 9 NODE 3 --> 12.0876694 sigma out 1act.( 11.173419 sig in 13act.) RANK 10 NODE 4 --> 10.7749805 sigma out 1act.( 9.61838055 sig in 13act.) RANK 11 NODE 8 --> 8.25258636 sigma out 1act.( 7.84522581 sig in 13act.) RANK 12 NODE 2 --> 7.25933409 sigma out 1act.( 7.36518431 sig in 13act.) RANK 13 NODE 11 --> 7.07357693 sigma out 1act.( 6.98197651 sig in 13act.) RANK 14 NODE 14 --> 6.98728037 sigma out 1act.( 6.7481761 sig in 13act.) RANK 15 NODE 6 --> 0.476118833 sigma out 1act.( 1.27636135 sig in 13act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 139.807617 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.537379622 *** contribution from regularisation: 0.00368269091 *** contribution from error: -0.541062295 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52635.7972 -0.00721750781 19.140543 EXIT FROM BFGS code FG_LNSRCH 0. -0.00721744448 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.53737092 *** contribution from regularisation: 0.00369141204 *** contribution from error: -0.541062355 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52634.9429 -0.00721744448 19.1518955 EXIT FROM BFGS code FG_LNSRCH 0. -0.00721744448 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.537382483 *** contribution from regularisation: 0.00367983477 *** contribution from error: -0.541062295 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52636.0769 -0.00721744448 19.1621494 EXIT FROM BFGS code FG_LNSRCH 0. -0.00721744448 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.537381232 *** contribution from regularisation: 0.00368106877 *** contribution from error: -0.541062295 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52635.9561 -0.00721744448 19.1717968 EXIT FROM BFGS code NEW_X -52635.9561 -0.00721744448 19.1717968 ENTER BFGS code NEW_X -52635.9561 -0.00721744448 19.1717968 EXIT FROM BFGS code CONVERGENC -52635.9561 -0.00721744448 19.1717968 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 146.162964 sigma out 15 active outputs RANK 2 NODE 3 --> 90.1209412 sigma out 15 active outputs RANK 3 NODE 1 --> 61.2775612 sigma out 15 active outputs RANK 4 NODE 8 --> 31.1567097 sigma out 15 active outputs RANK 5 NODE 2 --> 29.503397 sigma out 15 active outputs RANK 6 NODE 10 --> 28.3213673 sigma out 15 active outputs RANK 7 NODE 6 --> 26.9958458 sigma out 15 active outputs RANK 8 NODE 9 --> 23.9451828 sigma out 15 active outputs RANK 9 NODE 11 --> 22.1482182 sigma out 15 active outputs RANK 10 NODE 7 --> 20.7619972 sigma out 15 active outputs RANK 11 NODE 4 --> 17.6539955 sigma out 15 active outputs RANK 12 NODE 13 --> 14.3730307 sigma out 15 active outputs RANK 13 NODE 5 --> 11.4900188 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 168.85083 sigma in 13act. ( 188.768814 sig out 1act.) RANK 2 NODE 15 --> 57.0169907 sigma in 13act. ( 55.52631 sig out 1act.) RANK 3 NODE 1 --> 53.4862061 sigma in 13act. ( 53.4485817 sig out 1act.) RANK 4 NODE 13 --> 40.7272148 sigma in 13act. ( 43.5257874 sig out 1act.) RANK 5 NODE 5 --> 22.8784256 sigma in 13act. ( 26.4178543 sig out 1act.) RANK 6 NODE 7 --> 19.9057083 sigma in 13act. ( 22.63167 sig out 1act.) RANK 7 NODE 12 --> 17.7799129 sigma in 13act. ( 21.0975685 sig out 1act.) RANK 8 NODE 9 --> 17.3663788 sigma in 13act. ( 19.845953 sig out 1act.) RANK 9 NODE 3 --> 16.8006973 sigma in 13act. ( 18.8094597 sig out 1act.) RANK 10 NODE 4 --> 14.3343267 sigma in 13act. ( 16.6958637 sig out 1act.) RANK 11 NODE 8 --> 11.5959444 sigma in 13act. ( 12.8528414 sig out 1act.) RANK 12 NODE 2 --> 10.7016878 sigma in 13act. ( 11.3940506 sig out 1act.) RANK 13 NODE 11 --> 10.1517906 sigma in 13act. ( 10.9301605 sig out 1act.) RANK 14 NODE 14 --> 9.87630367 sigma in 13act. ( 10.8543673 sig out 1act.) RANK 15 NODE 6 --> 1.38749552 sigma in 13act. ( 0.706100106 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 188.768814 sigma out 1act.( 168.85083 sig in 13act.) RANK 2 NODE 15 --> 55.52631 sigma out 1act.( 57.0169907 sig in 13act.) RANK 3 NODE 1 --> 53.4485817 sigma out 1act.( 53.4862061 sig in 13act.) RANK 4 NODE 13 --> 43.5257874 sigma out 1act.( 40.7272148 sig in 13act.) RANK 5 NODE 5 --> 26.4178543 sigma out 1act.( 22.8784256 sig in 13act.) RANK 6 NODE 7 --> 22.63167 sigma out 1act.( 19.9057083 sig in 13act.) RANK 7 NODE 12 --> 21.0975685 sigma out 1act.( 17.7799129 sig in 13act.) RANK 8 NODE 9 --> 19.845953 sigma out 1act.( 17.3663788 sig in 13act.) RANK 9 NODE 3 --> 18.8094597 sigma out 1act.( 16.8006973 sig in 13act.) RANK 10 NODE 4 --> 16.6958637 sigma out 1act.( 14.3343267 sig in 13act.) RANK 11 NODE 8 --> 12.8528414 sigma out 1act.( 11.5959444 sig in 13act.) RANK 12 NODE 2 --> 11.3940506 sigma out 1act.( 10.7016878 sig in 13act.) RANK 13 NODE 11 --> 10.9301605 sigma out 1act.( 10.1517906 sig in 13act.) RANK 14 NODE 14 --> 10.8543673 sigma out 1act.( 9.87630367 sig in 13act.) RANK 15 NODE 6 --> 0.706100106 sigma out 1act.( 1.38749552 sig in 13act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 216.06131 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.537367582 *** contribution from regularisation: 0.00369474222 *** contribution from error: -0.541062295 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30604 Closing output file done