NNInput NNInputs_145.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 184113 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 47777 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 47777 Chosen entries: 47777 Signal fraction: 1 Background fraction: 0.350436 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 47777 Entries to split: 47777 Test with : 23888 Train with : 23888 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 47777 for Signal Prepared event 0 for Signal with 47777 events ====Entry 0 Variable Ht : 172.917 Variable LepAPt : 28.3138 Variable LepBPt : 20.098 Variable MetSigLeptonsJets : 7.843 Variable MetSpec : 76.8658 Variable SumEtLeptonsJets : 96.051 Variable VSumJetLeptonsPt : 77.1984 Variable addEt : 125.278 Variable dPhiLepSumMet : 2.50109 Variable dPhiLeptons : 0.378813 Variable dRLeptons : 0.471432 Variable lep1_E : 39.4547 Variable lep2_E : 23.5705 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2145 Ht = 172.917 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 28.314 LepAPt = 28.3138 LepBEt = 20.098 LepBPt = 20.098 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 76.8658 MetDelPhi = 2.27916 MetSig = 5.37355 MetSigLeptonsJets = 7.843 MetSpec = 76.8658 Mjj = 0 MostCentralJetEta = 1.79326 MtllMet = 134.112 Njets = 1 SB = 0 SumEt = 204.618 SumEtJets = 0 SumEtLeptonsJets = 96.051 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 77.1984 addEt = 125.278 dPhiLepSumMet = 2.50109 dPhiLeptons = 0.378813 dRLeptons = 0.471432 diltype = 49 dimass = 11.2172 event = 188 jet1_Et = 47.6392 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 39.4547 lep2_E = 23.5705 rand = 0.999742 run = 236503 weight = 3.13807e-06 ===Show End Prepared event 10000 for Signal with 47777 events Prepared event 20000 for Signal with 47777 events Prepared event 30000 for Signal with 47777 events Prepared event 40000 for Signal with 47777 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.346013 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4403 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 184113 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4403 negative weights. Signal fraction: 62.9948311 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.6220627 65.7805481 67.1777725 68.3708649 69.5592194 70.5213699 71.3595963 72.0884705 72.9947357 73.6825714 74.4404602 75.1347351 75.7395325 76.4108734 77.0072174 77.7472992 78.4707184 79.1404877 79.7648621 80.4828491 81.0815277 81.8595886 82.6835327 83.5211182 84.4890823 85.4127502 86.3961182 87.4165039 88.5266266 89.2854156 90.5894928 91.8512573 93.0654297 94.4342346 95.4402771 96.775116 98.1238556 99.397049 100.474808 101.633537 102.916397 104.173126 105.697342 106.971313 108.36824 109.631798 110.88578 112.225784 113.501678 114.853897 116.20607 117.460464 118.768097 119.717636 120.913788 122.124405 123.411118 124.603745 125.829391 127.008972 128.367722 129.57074 130.776733 131.97876 133.165451 134.305573 135.694214 137.030243 138.330963 139.665283 141.04068 142.527374 144.059586 145.774841 147.540787 149.126328 151.088409 153.250366 155.319077 157.252136 159.63269 161.769073 164.47467 167.012146 170.019211 172.88269 175.969208 179.266022 182.712952 186.963196 191.779099 196.918213 202.621307 209.169159 217.289886 228.018127 242.101578 263.155518 295.807922 869.036377 ------------------------------ Transdef: Tab for variable 3 20.0009289 20.338974 20.6858387 21.0098457 21.2337627 21.475441 21.728981 21.9655323 22.183609 22.3917618 22.5937004 22.8061199 22.9708481 23.1896667 23.3977757 23.6078014 23.8047562 24.0435448 24.2452049 24.4525146 24.6384468 24.8333569 25.0247898 25.1999817 25.416832 25.6135826 25.8244209 26.0021057 26.1960182 26.4052353 26.6131744 26.8057251 27.019392 27.2261333 27.4478436 27.6717167 27.8714275 28.0878067 28.3122406 28.5396423 28.724781 28.961441 29.1932125 29.4127102 29.6640358 29.9287529 30.1729469 30.4082947 30.6391506 30.8828411 31.1234169 31.3722324 31.5906506 31.8023567 32.0452423 32.2829514 32.5555229 32.8251343 33.1134109 33.3516235 33.6580505 33.9251633 34.2146149 34.5201912 34.8378143 35.1428604 35.4595757 35.7497635 36.066185 36.3950348 36.6755219 37.0140762 37.3688622 37.6925125 38.0432549 38.424984 38.8308945 39.1708908 39.5264511 39.9527664 40.345871 40.8465652 41.3260803 41.7952118 42.3554764 42.9498596 43.5504532 44.1491165 44.89748 45.7179489 46.5251541 47.5588684 48.6304512 49.8896408 51.3279762 53.1553383 55.4170609 58.1823044 62.7828293 71.2454681 162.429443 ------------------------------ Transdef: Tab for variable 4 10.0000515 10.1116428 10.2659845 10.3881912 10.4836559 10.5854454 10.6917276 10.8195381 10.9536448 11.0811777 11.2112904 11.3702068 11.4949303 11.6295033 11.7691879 11.9043159 12.0370693 12.1953888 12.3136959 12.4565411 12.6088295 12.7744017 12.9271679 13.0807714 13.268507 13.4358969 13.5921192 13.7256699 13.8750706 14.0429897 14.2110157 14.3795662 14.5745792 14.7571812 14.9468365 15.1231213 15.2915459 15.4470921 15.6563663 15.8600998 16.0482597 16.2631378 16.4567928 16.6472969 16.833292 17.0307312 17.2624359 17.487709 17.7063828 17.9407616 18.1741772 18.4109802 18.6458416 18.8691788 19.0625458 19.3050957 19.5501652 19.8068314 20.0692558 20.2689304 20.4898853 20.7188072 20.9696541 21.2098961 21.4487629 21.6826363 21.9206467 22.1077347 22.3601437 22.6095676 22.8641586 23.1554108 23.4145699 23.7366524 24.0474167 24.3582783 24.6416283 24.9512177 25.248661 25.5422096 25.8444099 26.1981697 26.5696793 26.9107304 27.3015518 27.6922626 28.0870361 28.4708862 28.8841896 29.3510704 29.8788567 30.4071102 31.0613174 31.6818848 32.4086609 33.2844086 34.437851 35.8359337 38.0633354 42.4474754 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.04660308 2.56608105 2.99283552 3.28219461 3.51346302 3.7585597 3.95198417 4.10028839 4.22177887 4.34602928 4.44251347 4.54235077 4.63999653 4.7335186 4.81361389 4.89974976 4.96753216 5.04275084 5.10974598 5.16703129 5.23430157 5.29024124 5.34211063 5.39923 5.45453167 5.51112986 5.55999184 5.60893822 5.66316843 5.71316099 5.75905895 5.80485058 5.85295582 5.90087223 5.94600391 5.98739529 6.02718973 6.07529163 6.1169095 6.16156578 6.20475483 6.23842335 6.27454376 6.3099103 6.34983921 6.39956474 6.44735432 6.49338341 6.53748417 6.57941914 6.626616 6.66296387 6.70766926 6.75263262 6.8004694 6.84291077 6.87498093 6.91635752 6.96612549 7.00583363 7.05623007 7.10371161 7.15126562 7.19082928 7.23342514 7.27998734 7.32706118 7.37446928 7.41960812 7.46619654 7.50425148 7.55001259 7.59904528 7.65476322 7.70674133 7.7616024 7.81768608 7.86809635 7.92557859 7.98011303 8.03560829 8.09150696 8.15243149 8.2172575 8.27963066 8.34981346 8.41916847 8.49845028 8.56958961 8.66423416 8.74251747 8.83363724 8.9420433 9.05349731 9.19096661 9.35624886 9.57125854 9.83626652 10.2730141 11.0489874 22.6250648 ------------------------------ Transdef: Tab for variable 6 15.003664 20.3030605 25.0436306 25.9977112 27.0644684 27.912365 28.8106613 29.5478973 30.3037109 30.9790993 31.5970879 32.079834 32.6695862 33.0632858 33.5189285 33.9906387 34.5043869 34.892067 35.3228989 35.7290001 36.0955849 36.4761429 36.8281021 37.2206879 37.5701065 37.9390335 38.3153 38.6717834 39.048378 39.4394569 39.814003 40.2288895 40.5387115 40.9274292 41.3076782 41.73806 42.2061729 42.5838623 43.0170898 43.4833527 43.9242935 44.4148788 44.897049 45.4359436 45.8878403 46.4692993 47.0510483 47.5258331 48.0005798 48.5960579 49.1529465 49.6624374 50.2107849 50.6627274 51.1443481 51.7545204 52.3598938 53.0470657 53.7171173 54.2617302 54.8349915 55.4632263 56.0930557 56.6544037 57.214119 57.817276 58.3901978 58.8347282 59.524147 60.1538467 60.7760773 61.4752274 62.0684547 62.7215958 63.3548737 63.9947586 64.6612778 65.3646851 66.0213852 66.7067566 67.3746185 68.0873642 68.8683014 69.5590973 70.3853455 71.2041473 72.181015 73.1667786 74.1908951 75.3508606 76.673645 78.0268707 79.6954956 81.4907227 83.9683685 86.8523331 90.3729248 95.1046066 102.226822 114.006775 241.141922 ------------------------------ Transdef: Tab for variable 7 30.1648712 32.854084 33.7959747 34.5655327 35.0485115 35.5188446 35.993248 36.4326401 36.8789673 37.2598953 37.6286011 37.9804916 38.3008995 38.6142464 38.8875961 39.2062988 39.5253029 39.809967 40.1464005 40.4355011 40.8050003 41.1294479 41.4770203 41.8734055 42.2464828 42.6497116 43.057766 43.6156769 44.1892776 44.6453552 45.2323074 45.8627548 46.604969 47.2338715 48.0051041 48.7665176 49.4521713 50.2802925 50.9944382 51.7480392 52.5272446 53.3532104 54.0969315 54.9766006 55.765976 56.4503746 57.1807938 57.887249 58.5651283 59.2519646 59.9458313 60.7303391 61.2330322 61.9780121 62.6842422 63.4302025 64.1933746 64.9784317 65.7481842 66.539917 67.3540726 68.1465454 68.9726868 69.8675995 70.7674713 71.6400909 72.5844727 73.7923126 75.0447998 76.3053894 77.6084137 78.8663635 80.3223877 81.7439117 83.1006775 84.6442413 86.2730713 87.9429474 89.5925674 91.3622208 93.1530457 95.0077057 96.8981247 98.9995422 101.340942 103.71109 106.03289 108.711639 111.564049 114.782692 118.012466 121.971558 126.16613 131.019409 137.018845 143.037506 151.352051 162.747955 179.388245 209.377151 608.361023 ------------------------------ Transdef: Tab for variable 8 3.10723281 23.4704571 28.3117752 30.2853012 31.6047363 32.4558105 33.0537033 33.6116333 33.9912109 34.4500427 34.884697 35.222187 35.5706558 35.9358902 36.2650986 36.5679436 36.8468094 37.131958 37.3853264 37.6947327 38.0101471 38.2742043 38.5561676 38.8256302 39.0563889 39.329937 39.591568 39.8551102 40.1353645 40.4453697 40.8099785 41.1314964 41.4264145 41.7976379 42.1745682 42.5526047 42.9730682 43.3635941 43.7358017 44.143158 44.6247826 45.1044083 45.5470047 46.1393929 46.6401749 47.1642609 47.7275543 48.2822609 48.760849 49.2726402 49.7265053 50.2055969 50.7965546 51.3219681 51.8979111 52.4688263 53.0065727 53.5059052 54.0490265 54.6418762 55.19561 55.7210159 56.2665901 56.8233185 57.362545 57.9275475 58.4184265 58.9344559 59.534565 60.08601 60.6927757 61.1435242 61.746933 62.3998566 63.0174942 63.634201 64.2289276 64.8765411 65.558075 66.2294006 66.9210968 67.6046753 68.3817139 69.164093 69.9310608 70.7730789 71.7106323 72.7045135 73.8714142 75.2005386 76.605896 78.2216034 79.8799896 82.0340195 84.5640793 87.6612244 91.6604691 96.7508392 104.630386 117.475464 346.391968 ------------------------------ Transdef: Tab for variable 9 46.2959023 62.9890251 65.0606995 66.4320984 67.6215057 68.6941223 69.765213 70.5762863 71.3492432 71.9533844 72.7899475 73.4266052 74.0332336 74.727417 75.3061523 75.798996 76.3867569 76.9523773 77.4273148 78.1391678 78.7107239 79.2907104 79.7845917 80.4104767 80.9136658 81.4933167 82.2058105 82.8563538 83.5398102 84.2793579 84.90168 85.7632904 86.5708923 87.4165039 88.2808838 88.9155426 89.8814926 90.9127045 91.8764725 92.8704453 93.9639893 94.8327332 95.6685181 96.7409821 97.8886261 98.8145905 99.8255157 100.956116 101.832626 102.908318 103.93335 104.950577 106.057327 107.014175 108.057457 109.044823 109.996117 110.841644 111.825043 112.834396 113.7565 114.809769 115.775558 116.728516 117.743378 118.689453 119.677795 120.387833 121.258698 122.144318 123.141449 123.99617 124.964996 126.028122 126.86644 127.941452 128.809052 129.695374 130.556885 131.523895 132.41507 133.340393 134.266663 135.311066 136.351196 137.439392 138.528946 139.663437 140.869476 142.046692 143.511917 144.981873 146.651855 148.333313 150.622894 153.372162 156.97522 161.922668 171.233948 189.539001 432.321075 ------------------------------ Transdef: Tab for variable 10 0.00143814425 1.01590538 1.33769631 1.53897285 1.68628979 1.80275512 1.91065812 1.99387395 2.07081795 2.14200783 2.20266032 2.25891113 2.30774641 2.34937382 2.3892312 2.42512989 2.45792365 2.49215841 2.52536154 2.55376244 2.57949877 2.60498381 2.62785816 2.65103054 2.673455 2.69547486 2.71597815 2.73321056 2.75107861 2.76672196 2.78179717 2.79726505 2.81033134 2.8247366 2.83658028 2.84761286 2.85780954 2.86754894 2.87842703 2.88756704 2.89729142 2.90773606 2.91571951 2.92352223 2.93152905 2.93908477 2.94727516 2.95470333 2.96179008 2.96802306 2.97427702 2.97996283 2.98469973 2.98992538 2.99574947 3.0018003 3.00654078 3.01129198 3.01555109 3.02044201 3.02508593 3.0294807 3.03350639 3.03754711 3.0412519 3.04465413 3.04879284 3.05254722 3.05625486 3.05970311 3.0628624 3.06633639 3.06928873 3.07220888 3.07530022 3.07825899 3.08097982 3.08380175 3.08692122 3.08985972 3.09267187 3.09513664 3.09776163 3.10063982 3.10351467 3.10606503 3.10900235 3.11148357 3.11402369 3.11631131 3.11885786 3.12127733 3.12364721 3.12617254 3.12845659 3.13052559 3.13225889 3.13445878 3.13670683 3.13914776 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00608193874 0.0120328125 0.019816637 0.0253482014 0.0336533785 0.0423536897 0.0499506295 0.0589553118 0.0662221909 0.0738456398 0.0805156231 0.0879554227 0.0960600451 0.103019238 0.108363152 0.116607606 0.124062538 0.130747437 0.138462126 0.146843314 0.15475376 0.162466034 0.168243468 0.174859405 0.180767536 0.187215328 0.193865895 0.199728429 0.205585361 0.211217284 0.216911271 0.222588092 0.228627592 0.233306885 0.239407182 0.245196953 0.251119494 0.256514788 0.261995912 0.267312557 0.273302019 0.279195786 0.284601927 0.290364593 0.295645118 0.300943613 0.306949437 0.312137365 0.318014622 0.32396391 0.329468369 0.335626721 0.341071606 0.345960855 0.351781189 0.357638717 0.363249838 0.369077265 0.374798894 0.380517125 0.386514962 0.391359538 0.397492528 0.403440356 0.409351945 0.414908707 0.420533985 0.426325709 0.432614565 0.439430356 0.445477933 0.452254772 0.458249331 0.464510322 0.47110939 0.477664113 0.484850407 0.493138552 0.500762463 0.509338498 0.516642809 0.524149477 0.53257966 0.54376483 0.552162051 0.561568022 0.572245121 0.583708167 0.596501946 0.608028114 0.621225357 0.635196328 0.652321219 0.670332968 0.693328619 0.71647954 0.743275166 0.789243102 0.840049565 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.216783747 0.229457378 0.24075675 0.251587838 0.261634648 0.27050972 0.279089034 0.286731243 0.295241177 0.302898467 0.30966264 0.316962421 0.324115396 0.331010163 0.338183492 0.344657242 0.349711895 0.355194986 0.361348748 0.367363572 0.373397708 0.378726363 0.38503322 0.390484273 0.395828068 0.400647461 0.404552698 0.408896059 0.412810445 0.416359067 0.419901788 0.424050659 0.427821636 0.431549966 0.435486078 0.439261138 0.443025142 0.446476072 0.450180441 0.454206586 0.457799464 0.461420476 0.464977711 0.468722701 0.471991301 0.475906998 0.478573829 0.482564628 0.486589551 0.490206063 0.493687391 0.497581154 0.501380682 0.505628109 0.509649515 0.513348043 0.517944694 0.522232294 0.526780725 0.531306386 0.536381841 0.541089416 0.546123862 0.550779939 0.555393815 0.559463263 0.564661741 0.569422364 0.574844956 0.580731571 0.587213576 0.5932284 0.598581791 0.604622424 0.610610545 0.617296696 0.623605549 0.630642176 0.638096213 0.646093965 0.652787209 0.659159303 0.666108131 0.673664391 0.681077242 0.689582467 0.70018512 0.710956693 0.720601082 0.728809178 0.741619229 0.752529263 0.766432524 0.781884253 0.797172189 0.816344857 0.839689851 0.866065383 0.908638418 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0222435 21.5056839 22.3113518 22.97118 23.5122681 24.0199337 24.5130081 24.9305763 25.3112278 25.6950836 26.130579 26.5237579 26.893074 27.2683506 27.6419888 27.9958115 28.341526 28.662571 28.9599228 29.2766209 29.6079865 29.9212608 30.2940941 30.5950203 30.9059124 31.1379948 31.4229774 31.679081 32.0130997 32.3101807 32.5698051 32.8573914 33.1699905 33.4621277 33.7813263 34.1063347 34.4340057 34.7555695 35.0884361 35.4119072 35.7355385 36.0535736 36.3604355 36.7078476 37.0829773 37.4192123 37.7552261 38.1084442 38.4449806 38.7819138 39.1668777 39.5172157 39.9292221 40.3708801 40.7598495 41.165863 41.5464783 41.9583893 42.4064941 42.8334694 43.2638588 43.6760864 44.1163483 44.5652466 45.0717468 45.550663 46.0336761 46.4482193 46.9621964 47.4619064 48.0107193 48.5595322 49.1924324 49.8333054 50.3988571 50.9813461 51.7191238 52.5058517 53.3743973 54.1273193 54.9330559 55.8177414 56.7458191 57.6886444 58.6487808 59.8154678 61.1319427 62.3973312 63.9196014 65.2122192 66.858696 68.6731262 70.6074829 73.2328644 76.1724091 79.9044189 84.0654678 87.602829 92.6428986 103.687973 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7305679 11.1730118 11.4727917 11.7606468 12.0922613 12.3245487 12.6185684 12.9235096 13.2777138 13.5706844 13.8528652 14.1090145 14.3790398 14.6135244 14.895874 15.1898994 15.4367466 15.6927814 15.9165859 16.1969604 16.4604187 16.6887817 16.9118233 17.1993217 17.4913788 17.7299652 17.9931412 18.2613792 18.5455952 18.7717171 19.0503387 19.3060379 19.5867004 19.8521709 20.1009598 20.3678551 20.6003551 20.8582191 21.1355362 21.4129353 21.6673813 21.9039612 22.1540451 22.4069538 22.6808167 22.9361038 23.1904716 23.437397 23.6967201 23.9711838 24.2350044 24.5279198 24.7951622 25.0852394 25.3693657 25.6048431 25.8727875 26.1393318 26.4260311 26.7105637 27.0467453 27.3505516 27.6576462 27.956604 28.2316875 28.5298233 28.8492088 29.1349354 29.4772224 29.8057766 30.1410961 30.4650173 30.8780823 31.2381401 31.5922985 32.0042877 32.4417496 32.9195061 33.3922997 33.7456779 34.2018356 34.6580505 35.1859207 35.7479477 36.3445244 36.9772835 37.6299896 38.4365005 39.2349243 40.0917053 41.1076508 42.2830353 43.4423561 44.8565903 46.6638908 49.0174446 52.4038849 56.4267654 63.4023094 116.249611 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 60.3 39.8 46.5 20.6 41.5 58.1 46.7 56.6 -30.0 -14.0 -31.2 6.5 18.4 2 60.3 100.0 62.8 56.2 28.5 65.0 94.2 70.9 90.5 -47.1 -24.0 -47.2 28.7 29.0 3 39.8 62.8 100.0 37.1 3.8 29.6 66.2 49.9 69.3 -14.8 -25.5 -51.3 63.2 17.4 4 46.5 56.2 37.1 100.0 10.6 32.3 56.8 46.9 62.4 -12.7 -28.5 -59.1 14.6 70.6 5 20.6 28.5 3.8 10.6 100.0 82.6 0.2 52.7 53.1 26.1 -6.4 -7.4 -7.1 0.7 6 41.5 65.0 29.6 32.3 82.6 100.0 43.0 76.8 78.2 -5.4 -14.7 -25.9 7.3 13.6 7 58.1 94.2 66.2 56.8 0.2 43.0 100.0 62.4 78.1 -55.2 -22.6 -47.3 33.4 31.1 8 46.7 70.9 49.9 46.9 52.7 76.8 62.4 100.0 81.0 -9.6 -22.8 -40.3 22.9 25.4 9 56.6 90.5 69.3 62.4 53.1 78.2 78.1 81.0 100.0 -21.0 -27.4 -53.7 33.9 34.3 10 -30.0 -47.1 -14.8 -12.7 26.1 -5.4 -55.2 -9.6 -21.0 100.0 3.9 9.4 -3.4 -3.9 11 -14.0 -24.0 -25.5 -28.5 -6.4 -14.7 -22.6 -22.8 -27.4 3.9 100.0 54.1 -12.7 -19.6 12 -31.2 -47.2 -51.3 -59.1 -7.4 -25.9 -47.3 -40.3 -53.7 9.4 54.1 100.0 -24.8 -34.8 13 6.5 28.7 63.2 14.6 -7.1 7.3 33.4 22.9 33.9 -3.4 -12.7 -24.8 100.0 43.3 14 18.4 29.0 17.4 70.6 0.7 13.6 31.1 25.4 34.3 -3.9 -19.6 -34.8 43.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 144.01425 TOTAL CORRELATION OF ALL VARIABLES 66.5542004 ROUND 1: MAX CORR ( 66.553299) AFTER KILLING INPUT VARIABLE 6 CONTR 0.346389501 ROUND 2: MAX CORR ( 66.5377851) AFTER KILLING INPUT VARIABLE 11 CONTR 1.43692756 ROUND 3: MAX CORR ( 66.5013414) AFTER KILLING INPUT VARIABLE 8 CONTR 2.20191824 ROUND 4: MAX CORR ( 66.4318998) AFTER KILLING INPUT VARIABLE 14 CONTR 3.03827027 ROUND 5: MAX CORR ( 66.3305046) AFTER KILLING INPUT VARIABLE 2 CONTR 3.66898767 ROUND 6: MAX CORR ( 66.1605425) AFTER KILLING INPUT VARIABLE 12 CONTR 4.74536198 ROUND 7: MAX CORR ( 65.6030312) AFTER KILLING INPUT VARIABLE 10 CONTR 8.57086257 ROUND 8: MAX CORR ( 64.9336246) AFTER KILLING INPUT VARIABLE 9 CONTR 9.34783945 ROUND 9: MAX CORR ( 64.2286586) AFTER KILLING INPUT VARIABLE 3 CONTR 9.54227514 ROUND 10: MAX CORR ( 63.1815206) AFTER KILLING INPUT VARIABLE 13 CONTR 11.5505862 ROUND 11: MAX CORR ( 61.642288) AFTER KILLING INPUT VARIABLE 4 CONTR 13.8612001 ROUND 12: MAX CORR ( 58.1432607) AFTER KILLING INPUT VARIABLE 5 CONTR 20.4727357 LAST REMAINING VARIABLE: 7 total correlation to target: 66.5542004 % total significance: 129.973465 sigma correlations of single variables to target: variable 2: 60.3095207 % , in sigma: 117.778252 variable 3: 39.7710009 % , in sigma: 77.6686485 variable 4: 46.4849864 % , in sigma: 90.7803674 variable 5: 20.599143 % , in sigma: 40.2279943 variable 6: 41.5301275 % , in sigma: 81.1040408 variable 7: 58.1432607 % , in sigma: 113.547771 variable 8: 46.7133557 % , in sigma: 91.226349 variable 9: 56.5603899 % , in sigma: 110.456588 variable 10: -29.981072 % , in sigma: 58.5499307 variable 11: -14.0386367 % , in sigma: 27.4160045 variable 12: -31.1962937 % , in sigma: 60.9231329 variable 13: 6.47208061 % , in sigma: 12.6393036 variable 14: 18.39306 % , in sigma: 35.9197425 variables sorted by significance: 1 most relevant variable 7 corr 58.143261 , in sigma: 113.547771 2 most relevant variable 5 corr 20.4727364 , in sigma: 39.9811352 3 most relevant variable 4 corr 13.8612003 , in sigma: 27.0694897 4 most relevant variable 13 corr 11.5505867 , in sigma: 22.5571004 5 most relevant variable 3 corr 9.54227543 , in sigma: 18.6350763 6 most relevant variable 9 corr 9.34783936 , in sigma: 18.2553628 7 most relevant variable 10 corr 8.57086277 , in sigma: 16.7380079 8 most relevant variable 12 corr 4.7453618 , in sigma: 9.26720048 9 most relevant variable 2 corr 3.66898775 , in sigma: 7.16515335 10 most relevant variable 14 corr 3.03827024 , in sigma: 5.93342732 11 most relevant variable 8 corr 2.20191813 , in sigma: 4.30011821 12 most relevant variable 11 corr 1.43692756 , in sigma: 2.8061708 13 most relevant variable 6 corr 0.346389502 , in sigma: 0.676462848 global correlations between input variables: variable 2: 99.1225485 % variable 3: 92.8501368 % variable 4: 91.740607 % variable 5: 95.2543405 % variable 6: 94.502109 % variable 7: 98.6862022 % variable 8: 88.2382583 % variable 9: 98.7894573 % variable 10: 72.4131721 % variable 11: 55.1901613 % variable 12: 75.7035291 % variable 13: 84.7064573 % variable 14: 87.4215597 % significance loss when removing single variables: variable 2: corr = 4.24351615 % , sigma = 8.28714784 variable 3: corr = 13.5122729 % , sigma = 26.3880705 variable 4: corr = 15.5321682 % , sigma = 30.332717 variable 5: corr = 12.4105923 % , sigma = 24.2366022 variable 6: corr = 0.346389501 % , sigma = 0.676462845 variable 7: corr = 5.27109671 % , sigma = 10.2939063 variable 8: corr = 2.24482261 % , sigma = 4.38390622 variable 9: corr = 9.9190034 % , sigma = 19.370787 variable 10: corr = 7.97812237 % , sigma = 15.5804473 variable 11: corr = 1.44705687 % , sigma = 2.82595229 variable 12: corr = 3.81429971 % , sigma = 7.44893256 variable 13: corr = 7.89200124 % , sigma = 15.4122616 variable 14: corr = 2.94529331 % , sigma = 5.751853 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 24.2242718 sigma out 15 active outputs RANK 2 NODE 12 --> 23.7263584 sigma out 15 active outputs RANK 3 NODE 10 --> 22.6904659 sigma out 15 active outputs RANK 4 NODE 2 --> 20.8884373 sigma out 15 active outputs RANK 5 NODE 1 --> 20.4985943 sigma out 15 active outputs RANK 6 NODE 7 --> 19.7291832 sigma out 15 active outputs RANK 7 NODE 9 --> 18.3313179 sigma out 15 active outputs RANK 8 NODE 4 --> 17.2910748 sigma out 15 active outputs RANK 9 NODE 5 --> 17.209156 sigma out 15 active outputs RANK 10 NODE 8 --> 12.329566 sigma out 15 active outputs RANK 11 NODE 3 --> 11.8710575 sigma out 15 active outputs RANK 12 NODE 6 --> 10.6676159 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 35.1956291 sigma in 12act. ( 35.9619904 sig out 1act.) RANK 2 NODE 3 --> 33.3069153 sigma in 12act. ( 31.5313549 sig out 1act.) RANK 3 NODE 7 --> 25.6391525 sigma in 12act. ( 26.4858665 sig out 1act.) RANK 4 NODE 10 --> 22.936058 sigma in 12act. ( 27.4505901 sig out 1act.) RANK 5 NODE 9 --> 16.1268539 sigma in 12act. ( 17.6718979 sig out 1act.) RANK 6 NODE 11 --> 10.4454918 sigma in 12act. ( 11.4316654 sig out 1act.) RANK 7 NODE 2 --> 10.3146963 sigma in 12act. ( 4.04044437 sig out 1act.) RANK 8 NODE 6 --> 9.75849724 sigma in 12act. ( 10.3800554 sig out 1act.) RANK 9 NODE 12 --> 7.81406498 sigma in 12act. ( 12.3550615 sig out 1act.) RANK 10 NODE 4 --> 6.13293791 sigma in 12act. ( 7.39433002 sig out 1act.) RANK 11 NODE 8 --> 4.79167223 sigma in 12act. ( 3.04977274 sig out 1act.) RANK 12 NODE 1 --> 2.93106222 sigma in 12act. ( 1.35952914 sig out 1act.) RANK 13 NODE 15 --> 2.58734322 sigma in 12act. ( 4.00070953 sig out 1act.) RANK 14 NODE 13 --> 2.4839859 sigma in 12act. ( 1.31034434 sig out 1act.) RANK 15 NODE 14 --> 1.69681323 sigma in 12act. ( 0.357436776 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 35.9619904 sigma out 1act.( 35.1956291 sig in 12act.) RANK 2 NODE 3 --> 31.5313549 sigma out 1act.( 33.3069153 sig in 12act.) RANK 3 NODE 10 --> 27.4505901 sigma out 1act.( 22.936058 sig in 12act.) RANK 4 NODE 7 --> 26.4858665 sigma out 1act.( 25.6391525 sig in 12act.) RANK 5 NODE 9 --> 17.6718979 sigma out 1act.( 16.1268539 sig in 12act.) RANK 6 NODE 12 --> 12.3550615 sigma out 1act.( 7.81406498 sig in 12act.) RANK 7 NODE 11 --> 11.4316654 sigma out 1act.( 10.4454918 sig in 12act.) RANK 8 NODE 6 --> 10.3800554 sigma out 1act.( 9.75849724 sig in 12act.) RANK 9 NODE 4 --> 7.39433002 sigma out 1act.( 6.13293791 sig in 12act.) RANK 10 NODE 2 --> 4.04044437 sigma out 1act.( 10.3146963 sig in 12act.) RANK 11 NODE 15 --> 4.00070953 sigma out 1act.( 2.58734322 sig in 12act.) RANK 12 NODE 8 --> 3.04977274 sigma out 1act.( 4.79167223 sig in 12act.) RANK 13 NODE 1 --> 1.35952914 sigma out 1act.( 2.93106222 sig in 12act.) RANK 14 NODE 13 --> 1.31034434 sigma out 1act.( 2.4839859 sig in 12act.) RANK 15 NODE 14 --> 0.357436776 sigma out 1act.( 1.69681323 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 67.4232941 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 24.6834202 sigma out 15 active outputs RANK 2 NODE 12 --> 23.8974609 sigma out 15 active outputs RANK 3 NODE 11 --> 21.7436771 sigma out 15 active outputs RANK 4 NODE 1 --> 19.8911476 sigma out 15 active outputs RANK 5 NODE 7 --> 19.846323 sigma out 15 active outputs RANK 6 NODE 2 --> 19.0411663 sigma out 15 active outputs RANK 7 NODE 9 --> 17.9100418 sigma out 15 active outputs RANK 8 NODE 5 --> 17.7264633 sigma out 15 active outputs RANK 9 NODE 4 --> 15.8605127 sigma out 15 active outputs RANK 10 NODE 3 --> 12.5187473 sigma out 15 active outputs RANK 11 NODE 8 --> 12.2516384 sigma out 15 active outputs RANK 12 NODE 6 --> 10.987483 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 31.6049576 sigma in 12act. ( 31.5475407 sig out 1act.) RANK 2 NODE 3 --> 27.5433693 sigma in 12act. ( 27.1491432 sig out 1act.) RANK 3 NODE 10 --> 25.4313927 sigma in 12act. ( 25.5391312 sig out 1act.) RANK 4 NODE 7 --> 22.4775848 sigma in 12act. ( 23.1572933 sig out 1act.) RANK 5 NODE 9 --> 16.8299656 sigma in 12act. ( 16.6979961 sig out 1act.) RANK 6 NODE 12 --> 14.7485199 sigma in 12act. ( 12.4441795 sig out 1act.) RANK 7 NODE 11 --> 13.3220778 sigma in 12act. ( 10.9748783 sig out 1act.) RANK 8 NODE 15 --> 10.9143858 sigma in 12act. ( 6.2287879 sig out 1act.) RANK 9 NODE 6 --> 10.6629667 sigma in 12act. ( 10.0355644 sig out 1act.) RANK 10 NODE 4 --> 9.24910736 sigma in 12act. ( 7.53234863 sig out 1act.) RANK 11 NODE 2 --> 7.63159323 sigma in 12act. ( 2.41029644 sig out 1act.) RANK 12 NODE 8 --> 7.50193357 sigma in 12act. ( 2.50659752 sig out 1act.) RANK 13 NODE 14 --> 6.83780909 sigma in 12act. ( 0.907935381 sig out 1act.) RANK 14 NODE 13 --> 6.54559231 sigma in 12act. ( 1.18919909 sig out 1act.) RANK 15 NODE 1 --> 3.01748657 sigma in 12act. ( 0.334991664 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 31.5475407 sigma out 1act.( 31.6049576 sig in 12act.) RANK 2 NODE 3 --> 27.1491432 sigma out 1act.( 27.5433693 sig in 12act.) RANK 3 NODE 10 --> 25.5391312 sigma out 1act.( 25.4313927 sig in 12act.) RANK 4 NODE 7 --> 23.1572933 sigma out 1act.( 22.4775848 sig in 12act.) RANK 5 NODE 9 --> 16.6979961 sigma out 1act.( 16.8299656 sig in 12act.) RANK 6 NODE 12 --> 12.4441795 sigma out 1act.( 14.7485199 sig in 12act.) RANK 7 NODE 11 --> 10.9748783 sigma out 1act.( 13.3220778 sig in 12act.) RANK 8 NODE 6 --> 10.0355644 sigma out 1act.( 10.6629667 sig in 12act.) RANK 9 NODE 4 --> 7.53234863 sigma out 1act.( 9.24910736 sig in 12act.) RANK 10 NODE 15 --> 6.2287879 sigma out 1act.( 10.9143858 sig in 12act.) RANK 11 NODE 8 --> 2.50659752 sigma out 1act.( 7.50193357 sig in 12act.) RANK 12 NODE 2 --> 2.41029644 sigma out 1act.( 7.63159323 sig in 12act.) RANK 13 NODE 13 --> 1.18919909 sigma out 1act.( 6.54559231 sig in 12act.) RANK 14 NODE 14 --> 0.907935381 sigma out 1act.( 6.83780909 sig in 12act.) RANK 15 NODE 1 --> 0.334991664 sigma out 1act.( 3.01748657 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.709549 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.406950504 *** contribution from regularisation: 0.0042288918 *** contribution from error: -0.411179394 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.45443818 *** contribution from regularisation: 0.00247351988 *** contribution from error: -0.456911713 *********************************************** -----------------> Test sample ENTER BFGS code START -41842.9656 0.183151215 0.00420671934 EXIT FROM BFGS code FG_START 0. 0.183151215 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.479290128 *** contribution from regularisation: 0.00240356638 *** contribution from error: -0.481693685 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -44121.5322 0.183151215 -4.49416542 EXIT FROM BFGS code FG_LNSRCH 0. 0.182459638 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.52297467 *** contribution from regularisation: 0.00295331026 *** contribution from error: -0.525927961 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48142.9552 0.182459638 79.9692841 EXIT FROM BFGS code NEW_X -48142.9552 0.182459638 79.9692841 ENTER BFGS code NEW_X -48142.9552 0.182459638 79.9692841 EXIT FROM BFGS code FG_LNSRCH 0. 0.197583899 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.527158558 *** contribution from regularisation: 0.0031911144 *** contribution from error: -0.530349672 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48528.1061 0.197583899 29.1167011 EXIT FROM BFGS code NEW_X -48528.1061 0.197583899 29.1167011 ENTER BFGS code NEW_X -48528.1061 0.197583899 29.1167011 EXIT FROM BFGS code FG_LNSRCH 0. 0.206581175 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.52827692 *** contribution from regularisation: 0.00322765647 *** contribution from error: -0.531504571 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48631.0589 0.206581175 3.59429407 EXIT FROM BFGS code NEW_X -48631.0589 0.206581175 3.59429407 ENTER BFGS code NEW_X -48631.0589 0.206581175 3.59429407 EXIT FROM BFGS code FG_LNSRCH 0. 0.211190805 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.528698385 *** contribution from regularisation: 0.00319506275 *** contribution from error: -0.531893432 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48669.857 0.211190805 -11.6458502 EXIT FROM BFGS code NEW_X -48669.857 0.211190805 -11.6458502 ENTER BFGS code NEW_X -48669.857 0.211190805 -11.6458502 EXIT FROM BFGS code FG_LNSRCH 0. 0.210728884 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.529111922 *** contribution from regularisation: 0.00312964013 *** contribution from error: -0.532241583 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48707.9269 0.210728884 -17.8092632 EXIT FROM BFGS code NEW_X -48707.9269 0.210728884 -17.8092632 ENTER BFGS code NEW_X -48707.9269 0.210728884 -17.8092632 EXIT FROM BFGS code FG_LNSRCH 0. 0.190853506 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.5306862 *** contribution from regularisation: 0.00282882596 *** contribution from error: -0.533515036 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48852.8494 0.190853506 -41.1640358 EXIT FROM BFGS code NEW_X -48852.8494 0.190853506 -41.1640358 ENTER BFGS code NEW_X -48852.8494 0.190853506 -41.1640358 EXIT FROM BFGS code FG_LNSRCH 0. 0.17516695 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 46.3054161 sigma out 15 active outputs RANK 2 NODE 1 --> 27.5474529 sigma out 15 active outputs RANK 3 NODE 11 --> 23.6498108 sigma out 15 active outputs RANK 4 NODE 3 --> 19.4477043 sigma out 15 active outputs RANK 5 NODE 5 --> 18.0669155 sigma out 15 active outputs RANK 6 NODE 2 --> 16.16609 sigma out 15 active outputs RANK 7 NODE 12 --> 12.1935511 sigma out 15 active outputs RANK 8 NODE 6 --> 11.9986868 sigma out 15 active outputs RANK 9 NODE 7 --> 9.9725399 sigma out 15 active outputs RANK 10 NODE 4 --> 8.80357838 sigma out 15 active outputs RANK 11 NODE 9 --> 7.57081413 sigma out 15 active outputs RANK 12 NODE 8 --> 7.31693316 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 44.8830032 sigma in 12act. ( 47.0192146 sig out 1act.) RANK 2 NODE 15 --> 34.1207695 sigma in 12act. ( 32.8762283 sig out 1act.) RANK 3 NODE 12 --> 22.2173691 sigma in 12act. ( 17.1399288 sig out 1act.) RANK 4 NODE 11 --> 18.0562458 sigma in 12act. ( 15.7948399 sig out 1act.) RANK 5 NODE 6 --> 18.02491 sigma in 12act. ( 16.9193249 sig out 1act.) RANK 6 NODE 4 --> 12.9159126 sigma in 12act. ( 10.4901085 sig out 1act.) RANK 7 NODE 9 --> 12.0058241 sigma in 12act. ( 9.92249107 sig out 1act.) RANK 8 NODE 13 --> 9.08249283 sigma in 12act. ( 8.74791145 sig out 1act.) RANK 9 NODE 3 --> 8.65239906 sigma in 12act. ( 7.06590414 sig out 1act.) RANK 10 NODE 5 --> 7.63266516 sigma in 12act. ( 5.66725397 sig out 1act.) RANK 11 NODE 7 --> 7.41165352 sigma in 12act. ( 6.00222683 sig out 1act.) RANK 12 NODE 2 --> 6.29737425 sigma in 12act. ( 4.78935385 sig out 1act.) RANK 13 NODE 14 --> 5.84980965 sigma in 12act. ( 3.46753645 sig out 1act.) RANK 14 NODE 8 --> 3.93837142 sigma in 12act. ( 1.46462381 sig out 1act.) RANK 15 NODE 1 --> 3.82816029 sigma in 12act. ( 2.69627786 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 47.0192146 sigma out 1act.( 44.8830032 sig in 12act.) RANK 2 NODE 15 --> 32.8762283 sigma out 1act.( 34.1207695 sig in 12act.) RANK 3 NODE 12 --> 17.1399288 sigma out 1act.( 22.2173691 sig in 12act.) RANK 4 NODE 6 --> 16.9193249 sigma out 1act.( 18.02491 sig in 12act.) RANK 5 NODE 11 --> 15.7948399 sigma out 1act.( 18.0562458 sig in 12act.) RANK 6 NODE 4 --> 10.4901085 sigma out 1act.( 12.9159126 sig in 12act.) RANK 7 NODE 9 --> 9.92249107 sigma out 1act.( 12.0058241 sig in 12act.) RANK 8 NODE 13 --> 8.74791145 sigma out 1act.( 9.08249283 sig in 12act.) RANK 9 NODE 3 --> 7.06590414 sigma out 1act.( 8.65239906 sig in 12act.) RANK 10 NODE 7 --> 6.00222683 sigma out 1act.( 7.41165352 sig in 12act.) RANK 11 NODE 5 --> 5.66725397 sigma out 1act.( 7.63266516 sig in 12act.) RANK 12 NODE 2 --> 4.78935385 sigma out 1act.( 6.29737425 sig in 12act.) RANK 13 NODE 14 --> 3.46753645 sigma out 1act.( 5.84980965 sig in 12act.) RANK 14 NODE 1 --> 2.69627786 sigma out 1act.( 3.82816029 sig in 12act.) RANK 15 NODE 8 --> 1.46462381 sigma out 1act.( 3.93837142 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 67.5917358 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.531593561 *** contribution from regularisation: 0.00338706141 *** contribution from error: -0.534980595 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48936.3783 0.17516695 -5.17717361 EXIT FROM BFGS code NEW_X -48936.3783 0.17516695 -5.17717361 ENTER BFGS code NEW_X -48936.3783 0.17516695 -5.17717361 EXIT FROM BFGS code FG_LNSRCH 0. 0.17284672 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.53247112 *** contribution from regularisation: 0.0030959039 *** contribution from error: -0.535567045 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49017.1602 0.17284672 -1.96822453 EXIT FROM BFGS code NEW_X -49017.1602 0.17284672 -1.96822453 ENTER BFGS code NEW_X -49017.1602 0.17284672 -1.96822453 EXIT FROM BFGS code FG_LNSRCH 0. 0.169864535 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.532779872 *** contribution from regularisation: 0.00310092978 *** contribution from error: -0.535880804 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49045.5845 0.169864535 1.86872065 EXIT FROM BFGS code NEW_X -49045.5845 0.169864535 1.86872065 ENTER BFGS code NEW_X -49045.5845 0.169864535 1.86872065 EXIT FROM BFGS code FG_LNSRCH 0. 0.168253362 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.533057928 *** contribution from regularisation: 0.00308481348 *** contribution from error: -0.536142766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49071.1798 0.168253362 2.50654125 EXIT FROM BFGS code NEW_X -49071.1798 0.168253362 2.50654125 ENTER BFGS code NEW_X -49071.1798 0.168253362 2.50654125 EXIT FROM BFGS code FG_LNSRCH 0. 0.164426386 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.533716738 *** contribution from regularisation: 0.00311667821 *** contribution from error: -0.536833405 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49131.829 0.164426386 5.33833933 EXIT FROM BFGS code NEW_X -49131.829 0.164426386 5.33833933 ENTER BFGS code NEW_X -49131.829 0.164426386 5.33833933 EXIT FROM BFGS code FG_LNSRCH 0. 0.162885115 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.533965588 *** contribution from regularisation: 0.00320916018 *** contribution from error: -0.537174761 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49154.7384 0.162885115 -9.31162643 EXIT FROM BFGS code NEW_X -49154.7384 0.162885115 -9.31162643 ENTER BFGS code NEW_X -49154.7384 0.162885115 -9.31162643 EXIT FROM BFGS code FG_LNSRCH 0. 0.162803441 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.534827292 *** contribution from regularisation: 0.00303838775 *** contribution from error: -0.537865698 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49234.0598 0.162803441 -4.42767859 EXIT FROM BFGS code NEW_X -49234.0598 0.162803441 -4.42767859 ENTER BFGS code NEW_X -49234.0598 0.162803441 -4.42767859 EXIT FROM BFGS code FG_LNSRCH 0. 0.161833748 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.534937143 *** contribution from regularisation: 0.00312303472 *** contribution from error: -0.538060188 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49244.174 0.161833748 -5.66546917 EXIT FROM BFGS code NEW_X -49244.174 0.161833748 -5.66546917 ENTER BFGS code NEW_X -49244.174 0.161833748 -5.66546917 EXIT FROM BFGS code FG_LNSRCH 0. 0.158289269 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.535082698 *** contribution from regularisation: 0.00311191939 *** contribution from error: -0.538194597 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49257.5733 0.158289269 -7.02962017 EXIT FROM BFGS code NEW_X -49257.5733 0.158289269 -7.02962017 ENTER BFGS code NEW_X -49257.5733 0.158289269 -7.02962017 EXIT FROM BFGS code FG_LNSRCH 0. 0.146891907 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.535284579 *** contribution from regularisation: 0.00310200336 *** contribution from error: -0.538386583 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49276.1565 0.146891907 -10.7565289 EXIT FROM BFGS code NEW_X -49276.1565 0.146891907 -10.7565289 ENTER BFGS code NEW_X -49276.1565 0.146891907 -10.7565289 EXIT FROM BFGS code FG_LNSRCH 0. 0.11952506 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 72.9976273 sigma out 15 active outputs RANK 2 NODE 3 --> 31.8057556 sigma out 15 active outputs RANK 3 NODE 1 --> 30.7945671 sigma out 15 active outputs RANK 4 NODE 2 --> 25.3034801 sigma out 15 active outputs RANK 5 NODE 11 --> 23.8612881 sigma out 15 active outputs RANK 6 NODE 12 --> 16.4517288 sigma out 15 active outputs RANK 7 NODE 5 --> 14.5616636 sigma out 15 active outputs RANK 8 NODE 6 --> 13.7487745 sigma out 15 active outputs RANK 9 NODE 7 --> 12.1711645 sigma out 15 active outputs RANK 10 NODE 9 --> 9.9891367 sigma out 15 active outputs RANK 11 NODE 8 --> 9.80431461 sigma out 15 active outputs RANK 12 NODE 4 --> 8.25996971 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 74.6132431 sigma in 12act. ( 80.3261414 sig out 1act.) RANK 2 NODE 15 --> 49.2416763 sigma in 12act. ( 51.7063942 sig out 1act.) RANK 3 NODE 11 --> 19.9067459 sigma in 12act. ( 21.1081944 sig out 1act.) RANK 4 NODE 6 --> 19.873394 sigma in 12act. ( 20.3379765 sig out 1act.) RANK 5 NODE 12 --> 17.9195442 sigma in 12act. ( 17.0619831 sig out 1act.) RANK 6 NODE 13 --> 15.339963 sigma in 12act. ( 18.0824928 sig out 1act.) RANK 7 NODE 9 --> 8.80143452 sigma in 12act. ( 9.86881065 sig out 1act.) RANK 8 NODE 4 --> 6.53465891 sigma in 12act. ( 5.81266451 sig out 1act.) RANK 9 NODE 1 --> 6.16111898 sigma in 12act. ( 6.94940519 sig out 1act.) RANK 10 NODE 3 --> 5.97601366 sigma in 12act. ( 6.02077579 sig out 1act.) RANK 11 NODE 5 --> 5.09906769 sigma in 12act. ( 4.77109957 sig out 1act.) RANK 12 NODE 7 --> 3.28484058 sigma in 12act. ( 2.59399009 sig out 1act.) RANK 13 NODE 2 --> 2.36603713 sigma in 12act. ( 1.65631545 sig out 1act.) RANK 14 NODE 14 --> 1.86011064 sigma in 12act. ( 0.468254179 sig out 1act.) RANK 15 NODE 8 --> 1.7243259 sigma in 12act. ( 1.50081301 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 80.3261414 sigma out 1act.( 74.6132431 sig in 12act.) RANK 2 NODE 15 --> 51.7063942 sigma out 1act.( 49.2416763 sig in 12act.) RANK 3 NODE 11 --> 21.1081944 sigma out 1act.( 19.9067459 sig in 12act.) RANK 4 NODE 6 --> 20.3379765 sigma out 1act.( 19.873394 sig in 12act.) RANK 5 NODE 13 --> 18.0824928 sigma out 1act.( 15.339963 sig in 12act.) RANK 6 NODE 12 --> 17.0619831 sigma out 1act.( 17.9195442 sig in 12act.) RANK 7 NODE 9 --> 9.86881065 sigma out 1act.( 8.80143452 sig in 12act.) RANK 8 NODE 1 --> 6.94940519 sigma out 1act.( 6.16111898 sig in 12act.) RANK 9 NODE 3 --> 6.02077579 sigma out 1act.( 5.97601366 sig in 12act.) RANK 10 NODE 4 --> 5.81266451 sigma out 1act.( 6.53465891 sig in 12act.) RANK 11 NODE 5 --> 4.77109957 sigma out 1act.( 5.09906769 sig in 12act.) RANK 12 NODE 7 --> 2.59399009 sigma out 1act.( 3.28484058 sig in 12act.) RANK 13 NODE 2 --> 1.65631545 sigma out 1act.( 2.36603713 sig in 12act.) RANK 14 NODE 8 --> 1.50081301 sigma out 1act.( 1.7243259 sig in 12act.) RANK 15 NODE 14 --> 0.468254179 sigma out 1act.( 1.86011064 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 104.180367 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.535453796 *** contribution from regularisation: 0.00316270697 *** contribution from error: -0.538616478 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49291.7347 0.11952506 -2.96155238 EXIT FROM BFGS code NEW_X -49291.7347 0.11952506 -2.96155238 ENTER BFGS code NEW_X -49291.7347 0.11952506 -2.96155238 EXIT FROM BFGS code FG_LNSRCH 0. 0.106271401 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.535612881 *** contribution from regularisation: 0.00313565391 *** contribution from error: -0.538748562 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49306.3806 0.106271401 -13.2403679 EXIT FROM BFGS code NEW_X -49306.3806 0.106271401 -13.2403679 ENTER BFGS code NEW_X -49306.3806 0.106271401 -13.2403679 EXIT FROM BFGS code FG_LNSRCH 0. 0.105718173 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.535624027 *** contribution from regularisation: 0.00314887473 *** contribution from error: -0.538772881 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49307.4035 0.105718173 -6.93475056 EXIT FROM BFGS code NEW_X -49307.4035 0.105718173 -6.93475056 ENTER BFGS code NEW_X -49307.4035 0.105718173 -6.93475056 EXIT FROM BFGS code FG_LNSRCH 0. 0.0966624692 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.535653412 *** contribution from regularisation: 0.00310928491 *** contribution from error: -0.538762689 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49310.1132 0.0966624692 -0.563554645 EXIT FROM BFGS code NEW_X -49310.1132 0.0966624692 -0.563554645 ENTER BFGS code NEW_X -49310.1132 0.0966624692 -0.563554645 EXIT FROM BFGS code FG_LNSRCH 0. 0.0766240358 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.535737514 *** contribution from regularisation: 0.00294586248 *** contribution from error: -0.538683355 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49317.8549 0.0766240358 7.02874088 EXIT FROM BFGS code NEW_X -49317.8549 0.0766240358 7.02874088 ENTER BFGS code NEW_X -49317.8549 0.0766240358 7.02874088 EXIT FROM BFGS code FG_LNSRCH 0. 0.0541029237 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.535474479 *** contribution from regularisation: 0.00293539721 *** contribution from error: -0.538409889 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49293.6377 0.0541029237 4.65792799 EXIT FROM BFGS code FG_LNSRCH 0. 0.0734739453 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.53499043 *** contribution from regularisation: 0.00368416053 *** contribution from error: -0.538674593 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49249.0787 0.0734739453 6.81894588 EXIT FROM BFGS code FG_LNSRCH 0. 0.0765906051 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.535477817 *** contribution from regularisation: 0.00320564909 *** contribution from error: -0.538683474 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49293.9479 0.0765906051 7.07188272 EXIT FROM BFGS code FG_LNSRCH 0. 0.0766240209 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.535428822 *** contribution from regularisation: 0.00325456797 *** contribution from error: -0.538683414 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49289.4367 0.0766240209 7.11859035 EXIT FROM BFGS code FG_LNSRCH 0. 0.0766240358 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.535449088 *** contribution from regularisation: 0.00323432428 *** contribution from error: -0.538683414 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49291.3003 0.0766240358 7.07698011 EXIT FROM BFGS code FG_LNSRCH 0. 0.0766240358 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 74.4765244 sigma out 15 active outputs RANK 2 NODE 3 --> 33.73946 sigma out 15 active outputs RANK 3 NODE 1 --> 32.4533424 sigma out 15 active outputs RANK 4 NODE 11 --> 26.2577019 sigma out 15 active outputs RANK 5 NODE 2 --> 22.5269928 sigma out 15 active outputs RANK 6 NODE 5 --> 14.7861195 sigma out 15 active outputs RANK 7 NODE 6 --> 14.386301 sigma out 15 active outputs RANK 8 NODE 12 --> 12.7625141 sigma out 15 active outputs RANK 9 NODE 7 --> 11.2240667 sigma out 15 active outputs RANK 10 NODE 9 --> 10.0753288 sigma out 15 active outputs RANK 11 NODE 4 --> 9.55792809 sigma out 15 active outputs RANK 12 NODE 8 --> 8.3215847 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 76.4401932 sigma in 12act. ( 86.7180786 sig out 1act.) RANK 2 NODE 15 --> 49.3900757 sigma in 12act. ( 52.3895607 sig out 1act.) RANK 3 NODE 6 --> 21.276289 sigma in 12act. ( 22.5081024 sig out 1act.) RANK 4 NODE 11 --> 19.711607 sigma in 12act. ( 20.6843452 sig out 1act.) RANK 5 NODE 13 --> 16.6827965 sigma in 12act. ( 18.8301411 sig out 1act.) RANK 6 NODE 12 --> 15.7200775 sigma in 12act. ( 14.9514055 sig out 1act.) RANK 7 NODE 9 --> 9.00381851 sigma in 12act. ( 9.8317461 sig out 1act.) RANK 8 NODE 3 --> 6.82372808 sigma in 12act. ( 6.92789555 sig out 1act.) RANK 9 NODE 1 --> 6.72055387 sigma in 12act. ( 7.468997 sig out 1act.) RANK 10 NODE 4 --> 5.96263361 sigma in 12act. ( 5.37774181 sig out 1act.) RANK 11 NODE 5 --> 5.53244162 sigma in 12act. ( 5.30267859 sig out 1act.) RANK 12 NODE 7 --> 3.27555394 sigma in 12act. ( 2.72697163 sig out 1act.) RANK 13 NODE 2 --> 2.3718946 sigma in 12act. ( 1.81659007 sig out 1act.) RANK 14 NODE 8 --> 2.07507467 sigma in 12act. ( 1.85896206 sig out 1act.) RANK 15 NODE 14 --> 1.74944186 sigma in 12act. ( 0.739014328 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 86.7180786 sigma out 1act.( 76.4401932 sig in 12act.) RANK 2 NODE 15 --> 52.3895607 sigma out 1act.( 49.3900757 sig in 12act.) RANK 3 NODE 6 --> 22.5081024 sigma out 1act.( 21.276289 sig in 12act.) RANK 4 NODE 11 --> 20.6843452 sigma out 1act.( 19.711607 sig in 12act.) RANK 5 NODE 13 --> 18.8301411 sigma out 1act.( 16.6827965 sig in 12act.) RANK 6 NODE 12 --> 14.9514055 sigma out 1act.( 15.7200775 sig in 12act.) RANK 7 NODE 9 --> 9.8317461 sigma out 1act.( 9.00381851 sig in 12act.) RANK 8 NODE 1 --> 7.468997 sigma out 1act.( 6.72055387 sig in 12act.) RANK 9 NODE 3 --> 6.92789555 sigma out 1act.( 6.82372808 sig in 12act.) RANK 10 NODE 4 --> 5.37774181 sigma out 1act.( 5.96263361 sig in 12act.) RANK 11 NODE 5 --> 5.30267859 sigma out 1act.( 5.53244162 sig in 12act.) RANK 12 NODE 7 --> 2.72697163 sigma out 1act.( 3.27555394 sig in 12act.) RANK 13 NODE 8 --> 1.85896206 sigma out 1act.( 2.07507467 sig in 12act.) RANK 14 NODE 2 --> 1.81659007 sigma out 1act.( 2.3718946 sig in 12act.) RANK 15 NODE 14 --> 0.739014328 sigma out 1act.( 1.74944186 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 109.770164 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.535430908 *** contribution from regularisation: 0.00325249438 *** contribution from error: -0.538683414 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49289.6276 0.0766240358 7.09965706 EXIT FROM BFGS code FG_LNSRCH 0. 0.0766240358 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.535423815 *** contribution from regularisation: 0.00325960759 *** contribution from error: -0.538683414 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49288.9728 0.0766240358 7.16472006 EXIT FROM BFGS code NEW_X -49288.9728 0.0766240358 7.16472006 ENTER BFGS code NEW_X -49288.9728 0.0766240358 7.16472006 EXIT FROM BFGS code CONVERGENC -49288.9728 0.0766240358 7.16472006 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 110.292648 sigma out 15 active outputs RANK 2 NODE 3 --> 52.8521004 sigma out 15 active outputs RANK 3 NODE 1 --> 49.9645767 sigma out 15 active outputs RANK 4 NODE 11 --> 38.4173737 sigma out 15 active outputs RANK 5 NODE 2 --> 33.7026978 sigma out 15 active outputs RANK 6 NODE 6 --> 21.6298885 sigma out 15 active outputs RANK 7 NODE 5 --> 21.158844 sigma out 15 active outputs RANK 8 NODE 12 --> 19.2559624 sigma out 15 active outputs RANK 9 NODE 7 --> 16.7105999 sigma out 15 active outputs RANK 10 NODE 9 --> 15.4188948 sigma out 15 active outputs RANK 11 NODE 4 --> 14.1098661 sigma out 15 active outputs RANK 12 NODE 8 --> 12.7048788 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 114.886566 sigma in 12act. ( 129.698776 sig out 1act.) RANK 2 NODE 15 --> 74.3421631 sigma in 12act. ( 77.7596207 sig out 1act.) RANK 3 NODE 6 --> 31.5115681 sigma in 12act. ( 34.0430374 sig out 1act.) RANK 4 NODE 11 --> 29.3611546 sigma in 12act. ( 30.6102028 sig out 1act.) RANK 5 NODE 13 --> 24.6552944 sigma in 12act. ( 28.4739666 sig out 1act.) RANK 6 NODE 12 --> 22.8110294 sigma in 12act. ( 22.6620045 sig out 1act.) RANK 7 NODE 9 --> 12.8752699 sigma in 12act. ( 14.7502174 sig out 1act.) RANK 8 NODE 3 --> 9.71201897 sigma in 12act. ( 10.519311 sig out 1act.) RANK 9 NODE 1 --> 9.64549446 sigma in 12act. ( 10.9470091 sig out 1act.) RANK 10 NODE 4 --> 8.29193687 sigma in 12act. ( 8.1760931 sig out 1act.) RANK 11 NODE 5 --> 7.82400227 sigma in 12act. ( 7.87514877 sig out 1act.) RANK 12 NODE 7 --> 4.29418802 sigma in 12act. ( 3.93588948 sig out 1act.) RANK 13 NODE 2 --> 2.92122245 sigma in 12act. ( 2.60206318 sig out 1act.) RANK 14 NODE 8 --> 2.68170333 sigma in 12act. ( 2.66392136 sig out 1act.) RANK 15 NODE 14 --> 1.90711737 sigma in 12act. ( 1.08497941 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 129.698776 sigma out 1act.( 114.886566 sig in 12act.) RANK 2 NODE 15 --> 77.7596207 sigma out 1act.( 74.3421631 sig in 12act.) RANK 3 NODE 6 --> 34.0430374 sigma out 1act.( 31.5115681 sig in 12act.) RANK 4 NODE 11 --> 30.6102028 sigma out 1act.( 29.3611546 sig in 12act.) RANK 5 NODE 13 --> 28.4739666 sigma out 1act.( 24.6552944 sig in 12act.) RANK 6 NODE 12 --> 22.6620045 sigma out 1act.( 22.8110294 sig in 12act.) RANK 7 NODE 9 --> 14.7502174 sigma out 1act.( 12.8752699 sig in 12act.) RANK 8 NODE 1 --> 10.9470091 sigma out 1act.( 9.64549446 sig in 12act.) RANK 9 NODE 3 --> 10.519311 sigma out 1act.( 9.71201897 sig in 12act.) RANK 10 NODE 4 --> 8.1760931 sigma out 1act.( 8.29193687 sig in 12act.) RANK 11 NODE 5 --> 7.87514877 sigma out 1act.( 7.82400227 sig in 12act.) RANK 12 NODE 7 --> 3.93588948 sigma out 1act.( 4.29418802 sig in 12act.) RANK 13 NODE 8 --> 2.66392136 sigma out 1act.( 2.68170333 sig in 12act.) RANK 14 NODE 2 --> 2.60206318 sigma out 1act.( 2.92122245 sig in 12act.) RANK 15 NODE 14 --> 1.08497941 sigma out 1act.( 1.90711737 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 164.000122 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.535467029 *** contribution from regularisation: 0.00321636233 *** contribution from error: -0.538683414 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29884 Closing output file done