NNInput NNInputs_150.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 187864 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 48064 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 48064 Chosen entries: 48064 Signal fraction: 1 Background fraction: 0.343805 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 48064 Entries to split: 48064 Test with : 24032 Train with : 24032 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 48064 for Signal Prepared event 0 for Signal with 48064 events ====Entry 0 Variable Ht : 117.82 Variable LepAPt : 47.4738 Variable LepBPt : 12.5622 Variable MetSigLeptonsJets : 3.17918 Variable MetSpec : 29.8229 Variable SumEtLeptonsJets : 87.9972 Variable VSumJetLeptonsPt : 86.2262 Variable addEt : 89.8589 Variable dPhiLepSumMet : 2.58393 Variable dPhiLeptons : 0.475938 Variable dRLeptons : 0.613309 Variable lep1_E : 64.1505 Variable lep2_E : 22.7882 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2150 Ht = 117.82 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 47.4738 LepAPt = 47.4738 LepBEt = 12.5622 LepBPt = 12.5622 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 29.8229 MetDelPhi = 2.20584 MetSig = 2.18904 MetSigLeptonsJets = 3.17918 MetSpec = 29.8229 Mjj = 0 MostCentralJetEta = 0.309078 MtllMet = 98.8413 Njets = 1 SB = 0 SumEt = 185.606 SumEtJets = 0 SumEtLeptonsJets = 87.9972 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 86.2262 addEt = 89.8589 dPhiLepSumMet = 2.58393 dPhiLeptons = 0.475938 dRLeptons = 0.613309 diltype = 1 dimass = 14.9303 event = 29 jet1_Et = 27.9612 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 64.1504 lep2_E = 22.7882 rand = 0.999742 run = 167138 weight = 3.54438e-06 ===Show End Prepared event 10000 for Signal with 48064 events Prepared event 20000 for Signal with 48064 events Prepared event 30000 for Signal with 48064 events Prepared event 40000 for Signal with 48064 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.280352 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4365 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 187864 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4365 negative weights. Signal fraction: 62.8655205 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1057739 65.2510452 67.0355911 68.2566986 69.1235886 70.2088394 71.0657349 71.8716431 72.7005157 73.4858017 74.1645813 74.8235168 75.4351654 76.0472565 76.7070999 77.2692184 77.9234772 78.4680176 79.0974503 79.6390686 80.3051224 81.1343231 81.8210754 82.5204468 83.256546 83.9446716 84.9231567 85.914505 86.7841644 88.0392685 89.2393799 90.5925674 92.1171265 93.320343 94.8538055 96.3375702 97.8408203 99.0507202 100.22657 101.557922 102.991493 104.267792 105.845779 107.115952 108.592682 110.052979 111.131363 112.557053 113.983612 115.46579 116.900963 118.224167 119.637054 120.998383 122.222809 123.592407 124.941887 126.362389 127.759262 129.024445 130.372253 131.754684 133.070038 134.421814 135.737427 136.919128 138.243011 139.591461 140.907349 142.341095 143.76088 145.296844 146.776794 148.173813 149.823944 151.450607 153.343216 155.420166 157.664429 160.11908 162.664978 164.923279 167.415466 170.113983 172.98291 176.045715 179.439911 182.898712 186.750092 190.939423 195.622925 200.55072 206.277191 213.231644 222.148712 233.640656 248.282623 270.988098 318.630981 836.977722 ------------------------------ Transdef: Tab for variable 3 20.0009289 20.2970352 20.6234436 20.9085007 21.1765614 21.4673271 21.6991329 21.9465675 22.1582222 22.3494759 22.5798512 22.7662201 22.9835358 23.1581955 23.3057556 23.5333996 23.6954098 23.8707199 24.0896301 24.2930794 24.5158615 24.7146683 24.9106731 25.1410751 25.3257637 25.5245399 25.701149 25.8841057 26.1111946 26.2992649 26.5165329 26.7142639 26.9181175 27.1348038 27.3549137 27.580616 27.7850571 27.9788494 28.188942 28.4450073 28.6919899 28.89851 29.1048717 29.3144569 29.5545921 29.7790909 30.0029869 30.2545433 30.5232201 30.8200226 31.1159859 31.4034538 31.6784019 31.98382 32.2455177 32.4995651 32.760788 33.0607758 33.3110046 33.5981903 33.853096 34.1450272 34.421936 34.6952896 35.0180855 35.2971992 35.5808296 35.9258804 36.2266159 36.5327682 36.8560295 37.1880035 37.5275497 37.8710823 38.2190933 38.5759735 38.9762344 39.3609543 39.7588501 40.1430511 40.5998192 40.9310226 41.3932152 41.9050255 42.4085846 42.9859238 43.5392876 44.1736526 44.8956985 45.659462 46.4663811 47.4414444 48.4642792 49.6510963 50.8357849 52.5521812 54.8410187 57.419487 61.5971565 69.0445404 228.385986 ------------------------------ Transdef: Tab for variable 4 10.000247 10.1189957 10.2303905 10.3519669 10.4843712 10.5899897 10.7285061 10.8544788 10.9766703 11.1028481 11.2442255 11.3788052 11.4918766 11.6405621 11.7590675 11.9396057 12.0696945 12.208972 12.3401775 12.5271997 12.6846962 12.8261795 12.9758711 13.1418476 13.330431 13.5017242 13.655304 13.8060207 13.978672 14.1613808 14.3231659 14.4964895 14.7262802 14.9230785 15.112174 15.3450356 15.5134544 15.7055521 15.8702755 16.067173 16.3102112 16.5551701 16.7660904 16.9850655 17.222847 17.4388294 17.7025013 17.9127121 18.0833817 18.3202133 18.5426254 18.7936707 19.042654 19.2957687 19.5621433 19.8160343 20.0856323 20.2754135 20.4722786 20.7209167 20.9739685 21.2364712 21.5034771 21.7442322 21.9734306 22.2212372 22.4845657 22.7419128 23.0265236 23.3072243 23.5956879 23.8426704 24.1283531 24.4153862 24.7422867 25.0523109 25.401535 25.7559376 26.1097488 26.4290619 26.7833633 27.1577797 27.5166016 27.8695812 28.2496796 28.6376419 29.036377 29.4676399 29.9063911 30.3755684 30.8811531 31.4820557 32.1080475 32.7763748 33.5368805 34.3806534 35.4585114 36.9362488 39.3681488 43.6934433 72.9396591 ------------------------------ Transdef: Tab for variable 5 1.04656506 2.65131474 3.05276442 3.33415174 3.6278286 3.85375738 4.04027557 4.16593647 4.29189301 4.41847324 4.5259428 4.60794401 4.69104099 4.7837472 4.86674738 4.95528507 5.02756405 5.09811783 5.16225052 5.21684456 5.27555943 5.32163811 5.37768078 5.42543507 5.47425556 5.52012348 5.55667639 5.60888958 5.65542936 5.70261383 5.75277042 5.79709721 5.8482728 5.8913393 5.93773556 5.98538303 6.02567911 6.07666683 6.1198864 6.1685195 6.20892954 6.25644588 6.28635406 6.32853222 6.36684656 6.40888739 6.4527936 6.49701118 6.53583145 6.58507538 6.62618017 6.6696291 6.71825838 6.7565794 6.79654598 6.8396759 6.87646866 6.91997433 6.97074795 7.01763248 7.05843258 7.11003065 7.16605091 7.20762825 7.24676657 7.30174255 7.35975075 7.41000271 7.45829248 7.51676178 7.5683136 7.61912775 7.67200994 7.72978926 7.78285027 7.8396492 7.89747524 7.95556068 8.01706505 8.08008575 8.13944435 8.20279503 8.26943779 8.34193802 8.41157532 8.47960091 8.55596447 8.63074398 8.70602226 8.78951836 8.89472675 9.00067806 9.13003731 9.26463032 9.42307281 9.60602951 9.82600403 10.1302509 10.5973701 11.4490776 17.1430473 ------------------------------ Transdef: Tab for variable 6 15.0174675 20.7655697 25.2102051 26.3411789 27.2744827 28.2419167 29.0307922 29.8059425 30.5939007 31.1273613 31.6753712 32.1814728 32.6921921 33.1522675 33.6550293 34.1703568 34.6197815 34.8992462 35.268364 35.7022934 36.0888824 36.4472504 36.8317795 37.1537704 37.5467453 37.8680382 38.269455 38.6243286 39.0701065 39.389328 39.7334366 40.1160774 40.4435959 40.8450928 41.2225876 41.6725388 42.0810242 42.4907379 42.9505997 43.2272415 43.6887817 44.0385895 44.5059814 44.9589462 45.5829468 46.0779114 46.6691666 47.3189011 47.8303223 48.4595795 49.0327988 49.7111969 50.3132401 50.9269943 51.5350151 52.1340256 52.789463 53.4236679 54.1195641 54.6702576 55.3591347 56.0830231 56.7782211 57.4392357 58.0758667 58.6936035 59.3484497 60.0361099 60.6622887 61.3927383 62.1408195 62.8162804 63.4623146 64.2032013 64.9398193 65.7054901 66.3821106 67.1638565 67.8762436 68.5888367 69.335495 70.03685 70.8351898 71.6281281 72.5048676 73.3935089 74.3204803 75.3853683 76.5394745 77.3585052 78.6292419 80.2790985 81.9930267 84.0224304 86.4112625 89.2008286 92.5261993 96.9756927 104.026619 115.376503 292.694519 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.8298302 33.6909027 34.2795105 35.0370445 35.5017624 35.9269524 36.2942886 36.6817474 37.0662155 37.399437 37.7350006 38.0516434 38.3773956 38.726593 38.9976883 39.2667999 39.5362549 39.7819328 40.1275864 40.4721718 40.7759628 41.0953674 41.4762802 41.8597641 42.3098526 42.7324448 43.1601524 43.7027969 44.4032555 44.9396973 45.480732 46.2363815 46.9687271 47.8055725 48.5805664 49.3401031 50.2720566 51.0597839 52.0019455 52.8849335 53.6463547 54.6714706 55.450985 56.1925621 57.0098877 57.7040825 58.5272827 59.2646523 60.068512 60.8811913 61.4078636 62.1784134 62.8712006 63.5941925 64.2892838 65.0365753 65.8297119 66.5711823 67.4544373 68.2126541 69.0772247 69.9810333 70.7839508 71.577179 72.4082489 73.333313 74.3225479 75.416832 76.6160736 77.8679199 79.1575775 80.6182861 82.1037292 83.5837555 85.1084366 86.7291107 88.5113373 90.0982666 91.9127121 93.6957626 95.4907379 97.414711 99.6581268 101.946701 104.154991 106.697617 109.341133 112.363968 115.762085 119.58606 123.198189 127.624512 132.922577 138.885834 145.992706 155.409042 168.397827 186.990326 221.512299 482.486786 ------------------------------ Transdef: Tab for variable 8 1.61999488 23.7264004 28.5182247 30.7567101 31.8541183 32.5753403 33.1712952 33.5882187 34.0591888 34.5192795 34.9710274 35.3211899 35.5988655 35.9323158 36.2481003 36.5046005 36.7872925 37.1276398 37.3536072 37.6680717 37.8862953 38.1465454 38.4264603 38.7054482 38.9657745 39.2374535 39.5450592 39.825592 40.1077271 40.3831444 40.6979523 40.9934082 41.3190994 41.6818008 42.0646019 42.4179611 42.7951202 43.2479401 43.7326355 44.1878052 44.6288986 45.1191139 45.670311 46.2906113 46.7992897 47.3555527 47.9391937 48.3507919 48.8540497 49.4360619 50.0425873 50.6479492 51.2531128 51.8515701 52.5069656 53.1027832 53.7161102 54.2707291 54.8842239 55.4347076 56.0541229 56.6264076 57.2564201 57.8613358 58.5105515 59.1206741 59.6972198 60.2995224 60.9609528 61.5603943 62.1747131 62.7992668 63.4318161 64.0721893 64.6900711 65.3230286 65.9582748 66.6065674 67.3129044 68.0312195 68.7112808 69.4685059 70.1876373 70.943924 71.6904449 72.5576172 73.5720062 74.6613922 75.722641 76.9843903 78.4777451 80.1462784 82.062439 84.2458191 87.0212708 90.2503815 94.3419876 99.7394867 108.111801 125.245575 349.597076 ------------------------------ Transdef: Tab for variable 9 49.6710663 62.7101555 64.5311127 66.1827927 67.4651642 68.5316315 69.4372101 70.2646866 71.0885925 71.8046722 72.5197906 73.2986298 73.9121857 74.4866714 75.0531235 75.6668167 76.1460876 76.7598038 77.2164764 77.8172684 78.353157 78.8218079 79.3596039 79.7738037 80.3777161 81.0785904 81.6366501 82.1966705 82.733223 83.4151764 84.0578308 84.8631592 85.660675 86.4167175 87.0179367 87.9130554 88.8344727 89.7541351 90.8080902 91.8374786 92.9339066 93.849884 95.0682678 96.2279816 97.5154266 98.5575409 99.5836945 100.756172 101.954453 103.092819 104.322098 105.477524 106.624176 107.801239 109.06926 110.178574 111.141403 112.309532 113.419067 114.489471 115.529076 116.597275 117.542694 118.698944 119.785011 120.817642 121.854942 122.849571 123.974228 124.999405 126.000435 127.000214 127.947754 128.972168 130.074509 131.122925 132.123138 133.096039 134.162384 135.19101 136.19104 137.171021 138.255844 139.309082 140.408356 141.576096 142.756195 143.94278 145.248291 146.447815 147.747971 149.169083 150.817841 152.728348 155.009186 157.733856 161.678192 167.224915 177.040192 200.489258 425.772034 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.919529676 1.31817329 1.54853594 1.71909988 1.84116006 1.94936252 2.03519511 2.10476756 2.17448211 2.23122215 2.28197813 2.33016157 2.37615728 2.41342187 2.45083475 2.48504066 2.51716518 2.54482126 2.57136059 2.59807491 2.61967039 2.64418077 2.66724443 2.68733644 2.70911551 2.72774172 2.74569583 2.76095819 2.77751064 2.79353523 2.80712509 2.82017183 2.83211899 2.84506154 2.85610819 2.86627197 2.87764788 2.88766384 2.89658594 2.90488386 2.9134047 2.91970992 2.9285121 2.93667173 2.94482756 2.95175171 2.95779896 2.96362686 2.96937418 2.97593737 2.98027039 2.98528886 2.99002457 2.99381733 2.99807763 3.00351715 3.00819635 3.01293826 3.01735091 3.02202415 3.02661777 3.03003597 3.03426409 3.03770828 3.04142141 3.04509544 3.049227 3.05279326 3.05632329 3.05990696 3.06331253 3.06711459 3.07043338 3.07327914 3.07580519 3.07871628 3.08202815 3.08478379 3.08768225 3.0904386 3.0929873 3.09547234 3.09831333 3.10104275 3.10393667 3.10631418 3.10873699 3.11147022 3.11394691 3.11653566 3.11933804 3.12205744 3.12472343 3.12710571 3.1296525 3.13213611 3.1341424 3.13655615 3.13907957 3.14158916 ------------------------------ Transdef: Tab for variable 11 1.62124634E-05 0.00618005358 0.0107754469 0.0180549771 0.0246745236 0.0314662457 0.0398924351 0.0486265421 0.0569475293 0.064048171 0.0718731284 0.0795077085 0.0868274719 0.0943078995 0.101289988 0.109050035 0.115868568 0.123991966 0.131653905 0.140020132 0.147221297 0.154163122 0.160024405 0.166606903 0.174063563 0.180396229 0.187309265 0.193489313 0.199845672 0.205655515 0.211394519 0.216513395 0.221690774 0.22736752 0.23287493 0.237143993 0.242822871 0.24849534 0.253911257 0.259062588 0.264114738 0.269426584 0.275422484 0.280789495 0.286169291 0.29194802 0.297256887 0.302264452 0.308206797 0.313326478 0.318612337 0.323461652 0.328816652 0.334567666 0.340484709 0.345956326 0.351406336 0.356908202 0.361387014 0.367609262 0.373317003 0.378424972 0.384603024 0.391237855 0.397229433 0.403431177 0.409542233 0.415171891 0.421835542 0.427347898 0.43405211 0.439151168 0.445754647 0.451552153 0.457938135 0.464386523 0.47136271 0.478477865 0.485863686 0.493878901 0.502167583 0.510674 0.517711639 0.528179586 0.537422597 0.544618249 0.553730845 0.565989256 0.576966345 0.587121248 0.600989938 0.616529226 0.633971334 0.649144053 0.666095614 0.688750863 0.712736487 0.741192937 0.785880685 0.847809911 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.215750933 0.228495002 0.239128053 0.249056205 0.258450568 0.266889811 0.275133252 0.282364607 0.290430129 0.298087686 0.305525064 0.311626673 0.318223447 0.325082779 0.33133167 0.33779186 0.343716919 0.349116415 0.354243308 0.358951658 0.365383685 0.370896369 0.37627998 0.381591678 0.387472183 0.392687172 0.397682697 0.40212822 0.406452298 0.410321563 0.414017022 0.417629957 0.421397716 0.425024837 0.42897284 0.432591736 0.436474741 0.440159142 0.443884462 0.447307229 0.450951099 0.455171227 0.459287584 0.46283859 0.466960847 0.471158445 0.474695086 0.47878015 0.482775062 0.486671984 0.490490079 0.494387269 0.498048872 0.502542078 0.507058382 0.511576891 0.515410781 0.519677401 0.523942351 0.528620422 0.533070087 0.537577212 0.542198658 0.547429681 0.550878644 0.555725217 0.560121298 0.565700769 0.570850909 0.575609088 0.58155334 0.587210774 0.59191978 0.59740293 0.603892446 0.610705256 0.616891444 0.623827577 0.631047487 0.638745427 0.646767318 0.654898167 0.661785483 0.668855429 0.67795217 0.686151147 0.696248412 0.705450058 0.718108714 0.728809178 0.741848946 0.753381491 0.76609242 0.78066802 0.797846317 0.819028497 0.84144938 0.873405814 0.919053316 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.4993896 22.3621483 22.9522743 23.4555798 24.0287857 24.5069599 24.9593201 25.3467369 25.7444897 26.1115952 26.5768986 27.0186939 27.3477707 27.7099571 28.0726852 28.4111023 28.7648964 29.1473179 29.4266567 29.73843 30.1013451 30.456604 30.7741432 31.0667915 31.4064236 31.7437859 32.1074219 32.4238434 32.7887344 33.1166077 33.3945312 33.7492943 34.0449257 34.3449059 34.6123352 34.9637985 35.2851639 35.5360336 35.8536301 36.1659012 36.4718628 36.819561 37.13591 37.5070763 37.8542175 38.1757431 38.5413475 38.8715744 39.2775307 39.6244011 39.9768181 40.3169022 40.669014 41.0675201 41.3912468 41.8081818 42.2413101 42.6280365 42.998764 43.3499832 43.7979355 44.2485466 44.6960182 45.1612091 45.6529045 46.1644325 46.585125 47.1038361 47.591301 48.1522522 48.7646179 49.3529053 49.9512787 50.6137886 51.2216949 51.9383545 52.6320457 53.4570236 54.2041168 55.0769577 55.8270569 56.6990738 57.6611176 58.6449051 59.6072922 60.8511009 62.0265465 63.3053055 64.980629 66.7214508 68.1410217 69.9314728 72.2673569 74.8113251 77.8956299 81.8141479 86.6035156 91.3329391 101.08564 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6855755 11.0953159 11.4576607 11.898118 12.2700167 12.5463696 12.8379316 13.1558285 13.4774389 13.7240505 14.0160904 14.3495865 14.6418095 14.9145966 15.2159386 15.5288525 15.8345642 16.1199532 16.4316635 16.7020836 16.9354153 17.2089214 17.5049191 17.7301788 17.9826736 18.235611 18.5102501 18.7620335 19.0519333 19.2921486 19.5873432 19.9006405 20.2066689 20.5123539 20.8119431 21.0992851 21.3652401 21.6207771 21.892189 22.1451797 22.416235 22.6932411 22.9776115 23.2362347 23.508379 23.7969227 24.0895901 24.3833885 24.6850929 24.962822 25.2714577 25.5559311 25.8003311 26.0635319 26.3322163 26.6465607 26.9398384 27.2383537 27.5103073 27.7788391 27.9614582 28.2540207 28.5540466 28.8491592 29.1329403 29.4226074 29.7547417 30.1011429 30.4688911 30.8677254 31.2187386 31.5708904 31.9272156 32.3409348 32.7589455 33.1488495 33.5784836 33.9765549 34.3796387 34.8168182 35.3014946 35.770134 36.3582077 36.9408951 37.4676208 38.1161575 38.8350449 39.6335945 40.2530975 41.132637 42.1878624 43.3102913 44.3975754 45.8365211 47.6397858 49.5505295 52.474411 56.2822647 62.8353119 124.81353 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 62.0 45.5 51.3 25.5 46.7 59.2 50.8 60.2 -26.0 -16.3 -36.4 8.2 20.6 2 62.0 100.0 64.3 58.8 34.0 68.0 94.3 73.8 91.6 -46.8 -22.8 -48.0 28.1 31.1 3 45.5 64.3 100.0 42.3 7.3 32.8 67.5 52.2 70.3 -16.1 -25.0 -53.7 61.4 20.9 4 51.3 58.8 42.3 100.0 14.7 37.2 59.2 51.3 65.4 -12.3 -29.3 -60.6 16.1 70.0 5 25.5 34.0 7.3 14.7 100.0 83.1 6.6 55.1 56.1 21.4 -5.6 -9.9 -5.8 3.7 6 46.7 68.0 32.8 37.2 83.1 100.0 46.8 77.5 79.5 -7.6 -14.7 -29.0 7.7 17.1 7 59.2 94.3 67.5 59.2 6.6 46.8 100.0 66.2 80.0 -54.6 -22.0 -48.4 32.7 32.8 8 50.8 73.8 52.2 51.3 55.1 77.5 66.2 100.0 82.5 -12.8 -22.4 -43.2 23.0 28.7 9 60.2 91.6 70.3 65.4 56.1 79.5 80.0 82.5 100.0 -23.0 -25.9 -54.5 32.9 36.8 10 -26.0 -46.8 -16.1 -12.3 21.4 -7.6 -54.6 -12.8 -23.0 100.0 2.7 7.9 -4.4 -3.0 11 -16.3 -22.8 -25.0 -29.3 -5.6 -14.7 -22.0 -22.4 -25.9 2.7 100.0 54.2 -9.1 -18.2 12 -36.4 -48.0 -53.7 -60.6 -9.9 -29.0 -48.4 -43.2 -54.5 7.9 54.2 100.0 -24.8 -35.4 13 8.2 28.1 61.4 16.1 -5.8 7.7 32.7 23.0 32.9 -4.4 -9.1 -24.8 100.0 45.3 14 20.6 31.1 20.9 70.0 3.7 17.1 32.8 28.7 36.8 -3.0 -18.2 -35.4 45.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 154.396438 TOTAL CORRELATION OF ALL VARIABLES 69.3021661 ROUND 1: MAX CORR ( 69.2878198) AFTER KILLING INPUT VARIABLE 8 CONTR 1.41005362 ROUND 2: MAX CORR ( 69.274737) AFTER KILLING INPUT VARIABLE 11 CONTR 1.34639859 ROUND 3: MAX CORR ( 69.1860309) AFTER KILLING INPUT VARIABLE 12 CONTR 3.50461299 ROUND 4: MAX CORR ( 69.080284) AFTER KILLING INPUT VARIABLE 14 CONTR 3.8237735 ROUND 5: MAX CORR ( 68.9293459) AFTER KILLING INPUT VARIABLE 7 CONTR 4.56408854 ROUND 6: MAX CORR ( 68.776466) AFTER KILLING INPUT VARIABLE 6 CONTR 4.5882953 ROUND 7: MAX CORR ( 68.56577) AFTER KILLING INPUT VARIABLE 10 CONTR 5.37935416 ROUND 8: MAX CORR ( 67.2404782) AFTER KILLING INPUT VARIABLE 9 CONTR 13.415771 ROUND 9: MAX CORR ( 66.948725) AFTER KILLING INPUT VARIABLE 5 CONTR 6.25700614 ROUND 10: MAX CORR ( 65.3489774) AFTER KILLING INPUT VARIABLE 3 CONTR 14.5479528 ROUND 11: MAX CORR ( 64.6588034) AFTER KILLING INPUT VARIABLE 13 CONTR 9.47248621 ROUND 12: MAX CORR ( 61.9779429) AFTER KILLING INPUT VARIABLE 4 CONTR 18.4254025 LAST REMAINING VARIABLE: 2 total correlation to target: 69.3021661 % total significance: 135.825448 sigma correlations of single variables to target: variable 2: 61.9779429 % , in sigma: 121.470689 variable 3: 45.5321262 % , in sigma: 89.2385016 variable 4: 51.3488555 % , in sigma: 100.63872 variable 5: 25.482961 % , in sigma: 49.9441041 variable 6: 46.6891795 % , in sigma: 91.5062126 variable 7: 59.1580311 % , in sigma: 115.943939 variable 8: 50.7636322 % , in sigma: 99.4917403 variable 9: 60.2071123 % , in sigma: 118.000035 variable 10: -25.9649769 % , in sigma: 50.8888081 variable 11: -16.2508461 % , in sigma: 31.8500644 variable 12: -36.4194072 % , in sigma: 71.3784661 variable 13: 8.23636505 % , in sigma: 16.1424677 variable 14: 20.5878111 % , in sigma: 40.3500905 variables sorted by significance: 1 most relevant variable 2 corr 61.9779434 , in sigma: 121.47069 2 most relevant variable 4 corr 18.4254017 , in sigma: 36.1119801 3 most relevant variable 13 corr 9.4724865 , in sigma: 18.5651445 4 most relevant variable 3 corr 14.5479527 , in sigma: 28.5125603 5 most relevant variable 5 corr 6.25700617 , in sigma: 12.2631184 6 most relevant variable 9 corr 13.4157715 , in sigma: 26.2935963 7 most relevant variable 10 corr 5.379354 , in sigma: 10.5430062 8 most relevant variable 6 corr 4.58829546 , in sigma: 8.99260908 9 most relevant variable 7 corr 4.56408834 , in sigma: 8.94516551 10 most relevant variable 14 corr 3.82377338 , in sigma: 7.4942208 11 most relevant variable 12 corr 3.50461292 , in sigma: 6.8686976 12 most relevant variable 11 corr 1.34639859 , in sigma: 2.63880919 13 most relevant variable 8 corr 1.41005361 , in sigma: 2.76356678 global correlations between input variables: variable 2: 99.1275681 % variable 3: 92.6716953 % variable 4: 91.8046896 % variable 5: 95.2167128 % variable 6: 94.303118 % variable 7: 98.645137 % variable 8: 89.1434354 % variable 9: 98.8690028 % variable 10: 71.1280295 % variable 11: 55.3271061 % variable 12: 76.4897476 % variable 13: 84.2396462 % variable 14: 87.2237791 % significance loss when removing single variables: variable 2: corr = 6.35667055 % , sigma = 12.4584508 variable 3: corr = 16.6900677 % , sigma = 32.7108956 variable 4: corr = 18.3576677 % , sigma = 35.9792282 variable 5: corr = 10.5599381 % , sigma = 20.696443 variable 6: corr = 3.81361496 % , sigma = 7.47431128 variable 7: corr = 3.09241502 % , sigma = 6.06083014 variable 8: corr = 1.41005362 % , sigma = 2.7635668 variable 9: corr = 12.4572156 % , sigma = 24.4149207 variable 10: corr = 4.75564756 % , sigma = 9.32060278 variable 11: corr = 1.43310946 % , sigma = 2.80875399 variable 12: corr = 2.50958839 % , sigma = 4.91854711 variable 13: corr = 7.54632302 % , sigma = 14.790053 variable 14: corr = 3.91121894 % , sigma = 7.6656055 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 17.3227119 sigma out 15 active outputs RANK 2 NODE 9 --> 16.4514599 sigma out 15 active outputs RANK 3 NODE 5 --> 15.4942904 sigma out 15 active outputs RANK 4 NODE 8 --> 14.383872 sigma out 15 active outputs RANK 5 NODE 4 --> 13.1626244 sigma out 15 active outputs RANK 6 NODE 12 --> 12.1505966 sigma out 15 active outputs RANK 7 NODE 7 --> 11.3535013 sigma out 15 active outputs RANK 8 NODE 3 --> 10.0118141 sigma out 15 active outputs RANK 9 NODE 11 --> 9.52164555 sigma out 15 active outputs RANK 10 NODE 1 --> 8.88524723 sigma out 15 active outputs RANK 11 NODE 2 --> 7.75342417 sigma out 15 active outputs RANK 12 NODE 10 --> 5.22093868 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 28.5344334 sigma in 12act. ( 31.3190746 sig out 1act.) RANK 2 NODE 15 --> 20.5067215 sigma in 12act. ( 19.2323456 sig out 1act.) RANK 3 NODE 1 --> 14.9155588 sigma in 12act. ( 18.817522 sig out 1act.) RANK 4 NODE 12 --> 10.8841209 sigma in 12act. ( 12.0020523 sig out 1act.) RANK 5 NODE 13 --> 8.16828632 sigma in 12act. ( 10.4542809 sig out 1act.) RANK 6 NODE 4 --> 6.42747688 sigma in 12act. ( 7.23848438 sig out 1act.) RANK 7 NODE 11 --> 6.40608358 sigma in 12act. ( 6.1258049 sig out 1act.) RANK 8 NODE 2 --> 5.46199083 sigma in 12act. ( 6.27190971 sig out 1act.) RANK 9 NODE 5 --> 4.96883249 sigma in 12act. ( 10.2742262 sig out 1act.) RANK 10 NODE 9 --> 4.67945671 sigma in 12act. ( 6.38041925 sig out 1act.) RANK 11 NODE 7 --> 3.08329487 sigma in 12act. ( 4.60367393 sig out 1act.) RANK 12 NODE 10 --> 2.32497787 sigma in 12act. ( 3.10050821 sig out 1act.) RANK 13 NODE 8 --> 2.29224777 sigma in 12act. ( 0.437479794 sig out 1act.) RANK 14 NODE 14 --> 1.30243111 sigma in 12act. ( 0.135554627 sig out 1act.) RANK 15 NODE 3 --> 1.29507768 sigma in 12act. ( 1.21005249 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 31.3190746 sigma out 1act.( 28.5344334 sig in 12act.) RANK 2 NODE 15 --> 19.2323456 sigma out 1act.( 20.5067215 sig in 12act.) RANK 3 NODE 1 --> 18.817522 sigma out 1act.( 14.9155588 sig in 12act.) RANK 4 NODE 12 --> 12.0020523 sigma out 1act.( 10.8841209 sig in 12act.) RANK 5 NODE 13 --> 10.4542809 sigma out 1act.( 8.16828632 sig in 12act.) RANK 6 NODE 5 --> 10.2742262 sigma out 1act.( 4.96883249 sig in 12act.) RANK 7 NODE 4 --> 7.23848438 sigma out 1act.( 6.42747688 sig in 12act.) RANK 8 NODE 9 --> 6.38041925 sigma out 1act.( 4.67945671 sig in 12act.) RANK 9 NODE 2 --> 6.27190971 sigma out 1act.( 5.46199083 sig in 12act.) RANK 10 NODE 11 --> 6.1258049 sigma out 1act.( 6.40608358 sig in 12act.) RANK 11 NODE 7 --> 4.60367393 sigma out 1act.( 3.08329487 sig in 12act.) RANK 12 NODE 10 --> 3.10050821 sigma out 1act.( 2.32497787 sig in 12act.) RANK 13 NODE 3 --> 1.21005249 sigma out 1act.( 1.29507768 sig in 12act.) RANK 14 NODE 8 --> 0.437479794 sigma out 1act.( 2.29224777 sig in 12act.) RANK 15 NODE 14 --> 0.135554627 sigma out 1act.( 1.30243111 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 47.6047935 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 21.8182812 sigma out 15 active outputs RANK 2 NODE 6 --> 18.9821339 sigma out 15 active outputs RANK 3 NODE 5 --> 16.3814087 sigma out 15 active outputs RANK 4 NODE 9 --> 15.6914673 sigma out 15 active outputs RANK 5 NODE 8 --> 14.8323011 sigma out 15 active outputs RANK 6 NODE 7 --> 13.9378319 sigma out 15 active outputs RANK 7 NODE 4 --> 13.7836523 sigma out 15 active outputs RANK 8 NODE 12 --> 13.2396088 sigma out 15 active outputs RANK 9 NODE 1 --> 11.4985228 sigma out 15 active outputs RANK 10 NODE 3 --> 11.2076054 sigma out 15 active outputs RANK 11 NODE 11 --> 10.318594 sigma out 15 active outputs RANK 12 NODE 10 --> 7.43944263 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 26.5058193 sigma in 12act. ( 28.7185097 sig out 1act.) RANK 2 NODE 15 --> 18.2271938 sigma in 12act. ( 17.5425129 sig out 1act.) RANK 3 NODE 1 --> 18.1305332 sigma in 12act. ( 19.2288952 sig out 1act.) RANK 4 NODE 5 --> 16.3123913 sigma in 12act. ( 12.5051537 sig out 1act.) RANK 5 NODE 12 --> 12.4228306 sigma in 12act. ( 11.6010447 sig out 1act.) RANK 6 NODE 13 --> 11.3965588 sigma in 12act. ( 10.1985159 sig out 1act.) RANK 7 NODE 9 --> 9.73726368 sigma in 12act. ( 6.99496651 sig out 1act.) RANK 8 NODE 7 --> 9.71905041 sigma in 12act. ( 6.35053587 sig out 1act.) RANK 9 NODE 2 --> 9.32753754 sigma in 12act. ( 6.34094667 sig out 1act.) RANK 10 NODE 4 --> 9.23866463 sigma in 12act. ( 7.44288158 sig out 1act.) RANK 11 NODE 3 --> 8.79903889 sigma in 12act. ( 2.44122887 sig out 1act.) RANK 12 NODE 11 --> 8.24309254 sigma in 12act. ( 5.94786167 sig out 1act.) RANK 13 NODE 10 --> 8.1950264 sigma in 12act. ( 4.31401491 sig out 1act.) RANK 14 NODE 8 --> 6.7258563 sigma in 12act. ( 0.304125279 sig out 1act.) RANK 15 NODE 14 --> 4.11196041 sigma in 12act. ( 0.0654537231 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 28.7185097 sigma out 1act.( 26.5058193 sig in 12act.) RANK 2 NODE 1 --> 19.2288952 sigma out 1act.( 18.1305332 sig in 12act.) RANK 3 NODE 15 --> 17.5425129 sigma out 1act.( 18.2271938 sig in 12act.) RANK 4 NODE 5 --> 12.5051537 sigma out 1act.( 16.3123913 sig in 12act.) RANK 5 NODE 12 --> 11.6010447 sigma out 1act.( 12.4228306 sig in 12act.) RANK 6 NODE 13 --> 10.1985159 sigma out 1act.( 11.3965588 sig in 12act.) RANK 7 NODE 4 --> 7.44288158 sigma out 1act.( 9.23866463 sig in 12act.) RANK 8 NODE 9 --> 6.99496651 sigma out 1act.( 9.73726368 sig in 12act.) RANK 9 NODE 7 --> 6.35053587 sigma out 1act.( 9.71905041 sig in 12act.) RANK 10 NODE 2 --> 6.34094667 sigma out 1act.( 9.32753754 sig in 12act.) RANK 11 NODE 11 --> 5.94786167 sigma out 1act.( 8.24309254 sig in 12act.) RANK 12 NODE 10 --> 4.31401491 sigma out 1act.( 8.1950264 sig in 12act.) RANK 13 NODE 3 --> 2.44122887 sigma out 1act.( 8.79903889 sig in 12act.) RANK 14 NODE 8 --> 0.304125279 sigma out 1act.( 6.7258563 sig in 12act.) RANK 15 NODE 14 --> 0.0654537231 sigma out 1act.( 4.11196041 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.2830734 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.426296651 *** contribution from regularisation: 0.00443130871 *** contribution from error: -0.430727959 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.476687402 *** contribution from regularisation: 0.00222210609 *** contribution from error: -0.478909522 *********************************************** -----------------> Test sample ENTER BFGS code START -44785.5934 -0.433555573 -0.19413878 EXIT FROM BFGS code FG_START 0. -0.433555573 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.505119085 *** contribution from regularisation: 0.0023597395 *** contribution from error: -0.507478833 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47446.8476 -0.433555573 -86.6734695 EXIT FROM BFGS code FG_LNSRCH 0. -0.44647944 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.537567377 *** contribution from regularisation: 0.00325231743 *** contribution from error: -0.540819705 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50494.7782 -0.44647944 -122.084816 EXIT FROM BFGS code NEW_X -50494.7782 -0.44647944 -122.084816 ENTER BFGS code NEW_X -50494.7782 -0.44647944 -122.084816 EXIT FROM BFGS code FG_LNSRCH 0. -0.460966527 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.540773749 *** contribution from regularisation: 0.00317465002 *** contribution from error: -0.543948412 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50795.9612 -0.460966527 -66.9926071 EXIT FROM BFGS code NEW_X -50795.9612 -0.460966527 -66.9926071 ENTER BFGS code NEW_X -50795.9612 -0.460966527 -66.9926071 EXIT FROM BFGS code FG_LNSRCH 0. -0.483536929 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.544038117 *** contribution from regularisation: 0.00314162462 *** contribution from error: -0.547179759 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51102.5891 -0.483536929 -11.7801809 EXIT FROM BFGS code NEW_X -51102.5891 -0.483536929 -11.7801809 ENTER BFGS code NEW_X -51102.5891 -0.483536929 -11.7801809 EXIT FROM BFGS code FG_LNSRCH 0. -0.503638268 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.545463979 *** contribution from regularisation: 0.00320245419 *** contribution from error: -0.548666418 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51236.5199 -0.503638268 23.8859539 EXIT FROM BFGS code NEW_X -51236.5199 -0.503638268 23.8859539 ENTER BFGS code NEW_X -51236.5199 -0.503638268 23.8859539 EXIT FROM BFGS code FG_LNSRCH 0. -0.505250573 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.54643935 *** contribution from regularisation: 0.00311542163 *** contribution from error: -0.549554765 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51328.1413 -0.505250573 15.2479401 EXIT FROM BFGS code NEW_X -51328.1413 -0.505250573 15.2479401 ENTER BFGS code NEW_X -51328.1413 -0.505250573 15.2479401 EXIT FROM BFGS code FG_LNSRCH 0. -0.50935775 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.547381282 *** contribution from regularisation: 0.00316500571 *** contribution from error: -0.550546288 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51416.6187 -0.50935775 7.52631664 EXIT FROM BFGS code NEW_X -51416.6187 -0.50935775 7.52631664 ENTER BFGS code NEW_X -51416.6187 -0.50935775 7.52631664 EXIT FROM BFGS code FG_LNSRCH 0. -0.509297192 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 40.1750755 sigma out 15 active outputs RANK 2 NODE 1 --> 20.0191441 sigma out 15 active outputs RANK 3 NODE 9 --> 13.9678326 sigma out 15 active outputs RANK 4 NODE 8 --> 13.6913223 sigma out 15 active outputs RANK 5 NODE 6 --> 13.2580919 sigma out 15 active outputs RANK 6 NODE 5 --> 13.1215649 sigma out 15 active outputs RANK 7 NODE 10 --> 12.3209209 sigma out 15 active outputs RANK 8 NODE 4 --> 12.2820425 sigma out 15 active outputs RANK 9 NODE 11 --> 11.0823927 sigma out 15 active outputs RANK 10 NODE 7 --> 10.3763685 sigma out 15 active outputs RANK 11 NODE 12 --> 10.0632801 sigma out 15 active outputs RANK 12 NODE 3 --> 8.33024216 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 29.9144802 sigma in 12act. ( 33.7982826 sig out 1act.) RANK 2 NODE 7 --> 22.1199398 sigma in 12act. ( 18.9365788 sig out 1act.) RANK 3 NODE 10 --> 20.2070007 sigma in 12act. ( 20.0315723 sig out 1act.) RANK 4 NODE 6 --> 18.3239422 sigma in 12act. ( 17.9370747 sig out 1act.) RANK 5 NODE 13 --> 15.1917315 sigma in 12act. ( 13.5611143 sig out 1act.) RANK 6 NODE 3 --> 14.1466665 sigma in 12act. ( 11.4185476 sig out 1act.) RANK 7 NODE 1 --> 13.7539196 sigma in 12act. ( 12.7082357 sig out 1act.) RANK 8 NODE 4 --> 13.123457 sigma in 12act. ( 11.8427534 sig out 1act.) RANK 9 NODE 9 --> 13.0191479 sigma in 12act. ( 11.5750914 sig out 1act.) RANK 10 NODE 11 --> 10.2307377 sigma in 12act. ( 8.84683037 sig out 1act.) RANK 11 NODE 8 --> 9.64231014 sigma in 12act. ( 10.7278175 sig out 1act.) RANK 12 NODE 12 --> 7.7039957 sigma in 12act. ( 5.95614958 sig out 1act.) RANK 13 NODE 15 --> 7.10471487 sigma in 12act. ( 4.17858028 sig out 1act.) RANK 14 NODE 2 --> 6.4590497 sigma in 12act. ( 3.53736377 sig out 1act.) RANK 15 NODE 14 --> 3.13918233 sigma in 12act. ( 1.7975719 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 33.7982826 sigma out 1act.( 29.9144802 sig in 12act.) RANK 2 NODE 10 --> 20.0315723 sigma out 1act.( 20.2070007 sig in 12act.) RANK 3 NODE 7 --> 18.9365788 sigma out 1act.( 22.1199398 sig in 12act.) RANK 4 NODE 6 --> 17.9370747 sigma out 1act.( 18.3239422 sig in 12act.) RANK 5 NODE 13 --> 13.5611143 sigma out 1act.( 15.1917315 sig in 12act.) RANK 6 NODE 1 --> 12.7082357 sigma out 1act.( 13.7539196 sig in 12act.) RANK 7 NODE 4 --> 11.8427534 sigma out 1act.( 13.123457 sig in 12act.) RANK 8 NODE 9 --> 11.5750914 sigma out 1act.( 13.0191479 sig in 12act.) RANK 9 NODE 3 --> 11.4185476 sigma out 1act.( 14.1466665 sig in 12act.) RANK 10 NODE 8 --> 10.7278175 sigma out 1act.( 9.64231014 sig in 12act.) RANK 11 NODE 11 --> 8.84683037 sigma out 1act.( 10.2307377 sig in 12act.) RANK 12 NODE 12 --> 5.95614958 sigma out 1act.( 7.7039957 sig in 12act.) RANK 13 NODE 15 --> 4.17858028 sigma out 1act.( 7.10471487 sig in 12act.) RANK 14 NODE 2 --> 3.53736377 sigma out 1act.( 6.4590497 sig in 12act.) RANK 15 NODE 14 --> 1.7975719 sigma out 1act.( 3.13918233 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 56.8856163 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.548234701 *** contribution from regularisation: 0.00313429511 *** contribution from error: -0.551369011 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51496.7809 -0.509297192 6.70017147 EXIT FROM BFGS code NEW_X -51496.7809 -0.509297192 6.70017147 ENTER BFGS code NEW_X -51496.7809 -0.509297192 6.70017147 EXIT FROM BFGS code FG_LNSRCH 0. -0.490990162 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.549727559 *** contribution from regularisation: 0.00333666475 *** contribution from error: -0.553064227 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51637.0083 -0.490990162 9.03618908 EXIT FROM BFGS code NEW_X -51637.0083 -0.490990162 9.03618908 ENTER BFGS code NEW_X -51637.0083 -0.490990162 9.03618908 EXIT FROM BFGS code FG_LNSRCH 0. -0.464902252 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.549218595 *** contribution from regularisation: 0.00322731747 *** contribution from error: -0.552445889 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51589.2011 -0.464902252 10.0520697 EXIT FROM BFGS code FG_LNSRCH 0. -0.480131745 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.550843656 *** contribution from regularisation: 0.00271905609 *** contribution from error: -0.553562701 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51741.8462 -0.480131745 11.6095896 EXIT FROM BFGS code NEW_X -51741.8462 -0.480131745 11.6095896 ENTER BFGS code NEW_X -51741.8462 -0.480131745 11.6095896 EXIT FROM BFGS code FG_LNSRCH 0. -0.474365979 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.55068171 *** contribution from regularisation: 0.00303345197 *** contribution from error: -0.553715169 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51726.632 -0.474365979 10.8768644 EXIT FROM BFGS code FG_LNSRCH 0. -0.479592443 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.550573766 *** contribution from regularisation: 0.00300577655 *** contribution from error: -0.553579569 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51716.4932 -0.479592443 11.3619184 EXIT FROM BFGS code FG_LNSRCH 0. -0.480127096 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.550567269 *** contribution from regularisation: 0.00299558393 *** contribution from error: -0.55356288 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51715.8873 -0.480127096 11.3892527 EXIT FROM BFGS code FG_LNSRCH 0. -0.480131745 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.550588608 *** contribution from regularisation: 0.00297411042 *** contribution from error: -0.553562701 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51717.8885 -0.480131745 11.4272642 EXIT FROM BFGS code FG_LNSRCH 0. -0.480131745 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.550573409 *** contribution from regularisation: 0.002989328 *** contribution from error: -0.55356276 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51716.459 -0.480131745 11.3609085 EXIT FROM BFGS code FG_LNSRCH 0. -0.480131745 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.550588608 *** contribution from regularisation: 0.00297408598 *** contribution from error: -0.553562701 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51717.8908 -0.480131745 11.3886833 EXIT FROM BFGS code FG_LNSRCH 0. -0.480131745 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 48.7940521 sigma out 15 active outputs RANK 2 NODE 10 --> 24.3075409 sigma out 15 active outputs RANK 3 NODE 1 --> 24.1223736 sigma out 15 active outputs RANK 4 NODE 9 --> 18.5580082 sigma out 15 active outputs RANK 5 NODE 11 --> 16.4036846 sigma out 15 active outputs RANK 6 NODE 6 --> 15.8593798 sigma out 15 active outputs RANK 7 NODE 4 --> 15.2890549 sigma out 15 active outputs RANK 8 NODE 8 --> 14.9998693 sigma out 15 active outputs RANK 9 NODE 12 --> 12.4097929 sigma out 15 active outputs RANK 10 NODE 7 --> 11.291584 sigma out 15 active outputs RANK 11 NODE 5 --> 10.9907827 sigma out 15 active outputs RANK 12 NODE 3 --> 7.71235704 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 53.4398003 sigma in 12act. ( 48.2131157 sig out 1act.) RANK 2 NODE 10 --> 21.0920506 sigma in 12act. ( 20.1702538 sig out 1act.) RANK 3 NODE 7 --> 19.8861656 sigma in 12act. ( 16.3692589 sig out 1act.) RANK 4 NODE 6 --> 17.4309845 sigma in 12act. ( 17.8244648 sig out 1act.) RANK 5 NODE 13 --> 16.8920822 sigma in 12act. ( 16.0695019 sig out 1act.) RANK 6 NODE 1 --> 15.5894594 sigma in 12act. ( 13.7056322 sig out 1act.) RANK 7 NODE 8 --> 15.5195036 sigma in 12act. ( 18.5146885 sig out 1act.) RANK 8 NODE 3 --> 14.350873 sigma in 12act. ( 12.1406384 sig out 1act.) RANK 9 NODE 4 --> 11.9428263 sigma in 12act. ( 10.5130424 sig out 1act.) RANK 10 NODE 9 --> 8.15997219 sigma in 12act. ( 5.77704906 sig out 1act.) RANK 11 NODE 11 --> 7.21198702 sigma in 12act. ( 5.11716366 sig out 1act.) RANK 12 NODE 12 --> 7.07634878 sigma in 12act. ( 5.42121744 sig out 1act.) RANK 13 NODE 2 --> 4.63896132 sigma in 12act. ( 0.779109776 sig out 1act.) RANK 14 NODE 15 --> 4.49040413 sigma in 12act. ( 0.984908521 sig out 1act.) RANK 15 NODE 14 --> 3.314785 sigma in 12act. ( 2.74759793 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 48.2131157 sigma out 1act.( 53.4398003 sig in 12act.) RANK 2 NODE 10 --> 20.1702538 sigma out 1act.( 21.0920506 sig in 12act.) RANK 3 NODE 8 --> 18.5146885 sigma out 1act.( 15.5195036 sig in 12act.) RANK 4 NODE 6 --> 17.8244648 sigma out 1act.( 17.4309845 sig in 12act.) RANK 5 NODE 7 --> 16.3692589 sigma out 1act.( 19.8861656 sig in 12act.) RANK 6 NODE 13 --> 16.0695019 sigma out 1act.( 16.8920822 sig in 12act.) RANK 7 NODE 1 --> 13.7056322 sigma out 1act.( 15.5894594 sig in 12act.) RANK 8 NODE 3 --> 12.1406384 sigma out 1act.( 14.350873 sig in 12act.) RANK 9 NODE 4 --> 10.5130424 sigma out 1act.( 11.9428263 sig in 12act.) RANK 10 NODE 9 --> 5.77704906 sigma out 1act.( 8.15997219 sig in 12act.) RANK 11 NODE 12 --> 5.42121744 sigma out 1act.( 7.07634878 sig in 12act.) RANK 12 NODE 11 --> 5.11716366 sigma out 1act.( 7.21198702 sig in 12act.) RANK 13 NODE 14 --> 2.74759793 sigma out 1act.( 3.314785 sig in 12act.) RANK 14 NODE 15 --> 0.984908521 sigma out 1act.( 4.49040413 sig in 12act.) RANK 15 NODE 2 --> 0.779109776 sigma out 1act.( 4.63896132 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.7972336 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.550577581 *** contribution from regularisation: 0.00298515894 *** contribution from error: -0.55356276 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51716.8507 -0.480131745 11.4475994 EXIT FROM BFGS code NEW_X -51716.8507 -0.480131745 11.4475994 ENTER BFGS code NEW_X -51716.8507 -0.480131745 11.4475994 EXIT FROM BFGS code CONVERGENC -51716.8507 -0.480131745 11.4475994 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 74.8527527 sigma out 15 active outputs RANK 2 NODE 10 --> 37.0523415 sigma out 15 active outputs RANK 3 NODE 1 --> 36.9893074 sigma out 15 active outputs RANK 4 NODE 9 --> 26.2395897 sigma out 15 active outputs RANK 5 NODE 11 --> 25.0811176 sigma out 15 active outputs RANK 6 NODE 4 --> 24.0063095 sigma out 15 active outputs RANK 7 NODE 6 --> 23.4657497 sigma out 15 active outputs RANK 8 NODE 8 --> 22.3518848 sigma out 15 active outputs RANK 9 NODE 12 --> 18.3173122 sigma out 15 active outputs RANK 10 NODE 7 --> 16.9810123 sigma out 15 active outputs RANK 11 NODE 5 --> 16.6984749 sigma out 15 active outputs RANK 12 NODE 3 --> 11.5317564 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 82.9211273 sigma in 12act. ( 75.1546326 sig out 1act.) RANK 2 NODE 10 --> 31.6182423 sigma in 12act. ( 31.1340008 sig out 1act.) RANK 3 NODE 7 --> 29.60359 sigma in 12act. ( 25.4484634 sig out 1act.) RANK 4 NODE 6 --> 26.6122971 sigma in 12act. ( 27.349638 sig out 1act.) RANK 5 NODE 13 --> 25.6513042 sigma in 12act. ( 24.3302727 sig out 1act.) RANK 6 NODE 8 --> 23.6465302 sigma in 12act. ( 28.7596722 sig out 1act.) RANK 7 NODE 1 --> 23.258604 sigma in 12act. ( 20.7267704 sig out 1act.) RANK 8 NODE 3 --> 20.8988457 sigma in 12act. ( 18.981802 sig out 1act.) RANK 9 NODE 4 --> 17.3704967 sigma in 12act. ( 16.3952484 sig out 1act.) RANK 10 NODE 9 --> 10.8914433 sigma in 12act. ( 8.87634182 sig out 1act.) RANK 11 NODE 11 --> 9.69969463 sigma in 12act. ( 7.90820503 sig out 1act.) RANK 12 NODE 12 --> 9.48978996 sigma in 12act. ( 8.59503174 sig out 1act.) RANK 13 NODE 2 --> 4.74784374 sigma in 12act. ( 1.19757152 sig out 1act.) RANK 14 NODE 15 --> 4.64498758 sigma in 12act. ( 1.512043 sig out 1act.) RANK 15 NODE 14 --> 4.48841953 sigma in 12act. ( 4.26844025 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 75.1546326 sigma out 1act.( 82.9211273 sig in 12act.) RANK 2 NODE 10 --> 31.1340008 sigma out 1act.( 31.6182423 sig in 12act.) RANK 3 NODE 8 --> 28.7596722 sigma out 1act.( 23.6465302 sig in 12act.) RANK 4 NODE 6 --> 27.349638 sigma out 1act.( 26.6122971 sig in 12act.) RANK 5 NODE 7 --> 25.4484634 sigma out 1act.( 29.60359 sig in 12act.) RANK 6 NODE 13 --> 24.3302727 sigma out 1act.( 25.6513042 sig in 12act.) RANK 7 NODE 1 --> 20.7267704 sigma out 1act.( 23.258604 sig in 12act.) RANK 8 NODE 3 --> 18.981802 sigma out 1act.( 20.8988457 sig in 12act.) RANK 9 NODE 4 --> 16.3952484 sigma out 1act.( 17.3704967 sig in 12act.) RANK 10 NODE 9 --> 8.87634182 sigma out 1act.( 10.8914433 sig in 12act.) RANK 11 NODE 12 --> 8.59503174 sigma out 1act.( 9.48978996 sig in 12act.) RANK 12 NODE 11 --> 7.90820503 sigma out 1act.( 9.69969463 sig in 12act.) RANK 13 NODE 14 --> 4.26844025 sigma out 1act.( 4.48841953 sig in 12act.) RANK 14 NODE 15 --> 1.512043 sigma out 1act.( 4.64498758 sig in 12act.) RANK 15 NODE 2 --> 1.19757152 sigma out 1act.( 4.74784374 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 103.576584 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.550559521 *** contribution from regularisation: 0.00300321588 *** contribution from error: -0.55356276 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done