NNInput NNInputs_140.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 195902 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 48967 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 48967 Chosen entries: 48967 Signal fraction: 1 Background fraction: 0.333256 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 48967 Entries to split: 48967 Test with : 24483 Train with : 24483 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 48967 for Signal Prepared event 0 for Signal with 48967 events ====Entry 0 Variable Ht : 135.044 Variable LepAPt : 36.7733 Variable LepBPt : 15.1786 Variable MetSigLeptonsJets : 6.335 Variable MetSpec : 56.2375 Variable SumEtLeptonsJets : 78.8061 Variable VSumJetLeptonsPt : 65.4215 Variable addEt : 108.19 Variable dPhiLepSumMet : 2.59573 Variable dPhiLeptons : 0.533909 Variable dRLeptons : 0.613899 Variable lep1_E : 40.034 Variable lep2_E : 15.2798 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2140 Ht = 135.044 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.7735 LepAPt = 36.7733 LepBEt = 15.1793 LepBPt = 15.1786 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 56.2375 MetDelPhi = 2.21558 MetSig = 4.21501 MetSigLeptonsJets = 6.335 MetSpec = 56.2375 Mjj = 0 MostCentralJetEta = -0.266727 MtllMet = 110.158 Njets = 1 SB = 0 SumEt = 178.015 SumEtJets = 0 SumEtLeptonsJets = 78.8061 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 65.4215 addEt = 108.19 dPhiLepSumMet = 2.59573 dPhiLeptons = 0.533909 dRLeptons = 0.613899 diltype = 17 dimass = 14.3911 event = 161 jet1_Et = 26.8541 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.034 lep2_E = 15.2798 rand = 0.999742 run = 234313 weight = 2.40583e-06 ===Show End Prepared event 10000 for Signal with 48967 events Prepared event 20000 for Signal with 48967 events Prepared event 30000 for Signal with 48967 events Prepared event 40000 for Signal with 48967 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.263696 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4520 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 195902 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4520 negative weights. Signal fraction: 61.9312706 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 62.2273026 64.5288544 66.392868 67.8093491 68.7400589 69.8122253 70.666626 71.4183578 72.1821365 72.9863358 73.7103577 74.2538452 74.8632202 75.4531555 76.0077057 76.6983032 77.1634369 77.724472 78.3128357 78.9546127 79.4881744 80.024086 80.6981812 81.2166138 81.9233017 82.5726929 83.2436676 83.9603271 84.924202 85.7974701 86.7013092 87.8350525 88.7274704 89.7649765 91.11689 92.419342 93.694458 95.0389099 96.2850876 97.4128189 98.6190491 99.8636017 101.108345 102.423714 103.548752 104.80896 106.011612 107.126495 108.303551 109.483215 110.768265 111.96463 113.221283 114.300003 115.469482 116.646713 117.873077 119.112778 120.399353 121.552246 122.798584 123.938522 125.118698 126.280159 127.53183 128.673462 129.863251 131.153366 132.503601 133.745407 135.046936 136.562714 137.975235 139.454239 141.270813 143.128723 145.0457 146.983398 148.831665 151.151672 153.543243 156.102112 158.61676 161.036652 163.671066 166.498138 169.512238 173.197784 176.697464 180.591934 185.209625 190.214569 196.253906 203.530441 211.496796 221.694672 234.873596 255.289551 290.255859 870.135071 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2843533 20.5615273 20.7859325 21.0005417 21.246563 21.4517651 21.6513176 21.868433 22.0660019 22.2502136 22.463129 22.6851959 22.9006596 23.0980225 23.2863293 23.4811268 23.6532879 23.8167953 23.9780312 24.1898537 24.3992271 24.5732079 24.7707138 24.9651909 25.1556435 25.3502636 25.5280533 25.6744652 25.850462 26.0426254 26.228611 26.4301205 26.6566334 26.8485222 27.0275078 27.2082787 27.389183 27.6215076 27.8320847 28.0226669 28.1918678 28.3969612 28.6253338 28.8450375 29.0559731 29.2330532 29.4602146 29.6779251 29.8901558 30.1230469 30.3524151 30.597971 30.8470573 31.0870266 31.3311043 31.5767403 31.8078156 32.0882759 32.3287735 32.583847 32.8241272 33.1057968 33.4185486 33.7093506 33.973465 34.2628479 34.5442123 34.8726921 35.192215 35.4957123 35.8068161 36.1457748 36.4664268 36.8432579 37.1802673 37.5832825 38.0006256 38.4003906 38.8769341 39.3217125 39.8264694 40.3116379 40.8030472 41.3374367 41.9843102 42.5755997 43.1981239 43.8737755 44.6785507 45.5149193 46.5327148 47.6539497 48.8536835 50.1500168 51.6493874 53.7662697 56.6200256 60.6229248 68.2520447 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1154499 10.2248592 10.3287811 10.432682 10.5389862 10.6620007 10.7609692 10.881073 10.9755697 11.0881052 11.2133408 11.317627 11.438159 11.5629044 11.6865597 11.7984028 11.924551 12.0696983 12.1905699 12.3279686 12.4952335 12.6347589 12.7736874 12.9243355 13.0838089 13.2433186 13.4122219 13.5555258 13.6891804 13.840765 13.9692688 14.1526718 14.2893581 14.4272099 14.5990887 14.7827158 14.9484253 15.1348438 15.2954779 15.4526501 15.6328716 15.8104401 15.9578152 16.1570129 16.3738766 16.5750771 16.7749996 16.9565353 17.1473217 17.3623581 17.5767345 17.7929859 18.021143 18.2310448 18.43964 18.6825523 18.8909988 19.1035347 19.3243446 19.5633602 19.7943211 20.0400925 20.2578201 20.4801731 20.7150917 20.9480286 21.1697388 21.4067783 21.6371384 21.8846855 22.162178 22.4023972 22.6659203 22.9096851 23.2251129 23.5080147 23.8092003 24.1334038 24.4620094 24.7788696 25.1136017 25.4439125 25.8123703 26.1617889 26.5408096 26.938736 27.3367958 27.7502499 28.1839676 28.6639194 29.1611271 29.7477951 30.3842525 31.0814133 31.9244747 32.9759483 34.3576508 36.4422684 40.4234238 71.5196915 ------------------------------ Transdef: Tab for variable 5 0.845276415 2.49558973 2.91780424 3.15958524 3.3909831 3.59712934 3.77099156 3.91385889 4.05637932 4.17268848 4.27912235 4.38588524 4.48375225 4.56884003 4.64791632 4.74497271 4.82376957 4.90998936 4.98110294 5.04855967 5.11457825 5.16932106 5.23607731 5.29304314 5.36274147 5.41471672 5.45662689 5.50356388 5.54387093 5.58934546 5.63218498 5.67980337 5.72483158 5.77103758 5.81179714 5.85316658 5.89667225 5.93346691 5.97933292 6.01621819 6.06092501 6.09350777 6.13134193 6.17183113 6.21116734 6.25900269 6.29306746 6.32695723 6.36126041 6.40122223 6.44131279 6.47740841 6.51737881 6.55632591 6.60394001 6.64219618 6.68690109 6.72405863 6.76792622 6.81461906 6.85476494 6.89894056 6.94503975 6.9897933 7.04126596 7.07502222 7.11985397 7.16535378 7.21587181 7.26315451 7.31202936 7.37073088 7.41716385 7.46444798 7.51883888 7.57546329 7.62969685 7.6854434 7.73970985 7.79501438 7.85224915 7.91416645 7.97594547 8.04255295 8.10532761 8.17627907 8.23936081 8.31148529 8.39407635 8.47911835 8.57278824 8.67660904 8.77867317 8.9055481 9.0408802 9.21871948 9.41705227 9.67498398 10.0689678 10.6972494 20.215023 ------------------------------ Transdef: Tab for variable 6 15.0038528 19.8393135 23.9115047 25.6537647 26.6249161 27.4152679 28.2032623 29.0086594 29.5697556 30.2057953 30.9041748 31.4260654 31.9390259 32.4827499 32.9650726 33.4397278 33.8817329 34.3013763 34.712677 35.0423965 35.4753799 35.8109207 36.1378098 36.4481812 36.7688293 37.0320892 37.3794937 37.7097359 38.0349655 38.363945 38.6687241 39.0281601 39.3321495 39.6197548 39.9377594 40.2693062 40.5558586 40.8787384 41.2336617 41.5914536 42.0158195 42.4129944 42.7538834 43.1122055 43.5351562 43.9245529 44.3976059 44.8455925 45.3592682 45.8532715 46.3978729 46.9537125 47.4849663 48.0304031 48.5448036 49.0602112 49.6121979 50.1324348 50.6863937 51.2328186 51.8008766 52.4264679 53.0958748 53.7379837 54.345665 54.8998032 55.4594727 56.0541458 56.677124 57.2610321 57.8428078 58.3899422 59.0331154 59.6104736 60.2536087 60.8862839 61.5276947 62.1201897 62.823822 63.4576263 64.1354599 64.7729187 65.4550323 66.2151871 67.1168976 67.9585953 68.9246292 69.8269806 70.8975296 72.1211853 73.3732605 74.9180756 76.5807343 78.4769287 80.9294662 83.3865356 86.7981873 91.4040833 98.2201385 109.862793 269.10907 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.4344711 33.3283844 33.9267273 34.6350365 35.1932526 35.6459923 36.0669136 36.4312935 36.8097153 37.0713005 37.447197 37.7062149 38.0041351 38.2990532 38.5994263 38.8747635 39.1737595 39.41008 39.6579971 40.0218124 40.3135681 40.6195221 40.9248085 41.2739029 41.5438385 41.89077 42.3076019 42.7226562 43.1650543 43.6328354 44.2792435 44.8291969 45.2424393 45.7996178 46.4184418 47.0549278 47.8501892 48.4708099 49.2734566 50.0860939 50.9121857 51.6398354 52.4333649 53.1427078 53.8935471 54.6848373 55.4755058 56.16576 56.8844261 57.614357 58.2294312 58.8775482 59.5609894 60.3389091 60.9792404 61.6588364 62.29916 63.0582886 63.7839699 64.5376129 65.3358002 66.1730652 66.9498978 67.8745575 68.8549271 69.9147949 71.011261 72.1145782 73.3677902 74.5962982 75.9897003 77.2574463 78.6632614 80.2457275 81.9668884 83.4333954 85.1062012 86.6762085 88.5368195 90.234787 92.0437088 93.9874878 96.2512207 98.2993774 100.539047 103.067368 105.78804 108.758194 111.621262 114.990158 119.06295 123.228516 128.258911 134.331558 141.588821 149.919128 161.617218 176.729507 204.552277 514.371704 ------------------------------ Transdef: Tab for variable 8 2.68028092 22.6448154 27.5993919 29.7099133 31.0048485 31.8071594 32.3932343 33.0106888 33.4961853 33.8894196 34.3125381 34.7161484 35.0584335 35.3589172 35.7027588 36.0007401 36.3030472 36.5573959 36.821167 37.1288528 37.3612747 37.6373367 37.8689499 38.091011 38.3689537 38.607048 38.8522911 39.0865936 39.2961731 39.5574188 39.8319702 40.0953827 40.3536224 40.6619492 40.9104691 41.2322388 41.5098724 41.8329544 42.1866341 42.5697975 42.9720764 43.307518 43.7274017 44.1100845 44.5128937 44.9400826 45.4124832 45.8480911 46.300499 46.7602081 47.2735214 47.8072014 48.3327141 48.8067551 49.3288803 49.8706131 50.4314957 50.9434662 51.4582138 52.0192184 52.6005249 53.1567688 53.6711502 54.2029533 54.7850838 55.3471375 55.853344 56.4404259 56.9636307 57.478035 58.0194702 58.540863 59.0871887 59.6549492 60.2547226 60.8201637 61.4440117 62.0853081 62.7162476 63.3459244 64.0498199 64.7218475 65.4207916 66.1899033 66.9638977 67.7898712 68.6779022 69.6700592 70.8457336 72.0563431 73.449501 74.9610138 76.6725769 78.617012 81.0614319 83.9060669 87.5486679 92.4035339 99.3158417 113.259697 361.698761 ------------------------------ Transdef: Tab for variable 9 47.1748543 61.6398811 63.9196167 65.7312622 67.0565491 68.1230927 68.9352341 69.7644043 70.515419 71.1832428 71.8046722 72.5220718 73.2227478 73.8335953 74.2933197 74.842659 75.3724213 75.8034744 76.4113083 76.9450455 77.3574982 77.8776627 78.3536682 78.8752747 79.3464966 79.7735977 80.2732468 80.7860718 81.2649155 81.8120422 82.3927765 82.9259186 83.4905701 84.0691528 84.8340912 85.578064 86.2710419 86.912384 87.7295303 88.5263062 89.2853851 90.1597443 91.1115494 92.0902481 92.9340591 93.9837341 95.0895767 95.9906082 96.917984 98.0031433 98.9627304 100.023911 100.999359 102.03421 102.966522 103.934372 104.927444 105.846519 106.796188 107.744881 108.727219 109.775734 110.736092 111.716965 112.690865 113.623894 114.491043 115.39872 116.300323 117.162209 118.09433 119.039574 119.994385 120.962189 121.812935 122.767044 123.5858 124.526855 125.489197 126.462196 127.454475 128.356476 129.274811 130.22168 131.267548 132.348145 133.430908 134.569214 135.742676 136.980392 138.311951 139.773346 141.516235 143.250458 145.407074 148.147064 151.757904 157.07196 165.730347 181.286041 433.44342 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.0376035 1.33036709 1.52029681 1.67641973 1.79459381 1.89343476 1.97398376 2.05187035 2.12238407 2.18635201 2.23601723 2.28428841 2.32697868 2.37047529 2.4116981 2.44688797 2.48173285 2.51513433 2.54162073 2.57093382 2.59773636 2.6192615 2.64324498 2.66854095 2.69040608 2.7110095 2.72840834 2.74720669 2.76307368 2.77812171 2.79279995 2.80712748 2.82033396 2.83230567 2.84408593 2.85556841 2.86613274 2.87689066 2.886971 2.89767838 2.90520978 2.91286922 2.9203167 2.92896247 2.9370842 2.94474506 2.95168281 2.95850086 2.9643569 2.96967435 2.97613049 2.98120189 2.98608375 2.99118853 2.99675584 3.00184917 3.00662112 3.01133299 3.01534724 3.02026176 3.02460408 3.02825308 3.03201056 3.03589964 3.0401895 3.04404354 3.04796743 3.05192804 3.05545616 3.05912638 3.06218386 3.06605029 3.06919289 3.07259512 3.07532525 3.0783639 3.08137703 3.08468699 3.08762741 3.0905962 3.09317112 3.09561443 3.09873843 3.1012764 3.10399175 3.10620642 3.10899162 3.111763 3.11437035 3.11661935 3.11914325 3.12160063 3.12476087 3.12725115 3.12966585 3.13207865 3.1345315 3.13700867 3.13899136 3.14158654 ------------------------------ Transdef: Tab for variable 11 3.9100647E-05 0.00641542673 0.0115925446 0.0188470557 0.0251226425 0.0323774815 0.0401516557 0.0475115776 0.0557661057 0.0632884502 0.070800066 0.0778927803 0.0855411291 0.0928153768 0.0994179845 0.10674423 0.11371839 0.120864779 0.12814191 0.134964824 0.142059803 0.148641109 0.15545547 0.162436336 0.168970361 0.175259471 0.182338461 0.188124955 0.193757415 0.198987484 0.204609513 0.208937705 0.21347785 0.218976855 0.225009143 0.229924858 0.234544635 0.240659505 0.246367246 0.251594067 0.25680548 0.2618635 0.267363042 0.273388982 0.279091448 0.284394145 0.290130913 0.295908332 0.3010993 0.306753993 0.312707484 0.317878544 0.323682368 0.329408735 0.335385859 0.34141171 0.347448707 0.352828413 0.358353019 0.364485234 0.370516807 0.376673937 0.382724762 0.388456166 0.394204438 0.399856001 0.406247973 0.412885636 0.418125808 0.425244719 0.432235241 0.438704073 0.445062697 0.451131791 0.457644224 0.464123249 0.471119016 0.477789521 0.485925585 0.494104385 0.502193272 0.509580195 0.517291784 0.526206613 0.533499837 0.544336259 0.554510295 0.56581074 0.576966524 0.587356627 0.600274682 0.61580503 0.632020295 0.649454474 0.664016724 0.687113523 0.711214185 0.735633492 0.774695337 0.831758678 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.200034663 0.209844649 0.218106925 0.22657904 0.23478815 0.241598532 0.249800548 0.257098198 0.263983786 0.270401359 0.277463496 0.284862936 0.292140603 0.298556954 0.30615437 0.31363973 0.319594651 0.32562536 0.332224548 0.338787168 0.346146941 0.351998746 0.358280361 0.364243627 0.3698695 0.376222491 0.38269189 0.388956606 0.395012259 0.400565892 0.405851871 0.41043666 0.414119244 0.41835776 0.421993554 0.42601791 0.430043817 0.433962882 0.437847853 0.441841602 0.445642292 0.44917205 0.453423291 0.457450658 0.461578876 0.466100633 0.470321983 0.473931313 0.477941692 0.481846213 0.485429972 0.48947072 0.493041337 0.497606188 0.50169456 0.505999684 0.510337472 0.514697492 0.518856227 0.522779822 0.527358294 0.532337666 0.537310421 0.541507781 0.546006918 0.551571488 0.556343913 0.56126821 0.56583637 0.570780635 0.575914502 0.580490232 0.585941076 0.592051744 0.597291112 0.603752255 0.611006856 0.618214369 0.624889374 0.630983233 0.63751328 0.645866036 0.653592825 0.660685897 0.668187439 0.675573826 0.683959723 0.695229411 0.705563843 0.715963423 0.727114439 0.736882687 0.748382092 0.759134114 0.772803843 0.789992988 0.809193373 0.832843184 0.863185227 0.904917002 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.3645039 22.0611763 22.5570564 23.1478577 23.6349277 24.1015625 24.558754 25.016449 25.4098148 25.7777405 26.1174774 26.4957733 26.8572044 27.1877689 27.4963264 27.8303223 28.1748333 28.4909878 28.8286572 29.1416588 29.391243 29.6906281 29.9991226 30.2975082 30.5320225 30.8040085 31.0426083 31.3387642 31.6632881 31.9209595 32.1874313 32.4558105 32.7366447 33.030098 33.3155518 33.637085 33.9415588 34.279171 34.5935135 34.8941956 35.2025757 35.4639282 35.805851 36.1222916 36.4011803 36.7460632 37.0589981 37.3726807 37.7272263 38.096447 38.4635849 38.8093948 39.1980362 39.593235 39.9519272 40.3422012 40.7476883 41.1985588 41.657608 42.102108 42.5501328 42.9829788 43.4009476 43.8455391 44.3700333 44.8949699 45.4347267 45.9622879 46.4933472 47.0056839 47.5723419 48.1167374 48.740097 49.3432465 50.0445786 50.786869 51.5022087 52.1628838 52.8852005 53.761898 54.5781326 55.5428925 56.5950165 57.7097931 58.7115898 59.8873024 61.0265274 62.5142288 64.0640488 65.7980347 67.4501572 69.463295 71.7103882 74.5263824 77.3824692 80.8996887 85.3630829 91.9672241 101.833344 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0034533 10.5919199 10.9767017 11.3135576 11.6091471 11.8735161 12.2294416 12.5101881 12.7885761 13.0735092 13.364192 13.5974112 13.8173943 14.0772247 14.3221035 14.539155 14.7784615 15.0279293 15.2215385 15.4631844 15.6737032 15.9172096 16.1798248 16.4222126 16.7042084 16.9353161 17.1970253 17.4475021 17.6942101 17.9202271 18.1831322 18.400589 18.6139221 18.8610802 19.0840721 19.2981529 19.5293045 19.8187408 20.0664558 20.3029041 20.5568867 20.8008766 21.0352783 21.2972145 21.5400028 21.7627411 22.0086937 22.286911 22.5410023 22.8094482 23.064476 23.3749447 23.6385193 23.8638649 24.1250668 24.4096375 24.6762867 24.9353065 25.2062206 25.4667931 25.7645779 26.0471363 26.3231964 26.6444397 26.9890327 27.2701302 27.5912018 27.8594494 28.1681843 28.4814911 28.812439 29.1361618 29.4924603 29.8072548 30.1926422 30.5498657 30.965065 31.3516464 31.7632542 32.2051239 32.6896973 33.1533051 33.6735458 34.1999474 34.7047501 35.2692337 35.9817963 36.6540527 37.3997192 38.1630478 38.9664383 39.8289871 40.8876419 42.1198196 43.7357445 45.5400925 47.7264328 50.6726837 54.4845123 61.0607758 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 61.5 42.9 46.1 20.0 42.1 58.6 47.4 58.4 -28.5 -8.7 -21.0 8.5 16.4 2 61.5 100.0 63.5 55.7 25.2 63.8 94.1 68.4 90.4 -47.6 -18.3 -36.0 29.4 28.2 3 42.9 63.5 100.0 35.0 0.6 28.7 67.1 48.5 68.8 -18.0 -19.1 -38.5 63.7 16.1 4 46.1 55.7 35.0 100.0 8.2 31.2 56.5 45.5 61.1 -13.1 -22.2 -46.3 13.4 69.8 5 20.0 25.2 0.6 8.2 100.0 82.2 -3.3 51.1 51.1 28.4 -2.3 -1.2 -8.4 -0.6 6 42.1 63.8 28.7 31.2 82.2 100.0 41.1 75.7 78.1 -3.9 -9.9 -17.2 7.2 12.9 7 58.6 94.1 67.1 56.5 -3.3 41.1 100.0 60.0 77.7 -55.6 -17.6 -36.4 34.0 30.6 8 47.4 68.4 48.5 45.5 51.1 75.7 60.0 100.0 79.5 -8.7 -17.4 -29.7 22.1 24.3 9 58.4 90.4 68.8 61.1 51.1 78.1 77.7 79.5 100.0 -21.3 -20.6 -40.2 34.1 33.1 10 -28.5 -47.6 -18.0 -13.1 28.4 -3.9 -55.6 -8.7 -21.3 100.0 3.6 8.0 -5.7 -3.8 11 -8.7 -18.3 -19.1 -22.2 -2.3 -9.9 -17.6 -17.4 -20.6 3.6 100.0 53.9 -5.6 -12.1 12 -21.0 -36.0 -38.5 -46.3 -1.2 -17.2 -36.4 -29.7 -40.2 8.0 53.9 100.0 -13.7 -22.1 13 8.5 29.4 63.7 13.4 -8.4 7.2 34.0 22.1 34.1 -5.7 -5.6 -13.7 100.0 43.0 14 16.4 28.2 16.1 69.8 -0.6 12.9 30.6 24.3 33.1 -3.8 -12.1 -22.1 43.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 143.767285 TOTAL CORRELATION OF ALL VARIABLES 67.8490135 ROUND 1: MAX CORR ( 67.8393352) AFTER KILLING INPUT VARIABLE 6 CONTR 1.14595972 ROUND 2: MAX CORR ( 67.8174371) AFTER KILLING INPUT VARIABLE 11 CONTR 1.72355285 ROUND 3: MAX CORR ( 67.7628345) AFTER KILLING INPUT VARIABLE 7 CONTR 2.72085048 ROUND 4: MAX CORR ( 67.5801432) AFTER KILLING INPUT VARIABLE 14 CONTR 4.97252306 ROUND 5: MAX CORR ( 67.3598426) AFTER KILLING INPUT VARIABLE 8 CONTR 5.45228012 ROUND 6: MAX CORR ( 67.0719729) AFTER KILLING INPUT VARIABLE 10 CONTR 6.22084029 ROUND 7: MAX CORR ( 66.4997944) AFTER KILLING INPUT VARIABLE 12 CONTR 8.74224783 ROUND 8: MAX CORR ( 65.5296122) AFTER KILLING INPUT VARIABLE 9 CONTR 11.3177988 ROUND 9: MAX CORR ( 65.2615106) AFTER KILLING INPUT VARIABLE 5 CONTR 5.92159732 ROUND 10: MAX CORR ( 63.831499) AFTER KILLING INPUT VARIABLE 4 CONTR 13.586924 ROUND 11: MAX CORR ( 62.2829534) AFTER KILLING INPUT VARIABLE 3 CONTR 13.9747623 ROUND 12: MAX CORR ( 61.4673008) AFTER KILLING INPUT VARIABLE 13 CONTR 10.0467515 LAST REMAINING VARIABLE: 2 total correlation to target: 67.8490135 % total significance: 135.463627 sigma correlations of single variables to target: variable 2: 61.4673008 % , in sigma: 122.722249 variable 3: 42.8841533 % , in sigma: 85.6201535 variable 4: 46.0608442 % , in sigma: 91.9625608 variable 5: 20.0254421 % , in sigma: 39.9817018 variable 6: 42.0781453 % , in sigma: 84.0109221 variable 7: 58.6022753 % , in sigma: 117.002096 variable 8: 47.4174481 % , in sigma: 94.6710818 variable 9: 58.4087372 % , in sigma: 116.615688 variable 10: -28.455567 % , in sigma: 56.8128277 variable 11: -8.69697286 % , in sigma: 17.3639 variable 12: -20.9511969 % , in sigma: 41.8300131 variable 13: 8.45758095 % , in sigma: 16.8859433 variable 14: 16.386003 % , in sigma: 32.7153969 variables sorted by significance: 1 most relevant variable 2 corr 61.4673004 , in sigma: 122.722248 2 most relevant variable 13 corr 10.046751 , in sigma: 20.0587933 3 most relevant variable 3 corr 13.974762 , in sigma: 27.9012449 4 most relevant variable 4 corr 13.5869236 , in sigma: 27.1269081 5 most relevant variable 5 corr 5.92159748 , in sigma: 11.8227375 6 most relevant variable 9 corr 11.3177986 , in sigma: 22.5964973 7 most relevant variable 12 corr 8.74224758 , in sigma: 17.4542931 8 most relevant variable 10 corr 6.22084045 , in sigma: 12.4201896 9 most relevant variable 8 corr 5.45228004 , in sigma: 10.8857239 10 most relevant variable 14 corr 4.97252321 , in sigma: 9.92786771 11 most relevant variable 7 corr 2.72085047 , in sigma: 5.43230114 12 most relevant variable 11 corr 1.72355282 , in sigma: 3.44115124 13 most relevant variable 6 corr 1.14595973 , in sigma: 2.28796049 global correlations between input variables: variable 2: 99.139929 % variable 3: 92.7881863 % variable 4: 91.1992922 % variable 5: 95.345116 % variable 6: 94.6510853 % variable 7: 98.6952618 % variable 8: 87.4703936 % variable 9: 98.7813413 % variable 10: 72.0604397 % variable 11: 54.5988696 % variable 12: 68.1999673 % variable 13: 85.0328195 % variable 14: 87.2041751 % significance loss when removing single variables: variable 2: corr = 6.5479361 % , sigma = 13.0732509 variable 3: corr = 14.9249862 % , sigma = 29.7984107 variable 4: corr = 16.9908755 % , sigma = 33.9230521 variable 5: corr = 11.2702111 % , sigma = 22.5014868 variable 6: corr = 1.14595972 % , sigma = 2.28796045 variable 7: corr = 2.46171659 % , sigma = 4.91492863 variable 8: corr = 3.92973443 % , sigma = 7.84589269 variable 9: corr = 9.98621422 % , sigma = 19.9379288 variable 10: corr = 6.40518772 % , sigma = 12.7882473 variable 11: corr = 1.74806602 % , sigma = 3.49009296 variable 12: corr = 6.73395573 % , sigma = 13.4446475 variable 13: corr = 7.28512424 % , sigma = 14.5450804 variable 14: corr = 4.86598529 % , sigma = 9.71515993 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 24.451849 sigma out 15 active outputs RANK 2 NODE 7 --> 24.1327724 sigma out 15 active outputs RANK 3 NODE 5 --> 19.7480526 sigma out 15 active outputs RANK 4 NODE 12 --> 16.9918041 sigma out 15 active outputs RANK 5 NODE 1 --> 16.7535362 sigma out 15 active outputs RANK 6 NODE 8 --> 14.0928469 sigma out 15 active outputs RANK 7 NODE 6 --> 13.98985 sigma out 15 active outputs RANK 8 NODE 3 --> 13.5903931 sigma out 15 active outputs RANK 9 NODE 10 --> 12.8293276 sigma out 15 active outputs RANK 10 NODE 4 --> 11.382987 sigma out 15 active outputs RANK 11 NODE 11 --> 9.98684216 sigma out 15 active outputs RANK 12 NODE 2 --> 8.27372646 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 31.3381214 sigma in 12act. ( 30.0043793 sig out 1act.) RANK 2 NODE 10 --> 24.1843433 sigma in 12act. ( 25.7460232 sig out 1act.) RANK 3 NODE 1 --> 20.9819317 sigma in 12act. ( 19.4893074 sig out 1act.) RANK 4 NODE 7 --> 19.5999146 sigma in 12act. ( 19.1145992 sig out 1act.) RANK 5 NODE 15 --> 17.2422009 sigma in 12act. ( 17.8578491 sig out 1act.) RANK 6 NODE 2 --> 14.9888229 sigma in 12act. ( 17.3495941 sig out 1act.) RANK 7 NODE 12 --> 9.62517452 sigma in 12act. ( 9.38932705 sig out 1act.) RANK 8 NODE 4 --> 8.50955963 sigma in 12act. ( 12.4258652 sig out 1act.) RANK 9 NODE 8 --> 5.18223524 sigma in 12act. ( 2.71049356 sig out 1act.) RANK 10 NODE 11 --> 4.9143014 sigma in 12act. ( 4.72799969 sig out 1act.) RANK 11 NODE 9 --> 4.44615698 sigma in 12act. ( 6.92840385 sig out 1act.) RANK 12 NODE 5 --> 3.38628531 sigma in 12act. ( 5.97597122 sig out 1act.) RANK 13 NODE 3 --> 2.9441247 sigma in 12act. ( 3.50048423 sig out 1act.) RANK 14 NODE 13 --> 2.74401903 sigma in 12act. ( 4.65173817 sig out 1act.) RANK 15 NODE 14 --> 2.05865693 sigma in 12act. ( 2.58590889 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 30.0043793 sigma out 1act.( 31.3381214 sig in 12act.) RANK 2 NODE 10 --> 25.7460232 sigma out 1act.( 24.1843433 sig in 12act.) RANK 3 NODE 1 --> 19.4893074 sigma out 1act.( 20.9819317 sig in 12act.) RANK 4 NODE 7 --> 19.1145992 sigma out 1act.( 19.5999146 sig in 12act.) RANK 5 NODE 15 --> 17.8578491 sigma out 1act.( 17.2422009 sig in 12act.) RANK 6 NODE 2 --> 17.3495941 sigma out 1act.( 14.9888229 sig in 12act.) RANK 7 NODE 4 --> 12.4258652 sigma out 1act.( 8.50955963 sig in 12act.) RANK 8 NODE 12 --> 9.38932705 sigma out 1act.( 9.62517452 sig in 12act.) RANK 9 NODE 9 --> 6.92840385 sigma out 1act.( 4.44615698 sig in 12act.) RANK 10 NODE 5 --> 5.97597122 sigma out 1act.( 3.38628531 sig in 12act.) RANK 11 NODE 11 --> 4.72799969 sigma out 1act.( 4.9143014 sig in 12act.) RANK 12 NODE 13 --> 4.65173817 sigma out 1act.( 2.74401903 sig in 12act.) RANK 13 NODE 3 --> 3.50048423 sigma out 1act.( 2.9441247 sig in 12act.) RANK 14 NODE 8 --> 2.71049356 sigma out 1act.( 5.18223524 sig in 12act.) RANK 15 NODE 14 --> 2.58590889 sigma out 1act.( 2.05865693 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 57.6609802 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 28.2406864 sigma out 15 active outputs RANK 2 NODE 9 --> 23.2130241 sigma out 15 active outputs RANK 3 NODE 7 --> 22.7255211 sigma out 15 active outputs RANK 4 NODE 5 --> 19.1830082 sigma out 15 active outputs RANK 5 NODE 1 --> 17.635128 sigma out 15 active outputs RANK 6 NODE 6 --> 16.1765099 sigma out 15 active outputs RANK 7 NODE 8 --> 15.7090559 sigma out 15 active outputs RANK 8 NODE 10 --> 12.9663639 sigma out 15 active outputs RANK 9 NODE 3 --> 12.9065933 sigma out 15 active outputs RANK 10 NODE 4 --> 11.6937904 sigma out 15 active outputs RANK 11 NODE 11 --> 10.5831642 sigma out 15 active outputs RANK 12 NODE 2 --> 9.99037552 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 25.0677128 sigma in 12act. ( 25.510004 sig out 1act.) RANK 2 NODE 10 --> 23.2118359 sigma in 12act. ( 23.0187359 sig out 1act.) RANK 3 NODE 15 --> 19.3698597 sigma in 12act. ( 16.8045807 sig out 1act.) RANK 4 NODE 1 --> 18.800827 sigma in 12act. ( 16.7164612 sig out 1act.) RANK 5 NODE 7 --> 18.3544807 sigma in 12act. ( 16.7045345 sig out 1act.) RANK 6 NODE 2 --> 17.6937828 sigma in 12act. ( 17.0793533 sig out 1act.) RANK 7 NODE 4 --> 16.455101 sigma in 12act. ( 13.7675562 sig out 1act.) RANK 8 NODE 9 --> 13.5259209 sigma in 12act. ( 8.20753002 sig out 1act.) RANK 9 NODE 13 --> 13.460743 sigma in 12act. ( 7.32298422 sig out 1act.) RANK 10 NODE 5 --> 13.3692608 sigma in 12act. ( 8.60560894 sig out 1act.) RANK 11 NODE 14 --> 10.3067045 sigma in 12act. ( 3.30082583 sig out 1act.) RANK 12 NODE 12 --> 10.0375671 sigma in 12act. ( 8.69606113 sig out 1act.) RANK 13 NODE 11 --> 7.96354198 sigma in 12act. ( 4.51369238 sig out 1act.) RANK 14 NODE 3 --> 7.3772788 sigma in 12act. ( 4.14407253 sig out 1act.) RANK 15 NODE 8 --> 6.2657752 sigma in 12act. ( 2.05915642 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 25.510004 sigma out 1act.( 25.0677128 sig in 12act.) RANK 2 NODE 10 --> 23.0187359 sigma out 1act.( 23.2118359 sig in 12act.) RANK 3 NODE 2 --> 17.0793533 sigma out 1act.( 17.6937828 sig in 12act.) RANK 4 NODE 15 --> 16.8045807 sigma out 1act.( 19.3698597 sig in 12act.) RANK 5 NODE 1 --> 16.7164612 sigma out 1act.( 18.800827 sig in 12act.) RANK 6 NODE 7 --> 16.7045345 sigma out 1act.( 18.3544807 sig in 12act.) RANK 7 NODE 4 --> 13.7675562 sigma out 1act.( 16.455101 sig in 12act.) RANK 8 NODE 12 --> 8.69606113 sigma out 1act.( 10.0375671 sig in 12act.) RANK 9 NODE 5 --> 8.60560894 sigma out 1act.( 13.3692608 sig in 12act.) RANK 10 NODE 9 --> 8.20753002 sigma out 1act.( 13.5259209 sig in 12act.) RANK 11 NODE 13 --> 7.32298422 sigma out 1act.( 13.460743 sig in 12act.) RANK 12 NODE 11 --> 4.51369238 sigma out 1act.( 7.96354198 sig in 12act.) RANK 13 NODE 3 --> 4.14407253 sigma out 1act.( 7.3772788 sig in 12act.) RANK 14 NODE 14 --> 3.30082583 sigma out 1act.( 10.3067045 sig in 12act.) RANK 15 NODE 8 --> 2.05915642 sigma out 1act.( 6.2657752 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.1610603 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.427780867 *** contribution from regularisation: 0.00510281185 *** contribution from error: -0.43288368 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.482149482 *** contribution from regularisation: 0.00249352749 *** contribution from error: -0.484643012 *********************************************** -----------------> Test sample ENTER BFGS code START -47236.818 0.0488644131 0.787125468 EXIT FROM BFGS code FG_START 0. 0.0488644131 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.498841405 *** contribution from regularisation: 0.00243665138 *** contribution from error: -0.501278043 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48862.0143 0.0488644131 257.729065 EXIT FROM BFGS code FG_LNSRCH 0. 0.0879756361 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.53 EXIT FROM BFGS code NEW_X -52162.8842 0.0879756361 26.4516678 ENTER BFGS code NEW_X -52162.8842 0.0879756361 26.4516678 EXIT FROM BFGS code FG_LNSRCH 0. 0.0920072272 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.534285963 *** contribution from regularisation: 0.00303977565 *** contribution from error: -0.53732574 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52333.8437 0.0920072272 23.0427628 EXIT FROM BFGS code NEW_X -52333.8437 0.0920072272 23.0427628 ENTER BFGS code NEW_X -52333.8437 0.0920072272 23.0427628 EXIT FROM BFGS code FG_LNSRCH 0. 0.100773297 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.535661638 *** contribution from regularisation: 0.00303361914 *** contribution from error: -0.538695276 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52468.5916 0.100773297 9.25523186 EXIT FROM BFGS code NEW_X -52468.5916 0.100773297 9.25523186 ENTER BFGS code NEW_X -52468.5916 0.100773297 9.25523186 EXIT FROM BFGS code FG_LNSRCH 0. 0.107581705 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.536258459 *** contribution from regularisation: 0.00301288534 *** contribution from error: -0.539271355 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52527.0546 0.107581705 -10.0916891 EXIT FROM BFGS code NEW_X -52527.0546 0.107581705 -10.0916891 ENTER BFGS code NEW_X -52527.0546 0.107581705 -10.0916891 EXIT FROM BFGS code FG_LNSRCH 0. 0.104511827 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.536556184 *** contribution from regularisation: 0.0030286226 *** contribution from error: -0.539584816 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52556.2164 0.104511827 -14.379734 EXIT FROM BFGS code NEW_X -52556.2164 0.104511827 -14.379734 ENTER BFGS code NEW_X -52556.2164 0.104511827 -14.379734 EXIT FROM BFGS code FG_LNSRCH 0. 0.0631080642 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.538593292 *** contribution from regularisation: 0.00286040222 *** contribution from error: -0.541453719 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52755.7512 0.0631080642 0.549490333 EXIT FROM BFGS code NEW_X -52755.7512 0.0631080642 0.549490333 ENTER BFGS code NEW_X -52755.7512 0.0631080642 0.549490333 EXIT FROM BFGS code FG_LNSRCH 0. 0.0344086476 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 46.7049065 sigma out 15 active outputs RANK 2 NODE 3 --> 21.8378696 sigma out 15 active outputs RANK 3 NODE 2 --> 20.7613029 sigma out 15 active outputs RANK 4 NODE 1 --> 18.3762131 sigma out 15 active outputs RANK 5 NODE 6 --> 18.0948486 sigma out 15 active outputs RANK 6 NODE 11 --> 14.5353651 sigma out 15 active outputs RANK 7 NODE 8 --> 13.0145473 sigma out 15 active outputs RANK 8 NODE 7 --> 10.8785229 sigma out 15 active outputs RANK 9 NODE 10 --> 10.8434448 sigma out 15 active outputs RANK 10 NODE 5 --> 10.7782707 sigma out 15 active outputs RANK 11 NODE 9 --> 10.0407171 sigma out 15 active outputs RANK 12 NODE 4 --> 9.0877142 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 42.6644707 sigma in 12act. ( 45.9796333 sig out 1act.) RANK 2 NODE 13 --> 34.6040573 sigma in 12act. ( 33.585186 sig out 1act.) RANK 3 NODE 9 --> 20.4928093 sigma in 12act. ( 18.5283756 sig out 1act.) RANK 4 NODE 4 --> 15.3417063 sigma in 12act. ( 12.8436584 sig out 1act.) RANK 5 NODE 11 --> 14.1116791 sigma in 12act. ( 13.9942226 sig out 1act.) RANK 6 NODE 7 --> 13.5147572 sigma in 12act. ( 13.0640259 sig out 1act.) RANK 7 NODE 15 --> 12.1363745 sigma in 12act. ( 10.0344801 sig out 1act.) RANK 8 NODE 6 --> 11.1819096 sigma in 12act. ( 10.6090946 sig out 1act.) RANK 9 NODE 2 --> 8.90020847 sigma in 12act. ( 6.88270283 sig out 1act.) RANK 10 NODE 10 --> 8.33236217 sigma in 12act. ( 7.17765808 sig out 1act.) RANK 11 NODE 14 --> 7.83436871 sigma in 12act. ( 4.50697517 sig out 1act.) RANK 12 NODE 3 --> 6.96314907 sigma in 12act. ( 4.62973738 sig out 1act.) RANK 13 NODE 12 --> 6.82519674 sigma in 12act. ( 5.94601202 sig out 1act.) RANK 14 NODE 8 --> 4.82770443 sigma in 12act. ( 3.99484134 sig out 1act.) RANK 15 NODE 1 --> 3.87324786 sigma in 12act. ( 1.53067601 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 45.9796333 sigma out 1act.( 42.6644707 sig in 12act.) RANK 2 NODE 13 --> 33.585186 sigma out 1act.( 34.6040573 sig in 12act.) RANK 3 NODE 9 --> 18.5283756 sigma out 1act.( 20.4928093 sig in 12act.) RANK 4 NODE 11 --> 13.9942226 sigma out 1act.( 14.1116791 sig in 12act.) RANK 5 NODE 7 --> 13.0640259 sigma out 1act.( 13.5147572 sig in 12act.) RANK 6 NODE 4 --> 12.8436584 sigma out 1act.( 15.3417063 sig in 12act.) RANK 7 NODE 6 --> 10.6090946 sigma out 1act.( 11.1819096 sig in 12act.) RANK 8 NODE 15 --> 10.0344801 sigma out 1act.( 12.1363745 sig in 12act.) RANK 9 NODE 10 --> 7.17765808 sigma out 1act.( 8.33236217 sig in 12act.) RANK 10 NODE 2 --> 6.88270283 sigma out 1act.( 8.90020847 sig in 12act.) RANK 11 NODE 12 --> 5.94601202 sigma out 1act.( 6.82519674 sig in 12act.) RANK 12 NODE 3 --> 4.62973738 sigma out 1act.( 6.96314907 sig in 12act.) RANK 13 NODE 14 --> 4.50697517 sigma out 1act.( 7.83436871 sig in 12act.) RANK 14 NODE 8 --> 3.99484134 sigma out 1act.( 4.82770443 sig in 12act.) RANK 15 NODE 1 --> 1.53067601 sigma out 1act.( 3.87324786 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 67.2636414 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.539527595 *** contribution from regularisation: 0.0034673214 *** contribution from error: -0.542994916 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52847.2687 0.0344086476 -15.6133137 EXIT FROM BFGS code NEW_X -52847.2687 0.0344086476 -15.6133137 ENTER BFGS code NEW_X -52847.2687 0.0344086476 -15.6133137 EXIT FROM BFGS code FG_LNSRCH 0. 0.0290342383 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.540294647 *** contribution from regularisation: 0.00290711946 *** contribution from error: -0.543201745 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52922.3995 0.0290342383 14.1660528 EXIT FROM BFGS code NEW_X -52922.3995 0.0290342383 14.1660528 ENTER BFGS code NEW_X -52922.3995 0.0290342383 14.1660528 EXIT FROM BFGS code FG_LNSRCH 0. 0.0325886644 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.540292323 *** contribution from regularisation: 0.00306240818 *** contribution from error: -0.54335475 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52922.1756 0.0325886644 -1.24285722 EXIT FROM BFGS code FG_LNSRCH 0. 0.0300190467 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.540176153 *** contribution from regularisation: 0.00308568194 *** contribution from error: -0.543261826 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52910.7922 0.0300190467 9.98478222 EXIT FROM BFGS code FG_LNSRCH 0. 0.029094547 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.54015559 *** contribution from regularisation: 0.00305042812 *** contribution from error: -0.543206036 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52908.7799 0.029094547 14.1090336 EXIT FROM BFGS code FG_LNSRCH 0. 0.0290345009 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.540157318 *** contribution from regularisation: 0.00304439315 *** contribution from error: -0.543201685 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52908.9511 0.0290345009 14.4124737 EXIT FROM BFGS code FG_LNSRCH 0. 0.0290342383 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.540121555 *** contribution from regularisation: 0.00308020855 *** contribution from error: -0.543201745 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52905.4452 0.0290342383 14.4612961 EXIT FROM BFGS code FG_LNSRCH 0. 0.0290342383 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.540141642 *** contribution from regularisation: 0.00306010386 *** contribution from error: -0.543201745 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52907.4145 0.0290342383 14.5004902 EXIT FROM BFGS code FG_LNSRCH 0. 0.0290342383 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.540153265 *** contribution from regularisation: 0.00304849073 *** contribution from error: -0.543201745 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52908.552 0.0290342383 14.5299625 EXIT FROM BFGS code FG_LNSRCH 0. 0.0290342383 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.540153384 *** contribution from regularisation: 0.00304835499 *** contribution from error: -0.543201745 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52908.5653 0.0290342383 14.5594244 EXIT FROM BFGS code NEW_X -52908.5653 0.0290342383 14.5594244 ENTER BFGS code NEW_X -52908.5653 0.0290342383 14.5594244 EXIT FROM BFGS code CONVERGENC -52908.5653 0.0290342383 14.5594244 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 68.3293762 sigma out 15 active outputs RANK 2 NODE 3 --> 31.1151543 sigma out 15 active outputs RANK 3 NODE 2 --> 29.41469 sigma out 15 active outputs RANK 4 NODE 6 --> 27.4889927 sigma out 15 active outputs RANK 5 NODE 1 --> 27.0745964 sigma out 15 active outputs RANK 6 NODE 11 --> 20.4328556 sigma out 15 active outputs RANK 7 NODE 8 --> 17.9759884 sigma out 15 active outputs RANK 8 NODE 5 --> 16.389183 sigma out 15 active outputs RANK 9 NODE 7 --> 16.0780659 sigma out 15 active outputs RANK 10 NODE 10 --> 15.564949 sigma out 15 active outputs RANK 11 NODE 9 --> 14.0111179 sigma out 15 active outputs RANK 12 NODE 4 --> 13.6785173 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 61.4085617 sigma in 12act. ( 71.2715683 sig out 1act.) RANK 2 NODE 13 --> 50.683403 sigma in 12act. ( 51.119854 sig out 1act.) RANK 3 NODE 9 --> 29.1121807 sigma in 12act. ( 27.6845455 sig out 1act.) RANK 4 NODE 4 --> 22.5484314 sigma in 12act. ( 19.4187965 sig out 1act.) RANK 5 NODE 7 --> 21.8356743 sigma in 12act. ( 21.8445396 sig out 1act.) RANK 6 NODE 11 --> 21.741806 sigma in 12act. ( 21.8018074 sig out 1act.) RANK 7 NODE 15 --> 18.058773 sigma in 12act. ( 15.0894251 sig out 1act.) RANK 8 NODE 6 --> 16.0527248 sigma in 12act. ( 15.8021936 sig out 1act.) RANK 9 NODE 2 --> 12.5935068 sigma in 12act. ( 11.1693954 sig out 1act.) RANK 10 NODE 10 --> 12.0100994 sigma in 12act. ( 11.3820791 sig out 1act.) RANK 11 NODE 12 --> 10.1606302 sigma in 12act. ( 9.5002079 sig out 1act.) RANK 12 NODE 3 --> 9.49786568 sigma in 12act. ( 6.90847397 sig out 1act.) RANK 13 NODE 14 --> 9.45584488 sigma in 12act. ( 7.25081825 sig out 1act.) RANK 14 NODE 8 --> 7.14183235 sigma in 12act. ( 6.87699175 sig out 1act.) RANK 15 NODE 1 --> 4.31280613 sigma in 12act. ( 2.82967401 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 71.2715683 sigma out 1act.( 61.4085617 sig in 12act.) RANK 2 NODE 13 --> 51.119854 sigma out 1act.( 50.683403 sig in 12act.) RANK 3 NODE 9 --> 27.6845455 sigma out 1act.( 29.1121807 sig in 12act.) RANK 4 NODE 7 --> 21.8445396 sigma out 1act.( 21.8356743 sig in 12act.) RANK 5 NODE 11 --> 21.8018074 sigma out 1act.( 21.741806 sig in 12act.) RANK 6 NODE 4 --> 19.4187965 sigma out 1act.( 22.5484314 sig in 12act.) RANK 7 NODE 6 --> 15.8021936 sigma out 1act.( 16.0527248 sig in 12act.) RANK 8 NODE 15 --> 15.0894251 sigma out 1act.( 18.058773 sig in 12act.) RANK 9 NODE 10 --> 11.3820791 sigma out 1act.( 12.0100994 sig in 12act.) RANK 10 NODE 2 --> 11.1693954 sigma out 1act.( 12.5935068 sig in 12act.) RANK 11 NODE 12 --> 9.5002079 sigma out 1act.( 10.1606302 sig in 12act.) RANK 12 NODE 14 --> 7.25081825 sigma out 1act.( 9.45584488 sig in 12act.) RANK 13 NODE 3 --> 6.90847397 sigma out 1act.( 9.49786568 sig in 12act.) RANK 14 NODE 8 --> 6.87699175 sigma out 1act.( 7.14183235 sig in 12act.) RANK 15 NODE 1 --> 2.82967401 sigma out 1act.( 4.31280613 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 103.761574 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.54014343 *** contribution from regularisation: 0.00305830035 *** contribution from error: -0.543201745 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done