NNInput NNInputs_145.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 196464 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 49529 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 49529 Chosen entries: 49529 Signal fraction: 1 Background fraction: 0.337081 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 49529 Entries to split: 49529 Test with : 24764 Train with : 24764 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 49529 for Signal Prepared event 0 for Signal with 49529 events ====Entry 0 Variable Ht : 172.917 Variable LepAPt : 28.3138 Variable LepBPt : 20.098 Variable MetSigLeptonsJets : 7.843 Variable MetSpec : 76.8658 Variable SumEtLeptonsJets : 96.051 Variable VSumJetLeptonsPt : 77.1984 Variable addEt : 125.278 Variable dPhiLepSumMet : 2.50109 Variable dPhiLeptons : 0.378813 Variable dRLeptons : 0.471432 Variable lep1_E : 39.4547 Variable lep2_E : 23.5705 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2145 Ht = 172.917 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 28.314 LepAPt = 28.3138 LepBEt = 20.098 LepBPt = 20.098 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 76.8658 MetDelPhi = 2.27916 MetSig = 5.37355 MetSigLeptonsJets = 7.843 MetSpec = 76.8658 Mjj = 0 MostCentralJetEta = 1.79326 MtllMet = 134.112 Njets = 1 SB = 0 SumEt = 204.618 SumEtJets = 0 SumEtLeptonsJets = 96.051 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 77.1984 addEt = 125.278 dPhiLepSumMet = 2.50109 dPhiLeptons = 0.378813 dRLeptons = 0.471432 diltype = 49 dimass = 11.2172 event = 188 jet1_Et = 47.6392 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 39.4547 lep2_E = 23.5705 rand = 0.999742 run = 236503 weight = 3.13807e-06 ===Show End Prepared event 10000 for Signal with 49529 events Prepared event 20000 for Signal with 49529 events Prepared event 30000 for Signal with 49529 events Prepared event 40000 for Signal with 49529 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.262424 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4556 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 196464 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4556 negative weights. Signal fraction: 62.7939949 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 48.8991051 62.1404266 64.4274597 66.4857483 67.8721008 68.8372955 69.8616943 70.7005463 71.4575195 72.2876511 73.0738678 73.7362518 74.3867874 75.0122223 75.5853729 76.248642 76.8839264 77.4116364 78.010788 78.5834045 79.2755508 79.7314758 80.3564911 81.0159149 81.6541138 82.3056793 83.0687103 83.9126892 84.9502716 85.9329376 86.8814468 87.9797363 88.970459 90.3078766 91.6167755 92.955246 94.3724518 95.6049271 96.7238617 98.1489029 99.596077 100.983757 102.194977 103.455276 104.847572 106.119171 107.41716 108.751053 110.134926 111.36058 112.640305 113.869263 115.229935 116.684898 117.940773 119.289246 120.567062 121.720543 122.876862 124.118393 125.345253 126.567894 127.887444 129.144333 130.526962 131.871613 133.105835 134.322388 135.694153 137.040253 138.450012 139.763733 141.256195 142.701324 144.231506 145.879272 147.656769 149.555939 151.789917 154.056885 156.321503 158.669327 160.865341 163.476578 166.054199 168.781586 171.542847 174.669037 178.042282 181.84964 185.8116 190.766907 195.807343 201.658875 208.4375 216.215912 227.117905 240.097443 260.522156 293.273926 820.901062 ------------------------------ Transdef: Tab for variable 3 20.0001068 20.2670612 20.5863228 20.8261223 21.0579834 21.3156853 21.5347977 21.7740173 21.9852448 22.1781807 22.3769722 22.5725021 22.7732201 22.9791241 23.1997795 23.3877182 23.5961437 23.7602825 23.9473953 24.1531181 24.341423 24.5327415 24.7175446 24.9155998 25.1240902 25.3025951 25.4613285 25.6062546 25.7880917 25.9729118 26.1724987 26.3671494 26.5622025 26.7624054 26.9600601 27.1316986 27.3203354 27.5524254 27.7464409 27.943203 28.1350899 28.3281441 28.5599403 28.7979622 29.0063057 29.2103996 29.4082813 29.6714706 29.8957291 30.1266594 30.3762283 30.6216812 30.8705482 31.1068878 31.405304 31.6587276 31.9276009 32.1734123 32.4212379 32.7072525 33.0172729 33.2921181 33.5871391 33.8794861 34.1738892 34.4632416 34.792984 35.0868187 35.4209366 35.7133026 36.0576019 36.3958435 36.7538147 37.0953674 37.4574547 37.8318253 38.2257233 38.6425133 39.0727997 39.4562683 39.9204483 40.3880539 40.9009018 41.4238129 41.9798355 42.6013527 43.1972122 43.8681221 44.5586014 45.3302994 46.1566162 47.0780716 48.1242065 49.3542099 50.7455292 52.4003143 54.5568619 57.4225693 61.2511101 69.5852356 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1169815 10.2252836 10.353405 10.4544868 10.5517111 10.6771774 10.7919941 10.9054308 11.0220661 11.1453285 11.2790337 11.3877468 11.499815 11.6254568 11.7482967 11.9046307 12.0386534 12.1907806 12.3161583 12.4631605 12.6126308 12.7668972 12.9143562 13.0799103 13.2343512 13.404211 13.5644703 13.6968575 13.8799057 14.0475445 14.2080498 14.3394146 14.4986973 14.6840115 14.8613682 15.0452032 15.237421 15.4085617 15.5651436 15.7574997 15.9472485 16.1520576 16.3464737 16.5476379 16.7588787 16.9546661 17.1897888 17.4270973 17.6868553 17.92659 18.1638069 18.4015274 18.6055756 18.8234825 19.051651 19.2930183 19.5273247 19.8016586 20.0400925 20.2452316 20.4712067 20.7005386 20.9753494 21.245945 21.4596939 21.7135315 21.9469261 22.2214165 22.4980125 22.7325001 23.0125046 23.2689743 23.5514908 23.8460598 24.130394 24.4713211 24.7640934 25.0916386 25.4159889 25.7520103 26.0931969 26.4301071 26.800457 27.1872215 27.5688515 27.978857 28.3976746 28.8390732 29.3171024 29.8189812 30.37113 31.0326424 31.6532555 32.3441238 33.2124405 34.3855743 35.8624268 38.170536 42.1741409 69.9040909 ------------------------------ Transdef: Tab for variable 5 1.04660308 2.49359512 2.89525032 3.16300416 3.3826499 3.59975123 3.77919912 3.94027948 4.07869434 4.1868124 4.30297613 4.40264034 4.50155735 4.59236383 4.66861391 4.75973511 4.83766842 4.92113733 4.99928808 5.06500864 5.13354492 5.19711208 5.25999451 5.31763315 5.37451458 5.42840528 5.483706 5.53298235 5.57704592 5.62699318 5.66952991 5.71504307 5.76854801 5.81294203 5.85245657 5.89559078 5.93541431 5.98114395 6.01678371 6.06085634 6.09569311 6.13849926 6.18180752 6.21899796 6.26145935 6.29580021 6.33101082 6.37202549 6.42236471 6.45815659 6.50598145 6.54975605 6.60166645 6.64943027 6.69004726 6.72961712 6.77555656 6.82151079 6.86021233 6.90075493 6.94360733 6.9897933 7.04254198 7.09004688 7.13862419 7.18439388 7.23038578 7.28102493 7.32472992 7.37632465 7.41934156 7.46712303 7.52261829 7.57792473 7.63081264 7.68993568 7.74654675 7.80347157 7.86493587 7.92279339 7.98010397 8.04547119 8.10580444 8.16919327 8.23912239 8.29839325 8.37277603 8.44961357 8.528965 8.60898781 8.7083683 8.79755592 8.91098118 9.03877544 9.18141651 9.35684204 9.56619835 9.84872627 10.2488708 10.9930496 22.6250648 ------------------------------ Transdef: Tab for variable 6 15.0065842 19.2273788 23.427412 25.4960823 26.4755688 27.2927475 28.0975189 28.9276962 29.6399269 30.3259544 30.9229813 31.4725151 32.0220718 32.5172272 32.9677544 33.3921089 33.8252449 34.3087692 34.71315 35.0700493 35.5029984 35.8823509 36.2128983 36.5119629 36.8533287 37.2156601 37.5596504 37.830513 38.1517487 38.5006485 38.8409538 39.1823349 39.5408249 39.9061737 40.2651482 40.5993805 40.9471359 41.3284302 41.7435455 42.1684227 42.5483475 42.9394608 43.2875671 43.7331314 44.1502609 44.5656586 45.1443367 45.7527542 46.3435669 46.8876343 47.432579 47.9565353 48.4726715 49.1083298 49.6809082 50.225193 50.7100143 51.2657394 51.9155884 52.5856247 53.2656021 53.9200439 54.5274925 55.2510109 55.9599762 56.593277 57.2091446 57.8267517 58.4039307 59.0901794 59.8068008 60.4391174 61.1377144 61.7930222 62.4715614 63.1774139 63.8087807 64.4628906 65.1938782 65.9059219 66.6508789 67.401535 68.1770096 68.9621429 69.7761688 70.6161957 71.521759 72.4776764 73.5235825 74.6841888 76.0662994 77.4636154 78.9427338 80.8912354 83.3417435 86.1104889 89.6675415 94.6725769 101.481461 112.777435 259.076752 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.5471191 33.4065781 34.0940628 34.6575851 35.2437935 35.6236725 36.0683632 36.4159851 36.8356552 37.1578865 37.4882431 37.7674103 38.1362839 38.4070969 38.6768646 38.9301605 39.1955032 39.4554977 39.714489 40.0543175 40.4020767 40.7410355 41.0583649 41.3924408 41.7177658 42.0633698 42.4460716 42.9143143 43.5083275 44.1293945 44.7790833 45.3203201 45.9877052 46.7165298 47.5396042 48.2488174 49.0235863 49.8893318 50.7193832 51.648613 52.5238914 53.3981285 54.1416931 55.0341568 55.7661705 56.4499321 57.257019 57.9961014 58.7030182 59.3095245 60.0221176 60.7448807 61.5197563 62.2158813 62.9677582 63.70681 64.4732971 65.2277756 66.0344543 66.8253326 67.6494522 68.4684525 69.3671265 70.2569427 71.1430588 72.1507874 73.2766876 74.4437103 75.5781555 76.8651276 78.2384491 79.6119843 81.0855637 82.5559082 84.0929108 85.6612091 87.321785 89.018959 90.9682541 92.8837585 94.7858276 96.7702332 98.8727112 101.035362 103.431107 105.819466 108.597534 111.47728 114.763641 118.235992 122.249603 126.493484 131.338028 137.253174 143.907745 152.297485 163.013916 178.459656 207.484329 467.62793 ------------------------------ Transdef: Tab for variable 8 0.609116197 22.4167557 27.4855423 29.9015961 31.3057709 32.0634613 32.7131538 33.1947708 33.6291351 34.0504837 34.4393387 34.8626785 35.1861839 35.4930611 35.8022385 36.0757484 36.3497429 36.6093063 36.899826 37.1788025 37.413784 37.6690369 37.9012527 38.1686058 38.4534531 38.6843185 38.8854523 39.1256714 39.361969 39.6267776 39.939888 40.2006912 40.4627762 40.7678299 41.0661469 41.3445511 41.6781387 41.9932785 42.3596115 42.8499985 43.2515831 43.6942368 44.1617203 44.6626816 45.1229706 45.5771103 46.0887756 46.649498 47.1380615 47.7142715 48.2883415 48.7952423 49.327095 49.8438187 50.4068069 51.0023575 51.59375 52.174202 52.7578011 53.22155 53.7842865 54.3920441 54.9484444 55.5034828 56.1013565 56.6367874 57.2006378 57.838974 58.4015274 58.9728851 59.6039886 60.2317886 60.8696594 61.4536209 62.074192 62.707695 63.3534088 64.0609207 64.7247772 65.4126968 66.1403809 66.8665466 67.6037292 68.3542328 69.1743774 69.9828644 70.9231491 71.9219208 72.9791412 74.2097168 75.5237274 77.1412582 78.8508301 81.1089478 83.5752029 86.62397 90.5895996 95.6087799 103.024414 115.913757 346.391968 ------------------------------ Transdef: Tab for variable 9 48.7045631 61.4196625 63.6646423 65.5551758 67.0928192 68.0469894 68.8892517 69.8445969 70.5041199 71.2012939 71.8043213 72.6138763 73.2793961 73.8216476 74.4042053 74.9614716 75.4596939 75.936882 76.4865112 77.0263519 77.5383911 78.0524826 78.5003357 79.1107178 79.5275574 79.964035 80.547287 81.083374 81.5802155 82.1891479 82.6776428 83.3685913 84.0390625 84.7947235 85.5081482 86.27005 87.0416718 87.9542694 88.7759857 89.6869583 90.6104279 91.6167755 92.638504 93.7206802 94.8624725 95.7746429 96.8486786 97.9415436 99.0389099 100.258041 101.3554 102.333313 103.442993 104.584946 105.595795 106.654587 107.657928 108.787186 109.729622 110.803055 111.874237 112.875671 113.829346 114.873886 115.930374 116.93541 117.90976 118.90242 119.919449 120.901901 121.815155 122.742264 123.674652 124.66114 125.614067 126.657745 127.634857 128.562988 129.54715 130.462128 131.451904 132.474762 133.444305 134.437561 135.482544 136.566071 137.673477 138.880737 140.006927 141.331772 142.714203 144.153061 145.755814 147.542404 149.736938 152.476715 155.764282 160.625687 168.593048 185.257202 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00143814425 1.00949585 1.3006773 1.51704025 1.67977953 1.79367375 1.89226604 1.98000956 2.0554471 2.12377501 2.18633938 2.23579931 2.28244543 2.32697868 2.36368656 2.40469265 2.44010878 2.4744916 2.50751829 2.53793716 2.56425095 2.59126735 2.61507463 2.63676596 2.6595273 2.68102837 2.7015667 2.72102928 2.73715305 2.75521946 2.77212667 2.78636265 2.80137491 2.81521487 2.82742763 2.83988953 2.84988499 2.86069608 2.86919022 2.88035727 2.88960195 2.89816618 2.90804386 2.91649485 2.92454576 2.9334178 2.94063377 2.94805121 2.95413876 2.96086764 2.96724272 2.97382307 2.97919035 2.98435736 2.98958731 2.99457407 2.99991417 3.00582027 3.01045656 3.01529264 3.02044082 3.02494121 3.02883506 3.03283405 3.03663778 3.04041433 3.04429841 3.04796147 3.05236387 3.05614567 3.05933475 3.06278753 3.06598043 3.06946921 3.07284021 3.07543612 3.07861948 3.08184886 3.08481073 3.08774447 3.09112597 3.09436917 3.09674168 3.09950352 3.10196328 3.10445023 3.10702252 3.10980558 3.11280584 3.1152153 3.11758924 3.11996555 3.12253237 3.12504959 3.1272974 3.12928724 3.13181496 3.13402557 3.1363287 3.13899565 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00642991113 0.0118153244 0.0187778473 0.024392128 0.031529665 0.0394085646 0.0475566536 0.0558978319 0.0624992847 0.0697598457 0.0771172047 0.0840266347 0.0909012258 0.0978226662 0.105026603 0.111343443 0.11832726 0.125574112 0.132458806 0.139407218 0.14647603 0.153324306 0.160155892 0.16652143 0.172299862 0.178995907 0.185190424 0.19106853 0.196612835 0.201947868 0.206738889 0.212236851 0.216912344 0.221833289 0.227149367 0.231729209 0.236019254 0.241799951 0.247055113 0.252289057 0.257325828 0.262354851 0.268318504 0.274012744 0.27982673 0.28509593 0.29069221 0.29663384 0.301007986 0.306976557 0.312856823 0.318222284 0.324246645 0.330118656 0.335856676 0.341428041 0.347830892 0.353622079 0.359509826 0.365551561 0.371745467 0.377610207 0.384244919 0.390284777 0.396779865 0.402643919 0.408279985 0.414317489 0.420694768 0.426438808 0.432575822 0.439115882 0.446072161 0.451849818 0.458069205 0.464798093 0.472479999 0.478458285 0.486629009 0.495240629 0.503830671 0.511090398 0.518460274 0.527253509 0.536783218 0.546051741 0.556013823 0.568387508 0.57970798 0.592486024 0.607370198 0.623345375 0.639819145 0.66082859 0.678023338 0.701200485 0.727823198 0.775355875 0.827508211 1.14609814 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.209177881 0.218147069 0.225637272 0.233874738 0.240534514 0.247433543 0.254888117 0.261072904 0.268157959 0.274795771 0.281441927 0.288450778 0.294911623 0.301670134 0.308302313 0.315157235 0.321418405 0.327570975 0.333859861 0.34119314 0.34747833 0.353110969 0.359502167 0.365075707 0.370908767 0.376604676 0.382559657 0.388845831 0.394363403 0.399678171 0.404538929 0.408875883 0.412433594 0.415903389 0.419735789 0.423624933 0.427232385 0.431035221 0.434751511 0.438043296 0.441787183 0.445440114 0.449108273 0.453317881 0.457541972 0.461763203 0.465529174 0.469631016 0.473673463 0.477579147 0.48178646 0.485638976 0.489320636 0.493047535 0.49700141 0.500601292 0.504715562 0.509096026 0.513257444 0.518136978 0.522979379 0.527386963 0.532296002 0.537224412 0.542022169 0.547226965 0.552956939 0.558493078 0.562997937 0.567716181 0.573874295 0.579374433 0.585173249 0.591824234 0.596865892 0.603425622 0.60986191 0.616465092 0.62326324 0.630618215 0.637965977 0.646238804 0.654467463 0.66189003 0.671429873 0.679578781 0.688846469 0.699509859 0.710516453 0.722879469 0.734952807 0.748275161 0.761757791 0.77748847 0.794113576 0.81418395 0.837814689 0.865681052 0.904917002 1.17128432 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.4819336 22.2295551 22.7674446 23.3156242 23.8137589 24.3106232 24.7576027 25.1937027 25.5468159 25.8627949 26.1952705 26.5948334 26.982729 27.3168278 27.6950932 28.0081902 28.3089409 28.6043892 28.9051247 29.2352715 29.4889565 29.7708187 30.0825748 30.3287868 30.5908012 30.8869247 31.1314507 31.4576912 31.7573872 32.0591354 32.3645706 32.6579666 32.9661102 33.2426147 33.5480385 33.8338394 34.1770477 34.5068283 34.8398857 35.1904678 35.4873428 35.8248901 36.1625519 36.4593201 36.8389549 37.1434631 37.5247498 37.8800354 38.2620888 38.6601562 39.0212059 39.4355698 39.7636337 40.1787758 40.5510025 40.9867706 41.3780289 41.8429108 42.2650986 42.7081528 43.1221008 43.5396194 43.9796333 44.4641724 44.9123497 45.4502602 45.9114342 46.4096527 46.8542938 47.3819923 47.9511337 48.5309334 49.1345215 49.7571182 50.4236374 51.0739021 51.8445892 52.552475 53.3694916 54.1836357 55.0739059 55.9684448 56.8764572 57.9772797 59.0910873 60.2561111 61.4867096 62.7673264 64.4460907 66.2742615 68.2011719 70.1929626 72.7185135 75.594696 78.4996567 82.3484802 87.5502014 92.8627472 102.035492 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0034533 10.7241497 11.0621624 11.3899021 11.6665802 11.9551029 12.2701674 12.5353804 12.8338995 13.1331549 13.4248676 13.7105074 13.9976177 14.2451286 14.4935799 14.7329302 15.0103912 15.2560873 15.5243931 15.7983971 16.0736675 16.3379059 16.6151066 16.849369 17.0550385 17.3536148 17.5851841 17.8320961 18.0976791 18.3661003 18.6335087 18.8578224 19.0808849 19.3144913 19.5644379 19.8518982 20.1126022 20.3688908 20.6358185 20.9297638 21.1968956 21.4644794 21.7178917 21.9773846 22.2634277 22.5665627 22.8501682 23.124794 23.3605156 23.6144104 23.8524742 24.1256256 24.3868408 24.6566963 24.9359665 25.1973457 25.4709187 25.7380714 26.0113602 26.3099289 26.60709 26.915802 27.2186127 27.4938641 27.7577076 28.0591946 28.3691769 28.7262325 29.0648346 29.3806992 29.6850395 30.0664654 30.440609 30.8259544 31.2032776 31.5808334 31.9819145 32.4809113 32.8893585 33.3606071 33.790451 34.2564392 34.7369423 35.2417755 35.8026733 36.4210052 37.0705376 37.7233238 38.4426575 39.2080994 40.0311661 41.0679245 42.2013702 43.369072 44.7779236 46.6342316 48.8196182 51.4077034 55.5648651 62.4170532 117.500763 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 63.2 45.3 49.8 22.6 44.0 60.3 49.6 60.5 -29.1 -10.7 -23.5 10.0 20.7 2 63.2 100.0 64.5 58.0 27.6 64.5 94.1 69.7 90.5 -47.9 -18.7 -37.8 29.7 31.1 3 45.3 64.5 100.0 39.8 2.9 30.0 67.9 49.7 69.6 -17.8 -20.3 -41.1 63.0 20.6 4 49.8 58.0 39.8 100.0 10.9 33.3 58.5 48.0 63.8 -14.1 -23.5 -48.1 16.4 70.4 5 22.6 27.6 2.9 10.9 100.0 83.1 -1.1 53.7 52.9 26.8 -3.1 -4.3 -8.0 1.9 6 44.0 64.5 30.0 33.3 83.1 100.0 41.8 77.1 78.5 -4.9 -9.8 -19.4 7.2 15.3 7 60.3 94.1 67.9 58.5 -1.1 41.8 100.0 60.7 77.7 -55.9 -17.8 -37.5 34.6 33.1 8 49.6 69.7 49.7 48.0 53.7 77.1 60.7 100.0 80.6 -8.9 -17.0 -31.6 22.2 26.8 9 60.5 90.5 69.6 63.8 52.9 78.5 77.7 80.6 100.0 -21.6 -20.9 -42.4 33.9 36.6 10 -29.1 -47.9 -17.8 -14.1 26.8 -4.9 -55.9 -8.9 -21.6 100.0 3.6 8.1 -6.1 -4.8 11 -10.7 -18.7 -20.3 -23.5 -3.1 -9.8 -17.8 -17.0 -20.9 3.6 100.0 54.1 -5.5 -12.8 12 -23.5 -37.8 -41.1 -48.1 -4.3 -19.4 -37.5 -31.6 -42.4 8.1 54.1 100.0 -14.5 -23.6 13 10.0 29.7 63.0 16.4 -8.0 7.2 34.6 22.2 33.9 -6.1 -5.5 -14.5 100.0 45.8 14 20.7 31.1 20.6 70.4 1.9 15.3 33.1 26.8 36.6 -4.8 -12.8 -23.6 45.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 150.916575 TOTAL CORRELATION OF ALL VARIABLES 70.0009146 ROUND 1: MAX CORR ( 69.9934536) AFTER KILLING INPUT VARIABLE 11 CONTR 1.02200639 ROUND 2: MAX CORR ( 69.9855522) AFTER KILLING INPUT VARIABLE 6 CONTR 1.0516758 ROUND 3: MAX CORR ( 69.9350413) AFTER KILLING INPUT VARIABLE 8 CONTR 2.65848115 ROUND 4: MAX CORR ( 69.8257639) AFTER KILLING INPUT VARIABLE 14 CONTR 3.90802915 ROUND 5: MAX CORR ( 69.698618) AFTER KILLING INPUT VARIABLE 2 CONTR 4.2118824 ROUND 6: MAX CORR ( 69.2714906) AFTER KILLING INPUT VARIABLE 10 CONTR 7.70441091 ROUND 7: MAX CORR ( 68.7969129) AFTER KILLING INPUT VARIABLE 12 CONTR 8.09470105 ROUND 8: MAX CORR ( 68.099023) AFTER KILLING INPUT VARIABLE 9 CONTR 9.77436875 ROUND 9: MAX CORR ( 66.9467141) AFTER KILLING INPUT VARIABLE 3 CONTR 12.4745507 ROUND 10: MAX CORR ( 66.3179651) AFTER KILLING INPUT VARIABLE 13 CONTR 9.15368948 ROUND 11: MAX CORR ( 64.6448185) AFTER KILLING INPUT VARIABLE 4 CONTR 14.8027001 ROUND 12: MAX CORR ( 60.3193448) AFTER KILLING INPUT VARIABLE 5 CONTR 23.249284 LAST REMAINING VARIABLE: 7 total correlation to target: 70.0009146 % total significance: 139.573108 sigma correlations of single variables to target: variable 2: 63.1539213 % , in sigma: 125.921056 variable 3: 45.2942159 % , in sigma: 90.3110272 variable 4: 49.8297701 % , in sigma: 99.3543574 variable 5: 22.6031177 % , in sigma: 45.0678025 variable 6: 44.0340251 % , in sigma: 87.7983635 variable 7: 60.3193448 % , in sigma: 120.269263 variable 8: 49.645663 % , in sigma: 98.9872708 variable 9: 60.5027122 % , in sigma: 120.634875 variable 10: -29.0829184 % , in sigma: 57.9877182 variable 11: -10.6611542 % , in sigma: 21.257014 variable 12: -23.5340358 % , in sigma: 46.9239373 variable 13: 9.97243162 % , in sigma: 19.883787 variable 14: 20.6508233 % , in sigma: 41.1751706 variables sorted by significance: 1 most relevant variable 7 corr 60.3193436 , in sigma: 120.269261 2 most relevant variable 5 corr 23.2492847 , in sigma: 46.3561791 3 most relevant variable 4 corr 14.8027 , in sigma: 29.5147409 4 most relevant variable 13 corr 9.15368938 , in sigma: 18.2513169 5 most relevant variable 3 corr 12.4745502 , in sigma: 24.8727 6 most relevant variable 9 corr 9.77436829 , in sigma: 19.4888734 7 most relevant variable 12 corr 8.09470081 , in sigma: 16.1398256 8 most relevant variable 10 corr 7.70441103 , in sigma: 15.3616363 9 most relevant variable 2 corr 4.21188259 , in sigma: 8.39796948 10 most relevant variable 14 corr 3.90802908 , in sigma: 7.79212341 11 most relevant variable 8 corr 2.65848112 , in sigma: 5.30068036 12 most relevant variable 6 corr 1.0516758 , in sigma: 2.0969106 13 most relevant variable 11 corr 1.02200639 , in sigma: 2.0377535 global correlations between input variables: variable 2: 99.1471788 % variable 3: 92.644217 % variable 4: 91.3615357 % variable 5: 95.3936033 % variable 6: 94.8643763 % variable 7: 98.70818 % variable 8: 88.2606774 % variable 9: 98.7690167 % variable 10: 72.4534099 % variable 11: 54.8420288 % variable 12: 69.0350239 % variable 13: 84.886423 % variable 14: 87.4622552 % significance loss when removing single variables: variable 2: corr = 5.00795787 % , sigma = 9.98524447 variable 3: corr = 15.5073606 % , sigma = 30.9197463 variable 4: corr = 17.3186032 % , sigma = 34.5311385 variable 5: corr = 12.8023282 % , sigma = 25.5262484 variable 6: corr = 1.08373172 % , sigma = 2.16082612 variable 7: corr = 4.17763766 % , sigma = 8.32968935 variable 8: corr = 2.91150846 % , sigma = 5.80518538 variable 9: corr = 10.2157769 % , sigma = 20.3689872 variable 10: corr = 6.91341021 % , sigma = 13.7844792 variable 11: corr = 1.02200639 % , sigma = 2.0377535 variable 12: corr = 7.05028803 % , sigma = 14.0573965 variable 13: corr = 7.6313337 % , sigma = 15.2159292 variable 14: corr = 3.83076289 % , sigma = 7.63806425 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 21.4985542 sigma out 15 active outputs RANK 2 NODE 12 --> 21.4921608 sigma out 15 active outputs RANK 3 NODE 5 --> 21.3969517 sigma out 15 active outputs RANK 4 NODE 7 --> 17.1402493 sigma out 15 active outputs RANK 5 NODE 11 --> 17.090538 sigma out 15 active outputs RANK 6 NODE 1 --> 12.4135799 sigma out 15 active outputs RANK 7 NODE 10 --> 12.2353344 sigma out 15 active outputs RANK 8 NODE 6 --> 9.81039619 sigma out 15 active outputs RANK 9 NODE 4 --> 9.4731493 sigma out 15 active outputs RANK 10 NODE 8 --> 8.99370956 sigma out 15 active outputs RANK 11 NODE 9 --> 8.84340858 sigma out 15 active outputs RANK 12 NODE 3 --> 8.0973196 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 36.7551498 sigma in 12act. ( 33.3788834 sig out 1act.) RANK 2 NODE 4 --> 26.8833179 sigma in 12act. ( 28.4874706 sig out 1act.) RANK 3 NODE 15 --> 13.4956779 sigma in 12act. ( 13.592309 sig out 1act.) RANK 4 NODE 14 --> 10.8849869 sigma in 12act. ( 10.9621105 sig out 1act.) RANK 5 NODE 10 --> 10.6400681 sigma in 12act. ( 16.8882179 sig out 1act.) RANK 6 NODE 13 --> 8.8323946 sigma in 12act. ( 9.83181 sig out 1act.) RANK 7 NODE 3 --> 7.19491005 sigma in 12act. ( 6.33097458 sig out 1act.) RANK 8 NODE 7 --> 4.12878323 sigma in 12act. ( 1.25472987 sig out 1act.) RANK 9 NODE 12 --> 3.71048856 sigma in 12act. ( 3.90671873 sig out 1act.) RANK 10 NODE 6 --> 3.63365436 sigma in 12act. ( 3.44495058 sig out 1act.) RANK 11 NODE 8 --> 3.41676974 sigma in 12act. ( 4.09932709 sig out 1act.) RANK 12 NODE 11 --> 1.93663371 sigma in 12act. ( 2.60505366 sig out 1act.) RANK 13 NODE 2 --> 1.60365283 sigma in 12act. ( 1.93403733 sig out 1act.) RANK 14 NODE 9 --> 1.45738602 sigma in 12act. ( 2.38275909 sig out 1act.) RANK 15 NODE 5 --> 0.922806323 sigma in 12act. ( 0.599468529 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 33.3788834 sigma out 1act.( 36.7551498 sig in 12act.) RANK 2 NODE 4 --> 28.4874706 sigma out 1act.( 26.8833179 sig in 12act.) RANK 3 NODE 10 --> 16.8882179 sigma out 1act.( 10.6400681 sig in 12act.) RANK 4 NODE 15 --> 13.592309 sigma out 1act.( 13.4956779 sig in 12act.) RANK 5 NODE 14 --> 10.9621105 sigma out 1act.( 10.8849869 sig in 12act.) RANK 6 NODE 13 --> 9.83181 sigma out 1act.( 8.8323946 sig in 12act.) RANK 7 NODE 3 --> 6.33097458 sigma out 1act.( 7.19491005 sig in 12act.) RANK 8 NODE 8 --> 4.09932709 sigma out 1act.( 3.41676974 sig in 12act.) RANK 9 NODE 12 --> 3.90671873 sigma out 1act.( 3.71048856 sig in 12act.) RANK 10 NODE 6 --> 3.44495058 sigma out 1act.( 3.63365436 sig in 12act.) RANK 11 NODE 11 --> 2.60505366 sigma out 1act.( 1.93663371 sig in 12act.) RANK 12 NODE 9 --> 2.38275909 sigma out 1act.( 1.45738602 sig in 12act.) RANK 13 NODE 2 --> 1.93403733 sigma out 1act.( 1.60365283 sig in 12act.) RANK 14 NODE 7 --> 1.25472987 sigma out 1act.( 4.12878323 sig in 12act.) RANK 15 NODE 5 --> 0.599468529 sigma out 1act.( 0.922806323 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.1021614 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 28.400959 sigma out 15 active outputs RANK 2 NODE 5 --> 18.4339466 sigma out 15 active outputs RANK 3 NODE 12 --> 17.9901466 sigma out 15 active outputs RANK 4 NODE 7 --> 17.6545258 sigma out 15 active outputs RANK 5 NODE 11 --> 17.4498844 sigma out 15 active outputs RANK 6 NODE 1 --> 13.8652382 sigma out 15 active outputs RANK 7 NODE 6 --> 12.7722616 sigma out 15 active outputs RANK 8 NODE 10 --> 12.2725954 sigma out 15 active outputs RANK 9 NODE 9 --> 11.079052 sigma out 15 active outputs RANK 10 NODE 8 --> 10.6226444 sigma out 15 active outputs RANK 11 NODE 4 --> 9.38631535 sigma out 15 active outputs RANK 12 NODE 3 --> 9.15684795 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 28.2656136 sigma in 12act. ( 28.8224392 sig out 1act.) RANK 2 NODE 4 --> 25.2110558 sigma in 12act. ( 26.0463161 sig out 1act.) RANK 3 NODE 10 --> 19.1194153 sigma in 12act. ( 17.2387543 sig out 1act.) RANK 4 NODE 15 --> 13.7554188 sigma in 12act. ( 12.7381811 sig out 1act.) RANK 5 NODE 14 --> 12.3437614 sigma in 12act. ( 11.0203648 sig out 1act.) RANK 6 NODE 9 --> 12.2043428 sigma in 12act. ( 5.70275593 sig out 1act.) RANK 7 NODE 13 --> 11.3181372 sigma in 12act. ( 10.6062717 sig out 1act.) RANK 8 NODE 11 --> 9.82367611 sigma in 12act. ( 4.96602345 sig out 1act.) RANK 9 NODE 2 --> 9.38205147 sigma in 12act. ( 4.37697077 sig out 1act.) RANK 10 NODE 3 --> 8.98469734 sigma in 12act. ( 5.83363008 sig out 1act.) RANK 11 NODE 6 --> 8.59924698 sigma in 12act. ( 3.79801273 sig out 1act.) RANK 12 NODE 5 --> 8.4470911 sigma in 12act. ( 1.89198232 sig out 1act.) RANK 13 NODE 12 --> 8.3340416 sigma in 12act. ( 4.45042467 sig out 1act.) RANK 14 NODE 8 --> 7.84659529 sigma in 12act. ( 5.1876297 sig out 1act.) RANK 15 NODE 7 --> 6.28341722 sigma in 12act. ( 0.669623494 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 28.8224392 sigma out 1act.( 28.2656136 sig in 12act.) RANK 2 NODE 4 --> 26.0463161 sigma out 1act.( 25.2110558 sig in 12act.) RANK 3 NODE 10 --> 17.2387543 sigma out 1act.( 19.1194153 sig in 12act.) RANK 4 NODE 15 --> 12.7381811 sigma out 1act.( 13.7554188 sig in 12act.) RANK 5 NODE 14 --> 11.0203648 sigma out 1act.( 12.3437614 sig in 12act.) RANK 6 NODE 13 --> 10.6062717 sigma out 1act.( 11.3181372 sig in 12act.) RANK 7 NODE 3 --> 5.83363008 sigma out 1act.( 8.98469734 sig in 12act.) RANK 8 NODE 9 --> 5.70275593 sigma out 1act.( 12.2043428 sig in 12act.) RANK 9 NODE 8 --> 5.1876297 sigma out 1act.( 7.84659529 sig in 12act.) RANK 10 NODE 11 --> 4.96602345 sigma out 1act.( 9.82367611 sig in 12act.) RANK 11 NODE 12 --> 4.45042467 sigma out 1act.( 8.3340416 sig in 12act.) RANK 12 NODE 2 --> 4.37697077 sigma out 1act.( 9.38205147 sig in 12act.) RANK 13 NODE 6 --> 3.79801273 sigma out 1act.( 8.59924698 sig in 12act.) RANK 14 NODE 5 --> 1.89198232 sigma out 1act.( 8.4470911 sig in 12act.) RANK 15 NODE 7 --> 0.669623494 sigma out 1act.( 6.28341722 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 48.7653961 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.420538574 *** contribution from regularisation: 0.00493773073 *** contribution from error: -0.425476313 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.477738142 *** contribution from regularisation: 0.00206096401 *** contribution from error: -0.479799092 *********************************************** -----------------> Test sample ENTER BFGS code START -46938.9957 -0.20382975 -0.0954122916 EXIT FROM BFGS code FG_START 0. -0.20382975 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.497535497 *** contribution from regularisation: 0.00214580656 *** contribution from error: -0.499681294 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48873.9066 -0.20382975 -120.48468 EXIT FROM BFGS code FG_LNSRCH 0. -0.219240963 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.5411973 *** contribution from regularisation: 0.0029549601 *** contribution from error: -0.54415226 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53162.8933 -0.219240963 -156.261368 EXIT FROM BFGS code NEW_X -53162.8933 -0.219240963 -156.261368 ENTER BFGS code NEW_X -53162.8933 -0.219240963 -156.261368 EXIT FROM BFGS code FG_LNSRCH 0. -0.238911629 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.543740809 *** contribution from regularisation: 0.0030320459 *** contribution from error: -0.546772838 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53412.7489 -0.238911629 -101.852654 EXIT FROM BFGS code NEW_X -53412.7489 -0.238911629 -101.852654 ENTER BFGS code NEW_X -53412.7489 -0.238911629 -101.852654 EXIT FROM BFGS code FG_LNSRCH 0. -0.28004691 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.547368169 *** contribution from regularisation: 0.00305502419 *** contribution from error: -0.550423205 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53769.0695 -0.28004691 -38.3506432 EXIT FROM BFGS code NEW_X -53769.0695 -0.28004691 -38.3506432 ENTER BFGS code NEW_X -53769.0695 -0.28004691 -38.3506432 EXIT FROM BFGS code FG_LNSRCH 0. -0.315588325 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.54838419 *** contribution from regularisation: 0.00298384251 *** contribution from error: -0.551368058 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53868.8781 -0.315588325 26.4775105 EXIT FROM BFGS code NEW_X -53868.8781 -0.315588325 26.4775105 ENTER BFGS code NEW_X -53868.8781 -0.315588325 26.4775105 EXIT FROM BFGS code FG_LNSRCH 0. -0.307998598 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.548766792 *** contribution from regularisation: 0.00294004264 *** contribution from error: -0.551706851 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53906.4616 -0.307998598 22.1503887 EXIT FROM BFGS code NEW_X -53906.4616 -0.307998598 22.1503887 ENTER BFGS code NEW_X -53906.4616 -0.307998598 22.1503887 EXIT FROM BFGS code FG_LNSRCH 0. -0.286907375 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.549368262 *** contribution from regularisation: 0.00289975456 *** contribution from error: -0.552268028 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53965.5441 -0.286907375 2.41530824 EXIT FROM BFGS code NEW_X -53965.5441 -0.286907375 2.41530824 ENTER BFGS code NEW_X -53965.5441 -0.286907375 2.41530824 EXIT FROM BFGS code FG_LNSRCH 0. -0.248531967 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 41.3325691 sigma out 15 active outputs RANK 2 NODE 1 --> 22.2755814 sigma out 15 active outputs RANK 3 NODE 5 --> 15.8074436 sigma out 15 active outputs RANK 4 NODE 11 --> 14.5127268 sigma out 15 active outputs RANK 5 NODE 10 --> 12.8813047 sigma out 15 active outputs RANK 6 NODE 3 --> 12.8394222 sigma out 15 active outputs RANK 7 NODE 9 --> 11.6396484 sigma out 15 active outputs RANK 8 NODE 12 --> 10.5449867 sigma out 15 active outputs RANK 9 NODE 6 --> 10.2303543 sigma out 15 active outputs RANK 10 NODE 7 --> 9.10420132 sigma out 15 active outputs RANK 11 NODE 8 --> 6.07361889 sigma out 15 active outputs RANK 12 NODE 4 --> 4.74767876 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 34.958416 sigma in 12act. ( 36.293663 sig out 1act.) RANK 2 NODE 10 --> 23.1884537 sigma in 12act. ( 21.0975437 sig out 1act.) RANK 3 NODE 11 --> 19.1533794 sigma in 12act. ( 13.7975359 sig out 1act.) RANK 4 NODE 2 --> 17.8674183 sigma in 12act. ( 16.4750214 sig out 1act.) RANK 5 NODE 12 --> 14.5986691 sigma in 12act. ( 12.6378117 sig out 1act.) RANK 6 NODE 5 --> 13.6432695 sigma in 12act. ( 10.8760843 sig out 1act.) RANK 7 NODE 6 --> 13.1690426 sigma in 12act. ( 11.8990078 sig out 1act.) RANK 8 NODE 14 --> 10.6091156 sigma in 12act. ( 9.91842175 sig out 1act.) RANK 9 NODE 1 --> 9.46167564 sigma in 12act. ( 9.11776543 sig out 1act.) RANK 10 NODE 4 --> 8.65393066 sigma in 12act. ( 7.891325 sig out 1act.) RANK 11 NODE 8 --> 8.26069832 sigma in 12act. ( 5.96034431 sig out 1act.) RANK 12 NODE 13 --> 7.27274799 sigma in 12act. ( 5.07274199 sig out 1act.) RANK 13 NODE 3 --> 6.2864728 sigma in 12act. ( 4.74437571 sig out 1act.) RANK 14 NODE 7 --> 4.41504955 sigma in 12act. ( 2.83316207 sig out 1act.) RANK 15 NODE 15 --> 3.7179234 sigma in 12act. ( 0.632504284 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 36.293663 sigma out 1act.( 34.958416 sig in 12act.) RANK 2 NODE 10 --> 21.0975437 sigma out 1act.( 23.1884537 sig in 12act.) RANK 3 NODE 2 --> 16.4750214 sigma out 1act.( 17.8674183 sig in 12act.) RANK 4 NODE 11 --> 13.7975359 sigma out 1act.( 19.1533794 sig in 12act.) RANK 5 NODE 12 --> 12.6378117 sigma out 1act.( 14.5986691 sig in 12act.) RANK 6 NODE 6 --> 11.8990078 sigma out 1act.( 13.1690426 sig in 12act.) RANK 7 NODE 5 --> 10.8760843 sigma out 1act.( 13.6432695 sig in 12act.) RANK 8 NODE 14 --> 9.91842175 sigma out 1act.( 10.6091156 sig in 12act.) RANK 9 NODE 1 --> 9.11776543 sigma out 1act.( 9.46167564 sig in 12act.) RANK 10 NODE 4 --> 7.891325 sigma out 1act.( 8.65393066 sig in 12act.) RANK 11 NODE 8 --> 5.96034431 sigma out 1act.( 8.26069832 sig in 12act.) RANK 12 NODE 13 --> 5.07274199 sigma out 1act.( 7.27274799 sig in 12act.) RANK 13 NODE 3 --> 4.74437571 sigma out 1act.( 6.2864728 sig in 12act.) RANK 14 NODE 7 --> 2.83316207 sigma out 1act.( 4.41504955 sig in 12act.) RANK 15 NODE 15 --> 0.632504284 sigma out 1act.( 3.7179234 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.5866356 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.550415516 *** contribution from regularisation: 0.00290884823 *** contribution from error: -0.553324342 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54068.4165 -0.248531967 -16.7624073 EXIT FROM BFGS code NEW_X -54068.4165 -0.248531967 -16.7624073 ENTER BFGS code NEW_X -54068.4165 -0.248531967 -16.7624073 EXIT FROM BFGS code FG_LNSRCH 0. -0.203958258 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.551553607 *** contribution from regularisation: 0.00315340608 *** contribution from error: -0.554706991 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54180.2118 -0.203958258 -44.5118484 EXIT FROM BFGS code NEW_X -54180.2118 -0.203958258 -44.5118484 ENTER BFGS code NEW_X -54180.2118 -0.203958258 -44.5118484 EXIT FROM BFGS code FG_LNSRCH 0. -0.20074518 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.551983058 *** contribution from regularisation: 0.00342017552 *** contribution from error: -0.555403233 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54222.402 -0.20074518 -14.266511 EXIT FROM BFGS code NEW_X -54222.402 -0.20074518 -14.266511 ENTER BFGS code NEW_X -54222.402 -0.20074518 -14.266511 EXIT FROM BFGS code FG_LNSRCH 0. -0.223315939 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.552390873 *** contribution from regularisation: 0.00306347036 *** contribution from error: -0.555454373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54262.4625 -0.223315939 18.7067013 EXIT FROM BFGS code NEW_X -54262.4625 -0.223315939 18.7067013 ENTER BFGS code NEW_X -54262.4625 -0.223315939 18.7067013 EXIT FROM BFGS code FG_LNSRCH 0. -0.221431553 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.552375436 *** contribution from regularisation: 0.00319295935 *** contribution from error: -0.555568397 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54260.9427 -0.221431553 -7.63049841 EXIT FROM BFGS code FG_LNSRCH 0. -0.222879782 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.552217901 *** contribution from regularisation: 0.00327384192 *** contribution from error: -0.555491745 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54245.4708 -0.222879782 12.5035524 EXIT FROM BFGS code FG_LNSRCH 0. -0.223299906 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.552239001 *** contribution from regularisation: 0.00321687828 *** contribution from error: -0.555455863 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54247.5392 -0.223299906 18.2788467 EXIT FROM BFGS code FG_LNSRCH 0. -0.22331591 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.552243412 *** contribution from regularisation: 0.0032109695 *** contribution from error: -0.555454373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54247.9737 -0.22331591 18.4518967 EXIT FROM BFGS code FG_LNSRCH 0. -0.223315939 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.552229881 *** contribution from regularisation: 0.00322451419 *** contribution from error: -0.555454373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54246.6429 -0.223315939 18.3995228 EXIT FROM BFGS code FG_LNSRCH 0. -0.223315939 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.552225947 *** contribution from regularisation: 0.00322842249 *** contribution from error: -0.555454373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54246.259 -0.223315939 18.3177052 EXIT FROM BFGS code FG_LNSRCH 0. -0.223315939 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 47.3551826 sigma out 15 active outputs RANK 2 NODE 1 --> 25.0171871 sigma out 15 active outputs RANK 3 NODE 5 --> 24.7684155 sigma out 15 active outputs RANK 4 NODE 3 --> 19.6139545 sigma out 15 active outputs RANK 5 NODE 10 --> 17.407547 sigma out 15 active outputs RANK 6 NODE 11 --> 16.083992 sigma out 15 active outputs RANK 7 NODE 6 --> 13.345458 sigma out 15 active outputs RANK 8 NODE 12 --> 12.8043852 sigma out 15 active outputs RANK 9 NODE 9 --> 12.6234531 sigma out 15 active outputs RANK 10 NODE 7 --> 9.78812313 sigma out 15 active outputs RANK 11 NODE 8 --> 9.4732523 sigma out 15 active outputs RANK 12 NODE 4 --> 5.58896685 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 44.9925346 sigma in 12act. ( 49.507103 sig out 1act.) RANK 2 NODE 10 --> 31.6758423 sigma in 12act. ( 29.5100021 sig out 1act.) RANK 3 NODE 2 --> 19.3849525 sigma in 12act. ( 19.0211163 sig out 1act.) RANK 4 NODE 12 --> 19.343689 sigma in 12act. ( 18.0304852 sig out 1act.) RANK 5 NODE 11 --> 18.1252041 sigma in 12act. ( 13.1766987 sig out 1act.) RANK 6 NODE 6 --> 18.0422401 sigma in 12act. ( 19.0856457 sig out 1act.) RANK 7 NODE 5 --> 14.2546511 sigma in 12act. ( 11.3581972 sig out 1act.) RANK 8 NODE 14 --> 10.9971123 sigma in 12act. ( 9.90328693 sig out 1act.) RANK 9 NODE 1 --> 9.65047646 sigma in 12act. ( 9.68183708 sig out 1act.) RANK 10 NODE 8 --> 8.80387306 sigma in 12act. ( 6.63093948 sig out 1act.) RANK 11 NODE 4 --> 7.76653099 sigma in 12act. ( 6.02062368 sig out 1act.) RANK 12 NODE 3 --> 7.355618 sigma in 12act. ( 6.61515045 sig out 1act.) RANK 13 NODE 13 --> 6.69707489 sigma in 12act. ( 4.74407673 sig out 1act.) RANK 14 NODE 7 --> 5.57560253 sigma in 12act. ( 5.0585556 sig out 1act.) RANK 15 NODE 15 --> 5.44450521 sigma in 12act. ( 4.09537315 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 49.507103 sigma out 1act.( 44.9925346 sig in 12act.) RANK 2 NODE 10 --> 29.5100021 sigma out 1act.( 31.6758423 sig in 12act.) RANK 3 NODE 6 --> 19.0856457 sigma out 1act.( 18.0422401 sig in 12act.) RANK 4 NODE 2 --> 19.0211163 sigma out 1act.( 19.3849525 sig in 12act.) RANK 5 NODE 12 --> 18.0304852 sigma out 1act.( 19.343689 sig in 12act.) RANK 6 NODE 11 --> 13.1766987 sigma out 1act.( 18.1252041 sig in 12act.) RANK 7 NODE 5 --> 11.3581972 sigma out 1act.( 14.2546511 sig in 12act.) RANK 8 NODE 14 --> 9.90328693 sigma out 1act.( 10.9971123 sig in 12act.) RANK 9 NODE 1 --> 9.68183708 sigma out 1act.( 9.65047646 sig in 12act.) RANK 10 NODE 8 --> 6.63093948 sigma out 1act.( 8.80387306 sig in 12act.) RANK 11 NODE 3 --> 6.61515045 sigma out 1act.( 7.355618 sig in 12act.) RANK 12 NODE 4 --> 6.02062368 sigma out 1act.( 7.76653099 sig in 12act.) RANK 13 NODE 7 --> 5.0585556 sigma out 1act.( 5.57560253 sig in 12act.) RANK 14 NODE 13 --> 4.74407673 sigma out 1act.( 6.69707489 sig in 12act.) RANK 15 NODE 15 --> 4.09537315 sigma out 1act.( 5.44450521 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 71.1072998 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.552246749 *** contribution from regularisation: 0.00320759183 *** contribution from error: -0.555454314 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54248.3052 -0.223315939 18.3043308 EXIT FROM BFGS code NEW_X -54248.3052 -0.223315939 18.3043308 ENTER BFGS code NEW_X -54248.3052 -0.223315939 18.3043308 EXIT FROM BFGS code CONVERGENC -54248.3052 -0.223315939 18.3043308 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 71.2715836 sigma out 15 active outputs RANK 2 NODE 1 --> 38.3193016 sigma out 15 active outputs RANK 3 NODE 5 --> 37.1129456 sigma out 15 active outputs RANK 4 NODE 3 --> 30.3432846 sigma out 15 active outputs RANK 5 NODE 10 --> 25.8738594 sigma out 15 active outputs RANK 6 NODE 11 --> 23.7883472 sigma out 15 active outputs RANK 7 NODE 6 --> 19.8622971 sigma out 15 active outputs RANK 8 NODE 9 --> 19.1665745 sigma out 15 active outputs RANK 9 NODE 12 --> 19.0939713 sigma out 15 active outputs RANK 10 NODE 8 --> 14.6416101 sigma out 15 active outputs RANK 11 NODE 7 --> 13.8856316 sigma out 15 active outputs RANK 12 NODE 4 --> 8.39057446 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 69.1244888 sigma in 12act. ( 75.7636261 sig out 1act.) RANK 2 NODE 10 --> 48.4881325 sigma in 12act. ( 44.6188583 sig out 1act.) RANK 3 NODE 12 --> 29.0200539 sigma in 12act. ( 27.7682743 sig out 1act.) RANK 4 NODE 2 --> 28.664381 sigma in 12act. ( 28.7201862 sig out 1act.) RANK 5 NODE 6 --> 27.3499222 sigma in 12act. ( 28.7516079 sig out 1act.) RANK 6 NODE 11 --> 26.7845325 sigma in 12act. ( 20.1452732 sig out 1act.) RANK 7 NODE 5 --> 20.7973671 sigma in 12act. ( 16.9464722 sig out 1act.) RANK 8 NODE 14 --> 15.3476305 sigma in 12act. ( 15.2809305 sig out 1act.) RANK 9 NODE 1 --> 13.8203592 sigma in 12act. ( 14.6172915 sig out 1act.) RANK 10 NODE 8 --> 12.4386492 sigma in 12act. ( 10.1114416 sig out 1act.) RANK 11 NODE 3 --> 10.2719984 sigma in 12act. ( 10.2849789 sig out 1act.) RANK 12 NODE 4 --> 10.1628208 sigma in 12act. ( 9.22005653 sig out 1act.) RANK 13 NODE 13 --> 9.21621513 sigma in 12act. ( 7.26164532 sig out 1act.) RANK 14 NODE 7 --> 8.05779171 sigma in 12act. ( 7.76954174 sig out 1act.) RANK 15 NODE 15 --> 7.38062477 sigma in 12act. ( 6.13173342 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 75.7636261 sigma out 1act.( 69.1244888 sig in 12act.) RANK 2 NODE 10 --> 44.6188583 sigma out 1act.( 48.4881325 sig in 12act.) RANK 3 NODE 6 --> 28.7516079 sigma out 1act.( 27.3499222 sig in 12act.) RANK 4 NODE 2 --> 28.7201862 sigma out 1act.( 28.664381 sig in 12act.) RANK 5 NODE 12 --> 27.7682743 sigma out 1act.( 29.0200539 sig in 12act.) RANK 6 NODE 11 --> 20.1452732 sigma out 1act.( 26.7845325 sig in 12act.) RANK 7 NODE 5 --> 16.9464722 sigma out 1act.( 20.7973671 sig in 12act.) RANK 8 NODE 14 --> 15.2809305 sigma out 1act.( 15.3476305 sig in 12act.) RANK 9 NODE 1 --> 14.6172915 sigma out 1act.( 13.8203592 sig in 12act.) RANK 10 NODE 3 --> 10.2849789 sigma out 1act.( 10.2719984 sig in 12act.) RANK 11 NODE 8 --> 10.1114416 sigma out 1act.( 12.4386492 sig in 12act.) RANK 12 NODE 4 --> 9.22005653 sigma out 1act.( 10.1628208 sig in 12act.) RANK 13 NODE 7 --> 7.76954174 sigma out 1act.( 8.05779171 sig in 12act.) RANK 14 NODE 13 --> 7.26164532 sigma out 1act.( 9.21621513 sig in 12act.) RANK 15 NODE 15 --> 6.13173342 sigma out 1act.( 7.38062477 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 108.339584 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.552209795 *** contribution from regularisation: 0.00324457302 *** contribution from error: -0.555454373 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done