NNInput NNInputs_200.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 158851 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 22515 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 22515 Chosen entries: 22515 Signal fraction: 1 Background fraction: 0.165143 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 22515 Entries to split: 22515 Test with : 11257 Train with : 11257 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 22515 for Signal Prepared event 0 for Signal with 22515 events ====Entry 0 Variable Ht : 152.764 Variable LepAPt : 33.6093 Variable LepBPt : 15.3084 Variable MetSigLeptonsJets : 8.99012 Variable MetSpec : 77.8251 Variable SumEtLeptonsJets : 74.9391 Variable VSumJetLeptonsPt : 71.9347 Variable addEt : 126.743 Variable dPhiLepSumMet : 2.71571 Variable dPhiLeptons : 0.104355 Variable dRLeptons : 0.619509 Variable lep1_E : 34.354 Variable lep2_E : 20.7615 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2200 Ht = 152.764 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.6093 LepAPt = 33.6093 LepBEt = 15.3088 LepBPt = 15.3084 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 77.8251 MetDelPhi = 2.68307 MetSig = 6.17532 MetSigLeptonsJets = 8.99012 MetSpec = 77.8251 Mjj = 0 MostCentralJetEta = 0.104936 MtllMet = 131.249 Njets = 1 SB = 0 SumEt = 158.825 SumEtJets = 0 SumEtLeptonsJets = 74.9391 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 71.9347 addEt = 126.743 dPhiLepSumMet = 2.71571 dPhiLeptons = 0.104355 dRLeptons = 0.619509 diltype = 54 dimass = 14.2669 event = 542 jet1_Et = 26.0214 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.354 lep2_E = 20.7615 rand = 0.999742 run = 196099 weight = 1.72479e-06 ===Show End Prepared event 10000 for Signal with 22515 events Prepared event 20000 for Signal with 22515 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.158548 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4395 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 158851 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4395 negative weights. Signal fraction: 63.0012169 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 0. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0048981 63.553257 66.0033417 67.4964294 68.7002106 70.0528793 70.8836746 71.6665878 72.5987701 73.5187149 74.221405 74.9681549 75.5637512 76.2964554 77.0389404 77.7792969 78.5633774 79.2883606 79.9910889 80.7617493 81.3352814 82.1891479 82.9663544 83.6375198 84.6574173 85.7722931 86.7277679 87.9938049 89.1399841 90.5950394 91.9664917 93.4802246 95.1574097 96.4939728 98.0027466 99.4708328 100.967163 102.682022 104.119644 105.54097 107.023987 108.829269 110.881561 112.765778 114.381088 116.210526 117.915962 119.707985 121.20182 122.836212 124.52507 126.261581 127.785774 129.519409 131.237732 132.960587 134.635437 136.280762 137.882477 139.43277 141.112885 142.583237 144.0737 145.75119 147.476135 149.099213 150.583755 152.380615 154.131622 156.082031 157.627258 159.547852 161.370941 163.288055 165.466217 167.442047 169.63855 171.901855 174.237762 176.452988 179.269867 181.617599 184.226196 187.356827 190.336609 193.398743 196.901566 200.403641 203.822754 207.909927 212.462143 217.903809 223.086548 230.373993 238.543533 248.87616 259.732727 276.829285 300.515442 350.18573 873.258301 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.4054375 20.7477264 21.0877628 21.3356094 21.5547466 21.8091774 22.0501976 22.2813072 22.5452824 22.7284088 22.9025421 23.1184521 23.2866592 23.5276146 23.7361412 23.9859142 24.2178116 24.4710007 24.707489 24.9235992 25.1789894 25.3714218 25.6058426 25.7938938 26.0462646 26.2583809 26.5099239 26.7524815 26.9879761 27.2191849 27.4488716 27.6821651 27.9048843 28.1349907 28.338665 28.6253662 28.8743439 29.1244278 29.3696899 29.665905 29.930357 30.2585983 30.5494347 30.8301773 31.144207 31.4959335 31.8364716 32.1798706 32.4935341 32.7980957 33.162384 33.5381088 33.8723526 34.2410278 34.6981277 35.0853577 35.4890289 35.8785744 36.3044357 36.7756042 37.303833 37.7901115 38.3171768 38.8171616 39.1707458 39.7152061 40.2369232 40.7830048 41.1168709 41.6954384 42.243927 42.7878342 43.368927 44.0208244 44.655899 45.2384148 45.911232 46.5807686 47.4142609 48.2269592 49.0578346 49.9424515 50.767868 51.7556763 52.7967148 53.9554062 55.124424 56.1051941 57.1676445 58.6060333 60.0548706 61.8162346 63.5351562 65.4231567 67.8152618 70.531723 73.6555634 78.085144 85.5792694 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0006914 10.1225615 10.2710609 10.3937168 10.496582 10.6235714 10.7773247 10.8945293 11.01754 11.1727982 11.3124151 11.4475689 11.604413 11.7363911 11.8821306 12.0566845 12.2117977 12.3520069 12.5121851 12.6810131 12.8400469 13.0079908 13.1867561 13.3584547 13.5274496 13.6735458 13.8549957 14.0189991 14.2131367 14.4010639 14.5957861 14.8068142 15.0059414 15.2037764 15.3880501 15.577631 15.7878456 15.9681787 16.1989479 16.414566 16.5918636 16.7822876 16.9906864 17.1599979 17.3733501 17.6099243 17.7882462 17.9862099 18.1158333 18.3458595 18.5552998 18.7535839 18.9761944 19.1399536 19.3830872 19.6172371 19.8297424 20.0412788 20.218092 20.3477154 20.5493965 20.7196159 20.9107819 21.118721 21.2936001 21.5013618 21.6875763 21.8910484 22.0373955 22.2624722 22.5060616 22.70051 22.9209843 23.1399689 23.403883 23.6152229 23.8743401 24.1231117 24.3924408 24.6410847 24.9398651 25.2414513 25.5317612 25.8764839 26.2887688 26.6713562 27.0401878 27.3986473 27.7880154 28.2273121 28.7881432 29.3362064 29.8117752 30.4529686 31.1914406 32.0325089 33.168644 34.5170364 36.3178406 39.575222 68.4152985 ------------------------------ Transdef: Tab for variable 5 1.19181919 2.69367385 3.10840464 3.49401426 3.74758339 3.97861695 4.12218142 4.24139881 4.38517714 4.51660872 4.61571693 4.70999146 4.80582523 4.89564323 4.98639297 5.05966043 5.13019848 5.19127464 5.26435947 5.33589554 5.38971138 5.45009995 5.50934267 5.54210281 5.59757805 5.6507988 5.70498991 5.75714207 5.81285191 5.86252594 5.91124344 5.9581337 6.00559998 6.05296898 6.10261488 6.15001822 6.19955921 6.24468613 6.28308868 6.33367634 6.38590336 6.4353404 6.47930336 6.52509117 6.57497978 6.62477779 6.66462517 6.71609497 6.76575041 6.81253815 6.85680962 6.89709473 6.96155119 7.00524378 7.05601788 7.10099506 7.16638231 7.21601009 7.27141666 7.33019829 7.3869586 7.43592644 7.48363018 7.532969 7.59913158 7.65585089 7.71498489 7.77433872 7.82954216 7.88327885 7.94309235 8.00893688 8.08118725 8.14329338 8.20964336 8.26711655 8.32589149 8.40182304 8.47001648 8.52821732 8.60409737 8.68413067 8.76198959 8.83905125 8.91375732 8.99362183 9.08348656 9.18170452 9.28404617 9.40047836 9.50933361 9.61502647 9.7596035 9.91101265 10.0904789 10.2907009 10.5391636 10.8954067 11.4004211 12.4610653 23.3634911 ------------------------------ Transdef: Tab for variable 6 15.0119848 21.6343956 25.4297333 26.5472946 27.7443848 28.7994347 29.5417137 30.3973465 31.1570625 31.7611809 32.3035278 32.8286133 33.3356781 33.8535767 34.4130783 34.777874 35.1831512 35.6657333 36.0886726 36.4794846 36.8858337 37.2383652 37.7001495 38.0619698 38.4855347 38.8409538 39.2157669 39.6778793 40.0912476 40.4261475 40.8721085 41.2911606 41.7957001 42.2547722 42.7583694 43.1153374 43.5230637 43.9021225 44.5093918 45.0732651 45.672699 46.311245 46.9124527 47.4934921 48.1208878 48.8265533 49.4582291 50.102356 50.6570358 51.5089684 52.4621048 53.3583107 54.2124786 55.0602798 55.8605499 56.5324669 57.2320328 58.0138931 58.5359535 59.3485832 60.1740303 61.0098572 61.768013 62.60186 63.4938049 64.3883972 65.2625427 65.9673004 66.7738342 67.6214676 68.5963135 69.504509 70.2632751 71.1756058 71.9607697 72.8438339 73.7984772 74.7471008 75.6866302 76.7150879 77.2865829 78.3417587 79.576004 80.6435242 81.8161545 82.9162827 84.2936401 85.7231293 87.0904922 88.7021484 90.2607727 92.1307983 94.1649323 96.6480103 99.4028015 102.371666 105.964996 111.032982 118.764755 132.27121 413.504761 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.8095818 33.7436676 34.5197296 35.1333771 35.664463 36.1238785 36.6788635 37.053669 37.5082245 37.8617935 38.169693 38.5056534 38.8152466 39.092392 39.4355011 39.7583313 40.0973129 40.3881874 40.779953 41.1297379 41.5316467 41.9402046 42.3329201 42.7771149 43.2755432 43.8885002 44.5940895 45.1494179 45.9868279 46.8621674 47.8218918 48.5628281 49.4886551 50.6297607 51.6902008 52.6918793 53.8852272 54.9534988 56.0014343 56.8717499 57.8149185 58.9160004 59.8008423 60.795929 61.1808548 62.0470123 62.8386078 63.8470955 64.7332535 65.5358505 66.598381 67.5233459 68.471283 69.3439178 70.2150726 71.1579437 72.21315 73.0961838 74.1845245 75.1957779 76.3110428 77.1842422 78.2087555 79.2022095 80.3009491 81.6392822 82.8153992 83.8711548 85.1626892 86.4423752 87.7728348 89.0755768 90.5867462 92.4122238 93.9962921 95.6410828 97.2544861 98.8706512 100.819389 102.647232 104.795731 106.891731 109.206924 111.668663 114.512421 117.393883 120.193619 123.023895 126.230362 130.424652 134.769867 138.979065 144.34993 151.080765 158.111237 166.998871 181.011353 202.472321 241.522705 503.735382 ------------------------------ Transdef: Tab for variable 8 1.44759953 24.4716625 29.125473 31.1122246 32.102478 32.8921547 33.4353065 33.8992271 34.3720665 34.8126335 35.2136459 35.5468445 35.984684 36.3323441 36.6259003 36.9315681 37.255661 37.5928497 37.8878899 38.1338272 38.4033661 38.7262421 38.9700546 39.2668304 39.5102844 39.7775803 40.1180801 40.4466705 40.8079758 41.1222 41.453392 41.8904953 42.3834991 42.8200531 43.2842445 43.7358017 44.2808075 44.7499619 45.3519592 46.0541229 46.7092705 47.3489456 48.01091 48.5115356 49.1267776 49.8129463 50.4467545 51.1700287 51.9513359 52.7427139 53.3863068 54.1288567 54.8796844 55.5686569 56.3245049 57.0405426 57.8033676 58.6091537 59.3073196 60.0866661 60.7195053 61.3089676 62.073082 62.908432 63.6679268 64.3691254 65.1227112 65.8047638 66.478714 67.3190079 68.0877914 68.7865601 69.5261993 70.4034882 71.2421722 72.0692596 72.9762115 73.8470993 74.7686462 75.711731 76.6291351 77.4957581 78.4907227 79.4558868 80.6090546 81.8065948 83.0665131 84.3754578 85.7917938 87.2211914 88.9727325 90.9894562 93.2442856 95.8407135 98.8132095 102.446533 107.028641 113.397736 122.76944 143.064819 417.506927 ------------------------------ Transdef: Tab for variable 9 48.8581314 63.0527267 65.3307419 66.92836 68.1737366 69.2193832 70.207077 70.9552155 71.647789 72.5184937 73.3338623 73.9588242 74.6625977 75.1830215 75.717247 76.3738861 77.0233917 77.6431732 78.2656708 78.8119278 79.5001678 80.0525513 80.6881256 81.2194672 81.9037781 82.5688934 83.1961441 83.7867889 84.6574173 85.3750305 86.2542572 86.8801575 87.9839783 88.921875 90.0239563 91.1163635 92.1316528 93.4799423 94.9848862 96.1318512 97.4605331 98.6808853 99.9500427 101.441605 102.786751 104.177673 105.507019 106.756287 108.186234 109.660629 111.025024 112.397957 113.970764 115.285522 116.506042 117.895943 119.381531 120.409515 121.636551 122.833382 124.051346 125.385818 126.758789 128.043137 129.225494 130.551392 131.788696 133.124847 134.430206 135.695312 137.066895 138.284988 139.677094 140.96225 142.103516 143.370697 144.812408 146.309326 147.796829 149.11084 150.548798 152.065887 153.721146 155.343658 156.980743 158.767761 160.595612 162.445328 164.52774 166.734741 169.171112 171.770615 174.542099 177.436127 180.742737 184.814545 189.548584 194.81871 203.421448 219.391388 453.251465 ------------------------------ Transdef: Tab for variable 10 0.000472510961 0.854887486 1.26783276 1.50178027 1.66029871 1.78890133 1.89476323 1.98878551 2.07923055 2.154984 2.20881987 2.26389694 2.31175971 2.35362387 2.39595413 2.42863035 2.46517992 2.49872494 2.53155875 2.55811119 2.58621311 2.61126542 2.63478851 2.65500283 2.67706823 2.69635201 2.71618938 2.73639107 2.75628757 2.77353525 2.790555 2.80435514 2.81805992 2.83075786 2.84198618 2.85082626 2.86178708 2.87294984 2.88170671 2.89109898 2.89798212 2.90714359 2.91562796 2.92275286 2.93105793 2.93879986 2.94673324 2.95384026 2.96003628 2.96598554 2.97229624 2.97793317 2.98364401 2.98942637 2.99381757 2.99949217 3.00392485 3.00849533 3.01361442 3.01745677 3.02200627 3.02640986 3.0305109 3.0345633 3.03758574 3.04114294 3.04457784 3.04878426 3.05272889 3.05658054 3.06021142 3.06419969 3.06710196 3.07040381 3.07353687 3.07633924 3.07932091 3.08232689 3.08568573 3.08847547 3.09177899 3.09451246 3.0970006 3.10014725 3.10274839 3.10494947 3.10804129 3.11014247 3.11266613 3.11511946 3.11786366 3.12018752 3.12265015 3.12538147 3.12788963 3.1304493 3.13197088 3.13436699 3.13649893 3.13917804 3.14159226 ------------------------------ Transdef: Tab for variable 11 3.87430191E-06 0.00544798374 0.0111004114 0.0182839632 0.0252893399 0.0325580835 0.0402092934 0.0475848317 0.0563724041 0.0626653135 0.0701327026 0.0775052309 0.0847374201 0.0932317376 0.100347042 0.107099771 0.112900108 0.121038705 0.12800324 0.135126382 0.142535806 0.148696542 0.15527159 0.162715077 0.168666378 0.1748631 0.180629715 0.187125325 0.192428857 0.198006094 0.204593301 0.209745288 0.215206921 0.220301479 0.225334287 0.230351776 0.235560656 0.241734266 0.24720788 0.251757741 0.256922096 0.261942446 0.266844988 0.271801353 0.277337223 0.282643735 0.287534714 0.292849779 0.298262537 0.303229809 0.309054434 0.314529657 0.319922805 0.325598836 0.331168175 0.336592376 0.342252821 0.347869664 0.35345912 0.359561145 0.365350246 0.371358663 0.37651509 0.382045835 0.387316048 0.392265081 0.398469806 0.404548764 0.411044985 0.417555809 0.423036158 0.429030538 0.435958087 0.442067116 0.448500037 0.455168962 0.462731332 0.469295621 0.476443529 0.484960318 0.493312597 0.502319932 0.510190606 0.519661188 0.528215766 0.537486494 0.544651806 0.553951979 0.565231502 0.578297019 0.591038704 0.604692936 0.620284379 0.638378978 0.656021595 0.678188086 0.708107412 0.738226295 0.779158354 0.839624405 1.11657131 ------------------------------ Transdef: Tab for variable 12 0.200070545 0.213016644 0.222693086 0.233078212 0.242113039 0.25085634 0.257867098 0.264777124 0.273190767 0.280203879 0.28643477 0.293195009 0.299874276 0.305762053 0.310815275 0.316702008 0.32269603 0.327649295 0.33287698 0.338672966 0.343856633 0.349179864 0.354496211 0.358435869 0.363924414 0.369841754 0.375106633 0.380342782 0.3851735 0.389952421 0.394533694 0.399222732 0.402828276 0.407125115 0.411339492 0.414445162 0.418004215 0.421638489 0.42545253 0.429173291 0.433203399 0.436799705 0.440298498 0.443901539 0.447387338 0.451894462 0.455547839 0.45945102 0.462611139 0.466739833 0.47044915 0.473744333 0.476587713 0.480002224 0.48358506 0.488490641 0.492696315 0.496904075 0.501001358 0.505944133 0.510721862 0.514885008 0.519880652 0.524437189 0.52911377 0.534412622 0.539126635 0.545209885 0.548626244 0.553922892 0.559209347 0.564612031 0.570297182 0.575962663 0.580617964 0.58777988 0.594507098 0.600871742 0.608340383 0.616148829 0.623151779 0.630997896 0.639135242 0.648562908 0.658321381 0.666371703 0.674293518 0.684063613 0.693876982 0.703728318 0.717675626 0.72947824 0.742522001 0.753894985 0.771336913 0.788516521 0.807145119 0.831414521 0.860045075 0.899161518 1.13453126 ------------------------------ Transdef: Tab for variable 13 20.0277634 21.5904636 22.4797211 23.136982 23.7448845 24.2793007 24.7893124 25.2537365 25.7024384 26.1726379 26.6299362 27.0826664 27.4619446 27.8703499 28.2946053 28.6833649 29.0323105 29.4015923 29.7965927 30.1533985 30.546875 30.9015388 31.1989689 31.5827732 31.9790649 32.3565521 32.6988068 33.1266022 33.5277481 33.9595184 34.344574 34.6896667 35.0684814 35.3935432 35.8472519 36.1896706 36.5390625 36.9722633 37.3876495 37.9087067 38.3461952 38.783989 39.3299637 39.7774506 40.258007 40.7258453 41.196907 41.6447067 42.182972 42.7138519 43.2186737 43.7228622 44.2486649 44.7479248 45.3085861 45.8695297 46.3651581 46.849514 47.4628792 47.9500504 48.558815 49.2271271 49.8756027 50.5165482 51.0804024 51.7768936 52.5134506 53.1510315 53.8339691 54.6169319 55.2802963 56.0658073 56.8229713 57.5542221 58.4569435 59.2289848 60.0339699 60.8924866 61.8076477 62.6539497 63.5625305 64.5065613 65.5788651 66.8680801 68.0185242 68.8440857 70.0007782 71.386261 72.7922516 74.2190247 76.2187042 77.7930069 79.9494019 82.2766113 84.8118057 87.5307083 90.0616379 94.6188354 100.885468 110.88414 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.7318964 11.2337894 11.614254 11.9377069 12.3120461 12.6126499 12.9655495 13.3121815 13.616066 13.9243221 14.2677488 14.5206461 14.7957535 15.0610332 15.3060856 15.6128054 15.8959866 16.194212 16.4033298 16.644062 16.9058628 17.1810646 17.4667683 17.7229233 17.9382782 18.1645813 18.3830109 18.6411705 18.8480263 19.09515 19.3603706 19.6325912 19.8765163 20.0938568 20.3628426 20.589035 20.8123474 21.0537262 21.2914467 21.5314884 21.7434044 21.9765701 22.1818237 22.3977776 22.6514683 22.8774223 23.1011238 23.3088703 23.5504913 23.7856903 24.0154438 24.2546272 24.5068398 24.7474594 25.0070496 25.2301445 25.4369221 25.627903 25.8633823 26.1163521 26.3860397 26.6296425 26.902462 27.1700859 27.4286575 27.6792336 27.9611435 28.1606369 28.4501419 28.7793655 29.0937347 29.4080257 29.7239513 30.1051292 30.4870491 30.8435802 31.19697 31.5744324 31.995079 32.434166 32.9406433 33.4023361 33.7671852 34.3247337 34.8322067 35.4104958 36.0436172 36.7875595 37.4393501 38.3673096 39.3370628 40.1394958 41.2107582 42.464344 43.9449005 45.9611893 48.6330338 52.4309998 58.4955673 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 63.8 50.0 48.3 29.6 49.3 61.5 52.6 61.6 -26.6 -18.4 -38.6 20.6 17.6 2 63.8 100.0 68.8 53.4 42.4 71.7 94.7 77.9 92.3 -44.1 -24.7 -49.8 40.4 24.5 3 50.0 68.8 100.0 39.1 23.5 45.6 69.3 61.2 77.4 -10.4 -28.5 -58.4 71.0 15.3 4 48.3 53.4 39.1 100.0 11.1 31.1 56.0 44.2 55.4 -13.4 -30.1 -57.8 18.4 68.5 5 29.6 42.4 23.5 11.1 100.0 84.7 15.9 62.0 62.6 18.8 -7.6 -14.9 9.8 -1.8 6 49.3 71.7 45.6 31.1 84.7 100.0 51.7 80.6 81.8 -7.4 -17.0 -32.7 23.7 9.5 7 61.5 94.7 69.3 56.0 15.9 51.7 100.0 69.6 81.3 -53.0 -23.8 -49.8 42.4 28.5 8 52.6 77.9 61.2 44.2 62.0 80.6 69.6 100.0 85.6 -12.0 -23.8 -44.6 37.6 20.8 9 61.6 92.3 77.4 55.4 62.6 81.8 81.3 85.6 100.0 -20.0 -27.5 -55.7 48.3 26.0 10 -26.6 -44.1 -10.4 -13.4 18.8 -7.4 -53.0 -12.0 -20.0 100.0 0.7 6.4 -2.8 -5.6 11 -18.4 -24.7 -28.5 -30.1 -7.6 -17.0 -23.8 -23.8 -27.5 0.7 100.0 55.9 -16.3 -18.6 12 -38.6 -49.8 -58.4 -57.8 -14.9 -32.7 -49.8 -44.6 -55.7 6.4 55.9 100.0 -35.1 -31.0 13 20.6 40.4 71.0 18.4 9.8 23.7 42.4 37.6 48.3 -2.8 -16.3 -35.1 100.0 40.0 14 17.6 24.5 15.3 68.5 -1.8 9.5 28.5 20.8 26.0 -5.6 -18.6 -31.0 40.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 160.68104 TOTAL CORRELATION OF ALL VARIABLES 69.6213226 ROUND 1: MAX CORR ( 69.6197998) AFTER KILLING INPUT VARIABLE 11 CONTR 0.460486418 ROUND 2: MAX CORR ( 69.5985006) AFTER KILLING INPUT VARIABLE 8 CONTR 1.72198313 ROUND 3: MAX CORR ( 69.5513698) AFTER KILLING INPUT VARIABLE 12 CONTR 2.560907 ROUND 4: MAX CORR ( 69.4495936) AFTER KILLING INPUT VARIABLE 2 CONTR 3.76125013 ROUND 5: MAX CORR ( 69.3353408) AFTER KILLING INPUT VARIABLE 14 CONTR 3.98202914 ROUND 6: MAX CORR ( 69.1302525) AFTER KILLING INPUT VARIABLE 6 CONTR 5.32894713 ROUND 7: MAX CORR ( 68.8565656) AFTER KILLING INPUT VARIABLE 10 CONTR 6.14533813 ROUND 8: MAX CORR ( 68.317155) AFTER KILLING INPUT VARIABLE 9 CONTR 8.60191594 ROUND 9: MAX CORR ( 67.061762) AFTER KILLING INPUT VARIABLE 13 CONTR 13.0366309 ROUND 10: MAX CORR ( 66.7119554) AFTER KILLING INPUT VARIABLE 3 CONTR 6.84068182 ROUND 11: MAX CORR ( 64.7108287) AFTER KILLING INPUT VARIABLE 4 CONTR 16.2170788 ROUND 12: MAX CORR ( 61.5004967) AFTER KILLING INPUT VARIABLE 5 CONTR 20.1290898 LAST REMAINING VARIABLE: 7 total correlation to target: 69.6213226 % total significance: 93.3399855 sigma correlations of single variables to target: variable 2: 63.7995602 % , in sigma: 85.534859 variable 3: 50.0085804 % , in sigma: 67.0455544 variable 4: 48.3441749 % , in sigma: 64.8141175 variable 5: 29.6369245 % , in sigma: 39.7336621 variable 6: 49.2592907 % , in sigma: 66.0409958 variable 7: 61.5004967 % , in sigma: 82.4525484 variable 8: 52.559563 % , in sigma: 70.4656082 variable 9: 61.5575683 % , in sigma: 82.5290632 variable 10: -26.6384354 % , in sigma: 35.7136447 variable 11: -18.3513521 % , in sigma: 24.6033093 variable 12: -38.5843424 % , in sigma: 51.7292953 variable 13: 20.6064216 % , in sigma: 27.6266382 variable 14: 17.6426423 % , in sigma: 23.6531556 variables sorted by significance: 1 most relevant variable 7 corr 61.5004959 , in sigma: 82.4525473 2 most relevant variable 5 corr 20.1290894 , in sigma: 26.9866879 3 most relevant variable 4 corr 16.2170792 , in sigma: 21.7419301 4 most relevant variable 3 corr 6.84068203 , in sigma: 9.17117253 5 most relevant variable 13 corr 13.0366306 , in sigma: 17.4779632 6 most relevant variable 9 corr 8.60191631 , in sigma: 11.5324259 7 most relevant variable 10 corr 6.14533806 , in sigma: 8.23893806 8 most relevant variable 6 corr 5.32894707 , in sigma: 7.14441816 9 most relevant variable 14 corr 3.9820292 , in sigma: 5.33863095 10 most relevant variable 2 corr 3.76125002 , in sigma: 5.04263649 11 most relevant variable 12 corr 2.56090689 , in sigma: 3.43335924 12 most relevant variable 8 corr 1.72198308 , in sigma: 2.30863002 13 most relevant variable 11 corr 0.460486412 , in sigma: 0.61736539 global correlations between input variables: variable 2: 99.2850917 % variable 3: 94.3902261 % variable 4: 90.5848007 % variable 5: 95.7095824 % variable 6: 94.3549881 % variable 7: 98.9135241 % variable 8: 91.0783419 % variable 9: 98.9889 % variable 10: 72.4882384 % variable 11: 56.9085469 % variable 12: 77.759933 % variable 13: 87.6196684 % variable 14: 86.7949632 % significance loss when removing single variables: variable 2: corr = 2.73525261 % , sigma = 3.66710125 variable 3: corr = 13.6705469 % , sigma = 18.3278426 variable 4: corr = 15.205301 % , sigma = 20.3854584 variable 5: corr = 9.03710716 % , sigma = 12.115878 variable 6: corr = 4.9433891 % , sigma = 6.62750791 variable 7: corr = 5.23963176 % , sigma = 7.02467483 variable 8: corr = 1.69040251 % , sigma = 2.26629055 variable 9: corr = 8.60191046 % , sigma = 11.5324181 variable 10: corr = 4.74443657 % , sigma = 6.36077603 variable 11: corr = 0.460486418 % , sigma = 0.617365398 variable 12: corr = 1.97800696 % , sigma = 2.65187638 variable 13: corr = 5.46118792 % , sigma = 7.32171097 variable 14: corr = 3.99584818 % , sigma = 5.3571578 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 12.3068819 sigma out 15 active outputs RANK 2 NODE 2 --> 11.6015663 sigma out 15 active outputs RANK 3 NODE 5 --> 10.8261766 sigma out 15 active outputs RANK 4 NODE 1 --> 10.6210775 sigma out 15 active outputs RANK 5 NODE 3 --> 8.60650635 sigma out 15 active outputs RANK 6 NODE 9 --> 8.1407795 sigma out 15 active outputs RANK 7 NODE 11 --> 7.62858534 sigma out 15 active outputs RANK 8 NODE 6 --> 7.59092188 sigma out 15 active outputs RANK 9 NODE 4 --> 6.54828978 sigma out 15 active outputs RANK 10 NODE 10 --> 5.86952448 sigma out 15 active outputs RANK 11 NODE 7 --> 5.81779194 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 13.4707441 sigma in 11act. ( 13.307416 sig out 1act.) RANK 2 NODE 6 --> 11.780076 sigma in 11act. ( 12.5409451 sig out 1act.) RANK 3 NODE 13 --> 11.0704889 sigma in 11act. ( 11.1614494 sig out 1act.) RANK 4 NODE 7 --> 9.65398788 sigma in 11act. ( 9.63425827 sig out 1act.) RANK 5 NODE 9 --> 9.54847908 sigma in 11act. ( 9.84344482 sig out 1act.) RANK 6 NODE 8 --> 8.42779541 sigma in 11act. ( 8.36209965 sig out 1act.) RANK 7 NODE 12 --> 8.0611496 sigma in 11act. ( 9.0848484 sig out 1act.) RANK 8 NODE 5 --> 5.66588736 sigma in 11act. ( 6.3034339 sig out 1act.) RANK 9 NODE 3 --> 4.80197382 sigma in 11act. ( 6.76455784 sig out 1act.) RANK 10 NODE 11 --> 4.20076275 sigma in 11act. ( 3.83826566 sig out 1act.) RANK 11 NODE 14 --> 3.9182961 sigma in 11act. ( 3.70327258 sig out 1act.) RANK 12 NODE 1 --> 3.5808177 sigma in 11act. ( 3.25900936 sig out 1act.) RANK 13 NODE 15 --> 3.28182507 sigma in 11act. ( 0.849846542 sig out 1act.) RANK 14 NODE 4 --> 2.42347622 sigma in 11act. ( 1.11600828 sig out 1act.) RANK 15 NODE 2 --> 1.61636078 sigma in 11act. ( 2.43263984 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 13.307416 sigma out 1act.( 13.4707441 sig in 11act.) RANK 2 NODE 6 --> 12.5409451 sigma out 1act.( 11.780076 sig in 11act.) RANK 3 NODE 13 --> 11.1614494 sigma out 1act.( 11.0704889 sig in 11act.) RANK 4 NODE 9 --> 9.84344482 sigma out 1act.( 9.54847908 sig in 11act.) RANK 5 NODE 7 --> 9.63425827 sigma out 1act.( 9.65398788 sig in 11act.) RANK 6 NODE 12 --> 9.0848484 sigma out 1act.( 8.0611496 sig in 11act.) RANK 7 NODE 8 --> 8.36209965 sigma out 1act.( 8.42779541 sig in 11act.) RANK 8 NODE 3 --> 6.76455784 sigma out 1act.( 4.80197382 sig in 11act.) RANK 9 NODE 5 --> 6.3034339 sigma out 1act.( 5.66588736 sig in 11act.) RANK 10 NODE 11 --> 3.83826566 sigma out 1act.( 4.20076275 sig in 11act.) RANK 11 NODE 14 --> 3.70327258 sigma out 1act.( 3.9182961 sig in 11act.) RANK 12 NODE 1 --> 3.25900936 sigma out 1act.( 3.5808177 sig in 11act.) RANK 13 NODE 2 --> 2.43263984 sigma out 1act.( 1.61636078 sig in 11act.) RANK 14 NODE 4 --> 1.11600828 sigma out 1act.( 2.42347622 sig in 11act.) RANK 15 NODE 15 --> 0.849846542 sigma out 1act.( 3.28182507 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 30.5541763 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 18.9171963 sigma out 15 active outputs RANK 2 NODE 8 --> 14.2479334 sigma out 15 active outputs RANK 3 NODE 2 --> 13.3309908 sigma out 15 active outputs RANK 4 NODE 5 --> 12.6124077 sigma out 15 active outputs RANK 5 NODE 1 --> 11.8370934 sigma out 15 active outputs RANK 6 NODE 9 --> 9.68087482 sigma out 15 active outputs RANK 7 NODE 3 --> 9.32206821 sigma out 15 active outputs RANK 8 NODE 6 --> 8.72306061 sigma out 15 active outputs RANK 9 NODE 4 --> 8.19530392 sigma out 15 active outputs RANK 10 NODE 7 --> 7.93113422 sigma out 15 active outputs RANK 11 NODE 10 --> 7.30174589 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 13.8720284 sigma in 11act. ( 13.1205187 sig out 1act.) RANK 2 NODE 3 --> 12.2638693 sigma in 11act. ( 8.23540497 sig out 1act.) RANK 3 NODE 2 --> 12.1394043 sigma in 11act. ( 5.74440384 sig out 1act.) RANK 4 NODE 6 --> 11.9304609 sigma in 11act. ( 11.2560682 sig out 1act.) RANK 5 NODE 7 --> 11.9206514 sigma in 11act. ( 9.34253597 sig out 1act.) RANK 6 NODE 13 --> 11.5260439 sigma in 11act. ( 11.291276 sig out 1act.) RANK 7 NODE 9 --> 11.0792017 sigma in 11act. ( 9.93000221 sig out 1act.) RANK 8 NODE 12 --> 10.5243654 sigma in 11act. ( 9.64669132 sig out 1act.) RANK 9 NODE 5 --> 8.67675591 sigma in 11act. ( 7.37173557 sig out 1act.) RANK 10 NODE 8 --> 8.42697239 sigma in 11act. ( 7.54504871 sig out 1act.) RANK 11 NODE 1 --> 7.24662066 sigma in 11act. ( 3.32994056 sig out 1act.) RANK 12 NODE 15 --> 6.95455551 sigma in 11act. ( 0.013584693 sig out 1act.) RANK 13 NODE 14 --> 6.17933321 sigma in 11act. ( 3.72418189 sig out 1act.) RANK 14 NODE 11 --> 5.4478488 sigma in 11act. ( 3.47471929 sig out 1act.) RANK 15 NODE 4 --> 4.67124224 sigma in 11act. ( 0.896996677 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 13.1205187 sigma out 1act.( 13.8720284 sig in 11act.) RANK 2 NODE 13 --> 11.291276 sigma out 1act.( 11.5260439 sig in 11act.) RANK 3 NODE 6 --> 11.2560682 sigma out 1act.( 11.9304609 sig in 11act.) RANK 4 NODE 9 --> 9.93000221 sigma out 1act.( 11.0792017 sig in 11act.) RANK 5 NODE 12 --> 9.64669132 sigma out 1act.( 10.5243654 sig in 11act.) RANK 6 NODE 7 --> 9.34253597 sigma out 1act.( 11.9206514 sig in 11act.) RANK 7 NODE 3 --> 8.23540497 sigma out 1act.( 12.2638693 sig in 11act.) RANK 8 NODE 8 --> 7.54504871 sigma out 1act.( 8.42697239 sig in 11act.) RANK 9 NODE 5 --> 7.37173557 sigma out 1act.( 8.67675591 sig in 11act.) RANK 10 NODE 2 --> 5.74440384 sigma out 1act.( 12.1394043 sig in 11act.) RANK 11 NODE 14 --> 3.72418189 sigma out 1act.( 6.17933321 sig in 11act.) RANK 12 NODE 11 --> 3.47471929 sigma out 1act.( 5.4478488 sig in 11act.) RANK 13 NODE 1 --> 3.32994056 sigma out 1act.( 7.24662066 sig in 11act.) RANK 14 NODE 4 --> 0.896996677 sigma out 1act.( 4.67124224 sig in 11act.) RANK 15 NODE 15 --> 0.013584693 sigma out 1act.( 6.95455551 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 30.9065247 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.535893857 *** contribution from regularisation: 0.00484234747 *** contribution from error: -0.540736198 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.569922328 *** contribution from regularisation: 0.00228597014 *** contribution from error: -0.572208285 *********************************************** -----------------> Test sample ENTER BFGS code START -45274.0234 0.180441216 0.0258636791 EXIT FROM BFGS code FG_START 0. 0.180441216 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.591026366 *** contribution from regularisation: 0.00170845783 *** contribution from error: -0.592734814 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46942.2692 0.180441216 33.571701 EXIT FROM BFGS code FG_LNSRCH 0. 0.203034505 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.609276593 *** contribution from regularisation: 0.00284972019 *** contribution from error: -0.612126291 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48391.7921 0.203034505 67.713356 EXIT FROM BFGS code NEW_X -48391.7921 0.203034505 67.713356 ENTER BFGS code NEW_X -48391.7921 0.203034505 67.713356 EXIT FROM BFGS code FG_LNSRCH 0. 0.245786533 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.610658467 *** contribution from regularisation: 0.00291963317 *** contribution from error: -0.613578081 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48501.5478 0.245786533 31.9408054 EXIT FROM BFGS code NEW_X -48501.5478 0.245786533 31.9408054 ENTER BFGS code NEW_X -48501.5478 0.245786533 31.9408054 EXIT FROM BFGS code FG_LNSRCH 0. 0.295015246 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.611523271 *** contribution from regularisation: 0.00281422539 *** contribution from error: -0.614337504 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48570.2336 0.295015246 4.27205181 EXIT FROM BFGS code NEW_X -48570.2336 0.295015246 4.27205181 ENTER BFGS code NEW_X -48570.2336 0.295015246 4.27205181 EXIT FROM BFGS code FG_LNSRCH 0. 0.343811929 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.611918032 *** contribution from regularisation: 0.00281617371 *** contribution from error: -0.614734232 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48601.5902 0.343811929 -15.4862795 EXIT FROM BFGS code NEW_X -48601.5902 0.343811929 -15.4862795 ENTER BFGS code NEW_X -48601.5902 0.343811929 -15.4862795 EXIT FROM BFGS code FG_LNSRCH 0. 0.393776864 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.612599671 *** contribution from regularisation: 0.002629939 *** contribution from error: -0.615229607 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48655.7309 0.393776864 -19.0785694 EXIT FROM BFGS code NEW_X -48655.7309 0.393776864 -19.0785694 ENTER BFGS code NEW_X -48655.7309 0.393776864 -19.0785694 EXIT FROM BFGS code FG_LNSRCH 0. 0.541104436 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.613485396 *** contribution from regularisation: 0.00241722749 *** contribution from error: -0.615902603 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48726.0771 0.541104436 -42.1041107 EXIT FROM BFGS code NEW_X -48726.0771 0.541104436 -42.1041107 ENTER BFGS code NEW_X -48726.0771 0.541104436 -42.1041107 EXIT FROM BFGS code FG_LNSRCH 0. 0.562300384 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 21.8540497 sigma out 15 active outputs RANK 2 NODE 4 --> 14.0610056 sigma out 15 active outputs RANK 3 NODE 2 --> 12.4412422 sigma out 15 active outputs RANK 4 NODE 1 --> 11.944747 sigma out 15 active outputs RANK 5 NODE 8 --> 10.298914 sigma out 15 active outputs RANK 6 NODE 9 --> 8.41211796 sigma out 15 active outputs RANK 7 NODE 6 --> 8.22514439 sigma out 15 active outputs RANK 8 NODE 7 --> 6.93029499 sigma out 15 active outputs RANK 9 NODE 10 --> 5.23985147 sigma out 15 active outputs RANK 10 NODE 5 --> 5.16094351 sigma out 15 active outputs RANK 11 NODE 3 --> 3.24878383 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 21.8110371 sigma in 11act. ( 16.0165234 sig out 1act.) RANK 2 NODE 10 --> 14.3808594 sigma in 11act. ( 11.2390919 sig out 1act.) RANK 3 NODE 3 --> 12.3844881 sigma in 11act. ( 8.6599617 sig out 1act.) RANK 4 NODE 5 --> 10.416667 sigma in 11act. ( 9.8210783 sig out 1act.) RANK 5 NODE 12 --> 8.81304932 sigma in 11act. ( 8.64810658 sig out 1act.) RANK 6 NODE 1 --> 8.08894444 sigma in 11act. ( 5.06085587 sig out 1act.) RANK 7 NODE 9 --> 7.87991858 sigma in 11act. ( 7.6973691 sig out 1act.) RANK 8 NODE 7 --> 6.39341688 sigma in 11act. ( 5.49291658 sig out 1act.) RANK 9 NODE 11 --> 5.6727457 sigma in 11act. ( 5.59991884 sig out 1act.) RANK 10 NODE 8 --> 5.64777088 sigma in 11act. ( 3.20193791 sig out 1act.) RANK 11 NODE 13 --> 5.11065435 sigma in 11act. ( 0.528942585 sig out 1act.) RANK 12 NODE 15 --> 4.23759794 sigma in 11act. ( 3.81106973 sig out 1act.) RANK 13 NODE 6 --> 3.42303467 sigma in 11act. ( 1.9493078 sig out 1act.) RANK 14 NODE 4 --> 3.17812729 sigma in 11act. ( 2.10709429 sig out 1act.) RANK 15 NODE 14 --> 3.07871652 sigma in 11act. ( 1.09801316 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 16.0165234 sigma out 1act.( 21.8110371 sig in 11act.) RANK 2 NODE 10 --> 11.2390919 sigma out 1act.( 14.3808594 sig in 11act.) RANK 3 NODE 5 --> 9.8210783 sigma out 1act.( 10.416667 sig in 11act.) RANK 4 NODE 3 --> 8.6599617 sigma out 1act.( 12.3844881 sig in 11act.) RANK 5 NODE 12 --> 8.64810658 sigma out 1act.( 8.81304932 sig in 11act.) RANK 6 NODE 9 --> 7.6973691 sigma out 1act.( 7.87991858 sig in 11act.) RANK 7 NODE 11 --> 5.59991884 sigma out 1act.( 5.6727457 sig in 11act.) RANK 8 NODE 7 --> 5.49291658 sigma out 1act.( 6.39341688 sig in 11act.) RANK 9 NODE 1 --> 5.06085587 sigma out 1act.( 8.08894444 sig in 11act.) RANK 10 NODE 15 --> 3.81106973 sigma out 1act.( 4.23759794 sig in 11act.) RANK 11 NODE 8 --> 3.20193791 sigma out 1act.( 5.64777088 sig in 11act.) RANK 12 NODE 4 --> 2.10709429 sigma out 1act.( 3.17812729 sig in 11act.) RANK 13 NODE 6 --> 1.9493078 sigma out 1act.( 3.42303467 sig in 11act.) RANK 14 NODE 14 --> 1.09801316 sigma out 1act.( 3.07871652 sig in 11act.) RANK 15 NODE 13 --> 0.528942585 sigma out 1act.( 5.11065435 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 28.4601326 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.612464666 *** contribution from regularisation: 0.00264673214 *** contribution from error: -0.615111411 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48645.0076 0.562300384 22.6615791 EXIT FROM BFGS code FG_LNSRCH 0. 0.544706702 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.613098502 *** contribution from regularisation: 0.00298233633 *** contribution from error: -0.616080821 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48695.3496 0.544706702 -32.4739189 EXIT FROM BFGS code FG_LNSRCH 0. 0.541330159 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.613174379 *** contribution from regularisation: 0.00274254219 *** contribution from error: -0.615916908 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48701.3751 0.541330159 -40.5650215 EXIT FROM BFGS code FG_LNSRCH 0. 0.541105926 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.613152862 *** contribution from regularisation: 0.00274987007 *** contribution from error: -0.615902722 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48699.666 0.541105926 -40.8148308 EXIT FROM BFGS code FG_LNSRCH 0. 0.541104436 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.613100529 *** contribution from regularisation: 0.00280206744 *** contribution from error: -0.615902603 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48695.5112 0.541104436 -40.8183784 EXIT FROM BFGS code FG_LNSRCH 0. 0.541104436 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.61315757 *** contribution from regularisation: 0.00274506817 *** contribution from error: -0.615902662 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48700.0383 0.541104436 -40.6910744 EXIT FROM BFGS code FG_LNSRCH 0. 0.541104436 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.613137364 *** contribution from regularisation: 0.00276527996 *** contribution from error: -0.615902662 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48698.433 0.541104436 -40.8967628 EXIT FROM BFGS code FG_LNSRCH 0. 0.541104436 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.613135457 *** contribution from regularisation: 0.002767178 *** contribution from error: -0.615902662 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48698.2823 0.541104436 -40.882473 EXIT FROM BFGS code NEW_X -48698.2823 0.541104436 -40.882473 ENTER BFGS code NEW_X -48698.2823 0.541104436 -40.882473 EXIT FROM BFGS code CONVERGENC -48698.2823 0.541104436 -40.882473 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 42.9824562 sigma out 15 active outputs RANK 2 NODE 1 --> 26.6328106 sigma out 15 active outputs RANK 3 NODE 8 --> 20.4324799 sigma out 15 active outputs RANK 4 NODE 4 --> 19.4732704 sigma out 15 active outputs RANK 5 NODE 2 --> 18.125803 sigma out 15 active outputs RANK 6 NODE 6 --> 13.6456509 sigma out 15 active outputs RANK 7 NODE 7 --> 13.5858688 sigma out 15 active outputs RANK 8 NODE 9 --> 13.262229 sigma out 15 active outputs RANK 9 NODE 10 --> 11.6918888 sigma out 15 active outputs RANK 10 NODE 5 --> 9.19005871 sigma out 15 active outputs RANK 11 NODE 3 --> 6.84661913 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 38.6471138 sigma in 11act. ( 30.5500431 sig out 1act.) RANK 2 NODE 10 --> 27.7024078 sigma in 11act. ( 18.9716625 sig out 1act.) RANK 3 NODE 3 --> 26.0875263 sigma in 11act. ( 19.1728096 sig out 1act.) RANK 4 NODE 5 --> 18.9456863 sigma in 11act. ( 17.5204563 sig out 1act.) RANK 5 NODE 12 --> 16.1902161 sigma in 11act. ( 16.2079067 sig out 1act.) RANK 6 NODE 9 --> 15.8202763 sigma in 11act. ( 14.1877975 sig out 1act.) RANK 7 NODE 1 --> 13.8998156 sigma in 11act. ( 9.59415531 sig out 1act.) RANK 8 NODE 7 --> 10.5956364 sigma in 11act. ( 11.2604542 sig out 1act.) RANK 9 NODE 8 --> 9.38865852 sigma in 11act. ( 6.22919941 sig out 1act.) RANK 10 NODE 11 --> 8.79855824 sigma in 11act. ( 7.4471736 sig out 1act.) RANK 11 NODE 13 --> 7.65082836 sigma in 11act. ( 5.03053188 sig out 1act.) RANK 12 NODE 15 --> 6.79703903 sigma in 11act. ( 5.61513042 sig out 1act.) RANK 13 NODE 14 --> 6.22019958 sigma in 11act. ( 4.13398695 sig out 1act.) RANK 14 NODE 6 --> 6.14386749 sigma in 11act. ( 5.26023579 sig out 1act.) RANK 15 NODE 4 --> 5.62189245 sigma in 11act. ( 3.83401322 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 30.5500431 sigma out 1act.( 38.6471138 sig in 11act.) RANK 2 NODE 3 --> 19.1728096 sigma out 1act.( 26.0875263 sig in 11act.) RANK 3 NODE 10 --> 18.9716625 sigma out 1act.( 27.7024078 sig in 11act.) RANK 4 NODE 5 --> 17.5204563 sigma out 1act.( 18.9456863 sig in 11act.) RANK 5 NODE 12 --> 16.2079067 sigma out 1act.( 16.1902161 sig in 11act.) RANK 6 NODE 9 --> 14.1877975 sigma out 1act.( 15.8202763 sig in 11act.) RANK 7 NODE 7 --> 11.2604542 sigma out 1act.( 10.5956364 sig in 11act.) RANK 8 NODE 1 --> 9.59415531 sigma out 1act.( 13.8998156 sig in 11act.) RANK 9 NODE 11 --> 7.4471736 sigma out 1act.( 8.79855824 sig in 11act.) RANK 10 NODE 8 --> 6.22919941 sigma out 1act.( 9.38865852 sig in 11act.) RANK 11 NODE 15 --> 5.61513042 sigma out 1act.( 6.79703903 sig in 11act.) RANK 12 NODE 6 --> 5.26023579 sigma out 1act.( 6.14386749 sig in 11act.) RANK 13 NODE 13 --> 5.03053188 sigma out 1act.( 7.65082836 sig in 11act.) RANK 14 NODE 14 --> 4.13398695 sigma out 1act.( 6.22019958 sig in 11act.) RANK 15 NODE 4 --> 3.83401322 sigma out 1act.( 5.62189245 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.4900627 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.613157809 *** contribution from regularisation: 0.00274483347 *** contribution from error: -0.615902662 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25970 Closing output file done