NNInput NNInputs_180.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 180687 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 38982 nbkg = 141705 Bkg Entries: 141705 Sig Entries: 38982 Chosen entries: 38982 Signal fraction: 1 Background fraction: 0.275093 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 141705 Actual Signal Entries: 38982 Entries to split: 38982 Test with : 19491 Train with : 19491 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 38982 for Signal Prepared event 0 for Signal with 38982 events ====Entry 0 Variable Ht : 181.988 Variable LepAPt : 36.3125 Variable LepBPt : 33.3263 Variable MetSigLeptonsJets : 8.50337 Variable MetSpec : 84.1215 Variable SumEtLeptonsJets : 97.8662 Variable VSumJetLeptonsPt : 93.7481 Variable addEt : 153.761 Variable dPhiLepSumMet : 2.8992 Variable dPhiLeptons : 0.358494 Variable dRLeptons : 0.375835 Variable lep1_E : 49.7842 Variable lep2_E : 42.4469 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2180 Ht = 181.988 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.3125 LepAPt = 36.3125 LepBEt = 33.3264 LepBPt = 33.3263 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 84.1215 MetDelPhi = 2.72772 MetSig = 7.11556 MetSigLeptonsJets = 8.50337 MetSpec = 84.1215 Mjj = 0 MostCentralJetEta = -2.14636 MtllMet = 165.707 Njets = 1 SB = 0 SumEt = 139.764 SumEtJets = 0 SumEtLeptonsJets = 97.8662 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 93.7481 addEt = 153.761 dPhiLepSumMet = 2.8992 dPhiLeptons = 0.358494 dRLeptons = 0.375835 diltype = 49 dimass = 13.013 event = 182 jet1_Et = 28.2274 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 49.7842 lep2_E = 42.4469 rand = 0.999742 run = 167139 weight = 3.11806e-06 ===Show End Prepared event 10000 for Signal with 38982 events Prepared event 20000 for Signal with 38982 events Prepared event 30000 for Signal with 38982 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 141705 for Background Prepared event 0 for Background with 141705 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.219807 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 141705 events Prepared event 20000 for Background with 141705 events Prepared event 30000 for Background with 141705 events Prepared event 40000 for Background with 141705 events Prepared event 50000 for Background with 141705 events Prepared event 60000 for Background with 141705 events Prepared event 70000 for Background with 141705 events Prepared event 80000 for Background with 141705 events Prepared event 90000 for Background with 141705 events Prepared event 100000 for Background with 141705 events Prepared event 110000 for Background with 141705 events Prepared event 120000 for Background with 141705 events Prepared event 130000 for Background with 141705 events Prepared event 140000 for Background with 141705 events Warning: found 4419 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 180687 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4419 negative weights. Signal fraction: 62.6510735 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 62.6909637 64.7586975 66.9571457 68.2945404 69.4471436 70.3649139 71.1106262 71.9475098 72.7874451 73.522049 74.1660919 74.8207474 75.4589386 76.248642 77.0276108 77.6334686 78.3614197 79.0535583 79.6116028 80.3202744 81.101326 81.8020935 82.5556564 83.3647614 84.3289413 85.3582153 86.357193 87.6169739 88.768219 89.9947968 91.7020187 93.3046875 94.9729309 96.5744171 98.2476349 99.7790527 101.425125 103.135254 104.950562 106.56842 108.368469 110.104103 111.804588 113.572166 115.438492 117.063499 118.970032 120.358032 122.139221 123.88472 125.638023 127.450317 128.983185 130.564835 132.332184 134.031921 135.645782 137.160629 138.65036 140.053329 141.567322 143.045563 144.533051 146.260834 147.85231 149.384827 150.876099 152.51712 154.118317 155.905518 157.494141 159.196808 160.906387 162.827026 164.915497 166.809555 168.663177 170.67453 172.660828 175.002686 177.360291 180.015106 182.5849 185.479706 188.597412 191.976364 195.496033 199.116592 203.018616 207.365692 212.360214 218.074402 224.16008 230.925903 239.136475 248.72818 263.713806 282.528015 319.910706 819.677795 ------------------------------ Transdef: Tab for variable 3 20.0002613 20.3838806 20.72715 21.0164337 21.3077354 21.5654221 21.8362236 22.0895996 22.3279781 22.5846939 22.791069 23.0554886 23.2901878 23.5243301 23.7385616 23.9149437 24.1231174 24.3624363 24.5834713 24.8132973 25.0468273 25.230545 25.4178524 25.6390934 25.8790588 26.0606689 26.2642841 26.4719372 26.7274761 26.9600983 27.2008018 27.4700851 27.6830521 27.9411888 28.1846809 28.4321022 28.6737022 28.968359 29.1953373 29.4418526 29.7251358 29.9937172 30.2870255 30.6153679 30.9678822 31.3191853 31.5935459 31.8732643 32.1625252 32.4813271 32.7891998 33.1495705 33.492878 33.835144 34.1985626 34.5990143 35.0033112 35.3664017 35.7453232 36.1177483 36.4645729 36.8608704 37.2878532 37.732605 38.151207 38.5387726 38.9338226 39.2884521 39.7152481 40.1498108 40.6077728 41.0435028 41.514389 41.9653091 42.5025864 42.949398 43.5337448 44.0804634 44.6192284 45.3030472 45.927948 46.5621719 47.2452774 47.8776512 48.5973511 49.4186249 50.1689682 50.9487839 51.8697357 52.8631668 53.8226624 54.8097992 56.0219955 57.3039398 58.7338409 60.3628578 62.4169846 64.8809433 68.8665771 76.3736267 160.265121 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1154013 10.2398796 10.3625832 10.4789534 10.5900126 10.7447796 10.8786125 11.0015059 11.1369076 11.2900028 11.4205036 11.5718765 11.7118282 11.853919 12.0249414 12.1875668 12.3175602 12.5146446 12.6849775 12.8445053 12.983943 13.1712503 13.3732872 13.5597515 13.701088 13.8414907 14.021883 14.2324114 14.4128103 14.6516161 14.8625908 15.1015339 15.3223152 15.5054035 15.7323761 15.8924589 16.1002388 16.3715801 16.5918274 16.8062992 17.0229893 17.2767677 17.5548668 17.8355141 18.1103954 18.369091 18.6616135 18.9137344 19.1596584 19.4178047 19.6990433 20.0037956 20.2270927 20.4616203 20.7160873 20.9872627 21.2416096 21.469944 21.7413788 22.010601 22.2170868 22.4883347 22.7261333 22.9901752 23.2841072 23.5594673 23.8162994 24.0821114 24.3597355 24.6403809 24.9143581 25.184391 25.4619293 25.7821293 26.0567436 26.3141251 26.5919933 26.8979568 27.1977196 27.5237045 27.830349 28.1227608 28.4684181 28.8613834 29.2540474 29.6817093 30.0765076 30.5408211 31.0028133 31.5453548 32.0989685 32.6999283 33.3492432 34.0553741 34.9258842 35.9577179 37.3055649 39.3307114 43.1702576 77.2990036 ------------------------------ Transdef: Tab for variable 5 1.06155312 2.68551922 3.09233665 3.36416173 3.62630796 3.80421925 3.9913187 4.13109303 4.26850176 4.38516235 4.50968647 4.60824442 4.69045162 4.78658009 4.86867905 4.95543957 5.04224825 5.12433338 5.19253159 5.2648077 5.32955313 5.38606167 5.43946075 5.49469423 5.53866291 5.59929943 5.64533329 5.6914525 5.75488901 5.81322193 5.86057758 5.91028118 5.96200562 6.01297998 6.06405926 6.10741425 6.15543222 6.20172882 6.25017929 6.28954887 6.32849026 6.3702774 6.42026711 6.46850395 6.51779318 6.56293964 6.61859465 6.66294003 6.71133423 6.7630043 6.81728268 6.86070347 6.90022659 6.95067406 6.9948349 7.04786587 7.10507011 7.1606226 7.21045589 7.26268673 7.32459354 7.38586235 7.43715858 7.48364162 7.54519463 7.60551071 7.66687679 7.72856998 7.79582739 7.84986305 7.9038353 7.96736526 8.02686882 8.08753395 8.15457535 8.22336388 8.28089714 8.35089588 8.41022205 8.47912312 8.54532242 8.60711956 8.68621445 8.75971031 8.83630276 8.91098309 8.99458408 9.08813095 9.18701744 9.28905487 9.39774132 9.51173592 9.64271164 9.78433132 9.95848083 10.1474924 10.3731575 10.6722202 11.1364269 11.9138327 21.7385216 ------------------------------ Transdef: Tab for variable 6 15.0093117 20.7775784 25.177845 26.1932564 27.1563377 27.9774857 28.8677635 29.6025391 30.4916229 31.0917549 31.6956978 32.2790985 32.760128 33.2639542 33.7362442 34.2709961 34.7072296 35.063652 35.5545197 35.9133911 36.3217926 36.6502762 37.0515366 37.4305611 37.8287773 38.2144928 38.6232452 39.0336075 39.3625717 39.7004166 40.0738449 40.4800873 40.8934326 41.3821983 41.8778839 42.34655 42.7719574 43.2455139 43.7598076 44.3315201 44.7770157 45.4255295 46.0989342 46.8164062 47.4064484 48.0909576 48.7038727 49.3948669 50.0426445 50.7100143 51.4949799 52.323494 53.2342072 54.1325531 54.9814224 55.780983 56.6248245 57.4209175 58.2842636 58.9208946 59.7537918 60.5821762 61.3477592 62.1497192 63.0528412 63.8978844 64.644577 65.3837204 66.2119141 67.0288696 67.9045486 68.7551117 69.5859985 70.470871 71.3126831 72.0740967 73.0168304 73.8403931 74.7176971 75.5679169 76.4946136 77.524826 78.4642639 79.414444 80.5568466 81.6230316 82.9061584 84.2598114 85.4929733 86.7319565 88.1749573 90.0338135 92.0925903 94.4341431 97.0503082 100.415451 104.512009 109.750961 116.553215 130.954376 311.985382 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.4667664 33.7203674 34.3140106 35.0424843 35.5649643 36.0427399 36.434803 36.8246307 37.1575699 37.5299454 37.8776855 38.2106781 38.5371971 38.8025856 39.0856171 39.35989 39.6591339 40.0542526 40.3568039 40.7198486 41.0723953 41.4178619 41.7560349 42.1519852 42.717926 43.1518097 43.750618 44.5937653 45.1500931 45.7496414 46.7971725 47.7202454 48.7262192 49.7989845 50.9824219 52.0492973 53.0977325 54.2781677 55.3655396 56.3176346 57.3546829 58.2351227 59.2939987 60.2782822 61.1814804 61.8892555 62.7694473 63.7088013 64.6753159 65.552803 66.4965515 67.3296967 68.1724701 68.9808655 69.9733276 70.8875885 71.6371994 72.5127563 73.4935303 74.3548584 75.2447968 76.3053436 77.2534485 78.1902466 79.232605 80.3038635 81.4702301 82.5624542 83.7643738 84.9188614 86.167099 87.5858002 89.0684662 90.7336121 92.353775 93.8818207 95.5187531 97.2535629 99.0834503 100.965218 102.816727 104.829575 106.931183 109.132233 111.719238 114.342575 117.227371 120.336212 123.564697 127.030037 131.055481 135.919205 140.705368 146.84613 154.198303 163.029404 173.993881 189.216492 217.449142 457.519592 ------------------------------ Transdef: Tab for variable 8 0.678276479 25.1301651 29.1745224 30.8968334 31.9400711 32.7737465 33.3435669 33.8314743 34.2432365 34.7450867 35.1159973 35.4792442 35.8703423 36.1463852 36.4935722 36.8476753 37.198761 37.4280052 37.7103653 37.9404678 38.2084122 38.5004234 38.7332764 38.9795647 39.2662582 39.5665131 39.8731613 40.1934319 40.4870949 40.8637962 41.2058334 41.5004425 41.912941 42.3517494 42.7482758 43.1811829 43.6705856 44.2083282 44.8068047 45.3440514 46.0595779 46.6529884 47.2978287 48.1614761 48.7952423 49.4260025 50.1628571 50.9150848 51.6100998 52.4188576 53.1788445 53.972374 54.6871605 55.454731 56.1681442 56.9091415 57.6485214 58.3625488 59.1221809 59.9138336 60.6677971 61.2386703 62.0485573 62.764122 63.4842186 64.1669464 64.8945465 65.5581818 66.2812805 67.0321732 67.7290802 68.4955215 69.3326187 70.0957184 70.7801361 71.5894623 72.3351898 73.085495 73.8702087 74.6911392 75.5608826 76.4937363 77.4438477 78.3443985 79.2498474 80.3399277 81.477272 82.7339935 83.8673172 85.2394333 86.8578491 88.6420822 90.6061249 93.0840912 95.8767242 99.6440506 103.446732 108.380104 116.573013 132.771454 363.290375 ------------------------------ Transdef: Tab for variable 9 47.1748543 61.9894485 64.1798553 66.0094147 67.4755707 68.6109543 69.6485901 70.4361725 71.1282043 71.8700714 72.6842804 73.404541 73.9886475 74.4836349 75.1295929 75.7515717 76.4238586 77.04039 77.618042 78.2234726 78.7297897 79.354805 79.786293 80.3616409 81.022644 81.6110077 82.2533875 82.7565765 83.526123 84.408493 85.2093201 86.0250931 86.9395218 88.0197601 88.8985443 89.8319702 91.1160583 92.3157578 93.4352112 94.7138062 96.1716537 97.6077576 98.9638367 100.457108 101.802925 103.321411 105.031136 106.52095 108.111427 109.413574 110.989761 112.36441 113.91185 115.444595 116.789261 118.349106 119.694603 120.689011 122.181564 123.545258 124.801514 126.190903 127.625031 128.824341 130.083878 131.432938 132.724915 133.920044 135.227417 136.536194 137.736786 138.966476 140.124146 141.383179 142.608063 143.725128 144.94931 146.221497 147.430481 148.597107 149.811218 151.082825 152.349609 153.803253 155.115158 156.548187 157.941315 159.393295 160.905304 162.514404 164.348206 166.126648 168.143127 170.227203 172.694946 175.46965 178.812515 183.365677 190.224731 206.087387 418.615662 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.09249675 1.41365385 1.62616491 1.78586292 1.90151095 1.99453175 2.07308912 2.15018177 2.216609 2.26914692 2.31717157 2.36640453 2.40643311 2.44489861 2.48129654 2.51329279 2.54231644 2.56828213 2.59492564 2.61913109 2.64359856 2.66611814 2.6881206 2.70948839 2.72783232 2.74565053 2.7634728 2.77837563 2.79109478 2.80554485 2.81917453 2.8319006 2.84298706 2.85352254 2.86390448 2.87437677 2.88373303 2.89273024 2.90261745 2.91161299 2.91889024 2.92680168 2.93431211 2.94210982 2.94920039 2.95508885 2.96160483 2.96738553 2.97342372 2.9786334 2.98379993 2.98831272 2.99350595 2.99864221 3.00385737 3.00840712 3.01376653 3.01821709 3.02279377 3.02711177 3.03112197 3.03512526 3.03830361 3.04209566 3.04559112 3.04908562 3.05267215 3.05655241 3.05924106 3.06278753 3.06641078 3.06975698 3.07309508 3.07591534 3.07895374 3.08205795 3.08513021 3.08815384 3.09090853 3.09361243 3.09639215 3.09912872 3.10161114 3.1041503 3.1064806 3.10882878 3.11168098 3.11405277 3.11621284 3.11893654 3.12128544 3.12378478 3.12609053 3.12827587 3.13027692 3.13225818 3.13438249 3.13679576 3.13911629 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00526618818 0.011048317 0.0170273744 0.0234181881 0.029807359 0.0377452374 0.046280805 0.0522423238 0.0590121448 0.067142725 0.0750319958 0.0815986991 0.088445127 0.0952428579 0.102686286 0.108850479 0.116244316 0.123244971 0.130267203 0.137268543 0.144201636 0.150707841 0.15706481 0.163318634 0.169641018 0.176161289 0.182917982 0.188588858 0.194592714 0.200513482 0.205244571 0.209935725 0.214848399 0.220408708 0.225766778 0.230413198 0.23558107 0.240961313 0.246714175 0.251452565 0.256391168 0.261155844 0.266340077 0.271602154 0.276649892 0.281560421 0.286570847 0.291691005 0.297015429 0.301753759 0.306584835 0.311611533 0.317319989 0.322877079 0.327795029 0.333098739 0.338193715 0.3439399 0.349700779 0.355005383 0.36045599 0.36633876 0.372038484 0.378754854 0.384963542 0.391237855 0.397097528 0.402850628 0.40907073 0.415457726 0.422120929 0.428894401 0.435848236 0.441943824 0.448896646 0.456149101 0.462055683 0.469107687 0.4776299 0.485605359 0.494581521 0.504647315 0.512770295 0.521217406 0.530201912 0.540154099 0.550668478 0.565099478 0.577821732 0.591298103 0.607861459 0.626070023 0.642865062 0.65909481 0.679744005 0.705623269 0.732816577 0.783112705 0.845786929 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.20003137 0.211946487 0.223356783 0.232930198 0.241010368 0.248115122 0.255712092 0.262740284 0.269544095 0.276498348 0.282019585 0.288325131 0.294389367 0.300427854 0.305596471 0.311571479 0.31688261 0.321767867 0.32694006 0.332046449 0.337638646 0.343191981 0.347887397 0.352463961 0.357925147 0.362922668 0.368290305 0.372795999 0.377002358 0.382885635 0.388077438 0.392462075 0.397259086 0.401412964 0.40552327 0.408984959 0.412351042 0.41609484 0.419358641 0.42274195 0.426354527 0.430043161 0.433880657 0.437327683 0.440865755 0.444457352 0.447455764 0.451538056 0.455504656 0.459423482 0.4636482 0.467619032 0.471677601 0.475719213 0.478780448 0.483311623 0.487410069 0.491937727 0.496268153 0.500599384 0.505524218 0.510274529 0.514662981 0.519582987 0.523963094 0.529242277 0.53509444 0.540926456 0.546409607 0.55236572 0.557627797 0.56343317 0.5688802 0.575124979 0.581873775 0.590105057 0.596302748 0.603906631 0.611415982 0.618473172 0.625843346 0.633994818 0.642514229 0.650794923 0.66088295 0.667761922 0.677270293 0.686847925 0.698553801 0.710450292 0.720602274 0.728813112 0.741924882 0.755160272 0.77095443 0.791159987 0.810240626 0.833519936 0.862248719 0.909337163 1.14129901 ------------------------------ Transdef: Tab for variable 13 20.0075798 21.7913914 22.6149979 23.4123993 24.0030155 24.638649 25.1088829 25.5411072 25.9794044 26.4601173 26.8800049 27.2378273 27.6561127 28.1344528 28.606699 29.0126534 29.4269562 29.7649727 30.137291 30.5027542 30.8795013 31.2034874 31.5608139 31.8864059 32.2618103 32.6346359 33.004921 33.3839378 33.7770691 34.1535263 34.5148163 34.906601 35.2349167 35.610527 36.0233612 36.3089218 36.7363281 37.1807632 37.6109352 38.0309753 38.4670372 38.8618507 39.3108444 39.726387 40.1578293 40.6340485 41.0860367 41.5481262 42.0170784 42.4976807 42.8820953 43.3470154 43.8016968 44.310112 44.8221359 45.2871017 45.7216187 46.225914 46.7279587 47.2246094 47.7173691 48.2059326 48.7281189 49.2230682 49.7123833 50.2718849 50.8459129 51.4516525 52.0887604 52.6852341 53.3574982 54.0048676 54.6897964 55.3236313 56.0296326 56.7787933 57.5085373 58.274231 59.0057678 59.8381538 60.6942673 61.626709 62.5922928 63.4781265 64.4586029 65.6255188 66.8032074 67.8343887 69.2708893 70.6514435 72.387619 74.0789185 75.8983536 78.1589432 80.6449356 83.2094116 86.9913177 90.2919312 95.8673782 106.683563 225.703049 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7037668 11.1582699 11.5046673 11.8377209 12.2789402 12.6532669 12.9821758 13.3208313 13.6530952 13.9708166 14.3054161 14.5796547 14.8674726 15.2371111 15.546833 15.8752747 16.2499504 16.5335159 16.8054714 17.0784473 17.399128 17.7327404 18.0615501 18.3298531 18.6442814 18.9490738 19.1724548 19.4701099 19.8170433 20.1167107 20.4314861 20.7722054 21.0709724 21.3517799 21.6150494 21.87117 22.1688023 22.464119 22.7716103 23.0594292 23.3503399 23.6105766 23.8808346 24.1870193 24.477726 24.7223549 25.0126114 25.2852707 25.5558815 25.7936687 26.0304451 26.280592 26.547287 26.8469162 27.1170158 27.3863525 27.6139412 27.8265266 28.1071606 28.3447685 28.6347733 28.9344711 29.2191963 29.5058689 29.8106117 30.1285706 30.4224014 30.7236557 31.0634155 31.3756371 31.6614914 32.0000496 32.3947678 32.7542801 33.1540718 33.4743195 33.8650589 34.2712669 34.6951752 35.1417389 35.6417999 36.1752243 36.7405167 37.2543678 37.7663269 38.3677635 39.0068321 39.7589149 40.4915161 41.2979012 42.2645645 43.2514496 44.4351044 45.8029709 47.5476151 49.4927597 52.5080147 56.0645256 62.4960442 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.0 53.8 55.1 34.0 52.6 64.9 58.2 66.4 -26.6 -20.8 -43.1 18.3 24.1 2 68.0 100.0 69.9 61.3 40.3 71.3 94.5 77.6 92.1 -42.8 -27.4 -53.4 35.5 32.6 3 53.8 69.9 100.0 49.1 19.1 42.1 71.8 60.2 76.4 -14.3 -29.2 -60.1 64.8 25.6 4 55.1 61.3 49.1 100.0 18.9 39.2 62.3 53.3 65.7 -12.6 -31.3 -63.6 23.8 69.7 5 34.0 40.3 19.1 18.9 100.0 85.5 12.7 60.8 61.3 23.4 -9.3 -16.1 3.4 5.8 6 52.6 71.3 42.1 39.2 85.5 100.0 50.4 80.7 81.9 -5.5 -17.7 -33.5 16.9 18.1 7 64.9 94.5 71.8 62.3 12.7 50.4 100.0 68.7 80.5 -51.9 -26.7 -53.8 38.9 34.9 8 58.2 77.6 60.2 53.3 60.8 80.7 68.7 100.0 85.3 -9.8 -26.1 -47.8 31.1 29.1 9 66.4 92.1 76.4 65.7 61.3 81.9 80.5 85.3 100.0 -18.5 -29.6 -58.8 41.3 36.6 10 -26.6 -42.8 -14.3 -12.6 23.4 -5.5 -51.9 -9.8 -18.5 100.0 4.4 9.9 -3.1 -3.8 11 -20.8 -27.4 -29.2 -31.3 -9.3 -17.7 -26.7 -26.1 -29.6 4.4 100.0 54.0 -13.1 -18.8 12 -43.1 -53.4 -60.1 -63.6 -16.1 -33.5 -53.8 -47.8 -58.8 9.9 54.0 100.0 -31.5 -36.8 13 18.3 35.5 64.8 23.8 3.4 16.9 38.9 31.1 41.3 -3.1 -13.1 -31.5 100.0 49.6 14 24.1 32.6 25.6 69.7 5.8 18.1 34.9 29.1 36.6 -3.8 -18.8 -36.8 49.6 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.349567 TOTAL CORRELATION OF ALL VARIABLES 74.131947 ROUND 1: MAX CORR ( 74.1310426) AFTER KILLING INPUT VARIABLE 6 CONTR 0.366196409 ROUND 2: MAX CORR ( 74.1279312) AFTER KILLING INPUT VARIABLE 8 CONTR 0.67917894 ROUND 3: MAX CORR ( 74.1219921) AFTER KILLING INPUT VARIABLE 11 CONTR 0.938339656 ROUND 4: MAX CORR ( 74.0917189) AFTER KILLING INPUT VARIABLE 2 CONTR 2.1182315 ROUND 5: MAX CORR ( 74.043201) AFTER KILLING INPUT VARIABLE 12 CONTR 2.6808926 ROUND 6: MAX CORR ( 73.9698269) AFTER KILLING INPUT VARIABLE 14 CONTR 3.29550167 ROUND 7: MAX CORR ( 73.613593) AFTER KILLING INPUT VARIABLE 10 CONTR 7.25080779 ROUND 8: MAX CORR ( 72.8449869) AFTER KILLING INPUT VARIABLE 9 CONTR 10.6098521 ROUND 9: MAX CORR ( 71.8299296) AFTER KILLING INPUT VARIABLE 3 CONTR 12.1183054 ROUND 10: MAX CORR ( 71.4893101) AFTER KILLING INPUT VARIABLE 13 CONTR 6.98694004 ROUND 11: MAX CORR ( 69.8568913) AFTER KILLING INPUT VARIABLE 4 CONTR 15.1900029 ROUND 12: MAX CORR ( 64.874426) AFTER KILLING INPUT VARIABLE 5 CONTR 25.9093441 LAST REMAINING VARIABLE: 7 total correlation to target: 74.131947 % total significance: 131.019686 sigma correlations of single variables to target: variable 2: 68.0307989 % , in sigma: 120.236609 variable 3: 53.7517701 % , in sigma: 95.0000687 variable 4: 55.0662381 % , in sigma: 97.3232396 variable 5: 33.9674464 % , in sigma: 60.0335531 variable 6: 52.6365422 % , in sigma: 93.0290318 variable 7: 64.874426 % , in sigma: 114.658083 variable 8: 58.1684157 % , in sigma: 102.805982 variable 9: 66.4452826 % , in sigma: 117.434392 variable 10: -26.631591 % , in sigma: 47.0682727 variable 11: -20.7856071 % , in sigma: 36.7361689 variable 12: -43.1167872 % , in sigma: 76.2039601 variable 13: 18.3316745 % , in sigma: 32.3991254 variable 14: 24.0836786 % , in sigma: 42.5651308 variables sorted by significance: 1 most relevant variable 7 corr 64.8744278 , in sigma: 114.658086 2 most relevant variable 5 corr 25.9093437 , in sigma: 45.7917838 3 most relevant variable 4 corr 15.1900024 , in sigma: 26.8465815 4 most relevant variable 13 corr 6.98693991 , in sigma: 12.3486123 5 most relevant variable 3 corr 12.1183052 , in sigma: 21.4177101 6 most relevant variable 9 corr 10.6098518 , in sigma: 18.7516923 7 most relevant variable 10 corr 7.25080776 , in sigma: 12.8149684 8 most relevant variable 14 corr 3.29550171 , in sigma: 5.82442007 9 most relevant variable 12 corr 2.68089271 , in sigma: 4.73816938 10 most relevant variable 2 corr 2.11823153 , in sigma: 3.7437305 11 most relevant variable 11 corr 0.938339651 , in sigma: 1.65840736 12 most relevant variable 8 corr 0.679178953 , in sigma: 1.20037065 13 most relevant variable 6 corr 0.366196424 , in sigma: 0.647210043 global correlations between input variables: variable 2: 99.2638427 % variable 3: 93.6648477 % variable 4: 91.5528619 % variable 5: 95.8176775 % variable 6: 95.3090893 % variable 7: 98.9076428 % variable 8: 90.7170746 % variable 9: 98.85699 % variable 10: 71.9963361 % variable 11: 54.9591227 % variable 12: 78.3788776 % variable 13: 85.7409564 % variable 14: 87.4327612 % significance loss when removing single variables: variable 2: corr = 2.28240794 % , sigma = 4.03389341 variable 3: corr = 13.979829 % , sigma = 24.7077392 variable 4: corr = 15.2769246 % , sigma = 27.0002065 variable 5: corr = 14.0630897 % , sigma = 24.8548929 variable 6: corr = 0.366196409 % , sigma = 0.647210016 variable 7: corr = 6.43718221 % , sigma = 11.3769789 variable 8: corr = 0.765014227 % , sigma = 1.35207462 variable 9: corr = 9.72694828 % , sigma = 17.1912619 variable 10: corr = 6.71733862 % , sigma = 11.8721231 variable 11: corr = 0.987018423 % , sigma = 1.74444149 variable 12: corr = 2.03307908 % , sigma = 3.59323334 variable 13: corr = 5.83559754 % , sigma = 10.3137472 variable 14: corr = 3.32055106 % , sigma = 5.86869193 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.806818 sigma out 15 active outputs RANK 2 NODE 6 --> 21.1931248 sigma out 15 active outputs RANK 3 NODE 8 --> 20.4171391 sigma out 15 active outputs RANK 4 NODE 10 --> 20.3660202 sigma out 15 active outputs RANK 5 NODE 9 --> 18.6490936 sigma out 15 active outputs RANK 6 NODE 3 --> 17.1779327 sigma out 15 active outputs RANK 7 NODE 5 --> 15.9771242 sigma out 15 active outputs RANK 8 NODE 4 --> 15.8367128 sigma out 15 active outputs RANK 9 NODE 1 --> 14.7052116 sigma out 15 active outputs RANK 10 NODE 7 --> 13.7552614 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 26.4873772 sigma in 10act. ( 23.9554958 sig out 1act.) RANK 2 NODE 15 --> 25.3094387 sigma in 10act. ( 28.6789646 sig out 1act.) RANK 3 NODE 6 --> 22.2385445 sigma in 10act. ( 21.229969 sig out 1act.) RANK 4 NODE 8 --> 18.7826424 sigma in 10act. ( 20.5794563 sig out 1act.) RANK 5 NODE 14 --> 15.0303593 sigma in 10act. ( 12.9170055 sig out 1act.) RANK 6 NODE 4 --> 14.819767 sigma in 10act. ( 18.7231979 sig out 1act.) RANK 7 NODE 13 --> 14.302886 sigma in 10act. ( 11.6489067 sig out 1act.) RANK 8 NODE 9 --> 13.584568 sigma in 10act. ( 13.4821091 sig out 1act.) RANK 9 NODE 3 --> 11.3951693 sigma in 10act. ( 9.57202435 sig out 1act.) RANK 10 NODE 12 --> 8.69606018 sigma in 10act. ( 10.5567026 sig out 1act.) RANK 11 NODE 2 --> 7.63751125 sigma in 10act. ( 9.39402771 sig out 1act.) RANK 12 NODE 1 --> 7.28288364 sigma in 10act. ( 7.98209238 sig out 1act.) RANK 13 NODE 5 --> 7.21530104 sigma in 10act. ( 5.39136934 sig out 1act.) RANK 14 NODE 11 --> 2.29616022 sigma in 10act. ( 2.56653285 sig out 1act.) RANK 15 NODE 7 --> 1.90316558 sigma in 10act. ( 2.40996194 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 28.6789646 sigma out 1act.( 25.3094387 sig in 10act.) RANK 2 NODE 10 --> 23.9554958 sigma out 1act.( 26.4873772 sig in 10act.) RANK 3 NODE 6 --> 21.229969 sigma out 1act.( 22.2385445 sig in 10act.) RANK 4 NODE 8 --> 20.5794563 sigma out 1act.( 18.7826424 sig in 10act.) RANK 5 NODE 4 --> 18.7231979 sigma out 1act.( 14.819767 sig in 10act.) RANK 6 NODE 9 --> 13.4821091 sigma out 1act.( 13.584568 sig in 10act.) RANK 7 NODE 14 --> 12.9170055 sigma out 1act.( 15.0303593 sig in 10act.) RANK 8 NODE 13 --> 11.6489067 sigma out 1act.( 14.302886 sig in 10act.) RANK 9 NODE 12 --> 10.5567026 sigma out 1act.( 8.69606018 sig in 10act.) RANK 10 NODE 3 --> 9.57202435 sigma out 1act.( 11.3951693 sig in 10act.) RANK 11 NODE 2 --> 9.39402771 sigma out 1act.( 7.63751125 sig in 10act.) RANK 12 NODE 1 --> 7.98209238 sigma out 1act.( 7.28288364 sig in 10act.) RANK 13 NODE 5 --> 5.39136934 sigma out 1act.( 7.21530104 sig in 10act.) RANK 14 NODE 11 --> 2.56653285 sigma out 1act.( 2.29616022 sig in 10act.) RANK 15 NODE 7 --> 2.40996194 sigma out 1act.( 1.90316558 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 59.177166 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 28.2969284 sigma out 15 active outputs RANK 2 NODE 8 --> 21.5530281 sigma out 15 active outputs RANK 3 NODE 10 --> 20.9665508 sigma out 15 active outputs RANK 4 NODE 6 --> 20.8599281 sigma out 15 active outputs RANK 5 NODE 9 --> 19.8791237 sigma out 15 active outputs RANK 6 NODE 3 --> 16.5625801 sigma out 15 active outputs RANK 7 NODE 4 --> 15.9611883 sigma out 15 active outputs RANK 8 NODE 7 --> 14.9162254 sigma out 15 active outputs RANK 9 NODE 5 --> 14.7637234 sigma out 15 active outputs RANK 10 NODE 1 --> 14.3286171 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 26.1267338 sigma in 10act. ( 26.9532909 sig out 1act.) RANK 2 NODE 10 --> 25.383337 sigma in 10act. ( 21.2101269 sig out 1act.) RANK 3 NODE 6 --> 20.7534027 sigma in 10act. ( 18.4903488 sig out 1act.) RANK 4 NODE 8 --> 20.3691616 sigma in 10act. ( 19.6710453 sig out 1act.) RANK 5 NODE 4 --> 19.9183426 sigma in 10act. ( 17.7877712 sig out 1act.) RANK 6 NODE 9 --> 14.7316618 sigma in 10act. ( 13.342761 sig out 1act.) RANK 7 NODE 12 --> 12.6634531 sigma in 10act. ( 10.0639849 sig out 1act.) RANK 8 NODE 2 --> 11.9724846 sigma in 10act. ( 9.42219639 sig out 1act.) RANK 9 NODE 13 --> 11.5847788 sigma in 10act. ( 9.52304268 sig out 1act.) RANK 10 NODE 14 --> 11.5201044 sigma in 10act. ( 10.3945293 sig out 1act.) RANK 11 NODE 3 --> 9.44257259 sigma in 10act. ( 7.83030653 sig out 1act.) RANK 12 NODE 7 --> 9.1715641 sigma in 10act. ( 4.05340481 sig out 1act.) RANK 13 NODE 1 --> 8.57901859 sigma in 10act. ( 8.02408886 sig out 1act.) RANK 14 NODE 5 --> 8.13186169 sigma in 10act. ( 4.7026 sig out 1act.) RANK 15 NODE 11 --> 6.3318429 sigma in 10act. ( 3.54135084 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 26.9532909 sigma out 1act.( 26.1267338 sig in 10act.) RANK 2 NODE 10 --> 21.2101269 sigma out 1act.( 25.383337 sig in 10act.) RANK 3 NODE 8 --> 19.6710453 sigma out 1act.( 20.3691616 sig in 10act.) RANK 4 NODE 6 --> 18.4903488 sigma out 1act.( 20.7534027 sig in 10act.) RANK 5 NODE 4 --> 17.7877712 sigma out 1act.( 19.9183426 sig in 10act.) RANK 6 NODE 9 --> 13.342761 sigma out 1act.( 14.7316618 sig in 10act.) RANK 7 NODE 14 --> 10.3945293 sigma out 1act.( 11.5201044 sig in 10act.) RANK 8 NODE 12 --> 10.0639849 sigma out 1act.( 12.6634531 sig in 10act.) RANK 9 NODE 13 --> 9.52304268 sigma out 1act.( 11.5847788 sig in 10act.) RANK 10 NODE 2 --> 9.42219639 sigma out 1act.( 11.9724846 sig in 10act.) RANK 11 NODE 1 --> 8.02408886 sigma out 1act.( 8.57901859 sig in 10act.) RANK 12 NODE 3 --> 7.83030653 sigma out 1act.( 9.44257259 sig in 10act.) RANK 13 NODE 5 --> 4.7026 sigma out 1act.( 8.13186169 sig in 10act.) RANK 14 NODE 7 --> 4.05340481 sigma out 1act.( 9.1715641 sig in 10act.) RANK 15 NODE 11 --> 3.54135084 sigma out 1act.( 6.3318429 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.4537239 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.483499348 *** contribution from regularisation: 0.00391395297 *** contribution from error: -0.487413287 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.52705133 *** contribution from regularisation: 0.00266306777 *** contribution from error: -0.529714406 *********************************************** -----------------> Test sample ENTER BFGS code START -47624.4313 0.117962375 -0.204274356 EXIT FROM BFGS code FG_START 0. 0.117962375 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.550108135 *** contribution from regularisation: 0.0021993313 *** contribution from error: -0.552307487 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49698.4175 0.117962375 -175.050262 EXIT FROM BFGS code FG_LNSRCH 0. 0.0683544353 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.578271806 *** contribution from regularisation: 0.00284937932 *** contribution from error: -0.581121206 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52242.811 0.0683544353 -141.765198 EXIT FROM BFGS code NEW_X -52242.811 0.0683544353 -141.765198 ENTER BFGS code NEW_X -52242.811 0.0683544353 -141.765198 EXIT FROM BFGS code FG_LNSRCH 0. 0.0196729917 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.582435846 *** contribution from regularisation: 0.0029084743 *** contribution from error: -0.585344315 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52619.0028 0.0196729917 -31.6221046 EXIT FROM BFGS code NEW_X -52619.0028 0.0196729917 -31.6221046 ENTER BFGS code NEW_X -52619.0028 0.0196729917 -31.6221046 EXIT FROM BFGS code FG_LNSRCH 0. -0.000145105063 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.583892584 *** contribution from regularisation: 0.00280438573 *** contribution from error: -0.586696982 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52750.6086 -0.000145105063 -9.29307079 EXIT FROM BFGS code NEW_X -52750.6086 -0.000145105063 -9.29307079 ENTER BFGS code NEW_X -52750.6086 -0.000145105063 -9.29307079 EXIT FROM BFGS code FG_LNSRCH 0. -0.0108175473 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.584201694 *** contribution from regularisation: 0.00267196051 *** contribution from error: -0.586873651 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52778.5314 -0.0108175473 5.16811132 EXIT FROM BFGS code NEW_X -52778.5314 -0.0108175473 5.16811132 ENTER BFGS code NEW_X -52778.5314 -0.0108175473 5.16811132 EXIT FROM BFGS code FG_LNSRCH 0. -0.0183088128 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.584366024 *** contribution from regularisation: 0.002633753 *** contribution from error: -0.586999774 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52793.3822 -0.0183088128 0.166047171 EXIT FROM BFGS code NEW_X -52793.3822 -0.0183088128 0.166047171 ENTER BFGS code NEW_X -52793.3822 -0.0183088128 0.166047171 EXIT FROM BFGS code FG_LNSRCH 0. -0.0672115088 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.584944665 *** contribution from regularisation: 0.00232801656 *** contribution from error: -0.587272704 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52845.6551 -0.0672115088 10.8110781 EXIT FROM BFGS code NEW_X -52845.6551 -0.0672115088 10.8110781 ENTER BFGS code NEW_X -52845.6551 -0.0672115088 10.8110781 EXIT FROM BFGS code FG_LNSRCH 0. -0.130967811 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 31.441803 sigma out 15 active outputs RANK 2 NODE 1 --> 19.2157803 sigma out 15 active outputs RANK 3 NODE 8 --> 15.5999231 sigma out 15 active outputs RANK 4 NODE 9 --> 12.9755497 sigma out 15 active outputs RANK 5 NODE 10 --> 12.3013391 sigma out 15 active outputs RANK 6 NODE 7 --> 11.5366001 sigma out 15 active outputs RANK 7 NODE 6 --> 10.7983589 sigma out 15 active outputs RANK 8 NODE 4 --> 9.72610569 sigma out 15 active outputs RANK 9 NODE 5 --> 6.72147655 sigma out 15 active outputs RANK 10 NODE 3 --> 5.27314043 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 19.8917694 sigma in 10act. ( 16.5330906 sig out 1act.) RANK 2 NODE 4 --> 19.408041 sigma in 10act. ( 16.2142162 sig out 1act.) RANK 3 NODE 15 --> 17.9056416 sigma in 10act. ( 16.9004383 sig out 1act.) RANK 4 NODE 2 --> 16.0461578 sigma in 10act. ( 17.2003822 sig out 1act.) RANK 5 NODE 12 --> 15.3146143 sigma in 10act. ( 13.3091755 sig out 1act.) RANK 6 NODE 9 --> 13.9778481 sigma in 10act. ( 10.4336624 sig out 1act.) RANK 7 NODE 10 --> 12.8932819 sigma in 10act. ( 9.67182159 sig out 1act.) RANK 8 NODE 11 --> 12.125164 sigma in 10act. ( 10.4884901 sig out 1act.) RANK 9 NODE 8 --> 8.38637352 sigma in 10act. ( 6.51338863 sig out 1act.) RANK 10 NODE 1 --> 7.3972168 sigma in 10act. ( 6.58360243 sig out 1act.) RANK 11 NODE 6 --> 6.66766977 sigma in 10act. ( 4.71619272 sig out 1act.) RANK 12 NODE 13 --> 6.12487459 sigma in 10act. ( 5.84911871 sig out 1act.) RANK 13 NODE 5 --> 4.46695089 sigma in 10act. ( 3.50028658 sig out 1act.) RANK 14 NODE 14 --> 3.38464451 sigma in 10act. ( 2.94694638 sig out 1act.) RANK 15 NODE 3 --> 2.47110438 sigma in 10act. ( 0.542350829 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 17.2003822 sigma out 1act.( 16.0461578 sig in 10act.) RANK 2 NODE 15 --> 16.9004383 sigma out 1act.( 17.9056416 sig in 10act.) RANK 3 NODE 7 --> 16.5330906 sigma out 1act.( 19.8917694 sig in 10act.) RANK 4 NODE 4 --> 16.2142162 sigma out 1act.( 19.408041 sig in 10act.) RANK 5 NODE 12 --> 13.3091755 sigma out 1act.( 15.3146143 sig in 10act.) RANK 6 NODE 11 --> 10.4884901 sigma out 1act.( 12.125164 sig in 10act.) RANK 7 NODE 9 --> 10.4336624 sigma out 1act.( 13.9778481 sig in 10act.) RANK 8 NODE 10 --> 9.67182159 sigma out 1act.( 12.8932819 sig in 10act.) RANK 9 NODE 1 --> 6.58360243 sigma out 1act.( 7.3972168 sig in 10act.) RANK 10 NODE 8 --> 6.51338863 sigma out 1act.( 8.38637352 sig in 10act.) RANK 11 NODE 13 --> 5.84911871 sigma out 1act.( 6.12487459 sig in 10act.) RANK 12 NODE 6 --> 4.71619272 sigma out 1act.( 6.66766977 sig in 10act.) RANK 13 NODE 5 --> 3.50028658 sigma out 1act.( 4.46695089 sig in 10act.) RANK 14 NODE 14 --> 2.94694638 sigma out 1act.( 3.38464451 sig in 10act.) RANK 15 NODE 3 --> 0.542350829 sigma out 1act.( 2.47110438 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.0799637 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.585004985 *** contribution from regularisation: 0.00218536868 *** contribution from error: -0.58719033 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52851.1029 -0.130967811 -36.3489189 EXIT FROM BFGS code NEW_X -52851.1029 -0.130967811 -36.3489189 ENTER BFGS code NEW_X -52851.1029 -0.130967811 -36.3489189 EXIT FROM BFGS code FG_LNSRCH 0. -0.178860709 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.584875643 *** contribution from regularisation: 0.00268614991 *** contribution from error: -0.587561786 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52839.4187 -0.178860709 22.5116081 EXIT FROM BFGS code FG_LNSRCH 0. -0.146104395 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.5847857 *** contribution from regularisation: 0.00272534136 *** contribution from error: -0.587511063 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52831.2958 -0.146104395 -20.0161362 EXIT FROM BFGS code FG_LNSRCH 0. -0.132847086 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.584546924 *** contribution from regularisation: 0.00269253482 *** contribution from error: -0.587239444 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52809.7215 -0.132847086 -34.9521217 EXIT FROM BFGS code FG_LNSRCH 0. -0.130994156 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.584505916 *** contribution from regularisation: 0.0026852279 *** contribution from error: -0.587191164 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52806.0155 -0.130994156 -37.0214844 EXIT FROM BFGS code FG_LNSRCH 0. -0.130967811 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.584517419 *** contribution from regularisation: 0.00267293234 *** contribution from error: -0.58719033 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52807.0549 -0.130967811 -37.1512032 EXIT FROM BFGS code FG_LNSRCH 0. -0.130967811 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.584514558 *** contribution from regularisation: 0.0026757915 *** contribution from error: -0.58719033 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52806.7966 -0.130967811 -37.2161674 EXIT FROM BFGS code FG_LNSRCH 0. -0.130967811 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.584519863 *** contribution from regularisation: 0.00267045805 *** contribution from error: -0.58719033 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52807.2784 -0.130967811 -37.3148193 EXIT FROM BFGS code FG_LNSRCH 0. -0.130967811 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.584526777 *** contribution from regularisation: 0.00266357465 *** contribution from error: -0.58719033 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52807.9003 -0.130967811 -37.38237 EXIT FROM BFGS code NEW_X -52807.9003 -0.130967811 -37.38237 ENTER BFGS code NEW_X -52807.9003 -0.130967811 -37.38237 EXIT FROM BFGS code CONVERGENC -52807.9003 -0.130967811 -37.38237 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 50.2892036 sigma out 15 active outputs RANK 2 NODE 1 --> 31.9745045 sigma out 15 active outputs RANK 3 NODE 8 --> 25.3836918 sigma out 15 active outputs RANK 4 NODE 9 --> 21.3120461 sigma out 15 active outputs RANK 5 NODE 10 --> 20.6935806 sigma out 15 active outputs RANK 6 NODE 7 --> 18.697134 sigma out 15 active outputs RANK 7 NODE 6 --> 17.9562092 sigma out 15 active outputs RANK 8 NODE 4 --> 15.2553654 sigma out 15 active outputs RANK 9 NODE 5 --> 10.6209927 sigma out 15 active outputs RANK 10 NODE 3 --> 8.17031002 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 33.087429 sigma in 10act. ( 26.5174484 sig out 1act.) RANK 2 NODE 4 --> 32.1024628 sigma in 10act. ( 27.4111252 sig out 1act.) RANK 3 NODE 15 --> 29.199543 sigma in 10act. ( 27.7707481 sig out 1act.) RANK 4 NODE 2 --> 26.0887566 sigma in 10act. ( 28.3815441 sig out 1act.) RANK 5 NODE 12 --> 24.8225994 sigma in 10act. ( 22.0535526 sig out 1act.) RANK 6 NODE 9 --> 22.7910194 sigma in 10act. ( 16.5516434 sig out 1act.) RANK 7 NODE 10 --> 20.4489632 sigma in 10act. ( 15.7138042 sig out 1act.) RANK 8 NODE 11 --> 19.6462479 sigma in 10act. ( 16.7773075 sig out 1act.) RANK 9 NODE 8 --> 13.1680584 sigma in 10act. ( 10.3985023 sig out 1act.) RANK 10 NODE 1 --> 11.4030447 sigma in 10act. ( 10.3775988 sig out 1act.) RANK 11 NODE 6 --> 9.72853947 sigma in 10act. ( 7.8216691 sig out 1act.) RANK 12 NODE 13 --> 9.67243576 sigma in 10act. ( 9.64952469 sig out 1act.) RANK 13 NODE 5 --> 6.33331442 sigma in 10act. ( 5.76000261 sig out 1act.) RANK 14 NODE 14 --> 4.92833996 sigma in 10act. ( 4.56086302 sig out 1act.) RANK 15 NODE 3 --> 2.84416533 sigma in 10act. ( 0.897200406 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 28.3815441 sigma out 1act.( 26.0887566 sig in 10act.) RANK 2 NODE 15 --> 27.7707481 sigma out 1act.( 29.199543 sig in 10act.) RANK 3 NODE 4 --> 27.4111252 sigma out 1act.( 32.1024628 sig in 10act.) RANK 4 NODE 7 --> 26.5174484 sigma out 1act.( 33.087429 sig in 10act.) RANK 5 NODE 12 --> 22.0535526 sigma out 1act.( 24.8225994 sig in 10act.) RANK 6 NODE 11 --> 16.7773075 sigma out 1act.( 19.6462479 sig in 10act.) RANK 7 NODE 9 --> 16.5516434 sigma out 1act.( 22.7910194 sig in 10act.) RANK 8 NODE 10 --> 15.7138042 sigma out 1act.( 20.4489632 sig in 10act.) RANK 9 NODE 8 --> 10.3985023 sigma out 1act.( 13.1680584 sig in 10act.) RANK 10 NODE 1 --> 10.3775988 sigma out 1act.( 11.4030447 sig in 10act.) RANK 11 NODE 13 --> 9.64952469 sigma out 1act.( 9.67243576 sig in 10act.) RANK 12 NODE 6 --> 7.8216691 sigma out 1act.( 9.72853947 sig in 10act.) RANK 13 NODE 5 --> 5.76000261 sigma out 1act.( 6.33331442 sig in 10act.) RANK 14 NODE 14 --> 4.56086302 sigma out 1act.( 4.92833996 sig in 10act.) RANK 15 NODE 3 --> 0.897200406 sigma out 1act.( 2.84416533 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 68.8831482 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.584534407 *** contribution from regularisation: 0.00265593291 *** contribution from error: -0.58719033 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25490 Closing output file done