NNInput NNInputs_185.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 181242 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 34307 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 34307 Chosen entries: 34307 Signal fraction: 1 Background fraction: 0.233484 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 34307 Entries to split: 34307 Test with : 17153 Train with : 17153 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 34307 for Signal Prepared event 0 for Signal with 34307 events ====Entry 0 Variable Ht : 147.006 Variable LepAPt : 30.5393 Variable LepBPt : 15.4876 Variable MetSigLeptonsJets : 2.11691 Variable MetSpec : 17.0117 Variable SumEtLeptonsJets : 123.482 Variable VSumJetLeptonsPt : 38.8269 Variable addEt : 69.5511 Variable dPhiLepSumMet : 0.952509 Variable dPhiLeptons : 0.431247 Variable dRLeptons : 0.583611 Variable lep1_E : 46.6216 Variable lep2_E : 18.2884 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2185 Ht = 147.006 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.5393 LepAPt = 30.5393 LepBEt = 15.4881 LepBPt = 15.4876 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 23.5237 MetDelPhi = 0.808389 MetSig = 1.71418 MetSigLeptonsJets = 2.11691 MetSpec = 17.0117 Mjj = 0 MostCentralJetEta = -1.43393 MtllMet = 76.1567 Njets = 1 SB = 0 SumEt = 188.32 SumEtJets = 0 SumEtLeptonsJets = 123.482 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 38.8269 addEt = 69.5511 dPhiLepSumMet = 0.952509 dPhiLeptons = 0.431247 dRLeptons = 0.583611 diltype = 52 dimass = 12.6791 event = 96 jet1_Et = 77.4552 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.6216 lep2_E = 18.2884 rand = 0.999742 run = 231298 weight = 2.74614e-06 ===Show End Prepared event 10000 for Signal with 34307 events Prepared event 20000 for Signal with 34307 events Prepared event 30000 for Signal with 34307 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.18222 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4495 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 181242 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4495 negative weights. Signal fraction: 62.5834389 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.3116226 62.4434891 64.5697174 66.4465485 67.9654541 69.0694504 70.2084961 71.1103821 71.8700714 72.847084 73.5599594 74.1343079 74.78125 75.4501038 76.0470428 76.7955933 77.2877655 77.875 78.5317535 79.1959839 79.7631531 80.494812 81.1552887 81.809845 82.4462433 83.232666 84.1094589 85.2025528 86.1289673 87.1144257 88.5254059 89.7452164 91.3318024 93.1737137 94.9327621 96.4734116 97.9989471 99.600296 101.14743 102.873741 104.682999 106.333252 107.973602 109.633316 111.21077 112.811035 114.654579 116.425003 118.276749 120.276009 121.852158 123.601395 125.222084 126.903885 128.597687 130.39212 132.207504 133.606415 135.32962 136.915894 138.480316 140.207977 141.691895 143.291626 144.998581 146.392944 148.039612 149.624847 151.394257 153.189545 155.037476 156.996124 158.782684 160.668884 162.706238 164.697906 166.667389 168.781311 171.057739 173.323242 175.697418 178.091751 180.540253 183.249207 186.112305 188.816833 191.695801 195.151764 199.152283 203.189331 207.532471 212.049194 217.082062 222.877029 230.42749 238.846512 249.204987 263.401733 282.480438 319.486389 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2988586 20.5945587 20.8826065 21.1509552 21.4190178 21.6885071 21.8974438 22.1137028 22.3491096 22.5641098 22.8002396 23.0283566 23.223032 23.4492455 23.6697731 23.8230095 24.0218163 24.2227535 24.4560642 24.675087 24.9030457 25.1099949 25.3298645 25.5733643 25.7362556 25.9399681 26.1912537 26.4167004 26.6689072 26.9025421 27.1141281 27.3567352 27.6416054 27.8778458 28.0910645 28.304388 28.6015701 28.8506985 29.1379261 29.3709831 29.6602554 29.9043732 30.1973953 30.497488 30.805397 31.1261616 31.4370289 31.7539444 32.0732956 32.3991051 32.7265854 33.0337982 33.3524055 33.6855774 34.0637283 34.4864578 34.8154831 35.2412109 35.5895386 35.9625206 36.3645515 36.7268753 37.106575 37.5521774 37.9842644 38.4442444 38.948513 39.4089508 39.8850937 40.4141388 40.895195 41.4505692 41.9476585 42.4631233 43.0172653 43.6045303 44.2152061 44.9278755 45.5374947 46.2113876 46.9764633 47.7573166 48.4487343 49.2357101 50.0357018 50.9250641 51.8166962 52.7427063 53.8031769 54.9265976 56.0632401 57.4019928 58.8331146 60.2710419 61.9405518 63.8537979 66.5231476 70.3921738 77.8759308 212.48645 ------------------------------ Transdef: Tab for variable 4 10.000247 10.1179342 10.2327518 10.357523 10.4590883 10.5858679 10.7201357 10.8377056 10.9672928 11.0728302 11.2239723 11.3543644 11.4698629 11.5904417 11.7305899 11.8609276 12.0189114 12.172431 12.3065987 12.466362 12.6415386 12.7936687 12.9487391 13.1252823 13.3273029 13.4976206 13.6831741 13.8741961 14.0481119 14.2240562 14.4098339 14.5879288 14.7938366 14.9837036 15.1849899 15.3635025 15.5832767 15.7831936 15.9893169 16.2178421 16.4499702 16.6768951 16.8541927 17.1174755 17.3828716 17.6281853 17.8682251 18.1234436 18.3740711 18.5771942 18.831749 19.0591431 19.2933235 19.5796967 19.837923 20.1197414 20.3396492 20.5620785 20.8099365 21.0602989 21.267786 21.4880104 21.7188072 21.9508877 22.177597 22.4097481 22.6408882 22.8756561 23.1394653 23.3980637 23.66465 23.932745 24.2099476 24.4947796 24.7456341 25.0162754 25.2962914 25.6133289 25.9124794 26.1961517 26.4945259 26.8134499 27.1655426 27.5100555 27.8972244 28.2784996 28.6635094 29.0714474 29.5223198 30.0075912 30.5496254 31.1275959 31.6844635 32.3376389 33.0133171 33.7954521 34.8190536 36.1659851 38.0464554 41.3198738 72.7606735 ------------------------------ Transdef: Tab for variable 5 1.0227313 2.61723256 3.04462862 3.30445147 3.55577421 3.7741437 3.94671345 4.09512234 4.23002529 4.35651588 4.47349215 4.57758427 4.65644073 4.76425743 4.85210609 4.94757175 5.02259684 5.10152817 5.17162132 5.24009418 5.30086327 5.36745644 5.42075539 5.46286583 5.52262306 5.57187319 5.62623024 5.6777935 5.72908783 5.78320122 5.82953262 5.87638998 5.92536163 5.97722912 6.02027225 6.06845522 6.10928106 6.15032196 6.19962502 6.24298096 6.28255939 6.32301998 6.36847019 6.41241741 6.46081877 6.50708961 6.55047655 6.60101318 6.65539932 6.70563602 6.74857998 6.79683018 6.84283829 6.88470411 6.93931293 6.98708725 7.03444099 7.08284569 7.14232635 7.20518303 7.26016521 7.3162055 7.37633562 7.43050671 7.49069691 7.54607773 7.60696507 7.67373753 7.73575878 7.80224133 7.86116791 7.92259836 7.9847641 8.04675674 8.11101151 8.17852402 8.2393465 8.29876328 8.36755943 8.43315887 8.50816345 8.57829094 8.65162659 8.73306084 8.81066513 8.88743591 8.98266411 9.0722847 9.16621876 9.2582016 9.36322498 9.4759922 9.60339737 9.74414444 9.90001678 10.1006327 10.3323765 10.6484814 11.121254 11.9254007 20.7051888 ------------------------------ Transdef: Tab for variable 6 15.0042896 20.0580406 24.9429016 25.9219398 26.8903008 27.7257004 28.7006741 29.3901291 30.1435547 30.7779369 31.4389324 32.0678291 32.5849457 33.0835724 33.5350952 34.0507889 34.5077667 34.8425598 35.2391129 35.685688 36.0194206 36.4315948 36.7904282 37.1760139 37.5030212 37.8686943 38.2281342 38.5861053 39.002037 39.3680954 39.6855392 40.1044693 40.4381104 40.8210678 41.1728592 41.6006699 42.0348129 42.4928131 42.9068832 43.3365059 43.7478447 44.2590866 44.8459015 45.5425949 46.279892 46.9013977 47.5576324 48.3018341 48.9528732 49.7770844 50.4381905 51.2251816 52.0776443 52.9811172 53.8420715 54.6137428 55.3935776 56.2302475 56.9738693 57.769062 58.5035172 59.3339691 60.1540871 61.1493835 61.9958954 62.8821259 63.7908249 64.5648651 65.3741074 66.1689301 67.0858459 68.0105667 68.8685303 69.8127823 70.6679001 71.5347595 72.481842 73.3735046 74.268219 75.2627258 76.2698059 77.312912 78.4304276 79.4623184 80.6103516 81.8202362 82.9210052 84.1782837 85.5068588 86.9245911 88.5188675 90.4769516 92.4448547 94.7677917 97.1897278 100.4161 103.972382 109.505707 117.485611 129.89949 261.761749 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.6011963 33.4947357 34.1699829 34.7755814 35.3712158 35.8011093 36.1749077 36.5427437 36.9524155 37.2973022 37.6564865 38.0323296 38.3385658 38.6869049 38.978447 39.2718887 39.5258102 39.8374405 40.1275864 40.4300003 40.8068161 41.1887627 41.4881783 41.8398094 42.2804565 42.7186279 43.2654152 43.9683151 44.697876 45.2897415 46.1607132 47.0551872 48.0146866 48.9475708 49.9975891 51.0489464 52.1742096 53.2511444 54.2004242 55.2812958 56.222023 57.2348404 58.205307 59.0809059 60.1333771 61.0913429 61.9494934 62.8292351 63.8287048 64.6408081 65.3618317 66.3196869 67.1133423 68.1750641 69.0533829 70.066803 71.0558777 72.0005188 72.9117508 73.7793808 74.7311325 75.7436066 76.7868195 77.7874146 78.9551697 80.184021 81.2532806 82.3106537 83.4925537 84.6633148 86.1539307 87.487915 89.0124207 90.4662476 91.8465347 93.5444565 95.2540283 96.9883881 98.8577499 101.018326 102.884705 105.017525 107.201019 109.691856 111.985367 114.638367 117.594238 120.687637 123.653015 127.436745 131.407471 136.115265 140.980331 147.117676 154.207718 162.240677 173.672058 189.619949 215.915527 522.386658 ------------------------------ Transdef: Tab for variable 8 0.678276479 23.7134171 28.5852985 30.5141354 31.735611 32.4520836 32.989975 33.4896622 33.9416122 34.4602089 34.9436798 35.2435074 35.5656548 35.9109192 36.2086334 36.5327454 36.837471 37.1572876 37.3900833 37.6516647 37.957283 38.208992 38.5280991 38.794899 39.0352936 39.3104477 39.6178055 39.8636856 40.1603622 40.4478111 40.7832642 41.0917778 41.3829956 41.7674561 42.1783981 42.6479759 43.1109695 43.6221275 44.1457062 44.6886673 45.2420273 45.8590813 46.4647903 47.100647 47.8150635 48.4771767 49.0337486 49.6637688 50.4314041 51.1958008 51.9104462 52.6955795 53.3907089 54.0816803 54.9294662 55.7393723 56.4773254 57.2182846 57.9923401 58.7312164 59.5024338 60.2826233 60.996006 61.783783 62.5422058 63.2419052 63.9320259 64.6625824 65.3619232 66.0821838 66.812561 67.6469421 68.5232391 69.4166565 70.2022705 70.9518356 71.7855377 72.5888977 73.3512726 74.1876831 75.0682831 76.0435715 77.0184402 78.0559082 79.1556396 80.2864151 81.5170746 82.8304138 84.0869598 85.5764771 87.2649994 88.9561081 90.9462738 93.1484299 96.0418243 99.5359802 103.431839 108.231316 116.162521 131.44693 326.868286 ------------------------------ Transdef: Tab for variable 9 47.3116226 61.8104935 63.8264046 65.6870117 67.2562408 68.3633881 69.2864685 70.1874008 70.9358673 71.6350403 72.4591675 73.2583084 73.8471985 74.3068237 74.9043274 75.4905853 75.9475098 76.645134 77.0636749 77.5985794 78.1004562 78.6537933 79.2167664 79.749054 80.3243866 80.9514618 81.5533905 82.1029663 82.5999603 83.2922211 83.962822 84.8414841 85.5998917 86.4439087 87.292099 88.3538055 89.3450012 90.4258881 91.5590515 92.9577408 94.3920593 95.8169708 97.1146851 98.4862823 99.9311371 101.380859 102.790619 104.408951 105.833069 107.210693 108.586533 110.025421 111.358688 112.732475 114.100418 115.562393 117.077698 118.597931 119.883759 121.324432 122.656067 123.950058 125.344193 126.680305 127.936195 129.388351 130.669708 132.008148 133.22847 134.585876 135.805069 137.052338 138.32196 139.640991 140.997437 142.201111 143.532166 144.844757 145.951279 147.227997 148.464142 149.916763 151.222015 152.64035 154.173691 155.800781 157.330704 158.942184 160.570496 162.595352 164.350143 166.358002 168.593063 170.929428 173.600601 176.739899 180.519318 185.082123 191.467987 206.525528 385.879456 ------------------------------ Transdef: Tab for variable 10 0.0063499934 1.08711839 1.39351368 1.61372948 1.75629616 1.87540007 1.96957362 2.05573869 2.12994885 2.1926918 2.24586391 2.30041671 2.34951258 2.3935976 2.43522692 2.46700239 2.49880981 2.52957439 2.55595922 2.58103132 2.60434723 2.62590647 2.64914942 2.67078209 2.69302845 2.71474457 2.73306632 2.75171709 2.76818824 2.78193879 2.79604936 2.81111121 2.8254385 2.83814478 2.84744358 2.85853529 2.86783028 2.8777504 2.88825798 2.89778471 2.90578794 2.91350842 2.92153931 2.92916036 2.93709373 2.94398403 2.95136023 2.95777035 2.96371198 2.97024298 2.97698855 2.98261714 2.98739004 2.99187517 2.99619889 3.00120544 3.00594521 3.01112056 3.01531577 3.01997924 3.02413154 3.02828598 3.03204823 3.03550148 3.03979397 3.04384279 3.04791522 3.05170727 3.05510426 3.05827761 3.06136894 3.06432724 3.06767011 3.07113314 3.07402849 3.0767312 3.07995462 3.0828619 3.08589935 3.08890104 3.09174132 3.09443665 3.09697843 3.09980249 3.10214281 3.10472345 3.10719085 3.11012173 3.11290073 3.11512947 3.11757016 3.12022066 3.12264299 3.12525821 3.12777758 3.12984085 3.13236666 3.13433337 3.13660908 3.13906717 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00519537274 0.0115075093 0.018585017 0.0247793198 0.0316231847 0.0393700004 0.0466406047 0.0534056276 0.0603079796 0.0670688152 0.0738771856 0.0804336742 0.0882583857 0.0948358774 0.101748109 0.108905002 0.115206242 0.121865422 0.129650354 0.136026144 0.142058253 0.147613347 0.153920352 0.160051227 0.166133642 0.172093391 0.178449899 0.184744239 0.190494537 0.196427464 0.201370522 0.205855548 0.210343003 0.215213776 0.220329046 0.224943876 0.230005026 0.234472752 0.239255309 0.244618341 0.2498492 0.254801691 0.259244442 0.264006674 0.268795609 0.273692489 0.278343379 0.283302307 0.288611591 0.293665409 0.299405605 0.304040551 0.308958828 0.31372115 0.319489777 0.325077176 0.330750346 0.336045504 0.341940939 0.347130775 0.35233891 0.357776225 0.363140106 0.369354367 0.375390828 0.38170135 0.388174891 0.393927455 0.399571031 0.406700134 0.41306603 0.419860244 0.42652297 0.433516115 0.439184546 0.446152091 0.452620387 0.460012436 0.468909264 0.47650677 0.485133588 0.494581521 0.505227208 0.514124632 0.523191154 0.532942355 0.544917107 0.557055891 0.570443392 0.583038151 0.596359551 0.61188978 0.629791558 0.649385035 0.667025566 0.696308255 0.721380591 0.757367313 0.832041562 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.208623886 0.216610789 0.223213226 0.230599821 0.237558573 0.243131429 0.249677092 0.255941361 0.261814535 0.268032402 0.273980319 0.278991491 0.284164906 0.28927356 0.294911146 0.301042378 0.306103945 0.310907364 0.315901339 0.320901662 0.326057523 0.331783444 0.336970389 0.342358351 0.347688705 0.352267444 0.357369721 0.362518966 0.367340267 0.372652769 0.377133846 0.382446378 0.387698591 0.392649531 0.397414565 0.401527524 0.40562737 0.40911442 0.412793398 0.416458786 0.420288265 0.424096614 0.428158313 0.432189643 0.435312033 0.438915581 0.442961276 0.446623325 0.450676024 0.455782145 0.459714532 0.463854671 0.467970252 0.471839786 0.476207078 0.480677664 0.484809428 0.488515556 0.493205845 0.498220623 0.503397107 0.508673012 0.51344192 0.518263638 0.522889793 0.52763021 0.532982111 0.537976861 0.54402411 0.549588442 0.555253267 0.561246395 0.567384601 0.573908925 0.580573201 0.587281406 0.595156252 0.602277577 0.60972482 0.617243111 0.624998033 0.632083058 0.641357899 0.649939537 0.658472061 0.666013718 0.675099373 0.685621262 0.697975218 0.711793542 0.723720312 0.736616611 0.749266744 0.762151837 0.78027457 0.796730995 0.823791683 0.856882513 0.902887225 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.4629745 22.3193264 23.0002251 23.6336708 24.1747131 24.6410103 25.1604786 25.5849152 25.9642982 26.4111366 26.8487091 27.2998333 27.7418137 28.1210098 28.5046234 28.8623657 29.2134476 29.5524769 29.869854 30.2618904 30.5819588 30.9208984 31.2603912 31.6354122 32.0279999 32.3652954 32.7096786 33.0982742 33.4647179 33.8550262 34.2199554 34.6263237 34.9925156 35.4045105 35.8064194 36.1643181 36.4998627 36.9255295 37.2859039 37.6870193 38.1096191 38.5141068 38.9234314 39.3639069 39.8092232 40.252037 40.727562 41.2167702 41.6888237 42.2230682 42.703167 43.1922226 43.6195145 44.1019211 44.562336 45.1063232 45.6221008 46.1935577 46.7437325 47.3209343 47.850174 48.3880386 48.9379883 49.4728699 50.1402817 50.7033539 51.2274055 51.9104843 52.540844 53.1646576 53.8666077 54.5656052 55.2750015 55.9053421 56.6304245 57.4701309 58.2891312 59.0744019 59.9160385 60.6904488 61.6752548 62.537056 63.4152336 64.5232773 65.6712952 66.7950897 67.9043427 69.2707672 70.7295151 72.5167084 74.1083145 75.9172058 77.5304489 79.7527924 82.3946762 85.9893036 90.0526047 96.2483444 107.23494 316.641113 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6391296 11.0938148 11.4428329 11.7540321 12.1490145 12.4323606 12.7359772 13.0612659 13.3888435 13.6799965 13.9631748 14.3025894 14.5514784 14.8626757 15.1384048 15.4093399 15.7147503 16.0026455 16.2734833 16.5785332 16.8501625 17.1202736 17.4018784 17.6698418 17.9075413 18.183197 18.4581203 18.7387295 19.0051956 19.1994743 19.4737625 19.8315315 20.1153297 20.4151039 20.6964417 20.9625969 21.2673969 21.5308914 21.7642975 22.0127811 22.2832508 22.5436687 22.8178902 23.0826263 23.3315964 23.5709991 23.8147926 24.0585251 24.3053303 24.5772324 24.8546944 25.1296883 25.4237328 25.6908798 25.946785 26.2300758 26.5009766 26.8077698 27.0685463 27.3638382 27.6506615 27.8881912 28.1575699 28.4471664 28.7347317 29.0471191 29.3165245 29.6051235 29.9068184 30.2786674 30.5923195 30.9337769 31.3150864 31.5973053 31.9828701 32.3913307 32.7762909 33.2008667 33.5870819 33.9775925 34.4278297 34.9005051 35.3716393 35.949585 36.5675011 37.1130753 37.7063332 38.3692856 39.0607948 39.8896561 40.7841225 41.6862335 42.9557037 44.3290749 46.0486298 48.0132675 50.8135147 54.6885452 60.2561035 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.4 53.2 54.1 33.1 50.9 64.6 56.7 65.8 -26.2 -15.8 -31.9 21.7 25.2 2 67.4 100.0 69.7 59.5 40.3 70.8 94.5 76.5 91.9 -43.0 -23.0 -43.0 39.1 32.6 3 53.2 69.7 100.0 45.7 20.3 42.5 71.2 59.3 76.7 -13.2 -25.0 -48.4 68.4 24.3 4 54.1 59.5 45.7 100.0 17.0 36.9 60.9 50.6 63.1 -13.2 -27.4 -52.6 23.8 70.9 5 33.1 40.3 20.3 17.0 100.0 85.4 12.9 62.0 61.7 23.7 -8.2 -12.1 5.7 4.6 6 50.9 70.8 42.5 36.9 85.4 100.0 49.8 81.1 81.7 -5.0 -15.1 -25.9 19.8 17.4 7 64.6 94.5 71.2 60.9 12.9 49.8 100.0 67.4 80.3 -52.1 -21.9 -42.9 41.9 35.5 8 56.7 76.5 59.3 50.6 62.0 81.1 67.4 100.0 84.7 -9.2 -22.2 -38.0 33.3 28.7 9 65.8 91.9 76.7 63.1 61.7 81.7 80.3 84.7 100.0 -17.9 -25.5 -47.8 45.2 35.8 10 -26.2 -43.0 -13.2 -13.2 23.7 -5.0 -52.1 -9.2 -17.9 100.0 2.8 7.0 -3.9 -4.7 11 -15.8 -23.0 -25.0 -27.4 -8.2 -15.1 -21.9 -22.2 -25.5 2.8 100.0 54.7 -10.8 -15.5 12 -31.9 -43.0 -48.4 -52.6 -12.1 -25.9 -42.9 -38.0 -47.8 7.0 54.7 100.0 -23.9 -27.3 13 21.7 39.1 68.4 23.8 5.7 19.8 41.9 33.3 45.2 -3.9 -10.8 -23.9 100.0 47.6 14 25.2 32.6 24.3 70.9 4.6 17.4 35.5 28.7 35.8 -4.7 -15.5 -27.3 47.6 100.0 TOTAL CORRELATION TO TARGET (diagonal) 169.62128 TOTAL CORRELATION OF ALL VARIABLES 73.5987417 ROUND 1: MAX CORR ( 73.597768) AFTER KILLING INPUT VARIABLE 8 CONTR 0.378578684 ROUND 2: MAX CORR ( 73.589842) AFTER KILLING INPUT VARIABLE 11 CONTR 1.08010161 ROUND 3: MAX CORR ( 73.5792542) AFTER KILLING INPUT VARIABLE 6 CONTR 1.24827765 ROUND 4: MAX CORR ( 73.5635942) AFTER KILLING INPUT VARIABLE 2 CONTR 1.51797649 ROUND 5: MAX CORR ( 73.4583605) AFTER KILLING INPUT VARIABLE 14 CONTR 3.93340378 ROUND 6: MAX CORR ( 73.2530861) AFTER KILLING INPUT VARIABLE 12 CONTR 5.48781374 ROUND 7: MAX CORR ( 72.9474611) AFTER KILLING INPUT VARIABLE 10 CONTR 6.68450067 ROUND 8: MAX CORR ( 72.2571539) AFTER KILLING INPUT VARIABLE 9 CONTR 10.0117825 ROUND 9: MAX CORR ( 71.282786) AFTER KILLING INPUT VARIABLE 13 CONTR 11.8262721 ROUND 10: MAX CORR ( 71.0286674) AFTER KILLING INPUT VARIABLE 3 CONTR 6.01365027 ROUND 11: MAX CORR ( 69.2491995) AFTER KILLING INPUT VARIABLE 4 CONTR 15.7993657 ROUND 12: MAX CORR ( 64.6057316) AFTER KILLING INPUT VARIABLE 5 CONTR 24.9309261 LAST REMAINING VARIABLE: 7 total correlation to target: 73.5987417 % total significance: 122.186332 sigma correlations of single variables to target: variable 2: 67.3764695 % , in sigma: 111.85631 variable 3: 53.2311365 % , in sigma: 88.37267 variable 4: 54.1154602 % , in sigma: 89.8407966 variable 5: 33.0735624 % , in sigma: 54.9076951 variable 6: 50.9454314 % , in sigma: 84.5780138 variable 7: 64.6057316 % , in sigma: 107.256417 variable 8: 56.7193172 % , in sigma: 94.1636386 variable 9: 65.8008275 % , in sigma: 109.240478 variable 10: -26.2253415 % , in sigma: 43.5384928 variable 11: -15.8186288 % , in sigma: 26.2615934 variable 12: -31.9280828 % , in sigma: 53.0060057 variable 13: 21.6729884 % , in sigma: 35.9808183 variable 14: 25.1516718 % , in sigma: 41.7560199 variables sorted by significance: 1 most relevant variable 7 corr 64.6057281 , in sigma: 107.256412 2 most relevant variable 5 corr 24.9309254 , in sigma: 41.3895435 3 most relevant variable 4 corr 15.799366 , in sigma: 26.2296139 4 most relevant variable 3 corr 6.01365042 , in sigma: 9.98367458 5 most relevant variable 13 corr 11.826272 , in sigma: 19.6336074 6 most relevant variable 9 corr 10.0117826 , in sigma: 16.6212488 7 most relevant variable 10 corr 6.68450069 , in sigma: 11.0973993 8 most relevant variable 12 corr 5.48781395 , in sigma: 9.1106973 9 most relevant variable 14 corr 3.93340373 , in sigma: 6.53011401 10 most relevant variable 2 corr 1.51797652 , in sigma: 2.52009721 11 most relevant variable 6 corr 1.24827766 , in sigma: 2.07235159 12 most relevant variable 11 corr 1.08010161 , in sigma: 1.79315095 13 most relevant variable 8 corr 0.378578693 , in sigma: 0.62850452 global correlations between input variables: variable 2: 99.2555574 % variable 3: 93.8944168 % variable 4: 91.1821475 % variable 5: 95.7162653 % variable 6: 95.1210085 % variable 7: 98.899171 % variable 8: 90.5597835 % variable 9: 98.8605404 % variable 10: 72.4541738 % variable 11: 55.3510836 % variable 12: 71.6465705 % variable 13: 86.7663382 % variable 14: 87.7581313 % significance loss when removing single variables: variable 2: corr = 1.68399639 % , sigma = 2.79571821 variable 3: corr = 13.3917436 % , sigma = 22.2325544 variable 4: corr = 16.0394528 % , sigma = 26.6281985 variable 5: corr = 14.0684768 % , sigma = 23.3560457 variable 6: corr = 1.29535558 % , sigma = 2.15050888 variable 7: corr = 6.80024471 % , sigma = 11.2895539 variable 8: corr = 0.378578684 % , sigma = 0.628504505 variable 9: corr = 8.42950919 % , sigma = 13.9944078 variable 10: corr = 6.206067 % , sigma = 10.3031186 variable 11: corr = 1.0997964 % , sigma = 1.82584762 variable 12: corr = 4.66219901 % , sigma = 7.74003716 variable 13: corr = 5.31985863 % , sigma = 8.83186312 variable 14: corr = 3.7860748 % , sigma = 6.28552312 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 22.1812801 sigma out 15 active outputs RANK 2 NODE 8 --> 19.9335861 sigma out 15 active outputs RANK 3 NODE 7 --> 18.7413597 sigma out 15 active outputs RANK 4 NODE 1 --> 17.5972195 sigma out 15 active outputs RANK 5 NODE 9 --> 17.3307877 sigma out 15 active outputs RANK 6 NODE 5 --> 14.6681252 sigma out 15 active outputs RANK 7 NODE 10 --> 14.3330297 sigma out 15 active outputs RANK 8 NODE 4 --> 13.1629553 sigma out 15 active outputs RANK 9 NODE 2 --> 13.0100765 sigma out 15 active outputs RANK 10 NODE 3 --> 12.2956381 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 28.8901615 sigma in 10act. ( 29.5351849 sig out 1act.) RANK 2 NODE 14 --> 23.315773 sigma in 10act. ( 23.5169182 sig out 1act.) RANK 3 NODE 5 --> 16.6979008 sigma in 10act. ( 15.9469395 sig out 1act.) RANK 4 NODE 1 --> 15.3690405 sigma in 10act. ( 16.695652 sig out 1act.) RANK 5 NODE 7 --> 14.5598049 sigma in 10act. ( 14.5082855 sig out 1act.) RANK 6 NODE 8 --> 12.2487659 sigma in 10act. ( 12.7493954 sig out 1act.) RANK 7 NODE 6 --> 12.018507 sigma in 10act. ( 11.2089958 sig out 1act.) RANK 8 NODE 15 --> 11.8480062 sigma in 10act. ( 11.1185303 sig out 1act.) RANK 9 NODE 2 --> 7.49722385 sigma in 10act. ( 5.75986195 sig out 1act.) RANK 10 NODE 4 --> 6.89547443 sigma in 10act. ( 5.10281992 sig out 1act.) RANK 11 NODE 3 --> 6.39701891 sigma in 10act. ( 7.63178158 sig out 1act.) RANK 12 NODE 12 --> 5.64952707 sigma in 10act. ( 0.900115967 sig out 1act.) RANK 13 NODE 13 --> 4.69174385 sigma in 10act. ( 7.88158369 sig out 1act.) RANK 14 NODE 11 --> 3.72110677 sigma in 10act. ( 3.64960098 sig out 1act.) RANK 15 NODE 10 --> 3.51053143 sigma in 10act. ( 0.0112590501 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 29.5351849 sigma out 1act.( 28.8901615 sig in 10act.) RANK 2 NODE 14 --> 23.5169182 sigma out 1act.( 23.315773 sig in 10act.) RANK 3 NODE 1 --> 16.695652 sigma out 1act.( 15.3690405 sig in 10act.) RANK 4 NODE 5 --> 15.9469395 sigma out 1act.( 16.6979008 sig in 10act.) RANK 5 NODE 7 --> 14.5082855 sigma out 1act.( 14.5598049 sig in 10act.) RANK 6 NODE 8 --> 12.7493954 sigma out 1act.( 12.2487659 sig in 10act.) RANK 7 NODE 6 --> 11.2089958 sigma out 1act.( 12.018507 sig in 10act.) RANK 8 NODE 15 --> 11.1185303 sigma out 1act.( 11.8480062 sig in 10act.) RANK 9 NODE 13 --> 7.88158369 sigma out 1act.( 4.69174385 sig in 10act.) RANK 10 NODE 3 --> 7.63178158 sigma out 1act.( 6.39701891 sig in 10act.) RANK 11 NODE 2 --> 5.75986195 sigma out 1act.( 7.49722385 sig in 10act.) RANK 12 NODE 4 --> 5.10281992 sigma out 1act.( 6.89547443 sig in 10act.) RANK 13 NODE 11 --> 3.64960098 sigma out 1act.( 3.72110677 sig in 10act.) RANK 14 NODE 12 --> 0.900115967 sigma out 1act.( 5.64952707 sig in 10act.) RANK 15 NODE 10 --> 0.0112590501 sigma out 1act.( 3.51053143 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.6728706 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 21.9463196 sigma out 15 active outputs RANK 2 NODE 8 --> 18.6789703 sigma out 15 active outputs RANK 3 NODE 7 --> 17.9491501 sigma out 15 active outputs RANK 4 NODE 2 --> 17.1239052 sigma out 15 active outputs RANK 5 NODE 1 --> 16.7962666 sigma out 15 active outputs RANK 6 NODE 9 --> 16.7415218 sigma out 15 active outputs RANK 7 NODE 10 --> 14.9045525 sigma out 15 active outputs RANK 8 NODE 5 --> 14.8026419 sigma out 15 active outputs RANK 9 NODE 4 --> 12.4112902 sigma out 15 active outputs RANK 10 NODE 3 --> 12.118432 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 25.5334072 sigma in 10act. ( 25.4940987 sig out 1act.) RANK 2 NODE 14 --> 22.9868813 sigma in 10act. ( 22.019968 sig out 1act.) RANK 3 NODE 1 --> 17.6539516 sigma in 10act. ( 16.6334877 sig out 1act.) RANK 4 NODE 7 --> 13.2710962 sigma in 10act. ( 13.0345106 sig out 1act.) RANK 5 NODE 5 --> 12.9340429 sigma in 10act. ( 12.9010582 sig out 1act.) RANK 6 NODE 13 --> 12.6206293 sigma in 10act. ( 11.1372366 sig out 1act.) RANK 7 NODE 8 --> 11.5677071 sigma in 10act. ( 11.5155373 sig out 1act.) RANK 8 NODE 6 --> 10.6782331 sigma in 10act. ( 10.0774651 sig out 1act.) RANK 9 NODE 3 --> 9.70365238 sigma in 10act. ( 7.68258429 sig out 1act.) RANK 10 NODE 15 --> 9.21407318 sigma in 10act. ( 8.73364353 sig out 1act.) RANK 11 NODE 12 --> 8.78439236 sigma in 10act. ( 0.0502207726 sig out 1act.) RANK 12 NODE 10 --> 8.63704967 sigma in 10act. ( 0.443393022 sig out 1act.) RANK 13 NODE 4 --> 8.45539665 sigma in 10act. ( 4.36858559 sig out 1act.) RANK 14 NODE 2 --> 7.48542595 sigma in 10act. ( 4.74603128 sig out 1act.) RANK 15 NODE 11 --> 7.04322815 sigma in 10act. ( 3.96696067 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 25.4940987 sigma out 1act.( 25.5334072 sig in 10act.) RANK 2 NODE 14 --> 22.019968 sigma out 1act.( 22.9868813 sig in 10act.) RANK 3 NODE 1 --> 16.6334877 sigma out 1act.( 17.6539516 sig in 10act.) RANK 4 NODE 7 --> 13.0345106 sigma out 1act.( 13.2710962 sig in 10act.) RANK 5 NODE 5 --> 12.9010582 sigma out 1act.( 12.9340429 sig in 10act.) RANK 6 NODE 8 --> 11.5155373 sigma out 1act.( 11.5677071 sig in 10act.) RANK 7 NODE 13 --> 11.1372366 sigma out 1act.( 12.6206293 sig in 10act.) RANK 8 NODE 6 --> 10.0774651 sigma out 1act.( 10.6782331 sig in 10act.) RANK 9 NODE 15 --> 8.73364353 sigma out 1act.( 9.21407318 sig in 10act.) RANK 10 NODE 3 --> 7.68258429 sigma out 1act.( 9.70365238 sig in 10act.) RANK 11 NODE 2 --> 4.74603128 sigma out 1act.( 7.48542595 sig in 10act.) RANK 12 NODE 4 --> 4.36858559 sigma out 1act.( 8.45539665 sig in 10act.) RANK 13 NODE 11 --> 3.96696067 sigma out 1act.( 7.04322815 sig in 10act.) RANK 14 NODE 10 --> 0.443393022 sigma out 1act.( 8.63704967 sig in 10act.) RANK 15 NODE 12 --> 0.0502207726 sigma out 1act.( 8.78439236 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 47.9466553 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.469816148 *** contribution from regularisation: 0.00356320781 *** contribution from error: -0.473379344 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.519718468 *** contribution from regularisation: 0.00234170025 *** contribution from error: -0.522060156 *********************************************** -----------------> Test sample ENTER BFGS code START -47106.47 0.164562702 0.0204797313 EXIT FROM BFGS code FG_START 0. 0.164562702 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.556195736 *** contribution from regularisation: 0.00197489094 *** contribution from error: -0.558170617 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -50403.0136 0.164562702 -54.6168747 EXIT FROM BFGS code FG_LNSRCH 0. 0.148451984 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.590441406 *** contribution from regularisation: 0.00264174794 *** contribution from error: -0.593083143 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53506.3898 0.148451984 -30.1539135 EXIT FROM BFGS code NEW_X -53506.3898 0.148451984 -30.1539135 ENTER BFGS code NEW_X -53506.3898 0.148451984 -30.1539135 EXIT FROM BFGS code FG_LNSRCH 0. 0.134621873 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.594507813 *** contribution from regularisation: 0.00286676246 *** contribution from error: -0.597374558 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53874.8912 0.134621873 -7.5455513 EXIT FROM BFGS code NEW_X -53874.8912 0.134621873 -7.5455513 ENTER BFGS code NEW_X -53874.8912 0.134621873 -7.5455513 EXIT FROM BFGS code FG_LNSRCH 0. 0.129060939 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.595371783 *** contribution from regularisation: 0.00271177059 *** contribution from error: -0.598083556 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53953.1856 0.129060939 -3.42127132 EXIT FROM BFGS code NEW_X -53953.1856 0.129060939 -3.42127132 ENTER BFGS code NEW_X -53953.1856 0.129060939 -3.42127132 EXIT FROM BFGS code FG_LNSRCH 0. 0.123248942 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.595748425 *** contribution from regularisation: 0.00255053397 *** contribution from error: -0.598298967 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53987.3195 0.123248942 -1.48764122 EXIT FROM BFGS code NEW_X -53987.3195 0.123248942 -1.48764122 ENTER BFGS code NEW_X -53987.3195 0.123248942 -1.48764122 EXIT FROM BFGS code FG_LNSRCH 0. 0.116379216 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.595928609 *** contribution from regularisation: 0.00246704696 *** contribution from error: -0.598395646 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54003.647 0.116379216 -1.28346467 EXIT FROM BFGS code NEW_X -54003.647 0.116379216 -1.28346467 ENTER BFGS code NEW_X -54003.647 0.116379216 -1.28346467 EXIT FROM BFGS code FG_LNSRCH 0. 0.0706698522 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.596668065 *** contribution from regularisation: 0.00189334701 *** contribution from error: -0.598561406 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54070.6561 0.0706698522 -0.123433515 EXIT FROM BFGS code NEW_X -54070.6561 0.0706698522 -0.123433515 ENTER BFGS code NEW_X -54070.6561 0.0706698522 -0.123433515 EXIT FROM BFGS code FG_LNSRCH 0. -0.0236436725 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 38.3981743 sigma out 15 active outputs RANK 2 NODE 6 --> 23.8042831 sigma out 15 active outputs RANK 3 NODE 4 --> 20.0717258 sigma out 15 active outputs RANK 4 NODE 8 --> 17.7857761 sigma out 15 active outputs RANK 5 NODE 1 --> 17.6328373 sigma out 15 active outputs RANK 6 NODE 3 --> 15.521244 sigma out 15 active outputs RANK 7 NODE 9 --> 15.0844612 sigma out 15 active outputs RANK 8 NODE 10 --> 14.0290136 sigma out 15 active outputs RANK 9 NODE 5 --> 12.3563709 sigma out 15 active outputs RANK 10 NODE 7 --> 11.288991 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 45.4611816 sigma in 10act. ( 47.3280869 sig out 1act.) RANK 2 NODE 14 --> 28.0696392 sigma in 10act. ( 24.5274162 sig out 1act.) RANK 3 NODE 1 --> 22.2853031 sigma in 10act. ( 18.0238552 sig out 1act.) RANK 4 NODE 3 --> 15.4989882 sigma in 10act. ( 14.9386892 sig out 1act.) RANK 5 NODE 11 --> 11.8581209 sigma in 10act. ( 10.7637978 sig out 1act.) RANK 6 NODE 9 --> 10.777647 sigma in 10act. ( 9.48477364 sig out 1act.) RANK 7 NODE 8 --> 9.99891663 sigma in 10act. ( 9.0179739 sig out 1act.) RANK 8 NODE 7 --> 5.93565893 sigma in 10act. ( 4.53874016 sig out 1act.) RANK 9 NODE 12 --> 2.70961499 sigma in 10act. ( 0.118204966 sig out 1act.) RANK 10 NODE 6 --> 2.70876074 sigma in 10act. ( 1.15814412 sig out 1act.) RANK 11 NODE 15 --> 2.52097249 sigma in 10act. ( 2.27377701 sig out 1act.) RANK 12 NODE 5 --> 2.1386466 sigma in 10act. ( 1.27365363 sig out 1act.) RANK 13 NODE 4 --> 1.81115484 sigma in 10act. ( 0.00494324649 sig out 1act.) RANK 14 NODE 10 --> 1.72070837 sigma in 10act. ( 0.128376186 sig out 1act.) RANK 15 NODE 2 --> 1.12390542 sigma in 10act. ( 0.215395838 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 47.3280869 sigma out 1act.( 45.4611816 sig in 10act.) RANK 2 NODE 14 --> 24.5274162 sigma out 1act.( 28.0696392 sig in 10act.) RANK 3 NODE 1 --> 18.0238552 sigma out 1act.( 22.2853031 sig in 10act.) RANK 4 NODE 3 --> 14.9386892 sigma out 1act.( 15.4989882 sig in 10act.) RANK 5 NODE 11 --> 10.7637978 sigma out 1act.( 11.8581209 sig in 10act.) RANK 6 NODE 9 --> 9.48477364 sigma out 1act.( 10.777647 sig in 10act.) RANK 7 NODE 8 --> 9.0179739 sigma out 1act.( 9.99891663 sig in 10act.) RANK 8 NODE 7 --> 4.53874016 sigma out 1act.( 5.93565893 sig in 10act.) RANK 9 NODE 15 --> 2.27377701 sigma out 1act.( 2.52097249 sig in 10act.) RANK 10 NODE 5 --> 1.27365363 sigma out 1act.( 2.1386466 sig in 10act.) RANK 11 NODE 6 --> 1.15814412 sigma out 1act.( 2.70876074 sig in 10act.) RANK 12 NODE 2 --> 0.215395838 sigma out 1act.( 1.12390542 sig in 10act.) RANK 13 NODE 10 --> 0.128376186 sigma out 1act.( 1.72070837 sig in 10act.) RANK 14 NODE 12 --> 0.118204966 sigma out 1act.( 2.70961499 sig in 10act.) RANK 15 NODE 4 --> 0.00494324649 sigma out 1act.( 1.81115484 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.8729858 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.595043302 *** contribution from regularisation: 0.00227810303 *** contribution from error: -0.597321391 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53923.4204 -0.0236436725 9.40812397 EXIT FROM BFGS code FG_LNSRCH 0. 0.0472241603 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.596726656 *** contribution from regularisation: 0.00202952512 *** contribution from error: -0.598756194 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54075.9683 0.0472241603 -2.10535264 EXIT FROM BFGS code NEW_X -54075.9683 0.0472241603 -2.10535264 ENTER BFGS code NEW_X -54075.9683 0.0472241603 -2.10535264 EXIT FROM BFGS code FG_LNSRCH 0. -0.00911687501 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.596172273 *** contribution from regularisation: 0.00207512546 *** contribution from error: -0.598247409 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54025.7255 -0.00911687501 -0.967700839 EXIT FROM BFGS code FG_LNSRCH 0. 0.0310057029 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.59676379 *** contribution from regularisation: 0.00214743265 *** contribution from error: -0.598911226 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54079.3297 0.0310057029 -0.996170044 EXIT FROM BFGS code NEW_X -54079.3297 0.0310057029 -0.996170044 ENTER BFGS code NEW_X -54079.3297 0.0310057029 -0.996170044 EXIT FROM BFGS code FG_LNSRCH 0. 0.00785921421 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.596858203 *** contribution from regularisation: 0.00200176542 *** contribution from error: -0.598859966 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54087.8891 0.00785921421 -0.646523714 EXIT FROM BFGS code NEW_X -54087.8891 0.00785921421 -0.646523714 ENTER BFGS code NEW_X -54087.8891 0.00785921421 -0.646523714 EXIT FROM BFGS code FG_LNSRCH 0. 0.015183351 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.596903503 *** contribution from regularisation: 0.00207483093 *** contribution from error: -0.598978341 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54091.9926 0.015183351 -0.75136143 EXIT FROM BFGS code NEW_X -54091.9926 0.015183351 -0.75136143 ENTER BFGS code NEW_X -54091.9926 0.015183351 -0.75136143 EXIT FROM BFGS code FG_LNSRCH 0. 0.0192702953 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.597010076 *** contribution from regularisation: 0.00203135423 *** contribution from error: -0.599041402 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54101.6509 0.0192702953 -1.02029026 EXIT FROM BFGS code NEW_X -54101.6509 0.0192702953 -1.02029026 ENTER BFGS code NEW_X -54101.6509 0.0192702953 -1.02029026 EXIT FROM BFGS code FG_LNSRCH 0. 0.016718721 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.597177267 *** contribution from regularisation: 0.0017326033 *** contribution from error: -0.598909855 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54116.8011 0.016718721 -0.644997299 EXIT FROM BFGS code NEW_X -54116.8011 0.016718721 -0.644997299 ENTER BFGS code NEW_X -54116.8011 0.016718721 -0.644997299 EXIT FROM BFGS code FG_LNSRCH 0. -0.00665770378 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.59585017 *** contribution from regularisation: 0.00189183676 *** contribution from error: -0.597742021 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53996.5394 -0.00665770378 -3.36243606 EXIT FROM BFGS code FG_LNSRCH 0. 0.0136347124 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.596567273 *** contribution from regularisation: 0.00240382063 *** contribution from error: -0.598971069 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54061.5235 0.0136347124 -0.771949589 EXIT FROM BFGS code FG_LNSRCH 0. 0.0166284721 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 35.7405319 sigma out 15 active outputs RANK 2 NODE 1 --> 16.7712479 sigma out 15 active outputs RANK 3 NODE 10 --> 14.2639618 sigma out 15 active outputs RANK 4 NODE 4 --> 13.004364 sigma out 15 active outputs RANK 5 NODE 8 --> 10.7060356 sigma out 15 active outputs RANK 6 NODE 7 --> 10.4320774 sigma out 15 active outputs RANK 7 NODE 3 --> 9.14214993 sigma out 15 active outputs RANK 8 NODE 6 --> 8.33977413 sigma out 15 active outputs RANK 9 NODE 5 --> 7.88153887 sigma out 15 active outputs RANK 10 NODE 9 --> 7.23948669 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 36.6475182 sigma in 10act. ( 38.9240341 sig out 1act.) RANK 2 NODE 14 --> 19.6704712 sigma in 10act. ( 14.879467 sig out 1act.) RANK 3 NODE 1 --> 15.3811131 sigma in 10act. ( 10.0341043 sig out 1act.) RANK 4 NODE 3 --> 13.6529922 sigma in 10act. ( 12.040946 sig out 1act.) RANK 5 NODE 8 --> 8.58191872 sigma in 10act. ( 6.81446505 sig out 1act.) RANK 6 NODE 11 --> 8.52890301 sigma in 10act. ( 5.5911684 sig out 1act.) RANK 7 NODE 9 --> 7.34505558 sigma in 10act. ( 6.09988737 sig out 1act.) RANK 8 NODE 7 --> 5.54613113 sigma in 10act. ( 3.99746299 sig out 1act.) RANK 9 NODE 6 --> 2.73115468 sigma in 10act. ( 1.44127679 sig out 1act.) RANK 10 NODE 12 --> 2.7210114 sigma in 10act. ( 0.948673904 sig out 1act.) RANK 11 NODE 15 --> 2.55186224 sigma in 10act. ( 1.95753884 sig out 1act.) RANK 12 NODE 10 --> 2.29797316 sigma in 10act. ( 0.871350348 sig out 1act.) RANK 13 NODE 4 --> 2.12137198 sigma in 10act. ( 0.270985037 sig out 1act.) RANK 14 NODE 5 --> 2.02089238 sigma in 10act. ( 1.16583216 sig out 1act.) RANK 15 NODE 2 --> 1.74624014 sigma in 10act. ( 0.22714746 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 38.9240341 sigma out 1act.( 36.6475182 sig in 10act.) RANK 2 NODE 14 --> 14.879467 sigma out 1act.( 19.6704712 sig in 10act.) RANK 3 NODE 3 --> 12.040946 sigma out 1act.( 13.6529922 sig in 10act.) RANK 4 NODE 1 --> 10.0341043 sigma out 1act.( 15.3811131 sig in 10act.) RANK 5 NODE 8 --> 6.81446505 sigma out 1act.( 8.58191872 sig in 10act.) RANK 6 NODE 9 --> 6.09988737 sigma out 1act.( 7.34505558 sig in 10act.) RANK 7 NODE 11 --> 5.5911684 sigma out 1act.( 8.52890301 sig in 10act.) RANK 8 NODE 7 --> 3.99746299 sigma out 1act.( 5.54613113 sig in 10act.) RANK 9 NODE 15 --> 1.95753884 sigma out 1act.( 2.55186224 sig in 10act.) RANK 10 NODE 6 --> 1.44127679 sigma out 1act.( 2.73115468 sig in 10act.) RANK 11 NODE 5 --> 1.16583216 sigma out 1act.( 2.02089238 sig in 10act.) RANK 12 NODE 12 --> 0.948673904 sigma out 1act.( 2.7210114 sig in 10act.) RANK 13 NODE 10 --> 0.871350348 sigma out 1act.( 2.29797316 sig in 10act.) RANK 14 NODE 4 --> 0.270985037 sigma out 1act.( 2.12137198 sig in 10act.) RANK 15 NODE 2 --> 0.22714746 sigma out 1act.( 1.74624014 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.0661011 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.596885622 *** contribution from regularisation: 0.00202704105 *** contribution from error: -0.598912656 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54090.3727 0.0166284721 -0.645375311 EXIT FROM BFGS code FG_LNSRCH 0. 0.0167185385 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.596831381 *** contribution from regularisation: 0.00207850477 *** contribution from error: -0.598909914 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54085.4552 0.0167185385 -0.627230763 EXIT FROM BFGS code FG_LNSRCH 0. 0.016718721 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.59685427 *** contribution from regularisation: 0.00205558841 *** contribution from error: -0.598909855 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54087.5319 0.016718721 -0.6258986 EXIT FROM BFGS code FG_LNSRCH 0. 0.016718721 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.596859336 *** contribution from regularisation: 0.00205054902 *** contribution from error: -0.598909914 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54087.9886 0.016718721 -0.632628024 EXIT FROM BFGS code FG_LNSRCH 0. 0.016718721 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.596852303 *** contribution from regularisation: 0.00205754372 *** contribution from error: -0.598909855 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54087.3547 0.016718721 -0.633089781 EXIT FROM BFGS code NEW_X -54087.3547 0.016718721 -0.633089781 ENTER BFGS code NEW_X -54087.3547 0.016718721 -0.633089781 EXIT FROM BFGS code CONVERGENC -54087.3547 0.016718721 -0.633089781 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 60.9405403 sigma out 15 active outputs RANK 2 NODE 1 --> 28.9855328 sigma out 15 active outputs RANK 3 NODE 10 --> 24.5834103 sigma out 15 active outputs RANK 4 NODE 4 --> 22.4877987 sigma out 15 active outputs RANK 5 NODE 8 --> 18.196125 sigma out 15 active outputs RANK 6 NODE 7 --> 17.1531887 sigma out 15 active outputs RANK 7 NODE 3 --> 15.4573612 sigma out 15 active outputs RANK 8 NODE 6 --> 14.3360348 sigma out 15 active outputs RANK 9 NODE 5 --> 13.2464638 sigma out 15 active outputs RANK 10 NODE 9 --> 12.6564751 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 63.9466362 sigma in 10act. ( 67.6552505 sig out 1act.) RANK 2 NODE 14 --> 33.8173485 sigma in 10act. ( 25.7896156 sig out 1act.) RANK 3 NODE 1 --> 25.7193489 sigma in 10act. ( 17.4643002 sig out 1act.) RANK 4 NODE 3 --> 22.6702271 sigma in 10act. ( 20.8745117 sig out 1act.) RANK 5 NODE 8 --> 14.2804232 sigma in 10act. ( 11.7897806 sig out 1act.) RANK 6 NODE 11 --> 13.5808964 sigma in 10act. ( 9.73519897 sig out 1act.) RANK 7 NODE 9 --> 11.9146757 sigma in 10act. ( 10.8143921 sig out 1act.) RANK 8 NODE 7 --> 8.55673599 sigma in 10act. ( 6.93153811 sig out 1act.) RANK 9 NODE 15 --> 3.74729252 sigma in 10act. ( 3.29283905 sig out 1act.) RANK 10 NODE 6 --> 3.44935012 sigma in 10act. ( 2.3952179 sig out 1act.) RANK 11 NODE 12 --> 3.09979177 sigma in 10act. ( 1.63282096 sig out 1act.) RANK 12 NODE 10 --> 2.66605282 sigma in 10act. ( 1.45021474 sig out 1act.) RANK 13 NODE 5 --> 2.65538192 sigma in 10act. ( 1.87654436 sig out 1act.) RANK 14 NODE 4 --> 2.1746552 sigma in 10act. ( 0.452861965 sig out 1act.) RANK 15 NODE 2 --> 1.7883873 sigma in 10act. ( 0.380888015 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 67.6552505 sigma out 1act.( 63.9466362 sig in 10act.) RANK 2 NODE 14 --> 25.7896156 sigma out 1act.( 33.8173485 sig in 10act.) RANK 3 NODE 3 --> 20.8745117 sigma out 1act.( 22.6702271 sig in 10act.) RANK 4 NODE 1 --> 17.4643002 sigma out 1act.( 25.7193489 sig in 10act.) RANK 5 NODE 8 --> 11.7897806 sigma out 1act.( 14.2804232 sig in 10act.) RANK 6 NODE 9 --> 10.8143921 sigma out 1act.( 11.9146757 sig in 10act.) RANK 7 NODE 11 --> 9.73519897 sigma out 1act.( 13.5808964 sig in 10act.) RANK 8 NODE 7 --> 6.93153811 sigma out 1act.( 8.55673599 sig in 10act.) RANK 9 NODE 15 --> 3.29283905 sigma out 1act.( 3.74729252 sig in 10act.) RANK 10 NODE 6 --> 2.3952179 sigma out 1act.( 3.44935012 sig in 10act.) RANK 11 NODE 5 --> 1.87654436 sigma out 1act.( 2.65538192 sig in 10act.) RANK 12 NODE 12 --> 1.63282096 sigma out 1act.( 3.09979177 sig in 10act.) RANK 13 NODE 10 --> 1.45021474 sigma out 1act.( 2.66605282 sig in 10act.) RANK 14 NODE 4 --> 0.452861965 sigma out 1act.( 2.1746552 sig in 10act.) RANK 15 NODE 2 --> 0.380888015 sigma out 1act.( 1.7883873 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 80.0442123 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.596848547 *** contribution from regularisation: 0.0020613349 *** contribution from error: -0.598909855 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26967 Closing output file done