NNInput NNInputs_165.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 201495 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 56797 nbkg = 144698 Bkg Entries: 144698 Sig Entries: 56797 Chosen entries: 56797 Signal fraction: 1 Background fraction: 0.392521 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 144698 Actual Signal Entries: 56797 Entries to split: 56797 Test with : 28398 Train with : 28398 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 56797 for Signal Prepared event 0 for Signal with 56797 events ====Entry 0 Variable Ht : 267.874 Variable LepAPt : 45.292 Variable LepBPt : 35.604 Variable MetSigLeptonsJets : 7.24556 Variable MetSpec : 95.2083 Variable SumEtLeptonsJets : 172.666 Variable VSumJetLeptonsPt : 107.325 Variable addEt : 176.104 Variable dPhiLepSumMet : 2.28406 Variable dPhiLeptons : 0.0254087 Variable dRLeptons : 0.325152 Variable lep1_E : 46.0978 Variable lep2_E : 40.383 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2165 Ht = 267.874 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 45.2922 LepAPt = 45.292 LepBEt = 35.604 LepBPt = 35.604 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 95.2083 MetDelPhi = 2.19471 MetSig = 6.53886 MetSigLeptonsJets = 7.24556 MetSpec = 95.2083 Mjj = 0 MostCentralJetEta = -1.47546 MtllMet = 179.575 Njets = 1 SB = 0 SumEt = 212.005 SumEtJets = 0 SumEtLeptonsJets = 172.666 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 107.325 addEt = 176.104 dPhiLepSumMet = 2.28406 dPhiLeptons = 0.0254087 dRLeptons = 0.325152 diltype = 52 dimass = 13.1154 event = 77 jet1_Et = 91.7697 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.0978 lep2_E = 40.383 rand = 0.999742 run = 237144 weight = 3.96224e-06 ===Show End Prepared event 10000 for Signal with 56797 events Prepared event 20000 for Signal with 56797 events Prepared event 30000 for Signal with 56797 events Prepared event 40000 for Signal with 56797 events Prepared event 50000 for Signal with 56797 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 144698 for Background Prepared event 0 for Background with 144698 events ====Entry 0 Variable Ht : 79.7868 Variable LepAPt : 30.5457 Variable LepBPt : 11.4206 Variable MetSigLeptonsJets : 5.83799 Variable MetSpec : 37.8193 Variable SumEtLeptonsJets : 41.9663 Variable VSumJetLeptonsPt : 41.2152 Variable addEt : 79.7868 Variable dPhiLepSumMet : 2.89654 Variable dPhiLeptons : 0.426439 Variable dRLeptons : 0.500605 Variable lep1_E : 30.5607 Variable lep2_E : 11.7282 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 79.7868 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.546 LepAPt = 30.5457 LepBEt = 11.4214 LepBPt = 11.4206 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 37.8193 MetDelPhi = 2.58497 MetSig = 2.81024 MetSigLeptonsJets = 5.83799 MetSpec = 37.8193 Mjj = 0 MostCentralJetEta = 0 MtllMet = 80.0898 Njets = 0 SB = 0 SumEt = 181.11 SumEtJets = 0 SumEtLeptonsJets = 41.9663 Target = 0 TrainWeight = 4.98554 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.2152 addEt = 79.7868 dPhiLepSumMet = 2.89654 dPhiLeptons = 0.426439 dRLeptons = 0.500605 diltype = 41 dimass = 9.31149 event = 6639571 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 30.5607 lep2_E = 11.7282 rand = 0.999742 run = 271566 weight = 0.0404189 ===Show End Prepared event 10000 for Background with 144698 events Prepared event 20000 for Background with 144698 events Prepared event 30000 for Background with 144698 events Prepared event 40000 for Background with 144698 events Prepared event 50000 for Background with 144698 events Prepared event 60000 for Background with 144698 events Prepared event 70000 for Background with 144698 events Prepared event 80000 for Background with 144698 events Prepared event 90000 for Background with 144698 events Prepared event 100000 for Background with 144698 events Prepared event 110000 for Background with 144698 events Prepared event 120000 for Background with 144698 events Prepared event 130000 for Background with 144698 events Prepared event 140000 for Background with 144698 events Warning: found 4551 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 201495 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4551 negative weights. Signal fraction: 63.231987 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 62.5291977 65.1282196 67.0751801 68.3000031 69.2226105 70.29422 71.1488647 71.9919891 72.9995728 73.8354874 74.3927917 75.1567078 75.6720734 76.347641 77.0031738 77.4537964 78.0547943 78.7608566 79.3609619 79.8694916 80.6395721 81.2990494 82.1867065 82.8870239 83.7283478 84.6664429 85.6543732 86.8798828 88.2279053 89.5259781 91.2200165 92.8378296 94.3754349 96.143013 97.9142914 99.4873886 101.004791 102.562073 104.244675 105.951141 107.570511 109.224014 111.186188 113.192032 114.803177 116.762894 118.721329 120.570328 122.580818 124.376953 126.051079 127.79567 129.350128 131.16951 132.891235 134.624939 136.327713 137.852676 139.33548 141.019592 142.603149 144.199066 145.736877 147.113388 148.564423 150.060699 151.49826 152.931213 154.32988 155.699219 157.051559 158.518814 159.96904 161.461105 163.106689 164.852814 166.787201 168.797485 170.851883 173.200104 175.712372 178.420151 180.882263 183.659332 186.908997 190.029785 193.374481 196.90564 200.789093 204.940857 209.811325 215.003876 221.172546 228.010071 235.970825 245.897507 258.620697 279.719482 312.284302 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0001068 20.3519669 20.6471519 20.9788589 21.236454 21.4944248 21.7400093 21.9830685 22.1984024 22.4381256 22.6852722 22.894268 23.1290321 23.3339577 23.5853119 23.7532578 23.9796753 24.2311172 24.4887848 24.6922646 24.8999176 25.1138 25.3446007 25.5711613 25.7812386 26.0132046 26.2339783 26.4377689 26.7227459 26.9535427 27.1578026 27.3834286 27.660511 27.8980408 28.1056519 28.3291664 28.6203537 28.8664894 29.1134586 29.3887253 29.6985016 29.9570465 30.2553654 30.5628204 30.857872 31.1629105 31.4419174 31.7075348 32.0323906 32.3324127 32.638504 32.9351463 33.2687759 33.5957756 33.8623428 34.1743813 34.5133896 34.8573341 35.1782227 35.5095596 35.8314972 36.1469955 36.4559021 36.74683 37.0641861 37.4324646 37.7361984 38.0823135 38.3766022 38.7184258 39.0514679 39.3827324 39.7446518 40.0643997 40.4412766 40.8181 41.1875343 41.6008377 41.9287109 42.3236008 42.7476654 43.206398 43.6650543 44.158802 44.6338882 45.1941757 45.7294769 46.2986374 46.9094925 47.6154709 48.2604065 49.09758 50.0530777 51.1366119 52.3841515 53.9712372 55.8526649 58.5777931 62.1572723 67.9890594 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0002251 10.126276 10.2705326 10.3762484 10.4661808 10.5900126 10.7242985 10.8394585 10.9771099 11.0914326 11.2287159 11.3685875 11.4989996 11.6345196 11.7596493 11.9069386 12.0484638 12.2344837 12.3828678 12.5711231 12.7256498 12.8877649 13.0852871 13.3098106 13.4954729 13.6657677 13.8415556 14.0481281 14.2486715 14.4502306 14.6622992 14.8788624 15.1046486 15.3094692 15.4735594 15.7272625 15.9354067 16.2213898 16.4798965 16.7660904 17.0079441 17.2730312 17.558073 17.8491592 18.1432304 18.4286823 18.7538872 19.0609779 19.3550072 19.6809311 20.0286846 20.3201504 20.6148415 20.8980026 21.207077 21.4845562 21.8040771 22.1508102 22.4589939 22.8494186 23.2007046 23.5501785 23.9150505 24.2829132 24.6468678 25.0063782 25.362133 25.7237759 26.0734596 26.421978 26.806076 27.1794586 27.5422001 27.9059525 28.2673111 28.6381569 29.0085487 29.4020348 29.793066 30.1787014 30.5478096 30.9408798 31.3387718 31.7329178 32.1746559 32.6161423 33.015152 33.4419327 33.882309 34.408989 34.9430733 35.513279 36.1056442 36.8003807 37.610321 38.5409546 39.6710052 41.1986008 43.7465363 48.2312775 74.3131104 ------------------------------ Transdef: Tab for variable 5 1.14728987 2.68520069 3.08253145 3.40146589 3.693717 3.91103601 4.11550856 4.25167465 4.39771557 4.52598858 4.62869167 4.73101234 4.81548929 4.92086887 5.00623703 5.08147907 5.14866018 5.20681667 5.28558874 5.34741831 5.40480232 5.4601984 5.51980686 5.56805468 5.61803913 5.6659646 5.71811104 5.77080297 5.81362963 5.85406637 5.90195322 5.94932556 5.99672604 6.03620052 6.08106279 6.12980604 6.17978621 6.22075653 6.26756382 6.30418873 6.34730339 6.39110279 6.43009901 6.47210121 6.52462244 6.5760231 6.62707615 6.67267752 6.72266197 6.7671566 6.81590939 6.85041046 6.90021324 6.95766449 7.00870514 7.06169605 7.11887932 7.166646 7.22278118 7.27497292 7.32576656 7.381073 7.43980026 7.50288677 7.56162357 7.62464333 7.6867075 7.74170017 7.80348015 7.86468983 7.92261934 7.98126221 8.04523468 8.10298538 8.16573334 8.22097015 8.28245544 8.34573555 8.40986347 8.47934055 8.54625702 8.61632347 8.68209457 8.74861622 8.81114769 8.88472366 8.95816803 9.03797913 9.12141514 9.21064663 9.30912685 9.41143322 9.53759289 9.67071152 9.82098198 10.0065203 10.2238131 10.5202637 10.9274397 11.6929932 19.6634274 ------------------------------ Transdef: Tab for variable 6 15.0039139 20.2660446 25.0861835 26.4983349 27.3590164 28.3634319 29.3779449 30.1964073 30.9486656 31.6743927 32.2853813 32.8473854 33.4087715 33.8681374 34.3775063 34.6991997 35.049881 35.508831 35.9256821 36.2445602 36.5555191 36.9586906 37.3043289 37.7077026 38.0089378 38.3618011 38.7379227 39.1123047 39.4403534 39.7863083 40.2043457 40.5369911 40.9898987 41.4185944 41.8722725 42.371582 42.8294106 43.2039604 43.7360458 44.2278633 44.8240662 45.4462204 46.0939026 46.878376 47.5766449 48.237278 48.882534 49.5510139 50.3333588 51.0365448 51.8343925 52.6252975 53.4546661 54.3514824 55.1769714 55.9192924 56.7203674 57.5143814 58.3994484 59.2325134 60.1187286 61.0324402 61.9444427 62.7800674 63.5838699 64.4268951 65.2922668 66.102562 66.9483185 67.7828979 68.5711517 69.3781738 70.2296753 71.0136948 71.8309097 72.6241684 73.4228134 74.2331238 74.9555359 75.7917633 76.595932 77.4842148 78.2542267 79.116394 80.0022125 80.9426041 81.8776245 82.8835602 83.9665985 85.2698517 86.7141647 88.4812393 90.4902191 92.6544647 95.0366135 97.9479218 101.726166 106.528725 113.96637 125.668655 289.142151 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.6211166 33.5543137 34.1328735 34.7711868 35.3335953 35.7990646 36.1656952 36.5992432 36.9938736 37.3790054 37.7062149 38.0139542 38.2930069 38.5890923 38.8470764 39.1595306 39.432621 39.7012062 40.0537109 40.4006424 40.7645035 41.1979446 41.5290375 41.8914642 42.2976227 42.8304062 43.4958649 44.2818604 44.9373932 45.6228867 46.5582275 47.5226746 48.4496078 49.394928 50.5523605 51.5037498 52.6262321 53.658783 54.7900543 55.9037209 56.7968445 57.8325958 58.7528839 59.6141052 60.6667786 61.6201973 62.5585747 63.511528 64.3531494 65.3853302 66.342598 67.2712326 68.2375793 69.0459137 69.9645996 70.8843079 71.6865692 72.5516357 73.399826 74.1925583 75.042778 75.9929504 76.8260651 77.5754547 78.469223 79.3786774 80.3151932 81.4482193 82.5886154 83.815712 85.1931381 86.6309204 88.1881714 89.6981277 91.339592 92.9149475 94.5082779 96.2222366 98.1786652 99.985733 101.834618 103.923698 105.91346 108.107147 110.50386 113.117348 115.668777 118.667702 122.215912 125.870773 129.846161 134.393478 139.574341 145.211975 152.334778 161.373734 172.783356 189.377686 216.450134 471.948059 ------------------------------ Transdef: Tab for variable 8 0.172416463 25.2297211 29.2589302 31.1906319 32.1027946 32.7928085 33.3600235 33.8760262 34.319725 34.7581825 35.1095047 35.4375839 35.8372574 36.1463547 36.4695816 36.7469482 37.017601 37.3011703 37.5672836 37.8219604 38.0836182 38.3482361 38.6100388 38.8520508 39.1557922 39.4423027 39.6856232 39.9858856 40.3395386 40.6946945 41.0196571 41.354805 41.7327347 42.0979538 42.5802612 43.0857735 43.6173553 44.1912193 44.7976532 45.3367462 45.9547272 46.6495743 47.2714882 48.0735588 48.7514267 49.3557205 50.052578 50.7681732 51.4456177 52.2788925 53.0509033 53.7509384 54.5422134 55.3747711 56.1158943 56.9104309 57.6887589 58.4086761 59.1486511 59.8615646 60.6286392 61.3406601 62.1588326 62.9576263 63.7209129 64.4784088 65.2380524 65.988678 66.6724091 67.4032135 68.1051788 68.8134613 69.5279388 70.2159729 70.9642792 71.7105789 72.4814453 73.1918488 73.9012222 74.601738 75.3697357 76.1336517 76.8864365 77.6981201 78.5792084 79.3382416 80.2941055 81.4159546 82.5332031 83.8443604 85.3180389 86.9383545 88.9635239 91.2853622 93.8780212 97.2465668 101.067604 106.109512 113.61937 126.587791 326.868286 ------------------------------ Transdef: Tab for variable 9 47.1748543 62.1604691 64.4388199 66.3768768 67.7663727 68.7329025 69.716568 70.470726 71.2039413 71.9839325 72.8874969 73.6195831 74.2096405 74.8276367 75.4496307 75.9054718 76.5355988 77.0263519 77.4537964 77.9999084 78.5825958 79.1113892 79.6186676 80.0605774 80.6799011 81.2337799 81.9622345 82.6328278 83.3730011 84.1151886 84.8528442 85.7470703 86.7469635 87.7753906 88.7956314 89.9929504 91.2246323 92.5185089 93.6817932 95.3768158 96.7746353 98.2134705 99.6648636 101.075363 102.260925 103.763367 105.297256 106.615204 108.166428 109.579086 111.058273 112.596222 114.006729 115.385498 116.764297 118.223221 119.688789 121.032249 122.483826 123.853073 125.157089 126.553787 127.902359 129.221954 130.558716 131.833191 133.076675 134.352203 135.605499 136.938416 138.15918 139.387756 140.610809 141.906052 143.210083 144.486588 145.632736 146.79892 148.012878 149.19281 150.310974 151.459763 152.618134 153.662888 154.769226 155.848053 156.950745 158.088806 159.263428 160.427902 161.762222 163.236908 164.767151 166.493042 168.568604 170.790222 173.860291 177.998718 184.660858 198.185822 387.21228 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.15881979 1.45158398 1.66007423 1.81136131 1.93303716 2.03016186 2.11611605 2.19126701 2.24642372 2.30069637 2.34010983 2.38658094 2.42621136 2.4622376 2.49575615 2.52673745 2.55576491 2.58496571 2.60969853 2.63009834 2.65384054 2.67529488 2.69674349 2.7163012 2.73465443 2.75334072 2.76946425 2.78381968 2.7997098 2.81273437 2.82544565 2.83442736 2.84679985 2.85694408 2.86557341 2.87530899 2.88450003 2.89393616 2.90299511 2.91100287 2.9189167 2.92660522 2.9350059 2.9426918 2.94956183 2.95543814 2.96154499 2.96785235 2.97452068 2.97934675 2.98508406 2.98964381 2.99427199 2.99949384 3.00434828 3.00860023 3.01305556 3.01749229 3.0220449 3.02612638 3.02991629 3.03404808 3.03761053 3.04145885 3.04489636 3.04871464 3.05236387 3.05603838 3.05920696 3.06278896 3.06594205 3.06871176 3.07177687 3.07467651 3.0773139 3.08036804 3.08326912 3.08638573 3.08909559 3.09197044 3.09483743 3.09711552 3.09972382 3.10205317 3.10445023 3.10715103 3.10978222 3.11257648 3.11502123 3.11750269 3.12004375 3.12247324 3.12500715 3.1275115 3.12972522 3.13211393 3.13456202 3.13691378 3.13914776 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00527000334 0.0109517844 0.0178934373 0.0241032839 0.0302944183 0.0381145477 0.0448431969 0.0518057346 0.0586323738 0.0655528307 0.0726071 0.0796744823 0.0866560936 0.093146652 0.098548919 0.105909824 0.112266548 0.118204594 0.124364287 0.130865276 0.137607202 0.144254625 0.150739968 0.157237783 0.163348436 0.168707311 0.174679279 0.180010766 0.185943484 0.191119969 0.196088672 0.200719357 0.204809457 0.20932579 0.213398337 0.217727274 0.222144604 0.226840019 0.232055098 0.236239746 0.241616905 0.246327341 0.251049578 0.255509675 0.259904861 0.264540702 0.269145131 0.274233431 0.278907895 0.283319652 0.287848115 0.293010473 0.29861486 0.3030321 0.308249712 0.31383729 0.319147825 0.324605703 0.330510527 0.335816026 0.341434717 0.347509146 0.353082418 0.359292924 0.364962399 0.371153355 0.377247334 0.383827209 0.390420586 0.397135973 0.404076099 0.410082847 0.417260885 0.424483299 0.430959702 0.439032793 0.446756124 0.45429337 0.462750435 0.471744299 0.479865313 0.489856184 0.499968946 0.508853436 0.518841207 0.528147459 0.539785087 0.552057505 0.56497848 0.578995228 0.595124662 0.610923052 0.630424142 0.645937979 0.666084051 0.697314143 0.723571658 0.77059263 0.821347833 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.207198024 0.213671923 0.219210207 0.225907043 0.231957108 0.237215281 0.242343575 0.247427404 0.253135324 0.258407652 0.263586938 0.26854682 0.27383095 0.278815091 0.284122586 0.289297253 0.294683516 0.299803138 0.304963052 0.309349477 0.314437628 0.319443285 0.324575692 0.329782546 0.335015565 0.339741707 0.34499073 0.349573612 0.354429752 0.359384745 0.364555359 0.369343668 0.374303877 0.379099429 0.384405255 0.389745831 0.394666463 0.399478734 0.403960675 0.40801537 0.411833048 0.415802866 0.419486761 0.423824966 0.427826464 0.431420803 0.435266197 0.439067423 0.443406761 0.447792768 0.452114999 0.456809819 0.461149365 0.465790987 0.470525861 0.474168301 0.478863299 0.48284176 0.487473756 0.49174276 0.496673644 0.501414895 0.506396413 0.511436343 0.516801834 0.521776199 0.526677608 0.532950103 0.538869262 0.54458952 0.550703168 0.556964338 0.562953413 0.569257319 0.577037573 0.584222436 0.591462851 0.598481297 0.606689811 0.614956319 0.622740746 0.631239891 0.63992095 0.649828911 0.659640431 0.666108429 0.676746964 0.687044859 0.69963336 0.710680604 0.721399307 0.735844731 0.749634266 0.763073921 0.77796793 0.799106598 0.827652872 0.860447288 0.906188667 1.14129901 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.6802692 22.4721985 23.1916161 23.7468948 24.2903824 24.8471985 25.3477364 25.7690468 26.2013626 26.6785011 27.1166496 27.5188732 27.9882317 28.3885727 28.7966766 29.192028 29.5334072 29.977459 30.2831402 30.6055183 30.9192257 31.2743835 31.6512871 31.9613361 32.3125 32.5784454 32.9823418 33.3604355 33.7446976 34.1195602 34.4520073 34.7841187 35.1365356 35.4995117 35.8387451 36.1741638 36.4536514 36.8487968 37.2325172 37.5999947 37.9813652 38.3295517 38.6752777 39.0666962 39.4516754 39.7777977 40.1535568 40.5208206 40.8964767 41.2749672 41.6536255 42.0569534 42.4639969 42.8428535 43.2142487 43.5814552 43.9934578 44.4082184 44.8363838 45.2457123 45.6473083 46.094017 46.5276108 46.9272614 47.3388748 47.7655029 48.1836853 48.6577568 49.1301765 49.6009407 50.119091 50.6377182 51.1212616 51.754467 52.3949432 52.9830399 53.6950302 54.3219528 55.0447769 55.7539749 56.528347 57.4390984 58.3189545 59.2009735 60.2358551 61.1739197 62.1849442 63.210228 64.6975555 66.2673645 67.8102875 69.6363449 71.8048096 74.4556656 77.3770905 80.5915527 85.1085052 91.2314377 101.063423 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0116768 10.6776924 11.0826035 11.4211197 11.7289228 12.0631466 12.4101171 12.7593632 13.1143255 13.4804058 13.7588272 14.0207453 14.3433094 14.6980438 14.9983711 15.2803822 15.5759172 15.8868351 16.2181664 16.5173664 16.8355827 17.1771069 17.5019569 17.7990074 18.1528778 18.4612694 18.7946243 19.0826378 19.3615208 19.7046452 20.029007 20.3688641 20.6848183 21.0787106 21.4205036 21.7109165 22.0126038 22.3796196 22.7683449 23.1080284 23.472271 23.7981148 24.155695 24.5163765 24.8586769 25.2008572 25.5628471 25.8843002 26.2284679 26.535881 26.9048958 27.2405281 27.5611877 27.8727551 28.2126637 28.5783768 28.9305267 29.2574959 29.6020508 29.9489937 30.2969666 30.6394806 31.0244408 31.3336678 31.5981636 31.9184971 32.2772141 32.6350632 32.9920502 33.3414268 33.7231483 34.1059303 34.5047302 34.8661423 35.2491989 35.6848068 36.0743866 36.4826584 36.880146 37.3754196 37.8391113 38.3104324 38.8131485 39.3630066 40.0077972 40.5439529 41.2068787 41.8905869 42.6454811 43.3674011 44.2300949 45.0699959 46.1301956 47.4455719 48.7616119 50.6299286 52.8377647 55.4642487 59.1303635 65.2143097 120.256287 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 69.0 54.7 58.4 34.2 53.1 66.4 59.3 67.7 -25.5 -18.4 -36.0 19.3 35.6 2 69.0 100.0 68.3 65.6 38.8 71.3 94.7 77.3 92.2 -43.4 -23.9 -45.5 33.8 43.4 3 54.7 68.3 100.0 54.2 12.3 37.0 71.9 55.9 73.0 -16.9 -25.4 -50.0 63.1 35.4 4 58.4 65.6 54.2 100.0 23.0 43.5 65.5 58.2 72.5 -10.9 -29.1 -57.2 26.4 76.0 5 34.2 38.8 12.3 23.0 100.0 84.8 12.3 60.1 59.1 22.8 -8.2 -13.3 -2.8 12.4 6 53.1 71.3 37.0 43.5 84.8 100.0 51.1 80.9 81.1 -7.6 -15.5 -28.2 12.0 27.0 7 66.4 94.7 71.9 65.5 12.3 51.1 100.0 68.8 81.4 -51.6 -23.1 -45.3 38.8 44.7 8 59.3 77.3 55.9 58.2 60.1 80.9 68.8 100.0 84.8 -10.5 -23.4 -40.2 26.7 39.5 9 67.7 92.2 73.0 72.5 59.1 81.1 81.4 84.8 100.0 -19.6 -26.4 -50.8 37.3 49.4 10 -25.5 -43.4 -16.9 -10.9 22.8 -7.6 -51.6 -10.5 -19.6 100.0 3.5 7.1 -6.6 -5.2 11 -18.4 -23.9 -25.4 -29.1 -8.2 -15.5 -23.1 -23.4 -26.4 3.5 100.0 54.5 -7.0 -17.9 12 -36.0 -45.5 -50.0 -57.2 -13.3 -28.2 -45.3 -40.2 -50.8 7.1 54.5 100.0 -20.3 -35.1 13 19.3 33.8 63.1 26.4 -2.8 12.0 38.8 26.7 37.3 -6.6 -7.0 -20.3 100.0 51.8 14 35.6 43.4 35.4 76.0 12.4 27.0 44.7 39.5 49.4 -5.2 -17.9 -35.1 51.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 177.726055 TOTAL CORRELATION OF ALL VARIABLES 75.6878037 ROUND 1: MAX CORR ( 75.6857305) AFTER KILLING INPUT VARIABLE 8 CONTR 0.560203144 ROUND 2: MAX CORR ( 75.682996) AFTER KILLING INPUT VARIABLE 14 CONTR 0.64336044 ROUND 3: MAX CORR ( 75.6796092) AFTER KILLING INPUT VARIABLE 11 CONTR 0.715982448 ROUND 4: MAX CORR ( 75.6735248) AFTER KILLING INPUT VARIABLE 6 CONTR 0.959637411 ROUND 5: MAX CORR ( 75.6649392) AFTER KILLING INPUT VARIABLE 2 CONTR 1.13987977 ROUND 6: MAX CORR ( 75.5537836) AFTER KILLING INPUT VARIABLE 12 CONTR 4.09985395 ROUND 7: MAX CORR ( 75.3478347) AFTER KILLING INPUT VARIABLE 10 CONTR 5.57476718 ROUND 8: MAX CORR ( 74.6089144) AFTER KILLING INPUT VARIABLE 13 CONTR 10.5264469 ROUND 9: MAX CORR ( 73.247758) AFTER KILLING INPUT VARIABLE 9 CONTR 14.1864745 ROUND 10: MAX CORR ( 72.9197802) AFTER KILLING INPUT VARIABLE 3 CONTR 6.92385104 ROUND 11: MAX CORR ( 71.4202149) AFTER KILLING INPUT VARIABLE 4 CONTR 14.7121463 ROUND 12: MAX CORR ( 66.4488162) AFTER KILLING INPUT VARIABLE 5 CONTR 26.1801816 LAST REMAINING VARIABLE: 7 total correlation to target: 75.6878037 % total significance: 161.024626 sigma correlations of single variables to target: variable 2: 69.0175176 % , in sigma: 146.833696 variable 3: 54.7458087 % , in sigma: 116.470857 variable 4: 58.3630289 % , in sigma: 124.166437 variable 5: 34.1575775 % , in sigma: 72.6697152 variable 6: 53.1106938 % , in sigma: 112.992175 variable 7: 66.4488162 % , in sigma: 141.368824 variable 8: 59.3195054 % , in sigma: 126.201326 variable 9: 67.6540101 % , in sigma: 143.932855 variable 10: -25.4686603 % , in sigma: 54.1841788 variable 11: -18.4467889 % , in sigma: 39.2452567 variable 12: -35.9509304 % , in sigma: 76.4850456 variable 13: 19.3203717 % , in sigma: 41.1037905 variable 14: 35.5851573 % , in sigma: 75.7068689 variables sorted by significance: 1 most relevant variable 7 corr 66.4488144 , in sigma: 141.36882 2 most relevant variable 5 corr 26.1801815 , in sigma: 55.6979292 3 most relevant variable 4 corr 14.7121458 , in sigma: 31.2998615 4 most relevant variable 3 corr 6.92385101 , in sigma: 14.7303854 5 most relevant variable 9 corr 14.1864748 , in sigma: 30.1815046 6 most relevant variable 13 corr 10.5264473 , in sigma: 22.394853 7 most relevant variable 10 corr 5.57476711 , in sigma: 11.8602304 8 most relevant variable 12 corr 4.09985399 , in sigma: 8.72237564 9 most relevant variable 2 corr 1.13987982 , in sigma: 2.4250766 10 most relevant variable 6 corr 0.959637403 , in sigma: 2.04161366 11 most relevant variable 11 corr 0.715982437 , in sigma: 1.52324151 12 most relevant variable 14 corr 0.643360436 , in sigma: 1.36873933 13 most relevant variable 8 corr 0.560203135 , in sigma: 1.19182346 global correlations between input variables: variable 2: 99.2087003 % variable 3: 92.3055422 % variable 4: 92.9526705 % variable 5: 95.3330012 % variable 6: 95.4240205 % variable 7: 98.8506728 % variable 8: 90.4185051 % variable 9: 98.6933813 % variable 10: 72.0137035 % variable 11: 55.35079 % variable 12: 72.6213714 % variable 13: 84.7728791 % variable 14: 89.4071656 % significance loss when removing single variables: variable 2: corr = 1.38776861 % , sigma = 2.95245614 variable 3: corr = 16.4028875 % , sigma = 34.8968882 variable 4: corr = 12.660675 % , sigma = 26.9353892 variable 5: corr = 16.8799984 % , sigma = 35.9119342 variable 6: corr = 1.10529007 % , sigma = 2.35148745 variable 7: corr = 8.88750899 % , sigma = 18.9080372 variable 8: corr = 0.560203144 % , sigma = 1.19182348 variable 9: corr = 11.5155531 % , sigma = 24.4991601 variable 10: corr = 5.29262676 % , sigma = 11.2599812 variable 11: corr = 0.791772298 % , sigma = 1.68448326 variable 12: corr = 3.27645909 % , sigma = 6.97061578 variable 13: corr = 7.99451767 % , sigma = 17.0082121 variable 14: corr = 0.640447508 % , sigma = 1.36254212 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 24.5190353 sigma out 15 active outputs RANK 2 NODE 5 --> 23.3209267 sigma out 15 active outputs RANK 3 NODE 6 --> 22.0533504 sigma out 15 active outputs RANK 4 NODE 2 --> 19.6914024 sigma out 15 active outputs RANK 5 NODE 1 --> 19.6446457 sigma out 15 active outputs RANK 6 NODE 3 --> 19.1783409 sigma out 15 active outputs RANK 7 NODE 4 --> 17.8944988 sigma out 15 active outputs RANK 8 NODE 8 --> 16.2201385 sigma out 15 active outputs RANK 9 NODE 7 --> 15.0191288 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 30.4315643 sigma in 9act. ( 31.8023853 sig out 1act.) RANK 2 NODE 1 --> 25.1371593 sigma in 9act. ( 31.1951103 sig out 1act.) RANK 3 NODE 7 --> 22.3896751 sigma in 9act. ( 23.4412155 sig out 1act.) RANK 4 NODE 9 --> 19.7023716 sigma in 9act. ( 23.8465271 sig out 1act.) RANK 5 NODE 13 --> 19.5092335 sigma in 9act. ( 18.8395042 sig out 1act.) RANK 6 NODE 14 --> 15.4132566 sigma in 9act. ( 20.3269138 sig out 1act.) RANK 7 NODE 6 --> 11.2062521 sigma in 9act. ( 10.4951382 sig out 1act.) RANK 8 NODE 3 --> 10.4765244 sigma in 9act. ( 10.9227371 sig out 1act.) RANK 9 NODE 8 --> 9.96992111 sigma in 9act. ( 9.14064026 sig out 1act.) RANK 10 NODE 4 --> 9.39454937 sigma in 9act. ( 12.1119423 sig out 1act.) RANK 11 NODE 10 --> 7.24304867 sigma in 9act. ( 6.44057798 sig out 1act.) RANK 12 NODE 2 --> 4.35070753 sigma in 9act. ( 2.3658371 sig out 1act.) RANK 13 NODE 11 --> 4.04642868 sigma in 9act. ( 7.93641472 sig out 1act.) RANK 14 NODE 5 --> 1.84414613 sigma in 9act. ( 2.73939347 sig out 1act.) RANK 15 NODE 12 --> 1.40559018 sigma in 9act. ( 1.28644526 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 31.8023853 sigma out 1act.( 30.4315643 sig in 9act.) RANK 2 NODE 1 --> 31.1951103 sigma out 1act.( 25.1371593 sig in 9act.) RANK 3 NODE 9 --> 23.8465271 sigma out 1act.( 19.7023716 sig in 9act.) RANK 4 NODE 7 --> 23.4412155 sigma out 1act.( 22.3896751 sig in 9act.) RANK 5 NODE 14 --> 20.3269138 sigma out 1act.( 15.4132566 sig in 9act.) RANK 6 NODE 13 --> 18.8395042 sigma out 1act.( 19.5092335 sig in 9act.) RANK 7 NODE 4 --> 12.1119423 sigma out 1act.( 9.39454937 sig in 9act.) RANK 8 NODE 3 --> 10.9227371 sigma out 1act.( 10.4765244 sig in 9act.) RANK 9 NODE 6 --> 10.4951382 sigma out 1act.( 11.2062521 sig in 9act.) RANK 10 NODE 8 --> 9.14064026 sigma out 1act.( 9.96992111 sig in 9act.) RANK 11 NODE 11 --> 7.93641472 sigma out 1act.( 4.04642868 sig in 9act.) RANK 12 NODE 10 --> 6.44057798 sigma out 1act.( 7.24304867 sig in 9act.) RANK 13 NODE 5 --> 2.73939347 sigma out 1act.( 1.84414613 sig in 9act.) RANK 14 NODE 2 --> 2.3658371 sigma out 1act.( 4.35070753 sig in 9act.) RANK 15 NODE 12 --> 1.28644526 sigma out 1act.( 1.40559018 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.7061691 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 26.0359592 sigma out 15 active outputs RANK 2 NODE 9 --> 24.6571617 sigma out 15 active outputs RANK 3 NODE 5 --> 23.2909775 sigma out 15 active outputs RANK 4 NODE 1 --> 23.0073757 sigma out 15 active outputs RANK 5 NODE 6 --> 21.4631805 sigma out 15 active outputs RANK 6 NODE 3 --> 20.2750416 sigma out 15 active outputs RANK 7 NODE 4 --> 19.4094296 sigma out 15 active outputs RANK 8 NODE 8 --> 17.086401 sigma out 15 active outputs RANK 9 NODE 7 --> 15.2724915 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 28.2227173 sigma in 9act. ( 28.986042 sig out 1act.) RANK 2 NODE 7 --> 25.7617512 sigma in 9act. ( 23.6980705 sig out 1act.) RANK 3 NODE 1 --> 25.7528706 sigma in 9act. ( 28.1185188 sig out 1act.) RANK 4 NODE 9 --> 23.508955 sigma in 9act. ( 22.3642464 sig out 1act.) RANK 5 NODE 14 --> 18.3884792 sigma in 9act. ( 18.2883492 sig out 1act.) RANK 6 NODE 13 --> 16.4248142 sigma in 9act. ( 15.8203154 sig out 1act.) RANK 7 NODE 11 --> 12.013339 sigma in 9act. ( 8.22481251 sig out 1act.) RANK 8 NODE 4 --> 11.8135014 sigma in 9act. ( 11.6760244 sig out 1act.) RANK 9 NODE 8 --> 11.0112972 sigma in 9act. ( 8.0213871 sig out 1act.) RANK 10 NODE 3 --> 10.8896418 sigma in 9act. ( 9.86596775 sig out 1act.) RANK 11 NODE 5 --> 10.5355997 sigma in 9act. ( 6.42819595 sig out 1act.) RANK 12 NODE 6 --> 8.93162537 sigma in 9act. ( 8.30445671 sig out 1act.) RANK 13 NODE 10 --> 7.55643272 sigma in 9act. ( 5.48426104 sig out 1act.) RANK 14 NODE 12 --> 6.86815214 sigma in 9act. ( 2.14070606 sig out 1act.) RANK 15 NODE 2 --> 5.34634256 sigma in 9act. ( 1.84071541 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 28.986042 sigma out 1act.( 28.2227173 sig in 9act.) RANK 2 NODE 1 --> 28.1185188 sigma out 1act.( 25.7528706 sig in 9act.) RANK 3 NODE 7 --> 23.6980705 sigma out 1act.( 25.7617512 sig in 9act.) RANK 4 NODE 9 --> 22.3642464 sigma out 1act.( 23.508955 sig in 9act.) RANK 5 NODE 14 --> 18.2883492 sigma out 1act.( 18.3884792 sig in 9act.) RANK 6 NODE 13 --> 15.8203154 sigma out 1act.( 16.4248142 sig in 9act.) RANK 7 NODE 4 --> 11.6760244 sigma out 1act.( 11.8135014 sig in 9act.) RANK 8 NODE 3 --> 9.86596775 sigma out 1act.( 10.8896418 sig in 9act.) RANK 9 NODE 6 --> 8.30445671 sigma out 1act.( 8.93162537 sig in 9act.) RANK 10 NODE 11 --> 8.22481251 sigma out 1act.( 12.013339 sig in 9act.) RANK 11 NODE 8 --> 8.0213871 sigma out 1act.( 11.0112972 sig in 9act.) RANK 12 NODE 5 --> 6.42819595 sigma out 1act.( 10.5355997 sig in 9act.) RANK 13 NODE 10 --> 5.48426104 sigma out 1act.( 7.55643272 sig in 9act.) RANK 14 NODE 12 --> 2.14070606 sigma out 1act.( 6.86815214 sig in 9act.) RANK 15 NODE 2 --> 1.84071541 sigma out 1act.( 5.34634256 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.5738297 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.430612653 *** contribution from regularisation: 0.00341572589 *** contribution from error: -0.434028387 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.486183435 *** contribution from regularisation: 0.00213992363 *** contribution from error: -0.488323361 *********************************************** -----------------> Test sample ENTER BFGS code START -48991.596 0.221196443 0.0964177549 EXIT FROM BFGS code FG_START 0. 0.221196443 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.512459695 *** contribution from regularisation: 0.00213733618 *** contribution from error: -0.514597058 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -51628.7743 0.221196443 21.4178104 EXIT FROM BFGS code FG_LNSRCH 0. 0.224206969 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.555724442 *** contribution from regularisation: 0.00266821519 *** contribution from error: -0.558392644 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55987.5694 0.224206969 8.38775635 EXIT FROM BFGS code NEW_X -55987.5694 0.224206969 8.38775635 ENTER BFGS code NEW_X -55987.5694 0.224206969 8.38775635 EXIT FROM BFGS code FG_LNSRCH 0. 0.225849986 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.559367418 *** contribution from regularisation: 0.00274210493 *** contribution from error: -0.56210953 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56354.5885 0.225849986 1.98137844 EXIT FROM BFGS code NEW_X -56354.5885 0.225849986 1.98137844 ENTER BFGS code NEW_X -56354.5885 0.225849986 1.98137844 EXIT FROM BFGS code FG_LNSRCH 0. 0.226472318 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.560897887 *** contribution from regularisation: 0.00262280973 *** contribution from error: -0.56352067 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56508.7788 0.226472318 -6.48323584 EXIT FROM BFGS code NEW_X -56508.7788 0.226472318 -6.48323584 ENTER BFGS code NEW_X -56508.7788 0.226472318 -6.48323584 EXIT FROM BFGS code FG_LNSRCH 0. 0.223387226 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.561250865 *** contribution from regularisation: 0.00250511453 *** contribution from error: -0.563755989 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56544.341 0.223387226 -3.91164088 EXIT FROM BFGS code NEW_X -56544.341 0.223387226 -3.91164088 ENTER BFGS code NEW_X -56544.341 0.223387226 -3.91164088 EXIT FROM BFGS code FG_LNSRCH 0. 0.22267215 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.561448812 *** contribution from regularisation: 0.00247890619 *** contribution from error: -0.56392771 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56564.2806 0.22267215 -4.97523451 EXIT FROM BFGS code NEW_X -56564.2806 0.22267215 -4.97523451 ENTER BFGS code NEW_X -56564.2806 0.22267215 -4.97523451 EXIT FROM BFGS code FG_LNSRCH 0. 0.219451889 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.561680734 *** contribution from regularisation: 0.00245873979 *** contribution from error: -0.564139485 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56587.6476 0.219451889 -6.12112141 EXIT FROM BFGS code NEW_X -56587.6476 0.219451889 -6.12112141 ENTER BFGS code NEW_X -56587.6476 0.219451889 -6.12112141 EXIT FROM BFGS code FG_LNSRCH 0. 0.205139995 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 43.543808 sigma out 15 active outputs RANK 2 NODE 1 --> 28.8236656 sigma out 15 active outputs RANK 3 NODE 8 --> 23.0326805 sigma out 15 active outputs RANK 4 NODE 9 --> 21.1588097 sigma out 15 active outputs RANK 5 NODE 4 --> 19.6548233 sigma out 15 active outputs RANK 6 NODE 3 --> 16.8722248 sigma out 15 active outputs RANK 7 NODE 5 --> 16.7574577 sigma out 15 active outputs RANK 8 NODE 7 --> 15.7667818 sigma out 15 active outputs RANK 9 NODE 6 --> 13.4216404 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 32.1831131 sigma in 9act. ( 31.5023727 sig out 1act.) RANK 2 NODE 5 --> 29.3955078 sigma in 9act. ( 21.7494698 sig out 1act.) RANK 3 NODE 11 --> 27.2639084 sigma in 9act. ( 23.262598 sig out 1act.) RANK 4 NODE 9 --> 23.9228001 sigma in 9act. ( 19.3910065 sig out 1act.) RANK 5 NODE 1 --> 20.1011467 sigma in 9act. ( 17.8650208 sig out 1act.) RANK 6 NODE 14 --> 19.6953583 sigma in 9act. ( 17.578867 sig out 1act.) RANK 7 NODE 12 --> 18.7372341 sigma in 9act. ( 12.9723091 sig out 1act.) RANK 8 NODE 4 --> 13.597353 sigma in 9act. ( 11.4142065 sig out 1act.) RANK 9 NODE 15 --> 13.4557219 sigma in 9act. ( 14.4231663 sig out 1act.) RANK 10 NODE 8 --> 11.3664684 sigma in 9act. ( 9.25944233 sig out 1act.) RANK 11 NODE 3 --> 8.48034191 sigma in 9act. ( 8.59953022 sig out 1act.) RANK 12 NODE 13 --> 8.08967876 sigma in 9act. ( 6.78504753 sig out 1act.) RANK 13 NODE 10 --> 6.58909273 sigma in 9act. ( 5.0521574 sig out 1act.) RANK 14 NODE 6 --> 6.12908125 sigma in 9act. ( 4.82590199 sig out 1act.) RANK 15 NODE 2 --> 3.68726087 sigma in 9act. ( 1.68889797 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 31.5023727 sigma out 1act.( 32.1831131 sig in 9act.) RANK 2 NODE 11 --> 23.262598 sigma out 1act.( 27.2639084 sig in 9act.) RANK 3 NODE 5 --> 21.7494698 sigma out 1act.( 29.3955078 sig in 9act.) RANK 4 NODE 9 --> 19.3910065 sigma out 1act.( 23.9228001 sig in 9act.) RANK 5 NODE 1 --> 17.8650208 sigma out 1act.( 20.1011467 sig in 9act.) RANK 6 NODE 14 --> 17.578867 sigma out 1act.( 19.6953583 sig in 9act.) RANK 7 NODE 15 --> 14.4231663 sigma out 1act.( 13.4557219 sig in 9act.) RANK 8 NODE 12 --> 12.9723091 sigma out 1act.( 18.7372341 sig in 9act.) RANK 9 NODE 4 --> 11.4142065 sigma out 1act.( 13.597353 sig in 9act.) RANK 10 NODE 8 --> 9.25944233 sigma out 1act.( 11.3664684 sig in 9act.) RANK 11 NODE 3 --> 8.59953022 sigma out 1act.( 8.48034191 sig in 9act.) RANK 12 NODE 13 --> 6.78504753 sigma out 1act.( 8.08967876 sig in 9act.) RANK 13 NODE 10 --> 5.0521574 sigma out 1act.( 6.58909273 sig in 9act.) RANK 14 NODE 6 --> 4.82590199 sigma out 1act.( 6.12908125 sig in 9act.) RANK 15 NODE 2 --> 1.68889797 sigma out 1act.( 3.68726087 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.4390678 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.562385917 *** contribution from regularisation: 0.00241133524 *** contribution from error: -0.564797223 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56658.6943 0.205139995 -11.853672 EXIT FROM BFGS code NEW_X -56658.6943 0.205139995 -11.853672 ENTER BFGS code NEW_X -56658.6943 0.205139995 -11.853672 EXIT FROM BFGS code FG_LNSRCH 0. 0.174260348 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.56331414 *** contribution from regularisation: 0.00253212731 *** contribution from error: -0.565846264 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56752.2087 0.174260348 -18.2683849 EXIT FROM BFGS code NEW_X -56752.2087 0.174260348 -18.2683849 ENTER BFGS code NEW_X -56752.2087 0.174260348 -18.2683849 EXIT FROM BFGS code FG_LNSRCH 0. 0.126056999 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.56350261 *** contribution from regularisation: 0.00291332952 *** contribution from error: -0.566415966 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56771.1991 0.126056999 50.088295 EXIT FROM BFGS code FG_LNSRCH 0. 0.150650755 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.564354777 *** contribution from regularisation: 0.00226337556 *** contribution from error: -0.566618145 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56857.0502 0.150650755 6.86686182 EXIT FROM BFGS code NEW_X -56857.0502 0.150650755 6.86686182 ENTER BFGS code NEW_X -56857.0502 0.150650755 6.86686182 EXIT FROM BFGS code FG_LNSRCH 0. 0.146731436 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.564273119 *** contribution from regularisation: 0.00260196161 *** contribution from error: -0.5668751 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56848.8226 0.146731436 6.63050699 EXIT FROM BFGS code FG_LNSRCH 0. 0.14993152 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.564211071 *** contribution from regularisation: 0.00246830261 *** contribution from error: -0.566679358 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56842.5738 0.14993152 6.88309431 EXIT FROM BFGS code FG_LNSRCH 0. 0.150618568 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.564113677 *** contribution from regularisation: 0.00250739628 *** contribution from error: -0.566621065 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56832.7631 0.150618568 6.92469311 EXIT FROM BFGS code FG_LNSRCH 0. 0.15065071 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.564098537 *** contribution from regularisation: 0.00251961011 *** contribution from error: -0.566618145 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56831.2358 0.15065071 6.95702696 EXIT FROM BFGS code FG_LNSRCH 0. 0.150650755 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.564103603 *** contribution from regularisation: 0.00251452997 *** contribution from error: -0.566618145 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56831.7472 0.150650755 6.98670816 EXIT FROM BFGS code FG_LNSRCH 0. 0.150650755 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.564113796 *** contribution from regularisation: 0.00250433246 *** contribution from error: -0.566618145 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56832.7745 0.150650755 6.95331573 EXIT FROM BFGS code FG_LNSRCH 0. 0.150650755 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 46.9719849 sigma out 15 active outputs RANK 2 NODE 1 --> 27.4701653 sigma out 15 active outputs RANK 3 NODE 4 --> 26.5758839 sigma out 15 active outputs RANK 4 NODE 8 --> 24.9629173 sigma out 15 active outputs RANK 5 NODE 7 --> 24.0898972 sigma out 15 active outputs RANK 6 NODE 5 --> 23.6315193 sigma out 15 active outputs RANK 7 NODE 9 --> 21.589819 sigma out 15 active outputs RANK 8 NODE 3 --> 16.6927662 sigma out 15 active outputs RANK 9 NODE 6 --> 13.4018936 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 45.6244125 sigma in 9act. ( 47.5081062 sig out 1act.) RANK 2 NODE 11 --> 32.71315 sigma in 9act. ( 31.9643269 sig out 1act.) RANK 3 NODE 5 --> 30.8833523 sigma in 9act. ( 27.426199 sig out 1act.) RANK 4 NODE 1 --> 25.1423893 sigma in 9act. ( 22.9543209 sig out 1act.) RANK 5 NODE 9 --> 20.8613224 sigma in 9act. ( 23.3576241 sig out 1act.) RANK 6 NODE 14 --> 19.5400581 sigma in 9act. ( 17.8499641 sig out 1act.) RANK 7 NODE 12 --> 17.9855347 sigma in 9act. ( 12.6769648 sig out 1act.) RANK 8 NODE 4 --> 11.7507467 sigma in 9act. ( 9.74472141 sig out 1act.) RANK 9 NODE 15 --> 10.1031189 sigma in 9act. ( 9.49222088 sig out 1act.) RANK 10 NODE 8 --> 9.70534706 sigma in 9act. ( 8.66827774 sig out 1act.) RANK 11 NODE 3 --> 6.6890769 sigma in 9act. ( 5.27610111 sig out 1act.) RANK 12 NODE 13 --> 5.70787764 sigma in 9act. ( 4.23203564 sig out 1act.) RANK 13 NODE 10 --> 5.1199007 sigma in 9act. ( 4.03698015 sig out 1act.) RANK 14 NODE 6 --> 4.65342855 sigma in 9act. ( 3.64239979 sig out 1act.) RANK 15 NODE 2 --> 3.98353791 sigma in 9act. ( 3.30019569 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 47.5081062 sigma out 1act.( 45.6244125 sig in 9act.) RANK 2 NODE 11 --> 31.9643269 sigma out 1act.( 32.71315 sig in 9act.) RANK 3 NODE 5 --> 27.426199 sigma out 1act.( 30.8833523 sig in 9act.) RANK 4 NODE 9 --> 23.3576241 sigma out 1act.( 20.8613224 sig in 9act.) RANK 5 NODE 1 --> 22.9543209 sigma out 1act.( 25.1423893 sig in 9act.) RANK 6 NODE 14 --> 17.8499641 sigma out 1act.( 19.5400581 sig in 9act.) RANK 7 NODE 12 --> 12.6769648 sigma out 1act.( 17.9855347 sig in 9act.) RANK 8 NODE 4 --> 9.74472141 sigma out 1act.( 11.7507467 sig in 9act.) RANK 9 NODE 15 --> 9.49222088 sigma out 1act.( 10.1031189 sig in 9act.) RANK 10 NODE 8 --> 8.66827774 sigma out 1act.( 9.70534706 sig in 9act.) RANK 11 NODE 3 --> 5.27610111 sigma out 1act.( 6.6890769 sig in 9act.) RANK 12 NODE 13 --> 4.23203564 sigma out 1act.( 5.70787764 sig in 9act.) RANK 13 NODE 10 --> 4.03698015 sigma out 1act.( 5.1199007 sig in 9act.) RANK 14 NODE 6 --> 3.64239979 sigma out 1act.( 4.65342855 sig in 9act.) RANK 15 NODE 2 --> 3.30019569 sigma out 1act.( 3.98353791 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 77.0009384 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.56409508 *** contribution from regularisation: 0.0025230872 *** contribution from error: -0.566618145 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56830.8851 0.150650755 6.99830103 EXIT FROM BFGS code NEW_X -56830.8851 0.150650755 6.99830103 ENTER BFGS code NEW_X -56830.8851 0.150650755 6.99830103 EXIT FROM BFGS code CONVERGENC -56830.8851 0.150650755 6.99830103 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 68.6540146 sigma out 15 active outputs RANK 2 NODE 1 --> 40.6219978 sigma out 15 active outputs RANK 3 NODE 4 --> 40.0195923 sigma out 15 active outputs RANK 4 NODE 8 --> 36.7787666 sigma out 15 active outputs RANK 5 NODE 7 --> 35.7880402 sigma out 15 active outputs RANK 6 NODE 5 --> 34.8605919 sigma out 15 active outputs RANK 7 NODE 9 --> 32.46035 sigma out 15 active outputs RANK 8 NODE 3 --> 25.4581299 sigma out 15 active outputs RANK 9 NODE 6 --> 18.901762 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 68.6013947 sigma in 9act. ( 70.8091049 sig out 1act.) RANK 2 NODE 11 --> 47.7464333 sigma in 9act. ( 48.5110817 sig out 1act.) RANK 3 NODE 5 --> 45.6326332 sigma in 9act. ( 40.7248306 sig out 1act.) RANK 4 NODE 1 --> 37.5499649 sigma in 9act. ( 34.0158577 sig out 1act.) RANK 5 NODE 9 --> 30.8630505 sigma in 9act. ( 35.0954475 sig out 1act.) RANK 6 NODE 14 --> 28.6751518 sigma in 9act. ( 26.9074764 sig out 1act.) RANK 7 NODE 12 --> 26.3037949 sigma in 9act. ( 19.0399036 sig out 1act.) RANK 8 NODE 4 --> 17.0997162 sigma in 9act. ( 14.6334896 sig out 1act.) RANK 9 NODE 15 --> 13.9096775 sigma in 9act. ( 14.2872038 sig out 1act.) RANK 10 NODE 8 --> 13.7163992 sigma in 9act. ( 13.0495586 sig out 1act.) RANK 11 NODE 3 --> 8.82137775 sigma in 9act. ( 7.94681168 sig out 1act.) RANK 12 NODE 13 --> 7.99115276 sigma in 9act. ( 6.29147243 sig out 1act.) RANK 13 NODE 10 --> 6.73793268 sigma in 9act. ( 6.01753521 sig out 1act.) RANK 14 NODE 6 --> 6.2771945 sigma in 9act. ( 5.28251362 sig out 1act.) RANK 15 NODE 2 --> 5.24302197 sigma in 9act. ( 4.84340286 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 70.8091049 sigma out 1act.( 68.6013947 sig in 9act.) RANK 2 NODE 11 --> 48.5110817 sigma out 1act.( 47.7464333 sig in 9act.) RANK 3 NODE 5 --> 40.7248306 sigma out 1act.( 45.6326332 sig in 9act.) RANK 4 NODE 9 --> 35.0954475 sigma out 1act.( 30.8630505 sig in 9act.) RANK 5 NODE 1 --> 34.0158577 sigma out 1act.( 37.5499649 sig in 9act.) RANK 6 NODE 14 --> 26.9074764 sigma out 1act.( 28.6751518 sig in 9act.) RANK 7 NODE 12 --> 19.0399036 sigma out 1act.( 26.3037949 sig in 9act.) RANK 8 NODE 4 --> 14.6334896 sigma out 1act.( 17.0997162 sig in 9act.) RANK 9 NODE 15 --> 14.2872038 sigma out 1act.( 13.9096775 sig in 9act.) RANK 10 NODE 8 --> 13.0495586 sigma out 1act.( 13.7163992 sig in 9act.) RANK 11 NODE 3 --> 7.94681168 sigma out 1act.( 8.82137775 sig in 9act.) RANK 12 NODE 13 --> 6.29147243 sigma out 1act.( 7.99115276 sig in 9act.) RANK 13 NODE 10 --> 6.01753521 sigma out 1act.( 6.73793268 sig in 9act.) RANK 14 NODE 6 --> 5.28251362 sigma out 1act.( 6.2771945 sig in 9act.) RANK 15 NODE 2 --> 4.84340286 sigma out 1act.( 5.24302197 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 115.238571 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.564111888 *** contribution from regularisation: 0.00250624213 *** contribution from error: -0.566618145 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done