NNInput NNInputs_140.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 189458 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 47753 nbkg = 141705 Bkg Entries: 141705 Sig Entries: 47753 Chosen entries: 47753 Signal fraction: 1 Background fraction: 0.336989 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 141705 Actual Signal Entries: 47753 Entries to split: 47753 Test with : 23876 Train with : 23876 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 47753 for Signal Prepared event 0 for Signal with 47753 events ====Entry 0 Variable Ht : 135.044 Variable LepAPt : 36.7733 Variable LepBPt : 15.1786 Variable MetSigLeptonsJets : 6.335 Variable MetSpec : 56.2375 Variable SumEtLeptonsJets : 78.8061 Variable VSumJetLeptonsPt : 65.4215 Variable addEt : 108.19 Variable dPhiLepSumMet : 2.59573 Variable dPhiLeptons : 0.533909 Variable dRLeptons : 0.613899 Variable lep1_E : 40.034 Variable lep2_E : 15.2798 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2140 Ht = 135.044 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.7735 LepAPt = 36.7733 LepBEt = 15.1793 LepBPt = 15.1786 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 56.2375 MetDelPhi = 2.21558 MetSig = 4.21501 MetSigLeptonsJets = 6.335 MetSpec = 56.2375 Mjj = 0 MostCentralJetEta = -0.266727 MtllMet = 110.158 Njets = 1 SB = 0 SumEt = 178.015 SumEtJets = 0 SumEtLeptonsJets = 78.8061 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 65.4215 addEt = 108.19 dPhiLepSumMet = 2.59573 dPhiLeptons = 0.533909 dRLeptons = 0.613899 diltype = 17 dimass = 14.3911 event = 161 jet1_Et = 26.8541 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.034 lep2_E = 15.2798 rand = 0.999742 run = 234313 weight = 2.40583e-06 ===Show End Prepared event 10000 for Signal with 47753 events Prepared event 20000 for Signal with 47753 events Prepared event 30000 for Signal with 47753 events Prepared event 40000 for Signal with 47753 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 141705 for Background Prepared event 0 for Background with 141705 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.275322 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 141705 events Prepared event 20000 for Background with 141705 events Prepared event 30000 for Background with 141705 events Prepared event 40000 for Background with 141705 events Prepared event 50000 for Background with 141705 events Prepared event 60000 for Background with 141705 events Prepared event 70000 for Background with 141705 events Prepared event 80000 for Background with 141705 events Prepared event 90000 for Background with 141705 events Prepared event 100000 for Background with 141705 events Prepared event 110000 for Background with 141705 events Prepared event 120000 for Background with 141705 events Prepared event 130000 for Background with 141705 events Prepared event 140000 for Background with 141705 events Warning: found 4453 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 189458 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4453 negative weights. Signal fraction: 63.1225815 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.3376122 62.3160057 64.5658112 66.3218536 67.7306061 68.8593445 69.8618011 70.7077942 71.4665527 72.3157806 73.2223969 73.8739243 74.4000549 75.0681992 75.773407 76.4407654 76.9994354 77.6316223 78.1888657 78.8119049 79.3511963 79.8842163 80.6833344 81.3163452 81.9861908 82.5556564 83.311676 84.0789795 84.9956055 85.9082336 86.880928 87.9231567 88.7197189 89.866066 91.3190002 92.5789795 93.8710632 95.2470856 96.4724579 97.6420746 98.7820892 100.012978 101.356583 102.43335 103.666374 104.947899 106.088715 107.356499 108.530655 109.690186 110.848297 112.182579 113.373276 114.675919 115.89505 116.935364 118.145805 119.309906 120.543396 121.611031 122.790176 123.948845 125.130646 126.340004 127.534897 128.550385 129.682037 130.841248 132.116577 133.418259 134.756439 136.235718 137.641327 139.110901 140.831635 142.637482 144.33606 146.438599 148.351379 150.621567 152.875885 155.16391 157.685272 160.237656 162.960449 165.692963 168.522461 172.021118 175.322327 179.334686 183.325989 187.935806 193.265839 199.101318 206.805084 215.265839 225.231049 239.678925 262.559021 311.68692 870.135071 ------------------------------ Transdef: Tab for variable 3 20.0001564 20.3259029 20.5931091 20.8259583 21.0837669 21.3361912 21.5651054 21.8026733 21.9855919 22.1860428 22.3949318 22.6161499 22.8520622 23.0723686 23.2536583 23.4751396 23.6699085 23.8333244 24.0204506 24.2311974 24.4354477 24.6293182 24.8386536 25.0705318 25.2371979 25.4304352 25.5781059 25.7372551 25.9215546 26.1460228 26.3152924 26.5090714 26.7216644 26.8927269 27.0912724 27.2830429 27.5123653 27.7179699 27.907814 28.0857525 28.2751637 28.4913635 28.6823254 28.9201851 29.1195431 29.2792473 29.4731255 29.7517452 29.9836578 30.1910439 30.4519997 30.6938477 30.9715118 31.1831284 31.4304867 31.674057 31.9401398 32.1794205 32.4141541 32.6732521 32.951664 33.2167816 33.4936485 33.7657547 34.0364304 34.3232307 34.6502228 34.9550247 35.2456818 35.5623474 35.8609009 36.1755486 36.5141754 36.8326645 37.166275 37.5726776 37.9938736 38.4074326 38.8224411 39.2350616 39.6816711 40.1514587 40.5831604 40.9741859 41.5351791 42.0589981 42.7101326 43.3608208 44.0848389 44.9213943 45.8378296 46.8166046 47.9180984 49.08284 50.5556183 52.2033005 54.1047821 56.9876175 61.0351143 69.0927124 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1182976 10.2322721 10.3399906 10.4575653 10.5521107 10.6700706 10.7819052 10.8977098 10.9976749 11.1122475 11.2489414 11.3704624 11.4892101 11.6347122 11.764307 11.9162226 12.0626316 12.1930866 12.3234177 12.4564085 12.5993824 12.753294 12.8937311 13.0512171 13.2097263 13.3588505 13.4908791 13.659791 13.7844296 13.9505081 14.1073799 14.2485409 14.3989124 14.5784798 14.7679672 14.9358444 15.1196537 15.311882 15.4707394 15.643568 15.8181725 15.9745693 16.1730061 16.3751106 16.5766029 16.7662392 16.948534 17.1785698 17.378643 17.6257973 17.8159523 17.9862728 18.1905651 18.401741 18.6180382 18.8432503 19.0630989 19.2966251 19.5343704 19.7823181 20.0322418 20.2475243 20.4476776 20.693203 20.9091377 21.1748199 21.4170456 21.6554756 21.8963013 22.1306686 22.3922234 22.6191502 22.9103622 23.2123871 23.4573097 23.748539 24.0349216 24.331646 24.651844 24.9853897 25.2949638 25.6388397 25.9936066 26.362381 26.7685871 27.1694775 27.5718956 27.9873505 28.4576645 28.895834 29.4149818 29.9981327 30.6258602 31.3611221 32.1599121 33.2121353 34.5732689 36.6808243 40.5521088 71.5196915 ------------------------------ Transdef: Tab for variable 5 0.845276415 2.48906851 2.8761375 3.14002371 3.35835981 3.57050657 3.75476933 3.90801477 4.05671072 4.17683601 4.28680038 4.38648844 4.48013973 4.57670784 4.65983391 4.7421422 4.81847095 4.90310049 4.98239899 5.04832983 5.11699152 5.18229485 5.2485137 5.30316782 5.35852814 5.4032011 5.45446205 5.50249577 5.54888153 5.59367895 5.63380432 5.68104744 5.72479582 5.77181244 5.8156929 5.86058426 5.90650654 5.94368172 5.99098301 6.03345966 6.07379532 6.11100626 6.14561033 6.19146156 6.23139763 6.27303123 6.3159709 6.353405 6.39463329 6.43786049 6.47258711 6.51992607 6.56077385 6.60482645 6.65045214 6.69315815 6.73544788 6.77713871 6.82151508 6.85815525 6.89598179 6.93691921 6.98804188 7.03781223 7.07765388 7.12239742 7.16388416 7.2104373 7.24967861 7.29993629 7.34695435 7.39363098 7.44496918 7.49875259 7.53914404 7.59315634 7.64377785 7.70175457 7.76074696 7.81522846 7.87325287 7.93168163 7.98535347 8.05207253 8.11817455 8.18446541 8.25418282 8.3326416 8.41374588 8.49078751 8.59223461 8.69008636 8.79328537 8.9214735 9.07231522 9.26750374 9.47429657 9.75523186 10.1945362 11.0481739 20.215023 ------------------------------ Transdef: Tab for variable 6 15.0004978 19.3138065 23.5786343 25.5151291 26.3899841 27.2571259 27.9889641 28.7949028 29.4752617 30.1357651 30.8260174 31.4459991 31.9090004 32.4332657 32.9082642 33.323864 33.7897949 34.2873039 34.6335297 34.9907188 35.4344406 35.8292961 36.1544571 36.4817963 36.820118 37.1681328 37.4989243 37.8676529 38.2088776 38.5509148 38.8729897 39.2483253 39.5810242 39.8837433 40.2412567 40.5502434 40.9107895 41.324234 41.6915016 42.1058502 42.5192986 42.9155655 43.2893372 43.716507 44.1891174 44.5455017 45.0271263 45.5929184 46.0640564 46.6150589 47.1443863 47.661171 48.2027664 48.7410507 49.2446365 49.8198547 50.3333588 50.7795105 51.3130341 51.9269371 52.4852676 53.1121521 53.6714554 54.2778931 54.8420639 55.4254379 56.0247116 56.6086617 57.1406326 57.6993561 58.2583618 58.8781357 59.4980621 60.1035538 60.7421989 61.3767166 61.9860382 62.6158943 63.2664032 63.9592133 64.6023636 65.2683105 66.0076523 66.8290253 67.6736603 68.4949951 69.3744659 70.3551331 71.4473343 72.6281509 73.8907471 75.4499054 76.7148285 78.4690628 80.8181458 83.2987976 86.6948853 90.8412018 96.8935699 107.672882 236.562576 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.5621414 33.426445 34.1968689 34.8771248 35.4061508 35.8262711 36.2097473 36.6356926 37.0051498 37.3356476 37.6619492 38.030304 38.282856 38.5824814 38.8142204 39.0825081 39.3559647 39.6778069 40.026329 40.3131409 40.6435318 40.9268723 41.2408714 41.5769157 41.912323 42.3059578 42.7342911 43.165596 43.6546135 44.2723503 44.7646942 45.1855621 45.8381042 46.5316048 47.2373199 47.9496689 48.6233597 49.3947983 50.1429596 50.9246216 51.6649628 52.4238396 53.1337967 53.8810196 54.7228241 55.4067078 56.0870209 56.8961906 57.4641647 58.1349525 58.8395157 59.493927 60.2084198 60.9236374 61.6423035 62.2693481 62.9677277 63.7312698 64.4598389 65.1538086 65.9756317 66.7741394 67.6398468 68.6093292 69.6717224 70.8949738 71.9485321 73.157692 74.3151093 75.6192551 77.0353088 78.3248749 79.7226868 81.2666321 82.7350922 84.3558655 85.917511 87.7582626 89.498703 91.3674774 93.3109665 95.3494263 97.3234406 99.4902496 101.950455 104.550491 107.255623 110.259201 113.500648 117.054291 121.275818 125.813614 130.927246 136.828506 144.613892 154.207214 166.509354 184.62265 220.472046 542.489136 ------------------------------ Transdef: Tab for variable 8 1.91423655 22.461729 27.1404152 29.7102413 31.0266495 31.8410168 32.5622559 33.0859566 33.6285019 34.0722427 34.4874954 34.8828392 35.213974 35.5418625 35.8744736 36.1622162 36.4810791 36.7573471 37.0458298 37.3127327 37.5812607 37.8272247 38.0784988 38.3011971 38.5792732 38.8101921 39.0506744 39.3395805 39.6804543 39.9382057 40.1830444 40.4601288 40.76091 41.0538864 41.325489 41.6572914 41.9896469 42.3358002 42.6808243 43.076973 43.4322968 43.8895035 44.3187103 44.7161064 45.1533051 45.5910454 46.0464706 46.5216103 47.0078506 47.5256653 48.0475082 48.5649719 49.0581512 49.4876099 50.0568466 50.5930862 51.0699463 51.6579552 52.2160187 52.7592735 53.2363815 53.7722321 54.3172684 54.8678894 55.3565292 55.9040489 56.4716377 56.9829941 57.5295105 58.1194649 58.6803284 59.1847687 59.7748795 60.3845558 60.9586258 61.4862823 62.0765305 62.7061081 63.2599411 63.9328003 64.5642853 65.2282867 65.9088287 66.6621628 67.4565506 68.3662262 69.3255463 70.3683014 71.4263611 72.6592407 74.0048981 75.6002731 77.3501511 79.3689957 81.9686584 84.9890823 88.7679596 94.2867432 101.844101 118.173355 361.698761 ------------------------------ Transdef: Tab for variable 9 47.3376122 61.5705338 63.8382034 65.6117401 66.7960815 68.0128937 68.9198074 69.7949677 70.5020599 71.2729874 71.9055099 72.7874451 73.3865662 73.9556885 74.4294968 75.0610962 75.6575241 76.1906891 76.7575531 77.2893066 77.7965088 78.2683487 78.795166 79.2594833 79.7589264 80.3614655 80.9618073 81.4909363 82.0301743 82.5547104 83.1076508 83.7153015 84.5034409 85.1255951 85.8321686 86.6033478 87.4152832 88.2448959 88.9087982 89.6542053 90.5438995 91.5822449 92.5019836 93.3631592 94.4989014 95.525238 96.4846649 97.4945831 98.4013367 99.3699493 100.433578 101.532265 102.405472 103.428665 104.459488 105.39653 106.346466 107.310226 108.318466 109.121544 110.130478 111.079437 112.131828 113.039658 113.965805 114.862579 115.743301 116.612595 117.483002 118.378326 119.299438 120.231712 121.095604 121.982132 122.900421 123.761497 124.678375 125.598679 126.542168 127.461548 128.322556 129.199219 130.095566 131.017822 132.025726 133.091675 134.068024 135.144608 136.399918 137.535248 138.808487 140.285416 141.93071 143.813324 146.214371 149.172699 153.264511 159.661133 170.057159 193.125549 452.995087 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.858090818 1.22238481 1.44606066 1.62354326 1.75136662 1.86397421 1.95087266 2.03246212 2.10284495 2.16565037 2.22165871 2.26960015 2.31364679 2.35706234 2.40011835 2.43862534 2.47133875 2.50282955 2.53000212 2.55976367 2.58766031 2.61201644 2.63522124 2.66010594 2.68249989 2.70290661 2.72273207 2.74256086 2.7607336 2.77648091 2.79279113 2.80703878 2.82027674 2.83225727 2.845438 2.85666037 2.86719322 2.87730479 2.88746977 2.8975687 2.9069674 2.91421127 2.92219591 2.92961407 2.93674707 2.94447517 2.95153904 2.95877457 2.96550179 2.97113323 2.97720003 2.98205709 2.98726034 2.99236202 2.99733305 3.00300455 3.00764179 3.01264429 3.01699233 3.02142954 3.02590466 3.03035212 3.03449345 3.03817987 3.04237747 3.0462811 3.05080128 3.05422974 3.05803227 3.06115079 3.0645256 3.06756973 3.07110739 3.07414961 3.07694721 3.08025074 3.08324051 3.08625817 3.08897209 3.09183693 3.09468889 3.09714222 3.09991145 3.10265422 3.10507107 3.10762167 3.1100378 3.11273289 3.11525893 3.11743021 3.1198945 3.12220955 3.12478256 3.1273675 3.12962389 3.1320014 3.13408709 3.13655472 3.13910532 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.07288361E-05 0.00667167734 0.0123049011 0.0194647312 0.0257952213 0.0334135294 0.0418217182 0.0495411754 0.0572229624 0.064515233 0.0727260113 0.0802878141 0.0883761644 0.0965511799 0.104919434 0.113095701 0.120257974 0.128311694 0.135322213 0.143327594 0.150606424 0.157981992 0.164217055 0.170347214 0.176330268 0.183133721 0.189604759 0.195326447 0.201784939 0.208070993 0.213459954 0.21992588 0.226166725 0.232190341 0.237426668 0.243781179 0.249421537 0.255449533 0.260844767 0.265895367 0.271490216 0.277391881 0.283333391 0.288968772 0.294566154 0.300413013 0.305999696 0.311927676 0.318226218 0.323428154 0.329432964 0.334182084 0.340115547 0.345768213 0.351166755 0.356606096 0.361819625 0.367450953 0.373399228 0.379483342 0.385334611 0.391162276 0.397127151 0.402098477 0.407784462 0.413139939 0.418651879 0.424417913 0.430869251 0.437010288 0.441861451 0.448763072 0.455205977 0.460709333 0.467154145 0.473564506 0.480058134 0.488486409 0.496613503 0.50401473 0.511305332 0.519081593 0.528232098 0.536580741 0.543991089 0.553381264 0.563163579 0.573306322 0.583921909 0.595798731 0.60852766 0.623797476 0.639634728 0.656232238 0.677191913 0.700435281 0.721385241 0.751470447 0.794885993 0.852379322 1.11007142 ------------------------------ Transdef: Tab for variable 12 0.200070545 0.2172167 0.232415393 0.244831458 0.25528276 0.265077651 0.274280339 0.283302188 0.291739881 0.299638808 0.306693465 0.314475149 0.32197091 0.328765035 0.335192204 0.342565328 0.349646032 0.356293708 0.36286974 0.369055271 0.375279099 0.381067276 0.387835741 0.393227667 0.398075283 0.402528882 0.407007754 0.41110301 0.414341718 0.418650299 0.422142744 0.425796151 0.42966482 0.433477521 0.437101901 0.440553427 0.444623709 0.448102236 0.451914251 0.45587182 0.459435999 0.462717414 0.466991425 0.470439643 0.473973125 0.47760272 0.481851339 0.485698104 0.489217281 0.493078887 0.497185677 0.501048684 0.505404711 0.509149969 0.513511419 0.517650783 0.521526814 0.525075912 0.530245066 0.534763813 0.539512455 0.543584764 0.547429681 0.552449167 0.556964338 0.561290622 0.56596303 0.570982277 0.576159 0.581476331 0.587055802 0.59222436 0.596430719 0.602415919 0.608927846 0.614947081 0.621094823 0.62760675 0.633443594 0.640084267 0.647200346 0.655633569 0.662264943 0.669348598 0.67736721 0.685767412 0.696229577 0.704346061 0.715470791 0.725804269 0.736315608 0.74753654 0.75859803 0.771010399 0.787503302 0.805656672 0.8253479 0.847167134 0.878308237 0.919374168 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.4652309 22.206974 22.6576347 23.2518253 23.7612 24.2744999 24.7376938 25.1722717 25.5787354 25.8821144 26.2876339 26.7206573 27.0971375 27.4406357 27.8303299 28.1803074 28.4747581 28.7810745 29.1354885 29.3954315 29.6790657 30.0150356 30.3107109 30.5960655 30.8868294 31.1288948 31.4413986 31.7742081 32.0753784 32.3698044 32.6227341 32.9391556 33.2513046 33.550415 33.8695602 34.2103653 34.4775085 34.751873 35.0347443 35.335907 35.6243706 35.9506493 36.2360458 36.592907 36.9487686 37.330925 37.676506 37.9948425 38.3815994 38.7085266 39.0811462 39.4700813 39.8123665 40.2031708 40.5796013 40.9765091 41.375351 41.8029327 42.2633247 42.7395592 43.173275 43.5567207 44.0518265 44.5031509 45.0257721 45.5473862 46.0760727 46.5359344 47.0645447 47.6526718 48.2227249 48.880394 49.4413834 50.2093735 50.8594818 51.5644836 52.2807388 53.0933151 53.9446297 54.8139801 55.6238098 56.5877838 57.6623268 58.6179276 59.7673645 60.9033356 62.2979546 63.6593094 65.1227188 66.8440094 68.1400757 70.0580597 72.57341 75.2173462 77.9338303 81.6237335 86.791626 93.2814331 102.203728 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.5566273 11.0623856 11.4027681 11.7919979 12.1488037 12.41819 12.668644 12.959753 13.2665672 13.5173969 13.7694082 14.0066385 14.2684994 14.5029984 14.7570648 15.0286922 15.2531433 15.5131607 15.7466669 15.9769897 16.2550354 16.4913425 16.758503 16.9811974 17.2358513 17.4979477 17.7303162 17.9678001 18.1903744 18.4475021 18.6649933 18.9317055 19.123909 19.3438702 19.6150551 19.8970222 20.16078 20.4061661 20.6600151 20.9128323 21.1593552 21.4049549 21.6673851 21.9206314 22.1644211 22.442997 22.7292271 22.9849815 23.2194958 23.4630508 23.7391472 23.9976044 24.2861061 24.5611115 24.8407631 25.0654945 25.3544559 25.5991859 25.8604145 26.1466904 26.4456139 26.7538528 27.0654869 27.3583164 27.6184578 27.882576 28.0815144 28.3927479 28.7082367 29.0459404 29.3475723 29.7170506 30.0667706 30.3974266 30.7744694 31.1844292 31.5382519 31.9042778 32.3900185 32.8390274 33.2972565 33.8134995 34.3403549 34.8473663 35.4256592 36.1703186 36.8682785 37.6133118 38.4068146 39.2726135 40.261692 41.3018341 42.6560593 44.3612289 46.2641716 48.3972855 51.5496407 55.9027328 62.106926 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 59.4 41.9 46.2 18.8 41.0 56.9 45.8 56.4 -27.0 -12.3 -31.0 5.3 14.8 2 59.4 100.0 63.9 55.2 26.7 63.6 94.2 69.4 90.6 -49.1 -20.4 -45.9 29.0 27.4 3 41.9 63.9 100.0 35.7 1.2 28.6 67.5 49.3 69.1 -18.6 -22.1 -50.5 61.9 15.2 4 46.2 55.2 35.7 100.0 8.0 30.8 56.2 45.2 60.8 -13.2 -25.9 -57.1 12.3 68.9 5 18.8 26.7 1.2 8.0 100.0 82.3 -1.3 51.7 51.8 25.1 -2.6 -2.6 -7.8 -0.6 6 41.0 63.6 28.6 30.8 82.3 100.0 41.4 75.5 77.7 -5.3 -10.9 -22.5 6.6 12.2 7 56.9 94.2 67.5 56.2 -1.3 41.4 100.0 61.2 78.2 -56.6 -19.6 -46.7 33.6 29.6 8 45.8 69.4 49.3 45.2 51.7 75.5 61.2 100.0 80.1 -11.4 -18.7 -37.6 22.0 23.3 9 56.4 90.6 69.1 60.8 51.8 77.7 78.2 80.1 100.0 -23.6 -22.9 -51.0 33.4 32.1 10 -27.0 -49.1 -18.6 -13.2 25.1 -5.3 -56.6 -11.4 -23.6 100.0 3.2 10.5 -6.2 -3.7 11 -12.3 -20.4 -22.1 -25.9 -2.6 -10.9 -19.6 -18.7 -22.9 3.2 100.0 52.4 -7.6 -15.0 12 -31.0 -45.9 -50.5 -57.1 -2.6 -22.5 -46.7 -37.6 -51.0 10.5 52.4 100.0 -23.0 -31.5 13 5.3 29.0 61.9 12.3 -7.8 6.6 33.6 22.0 33.4 -6.2 -7.6 -23.0 100.0 42.3 14 14.8 27.4 15.2 68.9 -0.6 12.2 29.6 23.3 32.1 -3.7 -15.0 -31.5 42.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 141.641146 TOTAL CORRELATION OF ALL VARIABLES 66.3637983 ROUND 1: MAX CORR ( 66.3406397) AFTER KILLING INPUT VARIABLE 11 CONTR 1.75307038 ROUND 2: MAX CORR ( 66.3130187) AFTER KILLING INPUT VARIABLE 7 CONTR 1.91416352 ROUND 3: MAX CORR ( 66.2612906) AFTER KILLING INPUT VARIABLE 6 CONTR 2.61874337 ROUND 4: MAX CORR ( 66.1271255) AFTER KILLING INPUT VARIABLE 10 CONTR 4.21448761 ROUND 5: MAX CORR ( 65.964013) AFTER KILLING INPUT VARIABLE 8 CONTR 4.6417359 ROUND 6: MAX CORR ( 65.7528561) AFTER KILLING INPUT VARIABLE 14 CONTR 5.27379656 ROUND 7: MAX CORR ( 65.5373622) AFTER KILLING INPUT VARIABLE 12 CONTR 5.31904546 ROUND 8: MAX CORR ( 64.5295551) AFTER KILLING INPUT VARIABLE 9 CONTR 11.4491207 ROUND 9: MAX CORR ( 64.3670556) AFTER KILLING INPUT VARIABLE 5 CONTR 4.57663908 ROUND 10: MAX CORR ( 62.6708808) AFTER KILLING INPUT VARIABLE 3 CONTR 14.6791876 ROUND 11: MAX CORR ( 61.5612314) AFTER KILLING INPUT VARIABLE 13 CONTR 11.7411283 ROUND 12: MAX CORR ( 59.4205842) AFTER KILLING INPUT VARIABLE 4 CONTR 16.0928365 LAST REMAINING VARIABLE: 2 total correlation to target: 66.3637983 % total significance: 129.440775 sigma correlations of single variables to target: variable 2: 59.4205842 % , in sigma: 115.898225 variable 3: 41.8531004 % , in sigma: 81.6333283 variable 4: 46.2397392 % , in sigma: 90.1893474 variable 5: 18.8431582 % , in sigma: 36.7530649 variable 6: 41.0187425 % , in sigma: 80.005936 variable 7: 56.8931694 % , in sigma: 110.968572 variable 8: 45.7903039 % , in sigma: 89.312736 variable 9: 56.4037235 % , in sigma: 110.013921 variable 10: -26.9992933 % , in sigma: 52.6613836 variable 11: -12.3161552 % , in sigma: 24.0223241 variable 12: -31.0143402 % , in sigma: 60.4926228 variable 13: 5.30955302 % , in sigma: 10.356138 variable 14: 14.7755269 % , in sigma: 28.8192612 variables sorted by significance: 1 most relevant variable 2 corr 59.4205856 , in sigma: 115.898228 2 most relevant variable 4 corr 16.0928364 , in sigma: 31.3886374 3 most relevant variable 13 corr 11.741128 , in sigma: 22.9007491 4 most relevant variable 3 corr 14.6791878 , in sigma: 28.6313545 5 most relevant variable 5 corr 4.57663918 , in sigma: 8.92660961 6 most relevant variable 9 corr 11.4491205 , in sigma: 22.3311966 7 most relevant variable 12 corr 5.31904554 , in sigma: 10.3746529 8 most relevant variable 14 corr 5.27379656 , in sigma: 10.286396 9 most relevant variable 8 corr 4.64173603 , in sigma: 9.05357924 10 most relevant variable 10 corr 4.21448755 , in sigma: 8.22024277 11 most relevant variable 6 corr 2.61874342 , in sigma: 5.10778745 12 most relevant variable 7 corr 1.91416347 , in sigma: 3.73352352 13 most relevant variable 11 corr 1.75307035 , in sigma: 3.4193158 global correlations between input variables: variable 2: 99.1569395 % variable 3: 92.8196188 % variable 4: 91.4257577 % variable 5: 95.010317 % variable 6: 94.1336594 % variable 7: 98.6728729 % variable 8: 87.7788873 % variable 9: 98.82624 % variable 10: 72.048911 % variable 11: 53.5834746 % variable 12: 74.7451413 % variable 13: 84.1835474 % variable 14: 86.6739279 % significance loss when removing single variables: variable 2: corr = 6.94680258 % , sigma = 13.5495485 variable 3: corr = 15.4332893 % , sigma = 30.1022088 variable 4: corr = 17.6403023 % , sigma = 34.4069274 variable 5: corr = 8.70774825 % , sigma = 16.9842249 variable 6: corr = 2.86529339 % , sigma = 5.58867642 variable 7: corr = 1.7953357 % , sigma = 3.50175321 variable 8: corr = 2.36240167 % , sigma = 4.60779988 variable 9: corr = 10.7366756 % , sigma = 20.9415923 variable 10: corr = 3.83746991 % , sigma = 7.48488016 variable 11: corr = 1.75307038 % , sigma = 3.41931586 variable 12: corr = 3.93182083 % , sigma = 7.66890905 variable 13: corr = 8.33685056 % , sigma = 16.2607991 variable 14: corr = 5.19936806 % , sigma = 10.1412253 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 21.4988384 sigma out 15 active outputs RANK 2 NODE 8 --> 20.2508602 sigma out 15 active outputs RANK 3 NODE 2 --> 18.2700577 sigma out 15 active outputs RANK 4 NODE 11 --> 15.505393 sigma out 15 active outputs RANK 5 NODE 4 --> 14.9187155 sigma out 15 active outputs RANK 6 NODE 9 --> 13.391531 sigma out 15 active outputs RANK 7 NODE 10 --> 12.7242355 sigma out 15 active outputs RANK 8 NODE 6 --> 12.1073666 sigma out 15 active outputs RANK 9 NODE 1 --> 11.3035469 sigma out 15 active outputs RANK 10 NODE 7 --> 9.27222633 sigma out 15 active outputs RANK 11 NODE 5 --> 8.57130814 sigma out 15 active outputs RANK 12 NODE 12 --> 6.71978092 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 27.6887932 sigma in 12act. ( 31.6590881 sig out 1act.) RANK 2 NODE 13 --> 23.233305 sigma in 12act. ( 25.0530529 sig out 1act.) RANK 3 NODE 11 --> 17.5608177 sigma in 12act. ( 21.7225609 sig out 1act.) RANK 4 NODE 7 --> 16.4670277 sigma in 12act. ( 17.8834553 sig out 1act.) RANK 5 NODE 2 --> 12.4108868 sigma in 12act. ( 12.9078655 sig out 1act.) RANK 6 NODE 6 --> 11.9518604 sigma in 12act. ( 13.6630039 sig out 1act.) RANK 7 NODE 3 --> 8.36261082 sigma in 12act. ( 7.67186403 sig out 1act.) RANK 8 NODE 12 --> 7.18301678 sigma in 12act. ( 8.79309082 sig out 1act.) RANK 9 NODE 1 --> 7.02937412 sigma in 12act. ( 7.24372578 sig out 1act.) RANK 10 NODE 14 --> 7.00351 sigma in 12act. ( 3.98704791 sig out 1act.) RANK 11 NODE 15 --> 6.34451437 sigma in 12act. ( 6.13577747 sig out 1act.) RANK 12 NODE 4 --> 5.22978354 sigma in 12act. ( 8.32390881 sig out 1act.) RANK 13 NODE 8 --> 3.15534496 sigma in 12act. ( 3.36458492 sig out 1act.) RANK 14 NODE 5 --> 2.83285117 sigma in 12act. ( 3.67278194 sig out 1act.) RANK 15 NODE 9 --> 0.905116975 sigma in 12act. ( 0.0925406069 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 31.6590881 sigma out 1act.( 27.6887932 sig in 12act.) RANK 2 NODE 13 --> 25.0530529 sigma out 1act.( 23.233305 sig in 12act.) RANK 3 NODE 11 --> 21.7225609 sigma out 1act.( 17.5608177 sig in 12act.) RANK 4 NODE 7 --> 17.8834553 sigma out 1act.( 16.4670277 sig in 12act.) RANK 5 NODE 6 --> 13.6630039 sigma out 1act.( 11.9518604 sig in 12act.) RANK 6 NODE 2 --> 12.9078655 sigma out 1act.( 12.4108868 sig in 12act.) RANK 7 NODE 12 --> 8.79309082 sigma out 1act.( 7.18301678 sig in 12act.) RANK 8 NODE 4 --> 8.32390881 sigma out 1act.( 5.22978354 sig in 12act.) RANK 9 NODE 3 --> 7.67186403 sigma out 1act.( 8.36261082 sig in 12act.) RANK 10 NODE 1 --> 7.24372578 sigma out 1act.( 7.02937412 sig in 12act.) RANK 11 NODE 15 --> 6.13577747 sigma out 1act.( 6.34451437 sig in 12act.) RANK 12 NODE 14 --> 3.98704791 sigma out 1act.( 7.00351 sig in 12act.) RANK 13 NODE 5 --> 3.67278194 sigma out 1act.( 2.83285117 sig in 12act.) RANK 14 NODE 8 --> 3.36458492 sigma out 1act.( 3.15534496 sig in 12act.) RANK 15 NODE 9 --> 0.0925406069 sigma out 1act.( 0.905116975 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.7783928 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 25.3115482 sigma out 15 active outputs RANK 2 NODE 8 --> 23.5496979 sigma out 15 active outputs RANK 3 NODE 3 --> 21.8190746 sigma out 15 active outputs RANK 4 NODE 4 --> 17.6817169 sigma out 15 active outputs RANK 5 NODE 9 --> 16.2031879 sigma out 15 active outputs RANK 6 NODE 11 --> 16.0887566 sigma out 15 active outputs RANK 7 NODE 1 --> 14.3972034 sigma out 15 active outputs RANK 8 NODE 6 --> 14.1292591 sigma out 15 active outputs RANK 9 NODE 10 --> 13.6336231 sigma out 15 active outputs RANK 10 NODE 7 --> 11.993041 sigma out 15 active outputs RANK 11 NODE 12 --> 9.72615147 sigma out 15 active outputs RANK 12 NODE 5 --> 9.58010292 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 32.7110977 sigma in 12act. ( 30.6401653 sig out 1act.) RANK 2 NODE 11 --> 23.767767 sigma in 12act. ( 21.9341621 sig out 1act.) RANK 3 NODE 13 --> 20.4610462 sigma in 12act. ( 22.2442341 sig out 1act.) RANK 4 NODE 7 --> 18.1839409 sigma in 12act. ( 17.6321507 sig out 1act.) RANK 5 NODE 6 --> 13.2925692 sigma in 12act. ( 12.9892006 sig out 1act.) RANK 6 NODE 4 --> 12.246666 sigma in 12act. ( 8.97055531 sig out 1act.) RANK 7 NODE 2 --> 11.9851942 sigma in 12act. ( 12.1567068 sig out 1act.) RANK 8 NODE 12 --> 11.2213869 sigma in 12act. ( 9.27680111 sig out 1act.) RANK 9 NODE 15 --> 10.2750854 sigma in 12act. ( 6.08149195 sig out 1act.) RANK 10 NODE 3 --> 9.90291786 sigma in 12act. ( 7.60198975 sig out 1act.) RANK 11 NODE 1 --> 8.50592613 sigma in 12act. ( 7.11293221 sig out 1act.) RANK 12 NODE 5 --> 8.4209795 sigma in 12act. ( 5.05243874 sig out 1act.) RANK 13 NODE 8 --> 7.1154623 sigma in 12act. ( 3.79948664 sig out 1act.) RANK 14 NODE 14 --> 6.01831532 sigma in 12act. ( 2.83444929 sig out 1act.) RANK 15 NODE 9 --> 3.76041007 sigma in 12act. ( 0.0645082369 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 30.6401653 sigma out 1act.( 32.7110977 sig in 12act.) RANK 2 NODE 13 --> 22.2442341 sigma out 1act.( 20.4610462 sig in 12act.) RANK 3 NODE 11 --> 21.9341621 sigma out 1act.( 23.767767 sig in 12act.) RANK 4 NODE 7 --> 17.6321507 sigma out 1act.( 18.1839409 sig in 12act.) RANK 5 NODE 6 --> 12.9892006 sigma out 1act.( 13.2925692 sig in 12act.) RANK 6 NODE 2 --> 12.1567068 sigma out 1act.( 11.9851942 sig in 12act.) RANK 7 NODE 12 --> 9.27680111 sigma out 1act.( 11.2213869 sig in 12act.) RANK 8 NODE 4 --> 8.97055531 sigma out 1act.( 12.246666 sig in 12act.) RANK 9 NODE 3 --> 7.60198975 sigma out 1act.( 9.90291786 sig in 12act.) RANK 10 NODE 1 --> 7.11293221 sigma out 1act.( 8.50592613 sig in 12act.) RANK 11 NODE 15 --> 6.08149195 sigma out 1act.( 10.2750854 sig in 12act.) RANK 12 NODE 5 --> 5.05243874 sigma out 1act.( 8.4209795 sig in 12act.) RANK 13 NODE 8 --> 3.79948664 sigma out 1act.( 7.1154623 sig in 12act.) RANK 14 NODE 14 --> 2.83444929 sigma out 1act.( 6.01831532 sig in 12act.) RANK 15 NODE 9 --> 0.0645082369 sigma out 1act.( 3.76041007 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.8704987 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.441328049 *** contribution from regularisation: 0.00409416808 *** contribution from error: -0.445422202 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.47821033 *** contribution from regularisation: 0.0025447642 *** contribution from error: -0.480755091 *********************************************** -----------------> Test sample ENTER BFGS code START -45309.8598 -0.413127601 -0.509306729 EXIT FROM BFGS code FG_START 0. -0.413127601 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.497800499 *** contribution from regularisation: 0.00230818568 *** contribution from error: -0.500108659 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47156.1425 -0.413127601 -158.276276 EXIT FROM BFGS code FG_LNSRCH 0. -0.445443958 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Pa.8924 -0.445443958 -102.561905 EXIT FROM BFGS code NEW_X -50168.8924 -0.445443958 -102.561905 ENTER BFGS code NEW_X -50168.8924 -0.445443958 -102.561905 EXIT FROM BFGS code FG_LNSRCH 0. -0.469225883 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.533671021 *** contribution from regularisation: 0.003278194 *** contribution from error: -0.536949217 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50554.1224 -0.469225883 -52.2106705 EXIT FROM BFGS code NEW_X -50554.1224 -0.469225883 -52.2106705 ENTER BFGS code NEW_X -50554.1224 -0.469225883 -52.2106705 EXIT FROM BFGS code FG_LNSRCH 0. -0.499781579 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.536668777 *** contribution from regularisation: 0.00322295004 *** contribution from error: -0.53989172 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50838.097 -0.499781579 18.9139423 EXIT FROM BFGS code NEW_X -50838.097 -0.499781579 18.9139423 ENTER BFGS code NEW_X -50838.097 -0.499781579 18.9139423 EXIT FROM BFGS code FG_LNSRCH 0. -0.496355861 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.537715316 *** contribution from regularisation: 0.00303266966 *** contribution from error: -0.540748 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50937.2314 -0.496355861 40.2740822 EXIT FROM BFGS code NEW_X -50937.2314 -0.496355861 40.2740822 ENTER BFGS code NEW_X -50937.2314 -0.496355861 40.2740822 EXIT FROM BFGS code FG_LNSRCH 0. -0.476682991 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.538755476 *** contribution from regularisation: 0.00305743935 *** contribution from error: -0.541812897 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51035.7682 -0.476682991 42.6341743 EXIT FROM BFGS code NEW_X -51035.7682 -0.476682991 42.6341743 ENTER BFGS code NEW_X -51035.7682 -0.476682991 42.6341743 EXIT FROM BFGS code FG_LNSRCH 0. -0.38237673 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.540024519 *** contribution from regularisation: 0.00334319496 *** contribution from error: -0.543367743 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51155.9818 -0.38237673 10.3580503 EXIT FROM BFGS code NEW_X -51155.9818 -0.38237673 10.3580503 ENTER BFGS code NEW_X -51155.9818 -0.38237673 10.3580503 EXIT FROM BFGS code FG_LNSRCH 0. -0.371814251 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 46.6085472 sigma out 15 active outputs RANK 2 NODE 1 --> 28.4965611 sigma out 15 active outputs RANK 3 NODE 12 --> 20.9590473 sigma out 15 active outputs RANK 4 NODE 9 --> 18.3127251 sigma out 15 active outputs RANK 5 NODE 4 --> 17.7751522 sigma out 15 active outputs RANK 6 NODE 8 --> 16.9095478 sigma out 15 active outputs RANK 7 NODE 11 --> 16.635294 sigma out 15 active outputs RANK 8 NODE 3 --> 15.2124434 sigma out 15 active outputs RANK 9 NODE 7 --> 14.4224968 sigma out 15 active outputs RANK 10 NODE 6 --> 13.2686052 sigma out 15 active outputs RANK 11 NODE 5 --> 12.8226271 sigma out 15 active outputs RANK 12 NODE 10 --> 9.29889679 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 43.5975914 sigma in 12act. ( 39.0903511 sig out 1act.) RANK 2 NODE 10 --> 34.8287697 sigma in 12act. ( 28.7805843 sig out 1act.) RANK 3 NODE 8 --> 22.3170414 sigma in 12act. ( 21.4373093 sig out 1act.) RANK 4 NODE 4 --> 20.9556446 sigma in 12act. ( 19.4255199 sig out 1act.) RANK 5 NODE 5 --> 20.4329395 sigma in 12act. ( 17.2308502 sig out 1act.) RANK 6 NODE 12 --> 17.9773102 sigma in 12act. ( 14.7218323 sig out 1act.) RANK 7 NODE 7 --> 14.5869455 sigma in 12act. ( 13.3904676 sig out 1act.) RANK 8 NODE 13 --> 10.115447 sigma in 12act. ( 9.56828785 sig out 1act.) RANK 9 NODE 3 --> 9.42277336 sigma in 12act. ( 7.5730505 sig out 1act.) RANK 10 NODE 1 --> 9.2976656 sigma in 12act. ( 8.37884426 sig out 1act.) RANK 11 NODE 2 --> 8.68940449 sigma in 12act. ( 8.33394814 sig out 1act.) RANK 12 NODE 15 --> 7.29325008 sigma in 12act. ( 5.27630711 sig out 1act.) RANK 13 NODE 9 --> 6.5675621 sigma in 12act. ( 6.45478106 sig out 1act.) RANK 14 NODE 6 --> 6.28824139 sigma in 12act. ( 3.41615987 sig out 1act.) RANK 15 NODE 14 --> 3.26532984 sigma in 12act. ( 1.3987298 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 39.0903511 sigma out 1act.( 43.5975914 sig in 12act.) RANK 2 NODE 10 --> 28.7805843 sigma out 1act.( 34.8287697 sig in 12act.) RANK 3 NODE 8 --> 21.4373093 sigma out 1act.( 22.3170414 sig in 12act.) RANK 4 NODE 4 --> 19.4255199 sigma out 1act.( 20.9556446 sig in 12act.) RANK 5 NODE 5 --> 17.2308502 sigma out 1act.( 20.4329395 sig in 12act.) RANK 6 NODE 12 --> 14.7218323 sigma out 1act.( 17.9773102 sig in 12act.) RANK 7 NODE 7 --> 13.3904676 sigma out 1act.( 14.5869455 sig in 12act.) RANK 8 NODE 13 --> 9.56828785 sigma out 1act.( 10.115447 sig in 12act.) RANK 9 NODE 1 --> 8.37884426 sigma out 1act.( 9.2976656 sig in 12act.) RANK 10 NODE 2 --> 8.33394814 sigma out 1act.( 8.68940449 sig in 12act.) RANK 11 NODE 3 --> 7.5730505 sigma out 1act.( 9.42277336 sig in 12act.) RANK 12 NODE 9 --> 6.45478106 sigma out 1act.( 6.5675621 sig in 12act.) RANK 13 NODE 15 --> 5.27630711 sigma out 1act.( 7.29325008 sig in 12act.) RANK 14 NODE 6 --> 3.41615987 sigma out 1act.( 6.28824139 sig in 12act.) RANK 15 NODE 14 --> 1.3987298 sigma out 1act.( 3.26532984 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 65.2527313 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.540952027 *** contribution from regularisation: 0.00313480035 *** contribution from error: -0.544086814 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51243.8457 -0.371814251 2.28806806 EXIT FROM BFGS code NEW_X -51243.8457 -0.371814251 2.28806806 ENTER BFGS code NEW_X -51243.8457 -0.371814251 2.28806806 EXIT FROM BFGS code FG_LNSRCH 0. -0.382891595 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.541305661 *** contribution from regularisation: 0.00310737011 *** contribution from error: -0.54441303 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51277.3433 -0.382891595 -0.346724361 EXIT FROM BFGS code NEW_X -51277.3433 -0.382891595 -0.346724361 ENTER BFGS code NEW_X -51277.3433 -0.382891595 -0.346724361 EXIT FROM BFGS code FG_LNSRCH 0. -0.383897841 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.541390657 *** contribution from regularisation: 0.00316145411 *** contribution from error: -0.544552088 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51285.3972 -0.383897841 2.37546563 EXIT FROM BFGS code NEW_X -51285.3972 -0.383897841 2.37546563 ENTER BFGS code NEW_X -51285.3972 -0.383897841 2.37546563 EXIT FROM BFGS code FG_LNSRCH 0. -0.375845224 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.542295933 *** contribution from regularisation: 0.00306724524 *** contribution from error: -0.545363188 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51371.1532 -0.375845224 8.73179054 EXIT FROM BFGS code NEW_X -51371.1532 -0.375845224 8.73179054 ENTER BFGS code NEW_X -51371.1532 -0.375845224 8.73179054 EXIT FROM BFGS code FG_LNSRCH 0. -0.35079357 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.542847395 *** contribution from regularisation: 0.00333645823 *** contribution from error: -0.546183825 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51423.3926 -0.35079357 39.1943779 EXIT FROM BFGS code NEW_X -51423.3926 -0.35079357 39.1943779 ENTER BFGS code NEW_X -51423.3926 -0.35079357 39.1943779 EXIT FROM BFGS code FG_LNSRCH 0. -0.290709585 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.543147326 *** contribution from regularisation: 0.00363103114 *** contribution from error: -0.546778381 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51451.8048 -0.290709585 -56.5142593 EXIT FROM BFGS code NEW_X -51451.8048 -0.290709585 -56.5142593 ENTER BFGS code NEW_X -51451.8048 -0.290709585 -56.5142593 EXIT FROM BFGS code FG_LNSRCH 0. -0.303249836 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.543951213 *** contribution from regularisation: 0.00337353372 *** contribution from error: -0.547324777 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51527.9542 -0.303249836 10.5545359 EXIT FROM BFGS code NEW_X -51527.9542 -0.303249836 10.5545359 ENTER BFGS code NEW_X -51527.9542 -0.303249836 10.5545359 EXIT FROM BFGS code FG_LNSRCH 0. -0.299080223 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.544102728 *** contribution from regularisation: 0.00342178368 *** contribution from error: -0.547524512 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51542.3064 -0.299080223 13.967515 EXIT FROM BFGS code NEW_X -51542.3064 -0.299080223 13.967515 ENTER BFGS code NEW_X -51542.3064 -0.299080223 13.967515 EXIT FROM BFGS code FG_LNSRCH 0. -0.271057844 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.54449904 *** contribution from regularisation: 0.00352536701 *** contribution from error: -0.548024416 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51579.8515 -0.271057844 17.8974915 EXIT FROM BFGS code NEW_X -51579.8515 -0.271057844 17.8974915 ENTER BFGS code NEW_X -51579.8515 -0.271057844 17.8974915 EXIT FROM BFGS code FG_LNSRCH 0. -0.236616284 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.544770718 *** contribution from regularisation: 0.00353496359 *** contribution from error: -0.54830569 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51605.5874 -0.236616284 -21.4597473 EXIT FROM BFGS code NEW_X -51605.5874 -0.236616284 -21.4597473 ENTER BFGS code NEW_X -51605.5874 -0.236616284 -21.4597473 EXIT FROM BFGS code FG_LNSRCH 0. -0.226088464 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 59.4696426 sigma out 15 active outputs RANK 2 NODE 1 --> 35.2846451 sigma out 15 active outputs RANK 3 NODE 4 --> 23.3944283 sigma out 15 active outputs RANK 4 NODE 9 --> 22.4336052 sigma out 15 active outputs RANK 5 NODE 12 --> 21.6106682 sigma out 15 active outputs RANK 6 NODE 8 --> 19.3020611 sigma out 15 active outputs RANK 7 NODE 7 --> 19.2474194 sigma out 15 active outputs RANK 8 NODE 5 --> 18.6564693 sigma out 15 active outputs RANK 9 NODE 6 --> 17.6822815 sigma out 15 active outputs RANK 10 NODE 11 --> 16.1220627 sigma out 15 active outputs RANK 11 NODE 3 --> 14.9125195 sigma out 15 active outputs RANK 12 NODE 10 --> 13.1652536 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 48.8592186 sigma in 12act. ( 67.3518753 sig out 1act.) RANK 2 NODE 10 --> 48.0673561 sigma in 12act. ( 42.1128769 sig out 1act.) RANK 3 NODE 8 --> 30.6255455 sigma in 12act. ( 37.2107811 sig out 1act.) RANK 4 NODE 4 --> 25.1109867 sigma in 12act. ( 24.4468632 sig out 1act.) RANK 5 NODE 5 --> 23.0294342 sigma in 12act. ( 21.1695576 sig out 1act.) RANK 6 NODE 7 --> 17.5813198 sigma in 12act. ( 17.4729652 sig out 1act.) RANK 7 NODE 12 --> 16.7514668 sigma in 12act. ( 15.1041527 sig out 1act.) RANK 8 NODE 13 --> 15.6079817 sigma in 12act. ( 15.5812845 sig out 1act.) RANK 9 NODE 9 --> 14.5018206 sigma in 12act. ( 16.1044331 sig out 1act.) RANK 10 NODE 1 --> 14.1854906 sigma in 12act. ( 14.1677504 sig out 1act.) RANK 11 NODE 3 --> 10.924839 sigma in 12act. ( 9.68957806 sig out 1act.) RANK 12 NODE 2 --> 9.40136719 sigma in 12act. ( 10.7220221 sig out 1act.) RANK 13 NODE 15 --> 8.46995735 sigma in 12act. ( 8.51744556 sig out 1act.) RANK 14 NODE 6 --> 5.91947222 sigma in 12act. ( 3.75305319 sig out 1act.) RANK 15 NODE 14 --> 1.64672399 sigma in 12act. ( 0.595149338 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 67.3518753 sigma out 1act.( 48.8592186 sig in 12act.) RANK 2 NODE 10 --> 42.1128769 sigma out 1act.( 48.0673561 sig in 12act.) RANK 3 NODE 8 --> 37.2107811 sigma out 1act.( 30.6255455 sig in 12act.) RANK 4 NODE 4 --> 24.4468632 sigma out 1act.( 25.1109867 sig in 12act.) RANK 5 NODE 5 --> 21.1695576 sigma out 1act.( 23.0294342 sig in 12act.) RANK 6 NODE 7 --> 17.4729652 sigma out 1act.( 17.5813198 sig in 12act.) RANK 7 NODE 9 --> 16.1044331 sigma out 1act.( 14.5018206 sig in 12act.) RANK 8 NODE 13 --> 15.5812845 sigma out 1act.( 15.6079817 sig in 12act.) RANK 9 NODE 12 --> 15.1041527 sigma out 1act.( 16.7514668 sig in 12act.) RANK 10 NODE 1 --> 14.1677504 sigma out 1act.( 14.1854906 sig in 12act.) RANK 11 NODE 2 --> 10.7220221 sigma out 1act.( 9.40136719 sig in 12act.) RANK 12 NODE 3 --> 9.68957806 sigma out 1act.( 10.924839 sig in 12act.) RANK 13 NODE 15 --> 8.51744556 sigma out 1act.( 8.46995735 sig in 12act.) RANK 14 NODE 6 --> 3.75305319 sigma out 1act.( 5.91947222 sig in 12act.) RANK 15 NODE 14 --> 0.595149338 sigma out 1act.( 1.64672399 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 101.352562 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.545049071 *** contribution from regularisation: 0.00350433518 *** contribution from error: -0.548553407 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51631.9555 -0.226088464 -11.0096674 EXIT FROM BFGS code NEW_X -51631.9555 -0.226088464 -11.0096674 ENTER BFGS code NEW_X -51631.9555 -0.226088464 -11.0096674 EXIT FROM BFGS code FG_LNSRCH 0. -0.218921587 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.545225561 *** contribution from regularisation: 0.00347581622 *** contribution from error: -0.548701406 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51648.6694 -0.218921587 5.81994915 EXIT FROM BFGS code NEW_X -51648.6694 -0.218921587 5.81994915 ENTER BFGS code NEW_X -51648.6694 -0.218921587 5.81994915 EXIT FROM BFGS code FG_LNSRCH 0. -0.19592911 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.545547664 *** contribution from regularisation: 0.00347843464 *** contribution from error: -0.549026072 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51679.1852 -0.19592911 24.3832111 EXIT FROM BFGS code NEW_X -51679.1852 -0.19592911 24.3832111 ENTER BFGS code NEW_X -51679.1852 -0.19592911 24.3832111 EXIT FROM BFGS code FG_LNSRCH 0. -0.170785621 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.545865297 *** contribution from regularisation: 0.00348909642 *** contribution from error: -0.549354374 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51709.2758 -0.170785621 38.7637215 EXIT FROM BFGS code NEW_X -51709.2758 -0.170785621 38.7637215 ENTER BFGS code NEW_X -51709.2758 -0.170785621 38.7637215 EXIT FROM BFGS code FG_LNSRCH 0. -0.130916089 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.54573822 *** contribution from regularisation: 0.00353479735 *** contribution from error: -0.549273014 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51697.2361 -0.130916089 -90.2648239 EXIT FROM BFGS code FG_LNSRCH 0. -0.154796958 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.54599601 *** contribution from regularisation: 0.00353415171 *** contribution from error: -0.549530149 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51721.6533 -0.154796958 -7.90923834 EXIT FROM BFGS code NEW_X -51721.6533 -0.154796958 -7.90923834 ENTER BFGS code NEW_X -51721.6533 -0.154796958 -7.90923834 EXIT FROM BFGS code FG_LNSRCH 0. -0.149300382 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.546166301 *** contribution from regularisation: 0.00350306393 *** contribution from error: -0.549669385 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51737.785 -0.149300382 5.25694704 EXIT FROM BFGS code NEW_X -51737.785 -0.149300382 5.25694704 ENTER BFGS code NEW_X -51737.785 -0.149300382 5.25694704 EXIT FROM BFGS code FG_LNSRCH 0. -0.14806135 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.546227992 *** contribution from regularisation: 0.00350410561 *** contribution from error: -0.549732089 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51743.6309 -0.14806135 0.564529836 EXIT FROM BFGS code NEW_X -51743.6309 -0.14806135 0.564529836 ENTER BFGS code NEW_X -51743.6309 -0.14806135 0.564529836 EXIT FROM BFGS code FG_LNSRCH 0. -0.13749738 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.546565592 *** contribution from regularisation: 0.00339316297 *** contribution from error: -0.549958766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51775.6123 -0.13749738 -5.07140064 EXIT FROM BFGS code NEW_X -51775.6123 -0.13749738 -5.07140064 ENTER BFGS code NEW_X -51775.6123 -0.13749738 -5.07140064 EXIT FROM BFGS code FG_LNSRCH 0. -0.128595904 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.546464562 *** contribution from regularisation: 0.00341650099 *** contribution from error: -0.549881041 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51766.0417 -0.128595904 8.37085819 EXIT FROM BFGS code FG_LNSRCH 0. -0.134754226 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 75.8252258 sigma out 15 active outputs RANK 2 NODE 1 --> 43.2196541 sigma out 15 active outputs RANK 3 NODE 4 --> 28.2091084 sigma out 15 active outputs RANK 4 NODE 8 --> 24.2881794 sigma out 15 active outputs RANK 5 NODE 7 --> 23.3147888 sigma out 15 active outputs RANK 6 NODE 11 --> 22.1200943 sigma out 15 active outputs RANK 7 NODE 6 --> 21.0507736 sigma out 15 active outputs RANK 8 NODE 12 --> 20.9067345 sigma out 15 active outputs RANK 9 NODE 5 --> 20.9011192 sigma out 15 active outputs RANK 10 NODE 9 --> 19.7082214 sigma out 15 active outputs RANK 11 NODE 10 --> 16.2933025 sigma out 15 active outputs RANK 12 NODE 3 --> 15.6207981 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 59.3811035 sigma in 12act. ( 86.6585541 sig out 1act.) RANK 2 NODE 10 --> 57.716095 sigma in 12act. ( 49.7312202 sig out 1act.) RANK 3 NODE 8 --> 40.6290665 sigma in 12act. ( 44.7592964 sig out 1act.) RANK 4 NODE 5 --> 30.0019436 sigma in 12act. ( 29.103651 sig out 1act.) RANK 5 NODE 4 --> 25.1531658 sigma in 12act. ( 26.1076565 sig out 1act.) RANK 6 NODE 7 --> 24.6708279 sigma in 12act. ( 24.8303146 sig out 1act.) RANK 7 NODE 9 --> 20.0122375 sigma in 12act. ( 23.3511047 sig out 1act.) RANK 8 NODE 13 --> 17.373991 sigma in 12act. ( 18.9316502 sig out 1act.) RANK 9 NODE 12 --> 16.770216 sigma in 12act. ( 15.347353 sig out 1act.) RANK 10 NODE 1 --> 14.1783638 sigma in 12act. ( 15.2480049 sig out 1act.) RANK 11 NODE 3 --> 12.1146421 sigma in 12act. ( 11.7930832 sig out 1act.) RANK 12 NODE 15 --> 11.8404446 sigma in 12act. ( 13.4621429 sig out 1act.) RANK 13 NODE 2 --> 10.6695576 sigma in 12act. ( 13.2075939 sig out 1act.) RANK 14 NODE 6 --> 3.87943959 sigma in 12act. ( 1.16663837 sig out 1act.) RANK 15 NODE 14 --> 1.01718926 sigma in 12act. ( 0.549475133 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 86.6585541 sigma out 1act.( 59.3811035 sig in 12act.) RANK 2 NODE 10 --> 49.7312202 sigma out 1act.( 57.716095 sig in 12act.) RANK 3 NODE 8 --> 44.7592964 sigma out 1act.( 40.6290665 sig in 12act.) RANK 4 NODE 5 --> 29.103651 sigma out 1act.( 30.0019436 sig in 12act.) RANK 5 NODE 4 --> 26.1076565 sigma out 1act.( 25.1531658 sig in 12act.) RANK 6 NODE 7 --> 24.8303146 sigma out 1act.( 24.6708279 sig in 12act.) RANK 7 NODE 9 --> 23.3511047 sigma out 1act.( 20.0122375 sig in 12act.) RANK 8 NODE 13 --> 18.9316502 sigma out 1act.( 17.373991 sig in 12act.) RANK 9 NODE 12 --> 15.347353 sigma out 1act.( 16.770216 sig in 12act.) RANK 10 NODE 1 --> 15.2480049 sigma out 1act.( 14.1783638 sig in 12act.) RANK 11 NODE 15 --> 13.4621429 sigma out 1act.( 11.8404446 sig in 12act.) RANK 12 NODE 2 --> 13.2075939 sigma out 1act.( 10.6695576 sig in 12act.) RANK 13 NODE 3 --> 11.7930832 sigma out 1act.( 12.1146421 sig in 12act.) RANK 14 NODE 6 --> 1.16663837 sigma out 1act.( 3.87943959 sig in 12act.) RANK 15 NODE 14 --> 0.549475133 sigma out 1act.( 1.01718926 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 126.489532 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.546394289 *** contribution from regularisation: 0.00364028104 *** contribution from error: -0.550034583 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51759.3839 -0.134754226 -0.304613829 EXIT FROM BFGS code FG_LNSRCH 0. -0.13725169 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.546395183 *** contribution from regularisation: 0.00357326725 *** contribution from error: -0.549968421 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51759.4693 -0.13725169 -4.71032047 EXIT FROM BFGS code FG_LNSRCH 0. -0.13749449 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.546428084 *** contribution from regularisation: 0.00353073026 *** contribution from error: -0.549958825 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51762.5882 -0.13749449 -5.19983578 EXIT FROM BFGS code FG_LNSRCH 0. -0.13749738 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.546436548 *** contribution from regularisation: 0.00352219609 *** contribution from error: -0.549958766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51763.3891 -0.13749738 -5.21431065 EXIT FROM BFGS code FG_LNSRCH 0. -0.13749738 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.546424687 *** contribution from regularisation: 0.00353406463 *** contribution from error: -0.549958766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51762.2648 -0.13749738 -5.23178482 EXIT FROM BFGS code FG_LNSRCH 0. -0.13749738 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.546421468 *** contribution from regularisation: 0.0035373047 *** contribution from error: -0.549958766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51761.9579 -0.13749738 -5.25378513 EXIT FROM BFGS code FG_LNSRCH 0. -0.13749738 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.54642868 *** contribution from regularisation: 0.00353006017 *** contribution from error: -0.549958766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51762.6441 -0.13749738 -5.27549791 EXIT FROM BFGS code NEW_X -51762.6441 -0.13749738 -5.27549791 ENTER BFGS code NEW_X -51762.6441 -0.13749738 -5.27549791 EXIT FROM BFGS code CONVERGENC -51762.6441 -0.13749738 -5.27549791 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 114.39093 sigma out 15 active outputs RANK 2 NODE 1 --> 65.9331436 sigma out 15 active outputs RANK 3 NODE 4 --> 42.7952919 sigma out 15 active outputs RANK 4 NODE 8 --> 37.0143661 sigma out 15 active outputs RANK 5 NODE 7 --> 35.6983109 sigma out 15 active outputs RANK 6 NODE 6 --> 33.6523666 sigma out 15 active outputs RANK 7 NODE 11 --> 33.5208969 sigma out 15 active outputs RANK 8 NODE 5 --> 31.6793156 sigma out 15 active outputs RANK 9 NODE 12 --> 30.9309196 sigma out 15 active outputs RANK 10 NODE 9 --> 29.471077 sigma out 15 active outputs RANK 11 NODE 10 --> 24.6348705 sigma out 15 active outputs RANK 12 NODE 3 --> 24.3565941 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 88.8393173 sigma in 12act. ( 135.091202 sig out 1act.) RANK 2 NODE 10 --> 88.5319061 sigma in 12act. ( 75.5528641 sig out 1act.) RANK 3 NODE 8 --> 61.8277512 sigma in 12act. ( 68.7801743 sig out 1act.) RANK 4 NODE 5 --> 45.4632416 sigma in 12act. ( 43.5227203 sig out 1act.) RANK 5 NODE 4 --> 38.8354759 sigma in 12act. ( 40.0119705 sig out 1act.) RANK 6 NODE 7 --> 37.2093735 sigma in 12act. ( 37.6449738 sig out 1act.) RANK 7 NODE 9 --> 30.7265263 sigma in 12act. ( 35.3851929 sig out 1act.) RANK 8 NODE 13 --> 26.4534073 sigma in 12act. ( 28.7766132 sig out 1act.) RANK 9 NODE 12 --> 25.5860977 sigma in 12act. ( 23.5484428 sig out 1act.) RANK 10 NODE 1 --> 21.5324726 sigma in 12act. ( 23.5233307 sig out 1act.) RANK 11 NODE 3 --> 17.9611244 sigma in 12act. ( 17.8545094 sig out 1act.) RANK 12 NODE 15 --> 17.7151031 sigma in 12act. ( 20.1943169 sig out 1act.) RANK 13 NODE 2 --> 16.2363644 sigma in 12act. ( 19.6774387 sig out 1act.) RANK 14 NODE 6 --> 4.14944458 sigma in 12act. ( 1.81323564 sig out 1act.) RANK 15 NODE 14 --> 1.15588701 sigma in 12act. ( 0.732519865 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 135.091202 sigma out 1act.( 88.8393173 sig in 12act.) RANK 2 NODE 10 --> 75.5528641 sigma out 1act.( 88.5319061 sig in 12act.) RANK 3 NODE 8 --> 68.7801743 sigma out 1act.( 61.8277512 sig in 12act.) RANK 4 NODE 5 --> 43.5227203 sigma out 1act.( 45.4632416 sig in 12act.) RANK 5 NODE 4 --> 40.0119705 sigma out 1act.( 38.8354759 sig in 12act.) RANK 6 NODE 7 --> 37.6449738 sigma out 1act.( 37.2093735 sig in 12act.) RANK 7 NODE 9 --> 35.3851929 sigma out 1act.( 30.7265263 sig in 12act.) RANK 8 NODE 13 --> 28.7766132 sigma out 1act.( 26.4534073 sig in 12act.) RANK 9 NODE 12 --> 23.5484428 sigma out 1act.( 25.5860977 sig in 12act.) RANK 10 NODE 1 --> 23.5233307 sigma out 1act.( 21.5324726 sig in 12act.) RANK 11 NODE 15 --> 20.1943169 sigma out 1act.( 17.7151031 sig in 12act.) RANK 12 NODE 2 --> 19.6774387 sigma out 1act.( 16.2363644 sig in 12act.) RANK 13 NODE 3 --> 17.8545094 sigma out 1act.( 17.9611244 sig in 12act.) RANK 14 NODE 6 --> 1.81323564 sigma out 1act.( 4.14944458 sig in 12act.) RANK 15 NODE 14 --> 0.732519865 sigma out 1act.( 1.15588701 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 194.696182 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.546433628 *** contribution from regularisation: 0.00352511252 *** contribution from error: -0.549958766 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29884 Closing output file done