NNInput NNInputs_200.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 173141 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 24799 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 24799 Chosen entries: 24799 Signal fraction: 1 Background fraction: 0.167175 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 24799 Entries to split: 24799 Test with : 12399 Train with : 12399 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 24799 for Signal Prepared event 0 for Signal with 24799 events ====Entry 0 Variable Ht : 152.764 Variable LepAPt : 33.6093 Variable LepBPt : 15.3084 Variable MetSigLeptonsJets : 8.99012 Variable MetSpec : 77.8251 Variable SumEtLeptonsJets : 74.9391 Variable VSumJetLeptonsPt : 71.9347 Variable addEt : 126.743 Variable dPhiLepSumMet : 2.71571 Variable dPhiLeptons : 0.104355 Variable dRLeptons : 0.619509 Variable lep1_E : 34.354 Variable lep2_E : 20.7615 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2200 Ht = 152.764 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.6093 LepAPt = 33.6093 LepBEt = 15.3088 LepBPt = 15.3084 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 77.8251 MetDelPhi = 2.68307 MetSig = 6.17532 MetSigLeptonsJets = 8.99012 MetSpec = 77.8251 Mjj = 0 MostCentralJetEta = 0.104936 MtllMet = 131.249 Njets = 1 SB = 0 SumEt = 158.825 SumEtJets = 0 SumEtLeptonsJets = 74.9391 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 71.9347 addEt = 126.743 dPhiLepSumMet = 2.71571 dPhiLeptons = 0.104355 dRLeptons = 0.619509 diltype = 54 dimass = 14.2669 event = 542 jet1_Et = 26.0214 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.354 lep2_E = 20.7615 rand = 0.999742 run = 196099 weight = 1.72479e-06 ===Show End Prepared event 10000 for Signal with 24799 events Prepared event 20000 for Signal with 24799 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.145872 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4703 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 173141 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4703 negative weights. Signal fraction: 63.0625496 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 63.0346184 65.646286 67.2536316 68.5416412 69.5403442 70.5166931 71.4554443 72.4362183 73.3649445 74.0437164 74.747757 75.5108948 76.1476593 76.8272018 77.4503937 78.2028809 78.8116608 79.5053482 80.318306 80.9682999 81.6375122 82.3629456 83.1014175 83.9085999 84.9161682 86.0459976 87.0027771 88.203598 89.3695602 90.6771851 92.0370941 93.5273743 95.0523071 96.3427582 98.2972412 99.9884491 101.632919 103.380699 105.075806 106.792717 108.754669 110.730789 112.757233 114.743942 116.323112 118.040878 119.717735 121.427902 123.120804 124.693283 126.459366 128.256531 129.849884 131.402328 133.379883 135.159134 136.782318 138.349945 140.086487 141.718018 143.184326 144.780777 146.584412 148.232452 150.031464 152.054626 153.959457 156.020752 157.735443 159.668335 161.565796 163.472153 165.735641 167.882904 170.290009 172.555466 174.920685 177.392517 179.816071 182.332352 184.614502 187.612579 190.16774 193.125977 196.120422 199.714508 203.226593 207.600372 212.278412 216.869156 221.798798 228.289856 234.70813 243.102737 254.119522 267.387756 284.235809 309.33606 366.84613 950.957642 ------------------------------ Transdef: Tab for variable 3 20.0005035 20.3167725 20.6295815 20.9307098 21.186058 21.4560928 21.7386436 22.0016212 22.2230492 22.447361 22.6950607 22.8869457 23.1057644 23.3288708 23.5746193 23.7994461 24.0533447 24.2741051 24.5462456 24.7655869 24.9938736 25.1980438 25.361639 25.5906296 25.7864704 26.0331802 26.25173 26.4924107 26.7226658 26.9537811 27.1807041 27.4435616 27.6889076 27.9417839 28.1946526 28.4688835 28.6879044 28.967907 29.2039547 29.4970779 29.7430305 30.044014 30.3778172 30.6651516 31.0120239 31.3409443 31.6173592 31.9158516 32.2412567 32.5922318 32.98909 33.3872223 33.7843475 34.1448097 34.5176697 34.922184 35.3574638 35.8158493 36.2399178 36.7411156 37.270546 37.7622414 38.2427368 38.7716827 39.1708412 39.6473045 40.2107162 40.7258911 41.1092911 41.6865959 42.2430878 42.7758484 43.3792992 44.0056458 44.6251183 45.22686 45.911232 46.5453033 47.3101654 48.1684647 48.9397507 49.7779846 50.7168999 51.666729 52.6244507 53.7164841 54.9311829 55.9054031 57.1128006 58.4197311 59.7998886 61.5116501 63.220787 64.9658813 66.9237366 69.49086 72.1393738 75.4736938 80.0255051 88.9834442 214.864914 ------------------------------ Transdef: Tab for variable 4 10.0008354 10.1259241 10.2805872 10.3785381 10.4946594 10.6360455 10.7770767 10.9200974 11.0402842 11.1777039 11.3288422 11.4658594 11.6168385 11.7484264 11.879343 12.0254154 12.187706 12.3129368 12.479599 12.6392822 12.8118229 12.9677429 13.1498375 13.3287296 13.4914494 13.6346016 13.8141537 13.9573717 14.1101694 14.2778568 14.4634457 14.6685963 14.8533745 15.067297 15.2596931 15.4129314 15.6032104 15.8054409 15.9748306 16.2191067 16.4455872 16.6303673 16.8605919 17.0668182 17.2692566 17.4841728 17.70504 17.9232731 18.0672188 18.2659912 18.4631824 18.6987267 18.9053116 19.0947704 19.3155746 19.5461159 19.7841721 20.0219536 20.2264214 20.392334 20.5876026 20.7803841 20.9963493 21.1743279 21.3819618 21.5790062 21.8019524 21.9931679 22.1866302 22.4051743 22.6192245 22.8489456 23.0555458 23.3330879 23.6002769 23.8617821 24.1756096 24.4218121 24.6870556 24.966362 25.2651691 25.5506859 25.9050751 26.3054314 26.6669731 27.0474186 27.4100113 27.7913895 28.2029247 28.693119 29.2450752 29.7555809 30.3563118 30.999773 31.7974739 32.7353363 33.8824806 35.4484787 37.8590012 42.1477547 95.7538834 ------------------------------ Transdef: Tab for variable 5 1.08546138 2.66297913 3.12036133 3.50391054 3.78170776 3.99677086 4.1396513 4.28112793 4.40589905 4.53045368 4.62903976 4.71527147 4.80553341 4.89238691 4.96395969 5.04693985 5.12222576 5.19681454 5.2648077 5.3303256 5.38855791 5.4443903 5.50574255 5.55378628 5.60087585 5.65320969 5.70572567 5.75553799 5.81053305 5.8489852 5.89887047 5.94476223 5.9961071 6.03962612 6.093472 6.14129496 6.19285393 6.23653078 6.27864933 6.32552576 6.36984205 6.42148399 6.46599865 6.50670004 6.55850887 6.60761595 6.64510107 6.692976 6.73807096 6.78145695 6.82961941 6.8679781 6.91269398 6.96820545 7.02238655 7.07658386 7.13096905 7.18609715 7.23507595 7.29731798 7.34875488 7.4052949 7.46145344 7.50184059 7.55895996 7.61932755 7.68115807 7.73397446 7.79185534 7.84833336 7.91203022 7.97391033 8.0387392 8.09825325 8.15195847 8.21796036 8.28599358 8.35916519 8.43693542 8.50973701 8.59119606 8.67135811 8.74835968 8.82506371 8.91521835 8.99637604 9.08747864 9.18720245 9.29353905 9.40023232 9.50166512 9.61722755 9.7612133 9.90754986 10.0826225 10.262188 10.5218277 10.8688421 11.4058132 12.5094414 19.3010483 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.6786003 25.5136147 26.6126919 27.6565037 28.712532 29.5140896 30.3305969 31.0172749 31.6203136 32.3283882 32.8332596 33.3815155 33.8184738 34.2838593 34.7344131 35.0845337 35.6008148 35.9927711 36.3901176 36.7047806 37.1492538 37.5251808 37.912941 38.3395309 38.6542892 39.0288239 39.4651718 39.8740005 40.2795105 40.6433182 41.0400085 41.4549103 41.8943901 42.3740044 42.8683167 43.2774734 43.7767639 44.2958107 44.8029404 45.3528442 45.8973312 46.5379829 47.1993408 47.8691063 48.4832382 49.2388916 49.9786835 50.4986649 51.2650223 52.126709 53.0545731 53.806572 54.6214485 55.5226212 56.2939606 56.9688072 57.8243904 58.5360031 59.2264175 59.9841003 60.8823128 61.732399 62.5637741 63.4384537 64.3563538 65.1945953 65.96492 66.6734161 67.5470886 68.5265045 69.4265823 70.3293152 71.2664642 72.0797424 72.9253998 73.9085922 74.9248352 75.792778 76.7150879 77.5300446 78.5709991 79.8331451 80.9236832 82.1085815 83.3673553 84.7974243 86.2498016 87.9073715 89.375946 91.0405045 92.9246521 94.8408661 97.3313828 99.8310699 102.786255 107.033127 112.22892 120.359024 133.954895 267.220703 ------------------------------ Transdef: Tab for variable 7 30.1648712 32.6715546 33.6425018 34.3379364 34.9701538 35.5428848 36.0070801 36.4782867 36.905983 37.2927933 37.682579 38.0115356 38.2826653 38.6233063 38.9250336 39.2839737 39.6022911 39.9197922 40.2063522 40.513855 40.8993073 41.2883682 41.6268921 42.0575218 42.5908737 43.0085602 43.5407791 44.156868 44.7238464 45.2202187 46.0001907 46.9498367 47.7438354 48.6984863 49.8412247 50.9540749 52.0627899 52.9919662 54.1642876 55.2118835 56.3376732 57.4331436 58.3764725 59.345726 60.3274803 61.1814804 61.894619 62.8757706 63.9077682 64.8308868 65.652771 66.7129974 67.6951599 68.667305 69.5381622 70.396225 71.4466095 72.3815002 73.3694611 74.4237366 75.5318909 76.6123428 77.6356812 78.8061371 79.8912354 81.1185608 82.411377 83.74263 85.059082 86.3346405 87.814743 89.1643372 90.7330856 92.5183258 94.0861359 95.8522797 97.3968353 99.1529846 101.108841 103.019806 105.106606 106.894356 109.223099 112.042892 114.763779 117.49688 120.166466 122.863098 126.203064 130.038635 134.08551 137.895905 142.846008 148.373474 155.062408 163.346436 173.743439 189.07048 211.257202 252.077942 607.448547 ------------------------------ Transdef: Tab for variable 8 1.44759953 24.7338982 29.0451164 31.0538368 32.1219406 32.8901596 33.4353065 33.8912926 34.3542175 34.8358765 35.2346344 35.5953064 35.980526 36.350647 36.7110481 37.0486031 37.3122177 37.6195107 37.8936005 38.138855 38.4044495 38.7161789 39.0112801 39.2669449 39.5475807 39.8162231 40.0988617 40.4450912 40.8079758 41.1737976 41.4877625 41.9268608 42.3470688 42.7383652 43.1811523 43.6041946 44.0081177 44.4341354 44.9831238 45.4624634 46.152626 46.8931732 47.5822678 48.3147507 48.9674149 49.6462708 50.3587837 51.0400696 51.8544846 52.6368446 53.2532806 54.0462837 54.8262978 55.6557388 56.4969788 57.2009659 57.9855766 58.771637 59.5176315 60.1635551 60.8481827 61.4327469 62.2450905 63.1006775 63.8060493 64.558548 65.280426 66.0226898 66.8102722 67.5777588 68.3554916 69.1279984 69.8622589 70.7087097 71.5287628 72.3572083 73.2660141 74.2106934 75.0769501 76.0740967 77.0663452 78.1075134 79.1392288 80.2321548 81.5278168 82.6897736 83.9448853 85.2565994 86.682312 88.3252335 90.2967072 92.2554626 94.3436737 96.7512054 99.7799911 103.285515 107.912949 113.943451 123.621895 145.060867 434.137238 ------------------------------ Transdef: Tab for variable 9 49.2546883 62.7863922 64.9087524 66.6755524 67.8850555 68.867218 69.861084 70.7131653 71.5281677 72.4171295 73.2708435 73.9272003 74.4560699 75.1648026 75.750946 76.3593903 76.95961 77.5005646 78.1147461 78.6411438 79.225975 79.7862091 80.5540924 81.0596161 81.6307068 82.2499542 82.865799 83.4478455 84.3355255 85.0910492 85.972084 86.7179565 87.7438812 88.7299881 89.6539917 90.7703857 91.9672241 93.1037521 94.4342346 95.605484 96.9467926 98.5626068 99.9075623 101.273102 102.627357 104.181755 105.644012 107.028961 108.613251 110.060455 111.510742 113.154297 114.702759 116.095581 117.272446 118.637779 119.779381 121.101044 122.447845 123.679497 125.001236 126.513504 127.756493 128.903488 130.107529 131.460648 132.845642 134.383759 135.645844 136.85733 137.991577 139.288635 140.590973 141.842041 143.076965 144.36911 145.76033 147.366486 148.708496 150.29007 151.842224 153.437759 155.218781 156.85466 158.57016 160.481293 162.247543 164.153519 166.379333 168.556381 171.071075 173.49826 176.471024 179.458054 183.10936 187.146713 191.752655 198.183685 207.6362 227.906494 493.485443 ------------------------------ Transdef: Tab for variable 10 0.000472510961 0.864810407 1.26619625 1.50374079 1.67183304 1.79955268 1.90906298 2.00427103 2.07968569 2.15555882 2.21778297 2.27105498 2.31825924 2.3562007 2.39368391 2.42865276 2.46126986 2.49341559 2.52850032 2.5565052 2.58381963 2.60625267 2.63171864 2.65381479 2.67528248 2.69509745 2.7148087 2.73330641 2.75182676 2.76948094 2.78434134 2.79936075 2.81313229 2.82647753 2.83786726 2.84707403 2.86043215 2.87048411 2.88012433 2.88917398 2.89766693 2.90704274 2.91548133 2.92200994 2.93021488 2.93703461 2.94405174 2.95076656 2.95799971 2.96413374 2.97053814 2.97610712 2.98197269 2.98702145 2.99211359 2.9972949 3.00243616 3.00647449 3.01172352 3.01653671 3.02077055 3.02515745 3.02952147 3.03338027 3.03727245 3.04125309 3.04529285 3.04935026 3.05307579 3.05657125 3.06023765 3.06389284 3.06709909 3.07035589 3.07306862 3.07568717 3.07836008 3.081635 3.08426523 3.08740568 3.09035778 3.09326267 3.09629917 3.0989399 3.10175371 3.1040287 3.10647845 3.10902762 3.11134768 3.11428022 3.11674643 3.11901903 3.12145233 3.12408781 3.12700319 3.12926531 3.13141704 3.1335969 3.13618708 3.13904047 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.0056374073 0.0112814745 0.0181307197 0.0239699483 0.0294759795 0.0353929996 0.0411972404 0.0471874475 0.0540804863 0.0606774539 0.0666794255 0.0731237531 0.0797986984 0.0858142376 0.0921481848 0.0972030163 0.102450162 0.107930183 0.111943245 0.117186606 0.122075766 0.127304196 0.132676363 0.138169289 0.143341184 0.148549736 0.153757185 0.158936977 0.16412282 0.169413507 0.174862027 0.179684043 0.184301406 0.190102577 0.195593983 0.200119615 0.206215277 0.211184323 0.216450572 0.221484274 0.226839066 0.231314033 0.237462699 0.242757142 0.248353601 0.253944218 0.259280145 0.264411449 0.270395815 0.275638461 0.280587673 0.286565542 0.29189539 0.298183858 0.303566575 0.309687138 0.315432906 0.321441263 0.327418745 0.333281219 0.340456933 0.347006083 0.353317916 0.359985858 0.365758955 0.373199791 0.379578352 0.386735648 0.393047363 0.399679899 0.406098127 0.413522482 0.419373482 0.425629258 0.432683349 0.43942672 0.447687268 0.455931962 0.464020491 0.472214043 0.479208231 0.489563227 0.498726845 0.509526193 0.520970404 0.531516194 0.540011704 0.550889254 0.56409061 0.577879667 0.594117641 0.61021471 0.626772761 0.644778013 0.659873843 0.688849449 0.723141432 0.771751881 0.839832902 1.11372733 ------------------------------ Transdef: Tab for variable 12 0.100060925 0.118433341 0.136927873 0.152381986 0.164490387 0.174703807 0.18470183 0.194756404 0.201487392 0.210222885 0.218728408 0.22631079 0.234207958 0.241502255 0.249065101 0.25545156 0.261716783 0.268543124 0.274986327 0.281238854 0.28734988 0.29452011 0.300880343 0.306723446 0.312833011 0.318622202 0.324434459 0.330021739 0.33501333 0.341101289 0.346152455 0.351751953 0.357026696 0.363551825 0.370042086 0.37583667 0.381924987 0.387379408 0.392375231 0.397755802 0.401734114 0.405887455 0.410611331 0.415108323 0.419376135 0.423362374 0.427498341 0.431491435 0.435833216 0.440652311 0.44475162 0.448730052 0.453426421 0.457495511 0.460957497 0.465672314 0.46983245 0.474044502 0.477499843 0.482038528 0.486622572 0.491412669 0.496346176 0.500961423 0.506447911 0.510980606 0.516872406 0.522309661 0.52756685 0.532830715 0.53839767 0.545410335 0.5500319 0.556287766 0.562276244 0.569144845 0.576079011 0.582433581 0.590209961 0.597068429 0.604469597 0.613028526 0.621507466 0.629569471 0.639232278 0.649917722 0.659920275 0.670625091 0.679591298 0.691813231 0.703132749 0.71570617 0.728809178 0.744230986 0.758701205 0.779274225 0.796653152 0.823436499 0.859775782 0.895572722 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0277634 21.508337 22.2619438 23.0137291 23.6455841 24.1488419 24.5962448 25.0865936 25.5346909 25.9964485 26.4321232 26.9020271 27.2407837 27.6211624 28.0556068 28.4807415 28.8650131 29.2078533 29.5541363 29.8991432 30.2200851 30.5761261 30.9106445 31.2181301 31.5727158 31.8868427 32.2956161 32.6150131 32.9934196 33.3502502 33.7433167 34.1808701 34.5440903 34.9110184 35.2964859 35.7231674 36.0966492 36.5166779 36.9981003 37.4592552 37.9414024 38.3229065 38.8141403 39.3090744 39.7612381 40.2009125 40.7015038 41.2101135 41.6940002 42.2520447 42.7200356 43.1334839 43.6493149 44.1522751 44.6658249 45.2229462 45.8778534 46.4439697 46.9586639 47.5552368 48.0623169 48.6961288 49.383522 49.9825668 50.6341209 51.2957268 51.9566078 52.6113358 53.3564377 54.102829 54.9095306 55.5919456 56.3583374 57.0998306 57.9140244 58.7431374 59.6445312 60.3474197 61.29105 62.3432159 63.4550819 64.4326477 65.4466782 66.649826 67.8892365 68.8291855 70.0035019 71.3717499 72.8507614 74.5747375 76.3298264 78.0223618 80.016861 82.3041229 85.113678 87.6026688 90.2789764 94.9127579 101.3367 112.54538 381.504089 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.8165007 11.2683783 11.6026144 11.8940945 12.2205935 12.4767227 12.7980518 13.0999699 13.4265776 13.6709528 13.9897642 14.3038349 14.5691376 14.8544178 15.1172352 15.3727798 15.5979939 15.8305035 16.0697441 16.3214397 16.5565491 16.8024597 17.0716553 17.333622 17.588459 17.8159714 18.0512905 18.283083 18.5142708 18.7551498 19.0118904 19.2238979 19.4852104 19.716114 19.9725723 20.2394753 20.4790649 20.6984711 20.9546204 21.1968136 21.4007645 21.626215 21.8422985 22.0517731 22.2503815 22.4545555 22.6776047 22.9224625 23.137331 23.3691216 23.6121635 23.8288994 24.0716324 24.3179665 24.5602722 24.8267326 25.066658 25.304184 25.5557289 25.756958 26.0293598 26.300705 26.5560551 26.8162231 27.1226654 27.4162693 27.6816216 27.96101 28.2021408 28.4697571 28.7695065 29.0876331 29.4449825 29.7940102 30.1637039 30.547245 30.9403038 31.3807793 31.7553635 32.2041931 32.65065 33.1381149 33.535347 34.0615692 34.6076889 35.1734085 35.763855 36.4520035 37.2313805 38.0984421 39.0632706 40.1363487 41.3051605 42.6725464 44.2199516 46.2155838 48.7544861 52.8014908 60.3762512 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 64.8 51.5 50.4 29.2 49.4 62.9 53.9 62.7 -26.8 -13.8 -25.2 26.1 24.0 2 64.8 100.0 70.5 56.0 40.6 70.8 94.9 78.0 92.8 -44.1 -20.9 -37.1 45.9 31.1 3 51.5 70.5 100.0 41.6 21.8 44.9 71.5 61.8 78.4 -12.0 -25.2 -44.2 75.2 21.7 4 50.4 56.0 41.6 100.0 11.3 32.4 58.7 46.3 57.9 -15.3 -25.9 -44.6 24.3 72.3 5 29.2 40.6 21.8 11.3 100.0 84.0 14.9 61.8 60.4 20.5 -6.4 -10.4 10.5 0.3 6 49.4 70.8 44.9 32.4 84.0 100.0 51.6 80.8 80.7 -7.1 -14.2 -24.1 26.2 13.7 7 62.9 94.9 71.5 58.7 14.9 51.6 100.0 70.1 82.4 -52.4 -20.0 -37.0 48.1 35.0 8 53.9 78.0 61.8 46.3 61.8 80.8 70.1 100.0 85.7 -12.2 -21.1 -34.7 41.0 25.4 9 62.7 92.8 78.4 57.9 60.4 80.7 82.4 85.7 100.0 -20.5 -24.1 -42.5 53.4 32.5 10 -26.8 -44.1 -12.0 -15.3 20.5 -7.1 -52.4 -12.2 -20.5 100.0 0.3 3.5 -5.1 -8.6 11 -13.8 -20.9 -25.2 -25.9 -6.4 -14.2 -20.0 -21.1 -24.1 0.3 100.0 60.5 -13.9 -14.7 12 -25.2 -37.1 -44.2 -44.6 -10.4 -24.1 -37.0 -34.7 -42.5 3.5 60.5 100.0 -25.0 -21.2 13 26.1 45.9 75.2 24.3 10.5 26.2 48.1 41.0 53.4 -5.1 -13.9 -25.0 100.0 43.3 14 24.0 31.1 21.7 72.3 0.3 13.7 35.0 25.4 32.5 -8.6 -14.7 -21.2 43.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 162.131545 TOTAL CORRELATION OF ALL VARIABLES 70.7712837 ROUND 1: MAX CORR ( 70.7712693) AFTER KILLING INPUT VARIABLE 11 CONTR 0.0450480841 ROUND 2: MAX CORR ( 70.744527) AFTER KILLING INPUT VARIABLE 8 CONTR 1.94537161 ROUND 3: MAX CORR ( 70.6644396) AFTER KILLING INPUT VARIABLE 2 CONTR 3.36527346 ROUND 4: MAX CORR ( 70.5665206) AFTER KILLING INPUT VARIABLE 14 CONTR 3.7187634 ROUND 5: MAX CORR ( 70.4007244) AFTER KILLING INPUT VARIABLE 6 CONTR 4.8344415 ROUND 6: MAX CORR ( 70.159536) AFTER KILLING INPUT VARIABLE 10 CONTR 5.82249988 ROUND 7: MAX CORR ( 69.8507967) AFTER KILLING INPUT VARIABLE 12 CONTR 6.57470105 ROUND 8: MAX CORR ( 69.2619693) AFTER KILLING INPUT VARIABLE 9 CONTR 9.05060318 ROUND 9: MAX CORR ( 68.236129) AFTER KILLING INPUT VARIABLE 13 CONTR 11.8764927 ROUND 10: MAX CORR ( 67.9451221) AFTER KILLING INPUT VARIABLE 3 CONTR 6.29521169 ROUND 11: MAX CORR ( 66.038098) AFTER KILLING INPUT VARIABLE 4 CONTR 15.9846562 ROUND 12: MAX CORR ( 62.9188997) AFTER KILLING INPUT VARIABLE 5 CONTR 20.0559826 LAST REMAINING VARIABLE: 7 total correlation to target: 70.7712837 % total significance: 99.4947176 sigma correlations of single variables to target: variable 2: 64.8170861 % , in sigma: 91.1239326 variable 3: 51.4878779 % , in sigma: 72.3848941 variable 4: 50.4059348 % , in sigma: 70.8638305 variable 5: 29.197834 % , in sigma: 41.0481497 variable 6: 49.4428832 % , in sigma: 69.5099121 variable 7: 62.9188997 % , in sigma: 88.4553429 variable 8: 53.8618339 % , in sigma: 75.7223506 variable 9: 62.7496077 % , in sigma: 88.2173415 variable 10: -26.8122598 % , in sigma: 37.6943596 variable 11: -13.7563738 % , in sigma: 19.3395748 variable 12: -25.151014 % , in sigma: 35.3588758 variable 13: 26.1176751 % , in sigma: 36.7178688 variable 14: 24.0056492 % , in sigma: 33.7486501 variables sorted by significance: 1 most relevant variable 7 corr 62.9188995 , in sigma: 88.4553426 2 most relevant variable 5 corr 20.0559826 , in sigma: 28.1959606 3 most relevant variable 4 corr 15.9846563 , in sigma: 22.4722343 4 most relevant variable 3 corr 6.29521179 , in sigma: 8.85020431 5 most relevant variable 13 corr 11.8764925 , in sigma: 16.6967194 6 most relevant variable 9 corr 9.05060291 , in sigma: 12.7239063 7 most relevant variable 12 corr 6.57470083 , in sigma: 9.24312756 8 most relevant variable 10 corr 5.82249975 , in sigma: 8.18563602 9 most relevant variable 6 corr 4.83444166 , in sigma: 6.79656187 10 most relevant variable 14 corr 3.71876335 , in sigma: 5.22807119 11 most relevant variable 2 corr 3.36527348 , in sigma: 4.73111292 12 most relevant variable 8 corr 1.94537163 , in sigma: 2.73492568 13 most relevant variable 11 corr 0.0450480841 , in sigma: 0.0633314273 global correlations between input variables: variable 2: 99.2956324 % variable 3: 94.7898798 % variable 4: 91.2333693 % variable 5: 95.4756839 % variable 6: 94.0500317 % variable 7: 98.9056762 % variable 8: 91.3241268 % variable 9: 99.0320084 % variable 10: 72.4565332 % variable 11: 61.0506787 % variable 12: 71.7071754 % variable 13: 89.321001 % variable 14: 88.3147689 % significance loss when removing single variables: variable 2: corr = 2.19530446 % , sigma = 3.08629696 variable 3: corr = 13.8451348 % , sigma = 19.4643605 variable 4: corr = 15.4925476 % , sigma = 21.780397 variable 5: corr = 9.66935515 % , sigma = 13.5937871 variable 6: corr = 4.6909734 % , sigma = 6.59486517 variable 7: corr = 5.96057279 % , sigma = 8.37974778 variable 8: corr = 1.94477415 % , sigma = 2.73408571 variable 9: corr = 8.22671024 % , sigma = 11.5656262 variable 10: corr = 4.46555964 % , sigma = 6.27796434 variable 11: corr = 0.0450480841 % , sigma = 0.0633314273 variable 12: corr = 5.74003821 % , sigma = 8.06970641 variable 13: corr = 5.40258813 % , sigma = 7.59529788 variable 14: corr = 3.68479322 % , sigma = 5.18031385 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 13.2677202 sigma out 15 active outputs RANK 2 NODE 9 --> 13.2325268 sigma out 15 active outputs RANK 3 NODE 7 --> 12.471118 sigma out 15 active outputs RANK 4 NODE 3 --> 11.3421946 sigma out 15 active outputs RANK 5 NODE 6 --> 11.2681093 sigma out 15 active outputs RANK 6 NODE 4 --> 10.9336491 sigma out 15 active outputs RANK 7 NODE 8 --> 10.3094063 sigma out 15 active outputs RANK 8 NODE 12 --> 10.1894894 sigma out 15 active outputs RANK 9 NODE 5 --> 8.32149982 sigma out 15 active outputs RANK 10 NODE 1 --> 7.96295404 sigma out 15 active outputs RANK 11 NODE 10 --> 6.07260275 sigma out 15 active outputs RANK 12 NODE 11 --> 4.8825779 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 16.8666573 sigma in 12act. ( 17.7753334 sig out 1act.) RANK 2 NODE 1 --> 15.9179316 sigma in 12act. ( 17.7230988 sig out 1act.) RANK 3 NODE 2 --> 13.1873989 sigma in 12act. ( 11.764596 sig out 1act.) RANK 4 NODE 9 --> 10.7835121 sigma in 12act. ( 13.209547 sig out 1act.) RANK 5 NODE 7 --> 9.83672619 sigma in 12act. ( 9.32964802 sig out 1act.) RANK 6 NODE 13 --> 9.78881741 sigma in 12act. ( 9.36078072 sig out 1act.) RANK 7 NODE 4 --> 9.26352215 sigma in 12act. ( 9.30857468 sig out 1act.) RANK 8 NODE 6 --> 9.00697231 sigma in 12act. ( 8.32403469 sig out 1act.) RANK 9 NODE 10 --> 7.56592846 sigma in 12act. ( 8.26851082 sig out 1act.) RANK 10 NODE 5 --> 4.82825375 sigma in 12act. ( 4.06806993 sig out 1act.) RANK 11 NODE 12 --> 2.37347245 sigma in 12act. ( 2.65400887 sig out 1act.) RANK 12 NODE 14 --> 1.88539743 sigma in 12act. ( 1.42593622 sig out 1act.) RANK 13 NODE 11 --> 1.73808467 sigma in 12act. ( 0.239558429 sig out 1act.) RANK 14 NODE 3 --> 1.69696426 sigma in 12act. ( 1.53212202 sig out 1act.) RANK 15 NODE 15 --> 1.44291079 sigma in 12act. ( 0.508822441 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 17.7753334 sigma out 1act.( 16.8666573 sig in 12act.) RANK 2 NODE 1 --> 17.7230988 sigma out 1act.( 15.9179316 sig in 12act.) RANK 3 NODE 9 --> 13.209547 sigma out 1act.( 10.7835121 sig in 12act.) RANK 4 NODE 2 --> 11.764596 sigma out 1act.( 13.1873989 sig in 12act.) RANK 5 NODE 13 --> 9.36078072 sigma out 1act.( 9.78881741 sig in 12act.) RANK 6 NODE 7 --> 9.32964802 sigma out 1act.( 9.83672619 sig in 12act.) RANK 7 NODE 4 --> 9.30857468 sigma out 1act.( 9.26352215 sig in 12act.) RANK 8 NODE 6 --> 8.32403469 sigma out 1act.( 9.00697231 sig in 12act.) RANK 9 NODE 10 --> 8.26851082 sigma out 1act.( 7.56592846 sig in 12act.) RANK 10 NODE 5 --> 4.06806993 sigma out 1act.( 4.82825375 sig in 12act.) RANK 11 NODE 12 --> 2.65400887 sigma out 1act.( 2.37347245 sig in 12act.) RANK 12 NODE 3 --> 1.53212202 sigma out 1act.( 1.69696426 sig in 12act.) RANK 13 NODE 14 --> 1.42593622 sigma out 1act.( 1.88539743 sig in 12act.) RANK 14 NODE 15 --> 0.508822441 sigma out 1act.( 1.44291079 sig in 12act.) RANK 15 NODE 11 --> 0.239558429 sigma out 1act.( 1.73808467 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 37.016655 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 22.6664886 sigma out 15 active outputs RANK 2 NODE 9 --> 14.0989008 sigma out 15 active outputs RANK 3 NODE 2 --> 13.9574566 sigma out 15 active outputs RANK 4 NODE 7 --> 13.6007948 sigma out 15 active outputs RANK 5 NODE 6 --> 12.0732088 sigma out 15 active outputs RANK 6 NODE 3 --> 11.7267981 sigma out 15 active outputs RANK 7 NODE 8 --> 11.6239815 sigma out 15 active outputs RANK 8 NODE 4 --> 11.0537233 sigma out 15 active outputs RANK 9 NODE 1 --> 10.7521229 sigma out 15 active outputs RANK 10 NODE 5 --> 8.86961269 sigma out 15 active outputs RANK 11 NODE 10 --> 7.7051487 sigma out 15 active outputs RANK 12 NODE 11 --> 5.0089283 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 18.3671608 sigma in 12act. ( 17.2829838 sig out 1act.) RANK 2 NODE 1 --> 14.7856522 sigma in 12act. ( 15.1558743 sig out 1act.) RANK 3 NODE 9 --> 14.7531834 sigma in 12act. ( 14.1190262 sig out 1act.) RANK 4 NODE 14 --> 11.7422199 sigma in 12act. ( 3.5667367 sig out 1act.) RANK 5 NODE 2 --> 10.9762201 sigma in 12act. ( 8.9685297 sig out 1act.) RANK 6 NODE 4 --> 10.7713146 sigma in 12act. ( 8.95741463 sig out 1act.) RANK 7 NODE 10 --> 10.4536057 sigma in 12act. ( 10.7135592 sig out 1act.) RANK 8 NODE 13 --> 10.3949947 sigma in 12act. ( 9.24704647 sig out 1act.) RANK 9 NODE 7 --> 9.84580231 sigma in 12act. ( 8.09379292 sig out 1act.) RANK 10 NODE 12 --> 9.71093178 sigma in 12act. ( 6.23653746 sig out 1act.) RANK 11 NODE 15 --> 9.45655346 sigma in 12act. ( 2.30570459 sig out 1act.) RANK 12 NODE 3 --> 9.27587128 sigma in 12act. ( 3.54979873 sig out 1act.) RANK 13 NODE 6 --> 8.82705212 sigma in 12act. ( 7.07123232 sig out 1act.) RANK 14 NODE 11 --> 7.41620064 sigma in 12act. ( 1.37226427 sig out 1act.) RANK 15 NODE 5 --> 6.83344555 sigma in 12act. ( 3.47407842 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 17.2829838 sigma out 1act.( 18.3671608 sig in 12act.) RANK 2 NODE 1 --> 15.1558743 sigma out 1act.( 14.7856522 sig in 12act.) RANK 3 NODE 9 --> 14.1190262 sigma out 1act.( 14.7531834 sig in 12act.) RANK 4 NODE 10 --> 10.7135592 sigma out 1act.( 10.4536057 sig in 12act.) RANK 5 NODE 13 --> 9.24704647 sigma out 1act.( 10.3949947 sig in 12act.) RANK 6 NODE 2 --> 8.9685297 sigma out 1act.( 10.9762201 sig in 12act.) RANK 7 NODE 4 --> 8.95741463 sigma out 1act.( 10.7713146 sig in 12act.) RANK 8 NODE 7 --> 8.09379292 sigma out 1act.( 9.84580231 sig in 12act.) RANK 9 NODE 6 --> 7.07123232 sigma out 1act.( 8.82705212 sig in 12act.) RANK 10 NODE 12 --> 6.23653746 sigma out 1act.( 9.71093178 sig in 12act.) RANK 11 NODE 14 --> 3.5667367 sigma out 1act.( 11.7422199 sig in 12act.) RANK 12 NODE 3 --> 3.54979873 sigma out 1act.( 9.27587128 sig in 12act.) RANK 13 NODE 5 --> 3.47407842 sigma out 1act.( 6.83344555 sig in 12act.) RANK 14 NODE 15 --> 2.30570459 sigma out 1act.( 9.45655346 sig in 12act.) RANK 15 NODE 11 --> 1.37226427 sigma out 1act.( 7.41620064 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 35.8845978 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.535451412 *** contribution from regularisation: 0.00499202497 *** contribution from error: -0.54044342 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.58076793 *** contribution from regularisation: 0.00235827034 *** contribution from error: -0.583126187 *********************************************** -----------------> Test sample ENTER BFGS code START -50285.7381 0.105145939 0.0791147724 EXIT FROM BFGS code FG_START 0. 0.105145939 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.602047443 *** contribution from regularisation: 0.00198559789 *** contribution from error: -0.604033053 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -52119.2451 0.105145939 25.2158909 EXIT FROM BFGS code FG_LNSRCH 0. 0.125509977 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.608639777 *** contribution from regularisation: 0.00279031997 *** contribution from error: -0.611430109 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52689.9451 0.125509977 8.88190174 EXIT FROM BFGS code NEW_X -52689.9451 0.125509977 8.88190174 ENTER BFGS code NEW_X -52689.9451 0.125509977 8.88190174 EXIT FROM BFGS code FG_LNSRCH 0. 0.128122374 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.612044811 *** contribution from regularisation: 0.00271056523 *** contribution from error: -0.614755392 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52984.7182 0.128122374 7.7828207 EXIT FROM BFGS code NEW_X -52984.7182 0.128122374 7.7828207 ENTER BFGS code NEW_X -52984.7182 0.128122374 7.7828207 EXIT FROM BFGS code FG_LNSRCH 0. 0.135261685 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.612953246 *** contribution from regularisation: 0.00268910057 *** contribution from error: -0.615642369 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53063.3643 0.135261685 3.32667756 EXIT FROM BFGS code NEW_X -53063.3643 0.135261685 3.32667756 ENTER BFGS code NEW_X -53063.3643 0.135261685 3.32667756 EXIT FROM BFGS code FG_LNSRCH 0. 0.141765833 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.613333881 *** contribution from regularisation: 0.00265704514 *** contribution from error: -0.615990937 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53096.3163 0.141765833 -5.35516596 EXIT FROM BFGS code NEW_X -53096.3163 0.141765833 -5.35516596 ENTER BFGS code NEW_X -53096.3163 0.141765833 -5.35516596 EXIT FROM BFGS code FG_LNSRCH 0. 0.139797047 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.613592923 *** contribution from regularisation: 0.00274124602 *** contribution from error: -0.61633414 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53118.74 0.139797047 -12.6960354 EXIT FROM BFGS code NEW_X -53118.74 0.139797047 -12.6960354 ENTER BFGS code NEW_X -53118.74 0.139797047 -12.6960354 EXIT FROM BFGS code FG_LNSRCH 0. 0.108616717 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.614302933 *** contribution from regularisation: 0.00250343257 *** contribution from error: -0.616806388 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53180.2047 0.108616717 -15.5586624 EXIT FROM BFGS code NEW_X -53180.2047 0.108616717 -15.5586624 ENTER BFGS code NEW_X -53180.2047 0.108616717 -15.5586624 EXIT FROM BFGS code FG_LNSRCH 0. 0.0475510918 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 22.8218079 sigma out 15 active outputs RANK 2 NODE 1 --> 13.1636801 sigma out 15 active outputs RANK 3 NODE 9 --> 11.3179235 sigma out 15 active outputs RANK 4 NODE 10 --> 9.96777058 sigma out 15 active outputs RANK 5 NODE 2 --> 9.72985554 sigma out 15 active outputs RANK 6 NODE 8 --> 7.45349169 sigma out 15 active outputs RANK 7 NODE 7 --> 6.07350445 sigma out 15 active outputs RANK 8 NODE 4 --> 5.82106352 sigma out 15 active outputs RANK 9 NODE 6 --> 5.4793148 sigma out 15 active outputs RANK 10 NODE 5 --> 4.53375053 sigma out 15 active outputs RANK 11 NODE 11 --> 4.22611809 sigma out 15 active outputs RANK 12 NODE 3 --> 4.15287781 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 16.0596943 sigma in 12act. ( 11.3748045 sig out 1act.) RANK 2 NODE 3 --> 14.8871355 sigma in 12act. ( 13.5772219 sig out 1act.) RANK 3 NODE 9 --> 11.4539585 sigma in 12act. ( 8.02682686 sig out 1act.) RANK 4 NODE 12 --> 11.4106627 sigma in 12act. ( 7.42909622 sig out 1act.) RANK 5 NODE 10 --> 10.0722475 sigma in 12act. ( 6.12598324 sig out 1act.) RANK 6 NODE 8 --> 9.62553501 sigma in 12act. ( 8.66446209 sig out 1act.) RANK 7 NODE 4 --> 8.86831951 sigma in 12act. ( 5.57586336 sig out 1act.) RANK 8 NODE 15 --> 6.43614006 sigma in 12act. ( 4.63136053 sig out 1act.) RANK 9 NODE 13 --> 6.34631348 sigma in 12act. ( 4.17740202 sig out 1act.) RANK 10 NODE 11 --> 6.0818162 sigma in 12act. ( 5.4930582 sig out 1act.) RANK 11 NODE 6 --> 5.48546362 sigma in 12act. ( 3.51411653 sig out 1act.) RANK 12 NODE 5 --> 4.56394768 sigma in 12act. ( 3.97065306 sig out 1act.) RANK 13 NODE 2 --> 4.38047123 sigma in 12act. ( 3.38456941 sig out 1act.) RANK 14 NODE 7 --> 3.6969378 sigma in 12act. ( 1.65829527 sig out 1act.) RANK 15 NODE 1 --> 3.47869706 sigma in 12act. ( 1.38967979 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 13.5772219 sigma out 1act.( 14.8871355 sig in 12act.) RANK 2 NODE 14 --> 11.3748045 sigma out 1act.( 16.0596943 sig in 12act.) RANK 3 NODE 8 --> 8.66446209 sigma out 1act.( 9.62553501 sig in 12act.) RANK 4 NODE 9 --> 8.02682686 sigma out 1act.( 11.4539585 sig in 12act.) RANK 5 NODE 12 --> 7.42909622 sigma out 1act.( 11.4106627 sig in 12act.) RANK 6 NODE 10 --> 6.12598324 sigma out 1act.( 10.0722475 sig in 12act.) RANK 7 NODE 4 --> 5.57586336 sigma out 1act.( 8.86831951 sig in 12act.) RANK 8 NODE 11 --> 5.4930582 sigma out 1act.( 6.0818162 sig in 12act.) RANK 9 NODE 15 --> 4.63136053 sigma out 1act.( 6.43614006 sig in 12act.) RANK 10 NODE 13 --> 4.17740202 sigma out 1act.( 6.34631348 sig in 12act.) RANK 11 NODE 5 --> 3.97065306 sigma out 1act.( 4.56394768 sig in 12act.) RANK 12 NODE 6 --> 3.51411653 sigma out 1act.( 5.48546362 sig in 12act.) RANK 13 NODE 2 --> 3.38456941 sigma out 1act.( 4.38047123 sig in 12act.) RANK 14 NODE 7 --> 1.65829527 sigma out 1act.( 3.6969378 sig in 12act.) RANK 15 NODE 1 --> 1.38967979 sigma out 1act.( 3.47869706 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 26.2747955 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.615140796 *** contribution from regularisation: 0.00239288271 *** contribution from error: -0.617533684 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53252.7386 0.0475510918 -26.9765568 EXIT FROM BFGS code NEW_X -53252.7386 0.0475510918 -26.9765568 ENTER BFGS code NEW_X -53252.7386 0.0475510918 -26.9765568 EXIT FROM BFGS code FG_LNSRCH 0. -0.0837856755 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.611404479 *** contribution from regularisation: 0.00274539064 *** contribution from error: -0.614149868 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52929.2872 -0.0837856755 120.628174 EXIT FROM BFGS code FG_LNSRCH 0. 0.0343147963 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.61478436 *** contribution from regularisation: 0.00292067183 *** contribution from error: -0.617705047 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53221.8846 0.0343147963 -19.3806648 EXIT FROM BFGS code FG_LNSRCH 0. 0.0468091071 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.614887953 *** contribution from regularisation: 0.00265753013 *** contribution from error: -0.617545485 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53230.8523 0.0468091071 -26.4461117 EXIT FROM BFGS code FG_LNSRCH 0. 0.0475468487 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.614821315 *** contribution from regularisation: 0.00271241716 *** contribution from error: -0.617533743 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53225.0836 0.0475468487 -26.9127502 EXIT FROM BFGS code FG_LNSRCH 0. 0.0475510918 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.614788294 *** contribution from regularisation: 0.00274537737 *** contribution from error: -0.617533684 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53222.2232 0.0475510918 -26.9199524 EXIT FROM BFGS code FG_LNSRCH 0. 0.0475510918 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.614795566 *** contribution from regularisation: 0.00273812609 *** contribution from error: -0.617533684 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53222.8509 0.0475510918 -26.9141369 EXIT FROM BFGS code FG_LNSRCH 0. 0.0475510918 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.614798069 *** contribution from regularisation: 0.00273560639 *** contribution from error: -0.617533684 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53223.069 0.0475510918 -26.9033794 EXIT FROM BFGS code FG_LNSRCH 0. 0.0475510918 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.614850521 *** contribution from regularisation: 0.00268312916 *** contribution from error: -0.617533624 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53227.612 0.0475510918 -26.9129066 EXIT FROM BFGS code NEW_X -53227.612 0.0475510918 -26.9129066 ENTER BFGS code NEW_X -53227.612 0.0475510918 -26.9129066 EXIT FROM BFGS code CONVERGENC -53227.612 0.0475510918 -26.9129066 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 42.2818642 sigma out 15 active outputs RANK 2 NODE 1 --> 25.3162918 sigma out 15 active outputs RANK 3 NODE 9 --> 21.3526058 sigma out 15 active outputs RANK 4 NODE 2 --> 18.6463642 sigma out 15 active outputs RANK 5 NODE 10 --> 17.629549 sigma out 15 active outputs RANK 6 NODE 8 --> 14.4290714 sigma out 15 active outputs RANK 7 NODE 7 --> 11.4827776 sigma out 15 active outputs RANK 8 NODE 4 --> 11.3523369 sigma out 15 active outputs RANK 9 NODE 6 --> 10.75665 sigma out 15 active outputs RANK 10 NODE 5 --> 8.4324379 sigma out 15 active outputs RANK 11 NODE 11 --> 7.91063499 sigma out 15 active outputs RANK 12 NODE 3 --> 7.39890909 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 31.2872143 sigma in 12act. ( 23.1730518 sig out 1act.) RANK 2 NODE 3 --> 29.6705666 sigma in 12act. ( 27.4794483 sig out 1act.) RANK 3 NODE 9 --> 21.4753151 sigma in 12act. ( 16.3745651 sig out 1act.) RANK 4 NODE 12 --> 21.2496624 sigma in 12act. ( 15.0919695 sig out 1act.) RANK 5 NODE 10 --> 18.368433 sigma in 12act. ( 12.3118505 sig out 1act.) RANK 6 NODE 8 --> 18.3137264 sigma in 12act. ( 17.3334217 sig out 1act.) RANK 7 NODE 4 --> 16.3154392 sigma in 12act. ( 10.9714108 sig out 1act.) RANK 8 NODE 13 --> 10.9787951 sigma in 12act. ( 8.3102951 sig out 1act.) RANK 9 NODE 15 --> 10.7029009 sigma in 12act. ( 9.36219978 sig out 1act.) RANK 10 NODE 11 --> 10.6213646 sigma in 12act. ( 10.9587431 sig out 1act.) RANK 11 NODE 6 --> 9.22025108 sigma in 12act. ( 6.8710947 sig out 1act.) RANK 12 NODE 5 --> 8.0396595 sigma in 12act. ( 7.53978109 sig out 1act.) RANK 13 NODE 2 --> 7.71717644 sigma in 12act. ( 6.35846996 sig out 1act.) RANK 14 NODE 7 --> 5.17141056 sigma in 12act. ( 3.2279489 sig out 1act.) RANK 15 NODE 1 --> 4.62081861 sigma in 12act. ( 2.7040565 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 27.4794483 sigma out 1act.( 29.6705666 sig in 12act.) RANK 2 NODE 14 --> 23.1730518 sigma out 1act.( 31.2872143 sig in 12act.) RANK 3 NODE 8 --> 17.3334217 sigma out 1act.( 18.3137264 sig in 12act.) RANK 4 NODE 9 --> 16.3745651 sigma out 1act.( 21.4753151 sig in 12act.) RANK 5 NODE 12 --> 15.0919695 sigma out 1act.( 21.2496624 sig in 12act.) RANK 6 NODE 10 --> 12.3118505 sigma out 1act.( 18.368433 sig in 12act.) RANK 7 NODE 4 --> 10.9714108 sigma out 1act.( 16.3154392 sig in 12act.) RANK 8 NODE 11 --> 10.9587431 sigma out 1act.( 10.6213646 sig in 12act.) RANK 9 NODE 15 --> 9.36219978 sigma out 1act.( 10.7029009 sig in 12act.) RANK 10 NODE 13 --> 8.3102951 sigma out 1act.( 10.9787951 sig in 12act.) RANK 11 NODE 5 --> 7.53978109 sigma out 1act.( 8.0396595 sig in 12act.) RANK 12 NODE 6 --> 6.8710947 sigma out 1act.( 9.22025108 sig in 12act.) RANK 13 NODE 2 --> 6.35846996 sigma out 1act.( 7.71717644 sig in 12act.) RANK 14 NODE 7 --> 3.2279489 sigma out 1act.( 5.17141056 sig in 12act.) RANK 15 NODE 1 --> 2.7040565 sigma out 1act.( 4.62081861 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.9096718 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.614766598 *** contribution from regularisation: 0.00276708743 *** contribution from error: -0.617533684 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done