NNInput NNInputs_175.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 192884 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 45949 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 45949 Chosen entries: 45949 Signal fraction: 1 Background fraction: 0.312717 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 45949 Entries to split: 45949 Test with : 22974 Train with : 22974 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 45949 for Signal Prepared event 0 for Signal with 45949 events ====Entry 0 Variable Ht : 241.352 Variable LepAPt : 26.6709 Variable LepBPt : 20.757 Variable MetSigLeptonsJets : 8.7004 Variable MetSpec : 102.516 Variable SumEtLeptonsJets : 138.836 Variable VSumJetLeptonsPt : 95.4385 Variable addEt : 149.944 Variable dPhiLepSumMet : 1.91756 Variable dPhiLeptons : 0.237715 Variable dRLeptons : 0.435475 Variable lep1_E : 34.2866 Variable lep2_E : 22.2255 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2175 Ht = 241.352 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 26.6709 LepAPt = 26.6709 LepBEt = 20.7574 LepBPt = 20.757 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 102.516 MetDelPhi = 1.78381 MetSig = 7.13205 MetSigLeptonsJets = 8.7004 MetSpec = 102.516 Mjj = 0 MostCentralJetEta = 1.70124 MtllMet = 156.27 Njets = 1 SB = 0 SumEt = 206.61 SumEtJets = 0 SumEtLeptonsJets = 138.836 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 95.4385 addEt = 149.944 dPhiLepSumMet = 1.91756 dPhiLeptons = 0.237715 dRLeptons = 0.435475 diltype = 54 dimass = 10.2815 event = 116 jet1_Et = 91.408 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.2866 lep2_E = 22.2255 rand = 0.999742 run = 236503 weight = 2.5946e-06 ===Show End Prepared event 10000 for Signal with 45949 events Prepared event 20000 for Signal with 45949 events Prepared event 30000 for Signal with 45949 events Prepared event 40000 for Signal with 45949 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.241849 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4500 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 192884 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4500 negative weights. Signal fraction: 62.7624588 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.3116226 62.7094803 64.6795807 66.392868 67.78685 68.8273926 69.9937134 70.7339172 71.5709229 72.5615692 73.416954 74.0368195 74.5998688 75.3804474 75.8928375 76.7188568 77.3549347 78.0359192 78.6128998 79.2028198 79.7734375 80.4912567 81.1888199 81.998703 82.7719574 83.6274414 84.6574173 85.5456085 86.6407318 87.925415 89.028595 90.4564972 91.966568 93.7315063 95.421814 97.3048096 99.0521698 100.572128 102.125351 103.934372 105.835014 107.438652 109.268173 111.18605 112.981232 114.594528 116.306488 118.305878 120.131866 121.86203 123.707787 125.341423 127.228561 128.875031 130.591797 132.212631 133.752182 135.423065 137.117386 138.637634 140.178558 141.857117 143.274902 144.835709 146.341461 148.00676 149.480621 150.989746 152.50296 154.078491 155.647751 157.279617 158.850739 160.564423 162.369293 164.263168 165.900879 167.875458 169.981537 171.975372 174.367188 176.665527 179.030945 181.629456 184.31665 187.253616 190.332764 194.025803 197.862061 201.559235 205.991394 210.754303 216.259872 222.504883 229.814392 238.518646 249.117157 262.875061 284.214508 320.15564 824.779175 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3793373 20.6718102 20.9438915 21.2468014 21.5032864 21.8032417 22.0203171 22.2382736 22.4512577 22.688139 22.9217644 23.1219215 23.3455772 23.5911465 23.781889 23.9741974 24.203476 24.4343185 24.6296768 24.8599663 25.1065769 25.3192291 25.5056286 25.6883278 25.9005623 26.1591873 26.3398762 26.5823135 26.8040848 27.0377235 27.2473602 27.5123653 27.7806587 27.9833107 28.2015381 28.462822 28.6977463 29.0023003 29.2739868 29.5896721 29.8191433 30.116436 30.4152889 30.6644135 30.9894867 31.3504715 31.6739807 31.9682579 32.3062668 32.6547165 32.9495811 33.266468 33.6172409 33.9478302 34.3104019 34.6353989 35.0122147 35.3516617 35.6989403 36.0604095 36.4515877 36.8458328 37.2559052 37.6200104 38.0609055 38.4803658 38.8770905 39.2820816 39.7095032 40.0898743 40.5098114 40.947525 41.4013519 41.8622551 42.3585243 42.8521881 43.4074173 43.9339638 44.4575043 45.0259933 45.6388702 46.2077751 46.8193283 47.5319633 48.1719704 48.8748932 49.6412582 50.4149551 51.2730522 52.2519379 53.2060738 54.3164291 55.5133209 56.8108139 58.4048805 60.3387756 62.6207924 66.2907562 73.6396637 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1231632 10.2443819 10.3762302 10.487524 10.5966835 10.7235947 10.8554878 10.9888735 11.1208267 11.2439251 11.3686228 11.4878359 11.6268015 11.7781477 11.9389296 12.1045122 12.2558355 12.4002495 12.5654297 12.7400513 12.8787613 13.0500135 13.2143097 13.4081411 13.5712442 13.7456512 13.917387 14.1078873 14.3209858 14.509903 14.7153111 14.9232635 15.1379032 15.366869 15.5445843 15.7626839 15.952467 16.1923218 16.4518013 16.687149 16.9367218 17.2053375 17.4456215 17.7315674 18.004303 18.2646503 18.5196266 18.8098373 19.1021347 19.3925476 19.7164688 20.0293846 20.2718544 20.5222015 20.7890377 21.0900459 21.3375092 21.6020088 21.849762 22.1256905 22.4461937 22.7250919 23.0162449 23.3060951 23.5905914 23.8976574 24.1953716 24.4959259 24.8149242 25.1129112 25.3928261 25.7033234 26.0161324 26.3279381 26.6361504 26.9635582 27.2763577 27.593235 27.9018803 28.2518425 28.6001663 28.9694176 29.3878822 29.7570648 30.1673508 30.569746 31.0141602 31.4802284 31.9600468 32.499588 33.0820732 33.7876091 34.4412842 35.1993637 36.0853653 37.3140526 38.7314148 41.1328964 44.8987808 72.2292328 ------------------------------ Transdef: Tab for variable 5 1.00477731 2.62609911 3.07045507 3.33159685 3.61771154 3.82003498 3.99605775 4.14091969 4.27405405 4.39606857 4.51946831 4.62487602 4.73061275 4.83105659 4.9285984 5.01110315 5.07786083 5.15384054 5.21639061 5.28606701 5.33428288 5.39207792 5.44120359 5.49180889 5.53860474 5.59221554 5.64251995 5.69245815 5.74664783 5.7894721 5.83721256 5.88798714 5.93643522 5.98210621 6.02453232 6.07589436 6.11823606 6.16439533 6.2089262 6.25648975 6.29590702 6.3397851 6.38979197 6.43752861 6.48845863 6.53445148 6.58848333 6.63795233 6.68677998 6.73615789 6.78529835 6.83455038 6.88020515 6.93423271 6.98287296 7.03782558 7.08346653 7.14214849 7.19290447 7.25196648 7.30613852 7.36598682 7.41651154 7.47521591 7.53540564 7.59876823 7.65963364 7.7203536 7.77576923 7.84083557 7.90356541 7.96739769 8.02770233 8.08606911 8.15477753 8.22200012 8.28604603 8.35208797 8.42106247 8.48436069 8.5535593 8.62457466 8.69651031 8.77177906 8.84374809 8.92398643 8.99612045 9.08983612 9.18367004 9.27894974 9.37320042 9.48109627 9.59281063 9.73198223 9.89689827 10.0732946 10.2915764 10.5989265 11.0342045 11.7903662 18.7658558 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.1813297 24.8878059 26.0343132 27.1091347 27.9674492 28.8825397 29.613472 30.3760414 30.962883 31.4717636 32.0343933 32.6023636 33.1802063 33.6567001 34.0787277 34.5612946 34.9558029 35.3848724 35.7896805 36.2001419 36.4873772 36.8844872 37.2333832 37.5722847 37.9216537 38.2455673 38.667778 39.0973969 39.4434738 39.815506 40.2503242 40.6496124 41.0915527 41.5196304 41.9571991 42.4226532 42.872345 43.3277779 43.8542213 44.345993 44.9084473 45.6569672 46.2869492 46.9410934 47.6810951 48.3118591 49.0861511 49.7508888 50.4225769 51.1890945 52.0975304 52.9746094 53.868576 54.6696701 55.4569626 56.2795219 57.0759811 57.9248009 58.7015762 59.5341034 60.3037872 61.159668 62.0905533 62.9632454 63.8226891 64.665741 65.5350647 66.3275299 67.1480255 68.0755615 68.8815918 69.722496 70.6221466 71.4771271 72.3345184 73.1238708 73.9608612 74.8114471 75.7090302 76.529213 77.3608246 78.2335052 79.1684647 80.1758041 81.2052765 82.3925018 83.5269852 84.7068481 86.1116486 87.6768036 89.3282623 91.3327637 93.6132812 96.4347687 99.6471252 103.610825 109.05072 116.420509 128.35202 252.491089 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.5810852 33.5118942 34.1026192 34.7711868 35.3335304 35.834938 36.2186661 36.6087532 37.0532379 37.4679947 37.7588234 38.1221886 38.3796196 38.6779175 38.9844894 39.2740517 39.5511856 39.8530731 40.2226868 40.5619278 40.8732681 41.2120819 41.5223236 41.9245796 42.3702278 42.8808975 43.495945 44.2291565 44.8804321 45.453476 46.3154106 47.2972107 48.295166 49.3582535 50.5451965 51.5041656 52.6103821 53.6414032 54.7751999 55.7915764 56.8961906 57.7926941 58.7966423 59.8572731 60.8756485 61.8066635 62.7486725 63.6155472 64.653717 65.5313797 66.3629456 67.3299789 68.191925 69.1538239 70.1125031 70.9967346 71.8978271 72.7167206 73.474823 74.3199768 75.1398468 75.9465332 76.8165283 77.7622986 78.7890778 79.8492508 80.9533997 82.0765228 83.02771 84.2937012 85.5287476 86.8407745 88.3046799 89.8070221 91.3673401 92.9271698 94.491478 96.3714142 98.2726669 100.246231 101.998398 104.17569 106.414078 108.675232 111.117401 113.725769 116.490662 119.477417 122.812546 126.325058 130.297302 135.218491 140.729111 146.633713 153.540405 162.464203 173.848511 190.144287 217.971741 533.700562 ------------------------------ Transdef: Tab for variable 8 2.05942559 24.0156021 28.8020363 30.7295933 31.7388458 32.5302658 33.0293694 33.5265884 33.9843102 34.5250435 34.9597397 35.3098755 35.6942749 36.0406303 36.3669624 36.6572723 37.0048218 37.2979584 37.5308456 37.7694931 38.0256348 38.2993851 38.5838852 38.8522911 39.109581 39.4324226 39.7551041 40.0213776 40.3119125 40.5557442 40.8425446 41.2136269 41.5442429 41.9490356 42.3775177 42.8893509 43.4207764 43.8853989 44.3953323 44.9553986 45.584465 46.2702484 46.9387894 47.6425819 48.4266663 49.0437202 49.7133026 50.4691696 51.1941833 51.9974747 52.7167435 53.5045662 54.3159561 55.0763931 55.8360291 56.6141815 57.3774185 58.1806717 58.9441414 59.7609825 60.5336952 61.274807 62.0288773 62.8472748 63.5817719 64.3268967 65.0594864 65.7164001 66.388916 67.1524353 67.9459534 68.6940765 69.3860092 70.133194 70.9111328 71.6514587 72.3251495 73.0892944 73.8682785 74.6895142 75.4685135 76.2838287 77.1932144 78.110733 78.9554138 80.0688477 81.0228348 82.1709518 83.3682098 84.6352921 86.273819 87.9634094 89.9325409 92.1004639 94.7454987 98.5538483 102.948578 108.297653 116.149223 129.808929 374.426086 ------------------------------ Transdef: Tab for variable 9 47.3116226 62.1601143 64.074501 65.7785645 66.994873 68.1424179 69.0063705 69.9633789 70.7071991 71.4296875 72.2386169 73.0472488 73.6633911 74.1934586 74.8214417 75.4688873 75.8913345 76.6405411 77.1301575 77.7824783 78.3411407 78.8592224 79.3453369 79.8187256 80.4912567 81.1408081 81.7666779 82.4871979 83.1172943 83.7734604 84.7064209 85.3579712 86.1930695 87.0523224 88.0541 88.951767 90.0953522 91.3132782 92.3555603 93.8669586 95.3514099 96.753418 98.3898621 99.7291794 101.322006 102.560974 104.146103 105.795364 107.294571 108.91124 110.296165 111.827713 113.382698 114.813393 116.141258 117.513298 118.931915 120.368279 121.781342 123.250488 124.654343 126.034866 127.426147 128.73819 130.108261 131.472443 132.829773 134.18808 135.589874 136.702118 137.970001 139.254471 140.417206 141.610138 142.870758 144.092163 145.332901 146.518768 147.752777 148.971497 150.100845 151.303223 152.516266 153.776794 154.963303 156.268311 157.512085 158.826218 160.337463 161.88678 163.558685 165.108276 166.797699 168.791 170.928955 173.502548 176.790787 181.176025 187.925095 204.387665 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0517990664 1.11877942 1.42174244 1.63361907 1.79152179 1.90872431 2.00852442 2.08869743 2.1668272 2.22767591 2.28504181 2.33024883 2.37335157 2.4154048 2.44804049 2.48151326 2.51491785 2.54254723 2.56807494 2.59652615 2.61747503 2.64108896 2.6650629 2.68523479 2.7045455 2.72239399 2.74213147 2.76024294 2.77512074 2.78858876 2.80323219 2.8175323 2.82875299 2.84154558 2.85229254 2.86175799 2.87185216 2.88113427 2.89051509 2.89910126 2.90815973 2.91505671 2.92283869 2.93053961 2.9373107 2.94375634 2.95089006 2.95804834 2.96409178 2.97043085 2.97687626 2.98210573 2.987113 2.99204683 2.99691391 3.00186682 3.00693631 3.01149535 3.01580024 3.02040911 3.02486873 3.02859068 3.03301334 3.03723621 3.0411799 3.04488087 3.04842424 3.05192947 3.05556297 3.05898142 3.06195068 3.06537819 3.06884241 3.07204056 3.07507372 3.07772255 3.08093143 3.0837903 3.08668852 3.08937073 3.092206 3.09496975 3.09725428 3.10000825 3.10238028 3.10510445 3.10747004 3.10995388 3.11293077 3.11537933 3.11763859 3.11991405 3.12239146 3.12524462 3.12776041 3.12991691 3.13185859 3.13390112 3.13640833 3.13891578 3.1415906 ------------------------------ Transdef: Tab for variable 11 7.9870224E-06 0.00646649953 0.0124394298 0.0191805214 0.0246602893 0.0314929113 0.038618654 0.0457826853 0.0526632071 0.0593867898 0.0665695667 0.0736507177 0.0805596709 0.0875930786 0.0941514671 0.100699812 0.106523454 0.113110185 0.119803645 0.126704931 0.133291662 0.140355587 0.146705687 0.15308857 0.15918678 0.165665448 0.171787649 0.17735675 0.182700157 0.188382834 0.193817139 0.198589683 0.203783631 0.208457351 0.213264763 0.217635214 0.222910866 0.227584094 0.231213808 0.2352916 0.240100801 0.245268106 0.250538588 0.255333543 0.259790301 0.264671326 0.269450665 0.273893684 0.278370857 0.283085972 0.287925303 0.293018103 0.298299313 0.302914143 0.307792425 0.313270062 0.318733692 0.324086726 0.330538988 0.335202336 0.340570986 0.345961809 0.351243228 0.357145548 0.363344908 0.369460613 0.376125574 0.382534027 0.388177037 0.39458406 0.399985909 0.40625596 0.41314292 0.420171082 0.427191138 0.434876561 0.441082001 0.447411299 0.455869913 0.463600278 0.471908212 0.480020523 0.489161491 0.499869496 0.509244442 0.519120455 0.528952837 0.539334893 0.550280452 0.56309557 0.577818036 0.592311203 0.607727528 0.626676023 0.645094872 0.665460408 0.695023656 0.720139742 0.765881896 0.836735487 1.13430727 ------------------------------ Transdef: Tab for variable 12 0.200005457 0.20763813 0.214133754 0.220640555 0.227389097 0.233173594 0.238780856 0.24420768 0.250092775 0.256038696 0.261621743 0.267597884 0.272349536 0.277709424 0.283168495 0.288761616 0.294013083 0.299258381 0.304320693 0.308563888 0.313236952 0.318991721 0.32376647 0.328804731 0.333784759 0.339376986 0.344427943 0.348455966 0.353317201 0.358651876 0.363402009 0.368914634 0.373639286 0.377975166 0.383552015 0.388586402 0.39347288 0.398042053 0.401819229 0.405834675 0.410152107 0.413655639 0.417388141 0.421323299 0.424886882 0.428349316 0.432190686 0.436515391 0.439929664 0.444406539 0.448420763 0.452566862 0.456833422 0.461243868 0.466050833 0.47050041 0.474525005 0.47900337 0.483506829 0.487496495 0.49148035 0.496158928 0.500605226 0.505570531 0.510518432 0.515820444 0.520903349 0.526138425 0.531945586 0.537577093 0.543078244 0.549246788 0.555622458 0.561707139 0.567594767 0.574900687 0.581205249 0.588199675 0.595769465 0.603425741 0.61100924 0.618622303 0.627292097 0.634848118 0.644917488 0.65324235 0.663615704 0.67326045 0.684037507 0.697402775 0.710516453 0.721588969 0.735881925 0.74976933 0.763097644 0.780215442 0.800121546 0.828758001 0.857703567 0.909680605 1.14129901 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.5197449 22.3578625 22.9521694 23.6171608 24.2142963 24.7651329 25.22155 25.7061958 26.0882587 26.5028152 27.0186939 27.3944664 27.7970695 28.1295433 28.5634747 28.9715519 29.3374252 29.7336178 30.0611916 30.4503059 30.7643452 31.0421944 31.4297943 31.8018951 32.1754951 32.5157928 32.9357071 33.2802277 33.6797829 34.0615997 34.4467163 34.8134842 35.1857719 35.5406723 35.903183 36.2475433 36.6584244 37.0356178 37.4246864 37.8217621 38.2062073 38.6057816 38.9870911 39.4294205 39.886116 40.2967606 40.6976166 41.1596909 41.5946732 42.0396576 42.4958534 42.896431 43.3501358 43.7744827 44.2537842 44.7127228 45.2299805 45.6965446 46.1971664 46.7015495 47.1582489 47.6566162 48.1151505 48.5852432 49.0841713 49.6018028 50.1609612 50.7288284 51.3295822 51.9174423 52.4750862 53.0524292 53.6649323 54.3323364 55.1287422 55.8311234 56.546257 57.231823 58.0149994 58.747818 59.646801 60.4296417 61.3863449 62.2941284 63.3564606 64.5008392 65.8219452 66.9765167 68.2128143 69.7519226 71.2325821 73.2593689 75.4872055 77.4884338 80.1948395 82.9963379 87.4980927 92.8165283 102.964584 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6560583 11.0891609 11.3968935 11.7326689 12.1647549 12.4467335 12.7938976 13.0454865 13.4005108 13.697319 13.9631748 14.3069353 14.5681763 14.9250793 15.234417 15.5542412 15.853838 16.149601 16.4428635 16.758709 17.0092926 17.317646 17.6314011 17.8729019 18.16119 18.4282837 18.7521095 19.0541954 19.2994041 19.6425858 19.9660835 20.2908764 20.5890999 20.8786316 21.197197 21.5428772 21.8231297 22.1152668 22.4167747 22.7372627 23.0595875 23.3688736 23.6447868 23.9165382 24.2144508 24.5059109 24.8198967 25.0690422 25.401062 25.6656532 25.9255829 26.23806 26.5268936 26.816473 27.0998497 27.3902912 27.6646919 27.9567127 28.1764584 28.4606628 28.7933083 29.1028709 29.4093704 29.7028236 30.044939 30.3676872 30.6780167 31.0200157 31.3420258 31.6856651 32.0414047 32.3935585 32.78685 33.1817703 33.5377045 33.9130707 34.3363647 34.7229843 35.1532211 35.6128769 36.1034126 36.5998116 37.2127533 37.708252 38.3145638 38.9752502 39.6106491 40.3661919 41.1832733 42.0113754 42.9758453 44.1196899 45.2479477 46.7088585 48.2659302 50.3660011 53.0154953 56.6618309 63.1792145 114.033585 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.3 54.8 56.6 34.4 52.3 65.6 58.8 67.0 -24.9 -18.1 -34.7 21.0 30.6 2 68.3 100.0 69.3 62.9 40.4 71.0 94.6 77.2 92.1 -42.2 -24.1 -44.5 36.6 38.2 3 54.8 69.3 100.0 51.2 17.1 40.1 71.6 58.2 75.1 -14.4 -26.1 -50.3 65.7 30.8 4 56.6 62.9 51.2 100.0 20.9 40.3 63.5 55.0 68.2 -11.8 -28.8 -54.9 26.1 73.3 5 34.4 40.4 17.1 20.9 100.0 85.5 13.5 61.5 61.0 23.3 -8.3 -12.5 2.0 9.4 6 52.3 71.0 40.1 40.3 85.5 100.0 50.4 81.0 81.3 -5.6 -15.2 -26.7 16.5 22.4 7 65.6 94.6 71.6 63.5 13.5 50.4 100.0 68.3 80.9 -51.1 -23.3 -44.6 40.4 40.0 8 58.8 77.2 58.2 55.0 61.5 81.0 68.3 100.0 85.0 -9.3 -22.8 -39.3 30.1 34.1 9 67.0 92.1 75.1 68.2 61.0 81.3 80.9 85.0 100.0 -18.0 -26.5 -49.2 41.5 43.0 10 -24.9 -42.2 -14.4 -11.8 23.3 -5.6 -51.1 -9.3 -18.0 100.0 3.4 7.4 -5.1 -5.2 11 -18.1 -24.1 -26.1 -28.8 -8.3 -15.2 -23.3 -22.8 -26.5 3.4 100.0 54.8 -9.2 -16.1 12 -34.7 -44.5 -50.3 -54.9 -12.5 -26.7 -44.6 -39.3 -49.2 7.4 54.8 100.0 -21.8 -29.5 13 21.0 36.6 65.7 26.1 2.0 16.5 40.4 30.1 41.5 -5.1 -9.2 -21.8 100.0 51.3 14 30.6 38.2 30.8 73.3 9.4 22.4 40.0 34.1 43.0 -5.2 -16.1 -29.5 51.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.829061 TOTAL CORRELATION OF ALL VARIABLES 74.857281 ROUND 1: MAX CORR ( 74.8535286) AFTER KILLING INPUT VARIABLE 11 CONTR 0.749516919 ROUND 2: MAX CORR ( 74.8485834) AFTER KILLING INPUT VARIABLE 6 CONTR 0.8604103 ROUND 3: MAX CORR ( 74.8462471) AFTER KILLING INPUT VARIABLE 8 CONTR 0.59138613 ROUND 4: MAX CORR ( 74.8346655) AFTER KILLING INPUT VARIABLE 2 CONTR 1.31663994 ROUND 5: MAX CORR ( 74.8177474) AFTER KILLING INPUT VARIABLE 14 CONTR 1.59117522 ROUND 6: MAX CORR ( 74.6740666) AFTER KILLING INPUT VARIABLE 12 CONTR 4.63455436 ROUND 7: MAX CORR ( 74.4412682) AFTER KILLING INPUT VARIABLE 10 CONTR 5.89184315 ROUND 8: MAX CORR ( 73.6378227) AFTER KILLING INPUT VARIABLE 13 CONTR 10.9074967 ROUND 9: MAX CORR ( 72.5008984) AFTER KILLING INPUT VARIABLE 9 CONTR 12.8898665 ROUND 10: MAX CORR ( 72.151956) AFTER KILLING INPUT VARIABLE 3 CONTR 7.10461222 ROUND 11: MAX CORR ( 70.4746335) AFTER KILLING INPUT VARIABLE 4 CONTR 15.4670875 ROUND 12: MAX CORR ( 65.5866009) AFTER KILLING INPUT VARIABLE 5 CONTR 25.7889849 LAST REMAINING VARIABLE: 7 total correlation to target: 74.857281 % total significance: 143.611783 sigma correlations of single variables to target: variable 2: 68.3329726 % , in sigma: 131.095064 variable 3: 54.8072608 % , in sigma: 105.146331 variable 4: 56.6181486 % , in sigma: 108.620473 variable 5: 34.3956418 % , in sigma: 65.9871608 variable 6: 52.2826751 % , in sigma: 100.302978 variable 7: 65.5866009 % , in sigma: 125.82622 variable 8: 58.799475 % , in sigma: 112.805292 variable 9: 66.9651435 % , in sigma: 128.470918 variable 10: -24.8519772 % , in sigma: 47.6778839 variable 11: -18.088225 % , in sigma: 34.701798 variable 12: -34.7370317 % , in sigma: 66.6421085 variable 13: 21.0158836 % , in sigma: 40.3184362 variable 14: 30.5511399 % , in sigma: 58.611582 variables sorted by significance: 1 most relevant variable 7 corr 65.5866013 , in sigma: 125.82622 2 most relevant variable 5 corr 25.7889843 , in sigma: 49.475508 3 most relevant variable 4 corr 15.4670877 , in sigma: 29.673213 4 most relevant variable 3 corr 7.10461235 , in sigma: 13.6300174 5 most relevant variable 9 corr 12.8898668 , in sigma: 24.7288805 6 most relevant variable 13 corr 10.9074965 , in sigma: 20.9257535 7 most relevant variable 10 corr 5.89184332 , in sigma: 11.303351 8 most relevant variable 12 corr 4.63455439 , in sigma: 8.89127428 9 most relevant variable 14 corr 1.5911752 , in sigma: 3.052629 10 most relevant variable 2 corr 1.3166399 , in sigma: 2.52594004 11 most relevant variable 8 corr 0.591386139 , in sigma: 1.13455921 12 most relevant variable 6 corr 0.860410273 , in sigma: 1.65067514 13 most relevant variable 11 corr 0.749516904 , in sigma: 1.43792905 global correlations between input variables: variable 2: 99.2244512 % variable 3: 93.0404088 % variable 4: 92.1801251 % variable 5: 95.5461294 % variable 6: 95.2328022 % variable 7: 98.8708091 % variable 8: 90.5367187 % variable 9: 98.7313251 % variable 10: 71.634305 % variable 11: 55.2941416 % variable 12: 72.3987264 % variable 13: 86.0613808 % variable 14: 88.7796666 % significance loss when removing single variables: variable 2: corr = 1.62284211 % , sigma = 3.11338116 variable 3: corr = 15.635266 % , sigma = 29.9958587 variable 4: corr = 14.2444328 % , sigma = 27.3275808 variable 5: corr = 15.3860047 % , sigma = 29.5176572 variable 6: corr = 0.880771193 % , sigma = 1.68973705 variable 7: corr = 7.68590624 % , sigma = 14.7452149 variable 8: corr = 0.902044058 % , sigma = 1.7305485 variable 9: corr = 10.5407373 % , sigma = 20.2221354 variable 10: corr = 5.62583468 % , sigma = 10.7930202 variable 11: corr = 0.749516919 % , sigma = 1.43792907 variable 12: corr = 3.95156788 % , sigma = 7.5809821 variable 13: corr = 6.69404749 % , sigma = 12.8423592 variable 14: corr = 1.52710452 % , sigma = 2.92971105 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 27.9428787 sigma out 15 active outputs RANK 2 NODE 7 --> 26.6630688 sigma out 15 active outputs RANK 3 NODE 6 --> 25.41646 sigma out 15 active outputs RANK 4 NODE 4 --> 24.5229588 sigma out 15 active outputs RANK 5 NODE 9 --> 24.2026157 sigma out 15 active outputs RANK 6 NODE 2 --> 20.4319878 sigma out 15 active outputs RANK 7 NODE 3 --> 19.1695595 sigma out 15 active outputs RANK 8 NODE 1 --> 17.4389973 sigma out 15 active outputs RANK 9 NODE 5 --> 10.9822121 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 38.3216705 sigma in 9act. ( 40.7033157 sig out 1act.) RANK 2 NODE 10 --> 34.3647804 sigma in 9act. ( 34.8849335 sig out 1act.) RANK 3 NODE 11 --> 23.5483646 sigma in 9act. ( 20.7943516 sig out 1act.) RANK 4 NODE 2 --> 20.7535419 sigma in 9act. ( 18.236845 sig out 1act.) RANK 5 NODE 9 --> 16.603838 sigma in 9act. ( 18.3011131 sig out 1act.) RANK 6 NODE 14 --> 13.8198385 sigma in 9act. ( 12.935833 sig out 1act.) RANK 7 NODE 3 --> 12.271101 sigma in 9act. ( 13.419528 sig out 1act.) RANK 8 NODE 13 --> 10.2010593 sigma in 9act. ( 12.592844 sig out 1act.) RANK 9 NODE 7 --> 7.87673378 sigma in 9act. ( 12.7311249 sig out 1act.) RANK 10 NODE 5 --> 7.83926535 sigma in 9act. ( 7.42021465 sig out 1act.) RANK 11 NODE 8 --> 5.40350294 sigma in 9act. ( 1.72791755 sig out 1act.) RANK 12 NODE 6 --> 3.72793984 sigma in 9act. ( 3.58654046 sig out 1act.) RANK 13 NODE 15 --> 2.65856767 sigma in 9act. ( 3.77086091 sig out 1act.) RANK 14 NODE 1 --> 1.55531883 sigma in 9act. ( 0.171695486 sig out 1act.) RANK 15 NODE 4 --> 1.55171716 sigma in 9act. ( 0.418400168 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 40.7033157 sigma out 1act.( 38.3216705 sig in 9act.) RANK 2 NODE 10 --> 34.8849335 sigma out 1act.( 34.3647804 sig in 9act.) RANK 3 NODE 11 --> 20.7943516 sigma out 1act.( 23.5483646 sig in 9act.) RANK 4 NODE 9 --> 18.3011131 sigma out 1act.( 16.603838 sig in 9act.) RANK 5 NODE 2 --> 18.236845 sigma out 1act.( 20.7535419 sig in 9act.) RANK 6 NODE 3 --> 13.419528 sigma out 1act.( 12.271101 sig in 9act.) RANK 7 NODE 14 --> 12.935833 sigma out 1act.( 13.8198385 sig in 9act.) RANK 8 NODE 7 --> 12.7311249 sigma out 1act.( 7.87673378 sig in 9act.) RANK 9 NODE 13 --> 12.592844 sigma out 1act.( 10.2010593 sig in 9act.) RANK 10 NODE 5 --> 7.42021465 sigma out 1act.( 7.83926535 sig in 9act.) RANK 11 NODE 15 --> 3.77086091 sigma out 1act.( 2.65856767 sig in 9act.) RANK 12 NODE 6 --> 3.58654046 sigma out 1act.( 3.72793984 sig in 9act.) RANK 13 NODE 8 --> 1.72791755 sigma out 1act.( 5.40350294 sig in 9act.) RANK 14 NODE 4 --> 0.418400168 sigma out 1act.( 1.55171716 sig in 9act.) RANK 15 NODE 1 --> 0.171695486 sigma out 1act.( 1.55531883 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 68.7535477 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 25.7761993 sigma out 15 active outputs RANK 2 NODE 7 --> 25.5222092 sigma out 15 active outputs RANK 3 NODE 2 --> 25.3283329 sigma out 15 active outputs RANK 4 NODE 6 --> 24.4629593 sigma out 15 active outputs RANK 5 NODE 4 --> 22.7374306 sigma out 15 active outputs RANK 6 NODE 9 --> 22.2717915 sigma out 15 active outputs RANK 7 NODE 3 --> 18.1069946 sigma out 15 active outputs RANK 8 NODE 1 --> 17.972826 sigma out 15 active outputs RANK 9 NODE 5 --> 10.5598469 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 34.5185776 sigma in 9act. ( 36.592762 sig out 1act.) RANK 2 NODE 10 --> 31.5892029 sigma in 9act. ( 31.9305 sig out 1act.) RANK 3 NODE 11 --> 22.0091629 sigma in 9act. ( 19.3539696 sig out 1act.) RANK 4 NODE 9 --> 16.5250301 sigma in 9act. ( 16.9984875 sig out 1act.) RANK 5 NODE 2 --> 16.2098541 sigma in 9act. ( 15.5911932 sig out 1act.) RANK 6 NODE 7 --> 16.0795975 sigma in 9act. ( 13.9030819 sig out 1act.) RANK 7 NODE 3 --> 13.6856565 sigma in 9act. ( 13.5794125 sig out 1act.) RANK 8 NODE 13 --> 12.4570656 sigma in 9act. ( 12.4518528 sig out 1act.) RANK 9 NODE 14 --> 11.8501196 sigma in 9act. ( 11.4474144 sig out 1act.) RANK 10 NODE 15 --> 10.7182436 sigma in 9act. ( 8.43119049 sig out 1act.) RANK 11 NODE 5 --> 9.17722797 sigma in 9act. ( 6.85835981 sig out 1act.) RANK 12 NODE 4 --> 7.57428455 sigma in 9act. ( 1.11604774 sig out 1act.) RANK 13 NODE 6 --> 7.27791452 sigma in 9act. ( 3.66815543 sig out 1act.) RANK 14 NODE 8 --> 6.85620689 sigma in 9act. ( 0.885083139 sig out 1act.) RANK 15 NODE 1 --> 4.8605051 sigma in 9act. ( 0.0165671166 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 36.592762 sigma out 1act.( 34.5185776 sig in 9act.) RANK 2 NODE 10 --> 31.9305 sigma out 1act.( 31.5892029 sig in 9act.) RANK 3 NODE 11 --> 19.3539696 sigma out 1act.( 22.0091629 sig in 9act.) RANK 4 NODE 9 --> 16.9984875 sigma out 1act.( 16.5250301 sig in 9act.) RANK 5 NODE 2 --> 15.5911932 sigma out 1act.( 16.2098541 sig in 9act.) RANK 6 NODE 7 --> 13.9030819 sigma out 1act.( 16.0795975 sig in 9act.) RANK 7 NODE 3 --> 13.5794125 sigma out 1act.( 13.6856565 sig in 9act.) RANK 8 NODE 13 --> 12.4518528 sigma out 1act.( 12.4570656 sig in 9act.) RANK 9 NODE 14 --> 11.4474144 sigma out 1act.( 11.8501196 sig in 9act.) RANK 10 NODE 15 --> 8.43119049 sigma out 1act.( 10.7182436 sig in 9act.) RANK 11 NODE 5 --> 6.85835981 sigma out 1act.( 9.17722797 sig in 9act.) RANK 12 NODE 6 --> 3.66815543 sigma out 1act.( 7.27791452 sig in 9act.) RANK 13 NODE 4 --> 1.11604774 sigma out 1act.( 7.57428455 sig in 9act.) RANK 14 NODE 8 --> 0.885083139 sigma out 1act.( 6.85620689 sig in 9act.) RANK 15 NODE 1 --> 0.0165671166 sigma out 1act.( 4.8605051 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.7384605 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.443264782 *** contribution from regularisation: 0.00307485717 *** contribution from error: -0.446339637 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.507013619 *** contribution from regularisation: 0.00209552376 *** contribution from error: -0.509109139 *********************************************** -----------------> Test sample ENTER BFGS code START -48907.0505 0.21051237 0.106332295 EXIT FROM BFGS code FG_START 0. 0.21051237 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.546717227 *** contribution from regularisation: 0.00210837717 *** contribution from error: -0.548825622 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -52726.5 0.21051237 159.783249 EXIT FROM BFGS code FG_LNSRCH 0. 0.247531489 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.573416054 *** contribution from regularisation: 0.00257733208 *** contribution from error: -0.575993359 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55301.389 0.247531489 63.5990639 EXIT FROM BFGS code NEW_X -55301.389 0.247531489 63.5990639 ENTER BFGS code NEW_X -55301.389 0.247531489 63.5990639 EXIT FROM BFGS code FG_LNSRCH 0. 0.264640659 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.576011002 *** contribution from regularisation: 0.00256145163 *** contribution from error: -0.578572452 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55551.6531 0.264640659 -1.17910767 EXIT FROM BFGS code NEW_X -55551.6531 0.264640659 -1.17910767 ENTER BFGS code NEW_X -55551.6531 0.264640659 -1.17910767 EXIT FROM BFGS code FG_LNSRCH 0. 0.265316606 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.576423109 *** contribution from regularisation: 0.00248218514 *** contribution from error: -0.578905284 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55591.3962 0.265316606 -13.1354961 EXIT FROM BFGS code NEW_X -55591.3962 0.265316606 -13.1354961 ENTER BFGS code NEW_X -55591.3962 0.265316606 -13.1354961 EXIT FROM BFGS code FG_LNSRCH 0. 0.259803981 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.576592445 *** contribution from regularisation: 0.00243376917 *** contribution from error: -0.579026222 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55607.7269 0.259803981 -11.3087645 EXIT FROM BFGS code NEW_X -55607.7269 0.259803981 -11.3087645 ENTER BFGS code NEW_X -55607.7269 0.259803981 -11.3087645 EXIT FROM BFGS code FG_LNSRCH 0. 0.248520032 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.576763153 *** contribution from regularisation: 0.00240160245 *** contribution from error: -0.579164743 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55624.1896 0.248520032 -8.6911869 EXIT FROM BFGS code NEW_X -55624.1896 0.248520032 -8.6911869 ENTER BFGS code NEW_X -55624.1896 0.248520032 -8.6911869 EXIT FROM BFGS code FG_LNSRCH 0. 0.195607513 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.577370763 *** contribution from regularisation: 0.00221331231 *** contribution from error: -0.579584062 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55682.7927 0.195607513 2.34735942 EXIT FROM BFGS code NEW_X -55682.7927 0.195607513 2.34735942 ENTER BFGS code NEW_X -55682.7927 0.195607513 2.34735942 EXIT FROM BFGS code FG_LNSRCH 0. 0.12142504 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 41.5111656 sigma out 15 active outputs RANK 2 NODE 1 --> 22.8963432 sigma out 15 active outputs RANK 3 NODE 4 --> 20.0676498 sigma out 15 active outputs RANK 4 NODE 6 --> 16.4295731 sigma out 15 active outputs RANK 5 NODE 7 --> 15.3678322 sigma out 15 active outputs RANK 6 NODE 8 --> 14.6246481 sigma out 15 active outputs RANK 7 NODE 9 --> 13.3160677 sigma out 15 active outputs RANK 8 NODE 3 --> 13.1270094 sigma out 15 active outputs RANK 9 NODE 5 --> 11.2706079 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 33.5453186 sigma in 9act. ( 26.4671001 sig out 1act.) RANK 2 NODE 15 --> 31.6382637 sigma in 9act. ( 27.7221966 sig out 1act.) RANK 3 NODE 6 --> 17.3533268 sigma in 9act. ( 18.1915455 sig out 1act.) RANK 4 NODE 12 --> 17.0194359 sigma in 9act. ( 18.7260094 sig out 1act.) RANK 5 NODE 10 --> 16.3156948 sigma in 9act. ( 15.9597397 sig out 1act.) RANK 6 NODE 13 --> 14.9699326 sigma in 9act. ( 10.5154705 sig out 1act.) RANK 7 NODE 4 --> 12.536911 sigma in 9act. ( 12.5792952 sig out 1act.) RANK 8 NODE 3 --> 12.0006781 sigma in 9act. ( 10.4912376 sig out 1act.) RANK 9 NODE 2 --> 9.58076763 sigma in 9act. ( 9.10172462 sig out 1act.) RANK 10 NODE 11 --> 8.74022293 sigma in 9act. ( 7.6448307 sig out 1act.) RANK 11 NODE 5 --> 8.3414278 sigma in 9act. ( 7.30346298 sig out 1act.) RANK 12 NODE 14 --> 7.89337206 sigma in 9act. ( 6.74004269 sig out 1act.) RANK 13 NODE 9 --> 4.20391703 sigma in 9act. ( 2.76918674 sig out 1act.) RANK 14 NODE 8 --> 3.48956847 sigma in 9act. ( 0.822765529 sig out 1act.) RANK 15 NODE 1 --> 2.88066101 sigma in 9act. ( 1.77641892 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 27.7221966 sigma out 1act.( 31.6382637 sig in 9act.) RANK 2 NODE 7 --> 26.4671001 sigma out 1act.( 33.5453186 sig in 9act.) RANK 3 NODE 12 --> 18.7260094 sigma out 1act.( 17.0194359 sig in 9act.) RANK 4 NODE 6 --> 18.1915455 sigma out 1act.( 17.3533268 sig in 9act.) RANK 5 NODE 10 --> 15.9597397 sigma out 1act.( 16.3156948 sig in 9act.) RANK 6 NODE 4 --> 12.5792952 sigma out 1act.( 12.536911 sig in 9act.) RANK 7 NODE 13 --> 10.5154705 sigma out 1act.( 14.9699326 sig in 9act.) RANK 8 NODE 3 --> 10.4912376 sigma out 1act.( 12.0006781 sig in 9act.) RANK 9 NODE 2 --> 9.10172462 sigma out 1act.( 9.58076763 sig in 9act.) RANK 10 NODE 11 --> 7.6448307 sigma out 1act.( 8.74022293 sig in 9act.) RANK 11 NODE 5 --> 7.30346298 sigma out 1act.( 8.3414278 sig in 9act.) RANK 12 NODE 14 --> 6.74004269 sigma out 1act.( 7.89337206 sig in 9act.) RANK 13 NODE 9 --> 2.76918674 sigma out 1act.( 4.20391703 sig in 9act.) RANK 14 NODE 1 --> 1.77641892 sigma out 1act.( 2.88066101 sig in 9act.) RANK 15 NODE 8 --> 0.822765529 sigma out 1act.( 3.48956847 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.0978317 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.577495396 *** contribution from regularisation: 0.00234861067 *** contribution from error: -0.579843998 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -55694.8111 0.12142504 44.4539413 EXIT FROM BFGS code NEW_X -55694.8111 0.12142504 44.4539413 ENTER BFGS code NEW_X -55694.8111 0.12142504 44.4539413 EXIT FROM BFGS code FG_LNSRCH 0. 0.123803906 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.577843845 *** contribution from regularisation: 0.00240177684 *** contribution from error: -0.580245614 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55728.4186 0.123803906 -22.8040028 EXIT FROM BFGS code NEW_X -55728.4186 0.123803906 -22.8040028 ENTER BFGS code NEW_X -55728.4186 0.123803906 -22.8040028 EXIT FROM BFGS code FG_LNSRCH 0. 0.125953928 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.577915311 *** contribution from regularisation: 0.00240045181 *** contribution from error: -0.580315769 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55735.3068 0.125953928 -9.87211895 EXIT FROM BFGS code NEW_X -55735.3068 0.125953928 -9.87211895 ENTER BFGS code NEW_X -55735.3068 0.125953928 -9.87211895 EXIT FROM BFGS code FG_LNSRCH 0. 0.124072783 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.577970743 *** contribution from regularisation: 0.00237813382 *** contribution from error: -0.580348849 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55740.652 0.124072783 -1.15806365 EXIT FROM BFGS code NEW_X -55740.652 0.124072783 -1.15806365 ENTER BFGS code NEW_X -55740.652 0.124072783 -1.15806365 EXIT FROM BFGS code FG_LNSRCH 0. 0.119100012 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.578026712 *** contribution from regularisation: 0.00235001976 *** contribution from error: -0.580376744 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55746.054 0.119100012 7.68792391 EXIT FROM BFGS code NEW_X -55746.054 0.119100012 7.68792391 ENTER BFGS code NEW_X -55746.054 0.119100012 7.68792391 EXIT FROM BFGS code FG_LNSRCH 0. 0.10915295 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.578162134 *** contribution from regularisation: 0.00227623666 *** contribution from error: -0.580438375 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55759.114 0.10915295 19.223341 EXIT FROM BFGS code NEW_X -55759.114 0.10915295 19.223341 ENTER BFGS code NEW_X -55759.114 0.10915295 19.223341 EXIT FROM BFGS code FG_LNSRCH 0. 0.101303495 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.57828033 *** contribution from regularisation: 0.00227273651 *** contribution from error: -0.580553055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55770.5119 0.101303495 9.84902382 EXIT FROM BFGS code NEW_X -55770.5119 0.101303495 9.84902382 ENTER BFGS code NEW_X -55770.5119 0.101303495 9.84902382 EXIT FROM BFGS code FG_LNSRCH 0. 0.0866038203 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.57807833 *** contribution from regularisation: 0.00234228163 *** contribution from error: -0.580420613 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55751.0324 0.0866038203 49.4265518 EXIT FROM BFGS code FG_LNSRCH 0. 0.0971238762 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.578172386 *** contribution from regularisation: 0.00247180555 *** contribution from error: -0.58064419 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55760.0985 0.0971238762 20.1416264 EXIT FROM BFGS code FG_LNSRCH 0. 0.100816086 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.578163981 *** contribution from regularisation: 0.00240494241 *** contribution from error: -0.58056891 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55759.2899 0.100816086 11.1753016 EXIT FROM BFGS code FG_LNSRCH 0. 0.101293519 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 40.6588135 sigma out 15 active outputs RANK 2 NODE 1 --> 22.069622 sigma out 15 active outputs RANK 3 NODE 7 --> 18.2740612 sigma out 15 active outputs RANK 4 NODE 4 --> 16.0790176 sigma out 15 active outputs RANK 5 NODE 6 --> 14.9452248 sigma out 15 active outputs RANK 6 NODE 8 --> 13.9118528 sigma out 15 active outputs RANK 7 NODE 9 --> 13.0307894 sigma out 15 active outputs RANK 8 NODE 5 --> 12.5343447 sigma out 15 active outputs RANK 9 NODE 3 --> 12.1026144 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 34.3667107 sigma in 9act. ( 27.6945667 sig out 1act.) RANK 2 NODE 15 --> 29.6165276 sigma in 9act. ( 28.7446384 sig out 1act.) RANK 3 NODE 6 --> 18.1193771 sigma in 9act. ( 18.6167736 sig out 1act.) RANK 4 NODE 12 --> 16.2711716 sigma in 9act. ( 17.5801506 sig out 1act.) RANK 5 NODE 10 --> 16.0316944 sigma in 9act. ( 15.7203741 sig out 1act.) RANK 6 NODE 4 --> 12.9176426 sigma in 9act. ( 11.8654165 sig out 1act.) RANK 7 NODE 13 --> 11.8320723 sigma in 9act. ( 8.33148479 sig out 1act.) RANK 8 NODE 2 --> 10.2939272 sigma in 9act. ( 10.3001146 sig out 1act.) RANK 9 NODE 3 --> 9.86342907 sigma in 9act. ( 7.61813259 sig out 1act.) RANK 10 NODE 5 --> 8.72497463 sigma in 9act. ( 8.34173584 sig out 1act.) RANK 11 NODE 14 --> 7.27686787 sigma in 9act. ( 6.4582634 sig out 1act.) RANK 12 NODE 11 --> 6.6434865 sigma in 9act. ( 5.30975628 sig out 1act.) RANK 13 NODE 9 --> 4.2017231 sigma in 9act. ( 3.02308822 sig out 1act.) RANK 14 NODE 8 --> 2.83094192 sigma in 9act. ( 0.171329215 sig out 1act.) RANK 15 NODE 1 --> 2.38354993 sigma in 9act. ( 1.38088405 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 28.7446384 sigma out 1act.( 29.6165276 sig in 9act.) RANK 2 NODE 7 --> 27.6945667 sigma out 1act.( 34.3667107 sig in 9act.) RANK 3 NODE 6 --> 18.6167736 sigma out 1act.( 18.1193771 sig in 9act.) RANK 4 NODE 12 --> 17.5801506 sigma out 1act.( 16.2711716 sig in 9act.) RANK 5 NODE 10 --> 15.7203741 sigma out 1act.( 16.0316944 sig in 9act.) RANK 6 NODE 4 --> 11.8654165 sigma out 1act.( 12.9176426 sig in 9act.) RANK 7 NODE 2 --> 10.3001146 sigma out 1act.( 10.2939272 sig in 9act.) RANK 8 NODE 5 --> 8.34173584 sigma out 1act.( 8.72497463 sig in 9act.) RANK 9 NODE 13 --> 8.33148479 sigma out 1act.( 11.8320723 sig in 9act.) RANK 10 NODE 3 --> 7.61813259 sigma out 1act.( 9.86342907 sig in 9act.) RANK 11 NODE 14 --> 6.4582634 sigma out 1act.( 7.27686787 sig in 9act.) RANK 12 NODE 11 --> 5.30975628 sigma out 1act.( 6.6434865 sig in 9act.) RANK 13 NODE 9 --> 3.02308822 sigma out 1act.( 4.2017231 sig in 9act.) RANK 14 NODE 1 --> 1.38088405 sigma out 1act.( 2.38354993 sig in 9act.) RANK 15 NODE 8 --> 0.171329215 sigma out 1act.( 2.83094192 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.962822 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.578168988 *** contribution from regularisation: 0.00238443655 *** contribution from error: -0.580553412 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -55759.7715 0.101293519 10.1010218 EXIT FROM BFGS code FG_LNSRCH 0. 0.101303488 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.578171253 *** contribution from regularisation: 0.00238179159 *** contribution from error: -0.580553055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55759.9944 0.101303488 10.1006985 EXIT FROM BFGS code FG_LNSRCH 0. 0.101303495 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.578167021 *** contribution from regularisation: 0.00238607498 *** contribution from error: -0.580553114 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55759.5813 0.101303495 10.1536541 EXIT FROM BFGS code FG_LNSRCH 0. 0.101303495 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.578189075 *** contribution from regularisation: 0.00236399006 *** contribution from error: -0.580553055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55761.7112 0.101303495 10.1519899 EXIT FROM BFGS code FG_LNSRCH 0. 0.101303495 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.578168213 *** contribution from regularisation: 0.00238485145 *** contribution from error: -0.580553055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55759.6993 0.101303495 10.1706324 EXIT FROM BFGS code NEW_X -55759.6993 0.101303495 10.1706324 ENTER BFGS code NEW_X -55759.6993 0.101303495 10.1706324 EXIT FROM BFGS code CONVERGENC -55759.6993 0.101303495 10.1706324 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 63.2175484 sigma out 15 active outputs RANK 2 NODE 1 --> 35.4070473 sigma out 15 active outputs RANK 3 NODE 7 --> 29.6049023 sigma out 15 active outputs RANK 4 NODE 4 --> 25.2221241 sigma out 15 active outputs RANK 5 NODE 6 --> 23.5879383 sigma out 15 active outputs RANK 6 NODE 8 --> 21.8228817 sigma out 15 active outputs RANK 7 NODE 9 --> 20.7186069 sigma out 15 active outputs RANK 8 NODE 5 --> 19.8756161 sigma out 15 active outputs RANK 9 NODE 3 --> 19.4173069 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 54.5862579 sigma in 9act. ( 45.9073906 sig out 1act.) RANK 2 NODE 15 --> 46.9171562 sigma in 9act. ( 46.9198265 sig out 1act.) RANK 3 NODE 6 --> 28.5446682 sigma in 9act. ( 29.8774357 sig out 1act.) RANK 4 NODE 12 --> 26.108366 sigma in 9act. ( 28.5877686 sig out 1act.) RANK 5 NODE 10 --> 25.3479939 sigma in 9act. ( 25.2871323 sig out 1act.) RANK 6 NODE 4 --> 19.9248867 sigma in 9act. ( 19.1548195 sig out 1act.) RANK 7 NODE 13 --> 18.5657768 sigma in 9act. ( 13.5866995 sig out 1act.) RANK 8 NODE 2 --> 16.1249561 sigma in 9act. ( 16.6860046 sig out 1act.) RANK 9 NODE 3 --> 14.9424124 sigma in 9act. ( 12.2512913 sig out 1act.) RANK 10 NODE 5 --> 13.5178738 sigma in 9act. ( 13.490612 sig out 1act.) RANK 11 NODE 14 --> 11.0266094 sigma in 9act. ( 10.6664772 sig out 1act.) RANK 12 NODE 11 --> 9.73320961 sigma in 9act. ( 8.63519669 sig out 1act.) RANK 13 NODE 9 --> 6.04296923 sigma in 9act. ( 4.8890357 sig out 1act.) RANK 14 NODE 1 --> 2.86735988 sigma in 9act. ( 2.20099092 sig out 1act.) RANK 15 NODE 8 --> 2.84018087 sigma in 9act. ( 0.277357131 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 46.9198265 sigma out 1act.( 46.9171562 sig in 9act.) RANK 2 NODE 7 --> 45.9073906 sigma out 1act.( 54.5862579 sig in 9act.) RANK 3 NODE 6 --> 29.8774357 sigma out 1act.( 28.5446682 sig in 9act.) RANK 4 NODE 12 --> 28.5877686 sigma out 1act.( 26.108366 sig in 9act.) RANK 5 NODE 10 --> 25.2871323 sigma out 1act.( 25.3479939 sig in 9act.) RANK 6 NODE 4 --> 19.1548195 sigma out 1act.( 19.9248867 sig in 9act.) RANK 7 NODE 2 --> 16.6860046 sigma out 1act.( 16.1249561 sig in 9act.) RANK 8 NODE 13 --> 13.5866995 sigma out 1act.( 18.5657768 sig in 9act.) RANK 9 NODE 5 --> 13.490612 sigma out 1act.( 13.5178738 sig in 9act.) RANK 10 NODE 3 --> 12.2512913 sigma out 1act.( 14.9424124 sig in 9act.) RANK 11 NODE 14 --> 10.6664772 sigma out 1act.( 11.0266094 sig in 9act.) RANK 12 NODE 11 --> 8.63519669 sigma out 1act.( 9.73320961 sig in 9act.) RANK 13 NODE 9 --> 4.8890357 sigma out 1act.( 6.04296923 sig in 9act.) RANK 14 NODE 1 --> 2.20099092 sigma out 1act.( 2.86735988 sig in 9act.) RANK 15 NODE 8 --> 0.277357131 sigma out 1act.( 2.84018087 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 89.6521225 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.578169405 *** contribution from regularisation: 0.0023836561 *** contribution from error: -0.580553055 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done