NNInput NNInputs_155.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 187631 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 51295 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 51295 Chosen entries: 51295 Signal fraction: 1 Background fraction: 0.37624 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 51295 Entries to split: 51295 Test with : 25647 Train with : 25647 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 51295 for Signal Prepared event 0 for Signal with 51295 events ====Entry 0 Variable Ht : 266.323 Variable LepAPt : 64.2176 Variable LepBPt : 58.0643 Variable MetSigLeptonsJets : 2.54404 Variable MetSpec : 36.171 Variable SumEtLeptonsJets : 227.916 Variable VSumJetLeptonsPt : 47.3654 Variable addEt : 160.689 Variable dPhiLepSumMet : 2.30851 Variable dPhiLeptons : 0.188909 Variable dRLeptons : 0.230155 Variable lep1_E : 71.5884 Variable lep2_E : 61.5172 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2155 Ht = 266.323 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 64.2176 LepAPt = 64.2176 LepBEt = 58.0643 LepBPt = 58.0643 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 38.4071 MetDelPhi = 1.22788 MetSig = 2.2508 MetSigLeptonsJets = 2.54404 MetSpec = 36.171 Mjj = 0 MostCentralJetEta = 0.570342 MtllMet = 163.453 Njets = 1 SB = 0 SumEt = 291.171 SumEtJets = 0 SumEtLeptonsJets = 227.916 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 47.3654 addEt = 160.689 dPhiLepSumMet = 2.30851 dPhiLeptons = 0.188909 dRLeptons = 0.230155 diltype = 45 dimass = 14.0433 event = 519 jet1_Et = 105.634 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.5884 lep2_E = 61.5172 rand = 0.999742 run = 236753 weight = 3.57235e-06 ===Show End Prepared event 10000 for Signal with 51295 events Prepared event 20000 for Signal with 51295 events Prepared event 30000 for Signal with 51295 events Prepared event 40000 for Signal with 51295 events Prepared event 50000 for Signal with 51295 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.369917 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4349 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 187631 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4349 negative weights. Signal fraction: 62.7042656 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.3752403 65.4466476 67.1784515 68.4564819 69.6098633 70.7962036 71.6171112 72.5623169 73.4305954 74.1218185 74.8130951 75.4943924 76.1549683 76.820755 77.4050598 78.1107635 78.7385254 79.549942 80.2483826 80.8817291 81.5812988 82.4283981 83.1438904 83.9805603 85.0467453 86.1929016 87.291626 88.6275024 89.6532135 91.0947647 92.1154556 93.0346603 94.4342346 95.6846161 97.0560913 98.338295 99.5810394 100.951477 102.225128 103.674484 105.099533 106.719284 108.368195 109.935432 111.353752 112.908173 114.490074 115.972824 117.520218 119.109436 120.677452 122.214157 123.682556 125.117172 126.587257 128.017456 129.476593 130.893829 132.237045 133.667389 135.041779 136.404495 137.869812 139.11615 140.484863 141.753769 142.978622 144.344116 145.677124 146.990845 148.241058 149.700058 151.204422 152.720184 154.385895 156.167664 158.13443 160.138153 162.238617 164.368042 166.851318 169.46286 171.983398 174.664978 177.3564 180.381775 183.675339 186.877655 190.807526 195.113617 199.818726 204.809143 211.062744 217.318909 224.406555 233.895462 247.576981 268.274841 303.505554 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.3702564 20.7589645 21.0739021 21.3127136 21.5687332 21.8203354 22.0729904 22.3067741 22.5156898 22.7096443 22.9011993 23.1087074 23.3367157 23.5470104 23.7760429 24.0145893 24.2693405 24.4822216 24.7071991 24.9038334 25.1100521 25.303896 25.5178318 25.7028923 25.9163857 26.1329651 26.3343868 26.5687008 26.7979488 27.0409012 27.2238712 27.4558697 27.6886044 27.9114437 28.1325951 28.3413334 28.5582676 28.7453232 28.9549904 29.2252312 29.4724121 29.727066 29.9488144 30.2564545 30.4971733 30.7474537 31.035759 31.2958412 31.5217381 31.7526436 31.9649811 32.2113838 32.4802017 32.7386818 33.0385284 33.2920074 33.6015167 33.8408127 34.1383133 34.4339371 34.723587 35.0305061 35.3043976 35.5988998 35.8763123 36.1797905 36.4975281 36.7919769 37.1194916 37.4575386 37.7828979 38.1314163 38.4825668 38.850872 39.206974 39.5847244 39.9839096 40.3746796 40.7254562 41.1405869 41.5651627 42.047493 42.5409164 43.0624695 43.5754585 44.1628685 44.8140869 45.4972534 46.1853943 47.0303726 47.8873596 48.8793068 49.9641876 51.2675018 52.8659554 54.9262848 57.5524292 61.5189133 68.5635834 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1155758 10.2784424 10.4117107 10.5190058 10.6444435 10.7608356 10.8945293 11.0015125 11.1426077 11.2954464 11.4392452 11.5828571 11.7157936 11.8485918 11.9947891 12.1473637 12.2926483 12.4209576 12.5973063 12.7731066 12.9188442 13.0882072 13.2707577 13.4509811 13.6337709 13.7862091 13.9581137 14.1391802 14.3591709 14.5501089 14.7607746 14.9828558 15.1884289 15.3602514 15.5819206 15.7716827 15.9338589 16.1358147 16.3748589 16.5919304 16.829895 17.03825 17.294632 17.5664635 17.8345871 18.0926514 18.3874035 18.6726665 18.9417534 19.1870098 19.451767 19.7244682 20.0307693 20.2402306 20.4961567 20.7503815 21.0240746 21.2540035 21.5425644 21.817421 22.0981636 22.3740959 22.6898479 22.9694939 23.2649002 23.5354233 23.8219528 24.1505508 24.4536934 24.7691536 25.0905533 25.4261742 25.7663956 26.0775242 26.3944206 26.7560081 27.1099415 27.4521236 27.8199444 28.1564445 28.5293369 28.9231262 29.2806892 29.6793175 30.107296 30.5273914 30.9997597 31.4715347 31.9398556 32.4786224 33.0382919 33.6432228 34.3453598 35.1367264 36.023407 37.1102295 38.6079979 41.039505 45.299736 74.11026 ------------------------------ Transdef: Tab for variable 5 1.31977379 2.6872611 3.10887718 3.4073348 3.66988373 3.8950851 4.0667944 4.18322277 4.29988098 4.42217731 4.53268051 4.62622166 4.71512508 4.80553341 4.89690733 4.97225475 5.05964756 5.12548065 5.18006992 5.24635124 5.31443262 5.37810802 5.43959284 5.4909811 5.53722715 5.58175659 5.63396454 5.68368626 5.73298025 5.78304005 5.82882023 5.88443851 5.93368387 5.97562027 6.01867914 6.06516457 6.11415577 6.15882683 6.20571136 6.24796867 6.28239059 6.32560539 6.36920357 6.41604376 6.46429968 6.507236 6.54977512 6.59752941 6.64157486 6.68874741 6.73800707 6.7771225 6.82815027 6.86763096 6.9145813 6.96610546 7.00521421 7.05522728 7.10680294 7.16176319 7.20760918 7.24674511 7.29617214 7.34627438 7.39880037 7.4480505 7.50409079 7.55375147 7.60791874 7.6616416 7.71593094 7.77496052 7.83385134 7.89186192 7.94526196 8.00298691 8.06116676 8.11880493 8.17333508 8.23370171 8.29656124 8.35920334 8.42294312 8.48241043 8.55335808 8.6228714 8.70164299 8.77479553 8.85813713 8.9511261 9.0376091 9.15231133 9.26016617 9.39813519 9.5423727 9.72974586 9.95803261 10.2658215 10.6770687 11.3923912 23.5595493 ------------------------------ Transdef: Tab for variable 6 15.0020647 21.3461456 25.4505882 26.5354977 27.3935547 28.3639259 29.2751141 30.0010738 30.7443314 31.3383789 31.9073296 32.4697495 33.0943718 33.5850754 34.0653725 34.5404968 34.9001083 35.3232193 35.7022934 36.0612411 36.4802475 36.8844872 37.2443619 37.6561165 38.0410461 38.4028053 38.7877159 39.1971588 39.622261 40.0348358 40.351799 40.7636566 41.1220932 41.5587883 42.0561676 42.5204735 42.9860573 43.4259453 43.8409615 44.2431107 44.7594833 45.2859116 45.8532715 46.432869 46.9881134 47.4993744 48.120903 48.6776962 49.2674942 49.9174461 50.4265327 51.0000229 51.8077393 52.5128899 53.2967072 54.0045471 54.5809135 55.2946167 55.9496841 56.6703491 57.3235245 57.989502 58.6937332 59.4113884 60.0909386 60.7747116 61.4858398 62.2131348 62.9591026 63.6510468 64.382782 65.1211243 65.8678741 66.5829773 67.2436829 67.9722824 68.751442 69.471405 70.1552277 70.8622894 71.6322479 72.3672485 73.2236404 73.997757 74.8695984 75.7439499 76.7864838 77.8721619 78.9531555 80.1598663 81.4128113 83.0835876 84.9823608 87.1255798 89.6345825 92.4855804 96.2106018 100.885437 108.080841 120.053513 218.598831 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.7614746 33.7815361 34.5207138 35.0503387 35.530468 36.0384293 36.4695587 36.9838295 37.3366699 37.7676811 38.0463791 38.3779106 38.6886673 38.9804382 39.2843246 39.6260109 39.9657745 40.2230072 40.528717 40.9429092 41.3240509 41.7317276 42.1109047 42.5910187 43.0083427 43.584343 44.2846909 44.8747482 45.446209 46.0045509 46.8144989 47.3876419 48.2460403 49.0204659 49.783226 50.6234131 51.4737549 52.3553391 53.2737427 54.2671585 55.1944084 56.0258179 56.8446884 57.6318054 58.507328 59.2645416 60.0832062 60.9147072 61.6693993 62.5655098 63.2171936 64.0362396 64.8544922 65.6700439 66.5157471 67.2735443 68.1063919 68.8967743 69.7013397 70.4583588 71.306076 72.1560211 72.9841995 73.8067245 74.6217575 75.6182709 76.6699829 77.6542206 78.822113 80.0475693 81.3978271 82.8219452 84.4242706 85.8591766 87.4358063 88.8922577 90.5287247 92.2570648 93.8956909 95.7028198 97.6535721 99.5739365 101.618622 103.736176 106.152618 108.639488 111.498543 114.276443 117.432739 121.230911 124.831665 128.957733 133.827942 139.495514 146.474579 155.50058 167.110306 182.197632 208.611115 474.268951 ------------------------------ Transdef: Tab for variable 8 1.91322863 24.8792572 29.1258965 31.0800209 32.0173187 32.8365402 33.3878555 33.8623505 34.3045731 34.7468491 35.1889877 35.5259438 35.9042969 36.2567711 36.5796356 36.8935394 37.1672783 37.4490891 37.712368 38.0208931 38.2205658 38.5039749 38.7539062 39.0169754 39.2984009 39.5855484 39.8269997 40.1180801 40.4585991 40.8125381 41.2205238 41.5432587 41.9198761 42.3651047 42.7616081 43.2146683 43.6396332 44.0992165 44.5555878 45.0425034 45.4708557 46.0505371 46.6307144 47.1503754 47.7255211 48.2685471 48.806839 49.3472977 50.0439796 50.6158981 51.2669563 51.946846 52.6243706 53.2009926 53.8775101 54.5223351 55.1563835 55.8537445 56.4868584 57.1232948 57.7704773 58.4114609 59.0419312 59.6960907 60.3256264 60.9065895 61.5476532 62.1241531 62.7566147 63.3835716 64.0826416 64.7469635 65.362381 66.0401764 66.7201233 67.3699951 68.066925 68.7150726 69.376564 70.0354691 70.8009262 71.5529785 72.354126 73.184288 73.9924927 74.8846588 75.8325043 76.7897568 77.9155884 79.0009308 80.5571136 82.088829 83.9538727 86.3536224 88.9732513 91.9875793 95.990654 101.006256 108.778656 121.410858 326.868286 ------------------------------ Transdef: Tab for variable 9 49.4992676 62.8621902 64.9005051 66.4608383 67.6486588 68.7967682 69.9390411 70.8416367 71.5293961 72.4209137 73.1877289 73.8343735 74.422699 75.0677643 75.5996704 76.181366 76.7728119 77.2195282 77.8654327 78.3756714 78.9687271 79.6745758 80.1437836 80.7757492 81.3850555 82.0535431 82.5687866 83.3295898 84.0177612 84.8733215 85.7213898 86.6726227 87.7807922 88.7787781 89.6027679 90.5656509 91.6167755 92.4763641 93.2105408 94.4342346 95.4439545 96.5531845 97.7505875 98.8104248 100.045647 101.318283 102.301559 103.485367 104.612167 105.843987 107.167343 108.479828 109.815941 110.96727 112.218658 113.371994 114.609787 115.724648 116.794624 117.996796 119.11705 120.222153 121.371979 122.464676 123.545509 124.681229 125.773041 126.86927 127.970764 129.012604 130.102554 131.246613 132.217712 133.3013 134.38324 135.465454 136.594849 137.672562 138.683167 139.705811 140.681732 141.796204 142.834839 143.932724 145.030609 146.17305 147.361115 148.413452 149.627136 150.876617 152.20018 153.480286 154.949799 156.762421 158.718689 161.23407 164.565979 168.789581 176.516724 191.284271 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00305827498 1.10713625 1.40974021 1.63123178 1.77486026 1.88927281 1.98531044 2.06588459 2.13618565 2.20473576 2.26120138 2.31314969 2.36115313 2.40329123 2.44043636 2.47375154 2.50224876 2.53245831 2.55905199 2.5853734 2.61185956 2.63202572 2.65631247 2.67798901 2.69799662 2.71627998 2.73505974 2.75248337 2.7683959 2.78068948 2.7954402 2.80809116 2.82294869 2.83531666 2.84792137 2.85721564 2.86719322 2.87811041 2.88733053 2.8973465 2.90484571 2.91323709 2.91929388 2.92654896 2.93311214 2.94180536 2.94964552 2.95586157 2.96254563 2.9686842 2.97485876 2.98038244 2.98527408 2.98992443 2.99472547 3.00042772 3.00553417 3.01056433 3.0149467 3.01962137 3.02412963 3.0284152 3.03224874 3.03584814 3.03903866 3.04231453 3.04597592 3.04983425 3.05326533 3.05667973 3.05986333 3.0637455 3.06713891 3.07015848 3.07307911 3.07599545 3.07893276 3.08206224 3.08524466 3.08830857 3.09121799 3.09412193 3.09677887 3.09948301 3.10239983 3.10490084 3.10769272 3.10975862 3.11227345 3.11484575 3.11719346 3.11998367 3.12237453 3.12477565 3.1275115 3.12958741 3.13225579 3.1342597 3.13665867 3.13906431 3.1415925 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00596868992 0.0127446651 0.0205846876 0.0276335515 0.0351051576 0.0433524325 0.0512145758 0.0585344955 0.064997673 0.0721719563 0.0792538822 0.0872040465 0.0953365266 0.102335155 0.110157073 0.117505372 0.124676585 0.131934658 0.138944745 0.14607358 0.153756976 0.159784794 0.166268274 0.17289561 0.179465503 0.185505748 0.191450357 0.197444081 0.203398705 0.208433926 0.214032173 0.21932292 0.224642992 0.230349705 0.23576352 0.241042733 0.246140301 0.251990914 0.257419109 0.261839479 0.266055286 0.270893157 0.276758194 0.281333864 0.286547542 0.292185277 0.297002435 0.302608848 0.308660626 0.313792348 0.31984362 0.325676888 0.331112981 0.336049557 0.341621757 0.347450912 0.353661537 0.358700991 0.36458239 0.370576501 0.375880361 0.382084489 0.387999058 0.394023895 0.399825215 0.405322552 0.411295891 0.417026043 0.423173785 0.429358184 0.435623884 0.440508008 0.44675827 0.453052163 0.460209072 0.467435002 0.47521174 0.48181963 0.490637362 0.499611199 0.508997202 0.516919196 0.525500774 0.536441565 0.546305895 0.558011413 0.570156097 0.580352545 0.593010426 0.607236624 0.62323302 0.635217845 0.649605274 0.666110039 0.686252356 0.712229311 0.741461277 0.788176656 0.844810843 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.212312415 0.222976387 0.232707739 0.241701096 0.250218272 0.258334368 0.266299754 0.273941696 0.281576008 0.289190143 0.29579556 0.302812636 0.308861196 0.314705372 0.320591867 0.326992869 0.333052754 0.338911891 0.345142305 0.349874645 0.355532467 0.361048341 0.366567016 0.371556222 0.376603067 0.38177231 0.387452781 0.391960293 0.39699477 0.401498199 0.405491471 0.409645706 0.413362384 0.417385608 0.420776457 0.424706221 0.428193152 0.431789339 0.43539995 0.438977778 0.442932189 0.446762621 0.450620472 0.454612494 0.457879126 0.461171627 0.465409935 0.469292849 0.473267674 0.477254033 0.480967224 0.485033184 0.489410698 0.493634403 0.497849852 0.502710819 0.507614076 0.511732519 0.51559937 0.520272493 0.525176287 0.530298352 0.535496593 0.540436506 0.545810819 0.551677883 0.556752801 0.562457323 0.568002582 0.573109508 0.578804314 0.584989786 0.5905689 0.597669959 0.603425622 0.609787226 0.618256211 0.624696374 0.632279038 0.641156971 0.650382638 0.65832746 0.666159213 0.674057126 0.680174828 0.689373493 0.699827313 0.707982659 0.71734339 0.728018761 0.739625931 0.749649048 0.761385739 0.780248761 0.795577705 0.813536286 0.837992787 0.864722133 0.910258174 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.6600246 22.4947414 23.1254215 23.6505508 24.1973438 24.7484779 25.1838074 25.5526428 26.0103798 26.4884377 26.9371452 27.298624 27.6882915 28.0830269 28.4989967 28.8447227 29.2195358 29.5724182 29.9020615 30.1934509 30.5388355 30.8717098 31.1867962 31.485836 31.8018951 32.1687355 32.458168 32.7118378 33.0665398 33.4049988 33.7566528 34.1008911 34.4389954 34.6923485 34.9854622 35.3062973 35.5881462 35.9210434 36.1620064 36.4718895 36.8497543 37.1788406 37.51754 37.8402214 38.1476059 38.5016747 38.8337708 39.1873169 39.5455093 39.927002 40.304863 40.6789513 41.0255966 41.3151817 41.7422562 42.1351471 42.4974899 42.8782196 43.2199173 43.5856018 44.0163383 44.4692192 44.9407349 45.4163589 45.9087105 46.4060287 46.8369598 47.3132553 47.8257217 48.3602371 48.9234924 49.4610786 50.0610199 50.6976547 51.3140297 52.0241241 52.7319489 53.4085846 54.3284149 55.0973587 55.8428307 56.7952309 57.8116341 58.8238335 59.7879066 60.8647461 62.140995 63.5895081 65.0119095 66.7182312 68.4011536 70.3673782 72.4746399 75.230072 78.0517349 81.7210388 85.9629517 91.7909393 101.514893 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7300863 11.1754055 11.5782156 11.9248257 12.2653303 12.5238209 12.8377705 13.1782684 13.5164337 13.8270664 14.0936966 14.3909998 14.6618767 14.9895878 15.2875137 15.5703611 15.8368378 16.1500092 16.4645653 16.6894112 16.9558125 17.2781429 17.6282692 17.8783569 18.1817055 18.4837761 18.7618446 19.036972 19.3311081 19.6577492 19.9476166 20.2556877 20.5641098 20.8238449 21.1207294 21.4001865 21.6822853 21.950489 22.2127762 22.4888306 22.8213425 23.11866 23.410387 23.6895599 23.994503 24.3005123 24.5713253 24.9050903 25.1787262 25.4762726 25.7315121 25.9945297 26.3039742 26.5994778 26.9409618 27.2486019 27.5348816 27.8387203 28.1325817 28.4162712 28.7422752 29.0576248 29.3374863 29.7106895 30.059803 30.3847065 30.7222519 31.064188 31.3882675 31.7058754 32.0890923 32.4585876 32.8319511 33.2606735 33.6764107 34.1048317 34.5187836 34.9541245 35.3972054 35.8740578 36.3909874 36.9415398 37.53862 38.0903397 38.6973839 39.3617859 40.085247 40.7807617 41.5430069 42.3761368 43.3495636 44.2824554 45.5308685 47.0323029 48.7929459 50.9403076 53.8154144 57.6645203 65.0792694 139.444885 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 64.6 45.8 53.4 27.6 48.0 62.0 53.5 62.5 -25.9 -20.9 -40.1 10.8 27.8 2 64.6 100.0 64.4 61.2 33.6 68.6 94.3 74.2 91.3 -45.0 -27.7 -51.4 28.8 35.7 3 45.8 64.4 100.0 46.1 6.9 32.6 67.9 52.2 70.2 -15.1 -29.4 -56.2 61.9 25.9 4 53.4 61.2 46.1 100.0 16.4 38.4 61.6 53.2 68.1 -11.6 -32.5 -64.1 19.0 72.8 5 27.6 33.6 6.9 16.4 100.0 83.8 5.6 55.7 56.2 24.4 -7.6 -11.6 -6.2 6.2 6 48.0 68.6 32.6 38.4 83.8 100.0 47.1 78.7 80.1 -6.5 -17.0 -30.6 8.3 20.5 7 62.0 94.3 67.9 61.6 5.6 47.1 100.0 65.9 79.4 -53.3 -26.9 -51.8 33.5 37.0 8 53.5 74.2 52.2 53.2 55.7 78.7 65.9 100.0 82.8 -10.1 -26.2 -45.1 23.0 32.3 9 62.5 91.3 70.2 68.1 56.2 80.1 79.4 82.8 100.0 -19.9 -30.5 -57.7 33.4 41.9 10 -25.9 -45.0 -15.1 -11.6 24.4 -6.5 -53.3 -10.1 -19.9 100.0 4.8 9.3 -4.0 -3.9 11 -20.9 -27.7 -29.4 -32.5 -7.6 -17.0 -26.9 -26.2 -30.5 4.8 100.0 55.4 -13.2 -23.3 12 -40.1 -51.4 -56.2 -64.1 -11.6 -30.6 -51.8 -45.1 -57.7 9.3 55.4 100.0 -27.1 -40.6 13 10.8 28.8 61.9 19.0 -6.2 8.3 33.5 23.0 33.4 -4.0 -13.2 -27.1 100.0 46.6 14 27.8 35.7 25.9 72.8 6.2 20.5 37.0 32.3 41.9 -3.9 -23.3 -40.6 46.6 100.0 TOTAL CORRELATION TO TARGET (diagonal) 162.473773 TOTAL CORRELATION OF ALL VARIABLES 70.6132718 ROUND 1: MAX CORR ( 70.6132586) AFTER KILLING INPUT VARIABLE 14 CONTR 0.0430881589 ROUND 2: MAX CORR ( 70.6113196) AFTER KILLING INPUT VARIABLE 11 CONTR 0.523298162 ROUND 3: MAX CORR ( 70.6085149) AFTER KILLING INPUT VARIABLE 6 CONTR 0.629350592 ROUND 4: MAX CORR ( 70.601619) AFTER KILLING INPUT VARIABLE 8 CONTR 0.986797689 ROUND 5: MAX CORR ( 70.5829148) AFTER KILLING INPUT VARIABLE 12 CONTR 1.62503723 ROUND 6: MAX CORR ( 70.518311) AFTER KILLING INPUT VARIABLE 2 CONTR 3.01921604 ROUND 7: MAX CORR ( 70.3269055) AFTER KILLING INPUT VARIABLE 10 CONTR 5.19216292 ROUND 8: MAX CORR ( 69.4785211) AFTER KILLING INPUT VARIABLE 9 CONTR 10.8907638 ROUND 9: MAX CORR ( 68.8273258) AFTER KILLING INPUT VARIABLE 3 CONTR 9.49021193 ROUND 10: MAX CORR ( 68.3135463) AFTER KILLING INPUT VARIABLE 13 CONTR 8.39405562 ROUND 11: MAX CORR ( 66.5115403) AFTER KILLING INPUT VARIABLE 4 CONTR 15.5870335 ROUND 12: MAX CORR ( 61.9623949) AFTER KILLING INPUT VARIABLE 5 CONTR 24.1753308 LAST REMAINING VARIABLE: 7 total correlation to target: 70.6132718 % total significance: 143.03172 sigma correlations of single variables to target: variable 2: 64.6207925 % , in sigma: 130.893568 variable 3: 45.7901097 % , in sigma: 92.75081 variable 4: 53.3972109 % , in sigma: 108.159482 variable 5: 27.6205835 % , in sigma: 55.947267 variable 6: 47.9744451 % , in sigma: 97.1753218 variable 7: 61.9623949 % , in sigma: 125.508813 variable 8: 53.521182 % , in sigma: 108.410594 variable 9: 62.4833596 % , in sigma: 126.564061 variable 10: -25.8937409 % , in sigma: 52.4494363 variable 11: -20.9173335 % , in sigma: 42.3694034 variable 12: -40.0698481 % , in sigma: 81.1640527 variable 13: 10.7873757 % , in sigma: 21.8505228 variable 14: 27.7746923 % , in sigma: 56.2594243 variables sorted by significance: 1 most relevant variable 7 corr 61.9623947 , in sigma: 125.508813 2 most relevant variable 5 corr 24.1753311 , in sigma: 48.9686869 3 most relevant variable 4 corr 15.5870333 , in sigma: 31.5725377 4 most relevant variable 13 corr 8.39405537 , in sigma: 17.0026986 5 most relevant variable 3 corr 9.49021149 , in sigma: 19.2230333 6 most relevant variable 9 corr 10.8907642 , in sigma: 22.0599429 7 most relevant variable 10 corr 5.19216299 , in sigma: 10.5170598 8 most relevant variable 2 corr 3.01921606 , in sigma: 6.11561618 9 most relevant variable 12 corr 1.62503719 , in sigma: 3.29161728 10 most relevant variable 8 corr 0.98679769 , in sigma: 1.99882214 11 most relevant variable 6 corr 0.629350603 , in sigma: 1.27479009 12 most relevant variable 11 corr 0.523298144 , in sigma: 1.05997402 13 most relevant variable 14 corr 0.0430881605 , in sigma: 0.0872778383 global correlations between input variables: variable 2: 99.163668 % variable 3: 92.4410573 % variable 4: 92.629593 % variable 5: 95.5832196 % variable 6: 95.1826356 % variable 7: 98.772251 % variable 8: 89.4440395 % variable 9: 98.7839791 % variable 10: 71.9520655 % variable 11: 56.7761657 % variable 12: 78.032062 % variable 13: 84.260184 % variable 14: 88.1943073 % significance loss when removing single variables: variable 2: corr = 3.28347132 % , sigma = 6.65088218 variable 3: corr = 13.6034364 % , sigma = 27.5546347 variable 4: corr = 13.1354904 % , sigma = 26.60678 variable 5: corr = 14.0766675 % , sigma = 28.5131947 variable 6: corr = 0.649563481 % , sigma = 1.31573258 variable 7: corr = 7.1032499 % , sigma = 14.3880892 variable 8: corr = 1.19032549 % , sigma = 2.41108078 variable 9: corr = 10.5791107 % , sigma = 21.4286687 variable 10: corr = 4.67186958 % , sigma = 9.46317209 variable 11: corr = 0.516903567 % , sigma = 1.0470214 variable 12: corr = 1.26120243 % , sigma = 2.55464658 variable 13: corr = 7.9736272 % , sigma = 16.1510944 variable 14: corr = 0.0430881589 % , sigma = 0.0872778352 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 34.2589035 sigma out 15 active outputs RANK 2 NODE 1 --> 27.8622742 sigma out 15 active outputs RANK 3 NODE 2 --> 23.2166462 sigma out 15 active outputs RANK 4 NODE 5 --> 20.4113464 sigma out 15 active outputs RANK 5 NODE 9 --> 17.2437 sigma out 15 active outputs RANK 6 NODE 6 --> 17.1091156 sigma out 15 active outputs RANK 7 NODE 7 --> 16.6456585 sigma out 15 active outputs RANK 8 NODE 4 --> 15.3990202 sigma out 15 active outputs RANK 9 NODE 3 --> 10.074935 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 51.117981 sigma in 9act. ( 53.3766403 sig out 1act.) RANK 2 NODE 13 --> 18.6614189 sigma in 9act. ( 19.3510075 sig out 1act.) RANK 3 NODE 3 --> 16.0546684 sigma in 9act. ( 15.2011232 sig out 1act.) RANK 4 NODE 2 --> 13.1242085 sigma in 9act. ( 20.7998295 sig out 1act.) RANK 5 NODE 5 --> 12.8545332 sigma in 9act. ( 14.4022942 sig out 1act.) RANK 6 NODE 4 --> 12.8086853 sigma in 9act. ( 20.4278412 sig out 1act.) RANK 7 NODE 7 --> 10.243206 sigma in 9act. ( 14.7773809 sig out 1act.) RANK 8 NODE 8 --> 9.28251362 sigma in 9act. ( 7.43958282 sig out 1act.) RANK 9 NODE 12 --> 7.42509556 sigma in 9act. ( 7.8884902 sig out 1act.) RANK 10 NODE 14 --> 6.60966206 sigma in 9act. ( 6.64246655 sig out 1act.) RANK 11 NODE 9 --> 5.35992098 sigma in 9act. ( 3.75836325 sig out 1act.) RANK 12 NODE 6 --> 5.30622005 sigma in 9act. ( 5.48291588 sig out 1act.) RANK 13 NODE 1 --> 5.24109602 sigma in 9act. ( 4.80223942 sig out 1act.) RANK 14 NODE 11 --> 3.48889112 sigma in 9act. ( 4.37004042 sig out 1act.) RANK 15 NODE 15 --> 2.08912206 sigma in 9act. ( 3.26604295 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 53.3766403 sigma out 1act.( 51.117981 sig in 9act.) RANK 2 NODE 2 --> 20.7998295 sigma out 1act.( 13.1242085 sig in 9act.) RANK 3 NODE 4 --> 20.4278412 sigma out 1act.( 12.8086853 sig in 9act.) RANK 4 NODE 13 --> 19.3510075 sigma out 1act.( 18.6614189 sig in 9act.) RANK 5 NODE 3 --> 15.2011232 sigma out 1act.( 16.0546684 sig in 9act.) RANK 6 NODE 7 --> 14.7773809 sigma out 1act.( 10.243206 sig in 9act.) RANK 7 NODE 5 --> 14.4022942 sigma out 1act.( 12.8545332 sig in 9act.) RANK 8 NODE 12 --> 7.8884902 sigma out 1act.( 7.42509556 sig in 9act.) RANK 9 NODE 8 --> 7.43958282 sigma out 1act.( 9.28251362 sig in 9act.) RANK 10 NODE 14 --> 6.64246655 sigma out 1act.( 6.60966206 sig in 9act.) RANK 11 NODE 6 --> 5.48291588 sigma out 1act.( 5.30622005 sig in 9act.) RANK 12 NODE 1 --> 4.80223942 sigma out 1act.( 5.24109602 sig in 9act.) RANK 13 NODE 11 --> 4.37004042 sigma out 1act.( 3.48889112 sig in 9act.) RANK 14 NODE 9 --> 3.75836325 sigma out 1act.( 5.35992098 sig in 9act.) RANK 15 NODE 15 --> 3.26604295 sigma out 1act.( 2.08912206 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 70.6331406 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 32.7444801 sigma out 15 active outputs RANK 2 NODE 1 --> 27.6307335 sigma out 15 active outputs RANK 3 NODE 9 --> 22.6579895 sigma out 15 active outputs RANK 4 NODE 2 --> 22.061552 sigma out 15 active outputs RANK 5 NODE 5 --> 19.0459938 sigma out 15 active outputs RANK 6 NODE 6 --> 18.5776806 sigma out 15 active outputs RANK 7 NODE 7 --> 18.094408 sigma out 15 active outputs RANK 8 NODE 4 --> 15.8912745 sigma out 15 active outputs RANK 9 NODE 3 --> 11.2591343 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 45.9026375 sigma in 9act. ( 49.4742889 sig out 1act.) RANK 2 NODE 4 --> 19.0089264 sigma in 9act. ( 20.1028786 sig out 1act.) RANK 3 NODE 2 --> 18.4372177 sigma in 9act. ( 19.8067818 sig out 1act.) RANK 4 NODE 13 --> 18.1702995 sigma in 9act. ( 17.9448738 sig out 1act.) RANK 5 NODE 7 --> 16.6733913 sigma in 9act. ( 14.8911219 sig out 1act.) RANK 6 NODE 3 --> 14.0210581 sigma in 9act. ( 13.6333818 sig out 1act.) RANK 7 NODE 5 --> 13.8271141 sigma in 9act. ( 14.0665874 sig out 1act.) RANK 8 NODE 14 --> 8.84346581 sigma in 9act. ( 6.30683279 sig out 1act.) RANK 9 NODE 15 --> 8.55898285 sigma in 9act. ( 4.16258478 sig out 1act.) RANK 10 NODE 12 --> 8.19795895 sigma in 9act. ( 7.67643929 sig out 1act.) RANK 11 NODE 8 --> 8.08597088 sigma in 9act. ( 6.50674009 sig out 1act.) RANK 12 NODE 6 --> 7.28017235 sigma in 9act. ( 5.3670187 sig out 1act.) RANK 13 NODE 11 --> 7.11686468 sigma in 9act. ( 4.39378214 sig out 1act.) RANK 14 NODE 1 --> 6.07711554 sigma in 9act. ( 4.43882704 sig out 1act.) RANK 15 NODE 9 --> 4.63095188 sigma in 9act. ( 3.02181125 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 49.4742889 sigma out 1act.( 45.9026375 sig in 9act.) RANK 2 NODE 4 --> 20.1028786 sigma out 1act.( 19.0089264 sig in 9act.) RANK 3 NODE 2 --> 19.8067818 sigma out 1act.( 18.4372177 sig in 9act.) RANK 4 NODE 13 --> 17.9448738 sigma out 1act.( 18.1702995 sig in 9act.) RANK 5 NODE 7 --> 14.8911219 sigma out 1act.( 16.6733913 sig in 9act.) RANK 6 NODE 5 --> 14.0665874 sigma out 1act.( 13.8271141 sig in 9act.) RANK 7 NODE 3 --> 13.6333818 sigma out 1act.( 14.0210581 sig in 9act.) RANK 8 NODE 12 --> 7.67643929 sigma out 1act.( 8.19795895 sig in 9act.) RANK 9 NODE 8 --> 6.50674009 sigma out 1act.( 8.08597088 sig in 9act.) RANK 10 NODE 14 --> 6.30683279 sigma out 1act.( 8.84346581 sig in 9act.) RANK 11 NODE 6 --> 5.3670187 sigma out 1act.( 7.28017235 sig in 9act.) RANK 12 NODE 1 --> 4.43882704 sigma out 1act.( 6.07711554 sig in 9act.) RANK 13 NODE 11 --> 4.39378214 sigma out 1act.( 7.11686468 sig in 9act.) RANK 14 NODE 15 --> 4.16258478 sigma out 1act.( 8.55898285 sig in 9act.) RANK 15 NODE 9 --> 3.02181125 sigma out 1act.( 4.63095188 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.384903 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.41070199 *** contribution from regularisation: 0.00336689223 *** contribution from error: -0.414068878 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.454601705 *** contribution from regularisation: 0.002237387 *** contribution from error: -0.456839085 *********************************************** -----------------> Test sample ENTER BFGS code START -42657.8416 1.1152997 0.0467131734 EXIT FROM BFGS code FG_START 0. 1.1152997 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.479599059 *** contribution from regularisation: 0.0020306143 *** contribution from error: -0.48162967 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -44993.5849 1.1152997 108.49881 EXIT FROM BFGS code FG_LNSRCH 0. 1.13025892 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.52415365 *** contribution from regularisation: 0.00270155328 *** contribution from error: -0.52685523 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49173.4757 1.13025892 345.221527 EXIT FROM BFGS code NEW_X -49173.4757 1.13025892 345.221527 ENTER BFGS code NEW_X -49173.4757 1.13025892 345.221527 EXIT FROM BFGS code FG_LNSRCH 0. 1.18324208 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.533217728 *** contribution from regularisation: 0.00294688577 *** contribution from error: -0.536164641 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50023.8222 1.18324208 101.098671 EXIT FROM BFGS code NEW_X -50023.8222 1.18324208 101.098671 ENTER BFGS code NEW_X -50023.8222 1.18324208 101.098671 EXIT FROM BFGS code FG_LNSRCH 0. 1.20896101 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.536050081 *** contribution from regularisation: 0.00284612179 *** contribution from error: -0.538896203 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50289.5401 1.20896101 20.101572 EXIT FROM BFGS code NEW_X -50289.5401 1.20896101 20.101572 ENTER BFGS code NEW_X -50289.5401 1.20896101 20.101572 EXIT FROM BFGS code FG_LNSRCH 0. 1.22263217 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.536785126 *** contribution from regularisation: 0.00269802869 *** contribution from error: -0.53948313 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50358.497 1.22263217 -65.260376 EXIT FROM BFGS code NEW_X -50358.497 1.22263217 -65.260376 ENTER BFGS code NEW_X -50358.497 1.22263217 -65.260376 EXIT FROM BFGS code FG_LNSRCH 0. 1.20418036 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.537005782 *** contribution from regularisation: 0.00265746145 *** contribution from error: -0.539663255 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50379.1977 1.20418036 -16.6044827 EXIT FROM BFGS code NEW_X -50379.1977 1.20418036 -16.6044827 ENTER BFGS code NEW_X -50379.1977 1.20418036 -16.6044827 EXIT FROM BFGS code FG_LNSRCH 0. 1.17648375 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.537248373 *** contribution from regularisation: 0.00263011619 *** contribution from error: -0.539878488 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50401.9544 1.17648375 -2.48973989 EXIT FROM BFGS code NEW_X -50401.9544 1.17648375 -2.48973989 ENTER BFGS code NEW_X -50401.9544 1.17648375 -2.48973989 EXIT FROM BFGS code FG_LNSRCH 0. 1.05698729 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 36.9767075 sigma out 15 active outputs RANK 2 NODE 1 --> 30.8642426 sigma out 15 active outputs RANK 3 NODE 5 --> 22.2333908 sigma out 15 active outputs RANK 4 NODE 8 --> 18.036171 sigma out 15 active outputs RANK 5 NODE 6 --> 17.8452168 sigma out 15 active outputs RANK 6 NODE 2 --> 17.2254486 sigma out 15 active outputs RANK 7 NODE 4 --> 14.5255041 sigma out 15 active outputs RANK 8 NODE 3 --> 13.0097952 sigma out 15 active outputs RANK 9 NODE 7 --> 12.9605312 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 29.0275059 sigma in 9act. ( 28.6145439 sig out 1act.) RANK 2 NODE 10 --> 28.106245 sigma in 9act. ( 29.3010674 sig out 1act.) RANK 3 NODE 2 --> 27.8566437 sigma in 9act. ( 26.1831703 sig out 1act.) RANK 4 NODE 4 --> 20.6979237 sigma in 9act. ( 24.8051395 sig out 1act.) RANK 5 NODE 15 --> 19.1612663 sigma in 9act. ( 19.9352551 sig out 1act.) RANK 6 NODE 14 --> 15.1814852 sigma in 9act. ( 14.0718203 sig out 1act.) RANK 7 NODE 5 --> 14.1398726 sigma in 9act. ( 13.8639221 sig out 1act.) RANK 8 NODE 13 --> 13.8571911 sigma in 9act. ( 14.3969336 sig out 1act.) RANK 9 NODE 12 --> 12.5085039 sigma in 9act. ( 10.3725157 sig out 1act.) RANK 10 NODE 3 --> 11.9443893 sigma in 9act. ( 11.2496843 sig out 1act.) RANK 11 NODE 11 --> 7.74611139 sigma in 9act. ( 7.60455036 sig out 1act.) RANK 12 NODE 1 --> 6.91209745 sigma in 9act. ( 5.97085094 sig out 1act.) RANK 13 NODE 6 --> 5.77063513 sigma in 9act. ( 4.74991369 sig out 1act.) RANK 14 NODE 8 --> 5.16552973 sigma in 9act. ( 3.69800448 sig out 1act.) RANK 15 NODE 9 --> 3.07525682 sigma in 9act. ( 2.07234049 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 29.3010674 sigma out 1act.( 28.106245 sig in 9act.) RANK 2 NODE 7 --> 28.6145439 sigma out 1act.( 29.0275059 sig in 9act.) RANK 3 NODE 2 --> 26.1831703 sigma out 1act.( 27.8566437 sig in 9act.) RANK 4 NODE 4 --> 24.8051395 sigma out 1act.( 20.6979237 sig in 9act.) RANK 5 NODE 15 --> 19.9352551 sigma out 1act.( 19.1612663 sig in 9act.) RANK 6 NODE 13 --> 14.3969336 sigma out 1act.( 13.8571911 sig in 9act.) RANK 7 NODE 14 --> 14.0718203 sigma out 1act.( 15.1814852 sig in 9act.) RANK 8 NODE 5 --> 13.8639221 sigma out 1act.( 14.1398726 sig in 9act.) RANK 9 NODE 3 --> 11.2496843 sigma out 1act.( 11.9443893 sig in 9act.) RANK 10 NODE 12 --> 10.3725157 sigma out 1act.( 12.5085039 sig in 9act.) RANK 11 NODE 11 --> 7.60455036 sigma out 1act.( 7.74611139 sig in 9act.) RANK 12 NODE 1 --> 5.97085094 sigma out 1act.( 6.91209745 sig in 9act.) RANK 13 NODE 6 --> 4.74991369 sigma out 1act.( 5.77063513 sig in 9act.) RANK 14 NODE 8 --> 3.69800448 sigma out 1act.( 5.16552973 sig in 9act.) RANK 15 NODE 9 --> 2.07234049 sigma out 1act.( 3.07525682 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 65.8882751 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.538109004 *** contribution from regularisation: 0.00246674474 *** contribution from error: -0.540575743 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50482.6987 1.05698729 38.2650108 EXIT FROM BFGS code NEW_X -50482.6987 1.05698729 38.2650108 ENTER BFGS code NEW_X -50482.6987 1.05698729 38.2650108 EXIT FROM BFGS code FG_LNSRCH 0. 0.87094599 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.539208591 *** contribution from regularisation: 0.00255298568 *** contribution from error: -0.541761577 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50585.856 0.87094599 64.0545273 EXIT FROM BFGS code NEW_X -50585.856 0.87094599 64.0545273 ENTER BFGS code NEW_X -50585.856 0.87094599 64.0545273 EXIT FROM BFGS code FG_LNSRCH 0. 0.57069844 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.532180607 *** contribution from regularisation: 0.00324329711 *** contribution from error: -0.535423875 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49926.5233 0.57069844 24.1951694 EXIT FROM BFGS code FG_LNSRCH 0. 0.81997931 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.540519714 *** contribution from regularisation: 0.00171382295 *** contribution from error: -0.542233527 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50708.8557 0.81997931 44.5412216 EXIT FROM BFGS code NEW_X -50708.8557 0.81997931 44.5412216 ENTER BFGS code NEW_X -50708.8557 0.81997931 44.5412216 EXIT FROM BFGS code FG_LNSRCH 0. 0.744171858 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.540056527 *** contribution from regularisation: 0.00276016188 *** contribution from error: -0.542816699 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50665.4057 0.744171858 20.4360428 EXIT FROM BFGS code FG_LNSRCH 0. 0.808967948 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.540094733 *** contribution from regularisation: 0.00226853555 *** contribution from error: -0.542363286 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50668.988 0.808967948 42.4428749 EXIT FROM BFGS code FG_LNSRCH 0. 0.819599152 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.539751232 *** contribution from regularisation: 0.00248710741 *** contribution from error: -0.542238355 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50636.7605 0.819599152 46.1181297 EXIT FROM BFGS code FG_LNSRCH 0. 0.819979012 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.539754391 *** contribution from regularisation: 0.00247916556 *** contribution from error: -0.542233527 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50637.0555 0.819979012 46.4129944 EXIT FROM BFGS code FG_LNSRCH 0. 0.81997931 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.539763629 *** contribution from regularisation: 0.00246991776 *** contribution from error: -0.542233527 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50637.9227 0.81997931 46.4722824 EXIT FROM BFGS code FG_LNSRCH 0. 0.81997931 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.539758325 *** contribution from regularisation: 0.00247520627 *** contribution from error: -0.542233527 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50637.4265 0.81997931 46.5430374 EXIT FROM BFGS code FG_LNSRCH 0. 0.81997931 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 41.4765549 sigma out 15 active outputs RANK 2 NODE 1 --> 29.7615795 sigma out 15 active outputs RANK 3 NODE 5 --> 25.8334904 sigma out 15 active outputs RANK 4 NODE 2 --> 20.732729 sigma out 15 active outputs RANK 5 NODE 6 --> 20.3085556 sigma out 15 active outputs RANK 6 NODE 8 --> 17.2360401 sigma out 15 active outputs RANK 7 NODE 3 --> 16.1372929 sigma out 15 active outputs RANK 8 NODE 4 --> 13.6029282 sigma out 15 active outputs RANK 9 NODE 7 --> 8.77837753 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 37.377903 sigma in 9act. ( 36.8106308 sig out 1act.) RANK 2 NODE 2 --> 28.9475365 sigma in 9act. ( 28.9679127 sig out 1act.) RANK 3 NODE 4 --> 24.5818577 sigma in 9act. ( 27.7876682 sig out 1act.) RANK 4 NODE 15 --> 22.7831001 sigma in 9act. ( 23.0912571 sig out 1act.) RANK 5 NODE 10 --> 21.7264633 sigma in 9act. ( 23.7799721 sig out 1act.) RANK 6 NODE 14 --> 21.1460876 sigma in 9act. ( 21.2841873 sig out 1act.) RANK 7 NODE 5 --> 15.7478838 sigma in 9act. ( 13.0034189 sig out 1act.) RANK 8 NODE 3 --> 11.1017647 sigma in 9act. ( 10.8087587 sig out 1act.) RANK 9 NODE 12 --> 10.6580143 sigma in 9act. ( 8.86744785 sig out 1act.) RANK 10 NODE 13 --> 9.16672325 sigma in 9act. ( 8.40444374 sig out 1act.) RANK 11 NODE 1 --> 5.46525574 sigma in 9act. ( 4.31255245 sig out 1act.) RANK 12 NODE 11 --> 5.24331188 sigma in 9act. ( 3.75831771 sig out 1act.) RANK 13 NODE 8 --> 3.70625067 sigma in 9act. ( 2.47997284 sig out 1act.) RANK 14 NODE 6 --> 3.657197 sigma in 9act. ( 2.35999489 sig out 1act.) RANK 15 NODE 9 --> 2.0883081 sigma in 9act. ( 0.849815845 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 36.8106308 sigma out 1act.( 37.377903 sig in 9act.) RANK 2 NODE 2 --> 28.9679127 sigma out 1act.( 28.9475365 sig in 9act.) RANK 3 NODE 4 --> 27.7876682 sigma out 1act.( 24.5818577 sig in 9act.) RANK 4 NODE 10 --> 23.7799721 sigma out 1act.( 21.7264633 sig in 9act.) RANK 5 NODE 15 --> 23.0912571 sigma out 1act.( 22.7831001 sig in 9act.) RANK 6 NODE 14 --> 21.2841873 sigma out 1act.( 21.1460876 sig in 9act.) RANK 7 NODE 5 --> 13.0034189 sigma out 1act.( 15.7478838 sig in 9act.) RANK 8 NODE 3 --> 10.8087587 sigma out 1act.( 11.1017647 sig in 9act.) RANK 9 NODE 12 --> 8.86744785 sigma out 1act.( 10.6580143 sig in 9act.) RANK 10 NODE 13 --> 8.40444374 sigma out 1act.( 9.16672325 sig in 9act.) RANK 11 NODE 1 --> 4.31255245 sigma out 1act.( 5.46525574 sig in 9act.) RANK 12 NODE 11 --> 3.75831771 sigma out 1act.( 5.24331188 sig in 9act.) RANK 13 NODE 8 --> 2.47997284 sigma out 1act.( 3.70625067 sig in 9act.) RANK 14 NODE 6 --> 2.35999489 sigma out 1act.( 3.657197 sig in 9act.) RANK 15 NODE 9 --> 0.849815845 sigma out 1act.( 2.0883081 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 70.6991959 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.539758503 *** contribution from regularisation: 0.00247502932 *** contribution from error: -0.542233527 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50637.4431 0.81997931 46.5887794 EXIT FROM BFGS code NEW_X -50637.4431 0.81997931 46.5887794 ENTER BFGS code NEW_X -50637.4431 0.81997931 46.5887794 EXIT FROM BFGS code CONVERGENC -50637.4431 0.81997931 46.5887794 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 60.285656 sigma out 15 active outputs RANK 2 NODE 1 --> 43.7265663 sigma out 15 active outputs RANK 3 NODE 5 --> 38.1389999 sigma out 15 active outputs RANK 4 NODE 2 --> 30.8158836 sigma out 15 active outputs RANK 5 NODE 6 --> 29.7812309 sigma out 15 active outputs RANK 6 NODE 8 --> 25.1232224 sigma out 15 active outputs RANK 7 NODE 3 --> 23.8246765 sigma out 15 active outputs RANK 8 NODE 4 --> 19.2575798 sigma out 15 active outputs RANK 9 NODE 7 --> 13.1213818 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 55.1578026 sigma in 9act. ( 55.1448364 sig out 1act.) RANK 2 NODE 2 --> 42.7700653 sigma in 9act. ( 43.4207001 sig out 1act.) RANK 3 NODE 4 --> 35.432579 sigma in 9act. ( 41.879364 sig out 1act.) RANK 4 NODE 15 --> 33.7622795 sigma in 9act. ( 34.1815796 sig out 1act.) RANK 5 NODE 10 --> 31.963995 sigma in 9act. ( 35.7371712 sig out 1act.) RANK 6 NODE 14 --> 31.158144 sigma in 9act. ( 31.6431389 sig out 1act.) RANK 7 NODE 5 --> 23.0083542 sigma in 9act. ( 19.6414089 sig out 1act.) RANK 8 NODE 3 --> 16.1311302 sigma in 9act. ( 16.0313778 sig out 1act.) RANK 9 NODE 12 --> 15.4862375 sigma in 9act. ( 13.2361698 sig out 1act.) RANK 10 NODE 13 --> 11.9783421 sigma in 9act. ( 12.7089252 sig out 1act.) RANK 11 NODE 1 --> 7.71752214 sigma in 9act. ( 6.35784817 sig out 1act.) RANK 12 NODE 11 --> 6.40467882 sigma in 9act. ( 5.72969484 sig out 1act.) RANK 13 NODE 8 --> 4.61197233 sigma in 9act. ( 3.61098075 sig out 1act.) RANK 14 NODE 6 --> 4.44856071 sigma in 9act. ( 3.56254292 sig out 1act.) RANK 15 NODE 9 --> 2.28556228 sigma in 9act. ( 1.25821602 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 55.1448364 sigma out 1act.( 55.1578026 sig in 9act.) RANK 2 NODE 2 --> 43.4207001 sigma out 1act.( 42.7700653 sig in 9act.) RANK 3 NODE 4 --> 41.879364 sigma out 1act.( 35.432579 sig in 9act.) RANK 4 NODE 10 --> 35.7371712 sigma out 1act.( 31.963995 sig in 9act.) RANK 5 NODE 15 --> 34.1815796 sigma out 1act.( 33.7622795 sig in 9act.) RANK 6 NODE 14 --> 31.6431389 sigma out 1act.( 31.158144 sig in 9act.) RANK 7 NODE 5 --> 19.6414089 sigma out 1act.( 23.0083542 sig in 9act.) RANK 8 NODE 3 --> 16.0313778 sigma out 1act.( 16.1311302 sig in 9act.) RANK 9 NODE 12 --> 13.2361698 sigma out 1act.( 15.4862375 sig in 9act.) RANK 10 NODE 13 --> 12.7089252 sigma out 1act.( 11.9783421 sig in 9act.) RANK 11 NODE 1 --> 6.35784817 sigma out 1act.( 7.71752214 sig in 9act.) RANK 12 NODE 11 --> 5.72969484 sigma out 1act.( 6.40467882 sig in 9act.) RANK 13 NODE 8 --> 3.61098075 sigma out 1act.( 4.61197233 sig in 9act.) RANK 14 NODE 6 --> 3.56254292 sigma out 1act.( 4.44856071 sig in 9act.) RANK 15 NODE 9 --> 1.25821602 sigma out 1act.( 2.28556228 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 105.863472 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.539750934 *** contribution from regularisation: 0.0024825891 *** contribution from error: -0.542233527 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done