NNInput NNInputs_115.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 40188 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 9744 nbkg = 30444 Bkg Entries: 30444 Sig Entries: 9744 Chosen entries: 9744 Signal fraction: 1 Background fraction: 0.320063 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 30444 Actual Signal Entries: 9744 Entries to split: 9744 Test with : 4872 Train with : 4872 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 9744 for Signal Prepared event 0 for Signal with 9744 events ====Entry 0 Variable Ht : 147.2 Variable LepAPt : 33.8436 Variable LepBPt : 16.8195 Variable MetSigLeptonsJets : 7.93922 Variable MetSpec : 69.8321 Variable SumEtLeptonsJets : 77.3669 Variable VSumJetLeptonsPt : 74.5437 Variable addEt : 120.496 Variable dPhiLepSumMet : 2.77597 Variable dPhiLeptons : 0.349396 Variable dRLeptons : 0.409585 Variable lep1_E : 34.748 Variable lep2_E : 16.8224 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2115 Ht = 147.2 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.8439 LepAPt = 33.8436 LepBEt = 16.82 LepBPt = 16.8195 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 69.8321 MetDelPhi = 2.54203 MetSig = 5.42558 MetSigLeptonsJets = 7.93922 MetSpec = 69.8321 Mjj = 0 MostCentralJetEta = -1.25048 MtllMet = 121.128 Njets = 1 SB = 0 SumEt = 165.661 SumEtJets = 0 SumEtLeptonsJets = 77.3669 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 74.5437 addEt = 120.496 dPhiLepSumMet = 2.77597 dPhiLeptons = 0.349396 dRLeptons = 0.409585 diltype = 17 dimass = 9.74565 event = 4187 jet1_Et = 26.7039 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.748 lep2_E = 16.8224 rand = 0.999742 run = 237705 weight = 5.90147e-07 ===Show End Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 30444 for Background Prepared event 0 for Background with 30444 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 1.18331 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 30444 events Prepared event 20000 for Background with 30444 events Prepared event 30000 for Background with 30444 events Warning: found 1026 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 40188 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 1026 negative weights. Signal fraction: 62.6569939 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 56.0800056 61.8958664 63.8969879 65.618988 67.2365112 68.7001343 70.2283325 71.3211594 72.7168884 73.9361115 75.2880325 76.8154984 78.0397339 79.2778168 80.2522812 81.2963104 82.4521637 83.6645355 84.9772873 86.051033 87.2592239 88.0954666 89.2032852 90.1654205 91.1063843 91.9838867 92.9371643 93.7626648 94.5202942 95.3056946 96.2070007 97.0108795 97.8557587 98.6259613 99.4616852 100.065849 100.738457 101.478271 102.314903 103.122253 103.894272 104.584274 105.244392 106.076385 106.7565 107.445862 108.029602 108.671143 109.451508 110.007065 110.907997 111.789078 112.60585 113.435806 114.284973 115.341919 116.445503 117.526237 118.699448 120.230331 121.421524 122.504929 123.945953 125.26667 126.512535 127.916023 129.170288 130.484894 131.729492 133.18486 134.771713 136.13739 137.705109 139.387512 140.875961 142.388031 144.075317 145.701691 147.681442 149.869339 151.825729 154.417389 156.572586 159.067169 161.484024 163.865921 167.016708 172.030304 176.091522 179.598221 183.935944 188.364441 194.801422 201.70932 209.934174 219.20636 228.665894 241.76944 271.371277 311.150635 679.506348 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3798122 20.7651482 21.0913754 21.4057617 21.7471981 22.086216 22.4005013 22.6778278 22.9759369 23.2407894 23.5264854 23.8366623 24.1070652 24.3745499 24.6655273 24.9431381 25.1234837 25.3859577 25.6203613 25.9153214 26.1431847 26.3313179 26.5825348 26.8083878 27.0733109 27.3051472 27.5414219 27.8263168 28.0364399 28.2305908 28.4596901 28.6670876 28.8785763 29.1343479 29.3688812 29.6121826 29.8369713 30.07901 30.2910328 30.490181 30.7260609 30.9239311 31.1737747 31.4271736 31.6425858 31.8823547 32.1033478 32.357132 32.5835342 32.8230972 33.0495453 33.2905312 33.5579796 33.8409386 34.0868835 34.3547516 34.5889206 34.8064346 35.0717201 35.3229027 35.6086044 35.8506775 36.1389618 36.3969078 36.6716576 36.9515228 37.3012543 37.5807495 37.8722229 38.2286224 38.5327377 38.8841705 39.2398682 39.5667038 39.9963913 40.414772 40.8490219 41.330101 41.8208618 42.3319397 42.7776489 43.4208374 44.0062408 44.6241913 45.4349365 46.1401672 46.9671402 47.8763504 48.7885475 49.8520012 50.8220139 52.4702721 53.9395027 56.1237106 58.0960617 60.532486 64.311882 69.2380981 78.3681412 178.378601 ------------------------------ Transdef: Tab for variable 4 10.0011187 10.1404114 10.2678957 10.4020948 10.5260553 10.6481962 10.7850857 10.8894653 11.0021257 11.1546574 11.2638264 11.4246941 11.5554829 11.6776371 11.8219891 11.9614067 12.0909061 12.2082796 12.3317575 12.4691391 12.5808353 12.7102737 12.833622 12.9774809 13.1295757 13.2733765 13.3921013 13.5294905 13.6856098 13.8003616 13.9405384 14.0693035 14.2195778 14.3538132 14.4982262 14.634119 14.7798767 14.9486027 15.0764999 15.2287931 15.3814774 15.5401783 15.7039833 15.841939 15.9827499 16.1612091 16.3092346 16.4772949 16.6459541 16.8008461 16.9590263 17.1578865 17.3581295 17.5633507 17.7540817 17.9500446 18.1578293 18.3440056 18.5654831 18.7734642 18.9643078 19.1758099 19.3733482 19.5676384 19.7882023 20.0087814 20.1969795 20.3661995 20.5169258 20.7016068 20.9039841 21.0584412 21.2390327 21.4485474 21.6045685 21.8410549 22.0525589 22.2949924 22.5405941 22.84095 23.0804348 23.3763809 23.6605644 23.9352913 24.1877823 24.5060387 24.8338013 25.171917 25.5645332 25.9897766 26.4030952 26.8654995 27.4052467 28.0588417 28.8074608 29.6633415 30.8374252 32.2757874 34.1240311 37.669014 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.55223811 2.49409652 2.73693228 2.93648243 3.05307293 3.1984334 3.32378721 3.41968632 3.54998922 3.66665363 3.76631093 3.84570408 3.91226625 3.97897482 4.04587173 4.11983061 4.18790245 4.24748325 4.31314564 4.37681389 4.44595528 4.51040173 4.56425762 4.63082886 4.69768095 4.746665 4.82332754 4.88405228 4.94473648 5.00416756 5.07407808 5.15449524 5.21759415 5.29403877 5.34886789 5.40491152 5.46692085 5.53476334 5.58245659 5.64794159 5.70419025 5.76061249 5.82993317 5.87634516 5.92724705 5.97203588 6.02675629 6.07622147 6.12421513 6.17327356 6.22319412 6.270298 6.31937695 6.36074257 6.40665531 6.45857859 6.50162458 6.54381371 6.5794487 6.61995792 6.66456127 6.70768404 6.75101137 6.80153179 6.84794664 6.89193439 6.92845631 6.97897816 7.01679325 7.05803061 7.10144663 7.15314198 7.19192314 7.24098015 7.28339005 7.32478046 7.36697865 7.41116333 7.46053171 7.50991344 7.56452465 7.62314796 7.69398594 7.77020407 7.83127403 7.88689137 7.95579338 8.0144825 8.09094524 8.16661263 8.25778198 8.3576622 8.45749855 8.58327484 8.70962143 8.8509903 9.01390266 9.27321434 9.60915375 10.2576275 15.0165958 ------------------------------ Transdef: Tab for variable 6 25.0005894 25.3194122 25.6684494 25.9184418 26.2447357 26.6912384 27.0467281 27.4056549 27.8346901 28.2731323 28.7545128 29.174614 29.6785736 30.0770111 30.5814171 31.1806202 31.6670151 32.1528091 32.6339722 33.1411209 33.7457657 34.2437744 34.8277168 35.4573212 35.9985886 36.5144577 37.01651 37.520565 38.0150833 38.4440918 38.9001389 39.4104614 39.7793465 40.2590904 40.6919022 41.1171341 41.5965958 41.9970779 42.3444824 42.8396301 43.2565994 43.6895599 44.0632095 44.4610291 44.855835 45.255806 45.7078476 46.0653496 46.4331932 46.7711678 47.1416626 47.5503464 47.8958359 48.2471848 48.6104736 49.0027046 49.3700523 49.7189102 50.0610161 50.5421257 50.8841171 51.302021 51.6422653 52.041172 52.4486198 52.8238182 53.2118301 53.6396103 54.0461349 54.4516907 54.951458 55.4473419 55.8738594 56.2964134 56.7539711 57.3367729 57.9570312 58.4804916 59.0573044 59.7724762 60.4726753 61.2081985 61.9914856 62.8696747 63.6825333 64.5175323 65.4132919 66.5078278 67.6580963 68.6984406 69.9893723 71.3097229 72.9854889 74.571991 76.5204544 78.4861298 81.6642303 86.597702 93.0988693 103.634644 218.598831 ------------------------------ Transdef: Tab for variable 7 30.1229668 33.1903839 34.4770432 35.2961121 36.2210236 36.9409256 37.6050835 38.3497925 39.0563507 39.6925507 40.2080002 40.8137245 41.322876 41.9022293 42.3361435 42.7998505 43.3729668 43.9309845 44.4873276 44.9111252 45.4476967 45.7965088 46.2724686 46.7017059 47.1775208 47.6711655 48.228447 48.619545 49.0000076 49.4430542 49.9543686 50.4026184 50.8799438 51.3055496 51.7285919 52.1883011 52.6729355 53.1130066 53.5455742 54.0183029 54.4731293 54.9614868 55.3809814 55.8308258 56.341404 56.868187 57.4099655 58.0691986 58.8234863 59.4994583 60.3458977 61.0831642 61.9577942 62.7773018 63.5860214 64.4310455 65.2799683 65.9957428 66.9638672 67.8355408 68.7675781 69.6897659 70.6645126 71.6094513 72.6719589 73.7214355 74.6781616 75.8084641 77.0138092 78.0881348 79.2624664 80.6378326 81.754509 83.3676605 84.7356262 86.1017914 87.6844788 89.5103912 91.2265396 92.8059998 95.1339569 96.7478333 99.0799561 101.640358 104.114777 107.150665 110.152206 113.275528 116.3246 120.009659 123.725365 128.613556 133.116791 138.358109 145.323608 153.72995 162.379242 175.543213 194.72467 225.945648 407.692993 ------------------------------ Transdef: Tab for variable 8 3.28242826 22.0290642 26.1864548 29.1257668 30.6453018 31.8340569 32.7725754 33.4239044 34.1123009 34.725563 35.0794449 35.7083664 36.2987518 36.7268333 37.1114273 37.6322021 38.0876083 38.4524384 38.9185905 39.3785477 39.730545 40.1167603 40.4845047 40.8469086 41.1854324 41.5873566 41.9530945 42.2979546 42.6434555 42.9945183 43.3180084 43.6898804 43.9912148 44.3545837 44.6630135 44.9837036 45.3368073 45.6660309 45.9776993 46.3094063 46.6138535 46.9218559 47.2535362 47.5725441 47.8447418 48.1539688 48.4479103 48.7752304 49.0410538 49.3850555 49.7133713 50.0533829 50.41008 50.7281113 51.0388184 51.3481522 51.6862717 52.0686264 52.3993149 52.7361031 52.9917374 53.3201828 53.6951523 54.0186119 54.3792496 54.7587204 55.1324577 55.5712967 55.9634056 56.3828354 56.8514633 57.4068985 57.8520355 58.3875732 59.0103912 59.7171631 60.2737885 60.8994064 61.487339 62.1649628 62.8237228 63.4341507 64.1536789 65.0619507 65.9483185 66.8264389 67.7730255 68.9043274 69.9006958 70.9616394 72.2069855 73.6792297 75.2972031 76.9171066 78.9093323 81.3593292 84.7829895 89.5383148 96.8637848 112.351151 289.322327 ------------------------------ Transdef: Tab for variable 9 56.0800056 61.287384 63.4792137 64.5376892 65.956459 67.1703186 68.3579254 69.5005875 70.4269714 71.4253082 72.5296326 73.4086151 74.4898453 75.506073 76.5955582 77.4077911 78.4600143 79.4673157 80.150116 81.032608 81.76474 82.6293259 83.471962 84.2076874 85.1459808 85.9087677 86.7610245 87.4675217 88.0115051 88.8348923 89.5863953 90.2286072 90.8540497 91.3897934 92.1171417 92.8966904 93.5306702 94.1232147 94.608139 95.1654053 95.7001495 96.359024 96.9204559 97.4694977 98.0552292 98.6202316 99.1720276 99.7273483 100.28878 100.804352 101.426613 101.980888 102.584427 103.09433 103.574615 104.136749 104.645798 105.165619 105.648209 106.17128 106.729782 107.258179 107.732254 108.149063 108.651535 109.166458 109.681458 110.172363 110.804817 111.30455 111.943779 112.589806 113.24971 113.958923 114.714485 115.455742 116.090973 117.139984 117.991074 118.86274 119.888626 121.077156 122.361191 123.490494 124.94072 126.262161 127.821564 129.536652 131.608368 133.654785 135.670471 137.619858 140.362061 143.132812 146.922653 150.731812 155.41626 162.65506 173.197296 190.451538 379.21344 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.900591671 1.12742496 1.27262914 1.39855635 1.49556613 1.59389853 1.6942842 1.76743603 1.82575893 1.88512397 1.95565629 2.0154326 2.0562346 2.11478114 2.17062902 2.21358228 2.2490325 2.28440762 2.32632375 2.36089659 2.39434385 2.42768288 2.4559741 2.48559785 2.50987625 2.5358243 2.56302118 2.5870142 2.61106491 2.63402104 2.65583849 2.67840838 2.69964123 2.71469736 2.73413014 2.75562477 2.77401567 2.78867102 2.80392694 2.81706142 2.83029318 2.84299231 2.85494375 2.86734986 2.87815499 2.88860035 2.89739418 2.90803957 2.91838789 2.92573118 2.93442106 2.94254875 2.95134926 2.95928645 2.96604395 2.97345972 2.98075819 2.98732138 2.99298453 2.99831104 3.0044446 3.01054573 3.01554537 3.02092266 3.02625608 3.03069544 3.03521299 3.03953052 3.04313207 3.04651403 3.05062366 3.05474377 3.05915308 3.06344652 3.06726408 3.07043242 3.07390356 3.07668352 3.0803647 3.08375645 3.08690453 3.0902245 3.09325075 3.09638333 3.09960175 3.10275841 3.10538626 3.10837054 3.11112404 3.11351132 3.11618328 3.11901712 3.1215744 3.12432718 3.12706423 3.12971401 3.132797 3.13626242 3.13925505 3.14159131 ------------------------------ Transdef: Tab for variable 11 5.05447388E-05 0.0102836192 0.0205636621 0.0293395519 0.0390666723 0.0464893579 0.0542063415 0.0620856285 0.0707210302 0.0794301629 0.0851794481 0.0920579433 0.0993511677 0.10639739 0.112770796 0.119223773 0.126145005 0.132268071 0.139386654 0.145396292 0.151008606 0.157644868 0.163848042 0.170551062 0.176127911 0.181831837 0.1880638 0.193229824 0.198518395 0.203926921 0.209008262 0.214290619 0.219209671 0.222969294 0.227324545 0.233015418 0.237676978 0.243528605 0.248791218 0.253304243 0.25783509 0.262395382 0.267474413 0.272664249 0.277855992 0.282018483 0.28702724 0.292772532 0.297544003 0.301689625 0.306946993 0.31248194 0.319092989 0.323365211 0.328876615 0.334548831 0.340545416 0.346667409 0.352345824 0.357919544 0.364661485 0.370536268 0.376819253 0.382737249 0.387997687 0.393779755 0.401310682 0.407549858 0.412380874 0.417976022 0.423854113 0.430943012 0.43736136 0.44222039 0.449571997 0.456532478 0.464019299 0.471541703 0.478709698 0.486630112 0.494550467 0.501650333 0.51054728 0.517388821 0.525577784 0.535247564 0.545448542 0.556688309 0.56697464 0.578932703 0.592789888 0.604510188 0.620203853 0.637942195 0.657457948 0.674865723 0.697038054 0.726129532 0.768079162 0.848389447 1.12525487 ------------------------------ Transdef: Tab for variable 12 0.200000167 0.208137691 0.215756223 0.223757565 0.231524646 0.239336044 0.246426031 0.253513843 0.260015905 0.266014546 0.273350716 0.279179811 0.28538534 0.291413069 0.297094226 0.302402377 0.307623386 0.313945293 0.319282651 0.324802577 0.32991904 0.333700061 0.34017396 0.346230268 0.351713479 0.356999487 0.362605602 0.367770463 0.374074817 0.3792274 0.383872628 0.388467789 0.393558741 0.398774624 0.402008563 0.407002628 0.411203951 0.415930003 0.420306683 0.424493104 0.429375231 0.434174985 0.438467503 0.442557931 0.446036816 0.449977934 0.453938067 0.457972795 0.462449253 0.466497123 0.470194101 0.475128919 0.4802984 0.485175133 0.49014467 0.494770229 0.499552488 0.505636096 0.51042062 0.514532447 0.519538283 0.523343444 0.527961731 0.532468081 0.536822736 0.541475296 0.546455741 0.550752759 0.554591298 0.559984565 0.565402746 0.571619391 0.576111734 0.581423879 0.585755885 0.592101097 0.597429395 0.603471041 0.609125018 0.615866303 0.622691154 0.629466772 0.635151863 0.642744303 0.648648798 0.657660365 0.664112449 0.672743797 0.681908011 0.689782143 0.700967312 0.712125063 0.723569572 0.73603332 0.753924489 0.775762379 0.793225646 0.82884872 0.865626693 0.918558478 1.12845647 ------------------------------ Transdef: Tab for variable 13 20.035202 21.1887131 21.8963356 22.4742661 22.9472713 23.3975849 23.7822113 24.2922955 24.7432098 25.0241165 25.4524879 25.8731899 26.3062401 26.6126862 26.9189205 27.2646446 27.533905 27.9136543 28.1939907 28.5054226 28.8039074 29.1315613 29.4837341 29.7708817 30.0543251 30.3265362 30.6085739 30.8274632 31.045948 31.2828369 31.4989052 31.8060303 32.1594925 32.4457397 32.7739563 33.0076141 33.2559738 33.487278 33.7994461 34.0934982 34.412529 34.633213 34.9070435 35.1642609 35.4682579 35.6898575 35.9453926 36.2407761 36.4859238 36.7701492 37.0627213 37.3614388 37.6101227 37.8681145 38.1334305 38.4097595 38.6910629 38.9597435 39.2455139 39.5678177 39.9196396 40.1861038 40.5671005 40.8539085 41.223156 41.5532379 41.9480896 42.3094826 42.7145767 43.1164474 43.5723343 44.0148087 44.4576797 44.9530182 45.4456863 45.8063126 46.2425957 46.8460503 47.3778152 48.090126 48.8085632 49.4140816 50.0810928 50.8204651 51.5595856 52.4904251 53.236599 54.2362556 55.211113 56.4943008 57.7096481 59.2177124 60.6987915 62.3201523 64.8029785 67.3113098 70.8354874 74.9788895 81.6391602 92.1112671 201.326797 ------------------------------ Transdef: Tab for variable 14 10.0034533 10.5185795 10.8567753 11.1195202 11.3696203 11.6115837 11.8439112 12.0114594 12.2199516 12.3567133 12.5387478 12.7406883 12.893404 13.0837135 13.2949238 13.4727726 13.6438923 13.8211842 13.9966602 14.1638813 14.3350067 14.4731016 14.6436481 14.8352833 15.0372047 15.1608686 15.3567591 15.5164394 15.6609802 15.8171082 15.9682999 16.1198044 16.3309326 16.5456848 16.7129707 16.8750801 17.0562286 17.234499 17.4151268 17.5944328 17.7772026 17.9455261 18.1273193 18.3140678 18.5036583 18.6935387 18.8971558 19.1236057 19.3316803 19.5404053 19.7332726 19.9287033 20.1079369 20.3227119 20.5143738 20.7292213 20.915514 21.0897884 21.3045921 21.5110664 21.718153 21.9030228 22.1666451 22.4139061 22.647831 22.8896294 23.1295586 23.3553925 23.5767059 23.8140259 24.08634 24.3197899 24.5688934 24.8718128 25.1601906 25.4252319 25.706749 25.9621277 26.2592621 26.6151619 26.9474602 27.2815266 27.7200775 28.1671238 28.5816536 29.0470848 29.4463215 29.947094 30.4866066 31.0897484 31.7136021 32.4088364 33.2444458 33.9844055 34.8327408 36.0159225 37.4109192 39.069809 41.5596008 46.1788406 79.005455 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 29.4 17.4 -4.2 1.1 17.0 26.7 8.6 19.9 -22.8 -1.0 -1.4 14.6 -6.1 2 29.4 100.0 60.8 40.4 13.1 58.2 94.1 56.3 85.9 -48.8 -19.4 -35.0 55.9 33.5 3 17.4 60.8 100.0 21.2 -5.3 25.1 62.8 41.8 68.9 -12.7 -22.1 -41.5 91.4 16.5 4 -4.2 40.4 21.2 100.0 0.4 19.1 40.7 30.3 48.2 -4.1 -25.0 -44.7 20.8 88.8 5 1.1 13.1 -5.3 0.4 100.0 82.0 -16.9 48.4 46.6 38.8 2.5 5.2 -5.9 -0.2 6 17.0 58.2 25.1 19.1 82.0 100.0 32.6 69.5 77.4 6.0 -7.6 -12.7 22.1 15.2 7 26.7 94.1 62.8 40.7 -16.9 32.6 100.0 46.1 70.8 -58.1 -20.0 -37.0 58.0 34.0 8 8.6 56.3 41.8 30.3 48.4 69.5 46.1 100.0 73.0 4.1 -14.7 -25.6 38.2 25.5 9 19.9 85.9 68.9 48.2 46.6 77.4 70.8 73.0 100.0 -13.4 -21.4 -39.6 63.2 40.7 10 -22.8 -48.8 -12.7 -4.1 38.8 6.0 -58.1 4.1 -13.4 100.0 4.7 6.8 -11.8 -3.0 11 -1.0 -19.4 -22.1 -25.0 2.5 -7.6 -20.0 -14.7 -21.4 4.7 100.0 56.0 -19.7 -24.6 12 -1.4 -35.0 -41.5 -44.7 5.2 -12.7 -37.0 -25.6 -39.6 6.8 56.0 100.0 -38.1 -36.2 13 14.6 55.9 91.4 20.8 -5.9 22.1 58.0 38.2 63.2 -11.8 -19.7 -38.1 100.0 24.9 14 -6.1 33.5 16.5 88.8 -0.2 15.2 34.0 25.5 40.7 -3.0 -24.6 -36.2 24.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 58.5534342 TOTAL CORRELATION OF ALL VARIABLES 37.5819359 ROUND 1: MAX CORR ( 37.5818719) AFTER KILLING INPUT VARIABLE 11 CONTR 0.0693614899 ROUND 2: MAX CORR ( 37.5786227) AFTER KILLING INPUT VARIABLE 4 CONTR 0.494172276 ROUND 3: MAX CORR ( 37.5604188) AFTER KILLING INPUT VARIABLE 13 CONTR 1.16954048 ROUND 4: MAX CORR ( 37.5114427) AFTER KILLING INPUT VARIABLE 8 CONTR 1.91747876 ROUND 5: MAX CORR ( 37.3580193) AFTER KILLING INPUT VARIABLE 12 CONTR 3.38920774 ROUND 6: MAX CORR ( 37.1070571) AFTER KILLING INPUT VARIABLE 5 CONTR 4.322953 ROUND 7: MAX CORR ( 36.8787503) AFTER KILLING INPUT VARIABLE 14 CONTR 4.10992263 ROUND 8: MAX CORR ( 36.458802) AFTER KILLING INPUT VARIABLE 10 CONTR 5.54959277 ROUND 9: MAX CORR ( 35.7206705) AFTER KILLING INPUT VARIABLE 6 CONTR 7.29917377 ROUND 10: MAX CORR ( 33.1850111) AFTER KILLING INPUT VARIABLE 3 CONTR 13.2182199 ROUND 11: MAX CORR ( 31.2595598) AFTER KILLING INPUT VARIABLE 7 CONTR 11.1393397 ROUND 12: MAX CORR ( 29.4374249) AFTER KILLING INPUT VARIABLE 9 CONTR 10.5165627 LAST REMAINING VARIABLE: 2 total correlation to target: 37.5819359 % total significance: 33.2042144 sigma correlations of single variables to target: variable 2: 29.4374249 % , in sigma: 26.0084145 variable 3: 17.3676656 % , in sigma: 15.3445978 variable 4: -4.16945787 % , in sigma: 3.68377971 variable 5: 1.0671599 % , in sigma: 0.942852068 variable 6: 16.9641867 % , in sigma: 14.9881181 variable 7: 26.6914082 % , in sigma: 23.5822668 variable 8: 8.56543183 % , in sigma: 7.56768985 variable 9: 19.9184737 % , in sigma: 17.5982757 variable 10: -22.8068066 % , in sigma: 20.150162 variable 11: -0.953487178 % , in sigma: 0.842420485 variable 12: -1.4059975 % , in sigma: 1.24222026 variable 13: 14.5519598 % , in sigma: 12.8568788 variable 14: -6.05480059 % , in sigma: 5.34950881 variables sorted by significance: 1 most relevant variable 2 corr 29.4374256 , in sigma: 26.0084152 2 most relevant variable 9 corr 10.5165625 , in sigma: 9.29154357 3 most relevant variable 7 corr 11.1393394 , in sigma: 9.84177654 4 most relevant variable 3 corr 13.2182198 , in sigma: 11.6784991 5 most relevant variable 6 corr 7.29917383 , in sigma: 6.44893157 6 most relevant variable 10 corr 5.54959297 , in sigma: 4.90315016 7 most relevant variable 14 corr 4.10992241 , in sigma: 3.63117922 8 most relevant variable 5 corr 4.32295322 , in sigma: 3.8193952 9 most relevant variable 12 corr 3.38920784 , in sigma: 2.99441689 10 most relevant variable 8 corr 1.9174788 , in sigma: 1.69412181 11 most relevant variable 13 corr 1.16954052 , in sigma: 1.03330692 12 most relevant variable 4 corr 0.494172275 , in sigma: 0.436608753 13 most relevant variable 11 corr 0.069361493 , in sigma: 0.0612819385 global correlations between input variables: variable 2: 99.3163643 % variable 3: 96.409683 % variable 4: 93.7625539 % variable 5: 96.3907382 % variable 6: 95.4288765 % variable 7: 98.9859989 % variable 8: 83.6662358 % variable 9: 98.9190791 % variable 10: 76.5037849 % variable 11: 57.5162621 % variable 12: 69.812633 % variable 13: 93.3718733 % variable 14: 91.5311304 % significance loss when removing single variables: variable 2: corr = 11.2266708 % , sigma = 9.91893509 variable 3: corr = 5.73297516 % , sigma = 5.06517112 variable 4: corr = 0.498168068 % , sigma = 0.440139097 variable 5: corr = 4.33289836 % , sigma = 3.82818188 variable 6: corr = 7.22896378 % , sigma = 6.38689992 variable 7: corr = 7.72884717 % , sigma = 6.82855453 variable 8: corr = 1.9035109 % , sigma = 1.68178096 variable 9: corr = 6.11208559 % , sigma = 5.40012098 variable 10: corr = 4.0022943 % , sigma = 3.53608815 variable 11: corr = 0.0693614899 % , sigma = 0.0612819357 variable 12: corr = 2.78891546 % , sigma = 2.46404941 variable 13: corr = 1.270258 % , sigma = 1.12229234 variable 14: corr = 2.33694305 % , sigma = 2.06472488 Keep only 6 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 7 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 9.0865221 sigma out 15 active outputs RANK 2 NODE 6 --> 7.79798985 sigma out 15 active outputs RANK 3 NODE 5 --> 6.63655996 sigma out 15 active outputs RANK 4 NODE 7 --> 6.62160683 sigma out 15 active outputs RANK 5 NODE 4 --> 6.40567207 sigma out 15 active outputs RANK 6 NODE 2 --> 5.77115059 sigma out 15 active outputs RANK 7 NODE 3 --> 4.50891256 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 9.537467 sigma in 7act. ( 9.09810352 sig out 1act.) RANK 2 NODE 14 --> 5.87021637 sigma in 7act. ( 6.10610533 sig out 1act.) RANK 3 NODE 15 --> 5.85808468 sigma in 7act. ( 6.26668167 sig out 1act.) RANK 4 NODE 4 --> 5.35453033 sigma in 7act. ( 5.31001568 sig out 1act.) RANK 5 NODE 3 --> 5.23143291 sigma in 7act. ( 5.90712929 sig out 1act.) RANK 6 NODE 7 --> 5.16194773 sigma in 7act. ( 4.83163261 sig out 1act.) RANK 7 NODE 5 --> 4.52212238 sigma in 7act. ( 4.9520402 sig out 1act.) RANK 8 NODE 13 --> 4.23057461 sigma in 7act. ( 4.56744146 sig out 1act.) RANK 9 NODE 8 --> 4.03480291 sigma in 7act. ( 3.52341032 sig out 1act.) RANK 10 NODE 6 --> 3.19726706 sigma in 7act. ( 3.43227124 sig out 1act.) RANK 11 NODE 2 --> 2.76805305 sigma in 7act. ( 2.97843146 sig out 1act.) RANK 12 NODE 9 --> 2.24960732 sigma in 7act. ( 2.19131923 sig out 1act.) RANK 13 NODE 1 --> 1.75916302 sigma in 7act. ( 1.15491283 sig out 1act.) RANK 14 NODE 11 --> 1.30950654 sigma in 7act. ( 0.476772189 sig out 1act.) RANK 15 NODE 10 --> 1.06111598 sigma in 7act. ( 0.396703959 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 9.09810352 sigma out 1act.( 9.537467 sig in 7act.) RANK 2 NODE 15 --> 6.26668167 sigma out 1act.( 5.85808468 sig in 7act.) RANK 3 NODE 14 --> 6.10610533 sigma out 1act.( 5.87021637 sig in 7act.) RANK 4 NODE 3 --> 5.90712929 sigma out 1act.( 5.23143291 sig in 7act.) RANK 5 NODE 4 --> 5.31001568 sigma out 1act.( 5.35453033 sig in 7act.) RANK 6 NODE 5 --> 4.9520402 sigma out 1act.( 4.52212238 sig in 7act.) RANK 7 NODE 7 --> 4.83163261 sigma out 1act.( 5.16194773 sig in 7act.) RANK 8 NODE 13 --> 4.56744146 sigma out 1act.( 4.23057461 sig in 7act.) RANK 9 NODE 8 --> 3.52341032 sigma out 1act.( 4.03480291 sig in 7act.) RANK 10 NODE 6 --> 3.43227124 sigma out 1act.( 3.19726706 sig in 7act.) RANK 11 NODE 2 --> 2.97843146 sigma out 1act.( 2.76805305 sig in 7act.) RANK 12 NODE 9 --> 2.19131923 sigma out 1act.( 2.24960732 sig in 7act.) RANK 13 NODE 1 --> 1.15491283 sigma out 1act.( 1.75916302 sig in 7act.) RANK 14 NODE 11 --> 0.476772189 sigma out 1act.( 1.30950654 sig in 7act.) RANK 15 NODE 10 --> 0.396703959 sigma out 1act.( 1.06111598 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 18.1861763 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 10.8212328 sigma out 15 active outputs RANK 2 NODE 1 --> 9.57765865 sigma out 15 active outputs RANK 3 NODE 2 --> 9.32586479 sigma out 15 active outputs RANK 4 NODE 4 --> 9.25220394 sigma out 15 active outputs RANK 5 NODE 7 --> 8.81881046 sigma out 15 active outputs RANK 6 NODE 5 --> 8.30668449 sigma out 15 active outputs RANK 7 NODE 3 --> 7.27592134 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 10.2974873 sigma in 7act. ( 9.09988022 sig out 1act.) RANK 2 NODE 14 --> 8.07739258 sigma in 7act. ( 6.28920984 sig out 1act.) RANK 3 NODE 4 --> 7.72795725 sigma in 7act. ( 5.51585054 sig out 1act.) RANK 4 NODE 3 --> 6.96456099 sigma in 7act. ( 6.05756712 sig out 1act.) RANK 5 NODE 5 --> 6.7574234 sigma in 7act. ( 5.65276432 sig out 1act.) RANK 6 NODE 15 --> 6.61602259 sigma in 7act. ( 6.85323 sig out 1act.) RANK 7 NODE 7 --> 6.2864337 sigma in 7act. ( 4.558043 sig out 1act.) RANK 8 NODE 6 --> 5.56749439 sigma in 7act. ( 4.09061384 sig out 1act.) RANK 9 NODE 8 --> 5.51293135 sigma in 7act. ( 3.2037077 sig out 1act.) RANK 10 NODE 1 --> 5.20719099 sigma in 7act. ( 1.639781 sig out 1act.) RANK 11 NODE 13 --> 4.94564342 sigma in 7act. ( 5.53614569 sig out 1act.) RANK 12 NODE 2 --> 4.65774107 sigma in 7act. ( 3.43140197 sig out 1act.) RANK 13 NODE 11 --> 3.80619669 sigma in 7act. ( 0.974045157 sig out 1act.) RANK 14 NODE 9 --> 3.7849462 sigma in 7act. ( 2.46316981 sig out 1act.) RANK 15 NODE 10 --> 3.03038931 sigma in 7act. ( 0.30709374 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 9.09988022 sigma out 1act.( 10.2974873 sig in 7act.) RANK 2 NODE 15 --> 6.85323 sigma out 1act.( 6.61602259 sig in 7act.) RANK 3 NODE 14 --> 6.28920984 sigma out 1act.( 8.07739258 sig in 7act.) RANK 4 NODE 3 --> 6.05756712 sigma out 1act.( 6.96456099 sig in 7act.) RANK 5 NODE 5 --> 5.65276432 sigma out 1act.( 6.7574234 sig in 7act.) RANK 6 NODE 13 --> 5.53614569 sigma out 1act.( 4.94564342 sig in 7act.) RANK 7 NODE 4 --> 5.51585054 sigma out 1act.( 7.72795725 sig in 7act.) RANK 8 NODE 7 --> 4.558043 sigma out 1act.( 6.2864337 sig in 7act.) RANK 9 NODE 6 --> 4.09061384 sigma out 1act.( 5.56749439 sig in 7act.) RANK 10 NODE 2 --> 3.43140197 sigma out 1act.( 4.65774107 sig in 7act.) RANK 11 NODE 8 --> 3.2037077 sigma out 1act.( 5.51293135 sig in 7act.) RANK 12 NODE 9 --> 2.46316981 sigma out 1act.( 3.7849462 sig in 7act.) RANK 13 NODE 1 --> 1.639781 sigma out 1act.( 5.20719099 sig in 7act.) RANK 14 NODE 11 --> 0.974045157 sigma out 1act.( 3.80619669 sig in 7act.) RANK 15 NODE 10 --> 0.30709374 sigma out 1act.( 3.03038931 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 19.193655 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.4129816 *** contribution from regularisation: 0.00920637324 *** contribution from error: -0.422187984 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.430529416 *** contribution from regularisation: 0.00542007247 *** contribution from error: -0.435949475 *********************************************** -----------------> Test sample ENTER BFGS code START -8653.06774 0.277755708 0.178013429 EXIT FROM BFGS code FG_START 0. 0.277755708 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.437063992 *** contribution from regularisation: 0.00366891036 *** contribution from error: -0.440732896 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -8782.36378 0.277755708 42.9727859 EXIT FROM BFGS code FG_LNSRCH 0. 0.333319336 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.455538034 *** contribution from regularisation: 0.00693534734 *** contribution from error: -0.462473392 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9153.58097 0.333319336 -13.1786041 EXIT FROM BFGS code NEW_X -9153.58097 0.333319336 -13.1786041 ENTER BFGS code NEW_X -9153.58097 0.333319336 -13.1786041 EXIT FROM BFGS code FG_LNSRCH 0. 0.327403247 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.459036827 *** contribution from regularisation: 0.00678943284 *** contribution from error: -0.465826273 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9223.88578 0.327403247 16.7440929 EXIT FROM BFGS code NEW_X -9223.88578 0.327403247 16.7440929 ENTER BFGS code NEW_X -9223.88578 0.327403247 16.7440929 EXIT FROM BFGS code FG_LNSRCH 0. 0.338008374 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.460135758 *** contribution from regularisation: 0.00628386578 *** contribution from error: -0.466419637 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9245.96809 0.338008374 11.4751635 EXIT FROM BFGS code NEW_X -9245.96809 0.338008374 11.4751635 ENTER BFGS code NEW_X -9245.96809 0.338008374 11.4751635 EXIT FROM BFGS code FG_LNSRCH 0. 0.371976376 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.461445123 *** contribution from regularisation: 0.00587579655 *** contribution from error: -0.467320919 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9272.2782 0.371976376 -1.75749326 EXIT FROM BFGS code NEW_X -9272.2782 0.371976376 -1.75749326 ENTER BFGS code NEW_X -9272.2782 0.371976376 -1.75749326 EXIT FROM BFGS code FG_LNSRCH 0. 0.391144425 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.462506801 *** contribution from regularisation: 0.00556625426 *** contribution from error: -0.46807304 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9293.61194 0.391144425 -2.33281446 EXIT FROM BFGS code NEW_X -9293.61194 0.391144425 -2.33281446 ENTER BFGS code NEW_X -9293.61194 0.391144425 -2.33281446 EXIT FROM BFGS code FG_LNSRCH 0. 0.507783175 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.465449661 *** contribution from regularisation: 0.00580571173 *** contribution from error: -0.471255362 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9352.7452 0.507783175 -6.62142849 EXIT FROM BFGS code NEW_X -9352.7452 0.507783175 -6.62142849 ENTER BFGS code NEW_X -9352.7452 0.507783175 -6.62142849 EXIT FROM BFGS code FG_LNSRCH 0. 0.547671437 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 7 --> 19.2005482 sigma out 15 active outputs RANK 2 NODE 4 --> 17.1449986 sigma out 15 active outputs RANK 3 NODE 1 --> 15.9934759 sigma out 15 active outputs RANK 4 NODE 2 --> 11.9814749 sigma out 15 active outputs RANK 5 NODE 6 --> 6.46566343 sigma out 15 active outputs RANK 6 NODE 5 --> 6.30453491 sigma out 15 active outputs RANK 7 NODE 3 --> 5.71584511 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 25.6365967 sigma in 7act. ( 26.2293472 sig out 1act.) RANK 2 NODE 1 --> 16.7480488 sigma in 7act. ( 17.6341476 sig out 1act.) RANK 3 NODE 12 --> 9.56791782 sigma in 7act. ( 10.3869743 sig out 1act.) RANK 4 NODE 2 --> 6.07038021 sigma in 7act. ( 4.62393188 sig out 1act.) RANK 5 NODE 11 --> 5.8905015 sigma in 7act. ( 4.28987026 sig out 1act.) RANK 6 NODE 4 --> 3.39061379 sigma in 7act. ( 2.12614584 sig out 1act.) RANK 7 NODE 6 --> 3.28587985 sigma in 7act. ( 2.12111306 sig out 1act.) RANK 8 NODE 14 --> 3.13516307 sigma in 7act. ( 1.8874507 sig out 1act.) RANK 9 NODE 9 --> 2.94274068 sigma in 7act. ( 2.12328196 sig out 1act.) RANK 10 NODE 3 --> 2.72772741 sigma in 7act. ( 2.16773605 sig out 1act.) RANK 11 NODE 15 --> 2.55035949 sigma in 7act. ( 1.29487598 sig out 1act.) RANK 12 NODE 7 --> 2.50260997 sigma in 7act. ( 0.0929977298 sig out 1act.) RANK 13 NODE 10 --> 2.30423689 sigma in 7act. ( 2.1285758 sig out 1act.) RANK 14 NODE 8 --> 2.16762614 sigma in 7act. ( 0.125336766 sig out 1act.) RANK 15 NODE 13 --> 2.08780003 sigma in 7act. ( 0.862573028 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 26.2293472 sigma out 1act.( 25.6365967 sig in 7act.) RANK 2 NODE 1 --> 17.6341476 sigma out 1act.( 16.7480488 sig in 7act.) RANK 3 NODE 12 --> 10.3869743 sigma out 1act.( 9.56791782 sig in 7act.) RANK 4 NODE 2 --> 4.62393188 sigma out 1act.( 6.07038021 sig in 7act.) RANK 5 NODE 11 --> 4.28987026 sigma out 1act.( 5.8905015 sig in 7act.) RANK 6 NODE 3 --> 2.16773605 sigma out 1act.( 2.72772741 sig in 7act.) RANK 7 NODE 10 --> 2.1285758 sigma out 1act.( 2.30423689 sig in 7act.) RANK 8 NODE 4 --> 2.12614584 sigma out 1act.( 3.39061379 sig in 7act.) RANK 9 NODE 9 --> 2.12328196 sigma out 1act.( 2.94274068 sig in 7act.) RANK 10 NODE 6 --> 2.12111306 sigma out 1act.( 3.28587985 sig in 7act.) RANK 11 NODE 14 --> 1.8874507 sigma out 1act.( 3.13516307 sig in 7act.) RANK 12 NODE 15 --> 1.29487598 sigma out 1act.( 2.55035949 sig in 7act.) RANK 13 NODE 13 --> 0.862573028 sigma out 1act.( 2.08780003 sig in 7act.) RANK 14 NODE 8 --> 0.125336766 sigma out 1act.( 2.16762614 sig in 7act.) RANK 15 NODE 7 --> 0.0929977298 sigma out 1act.( 2.50260997 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 34.2838211 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.468977988 *** contribution from regularisation: 0.0064219893 *** contribution from error: -0.475399971 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -9423.64362 0.547671437 -14.5022583 EXIT FROM BFGS code NEW_X -9423.64362 0.547671437 -14.5022583 ENTER BFGS code NEW_X -9423.64362 0.547671437 -14.5022583 EXIT FROM BFGS code FG_LNSRCH 0. 0.569485068 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.470622301 *** contribution from regularisation: 0.00721403351 *** contribution from error: -0.477836341 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9456.68435 0.569485068 -8.65480328 EXIT FROM BFGS code NEW_X -9456.68435 0.569485068 -8.65480328 ENTER BFGS code NEW_X -9456.68435 0.569485068 -8.65480328 EXIT FROM BFGS code FG_LNSRCH 0. 0.52058363 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.472349823 *** contribution from regularisation: 0.00607603695 *** contribution from error: -0.47842586 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9491.39719 0.52058363 -17.8576832 EXIT FROM BFGS code NEW_X -9491.39719 0.52058363 -17.8576832 ENTER BFGS code NEW_X -9491.39719 0.52058363 -17.8576832 EXIT FROM BFGS code FG_LNSRCH 0. 0.458888888 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.472945482 *** contribution from regularisation: 0.00650282437 *** contribution from error: -0.479448318 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9503.36629 0.458888888 -11.9763956 EXIT FROM BFGS code NEW_X -9503.36629 0.458888888 -11.9763956 ENTER BFGS code NEW_X -9503.36629 0.458888888 -11.9763956 EXIT FROM BFGS code FG_LNSRCH 0. 0.349402905 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.47417444 *** contribution from regularisation: 0.00738208974 *** contribution from error: -0.481556535 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9528.0614 0.349402905 -22.4111805 EXIT FROM BFGS code NEW_X -9528.0614 0.349402905 -22.4111805 ENTER BFGS code NEW_X -9528.0614 0.349402905 -22.4111805 EXIT FROM BFGS code FG_LNSRCH 0. 0.322052449 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.475704312 *** contribution from regularisation: 0.00746715488 *** contribution from error: -0.483171463 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9558.80253 0.322052449 1.33293045 EXIT FROM BFGS code NEW_X -9558.80253 0.322052449 1.33293045 ENTER BFGS code NEW_X -9558.80253 0.322052449 1.33293045 EXIT FROM BFGS code FG_LNSRCH 0. 0.311410278 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.475913197 *** contribution from regularisation: 0.00769905467 *** contribution from error: -0.483612239 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9562.99978 0.311410278 0.518881083 EXIT FROM BFGS code NEW_X -9562.99978 0.311410278 0.518881083 ENTER BFGS code NEW_X -9562.99978 0.311410278 0.518881083 EXIT FROM BFGS code FG_LNSRCH 0. 0.277442843 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.476713389 *** contribution from regularisation: 0.00787253492 *** contribution from error: -0.484585911 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9579.07865 0.277442843 -0.291307747 EXIT FROM BFGS code NEW_X -9579.07865 0.277442843 -0.291307747 ENTER BFGS code NEW_X -9579.07865 0.277442843 -0.291307747 EXIT FROM BFGS code FG_LNSRCH 0. 0.245071828 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.476878524 *** contribution from regularisation: 0.00808614399 *** contribution from error: -0.484964669 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9582.39721 0.245071828 -14.7087727 EXIT FROM BFGS code NEW_X -9582.39721 0.245071828 -14.7087727 ENTER BFGS code NEW_X -9582.39721 0.245071828 -14.7087727 EXIT FROM BFGS code FG_LNSRCH 0. 0.233897805 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.477198958 *** contribution from regularisation: 0.00787542108 *** contribution from error: -0.485074371 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9588.83569 0.233897805 -9.3075676 EXIT FROM BFGS code NEW_X -9588.83569 0.233897805 -9.3075676 ENTER BFGS code NEW_X -9588.83569 0.233897805 -9.3075676 EXIT FROM BFGS code FG_LNSRCH 0. 0.200710118 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 44.7595901 sigma out 15 active outputs RANK 2 NODE 4 --> 35.6096382 sigma out 15 active outputs RANK 3 NODE 7 --> 33.3099174 sigma out 15 active outputs RANK 4 NODE 3 --> 11.3965693 sigma out 15 active outputs RANK 5 NODE 2 --> 9.42121601 sigma out 15 active outputs RANK 6 NODE 6 --> 9.20667744 sigma out 15 active outputs RANK 7 NODE 5 --> 6.19812679 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 63.1122169 sigma in 7act. ( 60.452076 sig out 1act.) RANK 2 NODE 1 --> 18.8365993 sigma in 7act. ( 18.8111191 sig out 1act.) RANK 3 NODE 12 --> 12.2337017 sigma in 7act. ( 13.1254692 sig out 1act.) RANK 4 NODE 10 --> 6.19441271 sigma in 7act. ( 6.66721344 sig out 1act.) RANK 5 NODE 14 --> 6.15341997 sigma in 7act. ( 6.64765072 sig out 1act.) RANK 6 NODE 3 --> 5.90257502 sigma in 7act. ( 6.30700302 sig out 1act.) RANK 7 NODE 2 --> 5.58498764 sigma in 7act. ( 4.73191643 sig out 1act.) RANK 8 NODE 7 --> 5.32235861 sigma in 7act. ( 5.6811986 sig out 1act.) RANK 9 NODE 11 --> 5.31360722 sigma in 7act. ( 4.63533401 sig out 1act.) RANK 10 NODE 4 --> 3.40935183 sigma in 7act. ( 3.4318347 sig out 1act.) RANK 11 NODE 8 --> 3.182096 sigma in 7act. ( 3.34398603 sig out 1act.) RANK 12 NODE 13 --> 2.94956207 sigma in 7act. ( 2.79225302 sig out 1act.) RANK 13 NODE 15 --> 1.57452333 sigma in 7act. ( 1.27780056 sig out 1act.) RANK 14 NODE 9 --> 1.43189418 sigma in 7act. ( 0.784489632 sig out 1act.) RANK 15 NODE 6 --> 1.18191791 sigma in 7act. ( 0.346920937 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 60.452076 sigma out 1act.( 63.1122169 sig in 7act.) RANK 2 NODE 1 --> 18.8111191 sigma out 1act.( 18.8365993 sig in 7act.) RANK 3 NODE 12 --> 13.1254692 sigma out 1act.( 12.2337017 sig in 7act.) RANK 4 NODE 10 --> 6.66721344 sigma out 1act.( 6.19441271 sig in 7act.) RANK 5 NODE 14 --> 6.64765072 sigma out 1act.( 6.15341997 sig in 7act.) RANK 6 NODE 3 --> 6.30700302 sigma out 1act.( 5.90257502 sig in 7act.) RANK 7 NODE 7 --> 5.6811986 sigma out 1act.( 5.32235861 sig in 7act.) RANK 8 NODE 2 --> 4.73191643 sigma out 1act.( 5.58498764 sig in 7act.) RANK 9 NODE 11 --> 4.63533401 sigma out 1act.( 5.31360722 sig in 7act.) RANK 10 NODE 4 --> 3.4318347 sigma out 1act.( 3.40935183 sig in 7act.) RANK 11 NODE 8 --> 3.34398603 sigma out 1act.( 3.182096 sig in 7act.) RANK 12 NODE 13 --> 2.79225302 sigma out 1act.( 2.94956207 sig in 7act.) RANK 13 NODE 15 --> 1.27780056 sigma out 1act.( 1.57452333 sig in 7act.) RANK 14 NODE 9 --> 0.784489632 sigma out 1act.( 1.43189418 sig in 7act.) RANK 15 NODE 6 --> 0.346920937 sigma out 1act.( 1.18191791 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.4702148 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.477014929 *** contribution from regularisation: 0.00683688046 *** contribution from error: -0.48385182 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -9585.13799 0.200710118 4.33446121 EXIT FROM BFGS code FG_LNSRCH 0. 0.224632233 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.474961519 *** contribution from regularisation: 0.00999243371 *** contribution from error: -0.48495394 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9543.87689 0.224632233 -6.18732119 EXIT FROM BFGS code FG_LNSRCH 0. 0.233630553 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.476864845 *** contribution from regularisation: 0.00820805412 *** contribution from error: -0.485072911 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9582.12198 0.233630553 -9.17785645 EXIT FROM BFGS code FG_LNSRCH 0. 0.233896151 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.476806641 *** contribution from regularisation: 0.00826777611 *** contribution from error: -0.485074431 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9580.95262 0.233896151 -9.26315784 EXIT FROM BFGS code FG_LNSRCH 0. 0.233897805 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.476887554 *** contribution from regularisation: 0.00818682741 *** contribution from error: -0.485074371 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9582.57829 0.233897805 -9.26487541 EXIT FROM BFGS code FG_LNSRCH 0. 0.233897805 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.476778269 *** contribution from regularisation: 0.00829610508 *** contribution from error: -0.485074371 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9580.38246 0.233897805 -9.25884628 EXIT FROM BFGS code FG_LNSRCH 0. 0.233897805 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.476820529 *** contribution from regularisation: 0.00825384073 *** contribution from error: -0.485074371 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9581.23172 0.233897805 -9.25448418 EXIT FROM BFGS code FG_LNSRCH 0. 0.233897805 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.476786077 *** contribution from regularisation: 0.00828829221 *** contribution from error: -0.485074371 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9580.53946 0.233897805 -9.23944569 EXIT FROM BFGS code NEW_X -9580.53946 0.233897805 -9.23944569 ENTER BFGS code NEW_X -9580.53946 0.233897805 -9.23944569 EXIT FROM BFGS code CONVERGENC -9580.53946 0.233897805 -9.23944569 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 74.0679703 sigma out 15 active outputs RANK 2 NODE 4 --> 61.6310959 sigma out 15 active outputs RANK 3 NODE 7 --> 54.5019226 sigma out 15 active outputs RANK 4 NODE 3 --> 21.5148373 sigma out 15 active outputs RANK 5 NODE 2 --> 20.0957375 sigma out 15 active outputs RANK 6 NODE 6 --> 12.0588465 sigma out 15 active outputs RANK 7 NODE 5 --> 9.82568455 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 107.245613 sigma in 7act. ( 97.4447403 sig out 1act.) RANK 2 NODE 1 --> 31.76437 sigma in 7act. ( 33.3452606 sig out 1act.) RANK 3 NODE 12 --> 19.7148247 sigma in 7act. ( 21.8329639 sig out 1act.) RANK 4 NODE 2 --> 8.65487576 sigma in 7act. ( 7.77007151 sig out 1act.) RANK 5 NODE 14 --> 8.47581673 sigma in 7act. ( 9.22267818 sig out 1act.) RANK 6 NODE 10 --> 8.31583023 sigma in 7act. ( 9.01412487 sig out 1act.) RANK 7 NODE 3 --> 7.96859407 sigma in 7act. ( 8.54297066 sig out 1act.) RANK 8 NODE 11 --> 7.62105799 sigma in 7act. ( 7.13812637 sig out 1act.) RANK 9 NODE 7 --> 7.37219048 sigma in 7act. ( 7.83162498 sig out 1act.) RANK 10 NODE 4 --> 5.17850351 sigma in 7act. ( 5.28828096 sig out 1act.) RANK 11 NODE 8 --> 4.24456358 sigma in 7act. ( 4.47351599 sig out 1act.) RANK 12 NODE 13 --> 3.98238158 sigma in 7act. ( 3.79908252 sig out 1act.) RANK 13 NODE 15 --> 2.34742928 sigma in 7act. ( 2.0387876 sig out 1act.) RANK 14 NODE 9 --> 1.95174646 sigma in 7act. ( 1.194435 sig out 1act.) RANK 15 NODE 6 --> 1.57896066 sigma in 7act. ( 0.491822153 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 97.4447403 sigma out 1act.( 107.245613 sig in 7act.) RANK 2 NODE 1 --> 33.3452606 sigma out 1act.( 31.76437 sig in 7act.) RANK 3 NODE 12 --> 21.8329639 sigma out 1act.( 19.7148247 sig in 7act.) RANK 4 NODE 14 --> 9.22267818 sigma out 1act.( 8.47581673 sig in 7act.) RANK 5 NODE 10 --> 9.01412487 sigma out 1act.( 8.31583023 sig in 7act.) RANK 6 NODE 3 --> 8.54297066 sigma out 1act.( 7.96859407 sig in 7act.) RANK 7 NODE 7 --> 7.83162498 sigma out 1act.( 7.37219048 sig in 7act.) RANK 8 NODE 2 --> 7.77007151 sigma out 1act.( 8.65487576 sig in 7act.) RANK 9 NODE 11 --> 7.13812637 sigma out 1act.( 7.62105799 sig in 7act.) RANK 10 NODE 4 --> 5.28828096 sigma out 1act.( 5.17850351 sig in 7act.) RANK 11 NODE 8 --> 4.47351599 sigma out 1act.( 4.24456358 sig in 7act.) RANK 12 NODE 13 --> 3.79908252 sigma out 1act.( 3.98238158 sig in 7act.) RANK 13 NODE 15 --> 2.0387876 sigma out 1act.( 2.34742928 sig in 7act.) RANK 14 NODE 9 --> 1.194435 sigma out 1act.( 1.95174646 sig in 7act.) RANK 15 NODE 6 --> 0.491822153 sigma out 1act.( 1.57896066 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 107.537224 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.47689414 *** contribution from regularisation: 0.00818023365 *** contribution from error: -0.485074371 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25167 Closing output file done