NNInput NNInputs_170.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 198265 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 51330 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 51330 Chosen entries: 51330 Signal fraction: 1 Background fraction: 0.349338 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 51330 Entries to split: 51330 Test with : 25665 Train with : 25665 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 51330 for Signal Prepared event 0 for Signal with 51330 events ====Entry 0 Variable Ht : 206.347 Variable LepAPt : 36.1308 Variable LepBPt : 29.2247 Variable MetSigLeptonsJets : 10.199 Variable MetSpec : 96.7965 Variable SumEtLeptonsJets : 102.892 Variable VSumJetLeptonsPt : 40.6877 Variable addEt : 168.81 Variable dPhiLepSumMet : 2.54625 Variable dPhiLeptons : 0.182576 Variable dRLeptons : 0.326 Variable lep1_E : 42.5211 Variable lep2_E : 30.6986 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2170 Ht = 206.347 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.1308 LepAPt = 36.1308 LepBEt = 29.225 LepBPt = 29.2247 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 103.455 MetDelPhi = 1.21007 MetSig = 7.81518 MetSigLeptonsJets = 10.199 MetSpec = 96.7965 Mjj = 0 MostCentralJetEta = -1.03827 MtllMet = 173.786 Njets = 1 SB = 0 SumEt = 175.236 SumEtJets = 0 SumEtLeptonsJets = 102.892 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 40.6877 addEt = 168.81 dPhiLepSumMet = 2.54625 dPhiLeptons = 0.182576 dRLeptons = 0.326 diltype = 47 dimass = 10.613 event = 34 jet1_Et = 37.5368 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 42.5211 lep2_E = 30.6986 rand = 0.999742 run = 175066 weight = 3.57526e-06 ===Show End Prepared event 10000 for Signal with 51330 events Prepared event 20000 for Signal with 51330 events Prepared event 30000 for Signal with 51330 events Prepared event 40000 for Signal with 51330 events Prepared event 50000 for Signal with 51330 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.270542 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4403 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 198265 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4403 negative weights. Signal fraction: 62.9289322 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 48.8991051 62.1908951 64.731781 66.43396 67.8095398 68.8880386 70.0645905 70.8068924 71.6664429 72.5097961 73.4284973 74.0097504 74.5556793 75.3690948 75.858963 76.6880035 77.2590332 77.865036 78.4676056 79.0044556 79.6390686 80.2919617 80.9621887 81.7797928 82.4281464 83.1703186 84.0722122 85.1178741 86.1289215 87.276123 88.615036 90.1578445 91.9273529 93.5645218 95.402832 96.9167786 98.7895355 100.577217 102.200882 103.986595 105.726448 107.449112 109.203735 110.98909 112.737991 114.572754 116.484482 118.230072 120.317398 121.963211 123.747787 125.550247 127.2127 129.008743 130.757385 132.529449 134.197144 135.880585 137.460205 139.10556 140.749756 142.341095 143.667633 145.104797 146.674911 148.207825 149.721939 151.220245 152.783234 154.163544 155.700012 157.290833 158.776001 160.41803 162.03923 163.793335 165.559128 167.501068 169.345459 171.54245 173.847137 176.386139 178.970612 181.479919 184.267914 187.335632 190.477051 193.847275 197.360641 201.270325 205.628143 210.237335 214.945892 220.551788 227.344299 235.229736 246.074036 260.689758 281.044922 316.851624 843.047852 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.2908478 20.6204166 20.9033871 21.1918411 21.4538021 21.6897526 21.9108181 22.1496201 22.3885727 22.6092415 22.8328438 23.0656815 23.2706585 23.5232334 23.7405415 23.9420319 24.1830769 24.3994846 24.6338139 24.8710251 25.1180058 25.3421154 25.5605297 25.7340469 25.9495773 26.1946449 26.4120064 26.6616707 26.8914528 27.111042 27.3073921 27.5611115 27.8111629 28.0351391 28.210495 28.4710503 28.7446404 29.0121803 29.2157383 29.4638367 29.7536392 30.061861 30.3499279 30.6293182 30.9313736 31.2341881 31.5617714 31.8710384 32.1800652 32.5141678 32.8454971 33.1720734 33.5421448 33.8447876 34.1745453 34.5311813 34.8968086 35.2630272 35.5742989 35.9388733 36.2990265 36.6403961 36.9999466 37.3592072 37.738678 38.1008377 38.4837418 38.875679 39.260067 39.6437912 39.9857445 40.3919258 40.7444153 41.1947937 41.6283417 42.0991211 42.5495377 43.046196 43.4896164 44.0104294 44.5457687 45.0460587 45.6069603 46.1998596 46.8328476 47.4195938 48.0284958 48.7276001 49.5305176 50.42136 51.3502197 52.2860794 53.3996506 54.6565094 56.1834641 58.0376053 60.7977066 64.5895462 71.7778473 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1119308 10.2282639 10.3539944 10.4574051 10.589797 10.691721 10.8113613 10.9385605 11.0616226 11.2110424 11.3477535 11.5029726 11.6586742 11.7908373 11.968914 12.1262455 12.246769 12.4072657 12.5871525 12.758112 12.9122601 13.1149178 13.2945576 13.477706 13.6430988 13.8162689 14.0056553 14.1815853 14.3795452 14.586092 14.8028994 15.0228205 15.2597408 15.4470463 15.6655331 15.8776379 16.1262817 16.388176 16.62883 16.8684883 17.1276665 17.3834419 17.6984997 17.9584808 18.226263 18.505764 18.8018894 19.0750961 19.3568687 19.6597652 19.9516792 20.244751 20.5516987 20.8635139 21.1679878 21.4476128 21.7622986 22.0611687 22.3706188 22.6858273 22.9924545 23.3197136 23.6662502 23.9751701 24.2843838 24.606987 24.9451103 25.3022423 25.6273022 25.9681053 26.2844925 26.5981979 26.9462357 27.2546272 27.5877571 27.9210777 28.2587967 28.5793705 28.9228172 29.3059921 29.6827793 30.0652237 30.431633 30.8470993 31.2834187 31.7221794 32.1632271 32.6601067 33.1372108 33.6508904 34.2009811 34.8166771 35.4797363 36.2282486 37.0633392 38.1654892 39.543602 41.8285675 45.9345169 74.0718307 ------------------------------ Transdef: Tab for variable 5 1.23662496 2.67670155 3.06645823 3.36144519 3.63361168 3.84141374 4.02684736 4.17428493 4.30226231 4.42546368 4.53940201 4.64971447 4.75269222 4.85202503 4.95524406 5.02572727 5.10033464 5.16735506 5.23756981 5.29094982 5.35284519 5.40505886 5.45636463 5.51588631 5.5680542 5.62018871 5.66662693 5.72012043 5.77305317 5.82221889 5.87441874 5.9187479 5.96989441 6.01633644 6.06393909 6.10743809 6.1581645 6.20928907 6.25291967 6.28840494 6.32943916 6.37655544 6.42251015 6.46497154 6.51007175 6.55434132 6.60503292 6.65227509 6.69331121 6.74469852 6.7881937 6.83352852 6.8735466 6.92890358 6.98173904 7.03661203 7.08570242 7.14233017 7.19791317 7.25596905 7.31510162 7.3742547 7.43461084 7.4952755 7.54993153 7.61036301 7.66802406 7.73278284 7.79333639 7.85430813 7.91837692 7.97955179 8.04287148 8.11287498 8.17943668 8.23934746 8.29953671 8.36831093 8.42757225 8.49104118 8.55771828 8.61872673 8.68950844 8.76546288 8.84145927 8.91580582 8.98967552 9.06947994 9.15483284 9.25015259 9.35459518 9.46435356 9.58284378 9.71042633 9.8687439 10.0623064 10.3030319 10.5893269 11.0417004 11.8083057 20.3265991 ------------------------------ Transdef: Tab for variable 6 15.0089226 20.8517284 25.1327057 26.1568947 27.0966988 27.9125748 28.8051319 29.5641193 30.2694321 30.9483795 31.5372849 32.1820374 32.7466507 33.2383919 33.6915474 34.1841583 34.6534119 34.9860039 35.4829369 35.9477768 36.3257294 36.6462517 37.0179253 37.4175911 37.7678604 38.1006317 38.4948044 38.864975 39.275589 39.6229897 39.9922485 40.3435783 40.7051315 41.0911942 41.4944916 41.9705429 42.4198074 42.823143 43.290657 43.8314285 44.354702 44.8583221 45.6061783 46.299118 46.9740753 47.7442703 48.5023766 49.2185783 50.0428886 50.6666756 51.4222145 52.311039 53.1176987 54.0310135 54.8168335 55.6127167 56.4278183 57.2364273 58.1135178 58.9942093 59.8384857 60.7432289 61.6497459 62.4753036 63.2671509 64.1971512 64.9694443 65.8226776 66.6486664 67.5485535 68.3921051 69.2256775 70.1187057 70.9509659 71.7411499 72.5664978 73.3681335 74.2196808 75.0045929 75.8147812 76.6767578 77.53022 78.3376236 79.2005844 80.175766 81.1791077 82.2454071 83.3659668 84.5740356 85.7952805 87.1560669 88.8316193 90.7527161 92.9844284 95.7038116 98.845047 102.75354 107.531212 114.895386 127.740082 320.548706 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.5626221 33.5346298 34.1485748 34.7478027 35.2847633 35.660347 36.1083374 36.4685707 36.8738708 37.2531242 37.5753708 37.8930893 38.2108078 38.5317497 38.7849731 39.0837975 39.3491173 39.622551 39.9751015 40.3042641 40.6634102 41.0501328 41.4136124 41.7812119 42.1377487 42.6506119 43.2700806 44.0000076 44.7892342 45.3898392 46.1983643 47.1376114 48.1449738 49.1681366 50.4133224 51.4357147 52.5835152 53.5848389 54.5988159 55.6016312 56.542057 57.5881271 58.5246124 59.469738 60.3829422 61.3469238 62.2815399 63.2526093 64.1694183 65.155014 66.0077057 66.9212036 67.8756714 68.7835388 69.7634735 70.6200104 71.5359955 72.4230423 73.3442154 74.1400299 75.033432 75.9454117 76.7706375 77.6676178 78.6374741 79.6587677 80.6014023 81.7282562 82.8768311 84.1907501 85.607132 87.0120773 88.5343933 90.0788879 91.661377 93.3119049 94.8844299 96.5575562 98.3144073 100.118912 102.072136 104.140709 106.424164 108.442192 110.827087 113.251984 115.97113 119.090736 122.411743 126.057236 129.878174 134.430573 139.398926 145.276672 152.418594 161.067566 172.887756 187.822083 216.247711 527.566101 ------------------------------ Transdef: Tab for variable 8 0.678276479 24.7338104 29.125473 30.8690948 31.9021835 32.5775604 33.1970749 33.7164612 34.1103325 34.5532227 34.9517136 35.2627449 35.6068192 35.9971237 36.3131485 36.6176567 36.9311714 37.2201538 37.4370651 37.7292747 37.9880028 38.2256699 38.5410309 38.7891846 39.06353 39.3221512 39.6332626 39.985054 40.2671814 40.5306702 40.8802261 41.2197952 41.5911865 41.9535561 42.3830719 42.8438797 43.4335403 43.9979782 44.4881287 45.1197052 45.6849899 46.3346405 47.0055161 47.7539711 48.459671 49.1942635 49.8942261 50.6818352 51.4130554 52.1959381 52.9479599 53.6754723 54.4556694 55.2447548 56.0162659 56.8342094 57.5827255 58.2862778 58.9953766 59.7310371 60.4502945 61.2790146 62.0180817 62.7455597 63.4624634 64.2217865 64.9337616 65.6573792 66.3380432 67.0500488 67.7932968 68.5163879 69.3372116 70.0623398 70.8362274 71.6119614 72.3845215 73.172287 73.9489746 74.7566681 75.5092316 76.2700653 76.9626007 77.8240662 78.7574539 79.712059 80.6820679 81.8250885 82.9876251 84.3465195 85.8787079 87.5832825 89.461441 91.9642334 94.5650787 97.7910156 101.722122 106.832382 114.515915 128.873428 364.944763 ------------------------------ Transdef: Tab for variable 9 48.8581314 61.5812378 64.168045 65.8422394 67.1908569 68.3376999 69.2309265 70.1088638 70.7508392 71.5354462 72.2545013 73.0895233 73.7847595 74.272583 74.8921356 75.4904861 76.0081177 76.6629181 77.1602173 77.7275925 78.2854233 78.7114868 79.2660522 79.7459564 80.3657379 80.9611511 81.6260834 82.2149887 82.7548523 83.4688263 84.2858582 85.2034378 86.0250931 86.9840851 87.9850159 89.2211761 90.391449 91.8681488 92.988884 94.5688095 95.9410248 97.3427887 98.8516235 100.435829 101.744049 103.16716 104.767502 106.07959 107.430855 108.96582 110.460236 111.977615 113.384018 114.848236 116.452744 117.777908 119.254501 120.785767 122.248322 123.575821 124.97229 126.288445 127.563004 128.95752 130.308746 131.772888 133.079819 134.392639 135.714127 137.011902 138.202927 139.469818 140.755402 141.985535 143.141006 144.27533 145.444778 146.649475 147.825134 148.994797 150.202133 151.408508 152.588623 153.708435 154.841309 155.890945 157.16069 158.338928 159.67392 161.023163 162.459167 164.059494 165.786774 167.783264 169.871933 172.351715 175.487915 179.822159 186.555603 202.013031 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.11660504 1.44209671 1.64697838 1.8047893 1.91235042 2.01871204 2.10140324 2.18164325 2.24155092 2.2946229 2.33961558 2.38462973 2.42318201 2.4595294 2.49100542 2.52246666 2.55041981 2.57495952 2.60131645 2.6265626 2.6513257 2.67350531 2.69278312 2.71223974 2.72853017 2.74692249 2.76356697 2.77728224 2.7921257 2.80819225 2.82203436 2.83230567 2.84442091 2.85478067 2.86531115 2.87597513 2.88645983 2.89589596 2.90365934 2.91141486 2.91827726 2.92615891 2.93328476 2.94082737 2.94839859 2.954777 2.96135116 2.96725655 2.97298288 2.97863841 2.98424435 2.98913932 2.99358606 2.99858856 3.00409889 3.00847721 3.01362801 3.01774049 3.02193904 3.02609396 3.02989721 3.03375363 3.03789806 3.04188538 3.04575229 3.04935169 3.05306816 3.0566082 3.05942297 3.06266928 3.06624842 3.06950712 3.0728054 3.07548809 3.07850075 3.08167005 3.08488369 3.08788276 3.09041023 3.09333563 3.09578371 3.09848404 3.10091257 3.10340691 3.10567641 3.10832167 3.11089611 3.1135323 3.11611128 3.11845541 3.12101579 3.12331676 3.12584543 3.1279583 3.13003063 3.13225889 3.13416433 3.13651848 3.13890171 3.14159226 ------------------------------ Transdef: Tab for variable 11 4.88758087E-06 0.0057861805 0.011453256 0.0182023756 0.0241193771 0.0305299759 0.037853878 0.0449187756 0.0516500473 0.0586397648 0.0654785037 0.0724872947 0.0790217966 0.0855497569 0.0923100114 0.0992356539 0.106470346 0.112749696 0.119604677 0.126438737 0.132934809 0.139500082 0.146082997 0.15305689 0.158771813 0.165231466 0.171211004 0.176788181 0.182717562 0.188719451 0.19438991 0.199240133 0.203605652 0.207865864 0.212328136 0.216105461 0.220768929 0.225209475 0.229833007 0.234299183 0.239149928 0.243953228 0.248598576 0.253519654 0.258346677 0.262551069 0.267049968 0.271631271 0.276792645 0.281417847 0.285852551 0.291041493 0.296409309 0.301031828 0.306200981 0.311257124 0.316448152 0.32195735 0.326958954 0.332741022 0.338075936 0.343494356 0.34921658 0.354734659 0.359573841 0.36526823 0.371202946 0.376978129 0.383867383 0.389835238 0.397104263 0.403201699 0.409888566 0.416118979 0.423711658 0.430547953 0.437483311 0.444009542 0.451545864 0.459666014 0.467544198 0.475819588 0.484959066 0.495771408 0.505332112 0.515207291 0.524164319 0.533812165 0.545445025 0.559124112 0.573783815 0.587723494 0.603238225 0.621310472 0.639037848 0.663456559 0.694858611 0.724993587 0.767990589 0.836836576 1.12525487 ------------------------------ Transdef: Tab for variable 12 0.200003088 0.207063615 0.213807106 0.220740378 0.227261156 0.233060956 0.23899582 0.245163202 0.250821203 0.256451994 0.262015939 0.267391562 0.272795796 0.277958602 0.283428967 0.288584173 0.293642342 0.298650414 0.303776771 0.309023827 0.313951969 0.318161309 0.323021919 0.328631759 0.333513826 0.338282168 0.343426168 0.348259032 0.353523374 0.359153718 0.363825738 0.368423998 0.373323739 0.378192604 0.383283198 0.388420343 0.39295876 0.397755563 0.401970148 0.405736893 0.409343839 0.41325599 0.417279422 0.420964479 0.424658477 0.428500652 0.432138383 0.436069697 0.439920932 0.444702923 0.448317349 0.452545285 0.456623882 0.460309029 0.465100825 0.469352126 0.473606348 0.477942735 0.482070297 0.486195952 0.490527064 0.495236516 0.499662995 0.505063474 0.510706425 0.515712857 0.520546317 0.525297821 0.531140804 0.536988497 0.542537451 0.548368216 0.554322124 0.559731245 0.56571871 0.571401119 0.578213871 0.583912969 0.59120369 0.597926259 0.605810404 0.614711404 0.623262882 0.631607294 0.640041351 0.649392128 0.658559084 0.668664575 0.67941916 0.692425907 0.705049157 0.719872415 0.731849909 0.746255398 0.761328816 0.780090392 0.801298559 0.829345107 0.862491012 0.910116315 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0277634 21.6620045 22.4193192 23.1089134 23.7211533 24.3110046 24.8334751 25.2821732 25.7612991 26.1687679 26.6596889 27.0470238 27.4734135 27.8618355 28.261797 28.678463 29.0346012 29.4288521 29.8361073 30.1826134 30.5358047 30.8454552 31.1739235 31.5357475 31.8685493 32.2162628 32.5896835 32.9593201 33.2798958 33.6620445 34.0543365 34.4175377 34.7811356 35.196312 35.602562 36.0013962 36.337677 36.7010307 37.0923309 37.496315 37.8693542 38.2786636 38.6637878 39.031601 39.471405 39.8393517 40.2224045 40.6024246 41.016922 41.3853607 41.8036652 42.2587738 42.6729813 43.0809631 43.5094528 43.9378967 44.3865814 44.78825 45.2333069 45.7127304 46.2199707 46.6043892 47.0764618 47.5810776 48.0420837 48.4699249 48.9771461 49.4691315 50.0100441 50.5357056 51.0510597 51.6765137 52.2390594 52.8412819 53.4730453 54.1285286 54.7644691 55.4030838 56.0305214 56.7609901 57.4902039 58.4131927 59.2540894 60.1223755 61.121788 62.1092377 63.0881577 64.2419891 65.4613724 66.7527237 68.3039474 69.9319916 71.9625397 74.2872314 76.3837433 78.6629486 82.0982819 86.5044327 92.2548065 102.119919 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.6915932 11.0883379 11.4714441 11.7923241 12.1939831 12.479022 12.8213177 13.1558266 13.4908447 13.795414 14.0841961 14.3911037 14.7083807 15.0155506 15.3000059 15.6074715 15.9673147 16.2915382 16.6434135 16.933094 17.2149353 17.5410919 17.8613205 18.1736507 18.5086021 18.7944317 19.0952072 19.3411236 19.6700783 20.023243 20.3432484 20.698307 21.0396652 21.327549 21.6207733 21.8953705 22.2458076 22.5844917 22.8842735 23.1904011 23.4878349 23.7983513 24.1292858 24.4426231 24.7784462 25.0538826 25.3679237 25.6694031 25.9973621 26.3132248 26.6254196 26.9700432 27.2852974 27.5820675 27.8715286 28.1638699 28.4336166 28.7782459 29.067812 29.3636875 29.6549377 29.9743462 30.3101501 30.6331425 30.9680252 31.3022385 31.5776138 31.9080524 32.2493134 32.6097374 32.9472923 33.3190308 33.6872177 34.047821 34.4591827 34.8406563 35.272419 35.7178345 36.1600189 36.6415482 37.0985489 37.576519 38.1269455 38.680584 39.292923 39.9124756 40.5819016 41.3216782 42.1130753 43.0442543 43.9714355 44.9151039 46.0728912 47.5610733 49.0923233 51.0529137 53.6176682 57.0497742 63.4885521 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.6 55.0 58.1 34.6 52.9 66.0 58.8 67.5 -25.6 -16.7 -34.2 19.7 33.4 2 68.6 100.0 69.3 64.3 40.0 71.0 94.6 77.2 92.1 -42.7 -23.7 -45.1 35.3 41.1 3 55.0 69.3 100.0 52.8 16.1 39.7 72.1 57.8 74.7 -16.2 -24.9 -49.0 64.7 34.0 4 58.1 64.3 52.8 100.0 22.1 42.3 64.6 56.4 70.1 -11.3 -28.9 -56.8 25.8 74.4 5 34.6 40.0 16.1 22.1 100.0 85.1 13.1 60.7 60.6 23.2 -7.9 -13.4 0.7 11.0 6 52.9 71.0 39.7 42.3 85.1 100.0 50.5 80.7 81.3 -6.2 -15.1 -28.1 15.1 25.2 7 66.0 94.6 72.1 64.6 13.1 50.5 100.0 68.5 81.0 -51.6 -23.1 -44.9 39.7 42.8 8 58.8 77.2 57.8 56.4 60.7 80.7 68.5 100.0 84.7 -10.4 -23.4 -40.3 29.0 36.9 9 67.5 92.1 74.7 70.1 60.6 81.3 81.0 84.7 100.0 -18.7 -26.0 -50.2 39.8 46.2 10 -25.6 -42.7 -16.2 -11.3 23.2 -6.2 -51.6 -10.4 -18.7 100.0 3.6 6.9 -5.7 -4.7 11 -16.7 -23.7 -24.9 -28.9 -7.9 -15.1 -23.1 -23.4 -26.0 3.6 100.0 53.6 -8.4 -17.3 12 -34.2 -45.1 -49.0 -56.8 -13.4 -28.1 -44.9 -40.3 -50.2 6.9 53.6 100.0 -20.7 -33.2 13 19.7 35.3 64.7 25.8 0.7 15.1 39.7 29.0 39.8 -5.7 -8.4 -20.7 100.0 51.8 14 33.4 41.1 34.0 74.4 11.0 25.2 42.8 36.9 46.2 -4.7 -17.3 -33.2 51.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 176.330136 TOTAL CORRELATION OF ALL VARIABLES 75.6260797 ROUND 1: MAX CORR ( 75.6260032) AFTER KILLING INPUT VARIABLE 8 CONTR 0.107578879 ROUND 2: MAX CORR ( 75.6243958) AFTER KILLING INPUT VARIABLE 2 CONTR 0.493060318 ROUND 3: MAX CORR ( 75.6217688) AFTER KILLING INPUT VARIABLE 14 CONTR 0.63033832 ROUND 4: MAX CORR ( 75.6183758) AFTER KILLING INPUT VARIABLE 6 CONTR 0.716355765 ROUND 5: MAX CORR ( 75.6023036) AFTER KILLING INPUT VARIABLE 11 CONTR 1.55898714 ROUND 6: MAX CORR ( 75.3772474) AFTER KILLING INPUT VARIABLE 12 CONTR 5.82914172 ROUND 7: MAX CORR ( 75.1229105) AFTER KILLING INPUT VARIABLE 10 CONTR 6.18690091 ROUND 8: MAX CORR ( 74.2541775) AFTER KILLING INPUT VARIABLE 13 CONTR 11.3916107 ROUND 9: MAX CORR ( 73.0558083) AFTER KILLING INPUT VARIABLE 9 CONTR 13.2865254 ROUND 10: MAX CORR ( 72.7524698) AFTER KILLING INPUT VARIABLE 3 CONTR 6.65050851 ROUND 11: MAX CORR ( 71.0240187) AFTER KILLING INPUT VARIABLE 4 CONTR 15.7642199 ROUND 12: MAX CORR ( 65.9977215) AFTER KILLING INPUT VARIABLE 5 CONTR 26.2433227 LAST REMAINING VARIABLE: 7 total correlation to target: 75.6260797 % total significance: 153.244276 sigma correlations of single variables to target: variable 2: 68.6468693 % , in sigma: 139.102011 variable 3: 55.0359767 % , in sigma: 111.521692 variable 4: 58.0737025 % , in sigma: 117.677163 variable 5: 34.6438332 % , in sigma: 70.2002426 variable 6: 52.9125389 % , in sigma: 107.218882 variable 7: 65.9977215 % , in sigma: 133.733933 variable 8: 58.824913 % , in sigma: 119.199372 variable 9: 67.48088 % , in sigma: 136.739319 variable 10: -25.6046793 % , in sigma: 51.8838285 variable 11: -16.6606906 % , in sigma: 33.7602514 variable 12: -34.2086695 % , in sigma: 69.3184522 variable 13: 19.7304999 % , in sigma: 39.980734 variable 14: 33.4071254 % , in sigma: 67.6942499 variables sorted by significance: 1 most relevant variable 7 corr 65.9977188 , in sigma: 133.733927 2 most relevant variable 5 corr 26.2433224 , in sigma: 53.1779374 3 most relevant variable 4 corr 15.7642202 , in sigma: 31.9436962 4 most relevant variable 3 corr 6.6505084 , in sigma: 13.4762022 5 most relevant variable 9 corr 13.2865257 , in sigma: 26.9230406 6 most relevant variable 13 corr 11.3916111 , in sigma: 23.0832962 7 most relevant variable 10 corr 6.18690109 , in sigma: 12.5367754 8 most relevant variable 12 corr 5.82914162 , in sigma: 11.8118325 9 most relevant variable 11 corr 1.55898714 , in sigma: 3.15904059 10 most relevant variable 6 corr 0.716355741 , in sigma: 1.45158148 11 most relevant variable 14 corr 0.630338311 , in sigma: 1.27728078 12 most relevant variable 2 corr 0.493060321 , in sigma: 0.999108669 13 most relevant variable 8 corr 0.107578881 , in sigma: 0.217991569 global correlations between input variables: variable 2: 99.2145324 % variable 3: 92.7088447 % variable 4: 92.4932995 % variable 5: 95.4339913 % variable 6: 95.1550543 % variable 7: 98.8605807 % variable 8: 90.3551859 % variable 9: 98.7306946 % variable 10: 71.7002418 % variable 11: 54.261402 % variable 12: 72.141046 % variable 13: 85.5451367 % variable 14: 88.9478061 % significance loss when removing single variables: variable 2: corr = 0.412949802 % , sigma = 0.836777387 variable 3: corr = 15.8846794 % , sigma = 32.1877876 variable 4: corr = 13.9389545 % , sigma = 28.2450842 variable 5: corr = 16.0784819 % , sigma = 32.5804977 variable 6: corr = 0.666583723 % , sigma = 1.35072637 variable 7: corr = 8.89815934 % , sigma = 18.030711 variable 8: corr = 0.107578879 % , sigma = 0.217991564 variable 9: corr = 9.9458818 % , sigma = 20.1537546 variable 10: corr = 5.88134479 % , sigma = 11.917614 variable 11: corr = 1.52980721 % , sigma = 3.09991208 variable 12: corr = 4.5198188 % , sigma = 9.15869714 variable 13: corr = 7.80039716 % , sigma = 15.8062697 variable 14: corr = 0.616100771 % , sigma = 1.24843066 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 28.6432533 sigma out 15 active outputs RANK 2 NODE 6 --> 26.8829288 sigma out 15 active outputs RANK 3 NODE 7 --> 24.9029102 sigma out 15 active outputs RANK 4 NODE 4 --> 24.1765766 sigma out 15 active outputs RANK 5 NODE 8 --> 21.3520908 sigma out 15 active outputs RANK 6 NODE 3 --> 20.5234413 sigma out 15 active outputs RANK 7 NODE 2 --> 20.1022568 sigma out 15 active outputs RANK 8 NODE 1 --> 17.8878727 sigma out 15 active outputs RANK 9 NODE 9 --> 13.9259768 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 39.6146812 sigma in 9act. ( 35.5221367 sig out 1act.) RANK 2 NODE 8 --> 22.9610615 sigma in 9act. ( 24.9742146 sig out 1act.) RANK 3 NODE 15 --> 20.7920704 sigma in 9act. ( 23.0789223 sig out 1act.) RANK 4 NODE 2 --> 20.0020103 sigma in 9act. ( 18.1973267 sig out 1act.) RANK 5 NODE 6 --> 19.2666988 sigma in 9act. ( 20.6569233 sig out 1act.) RANK 6 NODE 14 --> 19.2345924 sigma in 9act. ( 20.3124523 sig out 1act.) RANK 7 NODE 5 --> 13.7135649 sigma in 9act. ( 8.04365635 sig out 1act.) RANK 8 NODE 12 --> 13.1844034 sigma in 9act. ( 13.4288435 sig out 1act.) RANK 9 NODE 4 --> 12.1338997 sigma in 9act. ( 14.6342926 sig out 1act.) RANK 10 NODE 9 --> 11.5016127 sigma in 9act. ( 11.8880787 sig out 1act.) RANK 11 NODE 3 --> 11.4215174 sigma in 9act. ( 11.7998228 sig out 1act.) RANK 12 NODE 10 --> 5.8154974 sigma in 9act. ( 8.46080112 sig out 1act.) RANK 13 NODE 11 --> 5.6211772 sigma in 9act. ( 8.3112936 sig out 1act.) RANK 14 NODE 7 --> 4.37580395 sigma in 9act. ( 4.41159105 sig out 1act.) RANK 15 NODE 13 --> 4.04948854 sigma in 9act. ( 3.2660656 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 35.5221367 sigma out 1act.( 39.6146812 sig in 9act.) RANK 2 NODE 8 --> 24.9742146 sigma out 1act.( 22.9610615 sig in 9act.) RANK 3 NODE 15 --> 23.0789223 sigma out 1act.( 20.7920704 sig in 9act.) RANK 4 NODE 6 --> 20.6569233 sigma out 1act.( 19.2666988 sig in 9act.) RANK 5 NODE 14 --> 20.3124523 sigma out 1act.( 19.2345924 sig in 9act.) RANK 6 NODE 2 --> 18.1973267 sigma out 1act.( 20.0020103 sig in 9act.) RANK 7 NODE 4 --> 14.6342926 sigma out 1act.( 12.1338997 sig in 9act.) RANK 8 NODE 12 --> 13.4288435 sigma out 1act.( 13.1844034 sig in 9act.) RANK 9 NODE 9 --> 11.8880787 sigma out 1act.( 11.5016127 sig in 9act.) RANK 10 NODE 3 --> 11.7998228 sigma out 1act.( 11.4215174 sig in 9act.) RANK 11 NODE 10 --> 8.46080112 sigma out 1act.( 5.8154974 sig in 9act.) RANK 12 NODE 11 --> 8.3112936 sigma out 1act.( 5.6211772 sig in 9act.) RANK 13 NODE 5 --> 8.04365635 sigma out 1act.( 13.7135649 sig in 9act.) RANK 14 NODE 7 --> 4.41159105 sigma out 1act.( 4.37580395 sig in 9act.) RANK 15 NODE 13 --> 3.2660656 sigma out 1act.( 4.04948854 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 67.0758438 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 24.1390152 sigma out 15 active outputs RANK 2 NODE 6 --> 23.9655724 sigma out 15 active outputs RANK 3 NODE 7 --> 23.457098 sigma out 15 active outputs RANK 4 NODE 4 --> 22.3056316 sigma out 15 active outputs RANK 5 NODE 8 --> 21.8585243 sigma out 15 active outputs RANK 6 NODE 2 --> 21.3976879 sigma out 15 active outputs RANK 7 NODE 1 --> 18.8999062 sigma out 15 active outputs RANK 8 NODE 3 --> 18.2967243 sigma out 15 active outputs RANK 9 NODE 9 --> 13.7292843 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 30.198061 sigma in 9act. ( 28.6011696 sig out 1act.) RANK 2 NODE 8 --> 26.2999172 sigma in 9act. ( 23.7582626 sig out 1act.) RANK 3 NODE 15 --> 21.2670555 sigma in 9act. ( 20.888216 sig out 1act.) RANK 4 NODE 6 --> 18.3933659 sigma in 9act. ( 17.9331322 sig out 1act.) RANK 5 NODE 14 --> 18.0868855 sigma in 9act. ( 18.1637192 sig out 1act.) RANK 6 NODE 2 --> 15.6073599 sigma in 9act. ( 15.2850189 sig out 1act.) RANK 7 NODE 4 --> 15.1684399 sigma in 9act. ( 14.5805912 sig out 1act.) RANK 8 NODE 12 --> 12.2647266 sigma in 9act. ( 11.9219561 sig out 1act.) RANK 9 NODE 3 --> 11.81071 sigma in 9act. ( 11.207015 sig out 1act.) RANK 10 NODE 11 --> 11.5572777 sigma in 9act. ( 10.360961 sig out 1act.) RANK 11 NODE 10 --> 10.6783676 sigma in 9act. ( 9.42759514 sig out 1act.) RANK 12 NODE 9 --> 10.4394293 sigma in 9act. ( 10.2565174 sig out 1act.) RANK 13 NODE 5 --> 9.94783211 sigma in 9act. ( 6.37211037 sig out 1act.) RANK 14 NODE 13 --> 6.47208166 sigma in 9act. ( 3.21934843 sig out 1act.) RANK 15 NODE 7 --> 6.21139336 sigma in 9act. ( 4.77537441 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 28.6011696 sigma out 1act.( 30.198061 sig in 9act.) RANK 2 NODE 8 --> 23.7582626 sigma out 1act.( 26.2999172 sig in 9act.) RANK 3 NODE 15 --> 20.888216 sigma out 1act.( 21.2670555 sig in 9act.) RANK 4 NODE 14 --> 18.1637192 sigma out 1act.( 18.0868855 sig in 9act.) RANK 5 NODE 6 --> 17.9331322 sigma out 1act.( 18.3933659 sig in 9act.) RANK 6 NODE 2 --> 15.2850189 sigma out 1act.( 15.6073599 sig in 9act.) RANK 7 NODE 4 --> 14.5805912 sigma out 1act.( 15.1684399 sig in 9act.) RANK 8 NODE 12 --> 11.9219561 sigma out 1act.( 12.2647266 sig in 9act.) RANK 9 NODE 3 --> 11.207015 sigma out 1act.( 11.81071 sig in 9act.) RANK 10 NODE 11 --> 10.360961 sigma out 1act.( 11.5572777 sig in 9act.) RANK 11 NODE 9 --> 10.2565174 sigma out 1act.( 10.4394293 sig in 9act.) RANK 12 NODE 10 --> 9.42759514 sigma out 1act.( 10.6783676 sig in 9act.) RANK 13 NODE 5 --> 6.37211037 sigma out 1act.( 9.94783211 sig in 9act.) RANK 14 NODE 7 --> 4.77537441 sigma out 1act.( 6.21139336 sig in 9act.) RANK 15 NODE 13 --> 3.21934843 sigma out 1act.( 6.47208166 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 59.6613007 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.402343154 *** contribution from regularisation: 0.00316731539 *** contribution from error: -0.405510455 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.467407554 *** contribution from regularisation: 0.00237288116 *** contribution from error: -0.469780445 *********************************************** -----------------> Test sample ENTER BFGS code START -46344.9597 -0.0124509502 -0.107855611 EXIT FROM BFGS code FG_START 0. -0.0124509502 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.509984493 *** contribution from regularisation: 0.00224042847 *** contribution from error: -0.512224913 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -50555.7835 -0.0124509502 231.933044 EXIT FROM BFGS code FG_LNSRCH 0. 0.0209473148 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.559140503 *** contribution from regularisation: 0.00285974168 *** contribution from error: -0.562000275 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55428.7154 0.0209473148 152.037369 EXIT FROM BFGS code NEW_X -55428.7154 0.0209473148 152.037369 ENTER BFGS code NEW_X -55428.7154 0.0209473148 152.037369 EXIT FROM BFGS code FG_LNSRCH 0. 0.0576379634 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.567617655 *** contribution from regularisation: 0.0030834747 *** contribution from error: -0.570701122 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56269.0726 0.0576379634 60.5830917 EXIT FROM BFGS code NEW_X -56269.0726 0.0576379634 60.5830917 ENTER BFGS code NEW_X -56269.0726 0.0576379634 60.5830917 EXIT FROM BFGS code FG_LNSRCH 0. 0.0816686898 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.569776416 *** contribution from regularisation: 0.00281846779 *** contribution from error: -0.572594881 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56483.0774 0.0816686898 0.727734506 EXIT FROM BFGS code NEW_X -56483.0774 0.0816686898 0.727734506 ENTER BFGS code NEW_X -56483.0774 0.0816686898 0.727734506 EXIT FROM BFGS code FG_LNSRCH 0. 0.0862924233 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.570312381 *** contribution from regularisation: 0.00254149875 *** contribution from error: -0.572853863 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56536.2058 0.0862924233 23.5190277 EXIT FROM BFGS code NEW_X -56536.2058 0.0862924233 23.5190277 ENTER BFGS code NEW_X -56536.2058 0.0862924233 23.5190277 EXIT FROM BFGS code FG_LNSRCH 0. 0.0905850381 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.570471108 *** contribution from regularisation: 0.00251292158 *** contribution from error: -0.57298404 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56551.9433 0.0905850381 -3.46188807 EXIT FROM BFGS code NEW_X -56551.9433 0.0905850381 -3.46188807 ENTER BFGS code NEW_X -56551.9433 0.0905850381 -3.46188807 EXIT FROM BFGS code FG_LNSRCH 0. 0.091095522 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.57052201 *** contribution from regularisation: 0.00250262907 *** contribution from error: -0.573024631 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56556.9859 0.091095522 -5.03239918 EXIT FROM BFGS code NEW_X -56556.9859 0.091095522 -5.03239918 ENTER BFGS code NEW_X -56556.9859 0.091095522 -5.03239918 EXIT FROM BFGS code FG_LNSRCH 0. 0.0998645425 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 39.4376564 sigma out 15 active outputs RANK 2 NODE 1 --> 27.4998856 sigma out 15 active outputs RANK 3 NODE 8 --> 21.2136097 sigma out 15 active outputs RANK 4 NODE 7 --> 18.0193272 sigma out 15 active outputs RANK 5 NODE 6 --> 17.860918 sigma out 15 active outputs RANK 6 NODE 4 --> 15.9763117 sigma out 15 active outputs RANK 7 NODE 5 --> 14.5515041 sigma out 15 active outputs RANK 8 NODE 9 --> 12.1213455 sigma out 15 active outputs RANK 9 NODE 3 --> 11.6528063 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 37.1958809 sigma in 9act. ( 25.1987057 sig out 1act.) RANK 2 NODE 11 --> 24.1672306 sigma in 9act. ( 18.9083843 sig out 1act.) RANK 3 NODE 4 --> 21.5645523 sigma in 9act. ( 19.8495312 sig out 1act.) RANK 4 NODE 10 --> 20.6614838 sigma in 9act. ( 18.2752457 sig out 1act.) RANK 5 NODE 15 --> 15.5108185 sigma in 9act. ( 13.1864443 sig out 1act.) RANK 6 NODE 7 --> 13.7691565 sigma in 9act. ( 12.9509649 sig out 1act.) RANK 7 NODE 6 --> 12.9744501 sigma in 9act. ( 10.4599142 sig out 1act.) RANK 8 NODE 14 --> 12.9728451 sigma in 9act. ( 11.2374763 sig out 1act.) RANK 9 NODE 3 --> 10.8110008 sigma in 9act. ( 10.231492 sig out 1act.) RANK 10 NODE 12 --> 10.1092596 sigma in 9act. ( 8.59486103 sig out 1act.) RANK 11 NODE 1 --> 9.02314472 sigma in 9act. ( 8.38459492 sig out 1act.) RANK 12 NODE 13 --> 8.76321125 sigma in 9act. ( 8.28248882 sig out 1act.) RANK 13 NODE 9 --> 8.60877991 sigma in 9act. ( 6.99672747 sig out 1act.) RANK 14 NODE 2 --> 7.26261902 sigma in 9act. ( 6.07196045 sig out 1act.) RANK 15 NODE 5 --> 4.95355177 sigma in 9act. ( 0.219998538 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 25.1987057 sigma out 1act.( 37.1958809 sig in 9act.) RANK 2 NODE 4 --> 19.8495312 sigma out 1act.( 21.5645523 sig in 9act.) RANK 3 NODE 11 --> 18.9083843 sigma out 1act.( 24.1672306 sig in 9act.) RANK 4 NODE 10 --> 18.2752457 sigma out 1act.( 20.6614838 sig in 9act.) RANK 5 NODE 15 --> 13.1864443 sigma out 1act.( 15.5108185 sig in 9act.) RANK 6 NODE 7 --> 12.9509649 sigma out 1act.( 13.7691565 sig in 9act.) RANK 7 NODE 14 --> 11.2374763 sigma out 1act.( 12.9728451 sig in 9act.) RANK 8 NODE 6 --> 10.4599142 sigma out 1act.( 12.9744501 sig in 9act.) RANK 9 NODE 3 --> 10.231492 sigma out 1act.( 10.8110008 sig in 9act.) RANK 10 NODE 12 --> 8.59486103 sigma out 1act.( 10.1092596 sig in 9act.) RANK 11 NODE 1 --> 8.38459492 sigma out 1act.( 9.02314472 sig in 9act.) RANK 12 NODE 13 --> 8.28248882 sigma out 1act.( 8.76321125 sig in 9act.) RANK 13 NODE 9 --> 6.99672747 sigma out 1act.( 8.60877991 sig in 9act.) RANK 14 NODE 2 --> 6.07196045 sigma out 1act.( 7.26261902 sig in 9act.) RANK 15 NODE 5 --> 0.219998538 sigma out 1act.( 4.95355177 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 51.9722824 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.570963681 *** contribution from regularisation: 0.00231096405 *** contribution from error: -0.573274672 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56600.7689 0.0998645425 -16.7073402 EXIT FROM BFGS code NEW_X -56600.7689 0.0998645425 -16.7073402 ENTER BFGS code NEW_X -56600.7689 0.0998645425 -16.7073402 EXIT FROM BFGS code FG_LNSRCH 0. 0.11652793 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.57143569 *** contribution from regularisation: 0.00220998586 *** contribution from error: -0.573645651 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56647.5645 0.11652793 -14.0932703 EXIT FROM BFGS code NEW_X -56647.5645 0.11652793 -14.0932703 ENTER BFGS code NEW_X -56647.5645 0.11652793 -14.0932703 EXIT FROM BFGS code FG_LNSRCH 0. 0.140516102 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.572013438 *** contribution from regularisation: 0.00254457491 *** contribution from error: -0.57455802 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56704.8378 0.140516102 6.26058102 EXIT FROM BFGS code NEW_X -56704.8378 0.140516102 6.26058102 ENTER BFGS code NEW_X -56704.8378 0.140516102 6.26058102 EXIT FROM BFGS code FG_LNSRCH 0. 0.162166044 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.572392881 *** contribution from regularisation: 0.00274401437 *** contribution from error: -0.5751369 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56742.4496 0.162166044 -12.6829681 EXIT FROM BFGS code NEW_X -56742.4496 0.162166044 -12.6829681 ENTER BFGS code NEW_X -56742.4496 0.162166044 -12.6829681 EXIT FROM BFGS code FG_LNSRCH 0. 0.148646608 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.572822154 *** contribution from regularisation: 0.00235040695 *** contribution from error: -0.575172544 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56785.0046 0.148646608 12.6256227 EXIT FROM BFGS code NEW_X -56785.0046 0.148646608 12.6256227 ENTER BFGS code NEW_X -56785.0046 0.148646608 12.6256227 EXIT FROM BFGS code FG_LNSRCH 0. 0.151598811 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.572778642 *** contribution from regularisation: 0.00254612905 *** contribution from error: -0.575324774 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56780.6919 0.151598811 1.11079621 EXIT FROM BFGS code FG_LNSRCH 0. 0.149320528 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.57270807 *** contribution from regularisation: 0.00251967623 *** contribution from error: -0.575227737 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56773.698 0.149320528 10.0447216 EXIT FROM BFGS code FG_LNSRCH 0. 0.148684189 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.572644293 *** contribution from regularisation: 0.00253179693 *** contribution from error: -0.57517612 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56767.3719 0.148684189 12.6330109 EXIT FROM BFGS code FG_LNSRCH 0. 0.148646712 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.572652221 *** contribution from regularisation: 0.00252036378 *** contribution from error: -0.575172603 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56768.1574 0.148646712 12.8158979 EXIT FROM BFGS code FG_LNSRCH 0. 0.148646608 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.572651982 *** contribution from regularisation: 0.00252058497 *** contribution from error: -0.575172544 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56768.1345 0.148646608 12.8057089 EXIT FROM BFGS code FG_LNSRCH 0. 0.148646608 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 47.9682922 sigma out 15 active outputs RANK 2 NODE 1 --> 33.2542458 sigma out 15 active outputs RANK 3 NODE 7 --> 21.5447311 sigma out 15 active outputs RANK 4 NODE 6 --> 20.8497715 sigma out 15 active outputs RANK 5 NODE 4 --> 19.4312687 sigma out 15 active outputs RANK 6 NODE 5 --> 18.7795944 sigma out 15 active outputs RANK 7 NODE 8 --> 17.4512177 sigma out 15 active outputs RANK 8 NODE 9 --> 15.9155436 sigma out 15 active outputs RANK 9 NODE 3 --> 14.5310726 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 51.2874832 sigma in 9act. ( 36.7784348 sig out 1act.) RANK 2 NODE 4 --> 30.0847702 sigma in 9act. ( 31.2813358 sig out 1act.) RANK 3 NODE 11 --> 25.8085423 sigma in 9act. ( 22.7813282 sig out 1act.) RANK 4 NODE 10 --> 24.3636589 sigma in 9act. ( 20.3657494 sig out 1act.) RANK 5 NODE 7 --> 16.905611 sigma in 9act. ( 15.4840155 sig out 1act.) RANK 6 NODE 14 --> 11.923502 sigma in 9act. ( 11.1668816 sig out 1act.) RANK 7 NODE 6 --> 11.6843681 sigma in 9act. ( 11.3506126 sig out 1act.) RANK 8 NODE 3 --> 11.0987225 sigma in 9act. ( 9.82260036 sig out 1act.) RANK 9 NODE 13 --> 9.3239851 sigma in 9act. ( 9.14887142 sig out 1act.) RANK 10 NODE 9 --> 8.64676666 sigma in 9act. ( 7.96895742 sig out 1act.) RANK 11 NODE 15 --> 8.37814236 sigma in 9act. ( 7.98189449 sig out 1act.) RANK 12 NODE 12 --> 6.35216427 sigma in 9act. ( 4.68103361 sig out 1act.) RANK 13 NODE 5 --> 5.46080303 sigma in 9act. ( 5.42180586 sig out 1act.) RANK 14 NODE 1 --> 3.25898838 sigma in 9act. ( 2.33542633 sig out 1act.) RANK 15 NODE 2 --> 3.06732082 sigma in 9act. ( 2.21650648 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 36.7784348 sigma out 1act.( 51.2874832 sig in 9act.) RANK 2 NODE 4 --> 31.2813358 sigma out 1act.( 30.0847702 sig in 9act.) RANK 3 NODE 11 --> 22.7813282 sigma out 1act.( 25.8085423 sig in 9act.) RANK 4 NODE 10 --> 20.3657494 sigma out 1act.( 24.3636589 sig in 9act.) RANK 5 NODE 7 --> 15.4840155 sigma out 1act.( 16.905611 sig in 9act.) RANK 6 NODE 6 --> 11.3506126 sigma out 1act.( 11.6843681 sig in 9act.) RANK 7 NODE 14 --> 11.1668816 sigma out 1act.( 11.923502 sig in 9act.) RANK 8 NODE 3 --> 9.82260036 sigma out 1act.( 11.0987225 sig in 9act.) RANK 9 NODE 13 --> 9.14887142 sigma out 1act.( 9.3239851 sig in 9act.) RANK 10 NODE 15 --> 7.98189449 sigma out 1act.( 8.37814236 sig in 9act.) RANK 11 NODE 9 --> 7.96895742 sigma out 1act.( 8.64676666 sig in 9act.) RANK 12 NODE 5 --> 5.42180586 sigma out 1act.( 5.46080303 sig in 9act.) RANK 13 NODE 12 --> 4.68103361 sigma out 1act.( 6.35216427 sig in 9act.) RANK 14 NODE 1 --> 2.33542633 sigma out 1act.( 3.25898838 sig in 9act.) RANK 15 NODE 2 --> 2.21650648 sigma out 1act.( 3.06732082 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.2440186 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.572644949 *** contribution from regularisation: 0.00252760132 *** contribution from error: -0.575172544 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56767.439 0.148646608 12.8695412 EXIT FROM BFGS code FG_LNSRCH 0. 0.148646608 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.572660446 *** contribution from regularisation: 0.00251211994 *** contribution from error: -0.575172544 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56768.9737 0.148646608 12.8394804 EXIT FROM BFGS code NEW_X -56768.9737 0.148646608 12.8394804 ENTER BFGS code NEW_X -56768.9737 0.148646608 12.8394804 EXIT FROM BFGS code CONVERGENC -56768.9737 0.148646608 12.8394804 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 73.8576736 sigma out 15 active outputs RANK 2 NODE 1 --> 52.3530083 sigma out 15 active outputs RANK 3 NODE 7 --> 33.8114433 sigma out 15 active outputs RANK 4 NODE 6 --> 32.7219009 sigma out 15 active outputs RANK 5 NODE 4 --> 30.104208 sigma out 15 active outputs RANK 6 NODE 5 --> 28.2381115 sigma out 15 active outputs RANK 7 NODE 8 --> 27.2981129 sigma out 15 active outputs RANK 8 NODE 9 --> 24.3102093 sigma out 15 active outputs RANK 9 NODE 3 --> 22.8275795 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 80.5669861 sigma in 9act. ( 60.6241455 sig out 1act.) RANK 2 NODE 4 --> 46.7905464 sigma in 9act. ( 50.3288345 sig out 1act.) RANK 3 NODE 11 --> 39.7112389 sigma in 9act. ( 37.2599411 sig out 1act.) RANK 4 NODE 10 --> 37.063324 sigma in 9act. ( 33.5133972 sig out 1act.) RANK 5 NODE 7 --> 26.0763016 sigma in 9act. ( 24.7766762 sig out 1act.) RANK 6 NODE 14 --> 18.3773842 sigma in 9act. ( 17.7982159 sig out 1act.) RANK 7 NODE 6 --> 17.8926353 sigma in 9act. ( 17.7903194 sig out 1act.) RANK 8 NODE 3 --> 16.847168 sigma in 9act. ( 15.3463783 sig out 1act.) RANK 9 NODE 13 --> 13.9487047 sigma in 9act. ( 14.299346 sig out 1act.) RANK 10 NODE 9 --> 12.9041862 sigma in 9act. ( 13.0090103 sig out 1act.) RANK 11 NODE 15 --> 12.8866005 sigma in 9act. ( 12.5774412 sig out 1act.) RANK 12 NODE 12 --> 9.36063194 sigma in 9act. ( 7.71216345 sig out 1act.) RANK 13 NODE 5 --> 8.15505695 sigma in 9act. ( 8.45288754 sig out 1act.) RANK 14 NODE 1 --> 4.34909582 sigma in 9act. ( 3.77278042 sig out 1act.) RANK 15 NODE 2 --> 4.21002579 sigma in 9act. ( 3.45870614 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 60.6241455 sigma out 1act.( 80.5669861 sig in 9act.) RANK 2 NODE 4 --> 50.3288345 sigma out 1act.( 46.7905464 sig in 9act.) RANK 3 NODE 11 --> 37.2599411 sigma out 1act.( 39.7112389 sig in 9act.) RANK 4 NODE 10 --> 33.5133972 sigma out 1act.( 37.063324 sig in 9act.) RANK 5 NODE 7 --> 24.7766762 sigma out 1act.( 26.0763016 sig in 9act.) RANK 6 NODE 14 --> 17.7982159 sigma out 1act.( 18.3773842 sig in 9act.) RANK 7 NODE 6 --> 17.7903194 sigma out 1act.( 17.8926353 sig in 9act.) RANK 8 NODE 3 --> 15.3463783 sigma out 1act.( 16.847168 sig in 9act.) RANK 9 NODE 13 --> 14.299346 sigma out 1act.( 13.9487047 sig in 9act.) RANK 10 NODE 9 --> 13.0090103 sigma out 1act.( 12.9041862 sig in 9act.) RANK 11 NODE 15 --> 12.5774412 sigma out 1act.( 12.8866005 sig in 9act.) RANK 12 NODE 5 --> 8.45288754 sigma out 1act.( 8.15505695 sig in 9act.) RANK 13 NODE 12 --> 7.71216345 sigma out 1act.( 9.36063194 sig in 9act.) RANK 14 NODE 1 --> 3.77278042 sigma out 1act.( 4.34909582 sig in 9act.) RANK 15 NODE 2 --> 3.45870614 sigma out 1act.( 4.21002579 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 104.361969 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.572642148 *** contribution from regularisation: 0.00253042788 *** contribution from error: -0.575172603 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done