NNInput NNInputs_165.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 43541 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 13097 nbkg = 30444 Bkg Entries: 30444 Sig Entries: 13097 Chosen entries: 13097 Signal fraction: 1 Background fraction: 0.4302 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 30444 Actual Signal Entries: 13097 Entries to split: 13097 Test with : 6548 Train with : 6548 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 13097 for Signal Prepared event 0 for Signal with 13097 events ====Entry 0 Variable Ht : 166.062 Variable LepAPt : 46.6976 Variable LepBPt : 12.3497 Variable MetSigLeptonsJets : 5.53415 Variable MetSpec : 57.6277 Variable SumEtLeptonsJets : 108.433 Variable VSumJetLeptonsPt : 79.9325 Variable addEt : 116.676 Variable dPhiLepSumMet : 2.70198 Variable dPhiLeptons : 0.334072 Variable dRLeptons : 0.346084 Variable lep1_E : 46.9538 Variable lep2_E : 12.5861 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2165 Ht = 166.062 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 46.6978 LepAPt = 46.6976 LepBEt = 12.3505 LepBPt = 12.3497 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 57.6277 MetDelPhi = 2.10952 MetSig = 4.07747 MetSigLeptonsJets = 5.53415 MetSpec = 57.6277 Mjj = 0 MostCentralJetEta = -1.22278 MtllMet = 116.939 Njets = 1 SB = 0 SumEt = 199.747 SumEtJets = 0 SumEtLeptonsJets = 108.433 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 79.9325 addEt = 116.676 dPhiLepSumMet = 2.70198 dPhiLeptons = 0.334072 dRLeptons = 0.346084 diltype = 17 dimass = 8.28236 event = 966 jet1_Et = 49.3856 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.9538 lep2_E = 12.5861 rand = 0.999742 run = 237144 weight = 2.63466e-06 ===Show End Prepared event 10000 for Signal with 13097 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 30444 for Background Prepared event 0 for Background with 30444 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 1.59873 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 30444 events Prepared event 20000 for Background with 30444 events Prepared event 30000 for Background with 30444 events Warning: found 990 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 43541 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 990 negative weights. Signal fraction: 61.9292336 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 55.9230614 62.6408768 64.1576843 66.4454422 68.3242188 70.3143616 71.9649048 73.8118439 75.5733185 77.4636536 79.0043945 80.6265793 82.3743973 84.2361221 85.7614365 87.3420563 89.0130081 90.6161804 91.9948196 93.6295319 94.833313 96.2274628 97.8138123 99.1666412 100.741783 102.029205 103.435478 104.680298 106.045868 107.495773 108.842117 110.121605 111.632858 113.054161 114.474464 116.001755 117.520493 118.941116 120.550919 122.007675 123.450073 124.940567 126.410385 127.721191 129.114975 130.47467 131.900696 133.143982 134.358765 135.718506 137.016708 138.208008 139.509247 140.77269 142.098846 143.353806 144.77948 145.958786 147.039917 148.189331 149.219269 150.344879 151.363144 152.628159 153.755432 154.943939 156.000854 157.235428 158.43573 159.77597 160.943176 162.134338 163.712769 165.302917 167.130463 168.9953 170.805908 173.017227 175.324097 177.542709 179.894638 182.187393 184.9599 187.534195 190.216309 193.422821 196.50766 199.794708 203.327789 208.247223 212.326996 217.737885 223.006042 229.450867 236.414047 244.38974 253.776459 268.141663 287.615234 320.131042 679.506348 ------------------------------ Transdef: Tab for variable 3 20.0021973 20.6349945 21.0364304 21.4343796 21.8033886 22.270237 22.7367706 23.1636257 23.5025482 23.9289207 24.2951603 24.705555 24.9610786 25.247858 25.564045 25.9038696 26.1903381 26.5295105 26.9061241 27.2366333 27.5358925 27.8932953 28.2327576 28.5734367 28.8344727 29.141489 29.4216614 29.6702175 29.9301987 30.2105751 30.5154953 30.7731895 31.0717468 31.3371277 31.6203232 31.8980255 32.1727524 32.4394455 32.7068253 32.9653015 33.2632904 33.5264549 33.81884 34.1315308 34.3645287 34.619072 34.9124336 35.169239 35.4239502 35.6970291 35.978363 36.2494888 36.5098343 36.7571945 37.018364 37.3173599 37.5604248 37.8296776 38.1300926 38.4204559 38.6927185 38.9488831 39.2067909 39.494751 39.768631 40.0652924 40.3675461 40.7094955 41.0006142 41.3484421 41.6892853 41.9446068 42.2385521 42.5558853 42.8696213 43.2383728 43.5871658 43.9331512 44.2633476 44.6223145 45.0559998 45.5196075 45.9659271 46.4172516 46.9589767 47.498291 48.062809 48.636673 49.2200165 50.0362968 50.8802032 51.784668 52.8941422 53.9683533 55.3015366 56.8666992 58.7444916 61.3106155 65.6905823 73.1709747 160.265121 ------------------------------ Transdef: Tab for variable 4 10.0029955 10.2055836 10.3905087 10.6219921 10.8669338 11.0869493 11.3278027 11.5894079 11.8227139 12.0814495 12.3150768 12.5966244 12.8733492 13.1711597 13.4147596 13.7156668 13.9621315 14.2277365 14.5516634 14.8479633 15.1568165 15.4243155 15.7191086 15.9920788 16.2984238 16.6096153 16.9147854 17.1889343 17.5083427 17.8745651 18.232336 18.5784245 18.9171181 19.2057648 19.462616 19.7572517 20.0852661 20.3620186 20.5990257 20.8156605 21.0377884 21.2579613 21.5405312 21.7920628 22.0619469 22.2875175 22.5323181 22.7723541 23.051651 23.2725811 23.5859318 23.8669395 24.1166992 24.3843765 24.6577053 24.9004402 25.1885395 25.4172668 25.6926651 25.9950733 26.2842216 26.6055012 26.865694 27.1535225 27.4280739 27.7063828 28.0184021 28.3623734 28.6196136 28.9160347 29.244524 29.5281105 29.8786507 30.1851578 30.478096 30.7906723 31.0856094 31.4200554 31.7490559 32.0491028 32.4258957 32.7351685 33.0665054 33.4382629 33.7942886 34.1049271 34.4797821 34.9380455 35.2919846 35.7720757 36.2423401 36.7762985 37.3763008 37.9501266 38.7744751 39.8454628 41.0869675 42.6843567 45.1219368 49.2465134 74.3131104 ------------------------------ Transdef: Tab for variable 5 1.55223811 2.65402889 2.95063329 3.17401195 3.36431742 3.5482316 3.69530869 3.85248566 3.95484257 4.05825329 4.16116524 4.2493124 4.3356905 4.43457842 4.5128541 4.60228443 4.6866951 4.76238346 4.8480072 4.92572546 5.01537895 5.12021828 5.21925163 5.30954552 5.37742853 5.45530605 5.54310036 5.62116194 5.69002485 5.77848911 5.84740734 5.9210825 5.9941206 6.07716942 6.13558865 6.20852804 6.27267408 6.34695148 6.40485144 6.47655916 6.54331017 6.59638739 6.66358232 6.71533966 6.76427984 6.8169136 6.8689909 6.92098188 6.97717428 7.02923965 7.07728004 7.13587046 7.18011999 7.23001385 7.28727627 7.33301926 7.3809433 7.42928028 7.47046375 7.51342583 7.56794262 7.61580896 7.66278362 7.72283077 7.7732091 7.82465315 7.87811995 7.92973804 7.97582722 8.02066994 8.07103157 8.11703682 8.16567421 8.21445274 8.25718307 8.31299305 8.36662769 8.42438698 8.47676849 8.53377247 8.58802223 8.64947891 8.70805931 8.77186012 8.82134438 8.87822723 8.95101929 9.01402283 9.08900833 9.16361332 9.25293446 9.35188293 9.45490456 9.58893967 9.74075985 9.92301941 10.1101084 10.3813524 10.7042875 11.5695887 18.3108215 ------------------------------ Transdef: Tab for variable 6 25.0005894 25.3404446 25.7074642 26.1810436 26.6896744 27.0940323 27.60326 28.0805569 28.5582962 29.2316284 29.9040699 30.6935043 31.4310017 32.2079086 32.9756088 33.7938538 34.6469498 35.611721 36.4671936 37.3116264 38.0827484 38.8429489 39.7767639 40.6138687 41.3251266 42.0646362 42.7632141 43.5587006 44.154995 44.718132 45.2932129 45.8994827 46.4757462 47.3575897 47.9818649 48.6115036 49.20821 49.8897934 50.54245 51.2192001 51.8951797 52.5876083 53.2443008 53.8899078 54.5574722 55.260704 55.8442078 56.4920807 57.1333466 57.7895622 58.3927917 58.9992905 59.6062622 60.3027039 60.9929123 61.6570816 62.2950401 62.9603424 63.519104 64.1769409 64.7657318 65.380043 65.9897766 66.5982132 67.2479858 67.8206177 68.4042511 68.9873505 69.6102753 70.3833923 70.9160004 71.6025009 72.3022461 72.8277893 73.5341339 74.1555939 74.8085098 75.4500656 76.0904083 76.6945267 77.4051361 78.1255722 78.7964478 79.5328674 80.3166428 81.211853 82.2565155 83.3155899 84.3600922 85.4868317 87.0981445 88.9175262 90.9194183 92.9801407 95.4572601 98.7603607 102.558456 106.758316 113.296471 126.54966 224.544907 ------------------------------ Transdef: Tab for variable 7 30.3046741 33.4488106 35.3064575 36.358223 37.3134995 37.959877 39.0217171 39.88414 40.5830269 41.4325027 42.1595154 42.9019012 43.7509384 44.5775337 45.3480148 46.0620041 46.9118652 47.7929344 48.5022659 49.2602539 49.9513397 50.7639961 51.4097824 52.2146339 52.8956604 53.5671272 54.2696075 55.1702652 56.0161285 56.8657455 57.6414833 58.5614777 59.2543945 59.9259453 60.7550888 61.4957237 62.2269897 62.9282837 63.6489792 64.3705597 65.1294556 65.9039764 66.658493 67.4102173 68.2314224 68.9275513 69.6654816 70.4156189 71.0803833 71.7819977 72.5332336 73.1699677 73.7845001 74.3858185 75.1131744 75.8596115 76.5082474 77.1653366 77.8234482 78.5275345 79.222023 79.978775 80.794136 81.827507 82.9904175 84.1279602 85.3399811 86.6068039 87.7873688 89.1028748 90.5823364 91.8422394 93.4552307 94.7313385 96.1454773 97.9215546 99.463913 101.078163 102.744308 104.689873 106.772789 109.052155 111.226311 113.222748 115.452248 117.776711 120.610764 123.54213 126.68808 130.062164 134.171112 137.967194 142.86171 147.241211 153.010803 160.42038 170.991241 183.241272 199.144714 226.439728 437.649109 ------------------------------ Transdef: Tab for variable 8 3.67933035 25.3953552 29.9968338 31.6550674 32.9688416 34.2262573 35.0799103 35.681942 36.4194374 37.1297417 37.683815 38.3631859 39.0673676 39.637867 40.2249146 40.7750435 41.2485275 41.9051056 42.4171143 43.0776787 43.748558 44.3425293 44.9205551 45.5459061 46.083271 46.6448517 47.2255402 47.7752533 48.3133774 48.8667717 49.4215431 49.9841805 50.5561447 50.9352264 51.4658737 51.9871101 52.4328613 52.9509392 53.4938736 54.0549774 54.7003479 55.3374672 55.9300995 56.5100632 57.0886917 57.6887093 58.3237686 58.8598022 59.3617935 59.864357 60.4786758 61.0264053 61.610527 62.1324692 62.7316628 63.224205 63.7739792 64.3871078 64.8944473 65.4803925 66.0336304 66.5776825 67.1108856 67.7691803 68.2588959 68.9072113 69.4662781 70.0492401 70.5952454 71.2143555 71.8305054 72.335144 72.8236847 73.5119858 74.0926971 74.6592712 75.2869873 75.9266357 76.4187622 77.0169525 77.6958237 78.279007 78.9173965 79.6916199 80.378685 81.3806763 82.4476318 83.7627716 84.8155365 86.2091675 87.7360992 89.3495255 91.3202744 93.6892166 96.6469345 99.7769928 103.528023 109.068924 116.929405 131.981812 289.322327 ------------------------------ Transdef: Tab for variable 9 55.9230614 61.8958664 63.896698 65.4608459 67.0415802 68.3242188 70.0289078 71.2682724 72.5757751 73.855957 75.3040466 76.8681717 78.1421204 79.4013519 80.6289368 81.8937225 83.5352097 84.8214035 85.8776855 87.2648773 88.6088333 90.0280075 91.1618042 92.2579346 93.526535 94.5964966 95.6438446 96.8312073 98.009491 99.1365204 100.531662 101.65522 102.750145 104.032043 105.166702 106.223412 107.46595 108.670837 109.776154 110.859047 112.01458 113.260513 114.462936 115.709854 116.772629 117.997971 119.180511 120.32708 121.3592 122.552811 123.661972 124.683594 125.920799 126.992462 128.085083 129.262726 130.411865 131.530396 132.529922 133.57074 134.536438 135.537827 136.68634 137.555801 138.642273 139.56485 140.573578 141.557465 142.484787 143.373016 144.313538 145.239929 146.109085 146.986328 147.842896 148.71994 149.650726 150.566605 151.443604 152.28183 153.229263 154.194427 155.049011 155.977753 156.914444 157.82666 158.919174 159.97113 160.963226 162.00473 163.276917 164.717072 166.251968 168.074493 170.204071 172.977112 176.38678 180.806488 188.266113 203.4655 379.21344 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.1436578 1.35543394 1.56703913 1.70880246 1.8141402 1.92485356 1.99854565 2.07566905 2.14886045 2.1949687 2.24002028 2.28935719 2.33118153 2.36898923 2.40448809 2.44216967 2.47763133 2.50641298 2.5370388 2.5639112 2.58803463 2.60972166 2.62939 2.6501863 2.66789722 2.68511629 2.70236874 2.71511126 2.73306179 2.75044942 2.76749706 2.78213644 2.79578781 2.809834 2.8225286 2.83418894 2.84751558 2.85748792 2.86830187 2.87933636 2.88924074 2.89846873 2.90779424 2.91722202 2.92567754 2.93335199 2.94135857 2.94790173 2.95568895 2.96223474 2.96847916 2.97437596 2.98034716 2.98518467 2.99114609 2.99749279 3.00360036 3.00830865 3.01238775 3.0172925 3.02191544 3.02635288 3.03048301 3.03548002 3.0397253 3.04358506 3.04704714 3.05026817 3.05361223 3.05781507 3.06167603 3.06524467 3.06835175 3.07203627 3.07575607 3.07855463 3.08200407 3.08516645 3.08839917 3.09133959 3.09407711 3.09670162 3.09956264 3.10226154 3.10448456 3.10704041 3.10938144 3.11210251 3.11425352 3.11673641 3.11912131 3.121454 3.12438679 3.12700868 3.12942505 3.13233304 3.13466024 3.13708758 3.13933897 3.14157653 ------------------------------ Transdef: Tab for variable 11 1.71661377E-05 0.00849795341 0.0175543129 0.0256080627 0.0328205824 0.0406523943 0.0464339852 0.0533395149 0.0601634979 0.0665745139 0.0732396841 0.0795682669 0.084827669 0.0911408663 0.0972666442 0.102485061 0.108532786 0.114167124 0.120058298 0.12571387 0.131271347 0.137588263 0.143456519 0.147753477 0.153476715 0.157921195 0.163789868 0.169074655 0.17424947 0.180347681 0.18483308 0.189731836 0.194090366 0.198758483 0.202913642 0.206788599 0.210188985 0.213537291 0.217976272 0.221654922 0.225263834 0.230017453 0.234345913 0.2382164 0.242012441 0.245970726 0.249013305 0.252452612 0.256446034 0.260031998 0.263885677 0.267875671 0.272153139 0.275659204 0.279132307 0.28323555 0.287410498 0.291751862 0.295909047 0.300288051 0.304435372 0.309037685 0.313572586 0.318464935 0.32292366 0.32810545 0.333863497 0.339627534 0.344737798 0.349751472 0.354655981 0.360458672 0.365930915 0.372340202 0.378692865 0.385140419 0.39145723 0.398753524 0.406308532 0.412872672 0.42054081 0.428955227 0.437330306 0.44440341 0.451705515 0.461904168 0.473211616 0.484012783 0.494639754 0.50628078 0.517927408 0.533276081 0.548796892 0.570902705 0.591154933 0.611121118 0.642655015 0.678019166 0.719456673 0.791838765 1.12525487 ------------------------------ Transdef: Tab for variable 12 0.200007483 0.205077201 0.21052739 0.216090679 0.220669717 0.225550964 0.230238527 0.234475702 0.239290208 0.243353382 0.247446582 0.251083314 0.25558871 0.259874701 0.265299588 0.269386977 0.272784233 0.27690798 0.2805188 0.284323931 0.287798464 0.291422814 0.29505077 0.299170971 0.30270949 0.306163043 0.309324294 0.312448382 0.316246808 0.320032239 0.323958188 0.327589035 0.331342101 0.335071623 0.338780135 0.341966271 0.34540531 0.34908542 0.352937043 0.356659174 0.360494435 0.364423305 0.368586719 0.372329116 0.376233369 0.379320234 0.383465081 0.387540042 0.392051697 0.395871818 0.399534225 0.403228641 0.406647503 0.410681397 0.414248586 0.417685181 0.421732128 0.425678998 0.429516256 0.433492541 0.437452972 0.441565096 0.446444392 0.450867891 0.454766452 0.460099578 0.464966506 0.470181137 0.476038694 0.481872857 0.488253653 0.492860973 0.498067319 0.504142702 0.509802341 0.515479922 0.522213221 0.529766202 0.536722541 0.544610381 0.552187324 0.559601665 0.568454862 0.576653242 0.58641088 0.596422195 0.605046868 0.614893973 0.625499308 0.632645845 0.645610452 0.658936858 0.673524082 0.68609798 0.700671554 0.721119344 0.748822391 0.779065847 0.817254782 0.894246519 1.12845647 ------------------------------ Transdef: Tab for variable 13 20.0516586 21.4035645 22.2119217 22.8562012 23.671917 24.3936672 24.9034042 25.2943497 25.7785473 26.225996 26.7315693 27.227932 27.6542969 28.0842953 28.5028572 28.9385242 29.4195328 29.8047371 30.1692657 30.4988708 30.8580666 31.1724072 31.5076256 31.8567867 32.1629753 32.4538803 32.7719727 33.1188431 33.4204597 33.7503815 34.1213379 34.4749985 34.7954712 35.1893044 35.5178909 35.8141785 36.1611633 36.423233 36.7062531 37.0792198 37.3519516 37.6028595 37.8820953 38.1919594 38.4615364 38.7653008 39.0491676 39.3323708 39.5912857 39.9421005 40.2471542 40.5401688 40.8576698 41.1409149 41.5016327 41.88311 42.1914215 42.5061913 42.8159866 43.1278725 43.4664764 43.8326836 44.1460342 44.5540657 44.8560638 45.1669846 45.4818993 45.852108 46.2219696 46.5660934 46.9114914 47.3766899 47.8993454 48.2588654 48.7401886 49.137413 49.6803894 50.0958633 50.6411667 51.1000519 51.6743088 52.237812 52.7340927 53.4088135 54.1106911 54.687706 55.4618187 56.2623444 57.1012726 58.1379051 59.1024933 60.254715 61.5931396 63.0316124 64.6973877 66.8730698 69.3750229 72.2060699 76.8751526 87.6610947 201.326797 ------------------------------ Transdef: Tab for variable 14 10.0161438 10.7879829 11.3791313 11.7381926 12.0811958 12.3419876 12.7370872 13.0986223 13.4927063 13.8427544 14.1872139 14.5305061 14.8898249 15.2241983 15.518549 15.878212 16.1482658 16.5050602 16.8521919 17.1504345 17.4973907 17.8417683 18.2143993 18.6093903 18.9986267 19.3702393 19.7429142 20.0607185 20.3951645 20.6784325 21.006567 21.3194008 21.6683617 21.9711819 22.3274727 22.6677094 22.9908562 23.309166 23.5726852 23.8309364 24.1190605 24.3969421 24.7033806 25.0200233 25.3538952 25.5964432 25.8953304 26.1751022 26.4347916 26.7624664 27.0822945 27.3538551 27.6497421 27.9497662 28.2169914 28.5301628 28.8599548 29.1656551 29.4794159 29.7968674 30.0737991 30.3454666 30.6380825 30.9788971 31.2939453 31.5785408 31.9154263 32.2433891 32.57407 32.8709259 33.195137 33.4998016 33.8958282 34.2660904 34.618721 34.9863739 35.3560257 35.7293701 36.1146088 36.4414597 36.8551331 37.2910004 37.7019844 38.1141739 38.550106 39.0621796 39.6003113 40.1952629 40.7457199 41.4298096 42.274147 43.0718918 44.033371 45.0134964 46.0724297 47.5126114 48.9024315 51.1927795 54.2135925 59.5067482 94.9437866 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 54.6 34.2 48.8 32.6 47.9 48.4 45.8 54.9 -13.5 -19.5 -31.3 30.1 45.2 2 54.6 100.0 62.3 61.4 36.2 71.6 94.6 73.1 89.4 -39.8 -27.9 -46.8 57.0 56.2 3 34.2 62.3 100.0 50.1 9.2 33.4 64.6 49.4 69.6 -6.7 -30.2 -53.2 91.4 44.3 4 48.8 61.4 50.1 100.0 19.8 41.0 59.9 51.1 69.7 -3.2 -33.2 -59.6 46.1 92.1 5 32.6 36.2 9.2 19.8 100.0 85.6 7.4 61.4 60.3 31.0 -8.7 -10.7 7.9 18.4 6 47.9 71.6 33.4 41.0 85.6 100.0 49.0 81.2 83.1 1.5 -18.3 -27.5 30.2 37.7 7 48.4 94.6 64.6 59.9 7.4 49.0 100.0 60.7 76.1 -51.1 -27.8 -47.8 59.5 54.9 8 45.8 73.1 49.4 51.1 61.4 81.2 60.7 100.0 83.3 1.3 -25.1 -40.1 45.1 46.9 9 54.9 89.4 69.6 69.7 60.3 83.1 76.1 83.3 100.0 -9.1 -30.6 -52.1 63.6 63.5 10 -13.5 -39.8 -6.7 -3.2 31.0 1.5 -51.1 1.3 -9.1 100.0 3.0 4.0 -6.0 -3.1 11 -19.5 -27.9 -30.2 -33.2 -8.7 -18.3 -27.8 -25.1 -30.6 3.0 100.0 54.8 -26.7 -31.6 12 -31.3 -46.8 -53.2 -59.6 -10.7 -27.5 -47.8 -40.1 -52.1 4.0 54.8 100.0 -48.8 -52.8 13 30.1 57.0 91.4 46.1 7.9 30.2 59.5 45.1 63.6 -6.0 -26.7 -48.8 100.0 49.3 14 45.2 56.2 44.3 92.1 18.4 37.7 54.9 46.9 63.5 -3.1 -31.6 -52.8 49.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 147.72162 TOTAL CORRELATION OF ALL VARIABLES 60.9193133 ROUND 1: MAX CORR ( 60.9178066) AFTER KILLING INPUT VARIABLE 11 CONTR 0.428452835 ROUND 2: MAX CORR ( 60.9125181) AFTER KILLING INPUT VARIABLE 8 CONTR 0.802681864 ROUND 3: MAX CORR ( 60.9048121) AFTER KILLING INPUT VARIABLE 12 CONTR 0.968879541 ROUND 4: MAX CORR ( 60.8902977) AFTER KILLING INPUT VARIABLE 7 CONTR 1.32957774 ROUND 5: MAX CORR ( 60.8336344) AFTER KILLING INPUT VARIABLE 14 CONTR 2.6262667 ROUND 6: MAX CORR ( 60.7692308) AFTER KILLING INPUT VARIABLE 13 CONTR 2.79851129 ROUND 7: MAX CORR ( 60.7040918) AFTER KILLING INPUT VARIABLE 6 CONTR 2.8129431 ROUND 8: MAX CORR ( 60.4819685) AFTER KILLING INPUT VARIABLE 10 CONTR 5.18827975 ROUND 9: MAX CORR ( 60.0903328) AFTER KILLING INPUT VARIABLE 3 CONTR 6.87171198 ROUND 10: MAX CORR ( 59.6585364) AFTER KILLING INPUT VARIABLE 9 CONTR 7.1907666 ROUND 11: MAX CORR ( 57.894781) AFTER KILLING INPUT VARIABLE 5 CONTR 14.3991424 ROUND 12: MAX CORR ( 54.5503726) AFTER KILLING INPUT VARIABLE 4 CONTR 19.3923314 LAST REMAINING VARIABLE: 2 total correlation to target: 60.9193133 % total significance: 62.6605362 sigma correlations of single variables to target: variable 2: 54.5503726 % , in sigma: 56.1095556 variable 3: 34.1937942 % , in sigma: 35.1711365 variable 4: 48.8026664 % , in sigma: 50.1975659 variable 5: 32.5893549 % , in sigma: 33.5208384 variable 6: 47.9426394 % , in sigma: 49.3129573 variable 7: 48.3710776 % , in sigma: 49.7536412 variable 8: 45.8103174 % , in sigma: 47.1196883 variable 9: 54.8762481 % , in sigma: 56.4447454 variable 10: -13.4813514 % , in sigma: 13.8666814 variable 11: -19.4609808 % , in sigma: 20.0172232 variable 12: -31.2823853 % , in sigma: 32.1765123 variable 13: 30.0851068 % , in sigma: 30.9450127 variable 14: 45.1722084 % , in sigma: 46.4633405 variables sorted by significance: 1 most relevant variable 2 corr 54.5503731 , in sigma: 56.1095561 2 most relevant variable 4 corr 19.3923321 , in sigma: 19.9466123 3 most relevant variable 5 corr 14.3991423 , in sigma: 14.8107049 4 most relevant variable 9 corr 7.19076681 , in sigma: 7.3962965 5 most relevant variable 3 corr 6.87171221 , in sigma: 7.06812254 6 most relevant variable 10 corr 5.18827963 , in sigma: 5.33657334 7 most relevant variable 6 corr 2.81294322 , in sigma: 2.89334401 8 most relevant variable 13 corr 2.79851127 , in sigma: 2.87849956 9 most relevant variable 14 corr 2.62626672 , in sigma: 2.70133184 10 most relevant variable 7 corr 1.32957768 , in sigma: 1.36758026 11 most relevant variable 12 corr 0.968879521 , in sigma: 0.996572466 12 most relevant variable 8 corr 0.802681863 , in sigma: 0.825624473 13 most relevant variable 11 corr 0.428452849 , in sigma: 0.440699079 global correlations between input variables: variable 2: 99.4392419 % variable 3: 95.7732781 % variable 4: 95.7686564 % variable 5: 96.2997103 % variable 6: 96.6326571 % variable 7: 99.1566591 % variable 8: 88.930496 % variable 9: 98.7017357 % variable 10: 75.7668621 % variable 11: 55.7152763 % variable 12: 73.8059253 % variable 13: 94.0293016 % variable 14: 94.541223 % significance loss when removing single variables: variable 2: corr = 4.18627115 % , sigma = 4.30592501 variable 3: corr = 7.81656843 % , sigma = 8.03998506 variable 4: corr = 9.32982366 % , sigma = 9.59649282 variable 5: corr = 9.67870874 % , sigma = 9.95534989 variable 6: corr = 2.34895358 % , sigma = 2.41609241 variable 7: corr = 0.989425148 % , sigma = 1.01770534 variable 8: corr = 0.79222193 % , sigma = 0.814865569 variable 9: corr = 9.0660828 % , sigma = 9.32521361 variable 10: corr = 5.10687726 % , sigma = 5.2528443 variable 11: corr = 0.428452835 % , sigma = 0.440699064 variable 12: corr = 1.09569032 % , sigma = 1.12700783 variable 13: corr = 3.69949306 % , sigma = 3.80523361 variable 14: corr = 2.48030855 % , sigma = 2.55120183 Keep only 6 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 7 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 9.1775856 sigma out 15 active outputs RANK 2 NODE 7 --> 7.08198214 sigma out 15 active outputs RANK 3 NODE 1 --> 6.68143415 sigma out 15 active outputs RANK 4 NODE 3 --> 6.53506184 sigma out 15 active outputs RANK 5 NODE 2 --> 5.61575317 sigma out 15 active outputs RANK 6 NODE 5 --> 5.20445108 sigma out 15 active outputs RANK 7 NODE 6 --> 4.90019989 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 10.0880556 sigma in 7act. ( 11.4803162 sig out 1act.) RANK 2 NODE 6 --> 7.25924063 sigma in 7act. ( 7.84849882 sig out 1act.) RANK 3 NODE 4 --> 6.97276878 sigma in 7act. ( 7.58495951 sig out 1act.) RANK 4 NODE 13 --> 6.36466265 sigma in 7act. ( 6.82744503 sig out 1act.) RANK 5 NODE 2 --> 3.97997642 sigma in 7act. ( 4.3292079 sig out 1act.) RANK 6 NODE 9 --> 3.01307988 sigma in 7act. ( 3.2216115 sig out 1act.) RANK 7 NODE 14 --> 2.79302168 sigma in 7act. ( 2.77155685 sig out 1act.) RANK 8 NODE 3 --> 2.66501546 sigma in 7act. ( 3.41569519 sig out 1act.) RANK 9 NODE 10 --> 2.60084367 sigma in 7act. ( 2.70537663 sig out 1act.) RANK 10 NODE 5 --> 1.88823199 sigma in 7act. ( 1.58246338 sig out 1act.) RANK 11 NODE 8 --> 1.87181318 sigma in 7act. ( 2.1614244 sig out 1act.) RANK 12 NODE 11 --> 1.66624236 sigma in 7act. ( 1.2790035 sig out 1act.) RANK 13 NODE 7 --> 1.52990723 sigma in 7act. ( 1.6341002 sig out 1act.) RANK 14 NODE 12 --> 1.1785748 sigma in 7act. ( 0.110619374 sig out 1act.) RANK 15 NODE 1 --> 0.781386614 sigma in 7act. ( 0.347042859 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 11.4803162 sigma out 1act.( 10.0880556 sig in 7act.) RANK 2 NODE 6 --> 7.84849882 sigma out 1act.( 7.25924063 sig in 7act.) RANK 3 NODE 4 --> 7.58495951 sigma out 1act.( 6.97276878 sig in 7act.) RANK 4 NODE 13 --> 6.82744503 sigma out 1act.( 6.36466265 sig in 7act.) RANK 5 NODE 2 --> 4.3292079 sigma out 1act.( 3.97997642 sig in 7act.) RANK 6 NODE 3 --> 3.41569519 sigma out 1act.( 2.66501546 sig in 7act.) RANK 7 NODE 9 --> 3.2216115 sigma out 1act.( 3.01307988 sig in 7act.) RANK 8 NODE 14 --> 2.77155685 sigma out 1act.( 2.79302168 sig in 7act.) RANK 9 NODE 10 --> 2.70537663 sigma out 1act.( 2.60084367 sig in 7act.) RANK 10 NODE 8 --> 2.1614244 sigma out 1act.( 1.87181318 sig in 7act.) RANK 11 NODE 7 --> 1.6341002 sigma out 1act.( 1.52990723 sig in 7act.) RANK 12 NODE 5 --> 1.58246338 sigma out 1act.( 1.88823199 sig in 7act.) RANK 13 NODE 11 --> 1.2790035 sigma out 1act.( 1.66624236 sig in 7act.) RANK 14 NODE 1 --> 0.347042859 sigma out 1act.( 0.781386614 sig in 7act.) RANK 15 NODE 12 --> 0.110619374 sigma out 1act.( 1.1785748 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 19.1035442 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 12.0272741 sigma out 15 active outputs RANK 2 NODE 7 --> 10.5524206 sigma out 15 active outputs RANK 3 NODE 4 --> 10.541275 sigma out 15 active outputs RANK 4 NODE 1 --> 8.79845619 sigma out 15 active outputs RANK 5 NODE 2 --> 8.74985027 sigma out 15 active outputs RANK 6 NODE 3 --> 8.74473 sigma out 15 active outputs RANK 7 NODE 6 --> 6.51558924 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 11.6404066 sigma in 7act. ( 10.9705935 sig out 1act.) RANK 2 NODE 3 --> 7.74360609 sigma in 7act. ( 4.64354086 sig out 1act.) RANK 3 NODE 13 --> 7.31061316 sigma in 7act. ( 6.7067852 sig out 1act.) RANK 4 NODE 6 --> 7.20026159 sigma in 7act. ( 8.27670383 sig out 1act.) RANK 5 NODE 9 --> 6.99247837 sigma in 7act. ( 3.33234549 sig out 1act.) RANK 6 NODE 2 --> 6.64947319 sigma in 7act. ( 4.78707695 sig out 1act.) RANK 7 NODE 4 --> 6.50703621 sigma in 7act. ( 7.85906458 sig out 1act.) RANK 8 NODE 7 --> 6.29921627 sigma in 7act. ( 2.22882485 sig out 1act.) RANK 9 NODE 10 --> 5.95271301 sigma in 7act. ( 3.33806801 sig out 1act.) RANK 10 NODE 8 --> 5.40110397 sigma in 7act. ( 3.90504646 sig out 1act.) RANK 11 NODE 1 --> 5.04210997 sigma in 7act. ( 1.00958896 sig out 1act.) RANK 12 NODE 12 --> 4.93019295 sigma in 7act. ( 0.637019575 sig out 1act.) RANK 13 NODE 11 --> 4.82094669 sigma in 7act. ( 1.28194785 sig out 1act.) RANK 14 NODE 14 --> 4.0582943 sigma in 7act. ( 2.91481566 sig out 1act.) RANK 15 NODE 5 --> 3.17685127 sigma in 7act. ( 1.12639725 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 10.9705935 sigma out 1act.( 11.6404066 sig in 7act.) RANK 2 NODE 6 --> 8.27670383 sigma out 1act.( 7.20026159 sig in 7act.) RANK 3 NODE 4 --> 7.85906458 sigma out 1act.( 6.50703621 sig in 7act.) RANK 4 NODE 13 --> 6.7067852 sigma out 1act.( 7.31061316 sig in 7act.) RANK 5 NODE 2 --> 4.78707695 sigma out 1act.( 6.64947319 sig in 7act.) RANK 6 NODE 3 --> 4.64354086 sigma out 1act.( 7.74360609 sig in 7act.) RANK 7 NODE 8 --> 3.90504646 sigma out 1act.( 5.40110397 sig in 7act.) RANK 8 NODE 10 --> 3.33806801 sigma out 1act.( 5.95271301 sig in 7act.) RANK 9 NODE 9 --> 3.33234549 sigma out 1act.( 6.99247837 sig in 7act.) RANK 10 NODE 14 --> 2.91481566 sigma out 1act.( 4.0582943 sig in 7act.) RANK 11 NODE 7 --> 2.22882485 sigma out 1act.( 6.29921627 sig in 7act.) RANK 12 NODE 11 --> 1.28194785 sigma out 1act.( 4.82094669 sig in 7act.) RANK 13 NODE 5 --> 1.12639725 sigma out 1act.( 3.17685127 sig in 7act.) RANK 14 NODE 1 --> 1.00958896 sigma out 1act.( 5.04210997 sig in 7act.) RANK 15 NODE 12 --> 0.637019575 sigma out 1act.( 4.93019295 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 19.884161 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.357278109 *** contribution from regularisation: 0.00943763368 *** contribution from error: -0.366715729 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.402689934 *** contribution from regularisation: 0.00477867713 *** contribution from error: -0.407468617 *********************************************** -----------------> Test sample ENTER BFGS code START -8768.73655 0.170202926 -0.369501948 EXIT FROM BFGS code FG_START 0. 0.170202926 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.419101804 *** contribution from regularisation: 0.00468303682 *** contribution from error: -0.423784852 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -9123.84625 0.170202926 -68.1672897 EXIT FROM BFGS code FG_LNSRCH 0. 0.136814654 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.458288252 *** contribution from regularisation: 0.00738905417 *** contribution from error: -0.465677321 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9976.93512 0.136814654 -74.2684021 EXIT FROM BFGS code NEW_X -9976.93512 0.136814654 -74.2684021 ENTER BFGS code NEW_X -9976.93512 0.136814654 -74.2684021 EXIT FROM BFGS code FG_LNSRCH 0. 0.106802277 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.462870985 *** contribution from regularisation: 0.00747823855 *** contribution from error: -0.470349222 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10076.7015 0.106802277 -33.6338081 EXIT FROM BFGS code NEW_X -10076.7015 0.106802277 -33.6338081 ENTER BFGS code NEW_X -10076.7015 0.106802277 -33.6338081 EXIT FROM BFGS code FG_LNSRCH 0. 0.0796772167 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.464893699 *** contribution from regularisation: 0.00731522543 *** contribution from error: -0.472208917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10120.7361 0.0796772167 -16.254467 EXIT FROM BFGS code NEW_X -10120.7361 0.0796772167 -16.254467 ENTER BFGS code NEW_X -10120.7361 0.0796772167 -16.254467 EXIT FROM BFGS code FG_LNSRCH 0. 0.0456780642 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.465919673 *** contribution from regularisation: 0.00705019757 *** contribution from error: -0.47296986 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10143.0713 0.0456780642 -1.2152009 EXIT FROM BFGS code NEW_X -10143.0713 0.0456780642 -1.2152009 ENTER BFGS code NEW_X -10143.0713 0.0456780642 -1.2152009 EXIT FROM BFGS code FG_LNSRCH 0. 0.0278290827 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.466481656 *** contribution from regularisation: 0.00682799052 *** contribution from error: -0.473309636 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10155.3059 0.0278290827 -3.25975418 EXIT FROM BFGS code NEW_X -10155.3059 0.0278290827 -3.25975418 ENTER BFGS code NEW_X -10155.3059 0.0278290827 -3.25975418 EXIT FROM BFGS code FG_LNSRCH 0. -0.0698966011 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.468019515 *** contribution from regularisation: 0.00605576485 *** contribution from error: -0.474075288 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10188.785 -0.0698966011 -5.54934549 EXIT FROM BFGS code NEW_X -10188.785 -0.0698966011 -5.54934549 ENTER BFGS code NEW_X -10188.785 -0.0698966011 -5.54934549 EXIT FROM BFGS code FG_LNSRCH 0. -0.194285646 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 18.5903625 sigma out 15 active outputs RANK 2 NODE 3 --> 14.6686487 sigma out 15 active outputs RANK 3 NODE 1 --> 11.7136173 sigma out 15 active outputs RANK 4 NODE 2 --> 8.40674496 sigma out 15 active outputs RANK 5 NODE 4 --> 7.21950245 sigma out 15 active outputs RANK 6 NODE 7 --> 7.1313653 sigma out 15 active outputs RANK 7 NODE 6 --> 5.26926851 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 14.4040051 sigma in 7act. ( 15.6647091 sig out 1act.) RANK 2 NODE 7 --> 11.2900915 sigma in 7act. ( 10.0930624 sig out 1act.) RANK 3 NODE 13 --> 11.1904612 sigma in 7act. ( 8.28999138 sig out 1act.) RANK 4 NODE 6 --> 9.12814808 sigma in 7act. ( 7.42745876 sig out 1act.) RANK 5 NODE 8 --> 8.56594276 sigma in 7act. ( 7.95241737 sig out 1act.) RANK 6 NODE 1 --> 8.44538116 sigma in 7act. ( 7.28897905 sig out 1act.) RANK 7 NODE 15 --> 8.40556622 sigma in 7act. ( 6.97422647 sig out 1act.) RANK 8 NODE 10 --> 6.4978137 sigma in 7act. ( 5.61008787 sig out 1act.) RANK 9 NODE 12 --> 5.14669323 sigma in 7act. ( 4.26241159 sig out 1act.) RANK 10 NODE 4 --> 4.70509052 sigma in 7act. ( 3.44518447 sig out 1act.) RANK 11 NODE 14 --> 3.98284149 sigma in 7act. ( 3.30308652 sig out 1act.) RANK 12 NODE 2 --> 3.66542149 sigma in 7act. ( 2.29311275 sig out 1act.) RANK 13 NODE 9 --> 3.34655428 sigma in 7act. ( 0.770267725 sig out 1act.) RANK 14 NODE 11 --> 2.56626892 sigma in 7act. ( 1.0929867 sig out 1act.) RANK 15 NODE 5 --> 1.6186167 sigma in 7act. ( 0.476593584 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 15.6647091 sigma out 1act.( 14.4040051 sig in 7act.) RANK 2 NODE 7 --> 10.0930624 sigma out 1act.( 11.2900915 sig in 7act.) RANK 3 NODE 13 --> 8.28999138 sigma out 1act.( 11.1904612 sig in 7act.) RANK 4 NODE 8 --> 7.95241737 sigma out 1act.( 8.56594276 sig in 7act.) RANK 5 NODE 6 --> 7.42745876 sigma out 1act.( 9.12814808 sig in 7act.) RANK 6 NODE 1 --> 7.28897905 sigma out 1act.( 8.44538116 sig in 7act.) RANK 7 NODE 15 --> 6.97422647 sigma out 1act.( 8.40556622 sig in 7act.) RANK 8 NODE 10 --> 5.61008787 sigma out 1act.( 6.4978137 sig in 7act.) RANK 9 NODE 12 --> 4.26241159 sigma out 1act.( 5.14669323 sig in 7act.) RANK 10 NODE 4 --> 3.44518447 sigma out 1act.( 4.70509052 sig in 7act.) RANK 11 NODE 14 --> 3.30308652 sigma out 1act.( 3.98284149 sig in 7act.) RANK 12 NODE 2 --> 2.29311275 sigma out 1act.( 3.66542149 sig in 7act.) RANK 13 NODE 11 --> 1.0929867 sigma out 1act.( 2.56626892 sig in 7act.) RANK 14 NODE 9 --> 0.770267725 sigma out 1act.( 3.34655428 sig in 7act.) RANK 15 NODE 5 --> 0.476593584 sigma out 1act.( 1.6186167 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 26.7553463 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.468518794 *** contribution from regularisation: 0.00623570429 *** contribution from error: -0.474754512 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -10199.6538 -0.194285646 -6.5156002 EXIT FROM BFGS code NEW_X -10199.6538 -0.194285646 -6.5156002 ENTER BFGS code NEW_X -10199.6538 -0.194285646 -6.5156002 EXIT FROM BFGS code FG_LNSRCH 0. -0.35791406 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.46731478 *** contribution from regularisation: 0.00771546736 *** contribution from error: -0.475030243 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10173.4426 -0.35791406 30.8436832 EXIT FROM BFGS code FG_LNSRCH 0. -0.251947254 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.469096988 *** contribution from regularisation: 0.00668971334 *** contribution from error: -0.475786716 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10212.2414 -0.251947254 2.81772971 EXIT FROM BFGS code NEW_X -10212.2414 -0.251947254 2.81772971 ENTER BFGS code NEW_X -10212.2414 -0.251947254 2.81772971 EXIT FROM BFGS code FG_LNSRCH 0. -0.288365483 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.469406933 *** contribution from regularisation: 0.00683996547 *** contribution from error: -0.476246893 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10218.9887 -0.288365483 9.76882839 EXIT FROM BFGS code NEW_X -10218.9887 -0.288365483 9.76882839 ENTER BFGS code NEW_X -10218.9887 -0.288365483 9.76882839 EXIT FROM BFGS code FG_LNSRCH 0. -0.248715997 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.469725072 *** contribution from regularisation: 0.00672611548 *** contribution from error: -0.476451188 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10225.9151 -0.248715997 12.0070658 EXIT FROM BFGS code NEW_X -10225.9151 -0.248715997 12.0070658 ENTER BFGS code NEW_X -10225.9151 -0.248715997 12.0070658 EXIT FROM BFGS code FG_LNSRCH 0. -0.175424501 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.470363319 *** contribution from regularisation: 0.00637018541 *** contribution from error: -0.476733506 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10239.8097 -0.175424501 6.47753048 EXIT FROM BFGS code NEW_X -10239.8097 -0.175424501 6.47753048 ENTER BFGS code NEW_X -10239.8097 -0.175424501 6.47753048 EXIT FROM BFGS code FG_LNSRCH 0. -0.0912843943 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.469577223 *** contribution from regularisation: 0.00624429248 *** contribution from error: -0.475821525 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10222.6959 -0.0912843943 -2.11962795 EXIT FROM BFGS code FG_LNSRCH 0. -0.144985154 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.469416142 *** contribution from regularisation: 0.00757305184 *** contribution from error: -0.47698918 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10219.1895 -0.144985154 4.72651863 EXIT FROM BFGS code FG_LNSRCH 0. -0.172449812 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.469892204 *** contribution from regularisation: 0.00688469084 *** contribution from error: -0.476776898 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10229.5533 -0.172449812 6.28316307 EXIT FROM BFGS code FG_LNSRCH 0. -0.175346985 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.469904035 *** contribution from regularisation: 0.00683036447 *** contribution from error: -0.4767344 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10229.811 -0.175346985 6.40019226 EXIT FROM BFGS code FG_LNSRCH 0. -0.175424442 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 19.4514313 sigma out 15 active outputs RANK 2 NODE 3 --> 17.509613 sigma out 15 active outputs RANK 3 NODE 1 --> 12.7983036 sigma out 15 active outputs RANK 4 NODE 2 --> 9.22703075 sigma out 15 active outputs RANK 5 NODE 7 --> 7.56751299 sigma out 15 active outputs RANK 6 NODE 4 --> 6.80277777 sigma out 15 active outputs RANK 7 NODE 6 --> 4.7618947 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 16.5467606 sigma in 7act. ( 16.7783909 sig out 1act.) RANK 2 NODE 7 --> 13.0818377 sigma in 7act. ( 11.6861887 sig out 1act.) RANK 3 NODE 13 --> 12.0542517 sigma in 7act. ( 9.1576128 sig out 1act.) RANK 4 NODE 6 --> 10.7609482 sigma in 7act. ( 9.08724308 sig out 1act.) RANK 5 NODE 8 --> 8.85866261 sigma in 7act. ( 8.01578522 sig out 1act.) RANK 6 NODE 15 --> 8.71187687 sigma in 7act. ( 6.99977207 sig out 1act.) RANK 7 NODE 1 --> 8.2496109 sigma in 7act. ( 6.86022902 sig out 1act.) RANK 8 NODE 10 --> 6.33007956 sigma in 7act. ( 5.41337013 sig out 1act.) RANK 9 NODE 12 --> 6.29403687 sigma in 7act. ( 5.60103464 sig out 1act.) RANK 10 NODE 2 --> 4.03035545 sigma in 7act. ( 3.06761837 sig out 1act.) RANK 11 NODE 4 --> 3.78984547 sigma in 7act. ( 2.488096 sig out 1act.) RANK 12 NODE 14 --> 2.85672045 sigma in 7act. ( 1.9803201 sig out 1act.) RANK 13 NODE 9 --> 2.72493958 sigma in 7act. ( 0.00538101839 sig out 1act.) RANK 14 NODE 11 --> 1.87978351 sigma in 7act. ( 0.0718937665 sig out 1act.) RANK 15 NODE 5 --> 1.49243176 sigma in 7act. ( 0.763714254 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 16.7783909 sigma out 1act.( 16.5467606 sig in 7act.) RANK 2 NODE 7 --> 11.6861887 sigma out 1act.( 13.0818377 sig in 7act.) RANK 3 NODE 13 --> 9.1576128 sigma out 1act.( 12.0542517 sig in 7act.) RANK 4 NODE 6 --> 9.08724308 sigma out 1act.( 10.7609482 sig in 7act.) RANK 5 NODE 8 --> 8.01578522 sigma out 1act.( 8.85866261 sig in 7act.) RANK 6 NODE 15 --> 6.99977207 sigma out 1act.( 8.71187687 sig in 7act.) RANK 7 NODE 1 --> 6.86022902 sigma out 1act.( 8.2496109 sig in 7act.) RANK 8 NODE 12 --> 5.60103464 sigma out 1act.( 6.29403687 sig in 7act.) RANK 9 NODE 10 --> 5.41337013 sigma out 1act.( 6.33007956 sig in 7act.) RANK 10 NODE 2 --> 3.06761837 sigma out 1act.( 4.03035545 sig in 7act.) RANK 11 NODE 4 --> 2.488096 sigma out 1act.( 3.78984547 sig in 7act.) RANK 12 NODE 14 --> 1.9803201 sigma out 1act.( 2.85672045 sig in 7act.) RANK 13 NODE 5 --> 0.763714254 sigma out 1act.( 1.49243176 sig in 7act.) RANK 14 NODE 11 --> 0.0718937665 sigma out 1act.( 1.87978351 sig in 7act.) RANK 15 NODE 9 --> 0.00538101839 sigma out 1act.( 2.72493958 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 28.7336197 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.469956487 *** contribution from regularisation: 0.00677703926 *** contribution from error: -0.476733536 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -10230.9525 -0.175424442 6.43969202 EXIT FROM BFGS code FG_LNSRCH 0. -0.175424501 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.469934404 *** contribution from regularisation: 0.00679910462 *** contribution from error: -0.476733506 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10230.4721 -0.175424501 6.43909216 EXIT FROM BFGS code FG_LNSRCH 0. -0.175424501 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.469966203 *** contribution from regularisation: 0.00676731579 *** contribution from error: -0.476733506 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10231.1642 -0.175424501 6.4416213 EXIT FROM BFGS code FG_LNSRCH 0. -0.175424501 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.469999611 *** contribution from regularisation: 0.00673391717 *** contribution from error: -0.476733536 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -10231.8913 -0.175424501 6.41910458 EXIT FROM BFGS code NEW_X -10231.8913 -0.175424501 6.41910458 ENTER BFGS code NEW_X -10231.8913 -0.175424501 6.41910458 EXIT FROM BFGS code CONVERGENC -10231.8913 -0.175424501 6.41910458 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 24.9739532 sigma out 15 active outputs RANK 2 NODE 3 --> 23.4709415 sigma out 15 active outputs RANK 3 NODE 1 --> 17.1573429 sigma out 15 active outputs RANK 4 NODE 2 --> 11.8787785 sigma out 15 active outputs RANK 5 NODE 7 --> 10.0967464 sigma out 15 active outputs RANK 6 NODE 4 --> 8.73171616 sigma out 15 active outputs RANK 7 NODE 6 --> 6.20575666 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 22.2858143 sigma in 7act. ( 22.8639412 sig out 1act.) RANK 2 NODE 7 --> 17.3515644 sigma in 7act. ( 16.2518158 sig out 1act.) RANK 3 NODE 13 --> 15.9353371 sigma in 7act. ( 12.1602983 sig out 1act.) RANK 4 NODE 6 --> 14.023016 sigma in 7act. ( 12.3315306 sig out 1act.) RANK 5 NODE 8 --> 11.5545645 sigma in 7act. ( 10.7477474 sig out 1act.) RANK 6 NODE 15 --> 11.1841803 sigma in 7act. ( 9.54516029 sig out 1act.) RANK 7 NODE 1 --> 10.7437906 sigma in 7act. ( 9.02191067 sig out 1act.) RANK 8 NODE 12 --> 8.19749069 sigma in 7act. ( 7.42239952 sig out 1act.) RANK 9 NODE 10 --> 8.13158607 sigma in 7act. ( 7.25610113 sig out 1act.) RANK 10 NODE 2 --> 4.97592688 sigma in 7act. ( 4.03884888 sig out 1act.) RANK 11 NODE 4 --> 4.62302828 sigma in 7act. ( 3.3005898 sig out 1act.) RANK 12 NODE 14 --> 3.40372944 sigma in 7act. ( 2.51808071 sig out 1act.) RANK 13 NODE 9 --> 2.70831394 sigma in 7act. ( 0.00735407975 sig out 1act.) RANK 14 NODE 11 --> 1.86904907 sigma in 7act. ( 0.0924808905 sig out 1act.) RANK 15 NODE 5 --> 1.59912431 sigma in 7act. ( 0.960526466 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 22.8639412 sigma out 1act.( 22.2858143 sig in 7act.) RANK 2 NODE 7 --> 16.2518158 sigma out 1act.( 17.3515644 sig in 7act.) RANK 3 NODE 6 --> 12.3315306 sigma out 1act.( 14.023016 sig in 7act.) RANK 4 NODE 13 --> 12.1602983 sigma out 1act.( 15.9353371 sig in 7act.) RANK 5 NODE 8 --> 10.7477474 sigma out 1act.( 11.5545645 sig in 7act.) RANK 6 NODE 15 --> 9.54516029 sigma out 1act.( 11.1841803 sig in 7act.) RANK 7 NODE 1 --> 9.02191067 sigma out 1act.( 10.7437906 sig in 7act.) RANK 8 NODE 12 --> 7.42239952 sigma out 1act.( 8.19749069 sig in 7act.) RANK 9 NODE 10 --> 7.25610113 sigma out 1act.( 8.13158607 sig in 7act.) RANK 10 NODE 2 --> 4.03884888 sigma out 1act.( 4.97592688 sig in 7act.) RANK 11 NODE 4 --> 3.3005898 sigma out 1act.( 4.62302828 sig in 7act.) RANK 12 NODE 14 --> 2.51808071 sigma out 1act.( 3.40372944 sig in 7act.) RANK 13 NODE 5 --> 0.960526466 sigma out 1act.( 1.59912431 sig in 7act.) RANK 14 NODE 11 --> 0.0924808905 sigma out 1act.( 1.86904907 sig in 7act.) RANK 15 NODE 9 --> 0.00735407975 sigma out 1act.( 2.70831394 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.9494667 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.470029652 *** contribution from regularisation: 0.0067038713 *** contribution from error: -0.476733536 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25167 Closing output file done