NNInput NNInputs_175.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 181126 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 44790 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 44790 Chosen entries: 44790 Signal fraction: 1 Background fraction: 0.328527 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 44790 Entries to split: 44790 Test with : 22395 Train with : 22395 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 44790 for Signal Prepared event 0 for Signal with 44790 events ====Entry 0 Variable Ht : 241.352 Variable LepAPt : 26.6709 Variable LepBPt : 20.757 Variable MetSigLeptonsJets : 8.7004 Variable MetSpec : 102.516 Variable SumEtLeptonsJets : 138.836 Variable VSumJetLeptonsPt : 95.4385 Variable addEt : 149.944 Variable dPhiLepSumMet : 1.91756 Variable dPhiLeptons : 0.237715 Variable dRLeptons : 0.435475 Variable lep1_E : 34.2866 Variable lep2_E : 22.2255 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2175 Ht = 241.352 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 26.6709 LepAPt = 26.6709 LepBEt = 20.7574 LepBPt = 20.757 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 102.516 MetDelPhi = 1.78381 MetSig = 7.13205 MetSigLeptonsJets = 8.7004 MetSpec = 102.516 Mjj = 0 MostCentralJetEta = 1.70124 MtllMet = 156.27 Njets = 1 SB = 0 SumEt = 206.61 SumEtJets = 0 SumEtLeptonsJets = 138.836 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 95.4385 addEt = 149.944 dPhiLepSumMet = 1.91756 dPhiLeptons = 0.237715 dRLeptons = 0.435475 diltype = 54 dimass = 10.2815 event = 116 jet1_Et = 91.408 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.2866 lep2_E = 22.2255 rand = 0.999742 run = 236503 weight = 2.5946e-06 ===Show End Prepared event 10000 for Signal with 44790 events Prepared event 20000 for Signal with 44790 events Prepared event 30000 for Signal with 44790 events Prepared event 40000 for Signal with 44790 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.322639 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4349 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 181126 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4349 negative weights. Signal fraction: 62.9638786 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0048981 63.5279007 65.696785 67.2565613 68.5636139 69.5764313 70.4528198 71.3370667 72.1820526 73.1744003 73.952301 74.669693 75.4727707 76.181366 76.9240036 77.6730652 78.3902359 79.0647583 79.7731476 80.509407 81.2475052 82.0129089 82.7885132 83.6274414 84.6894455 85.9438019 87.0684204 88.4281769 89.4619446 90.9984589 92.6955872 94.1648407 95.9490662 97.6460266 99.2372589 100.830002 102.330978 104.062477 105.761169 107.199127 108.791924 110.635773 112.58757 114.393005 116.225113 117.964966 119.717735 121.062759 122.832108 124.750977 126.452667 128.140289 129.827576 131.533295 132.978653 134.577393 136.064331 137.532837 139.127045 140.599396 142.070282 143.519714 144.974258 146.477051 147.975128 149.376617 150.79538 152.292297 153.771637 155.279831 156.787476 158.399094 159.88739 161.618835 163.218597 164.994293 166.67305 168.576904 170.552917 172.706909 175.200317 177.456528 179.959183 182.518921 185.201324 188.189301 191.430267 194.927704 198.488373 202.279205 206.621735 211.394562 217.060303 223.080826 230.623016 239.844131 250.785339 264.767517 282.530121 319.105286 824.779175 ------------------------------ Transdef: Tab for variable 3 20.0001698 20.3515701 20.7229042 21.0827446 21.4000549 21.6525269 21.9273453 22.1599407 22.3918877 22.6480751 22.8328896 23.0691452 23.2836685 23.5161762 23.7582321 24.018589 24.2865639 24.5321636 24.7648201 25.0096283 25.2014694 25.3831406 25.5933304 25.7993736 26.0601635 26.3335266 26.5573502 26.8034782 27.0769672 27.2852173 27.5526085 27.8440247 28.0817261 28.338644 28.6200066 28.8230057 29.1048508 29.4062767 29.7004013 29.9759865 30.2913189 30.5651321 30.8219299 31.1271267 31.4762745 31.7586594 32.0240631 32.3360176 32.6808167 33.0053635 33.2953224 33.6334991 33.995697 34.338707 34.6691704 35.0685501 35.415123 35.7179222 36.0347862 36.4263535 36.7945213 37.1642456 37.5390091 37.8896942 38.2766609 38.6565094 39.0238876 39.2961502 39.7308884 40.1091614 40.5191345 40.9408264 41.3777313 41.8058815 42.2546387 42.7405167 43.2299767 43.7445831 44.2353058 44.7899323 45.3743134 45.9394379 46.4369049 47.059967 47.7359428 48.3638992 49.0841255 49.7770691 50.6006622 51.3870659 52.3471985 53.2487259 54.3392487 55.4951401 56.907299 58.5079498 60.4269104 62.8017731 66.6934586 74.2565002 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1373615 10.2866631 10.4076061 10.539587 10.6636219 10.7969437 10.9230385 11.0601559 11.2113628 11.3592129 11.4842129 11.6663723 11.8123093 11.9599667 12.1315384 12.2832527 12.4351959 12.6188602 12.8133144 12.9675083 13.1753588 13.3700142 13.5474234 13.692976 13.8367252 14.0135183 14.221838 14.4431553 14.6843081 14.8846378 15.1081581 15.3260288 15.528224 15.7400112 15.9746504 16.2498932 16.4690857 16.730608 16.9416962 17.1800137 17.4914513 17.7595634 18.0607948 18.3308144 18.6462078 18.908783 19.1653824 19.4654732 19.7514782 20.0634308 20.3243923 20.5755043 20.8161755 21.0996666 21.3861828 21.6414547 21.9133778 22.0989838 22.3836136 22.6646919 22.9305458 23.2296486 23.4975605 23.7769089 24.0689735 24.3657913 24.6387253 24.9472904 25.226593 25.5008259 25.7995491 26.0918713 26.3558197 26.6504784 26.9570179 27.2524223 27.5598202 27.8655586 28.1547241 28.4768028 28.8452244 29.20298 29.5882835 29.9658432 30.3412476 30.71105 31.1623707 31.5909348 32.06884 32.5965271 33.1250992 33.8308067 34.4708176 35.2522507 36.1207504 37.2360992 38.6665726 40.9349899 44.476326 72.9998398 ------------------------------ Transdef: Tab for variable 5 1.30781281 2.85494876 3.26711893 3.58670092 3.8313098 4.03245068 4.17951536 4.30397654 4.4299016 4.5631609 4.65153837 4.7608881 4.86646891 4.95015812 5.021595 5.10700607 5.1691618 5.25227833 5.30562305 5.36687946 5.42389393 5.47790956 5.53262901 5.58851004 5.63649368 5.69880676 5.75052834 5.80353928 5.85088539 5.90830994 5.95816231 6.0079031 6.05888462 6.10454321 6.15337944 6.20258045 6.25479078 6.29536438 6.34607315 6.39936447 6.45013905 6.4933939 6.54376507 6.58926296 6.63812065 6.68656158 6.7333312 6.78321695 6.82820129 6.87320137 6.92369604 6.9743185 7.02784252 7.07979631 7.1385088 7.18723106 7.241292 7.29563427 7.34214973 7.39563274 7.44683552 7.48987627 7.54920292 7.6137476 7.66429615 7.71935987 7.7816062 7.83976746 7.89943695 7.95499325 8.01315975 8.06667328 8.12729836 8.19569397 8.24990845 8.30687714 8.36415577 8.42670059 8.48774052 8.54939651 8.61351299 8.67872524 8.74661636 8.8127346 8.88829708 8.95260715 9.03429508 9.11863327 9.20772648 9.30169868 9.40668106 9.50452423 9.62403679 9.75839806 9.918787 10.0987883 10.3235874 10.6592579 11.078187 11.8601875 18.1303024 ------------------------------ Transdef: Tab for variable 6 15.0119848 22.1277428 25.634861 26.7493267 27.663456 28.7451153 29.5722122 30.4799042 31.2086525 31.8128967 32.4319611 32.9313736 33.4629364 33.9004288 34.4149208 34.8295593 35.2723579 35.7153702 36.0953407 36.5122147 36.9201431 37.3616028 37.748642 38.1209412 38.5111008 38.8958893 39.3715057 39.8652344 40.2882347 40.6496391 41.1104622 41.6135254 42.0813065 42.5204468 43.0022888 43.5113106 43.9254303 44.5093689 45.0820656 45.7103348 46.3909683 47.0701752 47.6684036 48.3610954 49.0454483 49.7105331 50.3402557 51.0654068 51.9508018 52.840519 53.6548691 54.3973351 55.186615 56.0189743 56.7867393 57.4053421 58.1911201 58.7368355 59.6000557 60.3734436 61.1685562 62.0391769 62.8659973 63.6970215 64.5100098 65.2852173 66.0928955 66.8647919 67.7114029 68.4714508 69.2943039 70.0665588 70.8894043 71.6215515 72.4330139 73.1835098 73.9026489 74.6524582 75.4562683 76.3019409 77.144989 78.0396957 78.9526062 79.8529892 80.7994461 81.7872467 82.734787 83.8922958 85.1337128 86.50177 88.0160904 89.7826538 91.6934509 94.0870972 96.9287796 100.306084 104.147552 109.719879 117.490082 131.665619 269.818756 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.6529846 33.7815361 34.4699326 35.0441704 35.6352081 36.106636 36.6088257 36.9506531 37.3752747 37.7817307 38.0883713 38.4224968 38.771904 39.0578194 39.3458252 39.7043495 39.9924622 40.2830505 40.6371803 41.0304871 41.4322205 41.8628006 42.2867813 42.7379646 43.3312683 44.0137405 44.6455994 45.3875656 46.1758881 47.048584 48.0289345 49.0202332 49.9650803 50.9944382 52.0017281 52.9230537 53.9354782 55.0487366 56.1096649 57.2055359 58.2192955 59.3233376 60.2737885 61.1810989 61.941803 62.7520027 63.7061462 64.6118317 65.4516983 66.2657623 67.1734619 68.0128632 68.865921 69.7754364 70.6555786 71.4522629 72.265976 73.1476364 74.0039673 74.8204498 75.7014008 76.4985962 77.2984009 78.2862244 79.2802124 80.3155212 81.403717 82.3650055 83.4304352 84.6243896 85.9324341 87.3517761 88.7304688 90.1776733 91.676918 93.2321243 94.7884674 96.631279 98.5694885 100.464157 102.278412 104.45166 106.647308 108.829971 111.152756 113.580833 116.262436 119.478584 123.025803 126.661423 130.733246 135.245178 139.729904 145.552246 151.398575 160.724487 172.589386 190.409302 217.87323 479.155426 ------------------------------ Transdef: Tab for variable 8 2.05942559 26.49963 29.8857479 31.4855442 32.3588486 32.9849854 33.6002197 34.0853958 34.4985161 34.9858475 35.4360275 35.8302383 36.1690407 36.5252762 36.8338776 37.1118622 37.3723145 37.7024078 38.0146751 38.2239876 38.5550613 38.8470078 39.1099777 39.3800812 39.6431541 39.8931465 40.2136841 40.5950775 40.9850388 41.3535728 41.8353004 42.2980042 42.7134857 43.2657089 43.7358017 44.2446213 44.7615967 45.4047089 46.0626526 46.6870422 47.374054 48.1062698 48.7485924 49.3837814 50.1163216 50.9153709 51.5874214 52.3265419 53.0867538 53.8643799 54.6255569 55.4034271 56.1528854 56.89711 57.6197433 58.416481 59.1668549 59.84655 60.5582733 61.0986443 61.7814522 62.5033607 63.184845 63.9201813 64.637001 65.2819901 65.9050827 66.6106949 67.3270264 68.0601654 68.7569809 69.4947205 70.2137985 70.9055862 71.6508026 72.2898865 73.0319366 73.8034515 74.4474792 75.2090912 75.9674683 76.8015213 77.687973 78.5612411 79.5415497 80.5262756 81.5063019 82.5871124 83.7296448 85.1136017 86.5806503 88.3322449 90.2889252 92.4909821 95.305069 98.7951355 103.130875 108.929733 117.330475 132.934662 374.426086 ------------------------------ Transdef: Tab for variable 9 48.8581314 63.0416183 65.1693268 66.8007202 68.0135651 69.0340652 69.9725342 70.80793 71.5930328 72.3555756 73.2240906 73.9532547 74.6332474 75.3478241 75.9721985 76.6545258 77.2185974 77.8834686 78.4862976 79.1126022 79.7322769 80.3597031 80.973526 81.5578003 82.2749481 82.9833984 83.6281357 84.499054 85.2701263 86.2076645 87.1461182 88.1902237 89.132515 90.0957489 91.2302551 92.6265717 93.6691284 95.1761475 96.5917664 98.0031433 99.4533234 100.970177 102.125351 103.686302 105.124931 106.474899 107.95182 109.3806 110.690392 112.296921 113.879425 115.251419 116.706108 117.973038 119.387482 120.308121 121.67617 123.060982 124.496696 125.857544 127.113068 128.39328 129.63266 131.034348 132.308899 133.6138 134.844635 136.122375 137.238312 138.381622 139.641632 140.732697 141.882812 142.981262 144.108795 145.328003 146.365829 147.544647 148.734924 149.8508 150.918701 152.004013 153.284164 154.419159 155.654419 156.900085 158.104355 159.520172 160.988556 162.482605 163.999847 165.590149 167.363892 169.277039 171.577728 174.123291 177.570496 181.793182 189.032593 205.395233 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.12428629 1.46215653 1.67618132 1.84186411 1.95387411 2.05077791 2.12901831 2.20176053 2.26128721 2.31639838 2.36158824 2.4047389 2.4408114 2.47392464 2.50593925 2.53695226 2.56520128 2.59118295 2.61453366 2.63609171 2.6576004 2.67929697 2.69954896 2.71819711 2.73736668 2.75410175 2.77031612 2.78397202 2.79992247 2.81350613 2.82650471 2.83917141 2.84932327 2.85723257 2.86716461 2.87855959 2.88712478 2.89609146 2.90470934 2.91263962 2.92031908 2.92842484 2.93518877 2.94232321 2.94964218 2.95617151 2.96299362 2.96822977 2.97455025 2.98022366 2.98502445 2.98985314 2.9949491 3.00011468 3.00461388 3.00957108 3.01388645 3.01812077 3.02244544 3.02652788 3.03030396 3.03431463 3.03829765 3.0420351 3.04555964 3.0493989 3.05290604 3.05642366 3.06031179 3.06386399 3.06710196 3.0701611 3.07324791 3.0761714 3.07895184 3.08207011 3.08477402 3.08793116 3.09091949 3.093472 3.09601641 3.09888411 3.10166979 3.1039474 3.1066246 3.10890627 3.11151886 3.11408329 3.1165235 3.1190567 3.12138748 3.12370944 3.12623787 3.12854409 3.1307478 3.13251257 3.13450527 3.13684511 3.13900471 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00603801478 0.0126445591 0.0199263077 0.0260089636 0.0330023766 0.040071018 0.0481903553 0.0557791069 0.0615950897 0.0687326789 0.0760614946 0.0834639072 0.0907557011 0.0982862115 0.104275227 0.109231994 0.115769744 0.122175813 0.12974894 0.137580931 0.144747853 0.15141964 0.157639652 0.163597584 0.170425951 0.175918818 0.181664109 0.187453389 0.193293691 0.198534966 0.203824043 0.208967566 0.213854074 0.219586611 0.224812627 0.229876757 0.234483331 0.239158958 0.244252026 0.249293476 0.254060984 0.259006858 0.263260245 0.267849475 0.272829652 0.277793169 0.282466888 0.287284881 0.292421937 0.297618985 0.302800655 0.308172166 0.313024938 0.318966389 0.324567974 0.330379128 0.335586131 0.341307759 0.346948087 0.352233171 0.358155131 0.364470601 0.370720983 0.376220137 0.382478714 0.387634277 0.392838597 0.398958683 0.405062199 0.411226988 0.417954803 0.424470484 0.431119561 0.437560439 0.445360839 0.452046454 0.459670067 0.467843145 0.475286365 0.482276976 0.492021918 0.500748873 0.509335041 0.520337701 0.530189157 0.541731596 0.551062822 0.564239144 0.578552008 0.593220592 0.607235909 0.624130964 0.641078711 0.657456458 0.681845903 0.711283803 0.737149715 0.777820826 0.844810843 1.11679101 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.209839374 0.219142482 0.227997243 0.235563278 0.243134111 0.250347674 0.256857336 0.263904989 0.270358711 0.276738763 0.282917321 0.289254725 0.295176417 0.300795972 0.305927396 0.310601413 0.315816551 0.321333349 0.326562047 0.331944346 0.336966753 0.342162669 0.346901178 0.351546139 0.35611999 0.361297965 0.366673857 0.371839136 0.375833988 0.38077414 0.385323524 0.39015016 0.394677758 0.398803473 0.402489126 0.405963004 0.409678996 0.413647354 0.417192757 0.420672864 0.424822271 0.428462386 0.432090104 0.436203301 0.439378083 0.443257153 0.447001219 0.451415569 0.455377907 0.459585011 0.462999582 0.467072904 0.470723987 0.47470516 0.477820992 0.482038766 0.486441672 0.490713954 0.494951069 0.499094188 0.503599882 0.508467555 0.513246357 0.519002616 0.52399683 0.529550195 0.53604579 0.541901588 0.547930479 0.55357182 0.559063077 0.564403296 0.570474386 0.577314138 0.583113909 0.590555608 0.596476436 0.604194403 0.612037003 0.620639205 0.628800273 0.636293054 0.646191716 0.655674934 0.664955556 0.672140479 0.68162787 0.692187309 0.703098536 0.714236975 0.725197375 0.73790127 0.751476645 0.76856637 0.787516713 0.805769622 0.83321619 0.869646192 0.915789902 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0150032 21.7915249 22.5012131 23.2942371 23.8650856 24.4336243 24.9587936 25.3778915 25.9425697 26.43367 26.912262 27.3579006 27.7837772 28.2443333 28.7022667 29.0962296 29.4808006 29.823597 30.2313061 30.5762444 30.9059124 31.1896763 31.5659695 31.9789238 32.3397369 32.7323799 33.1569824 33.5401535 33.9454689 34.3377495 34.71912 35.0555267 35.4006195 35.7682076 36.0905609 36.4677277 36.8403168 37.2235107 37.6078148 37.9810677 38.3519897 38.7155609 39.0620575 39.5166512 39.8635788 40.3131256 40.7276039 41.144577 41.5319824 41.9589233 42.4290848 42.8176041 43.2826309 43.6747932 44.1452179 44.5894699 45.0630341 45.553627 46.0222092 46.4849319 46.9903946 47.4263458 47.918663 48.3982849 48.9183693 49.4297523 49.9280319 50.4723244 51.0513916 51.6506462 52.1908035 52.7830009 53.3577309 53.945343 54.5476265 55.1782074 55.8062592 56.5588875 57.2744141 58.0361557 58.757988 59.6759033 60.5066986 61.5354919 62.4466019 63.5396042 64.5412292 65.7529907 66.9991837 68.3891678 69.9865875 71.5004654 73.4345856 75.7758026 78.1325302 81.0216827 84.7890091 87.9474335 93.380661 104.955711 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.723712 11.1346178 11.5337601 11.9943819 12.3175287 12.6684589 13.0406599 13.3985519 13.7165871 14.020752 14.3638783 14.708643 15.0558891 15.405344 15.6928415 15.9710636 16.3204231 16.6095924 16.8713799 17.1830902 17.5468674 17.830307 18.1141357 18.3130245 18.643074 18.9266968 19.2243156 19.5608406 19.8765163 20.2117157 20.5337257 20.8176308 21.1386528 21.4689083 21.7486534 22.0292263 22.2891121 22.6044044 22.946106 23.2410011 23.5130844 23.816473 24.1311531 24.4312611 24.722805 25.0125542 25.2816658 25.5485878 25.795805 26.0690498 26.3688126 26.6170959 26.8946762 27.1766167 27.4463463 27.7021599 27.993988 28.2813148 28.5580158 28.8622284 29.1914978 29.4845772 29.8001995 30.1258907 30.4077187 30.7305317 31.0815048 31.4323807 31.7676773 32.1053619 32.4494438 32.810524 33.1922913 33.4472885 33.7399521 34.1244087 34.4996033 34.911808 35.3294296 35.7948036 36.253418 36.7678528 37.27174 37.7898903 38.3562164 38.9757004 39.5711136 40.3288651 41.047287 41.9225044 42.869175 43.9984055 45.1742821 46.5513802 48.1369057 49.9839211 52.9595146 56.4347 62.5902634 114.033585 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 66.5 52.7 55.5 33.1 51.3 64.2 57.8 65.3 -25.3 -22.3 -43.8 19.9 30.3 2 66.5 100.0 68.4 62.2 40.8 71.9 94.6 78.2 92.4 -41.9 -29.1 -54.4 36.1 37.7 3 52.7 68.4 100.0 50.7 17.0 40.3 70.8 59.1 75.2 -12.7 -30.3 -60.1 66.5 30.4 4 55.5 62.2 50.7 100.0 20.0 40.1 63.2 55.0 67.7 -12.3 -33.5 -66.0 25.7 72.9 5 33.1 40.8 17.0 20.0 100.0 85.2 14.0 60.4 60.5 22.6 -11.1 -16.8 2.3 8.9 6 51.3 71.9 40.3 40.1 85.2 100.0 51.8 80.9 81.4 -6.9 -19.6 -34.5 16.7 22.2 7 64.2 94.6 70.8 63.2 14.0 51.8 100.0 70.1 81.6 -51.0 -28.1 -54.8 39.9 39.7 8 57.8 78.2 59.1 55.0 60.4 80.9 70.1 100.0 85.4 -10.6 -27.8 -49.3 31.7 34.6 9 65.3 92.4 75.2 67.7 60.5 81.4 81.6 85.4 100.0 -18.5 -31.9 -60.2 42.0 42.7 10 -25.3 -41.9 -12.7 -12.3 22.6 -6.9 -51.0 -10.6 -18.5 100.0 3.7 8.9 -3.9 -5.5 11 -22.3 -29.1 -30.3 -33.5 -11.1 -19.6 -28.1 -27.8 -31.9 3.7 100.0 55.2 -16.0 -24.1 12 -43.8 -54.4 -60.1 -66.0 -16.8 -34.5 -54.8 -49.3 -60.2 8.9 55.2 100.0 -32.5 -41.9 13 19.9 36.1 66.5 25.7 2.3 16.7 39.9 31.7 42.0 -3.9 -16.0 -32.5 100.0 50.2 14 30.3 37.7 30.4 72.9 8.9 22.2 39.7 34.6 42.7 -5.5 -24.1 -41.9 50.2 100.0 TOTAL CORRELATION TO TARGET (diagonal) 173.462402 TOTAL CORRELATION OF ALL VARIABLES 73.0739905 ROUND 1: MAX CORR ( 73.0738266) AFTER KILLING INPUT VARIABLE 14 CONTR 0.154790625 ROUND 2: MAX CORR ( 73.0717193) AFTER KILLING INPUT VARIABLE 11 CONTR 0.554946502 ROUND 3: MAX CORR ( 73.0687745) AFTER KILLING INPUT VARIABLE 8 CONTR 0.65601912 ROUND 4: MAX CORR ( 73.0670083) AFTER KILLING INPUT VARIABLE 6 CONTR 0.508044878 ROUND 5: MAX CORR ( 73.0617948) AFTER KILLING INPUT VARIABLE 2 CONTR 0.872828241 ROUND 6: MAX CORR ( 73.0252112) AFTER KILLING INPUT VARIABLE 12 CONTR 2.3117956 ROUND 7: MAX CORR ( 72.7122679) AFTER KILLING INPUT VARIABLE 10 CONTR 6.75333769 ROUND 8: MAX CORR ( 71.8892273) AFTER KILLING INPUT VARIABLE 13 CONTR 10.9093033 ROUND 9: MAX CORR ( 70.7344782) AFTER KILLING INPUT VARIABLE 9 CONTR 12.833339 ROUND 10: MAX CORR ( 70.4515474) AFTER KILLING INPUT VARIABLE 3 CONTR 6.32027578 ROUND 11: MAX CORR ( 68.6195915) AFTER KILLING INPUT VARIABLE 4 CONTR 15.9615848 ROUND 12: MAX CORR ( 64.1560811) AFTER KILLING INPUT VARIABLE 5 CONTR 24.3443133 LAST REMAINING VARIABLE: 7 total correlation to target: 73.0739905 % total significance: 138.182508 sigma correlations of single variables to target: variable 2: 66.4557047 % , in sigma: 125.667367 variable 3: 52.6564115 % , in sigma: 99.5729801 variable 4: 55.5193961 % , in sigma: 104.986868 variable 5: 33.1149101 % , in sigma: 62.62011 variable 6: 51.3374155 % , in sigma: 97.0787661 variable 7: 64.1560811 % , in sigma: 121.318791 variable 8: 57.7628851 % , in sigma: 109.229293 variable 9: 65.300469 % , in sigma: 123.482822 variable 10: -25.2635959 % , in sigma: 47.7733187 variable 11: -22.3005255 % , in sigma: 42.1701693 variable 12: -43.7930232 % , in sigma: 82.8123625 variable 13: 19.927966 % , in sigma: 37.6836725 variable 14: 30.305038 % , in sigma: 57.3066577 variables sorted by significance: 1 most relevant variable 7 corr 64.1560822 , in sigma: 121.318793 2 most relevant variable 5 corr 24.3443127 , in sigma: 46.0349593 3 most relevant variable 4 corr 15.961585 , in sigma: 30.1832682 4 most relevant variable 3 corr 6.32027578 , in sigma: 11.9516062 5 most relevant variable 9 corr 12.8333387 , in sigma: 24.2677719 6 most relevant variable 13 corr 10.9093037 , in sigma: 20.6294323 7 most relevant variable 10 corr 6.75333786 , in sigma: 12.7705242 8 most relevant variable 12 corr 2.31179571 , in sigma: 4.37159278 9 most relevant variable 2 corr 0.872828245 , in sigma: 1.65051334 10 most relevant variable 6 corr 0.508044899 , in sigma: 0.960710067 11 most relevant variable 8 corr 0.656019092 , in sigma: 1.24052844 12 most relevant variable 11 corr 0.554946482 , in sigma: 1.0494007 13 most relevant variable 14 corr 0.154790625 , in sigma: 0.292708208 global correlations between input variables: variable 2: 99.1941273 % variable 3: 93.345918 % variable 4: 92.1371586 % variable 5: 95.624872 % variable 6: 95.2916371 % variable 7: 98.8182722 % variable 8: 90.7740409 % variable 9: 98.8160705 % variable 10: 71.5927948 % variable 11: 56.2766763 % variable 12: 79.3200618 % variable 13: 85.909721 % variable 14: 88.2079841 % significance loss when removing single variables: variable 2: corr = 1.12784713 % , sigma = 2.13275262 variable 3: corr = 15.479319 % , sigma = 29.2713058 variable 4: corr = 13.1950264 % , sigma = 24.9517213 variable 5: corr = 15.3781911 % , sigma = 29.0800734 variable 6: corr = 0.730332085 % , sigma = 1.3810539 variable 7: corr = 8.35058513 % , sigma = 15.7909099 variable 8: corr = 0.689214844 % , sigma = 1.30330142 variable 9: corr = 10.344204 % , sigma = 19.5608321 variable 10: corr = 6.51931826 % , sigma = 12.3279944 variable 11: corr = 0.540728045 % , sigma = 1.02251371 variable 12: corr = 1.86980269 % , sigma = 3.53578645 variable 13: corr = 7.45373431 % , sigma = 14.09497 variable 14: corr = 0.154790625 % , sigma = 0.292708208 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 7 --> 12.6575613 sigma out 15 active outputs RANK 2 NODE 3 --> 11.2643223 sigma out 15 active outputs RANK 3 NODE 8 --> 11.0362759 sigma out 15 active outputs RANK 4 NODE 6 --> 11.0154953 sigma out 15 active outputs RANK 5 NODE 4 --> 10.3844557 sigma out 15 active outputs RANK 6 NODE 2 --> 10.372303 sigma out 15 active outputs RANK 7 NODE 5 --> 9.86096859 sigma out 15 active outputs RANK 8 NODE 1 --> 7.4392662 sigma out 15 active outputs RANK 9 NODE 9 --> 5.52914333 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 14.4195442 sigma in 9act. ( 15.8647518 sig out 1act.) RANK 2 NODE 5 --> 12.959137 sigma in 9act. ( 13.4932079 sig out 1act.) RANK 3 NODE 7 --> 12.8151321 sigma in 9act. ( 13.3222942 sig out 1act.) RANK 4 NODE 4 --> 10.7866068 sigma in 9act. ( 12.0986071 sig out 1act.) RANK 5 NODE 10 --> 9.20738029 sigma in 9act. ( 9.59436798 sig out 1act.) RANK 6 NODE 6 --> 7.43556881 sigma in 9act. ( 11.1247444 sig out 1act.) RANK 7 NODE 11 --> 5.12835169 sigma in 9act. ( 0.877546608 sig out 1act.) RANK 8 NODE 15 --> 4.67646837 sigma in 9act. ( 1.47993267 sig out 1act.) RANK 9 NODE 12 --> 4.02517462 sigma in 9act. ( 7.22127771 sig out 1act.) RANK 10 NODE 2 --> 3.93250823 sigma in 9act. ( 5.54565239 sig out 1act.) RANK 11 NODE 14 --> 3.79347372 sigma in 9act. ( 0.264125466 sig out 1act.) RANK 12 NODE 1 --> 3.74559689 sigma in 9act. ( 5.69418621 sig out 1act.) RANK 13 NODE 13 --> 2.9974823 sigma in 9act. ( 1.13284206 sig out 1act.) RANK 14 NODE 9 --> 2.96360779 sigma in 9act. ( 2.93207836 sig out 1act.) RANK 15 NODE 3 --> 2.50707078 sigma in 9act. ( 2.74048305 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 15.8647518 sigma out 1act.( 14.4195442 sig in 9act.) RANK 2 NODE 5 --> 13.4932079 sigma out 1act.( 12.959137 sig in 9act.) RANK 3 NODE 7 --> 13.3222942 sigma out 1act.( 12.8151321 sig in 9act.) RANK 4 NODE 4 --> 12.0986071 sigma out 1act.( 10.7866068 sig in 9act.) RANK 5 NODE 6 --> 11.1247444 sigma out 1act.( 7.43556881 sig in 9act.) RANK 6 NODE 10 --> 9.59436798 sigma out 1act.( 9.20738029 sig in 9act.) RANK 7 NODE 12 --> 7.22127771 sigma out 1act.( 4.02517462 sig in 9act.) RANK 8 NODE 1 --> 5.69418621 sigma out 1act.( 3.74559689 sig in 9act.) RANK 9 NODE 2 --> 5.54565239 sigma out 1act.( 3.93250823 sig in 9act.) RANK 10 NODE 9 --> 2.93207836 sigma out 1act.( 2.96360779 sig in 9act.) RANK 11 NODE 3 --> 2.74048305 sigma out 1act.( 2.50707078 sig in 9act.) RANK 12 NODE 15 --> 1.47993267 sigma out 1act.( 4.67646837 sig in 9act.) RANK 13 NODE 13 --> 1.13284206 sigma out 1act.( 2.9974823 sig in 9act.) RANK 14 NODE 11 --> 0.877546608 sigma out 1act.( 5.12835169 sig in 9act.) RANK 15 NODE 14 --> 0.264125466 sigma out 1act.( 3.79347372 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 33.3042679 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 21.9256134 sigma out 15 active outputs RANK 2 NODE 7 --> 13.7514944 sigma out 15 active outputs RANK 3 NODE 6 --> 13.6905499 sigma out 15 active outputs RANK 4 NODE 3 --> 12.9603395 sigma out 15 active outputs RANK 5 NODE 8 --> 12.88449 sigma out 15 active outputs RANK 6 NODE 4 --> 11.928237 sigma out 15 active outputs RANK 7 NODE 5 --> 11.662694 sigma out 15 active outputs RANK 8 NODE 1 --> 10.2336121 sigma out 15 active outputs RANK 9 NODE 9 --> 7.76152563 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 16.5765724 sigma in 9act. ( 15.863328 sig out 1act.) RANK 2 NODE 6 --> 13.0142145 sigma in 9act. ( 12.7240191 sig out 1act.) RANK 3 NODE 4 --> 12.657917 sigma in 9act. ( 11.4996738 sig out 1act.) RANK 4 NODE 7 --> 12.6539698 sigma in 9act. ( 12.7925997 sig out 1act.) RANK 5 NODE 12 --> 12.4880505 sigma in 9act. ( 9.13106918 sig out 1act.) RANK 6 NODE 5 --> 12.188118 sigma in 9act. ( 12.2101011 sig out 1act.) RANK 7 NODE 1 --> 10.6282377 sigma in 9act. ( 6.16929722 sig out 1act.) RANK 8 NODE 10 --> 9.22163391 sigma in 9act. ( 9.56200027 sig out 1act.) RANK 9 NODE 3 --> 8.93356133 sigma in 9act. ( 3.66500187 sig out 1act.) RANK 10 NODE 2 --> 8.30504704 sigma in 9act. ( 6.94084215 sig out 1act.) RANK 11 NODE 9 --> 7.72538233 sigma in 9act. ( 3.10984063 sig out 1act.) RANK 12 NODE 14 --> 7.32442999 sigma in 9act. ( 0.160663471 sig out 1act.) RANK 13 NODE 11 --> 6.8678565 sigma in 9act. ( 0.268682331 sig out 1act.) RANK 14 NODE 15 --> 5.93052721 sigma in 9act. ( 0.838210166 sig out 1act.) RANK 15 NODE 13 --> 4.80306578 sigma in 9act. ( 0.800462782 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 15.863328 sigma out 1act.( 16.5765724 sig in 9act.) RANK 2 NODE 7 --> 12.7925997 sigma out 1act.( 12.6539698 sig in 9act.) RANK 3 NODE 6 --> 12.7240191 sigma out 1act.( 13.0142145 sig in 9act.) RANK 4 NODE 5 --> 12.2101011 sigma out 1act.( 12.188118 sig in 9act.) RANK 5 NODE 4 --> 11.4996738 sigma out 1act.( 12.657917 sig in 9act.) RANK 6 NODE 10 --> 9.56200027 sigma out 1act.( 9.22163391 sig in 9act.) RANK 7 NODE 12 --> 9.13106918 sigma out 1act.( 12.4880505 sig in 9act.) RANK 8 NODE 2 --> 6.94084215 sigma out 1act.( 8.30504704 sig in 9act.) RANK 9 NODE 1 --> 6.16929722 sigma out 1act.( 10.6282377 sig in 9act.) RANK 10 NODE 3 --> 3.66500187 sigma out 1act.( 8.93356133 sig in 9act.) RANK 11 NODE 9 --> 3.10984063 sigma out 1act.( 7.72538233 sig in 9act.) RANK 12 NODE 15 --> 0.838210166 sigma out 1act.( 5.93052721 sig in 9act.) RANK 13 NODE 13 --> 0.800462782 sigma out 1act.( 4.80306578 sig in 9act.) RANK 14 NODE 11 --> 0.268682331 sigma out 1act.( 6.8678565 sig in 9act.) RANK 15 NODE 14 --> 0.160663471 sigma out 1act.( 7.32442999 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 33.8247528 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.44295904 *** contribution from regularisation: 0.00370470528 *** contribution from error: -0.446663737 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.489544928 *** contribution from regularisation: 0.00175733468 *** contribution from error: -0.491302252 *********************************************** -----------------> Test sample ENTER BFGS code START -44343.7135 0.237751245 0.233731121 EXIT FROM BFGS code FG_START 0. 0.237751245 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.509142518 *** contribution from regularisation: 0.00176676689 *** contribution from error: -0.510909259 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46109.4743 0.237751245 208.576767 EXIT FROM BFGS code FG_LNSRCH 0. 0.270083159 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.552163959 *** contribution from regularisation: 0.00272542587 *** contribution from error: -0.554889381 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50005.6231 0.270083159 290.984009 EXIT FROM BFGS code NEW_X -50005.6231 0.270083159 290.984009 ENTER BFGS code NEW_X -50005.6231 0.270083159 290.984009 EXIT FROM BFGS code FG_LNSRCH 0. 0.318805724 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.557393372 *** contribution from regularisation: 0.0027917868 *** contribution from error: -0.560185134 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50479.2183 0.318805724 173.48053 EXIT FROM BFGS code NEW_X -50479.2183 0.318805724 173.48053 ENTER BFGS code NEW_X -50479.2183 0.318805724 173.48053 EXIT FROM BFGS code FG_LNSRCH 0. 0.397720039 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.562394142 *** contribution from regularisation: 0.00267846743 *** contribution from error: -0.565072596 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50932.0991 0.397720039 37.2620926 EXIT FROM BFGS code NEW_X -50932.0991 0.397720039 37.2620926 ENTER BFGS code NEW_X -50932.0991 0.397720039 37.2620926 EXIT FROM BFGS code FG_LNSRCH 0. 0.430321157 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.563201666 *** contribution from regularisation: 0.00247746846 *** contribution from error: -0.565679133 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51005.2328 0.430321157 -37.3942642 EXIT FROM BFGS code NEW_X -51005.2328 0.430321157 -37.3942642 ENTER BFGS code NEW_X -51005.2328 0.430321157 -37.3942642 EXIT FROM BFGS code FG_LNSRCH 0. 0.417283237 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.563394487 *** contribution from regularisation: 0.00239584851 *** contribution from error: -0.565790355 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51022.6954 0.417283237 2.01644039 EXIT FROM BFGS code NEW_X -51022.6954 0.417283237 2.01644039 ENTER BFGS code NEW_X -51022.6954 0.417283237 2.01644039 EXIT FROM BFGS code FG_LNSRCH 0. 0.408980072 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.563470423 *** contribution from regularisation: 0.00239385478 *** contribution from error: -0.565864265 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51029.5695 0.408980072 21.2175674 EXIT FROM BFGS code NEW_X -51029.5695 0.408980072 21.2175674 ENTER BFGS code NEW_X -51029.5695 0.408980072 21.2175674 EXIT FROM BFGS code FG_LNSRCH 0. 0.379792124 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 35.8371277 sigma out 15 active outputs RANK 2 NODE 1 --> 18.5560074 sigma out 15 active outputs RANK 3 NODE 8 --> 16.2846985 sigma out 15 active outputs RANK 4 NODE 7 --> 14.144433 sigma out 15 active outputs RANK 5 NODE 4 --> 13.9973488 sigma out 15 active outputs RANK 6 NODE 3 --> 11.336977 sigma out 15 active outputs RANK 7 NODE 6 --> 11.326046 sigma out 15 active outputs RANK 8 NODE 5 --> 9.45739937 sigma out 15 active outputs RANK 9 NODE 9 --> 9.4098444 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 25.6916122 sigma in 9act. ( 26.1636143 sig out 1act.) RANK 2 NODE 2 --> 20.6092319 sigma in 9act. ( 15.503602 sig out 1act.) RANK 3 NODE 6 --> 18.6789589 sigma in 9act. ( 15.1959639 sig out 1act.) RANK 4 NODE 3 --> 16.359045 sigma in 9act. ( 15.3067741 sig out 1act.) RANK 5 NODE 8 --> 14.318162 sigma in 9act. ( 11.9233961 sig out 1act.) RANK 6 NODE 9 --> 13.0901661 sigma in 9act. ( 11.6203518 sig out 1act.) RANK 7 NODE 4 --> 13.0270538 sigma in 9act. ( 11.536458 sig out 1act.) RANK 8 NODE 1 --> 11.3363342 sigma in 9act. ( 9.88315964 sig out 1act.) RANK 9 NODE 7 --> 11.0191975 sigma in 9act. ( 9.8677597 sig out 1act.) RANK 10 NODE 5 --> 9.33328247 sigma in 9act. ( 8.82796288 sig out 1act.) RANK 11 NODE 10 --> 6.85542536 sigma in 9act. ( 5.66006565 sig out 1act.) RANK 12 NODE 15 --> 5.74991751 sigma in 9act. ( 4.99130106 sig out 1act.) RANK 13 NODE 14 --> 5.28156281 sigma in 9act. ( 2.75108695 sig out 1act.) RANK 14 NODE 11 --> 4.41754341 sigma in 9act. ( 1.26866269 sig out 1act.) RANK 15 NODE 13 --> 3.56377649 sigma in 9act. ( 2.1081152 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 26.1636143 sigma out 1act.( 25.6916122 sig in 9act.) RANK 2 NODE 2 --> 15.503602 sigma out 1act.( 20.6092319 sig in 9act.) RANK 3 NODE 3 --> 15.3067741 sigma out 1act.( 16.359045 sig in 9act.) RANK 4 NODE 6 --> 15.1959639 sigma out 1act.( 18.6789589 sig in 9act.) RANK 5 NODE 8 --> 11.9233961 sigma out 1act.( 14.318162 sig in 9act.) RANK 6 NODE 9 --> 11.6203518 sigma out 1act.( 13.0901661 sig in 9act.) RANK 7 NODE 4 --> 11.536458 sigma out 1act.( 13.0270538 sig in 9act.) RANK 8 NODE 1 --> 9.88315964 sigma out 1act.( 11.3363342 sig in 9act.) RANK 9 NODE 7 --> 9.8677597 sigma out 1act.( 11.0191975 sig in 9act.) RANK 10 NODE 5 --> 8.82796288 sigma out 1act.( 9.33328247 sig in 9act.) RANK 11 NODE 10 --> 5.66006565 sigma out 1act.( 6.85542536 sig in 9act.) RANK 12 NODE 15 --> 4.99130106 sigma out 1act.( 5.74991751 sig in 9act.) RANK 13 NODE 14 --> 2.75108695 sigma out 1act.( 5.28156281 sig in 9act.) RANK 14 NODE 13 --> 2.1081152 sigma out 1act.( 3.56377649 sig in 9act.) RANK 15 NODE 11 --> 1.26866269 sigma out 1act.( 4.41754341 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.3028564 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.563950777 *** contribution from regularisation: 0.00225139386 *** contribution from error: -0.566202164 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51073.0721 0.379792124 81.6475449 EXIT FROM BFGS code NEW_X -51073.0721 0.379792124 81.6475449 ENTER BFGS code NEW_X -51073.0721 0.379792124 81.6475449 EXIT FROM BFGS code FG_LNSRCH 0. 0.361399174 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.564210415 *** contribution from regularisation: 0.00237179734 *** contribution from error: -0.566582203 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51096.5891 0.361399174 102.90654 EXIT FROM BFGS code NEW_X -51096.5891 0.361399174 102.90654 ENTER BFGS code NEW_X -51096.5891 0.361399174 102.90654 EXIT FROM BFGS code FG_LNSRCH 0. 0.362343699 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.564750791 *** contribution from regularisation: 0.00263324543 *** contribution from error: -0.567384064 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51145.5262 0.362343699 8.83143139 EXIT FROM BFGS code NEW_X -51145.5262 0.362343699 8.83143139 ENTER BFGS code NEW_X -51145.5262 0.362343699 8.83143139 EXIT FROM BFGS code FG_LNSRCH 0. 0.365318656 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.56496644 *** contribution from regularisation: 0.00267425017 *** contribution from error: -0.567640662 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51165.0567 0.365318656 -0.968693733 EXIT FROM BFGS code NEW_X -51165.0567 0.365318656 -0.968693733 ENTER BFGS code NEW_X -51165.0567 0.365318656 -0.968693733 EXIT FROM BFGS code FG_LNSRCH 0. 0.369868964 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.564998448 *** contribution from regularisation: 0.00265403278 *** contribution from error: -0.567652464 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51167.9565 0.369868964 -12.0505428 EXIT FROM BFGS code NEW_X -51167.9565 0.369868964 -12.0505428 ENTER BFGS code NEW_X -51167.9565 0.369868964 -12.0505428 EXIT FROM BFGS code FG_LNSRCH 0. 0.366856158 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.565030992 *** contribution from regularisation: 0.00263734045 *** contribution from error: -0.567668319 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51170.8992 0.366856158 -15.4617023 EXIT FROM BFGS code NEW_X -51170.8992 0.366856158 -15.4617023 ENTER BFGS code NEW_X -51170.8992 0.366856158 -15.4617023 EXIT FROM BFGS code FG_LNSRCH 0. 0.340727419 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.565135896 *** contribution from regularisation: 0.00250146026 *** contribution from error: -0.567637384 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51180.4003 0.340727419 0.824961722 EXIT FROM BFGS code NEW_X -51180.4003 0.340727419 0.824961722 ENTER BFGS code NEW_X -51180.4003 0.340727419 0.824961722 EXIT FROM BFGS code FG_LNSRCH 0. 0.322240531 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.565124154 *** contribution from regularisation: 0.00250283419 *** contribution from error: -0.567627013 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51179.3392 0.322240531 -8.96981812 EXIT FROM BFGS code FG_LNSRCH 0. 0.336323559 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.56479466 *** contribution from regularisation: 0.00285180821 *** contribution from error: -0.567646444 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51149.4977 0.336323559 -0.965963781 EXIT FROM BFGS code FG_LNSRCH 0. 0.340621352 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.564952016 *** contribution from regularisation: 0.00268559414 *** contribution from error: -0.567637622 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51163.748 0.340621352 1.40644848 EXIT FROM BFGS code FG_LNSRCH 0. 0.340727299 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 40.27071 sigma out 15 active outputs RANK 2 NODE 7 --> 20.7647057 sigma out 15 active outputs RANK 3 NODE 1 --> 19.6201916 sigma out 15 active outputs RANK 4 NODE 8 --> 18.9699421 sigma out 15 active outputs RANK 5 NODE 4 --> 18.1688652 sigma out 15 active outputs RANK 6 NODE 3 --> 16.0818291 sigma out 15 active outputs RANK 7 NODE 5 --> 13.3610067 sigma out 15 active outputs RANK 8 NODE 6 --> 12.1440639 sigma out 15 active outputs RANK 9 NODE 9 --> 10.7430506 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 34.7046204 sigma in 9act. ( 37.8733559 sig out 1act.) RANK 2 NODE 2 --> 24.8511105 sigma in 9act. ( 20.1140785 sig out 1act.) RANK 3 NODE 9 --> 19.1902752 sigma in 9act. ( 17.9227562 sig out 1act.) RANK 4 NODE 6 --> 18.2673244 sigma in 9act. ( 15.2637253 sig out 1act.) RANK 5 NODE 4 --> 17.8361092 sigma in 9act. ( 15.3220396 sig out 1act.) RANK 6 NODE 3 --> 17.113493 sigma in 9act. ( 18.3530769 sig out 1act.) RANK 7 NODE 8 --> 13.3444242 sigma in 9act. ( 12.700654 sig out 1act.) RANK 8 NODE 1 --> 11.5990896 sigma in 9act. ( 10.941534 sig out 1act.) RANK 9 NODE 5 --> 10.3223295 sigma in 9act. ( 10.7190409 sig out 1act.) RANK 10 NODE 7 --> 10.1838818 sigma in 9act. ( 10.4894409 sig out 1act.) RANK 11 NODE 15 --> 8.00960255 sigma in 9act. ( 8.69310188 sig out 1act.) RANK 12 NODE 10 --> 7.71683931 sigma in 9act. ( 8.12962246 sig out 1act.) RANK 13 NODE 13 --> 4.47514772 sigma in 9act. ( 4.40138674 sig out 1act.) RANK 14 NODE 11 --> 3.98128223 sigma in 9act. ( 3.24982929 sig out 1act.) RANK 15 NODE 14 --> 3.23266459 sigma in 9act. ( 0.443713039 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 37.8733559 sigma out 1act.( 34.7046204 sig in 9act.) RANK 2 NODE 2 --> 20.1140785 sigma out 1act.( 24.8511105 sig in 9act.) RANK 3 NODE 3 --> 18.3530769 sigma out 1act.( 17.113493 sig in 9act.) RANK 4 NODE 9 --> 17.9227562 sigma out 1act.( 19.1902752 sig in 9act.) RANK 5 NODE 4 --> 15.3220396 sigma out 1act.( 17.8361092 sig in 9act.) RANK 6 NODE 6 --> 15.2637253 sigma out 1act.( 18.2673244 sig in 9act.) RANK 7 NODE 8 --> 12.700654 sigma out 1act.( 13.3444242 sig in 9act.) RANK 8 NODE 1 --> 10.941534 sigma out 1act.( 11.5990896 sig in 9act.) RANK 9 NODE 5 --> 10.7190409 sigma out 1act.( 10.3223295 sig in 9act.) RANK 10 NODE 7 --> 10.4894409 sigma out 1act.( 10.1838818 sig in 9act.) RANK 11 NODE 15 --> 8.69310188 sigma out 1act.( 8.00960255 sig in 9act.) RANK 12 NODE 10 --> 8.12962246 sigma out 1act.( 7.71683931 sig in 9act.) RANK 13 NODE 13 --> 4.40138674 sigma out 1act.( 4.47514772 sig in 9act.) RANK 14 NODE 11 --> 3.24982929 sigma out 1act.( 3.98128223 sig in 9act.) RANK 15 NODE 14 --> 0.443713039 sigma out 1act.( 3.23266459 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.3532562 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.564988434 *** contribution from regularisation: 0.00264891749 *** contribution from error: -0.567637324 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51167.0462 0.340727299 1.3440696 EXIT FROM BFGS code FG_LNSRCH 0. 0.340727419 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.56496501 *** contribution from regularisation: 0.00267234375 *** contribution from error: -0.567637324 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51164.9246 0.340727419 1.49489427 EXIT FROM BFGS code FG_LNSRCH 0. 0.340727419 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.564973354 *** contribution from regularisation: 0.00266396021 *** contribution from error: -0.567637324 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51165.6838 0.340727419 1.56371284 EXIT FROM BFGS code FG_LNSRCH 0. 0.340727419 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.564987183 *** contribution from regularisation: 0.00265013753 *** contribution from error: -0.567637324 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51166.9357 0.340727419 1.61677694 EXIT FROM BFGS code NEW_X -51166.9357 0.340727419 1.61677694 ENTER BFGS code NEW_X -51166.9357 0.340727419 1.61677694 EXIT FROM BFGS code CONVERGENC -51166.9357 0.340727419 1.61677694 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 63.067112 sigma out 15 active outputs RANK 2 NODE 7 --> 32.1642189 sigma out 15 active outputs RANK 3 NODE 1 --> 30.0445709 sigma out 15 active outputs RANK 4 NODE 8 --> 29.2395267 sigma out 15 active outputs RANK 5 NODE 4 --> 27.7504997 sigma out 15 active outputs RANK 6 NODE 3 --> 24.5982742 sigma out 15 active outputs RANK 7 NODE 5 --> 21.9734077 sigma out 15 active outputs RANK 8 NODE 6 --> 18.4223328 sigma out 15 active outputs RANK 9 NODE 9 --> 16.7002678 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 55.2339325 sigma in 9act. ( 60.0032272 sig out 1act.) RANK 2 NODE 2 --> 38.524559 sigma in 9act. ( 32.2167511 sig out 1act.) RANK 3 NODE 9 --> 29.6398659 sigma in 9act. ( 29.1226196 sig out 1act.) RANK 4 NODE 6 --> 27.9745178 sigma in 9act. ( 24.3771572 sig out 1act.) RANK 5 NODE 4 --> 27.7528419 sigma in 9act. ( 24.0720692 sig out 1act.) RANK 6 NODE 3 --> 26.3832893 sigma in 9act. ( 29.0457458 sig out 1act.) RANK 7 NODE 8 --> 20.8278732 sigma in 9act. ( 19.914238 sig out 1act.) RANK 8 NODE 1 --> 17.2301025 sigma in 9act. ( 17.4531269 sig out 1act.) RANK 9 NODE 5 --> 15.6084414 sigma in 9act. ( 17.0840645 sig out 1act.) RANK 10 NODE 7 --> 15.5289345 sigma in 9act. ( 16.7555714 sig out 1act.) RANK 11 NODE 15 --> 12.2444515 sigma in 9act. ( 13.8472586 sig out 1act.) RANK 12 NODE 10 --> 11.7270527 sigma in 9act. ( 13.0466385 sig out 1act.) RANK 13 NODE 13 --> 6.52115202 sigma in 9act. ( 6.96163321 sig out 1act.) RANK 14 NODE 11 --> 5.2389884 sigma in 9act. ( 5.09947729 sig out 1act.) RANK 15 NODE 14 --> 3.27228045 sigma in 9act. ( 0.693625212 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 60.0032272 sigma out 1act.( 55.2339325 sig in 9act.) RANK 2 NODE 2 --> 32.2167511 sigma out 1act.( 38.524559 sig in 9act.) RANK 3 NODE 9 --> 29.1226196 sigma out 1act.( 29.6398659 sig in 9act.) RANK 4 NODE 3 --> 29.0457458 sigma out 1act.( 26.3832893 sig in 9act.) RANK 5 NODE 6 --> 24.3771572 sigma out 1act.( 27.9745178 sig in 9act.) RANK 6 NODE 4 --> 24.0720692 sigma out 1act.( 27.7528419 sig in 9act.) RANK 7 NODE 8 --> 19.914238 sigma out 1act.( 20.8278732 sig in 9act.) RANK 8 NODE 1 --> 17.4531269 sigma out 1act.( 17.2301025 sig in 9act.) RANK 9 NODE 5 --> 17.0840645 sigma out 1act.( 15.6084414 sig in 9act.) RANK 10 NODE 7 --> 16.7555714 sigma out 1act.( 15.5289345 sig in 9act.) RANK 11 NODE 15 --> 13.8472586 sigma out 1act.( 12.2444515 sig in 9act.) RANK 12 NODE 10 --> 13.0466385 sigma out 1act.( 11.7270527 sig in 9act.) RANK 13 NODE 13 --> 6.96163321 sigma out 1act.( 6.52115202 sig in 9act.) RANK 14 NODE 11 --> 5.09947729 sigma out 1act.( 5.2389884 sig in 9act.) RANK 15 NODE 14 --> 0.693625212 sigma out 1act.( 3.27228045 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 95.9922562 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.56499052 *** contribution from regularisation: 0.00264682551 *** contribution from error: -0.567637324 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done