NNInput NNInputs_115.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 187659 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 45954 nbkg = 141705 Bkg Entries: 141705 Sig Entries: 45954 Chosen entries: 45954 Signal fraction: 1 Background fraction: 0.324293 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 141705 Actual Signal Entries: 45954 Entries to split: 45954 Test with : 22977 Train with : 22977 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 45954 for Signal Prepared event 0 for Signal with 45954 events ====Entry 0 Variable Ht : 147.2 Variable LepAPt : 33.8436 Variable LepBPt : 16.8195 Variable MetSigLeptonsJets : 7.93922 Variable MetSpec : 69.8321 Variable SumEtLeptonsJets : 77.3669 Variable VSumJetLeptonsPt : 74.5437 Variable addEt : 120.496 Variable dPhiLepSumMet : 2.77597 Variable dPhiLeptons : 0.349396 Variable dRLeptons : 0.409585 Variable lep1_E : 34.748 Variable lep2_E : 16.8224 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2115 Ht = 147.2 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.8439 LepAPt = 33.8436 LepBEt = 16.82 LepBPt = 16.8195 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 69.8321 MetDelPhi = 2.54203 MetSig = 5.42558 MetSigLeptonsJets = 7.93922 MetSpec = 69.8321 Mjj = 0 MostCentralJetEta = -1.25048 MtllMet = 121.128 Njets = 1 SB = 0 SumEt = 165.661 SumEtJets = 0 SumEtLeptonsJets = 77.3669 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 74.5437 addEt = 120.496 dPhiLepSumMet = 2.77597 dPhiLeptons = 0.349396 dRLeptons = 0.409585 diltype = 17 dimass = 9.74565 event = 4187 jet1_Et = 26.7039 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.748 lep2_E = 16.8224 rand = 0.999742 run = 237705 weight = 5.90147e-07 ===Show End Prepared event 10000 for Signal with 45954 events Prepared event 20000 for Signal with 45954 events Prepared event 30000 for Signal with 45954 events Prepared event 40000 for Signal with 45954 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 141705 for Background Prepared event 0 for Background with 141705 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.259744 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 141705 events Prepared event 20000 for Background with 141705 events Prepared event 30000 for Background with 141705 events Prepared event 40000 for Background with 141705 events Prepared event 50000 for Background with 141705 events Prepared event 60000 for Background with 141705 events Prepared event 70000 for Background with 141705 events Prepared event 80000 for Background with 141705 events Prepared event 90000 for Background with 141705 events Prepared event 100000 for Background with 141705 events Prepared event 110000 for Background with 141705 events Prepared event 120000 for Background with 141705 events Prepared event 130000 for Background with 141705 events Prepared event 140000 for Background with 141705 events Warning: found 4448 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 187659 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4448 negative weights. Signal fraction: 62.7726059 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 46.8693504 61.7397003 63.9263344 65.8751907 67.2292099 68.2330856 69.0722885 70.0967255 70.7917404 71.5172729 72.4101334 73.2788849 73.9627075 74.5945282 75.338295 75.9023819 76.5353699 77.1065369 77.7328415 78.3625946 78.9572296 79.5235214 80.080368 80.734993 81.2633209 81.933548 82.5473785 83.2065125 83.8886261 84.6730957 85.3993225 86.1378632 86.9059448 87.6613312 88.5493546 89.3320007 90.1653748 91.0467224 91.9174347 92.816864 93.8769608 94.6534576 95.5408554 96.3221588 97.256958 98.0344238 98.9222946 99.8109818 100.681519 101.464005 102.209885 103.053947 103.891739 104.514038 105.395592 106.271088 107.07325 107.951332 108.816513 109.660141 110.595276 111.540672 112.427094 113.416626 114.557022 115.882492 117.15107 118.560989 119.724899 121.293655 122.963211 124.654022 126.359528 128.207977 129.977478 131.885162 133.729889 135.728317 137.760071 139.882874 142.105133 144.496643 146.987915 149.771088 152.447083 155.455048 158.636642 161.775055 165.125824 169.535843 173.98111 178.9646 184.844208 191.404083 198.928619 209.197372 220.867859 237.997208 266.184326 310.384094 800.809509 ------------------------------ Transdef: Tab for variable 3 20.0001564 20.2996578 20.5804443 20.8328209 21.0330811 21.2510223 21.4848061 21.6961212 21.9129829 22.0835495 22.2935696 22.4819412 22.6700172 22.8518982 23.0641117 23.2765198 23.4424229 23.6205273 23.7568512 23.9533043 24.1777306 24.3996582 24.5719376 24.7795372 24.9502182 25.1374378 25.3155403 25.5207844 25.6639004 25.8516426 26.0365238 26.2120991 26.3952141 26.6405716 26.8600273 27.0824814 27.2855854 27.502594 27.7132225 27.9022217 28.0867653 28.2814388 28.4946976 28.7224522 28.9519825 29.1669121 29.3686333 29.6051941 29.8050194 30.0520363 30.2427101 30.5008774 30.7135315 30.9784012 31.2001438 31.4214134 31.6384888 31.8873787 32.1385574 32.3618393 32.6108246 32.8576202 33.1409302 33.3855057 33.6902771 34.0136032 34.2717209 34.5915833 34.8959351 35.2251129 35.5583344 35.8935432 36.2339554 36.5874252 36.9644547 37.366684 37.7708015 38.1481361 38.6187477 39.0918427 39.4308395 39.9467087 40.444931 40.8227997 41.4298439 42.0135574 42.6940613 43.4725266 44.3801994 45.2355957 46.2889252 47.3862152 48.7226143 50.2124634 51.9893036 54.3290825 57.442276 60.936348 65.9680939 75.9517288 178.378601 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.0913734 10.1892433 10.2853508 10.3723259 10.4519339 10.5189934 10.6143074 10.7135391 10.7983274 10.8976049 10.9834156 11.075345 11.1799936 11.2776194 11.3714428 11.460701 11.5497322 11.6383572 11.7362986 11.8345461 11.9275923 12.0259171 12.1430016 12.2301855 12.3233156 12.4281845 12.5318737 12.6364956 12.7468643 12.8511457 12.9514465 13.0747595 13.18573 13.3254986 13.4405708 13.5506897 13.6665344 13.7903795 13.9079895 14.0353909 14.1509876 14.2577038 14.3722162 14.5052357 14.6392012 14.7821274 14.9113779 15.0544329 15.2000332 15.3411617 15.4685497 15.6049728 15.7609959 15.8981209 16.0501862 16.1950226 16.3317451 16.4965019 16.6456642 16.795105 16.9724693 17.1593132 17.3319626 17.5161476 17.727396 17.9103527 18.0400734 18.204258 18.3864365 18.6054707 18.8157539 19.036087 19.2473145 19.4714203 19.6987267 19.9109459 20.155735 20.3012924 20.5063515 20.7464981 21.0178318 21.281271 21.5517693 21.8142529 22.0118484 22.3416214 22.6567154 23.0578938 23.4860573 23.9090786 24.3790436 24.9036465 25.5442467 26.2468071 27.0303688 28.0979958 29.3953896 31.4016953 35.0447197 71.4863358 ------------------------------ Transdef: Tab for variable 5 0.97587049 2.23876762 2.60302567 2.87053323 3.05356145 3.2248013 3.37687087 3.53233862 3.66846418 3.79373455 3.91805983 4.02926302 4.1324873 4.21291304 4.30802536 4.39266205 4.47925186 4.55785513 4.62769318 4.69914198 4.76592541 4.83762455 4.91107321 4.96992493 5.03481197 5.094491 5.15007877 5.1981802 5.2546463 5.30932617 5.3527832 5.40008688 5.4490757 5.49879313 5.52537346 5.57040501 5.61662102 5.657794 5.70109224 5.73869705 5.78186703 5.82399845 5.86058426 5.90096569 5.93665028 5.97969246 6.01521778 6.05340004 6.09243202 6.12863827 6.16788578 6.20475388 6.24658775 6.28044415 6.32088661 6.35133171 6.38760567 6.42364597 6.45661354 6.49331522 6.52849865 6.56775379 6.60920715 6.6512537 6.69369555 6.73114014 6.75972748 6.80092239 6.83966732 6.87319899 6.91171741 6.95851231 6.9908514 7.03905821 7.07519531 7.12297535 7.17240286 7.21580124 7.264781 7.31306839 7.37155533 7.42295647 7.47344685 7.5163126 7.57538366 7.63475704 7.710958 7.77919483 7.8558979 7.92752409 8.01878834 8.11904716 8.22672939 8.36317444 8.50070763 8.68770218 8.87617779 9.13282585 9.55848885 10.4613609 19.2163315 ------------------------------ Transdef: Tab for variable 6 15.0050735 18.2683334 21.2693901 24.3211708 25.553772 26.2851849 26.9801731 27.5191841 28.2246838 28.8051319 29.4172173 30.0379639 30.5785809 31.1199512 31.5398045 32.030899 32.4400673 32.8829765 33.2707977 33.6577148 34.0800476 34.4798622 34.7746811 35.1004257 35.4830971 35.8078766 36.1736374 36.5109787 36.8565292 37.142868 37.4410515 37.7599945 38.077034 38.4438934 38.7659607 39.0505447 39.3620262 39.6154556 39.9111176 40.229866 40.4936523 40.8023911 41.1409035 41.5101776 41.8464317 42.1769791 42.4573975 42.8122215 43.1154289 43.3885956 43.6573524 43.9689369 44.334137 44.6486664 45.01334 45.4528961 45.8547897 46.2211456 46.6005478 46.9847527 47.3614502 47.7750053 48.1374359 48.5991364 48.9532089 49.3564911 49.7242279 50.102562 50.4990845 50.930603 51.3544846 51.8206253 52.2774773 52.7390442 53.2419891 53.7253647 54.1774025 54.7008667 55.2346573 55.7679749 56.3004074 56.8869858 57.5051727 58.2122955 58.6437988 59.4478912 60.2758408 61.275528 62.3472748 63.3975601 64.5944977 66.0277328 67.6399384 69.5638962 71.8181152 74.5094452 77.029068 81.1180267 86.8898315 97.922699 201.618698 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.5217552 33.367569 34.0386581 34.7263794 35.1566849 35.5980644 35.9836655 36.3598442 36.7557945 37.1239891 37.4765701 37.783123 38.0856247 38.3753052 38.6796875 38.9712982 39.1951294 39.4559021 39.7076569 40.0183868 40.2982025 40.5689011 40.8774223 41.2192192 41.538002 41.8661194 42.2419281 42.5947914 42.9541168 43.3658142 43.7600327 44.2213745 44.6453552 44.9947433 45.4491882 45.8856697 46.392601 46.8705597 47.2590179 47.801796 48.2635956 48.8181534 49.356575 49.9152641 50.5086632 51.0450821 51.5881691 52.1851425 52.7145004 53.2744064 53.8854408 54.4984169 55.1327209 55.7585602 56.4235153 57.1658325 57.9225769 58.7836151 59.6757965 60.7403488 61.2984276 62.4314346 63.6414108 64.7597656 65.7159424 67.0147476 68.3983154 69.7504578 71.0724869 72.3947906 73.7030182 75.1255951 76.5876694 78.0133057 79.4843063 80.9950104 82.5560532 84.1558685 85.9551544 88.1000366 90.3414307 92.7014694 95.0374451 97.746521 100.355759 103.186829 106.422356 109.567352 113.304062 117.272369 121.337479 126.625488 132.576859 138.393097 146.254623 157.316132 172.170349 191.843506 227.839188 510.394806 ------------------------------ Transdef: Tab for variable 8 0.678276479 20.2399902 24.8687363 27.5270386 29.2970352 30.557312 31.4435158 32.0508728 32.5818634 33.0525818 33.5294991 33.9107895 34.3661194 34.7758331 35.1162071 35.3827782 35.6962204 35.9832268 36.2777328 36.5234871 36.8048897 37.0839386 37.312645 37.5408173 37.7943993 38.0538712 38.2588081 38.5058136 38.7315598 38.9426231 39.1754074 39.4024124 39.6701126 39.9091263 40.129837 40.374054 40.6330986 40.9023285 41.1773911 41.3814087 41.6865082 41.9942322 42.3143845 42.6417999 42.9406357 43.2091446 43.5610275 43.8339806 44.1887665 44.4644775 44.8251686 45.1270103 45.4324341 45.7851448 46.159977 46.5174255 46.8256798 47.2416382 47.6552505 48.0202026 48.3290596 48.7186203 49.0647125 49.4446869 49.8154755 50.2183533 50.6135712 51.0235519 51.4362221 51.8289719 52.2998314 52.7056274 53.1472244 53.6122208 54.0571442 54.5316849 55.0188904 55.5739594 56.1154404 56.7284737 57.3676605 58.0122986 58.7246208 59.5092239 60.3694267 61.0992737 62.162178 63.250679 64.4197083 65.6190033 67.2143784 68.8410187 70.6655121 72.8462067 75.1616516 78.2803955 81.4530945 86.5171661 94.5048981 112.688652 326.868286 ------------------------------ Transdef: Tab for variable 9 46.8693504 60.6250687 63.1686783 64.8956146 66.1893311 67.2807922 68.1230927 68.8892975 69.6764221 70.3366241 70.9154434 71.5584946 72.3372879 73.0499496 73.6695557 74.2092285 74.8104019 75.4228439 75.9102173 76.4522705 76.9800873 77.4527817 78.0490875 78.4784088 78.9896545 79.4833145 79.9147339 80.4543762 80.9867401 81.4257278 81.9654999 82.4640884 82.9425888 83.5458527 84.0121002 84.6472168 85.1869202 85.8403625 86.4011307 86.8315887 87.4040222 88.0218658 88.6495438 89.2853851 89.8503571 90.3937073 91.0467224 91.6540146 92.2837601 92.9725723 93.7034912 94.3504944 94.9519043 95.5721893 96.1755981 96.7940598 97.5222931 98.1124191 98.7618713 99.365097 99.9705505 100.680382 101.311096 101.9123 102.480965 103.079712 103.673157 104.257294 104.890854 105.532806 106.190559 106.8209 107.468948 108.13382 108.737892 109.459427 110.177948 110.834015 111.573898 112.273674 113.010773 113.859802 114.757118 115.600639 116.512466 117.549553 118.705376 119.736328 121.123085 122.768631 124.58757 126.894455 129.408844 132.339508 135.970978 140.601776 146.447968 154.232315 165.704254 192.475098 398.185333 ------------------------------ Transdef: Tab for variable 10 0.00483142957 0.729797482 1.05892241 1.26864552 1.42757845 1.55848455 1.6640029 1.75661087 1.84059 1.91309834 1.97962379 2.04726028 2.10599637 2.16302276 2.21328044 2.25891948 2.30245876 2.3448422 2.38897038 2.42560363 2.46215391 2.49136209 2.52068591 2.55032873 2.5761292 2.59897399 2.6259551 2.65231514 2.67833042 2.700459 2.71846414 2.73946047 2.75748634 2.77353787 2.78834581 2.80572605 2.82110214 2.83297014 2.84619474 2.85810947 2.87054586 2.88202667 2.89266348 2.90214157 2.911623 2.91932368 2.92836618 2.93493485 2.94241714 2.94964671 2.95757484 2.96450448 2.97134948 2.97725296 2.98239756 2.98688173 2.99147773 2.99523377 3.00110865 3.00617981 3.01125431 3.01587963 3.02053881 3.02533817 3.02971172 3.03394127 3.03800535 3.04245996 3.04593921 3.04997635 3.05433273 3.05815482 3.06143856 3.06523466 3.06782961 3.07158971 3.07451057 3.07771301 3.08142757 3.08471966 3.08836079 3.09153271 3.09442091 3.09718895 3.1002667 3.10330963 3.10550642 3.10899162 3.11219549 3.11480188 3.11727023 3.11961555 3.12223673 3.12507963 3.12775612 3.12989616 3.131778 3.13433981 3.13648772 3.13913465 3.1415844 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00611447822 0.0111405849 0.0187350493 0.0245200992 0.032974124 0.0410155058 0.0496000312 0.0581946485 0.0671188533 0.0758548379 0.0842843652 0.0934299231 0.101800889 0.108348534 0.116387613 0.124261379 0.132513165 0.141200781 0.149660587 0.157361537 0.164319098 0.171440154 0.179095507 0.185533285 0.192292571 0.199172735 0.205645084 0.212395608 0.219337285 0.226254418 0.231950685 0.237866104 0.245669365 0.252977133 0.258752704 0.264358759 0.270522118 0.277561128 0.283364177 0.28968209 0.296498299 0.302114487 0.30836153 0.31444931 0.320857167 0.326621383 0.332734942 0.339212686 0.34536314 0.350827575 0.356105268 0.360917211 0.367465854 0.373212337 0.37991333 0.385937929 0.391160905 0.397360116 0.40337801 0.409482121 0.415319324 0.421539545 0.426834941 0.433421642 0.439528614 0.446554661 0.452153802 0.458211422 0.464521408 0.471096754 0.476478308 0.483718991 0.490664482 0.498385012 0.505367756 0.512773514 0.519602895 0.526737452 0.534546554 0.540837944 0.548325062 0.556979179 0.566320777 0.57544601 0.583388448 0.592996478 0.603233695 0.614459991 0.625287116 0.635256052 0.647461534 0.661955416 0.677109301 0.695669651 0.71316874 0.735527992 0.767089128 0.80739069 0.863759637 1.11914444 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.227501869 0.24544102 0.260404438 0.273698449 0.284481376 0.295815408 0.306235075 0.316027045 0.324722826 0.333913088 0.342810422 0.350745559 0.357682347 0.364648402 0.371779323 0.378666788 0.385539532 0.392713785 0.398597777 0.403798878 0.409111798 0.412937403 0.416997939 0.42147699 0.42557326 0.430041999 0.434012651 0.437806487 0.441863716 0.44582653 0.44984448 0.454452574 0.459010243 0.462892711 0.46681571 0.470965981 0.474980831 0.478283197 0.482472658 0.48619169 0.489946276 0.49364388 0.497766286 0.501660109 0.505766332 0.509652317 0.513831496 0.517940342 0.521901131 0.52588892 0.530652523 0.534507871 0.539104223 0.543327093 0.547429681 0.551548004 0.555957556 0.559990406 0.564639509 0.569212079 0.573624849 0.577324569 0.581679821 0.586195469 0.591065347 0.595393121 0.601033807 0.605576873 0.611118972 0.616031289 0.621389389 0.625836253 0.631098032 0.635742426 0.642299294 0.647917807 0.654229105 0.66075182 0.666016102 0.671529531 0.678247809 0.685271382 0.692294061 0.699726582 0.707713723 0.716096282 0.723723888 0.732655764 0.742459893 0.751610637 0.760290384 0.771757901 0.785654724 0.799394369 0.815974712 0.83453095 0.85413003 0.883158326 0.927891612 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3603897 22.1516533 22.6495132 23.1772537 23.6373291 24.1024208 24.5801086 24.9827347 25.3621082 25.6925545 26.0851135 26.5259933 26.9444809 27.3062687 27.6513557 28.0018044 28.311058 28.6351089 28.9515152 29.2816544 29.580265 29.8717995 30.1575356 30.4435463 30.7255688 30.9720421 31.2723236 31.5639915 31.9042053 32.1879234 32.4403763 32.741806 33.032547 33.3146858 33.6228409 33.9622345 34.2854156 34.5172424 34.8872681 35.1937485 35.5392532 35.8761787 36.1731033 36.5131226 36.8373756 37.1948776 37.5318146 37.8339348 38.1864624 38.5530396 38.9324799 39.3451691 39.7504997 40.1715622 40.5543022 40.9861298 41.3662109 41.8416824 42.3056335 42.770256 43.1832504 43.6957092 44.1726608 44.6520233 45.2073212 45.7286949 46.3477631 46.9154282 47.5152779 48.1026917 48.7613297 49.4342613 50.1477699 50.845787 51.6219673 52.5164375 53.3720474 54.2255402 55.1361847 56.0729904 57.1532631 58.159523 59.2902679 60.5633926 61.963253 63.2018356 64.8532791 66.5300751 68.1264496 69.6395035 71.9313431 74.1532898 76.6084213 79.7876129 82.9961777 87.2045898 90.2144394 97.1747894 108.088165 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.492507 10.848568 11.0933056 11.313796 11.5464077 11.7796936 11.98283 12.2085934 12.3737698 12.5819817 12.7866764 12.9661608 13.1521778 13.334795 13.5261459 13.6919537 13.85781 14.036396 14.2026224 14.3867397 14.5512695 14.7288971 14.915102 15.1098042 15.2844648 15.4779949 15.6466398 15.8093433 16.0067844 16.2333794 16.4222832 16.6118355 16.7803974 16.9482193 17.1269512 17.3185692 17.5175457 17.6986179 17.890564 18.0808678 18.2768135 18.4871655 18.6941605 18.9117393 19.116497 19.3144913 19.5344582 19.764286 19.9723587 20.1711731 20.3810043 20.5953293 20.8464355 21.0615273 21.2911911 21.5130196 21.7267151 21.9346371 22.1642456 22.4047871 22.6656418 22.9571991 23.2039146 23.466877 23.7679672 24.0476532 24.3359642 24.632061 24.9706783 25.2968292 25.6270294 25.9403133 26.2894745 26.6439133 27.0534706 27.4545135 27.8357964 28.124197 28.5946312 29.0346794 29.512352 30.0525627 30.6588459 31.2156563 31.7477608 32.3593674 33.1256676 33.7049522 34.5180359 35.3706894 36.4154205 37.6483459 39.010994 40.2654266 41.9305649 44.0030479 46.8808861 50.6580124 57.18013 115.483475 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 51.1 38.2 23.1 1.8 26.5 49.9 32.7 45.6 -30.8 -5.3 -16.9 5.3 -7.7 2 51.1 100.0 64.3 43.6 10.7 53.2 94.2 59.4 88.8 -53.8 -18.1 -40.2 32.6 14.5 3 38.2 64.3 100.0 20.5 -9.2 21.9 67.6 44.2 69.6 -22.2 -18.6 -45.0 63.2 1.0 4 23.1 43.6 20.5 100.0 -4.7 15.8 45.6 30.6 47.3 -14.1 -23.3 -46.8 8.2 66.2 5 1.8 10.7 -9.2 -4.7 100.0 79.8 -16.7 43.2 40.6 31.9 3.6 8.2 -11.9 -7.4 6 26.5 53.2 21.9 15.8 79.8 100.0 30.2 69.4 71.9 -0.6 -5.3 -11.8 5.4 0.6 7 49.9 94.2 67.6 45.6 -16.7 30.2 100.0 52.3 75.9 -60.1 -18.1 -41.7 37.0 17.8 8 32.7 59.4 44.2 30.6 43.2 69.4 52.3 100.0 73.5 -8.9 -14.7 -27.7 22.3 11.0 9 45.6 88.8 69.6 47.3 40.6 71.9 75.9 73.5 100.0 -26.9 -19.4 -43.8 37.0 17.9 10 -30.8 -53.8 -22.2 -14.1 31.9 -0.6 -60.1 -8.9 -26.9 100.0 4.6 13.1 -9.2 -2.2 11 -5.3 -18.1 -18.6 -23.3 3.6 -5.3 -18.1 -14.7 -19.4 4.6 100.0 53.9 -8.1 -13.2 12 -16.9 -40.2 -45.0 -46.8 8.2 -11.8 -41.7 -27.7 -43.8 13.1 53.9 100.0 -22.8 -22.1 13 5.3 32.6 63.2 8.2 -11.9 5.4 37.0 22.3 37.0 -9.2 -8.1 -22.8 100.0 37.9 14 -7.7 14.5 1.0 66.2 -7.4 0.6 17.8 11.0 17.9 -2.2 -13.2 -22.1 37.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 110.874643 TOTAL CORRELATION OF ALL VARIABLES 57.5400238 ROUND 1: MAX CORR ( 57.5378525) AFTER KILLING INPUT VARIABLE 7 CONTR 0.499872376 ROUND 2: MAX CORR ( 57.5255509) AFTER KILLING INPUT VARIABLE 11 CONTR 1.18973253 ROUND 3: MAX CORR ( 57.5044986) AFTER KILLING INPUT VARIABLE 9 CONTR 1.55616244 ROUND 4: MAX CORR ( 57.4471092) AFTER KILLING INPUT VARIABLE 8 CONTR 2.56846372 ROUND 5: MAX CORR ( 57.2791113) AFTER KILLING INPUT VARIABLE 5 CONTR 4.39018931 ROUND 6: MAX CORR ( 57.2276959) AFTER KILLING INPUT VARIABLE 6 CONTR 2.42640004 ROUND 7: MAX CORR ( 56.9191726) AFTER KILLING INPUT VARIABLE 10 CONTR 5.93438849 ROUND 8: MAX CORR ( 56.4821111) AFTER KILLING INPUT VARIABLE 13 CONTR 7.04012336 ROUND 9: MAX CORR ( 55.8146926) AFTER KILLING INPUT VARIABLE 3 CONTR 8.65730695 ROUND 10: MAX CORR ( 55.4310553) AFTER KILLING INPUT VARIABLE 12 CONTR 6.53284163 ROUND 11: MAX CORR ( 53.3479005) AFTER KILLING INPUT VARIABLE 4 CONTR 15.0533518 ROUND 12: MAX CORR ( 51.1057113) AFTER KILLING INPUT VARIABLE 14 CONTR 15.3037501 LAST REMAINING VARIABLE: 2 total correlation to target: 57.5400238 % total significance: 110.337125 sigma correlations of single variables to target: variable 2: 51.1057113 % , in sigma: 97.9988685 variable 3: 38.1752216 % , in sigma: 73.2037267 variable 4: 23.0807829 % , in sigma: 44.2590573 variable 5: 1.75185621 % , in sigma: 3.35930998 variable 6: 26.4630203 % , in sigma: 50.7447403 variable 7: 49.8893724 % , in sigma: 95.6664514 variable 8: 32.6612275 % , in sigma: 62.6302473 variable 9: 45.6220424 % , in sigma: 87.4835399 variable 10: -30.8437083 % , in sigma: 59.145024 variable 11: -5.31210293 % , in sigma: 10.1863385 variable 12: -16.8534136 % , in sigma: 32.3176299 variable 13: 5.28447064 % , in sigma: 10.1333516 variable 14: -7.70520738 % , in sigma: 14.775288 variables sorted by significance: 1 most relevant variable 2 corr 51.1057129 , in sigma: 97.9988716 2 most relevant variable 14 corr 15.30375 , in sigma: 29.3460388 3 most relevant variable 4 corr 15.0533514 , in sigma: 28.8658815 4 most relevant variable 12 corr 6.53284168 , in sigma: 12.5271927 5 most relevant variable 3 corr 8.65730667 , in sigma: 16.6010068 6 most relevant variable 13 corr 7.04012346 , in sigma: 13.4999419 7 most relevant variable 10 corr 5.93438864 , in sigma: 11.379616 8 most relevant variable 6 corr 2.42639995 , in sigma: 4.652796 9 most relevant variable 5 corr 4.39018917 , in sigma: 8.41850276 10 most relevant variable 8 corr 2.5684638 , in sigma: 4.92521364 11 most relevant variable 9 corr 1.55616248 , in sigma: 2.98405321 12 most relevant variable 11 corr 1.18973255 , in sigma: 2.28139754 13 most relevant variable 7 corr 0.499872386 , in sigma: 0.95854117 global correlations between input variables: variable 2: 99.0481001 % variable 3: 93.7016785 % variable 4: 89.1473544 % variable 5: 94.490613 % variable 6: 92.9963755 % variable 7: 98.5923647 % variable 8: 84.2631779 % variable 9: 98.641645 % variable 10: 73.0583023 % variable 11: 54.9904107 % variable 12: 71.6328402 % variable 13: 83.9927042 % variable 14: 85.5593127 % significance loss when removing single variables: variable 2: corr = 4.12705958 % , sigma = 7.91393288 variable 3: corr = 8.73736258 % , sigma = 16.7545197 variable 4: corr = 10.369517 % , sigma = 19.8842929 variable 5: corr = 1.97541492 % , sigma = 3.78799986 variable 6: corr = 3.84738889 % , sigma = 7.37764427 variable 7: corr = 0.499872376 % , sigma = 0.95854115 variable 8: corr = 2.29471324 % , sigma = 4.4002773 variable 9: corr = 1.37665286 % , sigma = 2.63983063 variable 10: corr = 4.83928469 % , sigma = 9.27967564 variable 11: corr = 1.15403216 % , sigma = 2.21293947 variable 12: corr = 7.28182583 % , sigma = 13.9634235 variable 13: corr = 7.00955295 % , sigma = 13.4413208 variable 14: corr = 10.4742471 % , sigma = 20.0851205 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 17.5617981 sigma out 15 active outputs RANK 2 NODE 1 --> 14.7260637 sigma out 15 active outputs RANK 3 NODE 3 --> 11.2237396 sigma out 15 active outputs RANK 4 NODE 5 --> 10.7100191 sigma out 15 active outputs RANK 5 NODE 7 --> 10.2493515 sigma out 15 active outputs RANK 6 NODE 11 --> 9.58025932 sigma out 15 active outputs RANK 7 NODE 4 --> 8.82858849 sigma out 15 active outputs RANK 8 NODE 8 --> 8.64567566 sigma out 15 active outputs RANK 9 NODE 6 --> 8.61363983 sigma out 15 active outputs RANK 10 NODE 2 --> 8.52857971 sigma out 15 active outputs RANK 11 NODE 10 --> 6.32728815 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 17.9926376 sigma in 11act. ( 19.0910606 sig out 1act.) RANK 2 NODE 1 --> 16.9276085 sigma in 11act. ( 15.0216694 sig out 1act.) RANK 3 NODE 9 --> 14.7129335 sigma in 11act. ( 19.227211 sig out 1act.) RANK 4 NODE 8 --> 10.9500055 sigma in 11act. ( 12.6828728 sig out 1act.) RANK 5 NODE 4 --> 9.01365089 sigma in 11act. ( 10.1820679 sig out 1act.) RANK 6 NODE 7 --> 7.3037734 sigma in 11act. ( 7.16121674 sig out 1act.) RANK 7 NODE 6 --> 7.08244371 sigma in 11act. ( 8.4946785 sig out 1act.) RANK 8 NODE 14 --> 6.68756628 sigma in 11act. ( 2.53697896 sig out 1act.) RANK 9 NODE 12 --> 6.24671459 sigma in 11act. ( 8.02088261 sig out 1act.) RANK 10 NODE 10 --> 4.99811554 sigma in 11act. ( 2.30720425 sig out 1act.) RANK 11 NODE 5 --> 4.6601038 sigma in 11act. ( 6.12208939 sig out 1act.) RANK 12 NODE 11 --> 4.51831388 sigma in 11act. ( 7.60359049 sig out 1act.) RANK 13 NODE 2 --> 3.06794047 sigma in 11act. ( 2.97446346 sig out 1act.) RANK 14 NODE 13 --> 2.86779618 sigma in 11act. ( 3.18181562 sig out 1act.) RANK 15 NODE 3 --> 1.59388256 sigma in 11act. ( 1.2205894 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 19.227211 sigma out 1act.( 14.7129335 sig in 11act.) RANK 2 NODE 15 --> 19.0910606 sigma out 1act.( 17.9926376 sig in 11act.) RANK 3 NODE 1 --> 15.0216694 sigma out 1act.( 16.9276085 sig in 11act.) RANK 4 NODE 8 --> 12.6828728 sigma out 1act.( 10.9500055 sig in 11act.) RANK 5 NODE 4 --> 10.1820679 sigma out 1act.( 9.01365089 sig in 11act.) RANK 6 NODE 6 --> 8.4946785 sigma out 1act.( 7.08244371 sig in 11act.) RANK 7 NODE 12 --> 8.02088261 sigma out 1act.( 6.24671459 sig in 11act.) RANK 8 NODE 11 --> 7.60359049 sigma out 1act.( 4.51831388 sig in 11act.) RANK 9 NODE 7 --> 7.16121674 sigma out 1act.( 7.3037734 sig in 11act.) RANK 10 NODE 5 --> 6.12208939 sigma out 1act.( 4.6601038 sig in 11act.) RANK 11 NODE 13 --> 3.18181562 sigma out 1act.( 2.86779618 sig in 11act.) RANK 12 NODE 2 --> 2.97446346 sigma out 1act.( 3.06794047 sig in 11act.) RANK 13 NODE 14 --> 2.53697896 sigma out 1act.( 6.68756628 sig in 11act.) RANK 14 NODE 10 --> 2.30720425 sigma out 1act.( 4.99811554 sig in 11act.) RANK 15 NODE 3 --> 1.2205894 sigma out 1act.( 1.59388256 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 39.2380829 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 24.5780048 sigma out 15 active outputs RANK 2 NODE 1 --> 16.8832817 sigma out 15 active outputs RANK 3 NODE 5 --> 13.7024317 sigma out 15 active outputs RANK 4 NODE 7 --> 13.0173187 sigma out 15 active outputs RANK 5 NODE 4 --> 12.8534975 sigma out 15 active outputs RANK 6 NODE 11 --> 12.4927912 sigma out 15 active outputs RANK 7 NODE 3 --> 12.3963737 sigma out 15 active outputs RANK 8 NODE 6 --> 11.3598557 sigma out 15 active outputs RANK 9 NODE 2 --> 11.1909208 sigma out 15 active outputs RANK 10 NODE 8 --> 11.119297 sigma out 15 active outputs RANK 11 NODE 10 --> 10.7327814 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 21.7908649 sigma in 11act. ( 19.6218662 sig out 1act.) RANK 2 NODE 15 --> 20.381134 sigma in 11act. ( 19.9344006 sig out 1act.) RANK 3 NODE 1 --> 14.9440079 sigma in 11act. ( 14.0344315 sig out 1act.) RANK 4 NODE 11 --> 14.232234 sigma in 11act. ( 8.8441782 sig out 1act.) RANK 5 NODE 8 --> 13.6827593 sigma in 11act. ( 12.736908 sig out 1act.) RANK 6 NODE 4 --> 11.4311857 sigma in 11act. ( 10.3026428 sig out 1act.) RANK 7 NODE 6 --> 10.9326982 sigma in 11act. ( 9.03715611 sig out 1act.) RANK 8 NODE 12 --> 10.9188623 sigma in 11act. ( 8.56233311 sig out 1act.) RANK 9 NODE 5 --> 9.21354103 sigma in 11act. ( 7.47835064 sig out 1act.) RANK 10 NODE 14 --> 7.59432983 sigma in 11act. ( 2.01545119 sig out 1act.) RANK 11 NODE 7 --> 7.55807304 sigma in 11act. ( 6.73053217 sig out 1act.) RANK 12 NODE 10 --> 6.94858074 sigma in 11act. ( 1.87400055 sig out 1act.) RANK 13 NODE 3 --> 6.23948765 sigma in 11act. ( 1.7628597 sig out 1act.) RANK 14 NODE 2 --> 5.41786003 sigma in 11act. ( 3.23632646 sig out 1act.) RANK 15 NODE 13 --> 5.03934717 sigma in 11act. ( 3.84295344 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 19.9344006 sigma out 1act.( 20.381134 sig in 11act.) RANK 2 NODE 9 --> 19.6218662 sigma out 1act.( 21.7908649 sig in 11act.) RANK 3 NODE 1 --> 14.0344315 sigma out 1act.( 14.9440079 sig in 11act.) RANK 4 NODE 8 --> 12.736908 sigma out 1act.( 13.6827593 sig in 11act.) RANK 5 NODE 4 --> 10.3026428 sigma out 1act.( 11.4311857 sig in 11act.) RANK 6 NODE 6 --> 9.03715611 sigma out 1act.( 10.9326982 sig in 11act.) RANK 7 NODE 11 --> 8.8441782 sigma out 1act.( 14.232234 sig in 11act.) RANK 8 NODE 12 --> 8.56233311 sigma out 1act.( 10.9188623 sig in 11act.) RANK 9 NODE 5 --> 7.47835064 sigma out 1act.( 9.21354103 sig in 11act.) RANK 10 NODE 7 --> 6.73053217 sigma out 1act.( 7.55807304 sig in 11act.) RANK 11 NODE 13 --> 3.84295344 sigma out 1act.( 5.03934717 sig in 11act.) RANK 12 NODE 2 --> 3.23632646 sigma out 1act.( 5.41786003 sig in 11act.) RANK 13 NODE 14 --> 2.01545119 sigma out 1act.( 7.59432983 sig in 11act.) RANK 14 NODE 10 --> 1.87400055 sigma out 1act.( 6.94858074 sig in 11act.) RANK 15 NODE 3 --> 1.7628597 sigma out 1act.( 6.23948765 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 40.2254791 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.441914886 *** contribution from regularisation: 0.00399193354 *** contribution from error: -0.445906818 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.470746994 *** contribution from regularisation: 0.00221330975 *** contribution from error: -0.472960293 *********************************************** -----------------> Test sample ENTER BFGS code START -44179.1018 -0.124010853 -0.0552875139 EXIT FROM BFGS code FG_START 0. -0.124010853 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.482245535 *** contribution from regularisation: 0.00208711904 *** contribution from error: -0.484332651 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -45248.6153 -0.124010853 -40.0697594 EXIT FROM BFGS code FG_LNSRCH 0. -0.132979438 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.50789094 *** contribution from regularisation: 0.00315856491 *** contribution from error: -0.511049509 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47654.8994 -0.132979438 60.0255051 EXIT FROM BFGS code NEW_X -47654.8994 -0.132979438 60.0255051 ENTER BFGS code NEW_X -47654.8994 -0.132979438 60.0255051 EXIT FROM BFGS code FG_LNSRCH 0. -0.122761205 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.510320485 *** contribution from regularisation: 0.0030262419 *** contribution from error: -0.513346732 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47882.8594 -0.122761205 5.82216454 EXIT FROM BFGS code NEW_X -47882.8594 -0.122761205 5.82216454 ENTER BFGS code NEW_X -47882.8594 -0.122761205 5.82216454 EXIT FROM BFGS code FG_LNSRCH 0. -0.120670617 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.511266708 *** contribution from regularisation: 0.00292377896 *** contribution from error: -0.514190495 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47971.6462 -0.120670617 -12.786953 EXIT FROM BFGS code NEW_X -47971.6462 -0.120670617 -12.786953 ENTER BFGS code NEW_X -47971.6462 -0.120670617 -12.786953 EXIT FROM BFGS code FG_LNSRCH 0. -0.124862261 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.512211204 *** contribution from regularisation: 0.00282793958 *** contribution from error: -0.515039146 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48060.2646 -0.124862261 -22.3431358 EXIT FROM BFGS code NEW_X -48060.2646 -0.124862261 -22.3431358 ENTER BFGS code NEW_X -48060.2646 -0.124862261 -22.3431358 EXIT FROM BFGS code FG_LNSRCH 0. -0.131381661 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.513145387 *** contribution from regularisation: 0.0029717423 *** contribution from error: -0.516117156 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48147.9158 -0.131381661 -20.044426 EXIT FROM BFGS code NEW_X -48147.9158 -0.131381661 -20.044426 ENTER BFGS code NEW_X -48147.9158 -0.131381661 -20.044426 EXIT FROM BFGS code FG_LNSRCH 0. -0.201222584 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.498378426 *** contribution from regularisation: 0.0054922658 *** contribution from error: -0.503870666 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46762.3481 -0.201222584 5.32122612 EXIT FROM BFGS code FG_LNSRCH 0. -0.148287416 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 39.6755486 sigma out 15 active outputs RANK 2 NODE 1 --> 22.6663284 sigma out 15 active outputs RANK 3 NODE 4 --> 16.2629471 sigma out 15 active outputs RANK 4 NODE 8 --> 15.2368879 sigma out 15 active outputs RANK 5 NODE 6 --> 13.1868153 sigma out 15 active outputs RANK 6 NODE 5 --> 12.977932 sigma out 15 active outputs RANK 7 NODE 7 --> 12.6192732 sigma out 15 active outputs RANK 8 NODE 10 --> 12.2016888 sigma out 15 active outputs RANK 9 NODE 11 --> 11.0637884 sigma out 15 active outputs RANK 10 NODE 2 --> 9.70493603 sigma out 15 active outputs RANK 11 NODE 3 --> 9.60582733 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 43.0415039 sigma in 11act. ( 46.6391945 sig out 1act.) RANK 2 NODE 9 --> 18.7153034 sigma in 11act. ( 21.5035896 sig out 1act.) RANK 3 NODE 8 --> 16.8684616 sigma in 11act. ( 15.5756426 sig out 1act.) RANK 4 NODE 15 --> 14.4867468 sigma in 11act. ( 11.7220278 sig out 1act.) RANK 5 NODE 1 --> 13.8611212 sigma in 11act. ( 15.4264822 sig out 1act.) RANK 6 NODE 6 --> 12.907218 sigma in 11act. ( 11.5986118 sig out 1act.) RANK 7 NODE 14 --> 10.761899 sigma in 11act. ( 9.71837616 sig out 1act.) RANK 8 NODE 5 --> 8.61262703 sigma in 11act. ( 7.77850056 sig out 1act.) RANK 9 NODE 10 --> 8.46886063 sigma in 11act. ( 8.09508324 sig out 1act.) RANK 10 NODE 12 --> 8.450243 sigma in 11act. ( 7.64521551 sig out 1act.) RANK 11 NODE 3 --> 8.43869305 sigma in 11act. ( 7.01044941 sig out 1act.) RANK 12 NODE 4 --> 5.48593521 sigma in 11act. ( 4.66872168 sig out 1act.) RANK 13 NODE 13 --> 4.90290022 sigma in 11act. ( 4.04203796 sig out 1act.) RANK 14 NODE 2 --> 4.89997625 sigma in 11act. ( 4.05148506 sig out 1act.) RANK 15 NODE 7 --> 2.32775068 sigma in 11act. ( 1.41363668 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 46.6391945 sigma out 1act.( 43.0415039 sig in 11act.) RANK 2 NODE 9 --> 21.5035896 sigma out 1act.( 18.7153034 sig in 11act.) RANK 3 NODE 8 --> 15.5756426 sigma out 1act.( 16.8684616 sig in 11act.) RANK 4 NODE 1 --> 15.4264822 sigma out 1act.( 13.8611212 sig in 11act.) RANK 5 NODE 15 --> 11.7220278 sigma out 1act.( 14.4867468 sig in 11act.) RANK 6 NODE 6 --> 11.5986118 sigma out 1act.( 12.907218 sig in 11act.) RANK 7 NODE 14 --> 9.71837616 sigma out 1act.( 10.761899 sig in 11act.) RANK 8 NODE 10 --> 8.09508324 sigma out 1act.( 8.46886063 sig in 11act.) RANK 9 NODE 5 --> 7.77850056 sigma out 1act.( 8.61262703 sig in 11act.) RANK 10 NODE 12 --> 7.64521551 sigma out 1act.( 8.450243 sig in 11act.) RANK 11 NODE 3 --> 7.01044941 sigma out 1act.( 8.43869305 sig in 11act.) RANK 12 NODE 4 --> 4.66872168 sigma out 1act.( 5.48593521 sig in 11act.) RANK 13 NODE 2 --> 4.05148506 sigma out 1act.( 4.89997625 sig in 11act.) RANK 14 NODE 13 --> 4.04203796 sigma out 1act.( 4.90290022 sig in 11act.) RANK 15 NODE 7 --> 1.41363668 sigma out 1act.( 2.32775068 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.4390411 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.517732024 *** contribution from regularisation: 0.00140777102 *** contribution from error: -0.519139767 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48578.2769 -0.148287416 -7.16672945 EXIT FROM BFGS code NEW_X -48578.2769 -0.148287416 -7.16672945 ENTER BFGS code NEW_X -48578.2769 -0.148287416 -7.16672945 EXIT FROM BFGS code FG_LNSRCH 0. -0.184042752 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.516554594 *** contribution from regularisation: 0.00467047049 *** contribution from error: -0.521225035 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48467.8015 -0.184042752 -0.219378531 EXIT FROM BFGS code FG_LNSRCH 0. -0.161049694 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.51953125 *** contribution from regularisation: 0.00179726363 *** contribution from error: -0.521328509 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48747.0999 -0.161049694 2.0369215 EXIT FROM BFGS code NEW_X -48747.0999 -0.161049694 2.0369215 ENTER BFGS code NEW_X -48747.0999 -0.161049694 2.0369215 EXIT FROM BFGS code FG_LNSRCH 0. -0.190318272 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.518319666 *** contribution from regularisation: 0.00430138595 *** contribution from error: -0.522621036 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48633.4147 -0.190318272 5.86276817 EXIT FROM BFGS code FG_LNSRCH 0. -0.171282038 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.521141291 *** contribution from regularisation: 0.00196539843 *** contribution from error: -0.523106694 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48898.1689 -0.171282038 2.12832928 EXIT FROM BFGS code NEW_X -48898.1689 -0.171282038 2.12832928 ENTER BFGS code NEW_X -48898.1689 -0.171282038 2.12832928 EXIT FROM BFGS code FG_LNSRCH 0. -0.1893664 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.520175517 *** contribution from regularisation: 0.00339139113 *** contribution from error: -0.523566902 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48807.5506 -0.1893664 2.84401417 EXIT FROM BFGS code FG_LNSRCH 0. -0.176773712 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.521717787 *** contribution from regularisation: 0.00225820043 *** contribution from error: -0.523975968 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48952.2556 -0.176773712 3.2403295 EXIT FROM BFGS code NEW_X -48952.2556 -0.176773712 3.2403295 ENTER BFGS code NEW_X -48952.2556 -0.176773712 3.2403295 EXIT FROM BFGS code FG_LNSRCH 0. -0.182821959 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.521889687 *** contribution from regularisation: 0.00288896239 *** contribution from error: -0.524778664 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48968.3864 -0.182821959 3.50552964 EXIT FROM BFGS code NEW_X -48968.3864 -0.182821959 3.50552964 ENTER BFGS code NEW_X -48968.3864 -0.182821959 3.50552964 EXIT FROM BFGS code FG_LNSRCH 0. -0.181653067 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.522639811 *** contribution from regularisation: 0.00264463294 *** contribution from error: -0.525284469 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49038.77 -0.181653067 3.61446714 EXIT FROM BFGS code NEW_X -49038.77 -0.181653067 3.61446714 ENTER BFGS code NEW_X -49038.77 -0.181653067 3.61446714 EXIT FROM BFGS code FG_LNSRCH 0. -0.174820423 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.52344501 *** contribution from regularisation: 0.0026827713 *** contribution from error: -0.526127756 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49114.3199 -0.174820423 4.19856739 EXIT FROM BFGS code NEW_X -49114.3199 -0.174820423 4.19856739 ENTER BFGS code NEW_X -49114.3199 -0.174820423 4.19856739 EXIT FROM BFGS code FG_LNSRCH 0. -0.170067608 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 62.6679344 sigma out 15 active outputs RANK 2 NODE 8 --> 34.5236816 sigma out 15 active outputs RANK 3 NODE 1 --> 28.2806396 sigma out 15 active outputs RANK 4 NODE 7 --> 23.4313602 sigma out 15 active outputs RANK 5 NODE 4 --> 20.7438507 sigma out 15 active outputs RANK 6 NODE 6 --> 20.6299553 sigma out 15 active outputs RANK 7 NODE 5 --> 20.1933632 sigma out 15 active outputs RANK 8 NODE 10 --> 17.5719719 sigma out 15 active outputs RANK 9 NODE 11 --> 16.7772026 sigma out 15 active outputs RANK 10 NODE 3 --> 12.8814917 sigma out 15 active outputs RANK 11 NODE 2 --> 12.788106 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 68.0904694 sigma in 11act. ( 87.1715393 sig out 1act.) RANK 2 NODE 9 --> 34.6647224 sigma in 11act. ( 40.8128319 sig out 1act.) RANK 3 NODE 1 --> 30.5078449 sigma in 11act. ( 34.1864433 sig out 1act.) RANK 4 NODE 14 --> 23.8135777 sigma in 11act. ( 25.5659847 sig out 1act.) RANK 5 NODE 8 --> 23.4400826 sigma in 11act. ( 24.170084 sig out 1act.) RANK 6 NODE 6 --> 17.4360237 sigma in 11act. ( 19.1974239 sig out 1act.) RANK 7 NODE 15 --> 10.2353601 sigma in 11act. ( 7.34666538 sig out 1act.) RANK 8 NODE 10 --> 9.85616779 sigma in 11act. ( 9.6068058 sig out 1act.) RANK 9 NODE 12 --> 9.83923912 sigma in 11act. ( 9.44616413 sig out 1act.) RANK 10 NODE 3 --> 9.33047962 sigma in 11act. ( 9.1825037 sig out 1act.) RANK 11 NODE 5 --> 5.19123268 sigma in 11act. ( 3.59736156 sig out 1act.) RANK 12 NODE 13 --> 4.91939354 sigma in 11act. ( 4.6682682 sig out 1act.) RANK 13 NODE 4 --> 3.24254513 sigma in 11act. ( 1.40903473 sig out 1act.) RANK 14 NODE 2 --> 2.75916171 sigma in 11act. ( 0.295049995 sig out 1act.) RANK 15 NODE 7 --> 2.66354012 sigma in 11act. ( 2.11765575 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 87.1715393 sigma out 1act.( 68.0904694 sig in 11act.) RANK 2 NODE 9 --> 40.8128319 sigma out 1act.( 34.6647224 sig in 11act.) RANK 3 NODE 1 --> 34.1864433 sigma out 1act.( 30.5078449 sig in 11act.) RANK 4 NODE 14 --> 25.5659847 sigma out 1act.( 23.8135777 sig in 11act.) RANK 5 NODE 8 --> 24.170084 sigma out 1act.( 23.4400826 sig in 11act.) RANK 6 NODE 6 --> 19.1974239 sigma out 1act.( 17.4360237 sig in 11act.) RANK 7 NODE 10 --> 9.6068058 sigma out 1act.( 9.85616779 sig in 11act.) RANK 8 NODE 12 --> 9.44616413 sigma out 1act.( 9.83923912 sig in 11act.) RANK 9 NODE 3 --> 9.1825037 sigma out 1act.( 9.33047962 sig in 11act.) RANK 10 NODE 15 --> 7.34666538 sigma out 1act.( 10.2353601 sig in 11act.) RANK 11 NODE 13 --> 4.6682682 sigma out 1act.( 4.91939354 sig in 11act.) RANK 12 NODE 5 --> 3.59736156 sigma out 1act.( 5.19123268 sig in 11act.) RANK 13 NODE 7 --> 2.11765575 sigma out 1act.( 2.66354012 sig in 11act.) RANK 14 NODE 4 --> 1.40903473 sigma out 1act.( 3.24254513 sig in 11act.) RANK 15 NODE 2 --> 0.295049995 sigma out 1act.( 2.75916171 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 111.358582 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.523610294 *** contribution from regularisation: 0.00290061068 *** contribution from error: -0.526510894 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49129.8324 -0.170067608 2.74314833 EXIT FROM BFGS code NEW_X -49129.8324 -0.170067608 2.74314833 ENTER BFGS code NEW_X -49129.8324 -0.170067608 2.74314833 EXIT FROM BFGS code FG_LNSRCH 0. -0.170035467 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.523984373 *** contribution from regularisation: 0.00288768765 *** contribution from error: -0.526872039 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49164.9285 -0.170035467 3.64244509 EXIT FROM BFGS code NEW_X -49164.9285 -0.170035467 3.64244509 ENTER BFGS code NEW_X -49164.9285 -0.170035467 3.64244509 EXIT FROM BFGS code FG_LNSRCH 0. -0.16812928 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.524184406 *** contribution from regularisation: 0.00284431991 *** contribution from error: -0.527028739 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49183.6979 -0.16812928 4.54151487 EXIT FROM BFGS code NEW_X -49183.6979 -0.16812928 4.54151487 ENTER BFGS code NEW_X -49183.6979 -0.16812928 4.54151487 EXIT FROM BFGS code FG_LNSRCH 0. -0.162104815 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.524442315 *** contribution from regularisation: 0.00287688151 *** contribution from error: -0.527319193 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49207.8989 -0.162104815 5.72575378 EXIT FROM BFGS code NEW_X -49207.8989 -0.162104815 5.72575378 ENTER BFGS code NEW_X -49207.8989 -0.162104815 5.72575378 EXIT FROM BFGS code FG_LNSRCH 0. -0.149779305 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.524888813 *** contribution from regularisation: 0.00296036503 *** contribution from error: -0.527849197 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49249.7952 -0.149779305 7.92567968 EXIT FROM BFGS code NEW_X -49249.7952 -0.149779305 7.92567968 ENTER BFGS code NEW_X -49249.7952 -0.149779305 7.92567968 EXIT FROM BFGS code FG_LNSRCH 0. -0.129082397 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.525537372 *** contribution from regularisation: 0.00307194144 *** contribution from error: -0.528609335 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49310.6483 -0.129082397 6.44415283 EXIT FROM BFGS code NEW_X -49310.6483 -0.129082397 6.44415283 ENTER BFGS code NEW_X -49310.6483 -0.129082397 6.44415283 EXIT FROM BFGS code FG_LNSRCH 0. -0.0961051956 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.52561307 *** contribution from regularisation: 0.00328308996 *** contribution from error: -0.528896153 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49317.7466 -0.0961051956 11.309864 EXIT FROM BFGS code FG_LNSRCH 0. -0.113970913 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.526118159 *** contribution from regularisation: 0.00296705123 *** contribution from error: -0.529085219 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49365.1429 -0.113970913 8.42997932 EXIT FROM BFGS code NEW_X -49365.1429 -0.113970913 8.42997932 ENTER BFGS code NEW_X -49365.1429 -0.113970913 8.42997932 EXIT FROM BFGS code FG_LNSRCH 0. -0.101760045 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.526311636 *** contribution from regularisation: 0.00313964719 *** contribution from error: -0.529451311 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49383.2932 -0.101760045 1.86957645 EXIT FROM BFGS code NEW_X -49383.2932 -0.101760045 1.86957645 ENTER BFGS code NEW_X -49383.2932 -0.101760045 1.86957645 EXIT FROM BFGS code FG_LNSRCH 0. -0.0967643633 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.526455104 *** contribution from regularisation: 0.00312425802 *** contribution from error: -0.529579341 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49396.758 -0.0967643633 2.71764159 EXIT FROM BFGS code NEW_X -49396.758 -0.0967643633 2.71764159 ENTER BFGS code NEW_X -49396.758 -0.0967643633 2.71764159 EXIT FROM BFGS code FG_LNSRCH 0. -0.0821517631 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 84.7956467 sigma out 15 active outputs RANK 2 NODE 8 --> 46.0787277 sigma out 15 active outputs RANK 3 NODE 5 --> 34.2112465 sigma out 15 active outputs RANK 4 NODE 1 --> 33.0402565 sigma out 15 active outputs RANK 5 NODE 7 --> 31.2527924 sigma out 15 active outputs RANK 6 NODE 4 --> 29.2155304 sigma out 15 active outputs RANK 7 NODE 11 --> 29.0499382 sigma out 15 active outputs RANK 8 NODE 3 --> 27.9762421 sigma out 15 active outputs RANK 9 NODE 10 --> 26.7984619 sigma out 15 active outputs RANK 10 NODE 6 --> 23.8390465 sigma out 15 active outputs RANK 11 NODE 2 --> 23.7019577 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 76.7658768 sigma in 11act. ( 111.439232 sig out 1act.) RANK 2 NODE 1 --> 58.4544945 sigma in 11act. ( 67.8430862 sig out 1act.) RANK 3 NODE 9 --> 57.3397102 sigma in 11act. ( 62.7629852 sig out 1act.) RANK 4 NODE 14 --> 43.5797386 sigma in 11act. ( 47.5194893 sig out 1act.) RANK 5 NODE 8 --> 31.1231766 sigma in 11act. ( 31.8198757 sig out 1act.) RANK 6 NODE 6 --> 21.8159065 sigma in 11act. ( 26.7119579 sig out 1act.) RANK 7 NODE 15 --> 20.0622234 sigma in 11act. ( 16.1957378 sig out 1act.) RANK 8 NODE 12 --> 14.6378775 sigma in 11act. ( 15.2959766 sig out 1act.) RANK 9 NODE 10 --> 12.4789419 sigma in 11act. ( 10.9217653 sig out 1act.) RANK 10 NODE 3 --> 9.00645351 sigma in 11act. ( 9.346632 sig out 1act.) RANK 11 NODE 13 --> 6.78419447 sigma in 11act. ( 7.32281876 sig out 1act.) RANK 12 NODE 5 --> 4.39801979 sigma in 11act. ( 3.53315759 sig out 1act.) RANK 13 NODE 7 --> 3.77622771 sigma in 11act. ( 3.49724936 sig out 1act.) RANK 14 NODE 4 --> 1.79464972 sigma in 11act. ( 0.0483197458 sig out 1act.) RANK 15 NODE 2 --> 1.64757884 sigma in 11act. ( 0.362648576 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 111.439232 sigma out 1act.( 76.7658768 sig in 11act.) RANK 2 NODE 1 --> 67.8430862 sigma out 1act.( 58.4544945 sig in 11act.) RANK 3 NODE 9 --> 62.7629852 sigma out 1act.( 57.3397102 sig in 11act.) RANK 4 NODE 14 --> 47.5194893 sigma out 1act.( 43.5797386 sig in 11act.) RANK 5 NODE 8 --> 31.8198757 sigma out 1act.( 31.1231766 sig in 11act.) RANK 6 NODE 6 --> 26.7119579 sigma out 1act.( 21.8159065 sig in 11act.) RANK 7 NODE 15 --> 16.1957378 sigma out 1act.( 20.0622234 sig in 11act.) RANK 8 NODE 12 --> 15.2959766 sigma out 1act.( 14.6378775 sig in 11act.) RANK 9 NODE 10 --> 10.9217653 sigma out 1act.( 12.4789419 sig in 11act.) RANK 10 NODE 3 --> 9.346632 sigma out 1act.( 9.00645351 sig in 11act.) RANK 11 NODE 13 --> 7.32281876 sigma out 1act.( 6.78419447 sig in 11act.) RANK 12 NODE 5 --> 3.53315759 sigma out 1act.( 4.39801979 sig in 11act.) RANK 13 NODE 7 --> 3.49724936 sigma out 1act.( 3.77622771 sig in 11act.) RANK 14 NODE 2 --> 0.362648576 sigma out 1act.( 1.64757884 sig in 11act.) RANK 15 NODE 4 --> 0.0483197458 sigma out 1act.( 1.79464972 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 160.39357 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.526677728 *** contribution from regularisation: 0.00315856887 *** contribution from error: -0.529836297 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49417.6469 -0.0821517631 3.59002662 EXIT FROM BFGS code NEW_X -49417.6469 -0.0821517631 3.59002662 ENTER BFGS code NEW_X -49417.6469 -0.0821517631 3.59002662 EXIT FROM BFGS code FG_LNSRCH 0. -0.0685953274 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.526862144 *** contribution from regularisation: 0.00316913216 *** contribution from error: -0.530031264 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49434.9473 -0.0685953274 4.21735954 EXIT FROM BFGS code NEW_X -49434.9473 -0.0685953274 4.21735954 ENTER BFGS code NEW_X -49434.9473 -0.0685953274 4.21735954 EXIT FROM BFGS code FG_LNSRCH 0. -0.0562820472 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.526990354 *** contribution from regularisation: 0.00316916499 *** contribution from error: -0.530159533 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49446.9759 -0.0562820472 1.93519437 EXIT FROM BFGS code NEW_X -49446.9759 -0.0562820472 1.93519437 ENTER BFGS code NEW_X -49446.9759 -0.0562820472 1.93519437 EXIT FROM BFGS code FG_LNSRCH 0. -0.0577117652 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.527152479 *** contribution from regularisation: 0.00312079606 *** contribution from error: -0.530273259 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49462.19 -0.0577117652 1.57892287 EXIT FROM BFGS code NEW_X -49462.19 -0.0577117652 1.57892287 ENTER BFGS code NEW_X -49462.19 -0.0577117652 1.57892287 EXIT FROM BFGS code FG_LNSRCH 0. -0.0493759699 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.527329147 *** contribution from regularisation: 0.00303623662 *** contribution from error: -0.530365407 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49478.7661 -0.0493759699 3.88549495 EXIT FROM BFGS code NEW_X -49478.7661 -0.0493759699 3.88549495 ENTER BFGS code NEW_X -49478.7661 -0.0493759699 3.88549495 EXIT FROM BFGS code FG_LNSRCH 0. -0.0483804718 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.527224898 *** contribution from regularisation: 0.00315200724 *** contribution from error: -0.530376911 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49468.9845 -0.0483804718 0.206937432 EXIT FROM BFGS code FG_LNSRCH 0. -0.0492309853 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.527174771 *** contribution from regularisation: 0.00320691057 *** contribution from error: -0.53038168 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49464.2826 -0.0492309853 3.39311934 EXIT FROM BFGS code FG_LNSRCH 0. -0.0493730456 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.527190626 *** contribution from regularisation: 0.00317522441 *** contribution from error: -0.530365825 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49465.769 -0.0493730456 3.8770349 EXIT FROM BFGS code FG_LNSRCH 0. -0.0493759699 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.52719456 *** contribution from regularisation: 0.0031708423 *** contribution from error: -0.530365407 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49466.1362 -0.0493759699 3.88423133 EXIT FROM BFGS code FG_LNSRCH 0. -0.0493759699 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.527199984 *** contribution from regularisation: 0.00316539779 *** contribution from error: -0.530365407 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49466.647 -0.0493759699 3.88901949 EXIT FROM BFGS code FG_LNSRCH 0. -0.0493759699 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 91.2357254 sigma out 15 active outputs RANK 2 NODE 8 --> 44.392746 sigma out 15 active outputs RANK 3 NODE 11 --> 37.0883064 sigma out 15 active outputs RANK 4 NODE 1 --> 36.0571632 sigma out 15 active outputs RANK 5 NODE 7 --> 34.8001099 sigma out 15 active outputs RANK 6 NODE 5 --> 32.2742271 sigma out 15 active outputs RANK 7 NODE 4 --> 28.1271572 sigma out 15 active outputs RANK 8 NODE 3 --> 27.6173115 sigma out 15 active outputs RANK 9 NODE 10 --> 27.5928249 sigma out 15 active outputs RANK 10 NODE 6 --> 26.8879986 sigma out 15 active outputs RANK 11 NODE 2 --> 25.1830292 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 79.9681854 sigma in 11act. ( 108.128036 sig out 1act.) RANK 2 NODE 9 --> 62.6546211 sigma in 11act. ( 67.291153 sig out 1act.) RANK 3 NODE 1 --> 57.4657288 sigma in 11act. ( 66.8846893 sig out 1act.) RANK 4 NODE 14 --> 51.4661522 sigma in 11act. ( 53.4653931 sig out 1act.) RANK 5 NODE 8 --> 32.2648277 sigma in 11act. ( 33.3080368 sig out 1act.) RANK 6 NODE 6 --> 23.3210087 sigma in 11act. ( 28.5744286 sig out 1act.) RANK 7 NODE 15 --> 21.6033936 sigma in 11act. ( 16.9149704 sig out 1act.) RANK 8 NODE 12 --> 15.2993946 sigma in 11act. ( 15.7104759 sig out 1act.) RANK 9 NODE 10 --> 13.4945173 sigma in 11act. ( 11.9905386 sig out 1act.) RANK 10 NODE 3 --> 8.49528408 sigma in 11act. ( 8.75108242 sig out 1act.) RANK 11 NODE 13 --> 6.65053654 sigma in 11act. ( 7.10815477 sig out 1act.) RANK 12 NODE 5 --> 4.65594625 sigma in 11act. ( 3.94760609 sig out 1act.) RANK 13 NODE 7 --> 3.78919125 sigma in 11act. ( 3.33320475 sig out 1act.) RANK 14 NODE 4 --> 1.37025392 sigma in 11act. ( 0.13020207 sig out 1act.) RANK 15 NODE 2 --> 1.30627751 sigma in 11act. ( 0.282342583 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 108.128036 sigma out 1act.( 79.9681854 sig in 11act.) RANK 2 NODE 9 --> 67.291153 sigma out 1act.( 62.6546211 sig in 11act.) RANK 3 NODE 1 --> 66.8846893 sigma out 1act.( 57.4657288 sig in 11act.) RANK 4 NODE 14 --> 53.4653931 sigma out 1act.( 51.4661522 sig in 11act.) RANK 5 NODE 8 --> 33.3080368 sigma out 1act.( 32.2648277 sig in 11act.) RANK 6 NODE 6 --> 28.5744286 sigma out 1act.( 23.3210087 sig in 11act.) RANK 7 NODE 15 --> 16.9149704 sigma out 1act.( 21.6033936 sig in 11act.) RANK 8 NODE 12 --> 15.7104759 sigma out 1act.( 15.2993946 sig in 11act.) RANK 9 NODE 10 --> 11.9905386 sigma out 1act.( 13.4945173 sig in 11act.) RANK 10 NODE 3 --> 8.75108242 sigma out 1act.( 8.49528408 sig in 11act.) RANK 11 NODE 13 --> 7.10815477 sigma out 1act.( 6.65053654 sig in 11act.) RANK 12 NODE 5 --> 3.94760609 sigma out 1act.( 4.65594625 sig in 11act.) RANK 13 NODE 7 --> 3.33320475 sigma out 1act.( 3.78919125 sig in 11act.) RANK 14 NODE 2 --> 0.282342583 sigma out 1act.( 1.30627751 sig in 11act.) RANK 15 NODE 4 --> 0.13020207 sigma out 1act.( 1.37025392 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 162.198669 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.52719003 *** contribution from regularisation: 0.00317534246 *** contribution from error: -0.530365348 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49465.7139 -0.0493759699 3.88404059 EXIT FROM BFGS code FG_LNSRCH 0. -0.0493759699 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.527199864 *** contribution from regularisation: 0.00316553703 *** contribution from error: -0.530365407 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49466.6339 -0.0493759699 3.89001918 EXIT FROM BFGS code NEW_X -49466.6339 -0.0493759699 3.89001918 ENTER BFGS code NEW_X -49466.6339 -0.0493759699 3.89001918 EXIT FROM BFGS code CONVERGENC -49466.6339 -0.0493759699 3.89001918 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 144.70668 sigma out 15 active outputs RANK 2 NODE 8 --> 74.8332443 sigma out 15 active outputs RANK 3 NODE 11 --> 62.3910141 sigma out 15 active outputs RANK 4 NODE 1 --> 58.9437408 sigma out 15 active outputs RANK 5 NODE 7 --> 58.0324669 sigma out 15 active outputs RANK 6 NODE 5 --> 53.6850243 sigma out 15 active outputs RANK 7 NODE 10 --> 47.2410469 sigma out 15 active outputs RANK 8 NODE 3 --> 45.4840431 sigma out 15 active outputs RANK 9 NODE 4 --> 45.1303444 sigma out 15 active outputs RANK 10 NODE 6 --> 43.923233 sigma out 15 active outputs RANK 11 NODE 2 --> 40.1802177 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 129.074554 sigma in 11act. ( 178.479828 sig out 1act.) RANK 2 NODE 9 --> 103.678902 sigma in 11act. ( 110.039307 sig out 1act.) RANK 3 NODE 1 --> 93.5955124 sigma in 11act. ( 109.908073 sig out 1act.) RANK 4 NODE 14 --> 83.9495621 sigma in 11act. ( 87.43573 sig out 1act.) RANK 5 NODE 8 --> 52.3649712 sigma in 11act. ( 55.1567955 sig out 1act.) RANK 6 NODE 6 --> 37.6310196 sigma in 11act. ( 47.286171 sig out 1act.) RANK 7 NODE 15 --> 34.7215996 sigma in 11act. ( 28.2254848 sig out 1act.) RANK 8 NODE 12 --> 24.9588032 sigma in 11act. ( 25.8095665 sig out 1act.) RANK 9 NODE 10 --> 21.1035004 sigma in 11act. ( 19.8141079 sig out 1act.) RANK 10 NODE 3 --> 13.6539831 sigma in 11act. ( 14.786128 sig out 1act.) RANK 11 NODE 13 --> 10.5775824 sigma in 11act. ( 11.8686476 sig out 1act.) RANK 12 NODE 5 --> 7.09672546 sigma in 11act. ( 6.49045992 sig out 1act.) RANK 13 NODE 7 --> 6.01104641 sigma in 11act. ( 5.60510635 sig out 1act.) RANK 14 NODE 4 --> 1.37951851 sigma in 11act. ( 0.214572817 sig out 1act.) RANK 15 NODE 2 --> 1.36330712 sigma in 11act. ( 0.464280367 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 178.479828 sigma out 1act.( 129.074554 sig in 11act.) RANK 2 NODE 9 --> 110.039307 sigma out 1act.( 103.678902 sig in 11act.) RANK 3 NODE 1 --> 109.908073 sigma out 1act.( 93.5955124 sig in 11act.) RANK 4 NODE 14 --> 87.43573 sigma out 1act.( 83.9495621 sig in 11act.) RANK 5 NODE 8 --> 55.1567955 sigma out 1act.( 52.3649712 sig in 11act.) RANK 6 NODE 6 --> 47.286171 sigma out 1act.( 37.6310196 sig in 11act.) RANK 7 NODE 15 --> 28.2254848 sigma out 1act.( 34.7215996 sig in 11act.) RANK 8 NODE 12 --> 25.8095665 sigma out 1act.( 24.9588032 sig in 11act.) RANK 9 NODE 10 --> 19.8141079 sigma out 1act.( 21.1035004 sig in 11act.) RANK 10 NODE 3 --> 14.786128 sigma out 1act.( 13.6539831 sig in 11act.) RANK 11 NODE 13 --> 11.8686476 sigma out 1act.( 10.5775824 sig in 11act.) RANK 12 NODE 5 --> 6.49045992 sigma out 1act.( 7.09672546 sig in 11act.) RANK 13 NODE 7 --> 5.60510635 sigma out 1act.( 6.01104641 sig in 11act.) RANK 14 NODE 2 --> 0.464280367 sigma out 1act.( 1.36330712 sig in 11act.) RANK 15 NODE 4 --> 0.214572817 sigma out 1act.( 1.37951851 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 266.937164 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.527193785 *** contribution from regularisation: 0.00317157293 *** contribution from error: -0.530365348 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30761 Closing output file done