NNInput NNInputs_135.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 198783 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 50441 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 50441 Chosen entries: 50441 Signal fraction: 1 Background fraction: 0.340032 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 50441 Entries to split: 50441 Test with : 25220 Train with : 25220 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 50441 for Signal Prepared event 0 for Signal with 50441 events ====Entry 0 Variable Ht : 232.766 Variable LepAPt : 74.3556 Variable LepBPt : 30.6959 Variable MetSigLeptonsJets : 3.09436 Variable MetSpec : 41.4986 Variable SumEtLeptonsJets : 190.102 Variable VSumJetLeptonsPt : 35.9078 Variable addEt : 147.716 Variable dPhiLepSumMet : 2.12661 Variable dPhiLeptons : 0.248817 Variable dRLeptons : 0.333981 Variable lep1_E : 86.3275 Variable lep2_E : 32.4592 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2135 Ht = 232.766 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 74.3557 LepAPt = 74.3556 LepBEt = 30.6962 LepBPt = 30.6959 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 42.6642 MetDelPhi = 1.33651 MetSig = 2.91556 MetSigLeptonsJets = 3.09436 MetSpec = 41.4986 Mjj = 0 MostCentralJetEta = -1.56143 MtllMet = 152.006 Njets = 1 SB = 0 SumEt = 214.133 SumEtJets = 0 SumEtLeptonsJets = 190.102 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 35.9078 addEt = 147.716 dPhiLepSumMet = 2.12661 dPhiLeptons = 0.248817 dRLeptons = 0.333981 diltype = 17 dimass = 15.9508 event = 435 jet1_Et = 85.0503 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 86.3275 lep2_E = 32.4592 rand = 0.999742 run = 230778 weight = 2.42631e-06 ===Show End Prepared event 10000 for Signal with 50441 events Prepared event 20000 for Signal with 50441 events Prepared event 30000 for Signal with 50441 events Prepared event 40000 for Signal with 50441 events Prepared event 50000 for Signal with 50441 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.310984 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4728 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 198783 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4728 negative weights. Signal fraction: 62.4164124 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.3144035 65.4548187 66.9556274 68.127655 68.974762 70.1099854 70.9176941 71.666748 72.5227356 73.3391571 73.9874115 74.6548309 75.2408905 75.8927155 76.5201416 77.0809784 77.7324066 78.3696136 78.8435516 79.504364 80.047699 80.7089386 81.2712402 81.9280548 82.5562439 83.2384949 83.9429245 84.9547119 85.8842621 86.8432312 87.8437805 88.8939209 89.7556992 90.8913116 91.9840546 93.1128235 94.3145142 95.3456268 96.5062866 97.6219559 98.85112 100.087303 101.187363 102.336365 103.534363 104.759308 105.791153 106.763062 107.902786 108.912491 109.979256 111.124908 112.178261 113.445419 114.537048 115.587204 116.657791 117.761063 119.004158 120.17746 121.353516 122.517227 123.694092 124.755356 125.934174 127.091965 128.337616 129.554184 130.82399 132.116119 133.462097 134.973083 136.70871 138.437042 140.307037 142.104416 144.074799 146.431091 148.678955 150.853333 153.172607 155.680618 158.159912 160.828339 163.603806 166.826965 170.210785 173.792114 177.389587 181.849747 186.608887 192.256134 198.613708 206.312332 215.062317 226.244171 240.379456 262.970276 305.320557 936.384338 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2922611 20.574688 20.8356247 21.0977154 21.3261471 21.5385628 21.7931652 22.0055408 22.1880531 22.3709145 22.5762272 22.7328339 22.8959579 23.0956173 23.2645874 23.4675636 23.6503983 23.8324757 24.0367661 24.2430191 24.4467812 24.6249886 24.8059883 24.9843483 25.1788368 25.3455219 25.5289574 25.7021046 25.9033279 26.0983505 26.2964211 26.4871349 26.6760979 26.8782158 27.0745544 27.2387047 27.4608574 27.6578522 27.8478584 28.0584831 28.2589245 28.4593735 28.6629295 28.8767662 29.1049023 29.3395882 29.5661831 29.7591896 30.0038643 30.2436218 30.4972839 30.7266998 30.995224 31.2424507 31.4736423 31.7055168 31.8980713 32.1185913 32.3791771 32.6810722 32.9674072 33.2074509 33.4694977 33.7509804 34.0220795 34.2887878 34.5897903 34.8600235 35.1855774 35.5081787 35.8593597 36.2158356 36.5806885 36.8886299 37.253685 37.6126328 38.0499077 38.4588966 38.9079475 39.3108673 39.7830276 40.3428726 40.839241 41.3960342 42.0359917 42.6833115 43.392868 44.1441765 44.986702 45.9125748 46.9112167 48.1170807 49.4415627 51.0084152 52.8257904 55.2410355 58.1662445 63.4285736 72.0749359 215.283478 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1119308 10.2493486 10.3583794 10.4657297 10.5825539 10.7035742 10.8271656 10.9592857 11.0881252 11.2113628 11.3319035 11.4382238 11.5362587 11.6677618 11.7819309 11.9064636 12.0235453 12.1561737 12.2723866 12.405468 12.5419807 12.6924496 12.8409052 12.9703884 13.110218 13.2591925 13.4046745 13.5290203 13.6639061 13.7964401 13.9302387 14.0796146 14.2418575 14.3969603 14.5532055 14.7182426 14.8844013 15.0552025 15.2330132 15.3822708 15.5577583 15.7371864 15.8952694 16.0539856 16.2545052 16.4370193 16.6213646 16.7748375 16.9494019 17.1354523 17.3591385 17.5802155 17.7493687 17.9605293 18.1815414 18.3994637 18.6347961 18.8456688 19.0651245 19.2879391 19.5210781 19.7559338 19.9933929 20.1973953 20.3949318 20.6128082 20.8376083 21.0749092 21.3234901 21.5855732 21.8066998 22.0296249 22.292614 22.5218544 22.8224106 23.0943756 23.3838959 23.6682014 23.9701424 24.2675838 24.5912018 24.9514885 25.3139305 25.6877861 26.0403519 26.4040108 26.8339176 27.2967358 27.7148113 28.2493286 28.792511 29.4435635 30.1169682 30.8503609 31.7746735 32.9571571 34.7226982 37.3528137 42.3532181 102.012222 ------------------------------ Transdef: Tab for variable 5 1.07930291 2.52641916 2.95187521 3.25406623 3.49118948 3.71749926 3.91213799 4.06428385 4.17039585 4.27480507 4.37613487 4.47750854 4.57635117 4.65293169 4.73686743 4.81426048 4.8884058 4.96338129 5.02981567 5.09645367 5.15781689 5.21866989 5.2737875 5.3303256 5.37750053 5.43584061 5.48614216 5.53083992 5.57711887 5.6234374 5.66616535 5.71590233 5.76093435 5.79925966 5.83740234 5.88386631 5.92427397 5.96232605 6.00179672 6.04368877 6.09045315 6.12400866 6.16601658 6.20484161 6.24228334 6.27569389 6.31596994 6.3540864 6.39988613 6.4389019 6.47671843 6.50895977 6.54832315 6.58816719 6.63276196 6.6668129 6.70969296 6.75032234 6.78778505 6.826159 6.86767864 6.89982605 6.94399452 6.98667336 7.02869463 7.07085037 7.11560202 7.16642714 7.21233749 7.25553703 7.30025196 7.34349728 7.38755131 7.43563557 7.48777103 7.53956509 7.58474159 7.63825989 7.69169807 7.75504208 7.81153822 7.86673832 7.92936993 7.9913516 8.05789375 8.12460995 8.19197655 8.259161 8.33850098 8.42469025 8.50791359 8.60889053 8.72385216 8.8342495 8.98888588 9.15696907 9.36343002 9.61143589 9.98481274 10.6522579 19.048111 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.2200642 25.0425758 26.1151257 27.1649742 27.9067173 28.8050423 29.4874058 30.2649651 30.9190636 31.45784 32.0216446 32.5612946 33.0439034 33.4642792 33.8788147 34.3208923 34.6987991 34.9927368 35.4040108 35.7848206 36.11689 36.4807129 36.8090439 37.1424561 37.5071831 37.8422775 38.1747589 38.4640427 38.7431412 39.0864868 39.4288635 39.7853355 40.1089783 40.4733429 40.8277817 41.158783 41.5065269 41.844635 42.2371368 42.6402588 42.990593 43.3861046 43.7450867 44.095726 44.509594 44.9547806 45.4427567 45.8959122 46.3977737 46.8699951 47.3204193 47.8069191 48.2664452 48.8037872 49.3115997 49.7635803 50.188797 50.6981277 51.2079773 51.7991486 52.3108215 52.819603 53.368309 53.9412918 54.4638443 55.0132408 55.5421295 56.0494652 56.5628471 57.1566086 57.7493172 58.3594589 58.9645996 59.5870667 60.1100655 60.7696915 61.37677 61.9747353 62.6352196 63.3189926 64.0337524 64.7558136 65.5372772 66.3681488 67.2010498 68.0524902 69.0806427 70.1186981 71.3135376 72.7257156 74.110817 75.6444626 77.5302887 79.7805328 82.5775299 85.989502 90.4827042 96.6644058 108.183884 280.646332 ------------------------------ Transdef: Tab for variable 7 30.1267166 32.6331024 33.5311852 34.215023 34.8358574 35.2847633 35.7037239 36.1130981 36.5685654 36.9386597 37.2610435 37.5764618 37.9024353 38.2042542 38.4920273 38.775322 39.0505486 39.3224564 39.667717 39.9261436 40.1821747 40.4616318 40.7764053 41.1215401 41.4669685 41.8497772 42.2389526 42.6381607 43.0090141 43.508873 43.9966202 44.5447159 44.9798279 45.480732 45.9701996 46.6225967 47.2339096 47.8663902 48.5076828 49.291378 50.0595627 50.8123474 51.5186729 52.2527504 52.8946304 53.4727669 54.1379547 54.8207893 55.517746 56.1107254 56.704689 57.3417397 58.0574226 58.7637711 59.4882584 60.1585503 60.8215256 61.4366608 62.1977043 62.896122 63.6002464 64.3525772 65.1842346 66.0645905 67.0155945 68.039856 69.1011581 70.2835922 71.485527 72.6362152 73.9507904 75.2949982 76.7637939 78.1963196 79.4926682 81.1733093 82.7514954 84.4643784 86.1755066 87.7704544 89.7203217 91.641037 93.6309509 95.8355865 98.3748474 100.9832 103.493149 106.313354 109.365234 112.612274 116.291641 120.204391 125.181259 130.680801 137.108063 145.401001 154.558273 166.333771 184.000183 215.739502 664.642578 ------------------------------ Transdef: Tab for variable 8 0.802010298 23.5963707 28.0836411 30.2041416 31.4893513 32.328064 32.8987885 33.387352 33.8662262 34.249424 34.572197 34.9890366 35.3613739 35.687088 36.0485687 36.3431473 36.6161003 36.8993149 37.1670761 37.4258652 37.6801071 37.9288406 38.1396637 38.3868713 38.6495132 38.8717728 39.1218681 39.3599854 39.5917587 39.843483 40.1129761 40.4266052 40.7570343 41.0576553 41.3434792 41.6582603 42.0428467 42.3528748 42.6710854 43.0017624 43.3861046 43.6705856 44.0109138 44.3687439 44.76717 45.1963959 45.5793533 46.0299377 46.5212936 46.9837265 47.4933167 48.0033493 48.450489 48.9237366 49.4647369 49.9641113 50.4284897 50.8933716 51.3916473 51.9008369 52.3844681 52.900856 53.3016853 53.7872849 54.3291664 54.8679504 55.4000473 55.846405 56.3258743 56.8425293 57.3562775 57.894352 58.4668312 58.9959412 59.5295372 60.1164322 60.6986656 61.2704048 61.9404602 62.6411057 63.2423134 63.9155006 64.6432953 65.432312 66.22332 67.0617371 68.1047363 69.1224518 70.3321686 71.5545654 72.8800049 74.456459 76.2296295 78.3269958 80.5165558 83.5699615 87.5637817 92.6602936 100.236664 113.468185 326.868286 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.9165573 64.7906342 66.2845001 67.4354477 68.452301 69.2428055 70.2032776 70.9256134 71.6119843 72.3323898 73.0609436 73.7082367 74.258461 74.9028625 75.3401413 75.9000854 76.4626923 76.9858856 77.467453 78.0703278 78.5502548 78.9814377 79.5685654 79.9814224 80.5803146 81.118988 81.5962677 82.1929016 82.714325 83.3270264 83.89505 84.6423798 85.378418 86.1778717 86.8616943 87.5930862 88.5437012 89.2227325 89.8216553 90.5672302 91.552002 92.3448486 93.2414627 94.1223602 94.9322052 95.8154449 96.6965179 97.668869 98.5778046 99.4366837 100.438713 101.284225 102.130356 103.073784 104.024689 104.873535 105.725632 106.547874 107.386139 108.214546 109.090843 109.946228 110.858368 111.676743 112.516403 113.335541 114.239792 115.137146 115.912354 116.773567 117.60051 118.467911 119.3284 120.172501 121.00367 121.908592 122.817001 123.663445 124.489914 125.442245 126.378899 127.347244 128.324829 129.294952 130.356613 131.475952 132.550201 133.76799 135.009216 136.50705 138.147415 140.147659 142.157227 144.857666 148.413956 152.654388 158.946884 169.514984 192.030197 582.80835 ------------------------------ Transdef: Tab for variable 10 0.02857944 0.963585675 1.26960135 1.47088253 1.62720919 1.75175309 1.86020041 1.94865572 2.03134871 2.09172201 2.15898848 2.21770906 2.26728439 2.31417227 2.35964727 2.40475821 2.44157982 2.47563982 2.50898838 2.53871989 2.56929302 2.59486651 2.61879659 2.64132309 2.66296959 2.68516779 2.70536804 2.72394848 2.74196911 2.75937605 2.77522969 2.79060411 2.80636549 2.82122183 2.83389759 2.84601212 2.85490465 2.86534405 2.87606239 2.88545609 2.89525175 2.90419698 2.9122529 2.92020988 2.92837548 2.93564034 2.94367003 2.95113325 2.95815969 2.96435666 2.97026563 2.97662306 2.98216581 2.98735929 2.99183989 2.99739289 3.00257921 3.0064621 3.01160908 3.01583576 3.02049613 3.02474356 3.02896476 3.03287292 3.03659034 3.04059458 3.0438168 3.04791379 3.05150628 3.05540562 3.05881357 3.06208205 3.06550694 3.06817818 3.07144785 3.07457662 3.07797289 3.08146095 3.08432007 3.08736086 3.09077811 3.09388685 3.09653997 3.09943199 3.10222197 3.10475683 3.10729718 3.10954475 3.11215448 3.11470509 3.11744213 3.11962867 3.12224722 3.12479067 3.12733507 3.12961602 3.13187623 3.13399243 3.13620496 3.13897419 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.0073185E-05 0.00526451971 0.0112814745 0.0182661992 0.0241919458 0.0300316513 0.0373744965 0.0440284014 0.0506167263 0.057790339 0.0633218288 0.0692074299 0.0760284662 0.0829196572 0.08937563 0.095615387 0.102069259 0.108398795 0.114641666 0.120852947 0.127099633 0.133213043 0.139158607 0.144726336 0.151728034 0.156429082 0.161502481 0.166885138 0.173285067 0.179304332 0.184299439 0.189647794 0.195389867 0.200604945 0.206661344 0.211916625 0.217451096 0.223290056 0.229617357 0.235384941 0.241411 0.247555852 0.253026843 0.258754492 0.264222026 0.269862413 0.275952816 0.281662226 0.287544668 0.29315567 0.298588753 0.304948539 0.31122303 0.317873716 0.323704839 0.330190659 0.336524844 0.342939615 0.349259108 0.355842829 0.362355322 0.368941665 0.376322806 0.383191943 0.388452768 0.394407272 0.401020169 0.407798052 0.413745284 0.420302272 0.426438272 0.433026314 0.439387321 0.446042776 0.452098846 0.459075928 0.466274023 0.473144174 0.480049849 0.488140523 0.496929169 0.504769266 0.513847113 0.522453427 0.531459093 0.542125404 0.552986264 0.563747287 0.574039757 0.587532043 0.60017705 0.6149019 0.630427599 0.644901872 0.66155231 0.683560967 0.706613064 0.73853755 0.777179003 0.839796901 1.12256718 ------------------------------ Transdef: Tab for variable 12 0.100055709 0.123936459 0.144091278 0.159560144 0.171219885 0.185932904 0.197589159 0.205731809 0.216397852 0.226605833 0.235889196 0.2451666 0.253533781 0.261383533 0.271132112 0.279575706 0.287150383 0.294917166 0.302920103 0.309752524 0.317525983 0.325733423 0.332821071 0.339421213 0.34615913 0.352944553 0.360695243 0.367932945 0.375276893 0.38211298 0.388656557 0.39476788 0.400580585 0.405252934 0.410319954 0.414423943 0.418824434 0.422906756 0.427259386 0.432024568 0.436548233 0.440416932 0.44481349 0.449092805 0.453536749 0.45772779 0.461205393 0.465386331 0.469602615 0.473743111 0.477667689 0.481904089 0.486286134 0.490798831 0.495204687 0.499041468 0.503023863 0.507852495 0.512170434 0.517121911 0.522092462 0.527072966 0.532085299 0.537389219 0.542413473 0.547343493 0.552449286 0.55734992 0.562417984 0.567755461 0.57313931 0.578803658 0.585079432 0.590931773 0.59604919 0.602461815 0.608679771 0.614396691 0.621394098 0.628226876 0.635411382 0.643304706 0.65188992 0.66081214 0.668372631 0.676905036 0.68588686 0.694616795 0.704485774 0.714205563 0.723291159 0.734189034 0.745346904 0.757594943 0.77216053 0.788516343 0.808493614 0.833453476 0.865635633 0.90523237 1.13241494 ------------------------------ Transdef: Tab for variable 13 20.0082169 21.3223267 22.1206512 22.7177048 23.1949673 23.6523991 24.0481014 24.4514847 24.8706284 25.1894665 25.5224171 25.8756084 26.2146683 26.6112061 26.9335861 27.2436104 27.5417175 27.8617096 28.1739655 28.4672241 28.8124065 29.1379509 29.4436531 29.7145729 30.0032711 30.2782001 30.5606499 30.8246975 31.0548553 31.3508224 31.6042881 31.8839378 32.1730499 32.4277267 32.7142792 33.034317 33.3365479 33.6373749 33.9427071 34.267746 34.5148773 34.7806015 35.0441513 35.3653259 35.6684608 35.977211 36.2700157 36.6093941 36.953373 37.2768097 37.623909 37.942749 38.2628098 38.6151848 38.962471 39.3741531 39.7388763 40.112011 40.5420418 40.9492302 41.3851318 41.8597298 42.3070488 42.6710968 43.1425323 43.6188965 44.1193314 44.5912247 45.1434555 45.6942368 46.2934647 46.8005333 47.3837128 47.9859619 48.6833954 49.3889465 50.1130295 50.8577423 51.6645966 52.4206009 53.2742615 54.1550293 55.1001244 56.0853271 57.1402588 58.2583046 59.4294777 60.8510742 62.2609024 63.9429283 65.4222565 67.3215103 69.4721069 71.7230988 74.5272827 77.6917419 81.8103638 86.4150467 92.4247131 102.354889 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0074406 10.6672688 11.0494499 11.3954506 11.637804 11.9244289 12.2144756 12.4330921 12.6840687 12.9302177 13.2396145 13.4908409 13.6998081 13.9330959 14.1911077 14.4122639 14.6135254 14.835804 15.0664625 15.3053932 15.529253 15.7349501 15.9717455 16.2259941 16.3855591 16.5859756 16.7811852 16.9569283 17.1943665 17.4398003 17.6773186 17.8729668 18.0935097 18.2815056 18.5205498 18.7449646 18.9882221 19.2142467 19.4781857 19.6954536 19.924263 20.1769829 20.4083214 20.6283836 20.8877678 21.1470585 21.4076748 21.6673813 21.89641 22.1185951 22.3738708 22.6455269 22.8969612 23.1563072 23.4020023 23.653616 23.9283123 24.1924248 24.4750137 24.7580891 25.0135231 25.2727623 25.5439243 25.7731133 26.0531216 26.3376083 26.6341228 26.9319115 27.227272 27.5225849 27.8239517 28.1407242 28.4730358 28.8073845 29.2040443 29.6069221 30.0341492 30.4115753 30.8599682 31.3091717 31.7589531 32.2372017 32.7565536 33.2876663 33.8652267 34.4276581 35.0316734 35.7029037 36.4883575 37.271183 38.221405 39.209259 40.3918228 41.6890717 43.3162079 44.9933014 47.1482315 49.9444504 54.1517258 61.3025818 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 59.8 40.5 43.1 16.2 39.4 57.8 45.2 56.2 -29.6 -8.1 -14.2 11.8 18.1 2 59.8 100.0 63.3 55.0 22.2 62.4 94.2 68.1 90.9 -49.0 -17.9 -30.7 32.9 30.4 3 40.5 63.3 100.0 33.6 -1.8 27.2 66.8 48.5 69.3 -17.7 -18.6 -34.0 67.0 17.0 4 43.1 55.0 33.6 100.0 4.3 28.6 56.5 43.8 60.1 -15.3 -22.8 -41.7 15.2 72.3 5 16.2 22.2 -1.8 4.3 100.0 80.8 -5.6 47.6 47.1 27.9 -3.5 -1.7 -8.9 -2.5 6 39.4 62.4 27.2 28.6 80.8 100.0 40.6 73.7 76.2 -5.3 -10.8 -15.8 8.4 12.5 7 57.8 94.2 66.8 56.5 -5.6 40.6 100.0 61.0 78.9 -56.1 -16.5 -30.5 37.6 33.1 8 45.2 68.1 48.5 43.8 47.6 73.7 61.0 100.0 78.6 -10.7 -17.7 -27.6 25.3 25.1 9 56.2 90.9 69.3 60.1 47.1 76.2 78.9 78.6 100.0 -24.2 -21.3 -36.4 38.0 35.0 10 -29.6 -49.0 -17.7 -15.3 27.9 -5.3 -56.1 -10.7 -24.2 100.0 2.6 5.2 -7.2 -6.2 11 -8.1 -17.9 -18.6 -22.8 -3.5 -10.8 -16.5 -17.7 -21.3 2.6 100.0 59.5 -6.0 -13.5 12 -14.2 -30.7 -34.0 -41.7 -1.7 -15.8 -30.5 -27.6 -36.4 5.2 59.5 100.0 -12.4 -19.5 13 11.8 32.9 67.0 15.2 -8.9 8.4 37.6 25.3 38.0 -7.2 -6.0 -12.4 100.0 42.3 14 18.1 30.4 17.0 72.3 -2.5 12.5 33.1 25.1 35.0 -6.2 -13.5 -19.5 42.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 137.960087 TOTAL CORRELATION OF ALL VARIABLES 65.248176 ROUND 1: MAX CORR ( 65.2479444) AFTER KILLING INPUT VARIABLE 6 CONTR 0.173844327 ROUND 2: MAX CORR ( 65.2453058) AFTER KILLING INPUT VARIABLE 11 CONTR 0.58678606 ROUND 3: MAX CORR ( 65.1673791) AFTER KILLING INPUT VARIABLE 8 CONTR 3.18788883 ROUND 4: MAX CORR ( 65.0254693) AFTER KILLING INPUT VARIABLE 2 CONTR 4.29833028 ROUND 5: MAX CORR ( 64.8662043) AFTER KILLING INPUT VARIABLE 14 CONTR 4.54831804 ROUND 6: MAX CORR ( 64.51756) AFTER KILLING INPUT VARIABLE 10 CONTR 6.71631725 ROUND 7: MAX CORR ( 64.2173812) AFTER KILLING INPUT VARIABLE 9 CONTR 6.21638888 ROUND 8: MAX CORR ( 63.3147842) AFTER KILLING INPUT VARIABLE 12 CONTR 10.7289401 ROUND 9: MAX CORR ( 62.5095999) AFTER KILLING INPUT VARIABLE 3 CONTR 10.0653771 ROUND 10: MAX CORR ( 61.931496) AFTER KILLING INPUT VARIABLE 13 CONTR 8.48173807 ROUND 11: MAX CORR ( 60.9549443) AFTER KILLING INPUT VARIABLE 4 CONTR 10.954678 ROUND 12: MAX CORR ( 57.7537313) AFTER KILLING INPUT VARIABLE 5 CONTR 19.49389 LAST REMAINING VARIABLE: 7 total correlation to target: 65.248176 % total significance: 131.632 sigma correlations of single variables to target: variable 2: 59.7697475 % , in sigma: 120.57979 variable 3: 40.4832951 % , in sigma: 81.6712039 variable 4: 43.0892934 % , in sigma: 86.928558 variable 5: 16.2497915 % , in sigma: 32.7824115 variable 6: 39.441408 % , in sigma: 79.5692957 variable 7: 57.7537313 % , in sigma: 116.512669 variable 8: 45.205102 % , in sigma: 91.197001 variable 9: 56.2093836 % , in sigma: 113.397094 variable 10: -29.5968681 % , in sigma: 59.7088712 variable 11: -8.05419696 % , in sigma: 16.2485776 variable 12: -14.1561072 % , in sigma: 28.5586021 variable 13: 11.8128576 % , in sigma: 23.8313186 variable 14: 18.0561624 % , in sigma: 36.4265932 variables sorted by significance: 1 most relevant variable 7 corr 57.7537308 , in sigma: 116.512668 2 most relevant variable 5 corr 19.4938908 , in sigma: 39.3270737 3 most relevant variable 4 corr 10.9546776 , in sigma: 22.1000219 4 most relevant variable 13 corr 8.48173809 , in sigma: 17.1111013 5 most relevant variable 3 corr 10.0653772 , in sigma: 20.3059429 6 most relevant variable 12 corr 10.72894 , in sigma: 21.6446177 7 most relevant variable 9 corr 6.2163887 , in sigma: 12.540974 8 most relevant variable 10 corr 6.71631718 , in sigma: 13.5495322 9 most relevant variable 14 corr 4.54831791 , in sigma: 9.17579952 10 most relevant variable 2 corr 4.29833031 , in sigma: 8.67147326 11 most relevant variable 8 corr 3.18788886 , in sigma: 6.43126308 12 most relevant variable 11 corr 0.586786032 , in sigma: 1.1837851 13 most relevant variable 6 corr 0.173844323 , in sigma: 0.350714414 global correlations between input variables: variable 2: 99.1040062 % variable 3: 93.3711866 % variable 4: 91.6254381 % variable 5: 95.0098594 % variable 6: 93.9639106 % variable 7: 98.6201024 % variable 8: 86.8960162 % variable 9: 98.8429667 % variable 10: 71.896484 % variable 11: 60.331274 % variable 12: 69.4884681 % variable 13: 85.8987638 % variable 14: 88.0569257 % significance loss when removing single variables: variable 2: corr = 5.14038205 % , sigma = 10.3702327 variable 3: corr = 12.5644746 % , sigma = 25.3476345 variable 4: corr = 15.152656 % , sigma = 30.5690447 variable 5: corr = 10.4052815 % , sigma = 20.9916674 variable 6: corr = 0.173844327 % , sigma = 0.350714423 variable 7: corr = 4.29326569 % , sigma = 8.66125589 variable 8: corr = 3.01666776 % , sigma = 6.08584077 variable 9: corr = 8.510963 % , sigma = 17.1700597 variable 10: corr = 5.94829716 % , sigma = 12.0001247 variable 11: corr = 0.583065438 % , sigma = 1.17627916 variable 12: corr = 9.01404788 % , sigma = 18.1849857 variable 13: corr = 6.18197859 % , sigma = 12.4715548 variable 14: corr = 4.56537597 % , sigma = 9.21021252 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 28.1949596 sigma out 15 active outputs RANK 2 NODE 9 --> 24.913559 sigma out 15 active outputs RANK 3 NODE 1 --> 19.1341553 sigma out 15 active outputs RANK 4 NODE 8 --> 17.4889984 sigma out 15 active outputs RANK 5 NODE 10 --> 15.1010189 sigma out 15 active outputs RANK 6 NODE 12 --> 14.9017305 sigma out 15 active outputs RANK 7 NODE 7 --> 13.4239006 sigma out 15 active outputs RANK 8 NODE 11 --> 13.3785591 sigma out 15 active outputs RANK 9 NODE 4 --> 12.9616623 sigma out 15 active outputs RANK 10 NODE 5 --> 11.0443964 sigma out 15 active outputs RANK 11 NODE 2 --> 10.6292114 sigma out 15 active outputs RANK 12 NODE 3 --> 10.0580883 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 32.8992882 sigma in 12act. ( 33.2879257 sig out 1act.) RANK 2 NODE 5 --> 27.0480156 sigma in 12act. ( 29.6577168 sig out 1act.) RANK 3 NODE 3 --> 26.0363426 sigma in 12act. ( 26.8671112 sig out 1act.) RANK 4 NODE 4 --> 19.7534389 sigma in 12act. ( 21.3974323 sig out 1act.) RANK 5 NODE 11 --> 11.0140343 sigma in 12act. ( 11.3073301 sig out 1act.) RANK 6 NODE 2 --> 10.1574078 sigma in 12act. ( 10.2952738 sig out 1act.) RANK 7 NODE 8 --> 9.20348263 sigma in 12act. ( 3.10384774 sig out 1act.) RANK 8 NODE 9 --> 7.89660072 sigma in 12act. ( 12.4877548 sig out 1act.) RANK 9 NODE 14 --> 7.45248318 sigma in 12act. ( 8.441576 sig out 1act.) RANK 10 NODE 7 --> 6.32182789 sigma in 12act. ( 9.21414948 sig out 1act.) RANK 11 NODE 13 --> 4.43016005 sigma in 12act. ( 4.73384714 sig out 1act.) RANK 12 NODE 1 --> 3.86583614 sigma in 12act. ( 1.76238728 sig out 1act.) RANK 13 NODE 15 --> 2.5991838 sigma in 12act. ( 2.04266286 sig out 1act.) RANK 14 NODE 12 --> 2.42051482 sigma in 12act. ( 0.776051462 sig out 1act.) RANK 15 NODE 10 --> 2.18159771 sigma in 12act. ( 0.694905579 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 33.2879257 sigma out 1act.( 32.8992882 sig in 12act.) RANK 2 NODE 5 --> 29.6577168 sigma out 1act.( 27.0480156 sig in 12act.) RANK 3 NODE 3 --> 26.8671112 sigma out 1act.( 26.0363426 sig in 12act.) RANK 4 NODE 4 --> 21.3974323 sigma out 1act.( 19.7534389 sig in 12act.) RANK 5 NODE 9 --> 12.4877548 sigma out 1act.( 7.89660072 sig in 12act.) RANK 6 NODE 11 --> 11.3073301 sigma out 1act.( 11.0140343 sig in 12act.) RANK 7 NODE 2 --> 10.2952738 sigma out 1act.( 10.1574078 sig in 12act.) RANK 8 NODE 7 --> 9.21414948 sigma out 1act.( 6.32182789 sig in 12act.) RANK 9 NODE 14 --> 8.441576 sigma out 1act.( 7.45248318 sig in 12act.) RANK 10 NODE 13 --> 4.73384714 sigma out 1act.( 4.43016005 sig in 12act.) RANK 11 NODE 8 --> 3.10384774 sigma out 1act.( 9.20348263 sig in 12act.) RANK 12 NODE 15 --> 2.04266286 sigma out 1act.( 2.5991838 sig in 12act.) RANK 13 NODE 1 --> 1.76238728 sigma out 1act.( 3.86583614 sig in 12act.) RANK 14 NODE 12 --> 0.776051462 sigma out 1act.( 2.42051482 sig in 12act.) RANK 15 NODE 10 --> 0.694905579 sigma out 1act.( 2.18159771 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.2675934 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 27.2538986 sigma out 15 active outputs RANK 2 NODE 9 --> 24.1670265 sigma out 15 active outputs RANK 3 NODE 1 --> 19.4029446 sigma out 15 active outputs RANK 4 NODE 11 --> 19.2937107 sigma out 15 active outputs RANK 5 NODE 8 --> 17.4301758 sigma out 15 active outputs RANK 6 NODE 12 --> 16.3722363 sigma out 15 active outputs RANK 7 NODE 10 --> 15.9878149 sigma out 15 active outputs RANK 8 NODE 4 --> 13.7392273 sigma out 15 active outputs RANK 9 NODE 5 --> 12.9259586 sigma out 15 active outputs RANK 10 NODE 7 --> 12.1742115 sigma out 15 active outputs RANK 11 NODE 2 --> 10.8617926 sigma out 15 active outputs RANK 12 NODE 3 --> 10.7256479 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 29.7570019 sigma in 12act. ( 30.0744381 sig out 1act.) RANK 2 NODE 5 --> 27.346468 sigma in 12act. ( 28.9061089 sig out 1act.) RANK 3 NODE 3 --> 24.3938522 sigma in 12act. ( 25.0684357 sig out 1act.) RANK 4 NODE 4 --> 19.856472 sigma in 12act. ( 20.1214542 sig out 1act.) RANK 5 NODE 9 --> 15.8831053 sigma in 12act. ( 13.4375105 sig out 1act.) RANK 6 NODE 7 --> 12.6397743 sigma in 12act. ( 10.6623678 sig out 1act.) RANK 7 NODE 11 --> 12.0050488 sigma in 12act. ( 10.6792078 sig out 1act.) RANK 8 NODE 2 --> 11.0771437 sigma in 12act. ( 9.90610981 sig out 1act.) RANK 9 NODE 14 --> 9.02918148 sigma in 12act. ( 8.22343826 sig out 1act.) RANK 10 NODE 8 --> 7.03573561 sigma in 12act. ( 1.38949394 sig out 1act.) RANK 11 NODE 15 --> 6.83402157 sigma in 12act. ( 2.80915642 sig out 1act.) RANK 12 NODE 10 --> 6.70891857 sigma in 12act. ( 0.607364058 sig out 1act.) RANK 13 NODE 1 --> 6.55807209 sigma in 12act. ( 1.31534934 sig out 1act.) RANK 14 NODE 13 --> 6.41885471 sigma in 12act. ( 5.17973375 sig out 1act.) RANK 15 NODE 12 --> 5.62397289 sigma in 12act. ( 0.573949218 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 30.0744381 sigma out 1act.( 29.7570019 sig in 12act.) RANK 2 NODE 5 --> 28.9061089 sigma out 1act.( 27.346468 sig in 12act.) RANK 3 NODE 3 --> 25.0684357 sigma out 1act.( 24.3938522 sig in 12act.) RANK 4 NODE 4 --> 20.1214542 sigma out 1act.( 19.856472 sig in 12act.) RANK 5 NODE 9 --> 13.4375105 sigma out 1act.( 15.8831053 sig in 12act.) RANK 6 NODE 11 --> 10.6792078 sigma out 1act.( 12.0050488 sig in 12act.) RANK 7 NODE 7 --> 10.6623678 sigma out 1act.( 12.6397743 sig in 12act.) RANK 8 NODE 2 --> 9.90610981 sigma out 1act.( 11.0771437 sig in 12act.) RANK 9 NODE 14 --> 8.22343826 sigma out 1act.( 9.02918148 sig in 12act.) RANK 10 NODE 13 --> 5.17973375 sigma out 1act.( 6.41885471 sig in 12act.) RANK 11 NODE 15 --> 2.80915642 sigma out 1act.( 6.83402157 sig in 12act.) RANK 12 NODE 8 --> 1.38949394 sigma out 1act.( 7.03573561 sig in 12act.) RANK 13 NODE 1 --> 1.31534934 sigma out 1act.( 6.55807209 sig in 12act.) RANK 14 NODE 10 --> 0.607364058 sigma out 1act.( 6.70891857 sig in 12act.) RANK 15 NODE 12 --> 0.573949218 sigma out 1act.( 5.62397289 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 58.1933708 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.417099059 *** contribution from regularisation: 0.00384877622 *** contribution from error: -0.42094785 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.462751627 *** contribution from regularisation: 0.00225191098 *** contribution from error: -0.46500355 *********************************************** -----------------> Test sample ENTER BFGS code START -46003.2873 -0.702845931 -0.208651081 EXIT FROM BFGS code FG_START 0. -0.702845931 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.492937952 *** contribution from regularisation: 0.00231300271 *** contribution from error: -0.49525094 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48993.5946 -0.702845931 -67.5685501 EXIT FROM BFGS code FG_LNSRCH 0. -0.715610504 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.523897827 *** contribution from regularisation: 0.00297817681 *** contribution from error: -0.526876032 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52070.7263 -0.715610504 66.7652054 EXIT FROM BFGS code NEW_X -52070.7263 -0.715610504 66.7652054 ENTER BFGS code NEW_X -52070.7263 -0.715610504 66.7652054 EXIT FROM BFGS code FG_LNSRCH 0. -0.703271449 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.525740087 *** contribution from regularisation: 0.00297823967 *** contribution from error: -0.528718352 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52253.8318 -0.703271449 21.5090599 EXIT FROM BFGS code NEW_X -52253.8318 -0.703271449 21.5090599 ENTER BFGS code NEW_X -52253.8318 -0.703271449 21.5090599 EXIT FROM BFGS code FG_LNSRCH 0. -0.695552647 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.527038574 *** contribution from regularisation: 0.00288744224 *** contribution from error: -0.529926002 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52382.8887 -0.695552647 18.617363 EXIT FROM BFGS code NEW_X -52382.8887 -0.695552647 18.617363 ENTER BFGS code NEW_X -52382.8887 -0.695552647 18.617363 EXIT FROM BFGS code FG_LNSRCH 0. -0.679929197 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.527523935 *** contribution from regularisation: 0.00282149389 *** contribution from error: -0.53034544 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52431.1316 -0.679929197 11.4282217 EXIT FROM BFGS code NEW_X -52431.1316 -0.679929197 11.4282217 ENTER BFGS code NEW_X -52431.1316 -0.679929197 11.4282217 EXIT FROM BFGS code FG_LNSRCH 0. -0.644417405 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.528416157 *** contribution from regularisation: 0.00277588237 *** contribution from error: -0.531192064 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52519.8124 -0.644417405 18.2143345 EXIT FROM BFGS code NEW_X -52519.8124 -0.644417405 18.2143345 ENTER BFGS code NEW_X -52519.8124 -0.644417405 18.2143345 EXIT FROM BFGS code FG_LNSRCH 0. -0.424846888 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.528042018 *** contribution from regularisation: 0.00351051474 *** contribution from error: -0.531552553 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52482.6249 -0.424846888 9.94820404 EXIT FROM BFGS code FG_LNSRCH 0. -0.535615325 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 47.7387428 sigma out 15 active outputs RANK 2 NODE 3 --> 24.7444897 sigma out 15 active outputs RANK 3 NODE 1 --> 24.4765244 sigma out 15 active outputs RANK 4 NODE 9 --> 20.8188572 sigma out 15 active outputs RANK 5 NODE 10 --> 16.2242126 sigma out 15 active outputs RANK 6 NODE 7 --> 12.3729954 sigma out 15 active outputs RANK 7 NODE 8 --> 11.8367958 sigma out 15 active outputs RANK 8 NODE 12 --> 11.6290922 sigma out 15 active outputs RANK 9 NODE 6 --> 11.2241774 sigma out 15 active outputs RANK 10 NODE 5 --> 9.21768761 sigma out 15 active outputs RANK 11 NODE 2 --> 8.00454998 sigma out 15 active outputs RANK 12 NODE 4 --> 7.78434896 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 52.6966515 sigma in 12act. ( 60.2483902 sig out 1act.) RANK 2 NODE 7 --> 21.2020397 sigma in 12act. ( 16.9106216 sig out 1act.) RANK 3 NODE 3 --> 17.8960018 sigma in 12act. ( 17.9646378 sig out 1act.) RANK 4 NODE 13 --> 15.6580076 sigma in 12act. ( 13.6779871 sig out 1act.) RANK 5 NODE 5 --> 15.6263962 sigma in 12act. ( 14.1896973 sig out 1act.) RANK 6 NODE 15 --> 14.8789797 sigma in 12act. ( 12.3717775 sig out 1act.) RANK 7 NODE 8 --> 13.5425425 sigma in 12act. ( 12.3447523 sig out 1act.) RANK 8 NODE 6 --> 13.4613028 sigma in 12act. ( 11.3389902 sig out 1act.) RANK 9 NODE 11 --> 10.7999659 sigma in 12act. ( 8.99155331 sig out 1act.) RANK 10 NODE 14 --> 8.83281326 sigma in 12act. ( 7.42061901 sig out 1act.) RANK 11 NODE 2 --> 5.53673029 sigma in 12act. ( 3.63470578 sig out 1act.) RANK 12 NODE 10 --> 5.48302174 sigma in 12act. ( 4.24561071 sig out 1act.) RANK 13 NODE 4 --> 5.25889015 sigma in 12act. ( 3.36333489 sig out 1act.) RANK 14 NODE 1 --> 4.88825083 sigma in 12act. ( 4.02750492 sig out 1act.) RANK 15 NODE 12 --> 4.69829035 sigma in 12act. ( 3.5831089 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 60.2483902 sigma out 1act.( 52.6966515 sig in 12act.) RANK 2 NODE 3 --> 17.9646378 sigma out 1act.( 17.8960018 sig in 12act.) RANK 3 NODE 7 --> 16.9106216 sigma out 1act.( 21.2020397 sig in 12act.) RANK 4 NODE 5 --> 14.1896973 sigma out 1act.( 15.6263962 sig in 12act.) RANK 5 NODE 13 --> 13.6779871 sigma out 1act.( 15.6580076 sig in 12act.) RANK 6 NODE 15 --> 12.3717775 sigma out 1act.( 14.8789797 sig in 12act.) RANK 7 NODE 8 --> 12.3447523 sigma out 1act.( 13.5425425 sig in 12act.) RANK 8 NODE 6 --> 11.3389902 sigma out 1act.( 13.4613028 sig in 12act.) RANK 9 NODE 11 --> 8.99155331 sigma out 1act.( 10.7999659 sig in 12act.) RANK 10 NODE 14 --> 7.42061901 sigma out 1act.( 8.83281326 sig in 12act.) RANK 11 NODE 10 --> 4.24561071 sigma out 1act.( 5.48302174 sig in 12act.) RANK 12 NODE 1 --> 4.02750492 sigma out 1act.( 4.88825083 sig in 12act.) RANK 13 NODE 2 --> 3.63470578 sigma out 1act.( 5.53673029 sig in 12act.) RANK 14 NODE 12 --> 3.5831089 sigma out 1act.( 4.69829035 sig in 12act.) RANK 15 NODE 4 --> 3.36333489 sigma out 1act.( 5.25889015 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 72.5847702 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.530639946 *** contribution from regularisation: 0.00248428877 *** contribution from error: -0.533124208 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52740.8369 -0.535615325 10.3551226 EXIT FROM BFGS code NEW_X -52740.8369 -0.535615325 10.3551226 ENTER BFGS code NEW_X -52740.8369 -0.535615325 10.3551226 EXIT FROM BFGS code FG_LNSRCH 0. -0.409913689 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.531336129 *** contribution from regularisation: 0.00371067412 *** contribution from error: -0.535046816 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52810.032 -0.409913689 15.2202425 EXIT FROM BFGS code NEW_X -52810.032 -0.409913689 15.2202425 ENTER BFGS code NEW_X -52810.032 -0.409913689 15.2202425 EXIT FROM BFGS code FG_LNSRCH 0. -0.416919589 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.532858491 *** contribution from regularisation: 0.00283418316 *** contribution from error: -0.535692692 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52961.3354 -0.416919589 4.08284426 EXIT FROM BFGS code NEW_X -52961.3354 -0.416919589 4.08284426 ENTER BFGS code NEW_X -52961.3354 -0.416919589 4.08284426 EXIT FROM BFGS code FG_LNSRCH 0. -0.431223094 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.533100545 *** contribution from regularisation: 0.0029168711 *** contribution from error: -0.536017418 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52985.3965 -0.431223094 6.35641623 EXIT FROM BFGS code NEW_X -52985.3965 -0.431223094 6.35641623 ENTER BFGS code NEW_X -52985.3965 -0.431223094 6.35641623 EXIT FROM BFGS code FG_LNSRCH 0. -0.415181071 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.533568084 *** contribution from regularisation: 0.00299617765 *** contribution from error: -0.536564291 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53031.8635 -0.415181071 11.1299372 EXIT FROM BFGS code NEW_X -53031.8635 -0.415181071 11.1299372 ENTER BFGS code NEW_X -53031.8635 -0.415181071 11.1299372 EXIT FROM BFGS code FG_LNSRCH 0. -0.383478701 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.534016609 *** contribution from regularisation: 0.00307893194 *** contribution from error: -0.537095547 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53076.4469 -0.383478701 12.088562 EXIT FROM BFGS code NEW_X -53076.4469 -0.383478701 12.088562 ENTER BFGS code NEW_X -53076.4469 -0.383478701 12.088562 EXIT FROM BFGS code FG_LNSRCH 0. -0.336178243 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.534173667 *** contribution from regularisation: 0.00324842753 *** contribution from error: -0.537422121 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53092.0556 -0.336178243 8.62012863 EXIT FROM BFGS code NEW_X -53092.0556 -0.336178243 8.62012863 ENTER BFGS code NEW_X -53092.0556 -0.336178243 8.62012863 EXIT FROM BFGS code FG_LNSRCH 0. -0.343953609 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.534570515 *** contribution from regularisation: 0.00305433362 *** contribution from error: -0.537624836 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53131.4975 -0.343953609 9.18227196 EXIT FROM BFGS code NEW_X -53131.4975 -0.343953609 9.18227196 ENTER BFGS code NEW_X -53131.4975 -0.343953609 9.18227196 EXIT FROM BFGS code FG_LNSRCH 0. -0.338065445 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.534653902 *** contribution from regularisation: 0.00311028003 *** contribution from error: -0.537764192 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53139.7889 -0.338065445 8.84060955 EXIT FROM BFGS code NEW_X -53139.7889 -0.338065445 8.84060955 ENTER BFGS code NEW_X -53139.7889 -0.338065445 8.84060955 EXIT FROM BFGS code FG_LNSRCH 0. -0.308349133 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.534893513 *** contribution from regularisation: 0.00316061405 *** contribution from error: -0.538054109 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53163.6025 -0.308349133 7.77029419 EXIT FROM BFGS code NEW_X -53163.6025 -0.308349133 7.77029419 ENTER BFGS code NEW_X -53163.6025 -0.308349133 7.77029419 EXIT FROM BFGS code FG_LNSRCH 0. -0.27968955 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 87.1716766 sigma out 15 active outputs RANK 2 NODE 3 --> 51.9748192 sigma out 15 active outputs RANK 3 NODE 1 --> 34.2298775 sigma out 15 active outputs RANK 4 NODE 9 --> 21.5747566 sigma out 15 active outputs RANK 5 NODE 12 --> 20.9696102 sigma out 15 active outputs RANK 6 NODE 8 --> 20.1509094 sigma out 15 active outputs RANK 7 NODE 10 --> 15.4580917 sigma out 15 active outputs RANK 8 NODE 2 --> 14.9175138 sigma out 15 active outputs RANK 9 NODE 7 --> 12.1046085 sigma out 15 active outputs RANK 10 NODE 5 --> 8.78274345 sigma out 15 active outputs RANK 11 NODE 6 --> 7.76623297 sigma out 15 active outputs RANK 12 NODE 4 --> 7.5069294 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 107.984024 sigma in 12act. ( 117.530411 sig out 1act.) RANK 2 NODE 3 --> 18.0217667 sigma in 12act. ( 18.99827 sig out 1act.) RANK 3 NODE 8 --> 17.4836674 sigma in 12act. ( 19.8880444 sig out 1act.) RANK 4 NODE 7 --> 15.9712591 sigma in 12act. ( 13.6334248 sig out 1act.) RANK 5 NODE 15 --> 15.2343731 sigma in 12act. ( 15.8530703 sig out 1act.) RANK 6 NODE 6 --> 13.3714705 sigma in 12act. ( 13.997633 sig out 1act.) RANK 7 NODE 5 --> 12.3306904 sigma in 12act. ( 10.5438709 sig out 1act.) RANK 8 NODE 13 --> 11.8906794 sigma in 12act. ( 9.30384254 sig out 1act.) RANK 9 NODE 11 --> 9.6497097 sigma in 12act. ( 9.45283413 sig out 1act.) RANK 10 NODE 14 --> 8.73818684 sigma in 12act. ( 8.71206665 sig out 1act.) RANK 11 NODE 1 --> 7.11577749 sigma in 12act. ( 7.77026749 sig out 1act.) RANK 12 NODE 12 --> 7.0761137 sigma in 12act. ( 7.47993231 sig out 1act.) RANK 13 NODE 10 --> 6.31801176 sigma in 12act. ( 5.91314125 sig out 1act.) RANK 14 NODE 4 --> 3.7623992 sigma in 12act. ( 2.52598643 sig out 1act.) RANK 15 NODE 2 --> 3.22043347 sigma in 12act. ( 0.127505884 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 117.530411 sigma out 1act.( 107.984024 sig in 12act.) RANK 2 NODE 8 --> 19.8880444 sigma out 1act.( 17.4836674 sig in 12act.) RANK 3 NODE 3 --> 18.99827 sigma out 1act.( 18.0217667 sig in 12act.) RANK 4 NODE 15 --> 15.8530703 sigma out 1act.( 15.2343731 sig in 12act.) RANK 5 NODE 6 --> 13.997633 sigma out 1act.( 13.3714705 sig in 12act.) RANK 6 NODE 7 --> 13.6334248 sigma out 1act.( 15.9712591 sig in 12act.) RANK 7 NODE 5 --> 10.5438709 sigma out 1act.( 12.3306904 sig in 12act.) RANK 8 NODE 11 --> 9.45283413 sigma out 1act.( 9.6497097 sig in 12act.) RANK 9 NODE 13 --> 9.30384254 sigma out 1act.( 11.8906794 sig in 12act.) RANK 10 NODE 14 --> 8.71206665 sigma out 1act.( 8.73818684 sig in 12act.) RANK 11 NODE 1 --> 7.77026749 sigma out 1act.( 7.11577749 sig in 12act.) RANK 12 NODE 12 --> 7.47993231 sigma out 1act.( 7.0761137 sig in 12act.) RANK 13 NODE 10 --> 5.91314125 sigma out 1act.( 6.31801176 sig in 12act.) RANK 14 NODE 4 --> 2.52598643 sigma out 1act.( 3.7623992 sig in 12act.) RANK 15 NODE 2 --> 0.127505884 sigma out 1act.( 3.22043347 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 125.394058 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.535081923 *** contribution from regularisation: 0.00313964929 *** contribution from error: -0.538221598 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53182.3247 -0.27968955 6.81324482 EXIT FROM BFGS code NEW_X -53182.3247 -0.27968955 6.81324482 ENTER BFGS code NEW_X -53182.3247 -0.27968955 6.81324482 EXIT FROM BFGS code FG_LNSRCH 0. -0.24160178 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.535176337 *** contribution from regularisation: 0.00313332351 *** contribution from error: -0.538309634 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53191.7141 -0.24160178 6.15107775 EXIT FROM BFGS code NEW_X -53191.7141 -0.24160178 6.15107775 ENTER BFGS code NEW_X -53191.7141 -0.24160178 6.15107775 EXIT FROM BFGS code FG_LNSRCH 0. -0.235469103 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.535294056 *** contribution from regularisation: 0.00312036718 *** contribution from error: -0.538414419 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53203.4136 -0.235469103 6.16723776 EXIT FROM BFGS code NEW_X -53203.4136 -0.235469103 6.16723776 ENTER BFGS code NEW_X -53203.4136 -0.235469103 6.16723776 EXIT FROM BFGS code FG_LNSRCH 0. -0.19554171 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.535519004 *** contribution from regularisation: 0.00297581311 *** contribution from error: -0.538494825 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53225.769 -0.19554171 5.96234322 EXIT FROM BFGS code NEW_X -53225.769 -0.19554171 5.96234322 ENTER BFGS code NEW_X -53225.769 -0.19554171 5.96234322 EXIT FROM BFGS code FG_LNSRCH 0. -0.177986503 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.535413444 *** contribution from regularisation: 0.00309655629 *** contribution from error: -0.538510025 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53215.2783 -0.177986503 5.22578907 EXIT FROM BFGS code FG_LNSRCH 0. -0.192527473 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.535209179 *** contribution from regularisation: 0.00330530712 *** contribution from error: -0.538514495 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53194.9779 -0.192527473 5.76306725 EXIT FROM BFGS code FG_LNSRCH 0. -0.195480153 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.535309434 *** contribution from regularisation: 0.00318582309 *** contribution from error: -0.538495243 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53204.9378 -0.195480153 5.90565586 EXIT FROM BFGS code FG_LNSRCH 0. -0.195541665 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.535310805 *** contribution from regularisation: 0.00318401377 *** contribution from error: -0.538494825 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53205.0758 -0.195541665 5.91082001 EXIT FROM BFGS code FG_LNSRCH 0. -0.19554171 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.535317659 *** contribution from regularisation: 0.00317714363 *** contribution from error: -0.538494825 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53205.7586 -0.19554171 5.89083099 EXIT FROM BFGS code FG_LNSRCH 0. -0.19554171 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.535319984 *** contribution from regularisation: 0.00317481044 *** contribution from error: -0.538494766 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53205.9905 -0.19554171 5.91482353 EXIT FROM BFGS code FG_LNSRCH 0. -0.19554171 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 99.5030365 sigma out 15 active outputs RANK 2 NODE 3 --> 55.6620407 sigma out 15 active outputs RANK 3 NODE 1 --> 36.4787216 sigma out 15 active outputs RANK 4 NODE 8 --> 26.9320145 sigma out 15 active outputs RANK 5 NODE 12 --> 26.3743954 sigma out 15 active outputs RANK 6 NODE 9 --> 19.0082645 sigma out 15 active outputs RANK 7 NODE 10 --> 15.5881691 sigma out 15 active outputs RANK 8 NODE 7 --> 13.4318686 sigma out 15 active outputs RANK 9 NODE 2 --> 12.540554 sigma out 15 active outputs RANK 10 NODE 5 --> 8.90110397 sigma out 15 active outputs RANK 11 NODE 4 --> 8.58823204 sigma out 15 active outputs RANK 12 NODE 6 --> 7.00548744 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 121.810944 sigma in 12act. ( 131.418518 sig out 1act.) RANK 2 NODE 8 --> 19.7940025 sigma in 12act. ( 22.1616936 sig out 1act.) RANK 3 NODE 3 --> 17.1769714 sigma in 12act. ( 18.1742878 sig out 1act.) RANK 4 NODE 7 --> 16.13484 sigma in 12act. ( 14.4553175 sig out 1act.) RANK 5 NODE 15 --> 14.7288094 sigma in 12act. ( 16.0213108 sig out 1act.) RANK 6 NODE 6 --> 14.0960808 sigma in 12act. ( 15.0263691 sig out 1act.) RANK 7 NODE 5 --> 13.5945644 sigma in 12act. ( 12.2410011 sig out 1act.) RANK 8 NODE 11 --> 10.8749142 sigma in 12act. ( 11.737278 sig out 1act.) RANK 9 NODE 13 --> 10.2884569 sigma in 12act. ( 8.28791809 sig out 1act.) RANK 10 NODE 14 --> 10.2637367 sigma in 12act. ( 11.2402401 sig out 1act.) RANK 11 NODE 12 --> 8.19837952 sigma in 12act. ( 8.99629498 sig out 1act.) RANK 12 NODE 1 --> 7.49919176 sigma in 12act. ( 8.45946693 sig out 1act.) RANK 13 NODE 10 --> 6.20439529 sigma in 12act. ( 6.00864029 sig out 1act.) RANK 14 NODE 4 --> 3.19101977 sigma in 12act. ( 2.1350832 sig out 1act.) RANK 15 NODE 2 --> 2.77074528 sigma in 12act. ( 0.131132752 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 131.418518 sigma out 1act.( 121.810944 sig in 12act.) RANK 2 NODE 8 --> 22.1616936 sigma out 1act.( 19.7940025 sig in 12act.) RANK 3 NODE 3 --> 18.1742878 sigma out 1act.( 17.1769714 sig in 12act.) RANK 4 NODE 15 --> 16.0213108 sigma out 1act.( 14.7288094 sig in 12act.) RANK 5 NODE 6 --> 15.0263691 sigma out 1act.( 14.0960808 sig in 12act.) RANK 6 NODE 7 --> 14.4553175 sigma out 1act.( 16.13484 sig in 12act.) RANK 7 NODE 5 --> 12.2410011 sigma out 1act.( 13.5945644 sig in 12act.) RANK 8 NODE 11 --> 11.737278 sigma out 1act.( 10.8749142 sig in 12act.) RANK 9 NODE 14 --> 11.2402401 sigma out 1act.( 10.2637367 sig in 12act.) RANK 10 NODE 12 --> 8.99629498 sigma out 1act.( 8.19837952 sig in 12act.) RANK 11 NODE 1 --> 8.45946693 sigma out 1act.( 7.49919176 sig in 12act.) RANK 12 NODE 13 --> 8.28791809 sigma out 1act.( 10.2884569 sig in 12act.) RANK 13 NODE 10 --> 6.00864029 sigma out 1act.( 6.20439529 sig in 12act.) RANK 14 NODE 4 --> 2.1350832 sigma out 1act.( 3.19101977 sig in 12act.) RANK 15 NODE 2 --> 0.131132752 sigma out 1act.( 2.77074528 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 139.49736 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.535308301 *** contribution from regularisation: 0.00318653649 *** contribution from error: -0.538494825 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53204.825 -0.19554171 5.91834927 EXIT FROM BFGS code NEW_X -53204.825 -0.19554171 5.91834927 ENTER BFGS code NEW_X -53204.825 -0.19554171 5.91834927 EXIT FROM BFGS code CONVERGENC -53204.825 -0.19554171 5.91834927 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 154.053391 sigma out 15 active outputs RANK 2 NODE 3 --> 83.7019348 sigma out 15 active outputs RANK 3 NODE 1 --> 55.6959572 sigma out 15 active outputs RANK 4 NODE 8 --> 40.9360313 sigma out 15 active outputs RANK 5 NODE 12 --> 40.4416161 sigma out 15 active outputs RANK 6 NODE 9 --> 28.4662647 sigma out 15 active outputs RANK 7 NODE 10 --> 23.3808498 sigma out 15 active outputs RANK 8 NODE 7 --> 19.7493401 sigma out 15 active outputs RANK 9 NODE 2 --> 18.5031853 sigma out 15 active outputs RANK 10 NODE 5 --> 13.2260771 sigma out 15 active outputs RANK 11 NODE 4 --> 12.8647795 sigma out 15 active outputs RANK 12 NODE 6 --> 10.3914948 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 187.52269 sigma in 12act. ( 205.009598 sig out 1act.) RANK 2 NODE 8 --> 29.7980747 sigma in 12act. ( 34.5599251 sig out 1act.) RANK 3 NODE 3 --> 25.732645 sigma in 12act. ( 28.2071743 sig out 1act.) RANK 4 NODE 7 --> 23.8111095 sigma in 12act. ( 22.7517509 sig out 1act.) RANK 5 NODE 15 --> 22.1376266 sigma in 12act. ( 24.9839325 sig out 1act.) RANK 6 NODE 6 --> 21.0518436 sigma in 12act. ( 23.164669 sig out 1act.) RANK 7 NODE 5 --> 19.5855732 sigma in 12act. ( 19.2398052 sig out 1act.) RANK 8 NODE 11 --> 15.9795446 sigma in 12act. ( 18.0191631 sig out 1act.) RANK 9 NODE 14 --> 15.0670815 sigma in 12act. ( 17.1955242 sig out 1act.) RANK 10 NODE 13 --> 14.8375254 sigma in 12act. ( 12.845685 sig out 1act.) RANK 11 NODE 12 --> 12.3890228 sigma in 12act. ( 13.8359118 sig out 1act.) RANK 12 NODE 1 --> 11.2468882 sigma in 12act. ( 13.1289349 sig out 1act.) RANK 13 NODE 10 --> 9.09515762 sigma in 12act. ( 9.23262978 sig out 1act.) RANK 14 NODE 4 --> 4.24229956 sigma in 12act. ( 3.2242198 sig out 1act.) RANK 15 NODE 2 --> 2.77626038 sigma in 12act. ( 0.201861918 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 205.009598 sigma out 1act.( 187.52269 sig in 12act.) RANK 2 NODE 8 --> 34.5599251 sigma out 1act.( 29.7980747 sig in 12act.) RANK 3 NODE 3 --> 28.2071743 sigma out 1act.( 25.732645 sig in 12act.) RANK 4 NODE 15 --> 24.9839325 sigma out 1act.( 22.1376266 sig in 12act.) RANK 5 NODE 6 --> 23.164669 sigma out 1act.( 21.0518436 sig in 12act.) RANK 6 NODE 7 --> 22.7517509 sigma out 1act.( 23.8111095 sig in 12act.) RANK 7 NODE 5 --> 19.2398052 sigma out 1act.( 19.5855732 sig in 12act.) RANK 8 NODE 11 --> 18.0191631 sigma out 1act.( 15.9795446 sig in 12act.) RANK 9 NODE 14 --> 17.1955242 sigma out 1act.( 15.0670815 sig in 12act.) RANK 10 NODE 12 --> 13.8359118 sigma out 1act.( 12.3890228 sig in 12act.) RANK 11 NODE 1 --> 13.1289349 sigma out 1act.( 11.2468882 sig in 12act.) RANK 12 NODE 13 --> 12.845685 sigma out 1act.( 14.8375254 sig in 12act.) RANK 13 NODE 10 --> 9.23262978 sigma out 1act.( 9.09515762 sig in 12act.) RANK 14 NODE 4 --> 3.2242198 sigma out 1act.( 4.24229956 sig in 12act.) RANK 15 NODE 2 --> 0.201861918 sigma out 1act.( 2.77626038 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 217.514267 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.535305977 *** contribution from regularisation: 0.00318885408 *** contribution from error: -0.538494825 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29884 Closing output file done