NNInput NNInputs_115.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 184627 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 44827 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 44827 Chosen entries: 44827 Signal fraction: 1 Background fraction: 0.320651 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 44827 Entries to split: 44827 Test with : 22413 Train with : 22413 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 44827 for Signal Prepared event 0 for Signal with 44827 events ====Entry 0 Variable Ht : 147.2 Variable LepAPt : 33.8436 Variable LepBPt : 16.8195 Variable MetSigLeptonsJets : 7.93922 Variable MetSpec : 69.8321 Variable SumEtLeptonsJets : 77.3669 Variable VSumJetLeptonsPt : 74.5437 Variable addEt : 120.496 Variable dPhiLepSumMet : 2.77597 Variable dPhiLeptons : 0.349396 Variable dRLeptons : 0.409585 Variable lep1_E : 34.748 Variable lep2_E : 16.8224 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2115 Ht = 147.2 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.8439 LepAPt = 33.8436 LepBEt = 16.82 LepBPt = 16.8195 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 69.8321 MetDelPhi = 2.54203 MetSig = 5.42558 MetSigLeptonsJets = 7.93922 MetSpec = 69.8321 Mjj = 0 MostCentralJetEta = -1.25048 MtllMet = 121.128 Njets = 1 SB = 0 SumEt = 165.661 SumEtJets = 0 SumEtLeptonsJets = 77.3669 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 74.5437 addEt = 120.496 dPhiLepSumMet = 2.77597 dPhiLeptons = 0.349396 dRLeptons = 0.409585 diltype = 17 dimass = 9.74565 event = 4187 jet1_Et = 26.7039 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.748 lep2_E = 16.8224 rand = 0.999742 run = 237705 weight = 5.90147e-07 ===Show End Prepared event 10000 for Signal with 44827 events Prepared event 20000 for Signal with 44827 events Prepared event 30000 for Signal with 44827 events Prepared event 40000 for Signal with 44827 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.261158 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4366 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 184627 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4366 negative weights. Signal fraction: 62.3577728 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 62.9084549 64.802124 66.3857117 67.6327209 68.5835571 69.5403442 70.3292999 71.0700836 71.870018 72.6976242 73.3430328 74.0760193 74.673172 75.2991867 75.7732391 76.3090591 76.9102783 77.3967819 77.9550476 78.4631729 78.9929504 79.5373688 80.0819931 80.682579 81.2632675 81.9232254 82.4889069 83.0908585 83.7127533 84.55159 85.3478851 86.1820755 87.0101776 87.8137665 88.573967 89.3243179 90.1907196 91.1685028 92.2288971 93.1173096 94.1373444 94.9292145 95.6249771 96.5310059 97.4203339 98.2808304 99.1284561 100.018768 100.83226 101.625031 102.499435 103.346802 104.119659 104.893204 105.78437 106.667282 107.454247 108.31987 109.268677 110.179138 111.103409 111.998299 112.951797 114.023056 115.358734 116.692261 118.125381 119.685944 121.287979 122.820343 124.553589 126.536301 128.236481 129.82962 131.879761 133.580048 135.550537 137.583527 139.674683 141.777649 144.176956 146.668762 149.190094 151.956024 154.944092 158.492096 161.591187 164.845123 169.042633 173.485001 178.804794 184.916382 191.576416 199.50737 209.329224 222.149536 239.289551 265.002319 310.32962 871.385864 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.2441368 20.5067673 20.7477589 21.0070496 21.2657661 21.4807987 21.7004433 21.9066029 22.1009712 22.3279743 22.5415726 22.7432842 22.9244595 23.1207085 23.292551 23.4980564 23.6923485 23.8601418 24.0975399 24.3048706 24.4807663 24.6705208 24.8794136 25.0686264 25.245285 25.4181328 25.6047688 25.7613888 25.9335861 26.1279392 26.2928429 26.4809875 26.6712494 26.8618507 27.0522842 27.2566223 27.4765835 27.6794243 27.8675919 28.0537815 28.2136497 28.3957577 28.6349964 28.8769989 29.0973015 29.3006668 29.5106735 29.7249775 29.9331398 30.1477776 30.4066563 30.6214256 30.860218 31.103611 31.3638229 31.5722828 31.793066 32.0167084 32.2814407 32.5141602 32.7572632 33.0021439 33.2866402 33.5772552 33.8434868 34.1406708 34.4444847 34.7386055 35.0565872 35.3717804 35.6759987 35.9956741 36.3616257 36.7357597 37.0946465 37.53508 37.9235573 38.3635864 38.7944412 39.2617569 39.8105011 40.285759 40.8138657 41.2861786 41.8982391 42.5588684 43.2639008 44.1261482 45.0432816 46.0764999 47.2102394 48.4891205 49.8933487 51.479908 53.7557373 56.7557449 60.5532722 65.8115692 75.7357559 228.385986 ------------------------------ Transdef: Tab for variable 4 10.000247 10.0822945 10.1789341 10.2709579 10.363184 10.4469852 10.5218353 10.6041517 10.6867809 10.7752609 10.8568687 10.9363403 11.0147915 11.110754 11.194747 11.297348 11.3878193 11.4878368 11.5920925 11.6855755 11.7751541 11.8731565 11.9757824 12.0810547 12.1889839 12.2872896 12.3859062 12.4929743 12.599966 12.7149792 12.8231106 12.9142008 13.0155277 13.1268139 13.2477455 13.3848953 13.5023956 13.6240559 13.7408829 13.8366795 13.9327068 14.0634613 14.1657162 14.2822371 14.3771744 14.5064144 14.6410313 14.7859764 14.9273958 15.0681019 15.2163067 15.3529673 15.4791908 15.6015434 15.7582531 15.8822994 16.0146751 16.1722393 16.3218555 16.4584541 16.6152992 16.7660599 16.9216194 17.1022263 17.2774391 17.464344 17.6596565 17.8310013 17.9861107 18.1618786 18.339817 18.5258293 18.74823 18.9508476 19.1386585 19.3690453 19.623724 19.873745 20.1134644 20.2983112 20.5252228 20.8014183 21.0707664 21.3661976 21.6484947 21.9322624 22.2599144 22.6073914 22.9716759 23.3971596 23.8522053 24.2908993 24.8321056 25.4858971 26.216259 27.0586205 28.0381203 29.2538757 31.1776791 34.7816467 71.4863358 ------------------------------ Transdef: Tab for variable 5 0.97587049 2.28790164 2.67314816 2.93737555 3.15787911 3.32942677 3.52037644 3.69221759 3.84466743 3.97868085 4.08782291 4.18002462 4.26975346 4.36108541 4.44366884 4.53889847 4.61039782 4.67647934 4.74527264 4.80638647 4.87963963 4.94493675 5.00860119 5.06274509 5.11525536 5.16734743 5.22460747 5.27375889 5.32230663 5.36693001 5.4110651 5.45631742 5.4978137 5.53133583 5.58021021 5.62205887 5.6591053 5.70132637 5.74187374 5.7852602 5.8241272 5.86166048 5.89729357 5.9363966 5.97509766 6.01165009 6.05349636 6.08980942 6.13095856 6.16900635 6.20239115 6.23363113 6.27179718 6.30205202 6.33598948 6.36721706 6.40579033 6.44149876 6.47895241 6.51920891 6.5525856 6.59161377 6.63125753 6.66755915 6.70580769 6.74353981 6.77580309 6.81695271 6.84428215 6.88014221 6.92356443 6.96656656 7.00165796 7.04565525 7.08366537 7.13049746 7.1781702 7.22012997 7.26095104 7.30711555 7.35697556 7.40695095 7.45914173 7.51147461 7.57231569 7.63403988 7.69912624 7.77119255 7.84343433 7.92449284 8.01732445 8.11361027 8.22673035 8.36018848 8.50073433 8.68344498 8.90589333 9.19887543 9.59423637 10.481019 18.6198635 ------------------------------ Transdef: Tab for variable 6 15.0117254 18.8740959 22.6717949 25.313364 26.0791149 26.9284286 27.5406265 28.2673397 28.9356136 29.5285168 30.0800762 30.6601067 31.0887756 31.5887394 32.0515442 32.5668716 32.9546051 33.3650398 33.7652664 34.1421165 34.5450668 34.8746796 35.1720085 35.5624771 35.9189034 36.1972275 36.4817963 36.8396263 37.1589661 37.4520073 37.7443848 38.0206985 38.2843246 38.5762711 38.9003677 39.187664 39.4794655 39.7477608 40.0447998 40.3239212 40.5671616 40.8899918 41.22192 41.5568924 41.8688545 42.184082 42.4773026 42.8122063 43.0813751 43.3391609 43.6715088 43.9940643 44.345993 44.6585541 45.0693665 45.4623184 45.8537369 46.2387924 46.6344643 47.0399094 47.419323 47.8103828 48.2304611 48.6344223 49.0075073 49.3807945 49.7754288 50.1859474 50.5502739 50.9660645 51.3840179 51.8695831 52.3177567 52.7648621 53.2856064 53.7593384 54.2192345 54.7328568 55.2904243 55.8545837 56.4170341 57.0148277 57.6400452 58.3256378 58.9844933 59.8252678 60.7821655 61.7896118 62.8181 63.9362679 65.2297516 66.5184631 68.2562485 70.0376816 72.3435516 75.0842133 77.4857483 81.9081116 87.2472534 97.432663 232.087921 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.6107712 33.4971619 34.1754379 34.7807541 35.3159981 35.7455368 36.121933 36.4932365 36.8765335 37.2184677 37.4951668 37.7674713 38.0161591 38.2302322 38.5054169 38.7720261 39.018219 39.2803726 39.4989929 39.7655334 40.0976067 40.3701782 40.6777725 40.9711075 41.2809525 41.5600662 41.8928604 42.1682205 42.5870056 42.9844666 43.4294434 43.9150543 44.3296051 44.7398911 45.1235085 45.5789108 45.9865952 46.4643631 46.8943176 47.3559113 47.8909111 48.3381119 48.8780518 49.3882027 49.997757 50.5196457 51.0450363 51.54842 52.142952 52.6531982 53.2579842 53.8533745 54.4595032 55.0454712 55.7076492 56.2789955 57.0303116 57.8754311 58.8477364 59.8315811 60.993576 61.7326431 62.8562622 64.0188141 65.2340698 66.5203094 67.8388214 69.1667633 70.5477142 71.8540344 73.1872253 74.5895538 76.0764771 77.3906708 78.8533554 80.4091949 81.9551544 83.3869476 85.3130798 87.3139114 89.5143127 91.7115021 94.2244415 96.9540253 99.4444885 102.090759 105.167976 108.55146 112.096275 115.705978 120.105896 125.389755 131.542755 137.860229 146.137161 155.92749 170.098404 190.033722 227.468811 509.450317 ------------------------------ Transdef: Tab for variable 8 0.862621069 20.8682938 25.2881527 28.1524811 29.8541336 31.0447235 31.8408775 32.4485779 32.9623032 33.399826 33.8565407 34.2383499 34.6217651 34.9700737 35.223774 35.518631 35.8285828 36.1104889 36.4152794 36.609726 36.8796082 37.1291656 37.3352318 37.5530548 37.8095932 38.0206757 38.2135429 38.4578247 38.6435699 38.8591461 39.1059799 39.3010674 39.5366516 39.8209229 40.0772324 40.2997932 40.5492821 40.8113251 41.0917778 41.3496552 41.65728 41.948101 42.2049408 42.4971008 42.8518372 43.1547508 43.4215927 43.7358017 44.0380325 44.3830986 44.7058563 45.0614166 45.3929558 45.7067642 46.0762939 46.4430313 46.7464371 47.1569405 47.5596046 47.9364166 48.239933 48.6553497 49.0047684 49.3691483 49.7392502 50.1420937 50.5177574 50.9416809 51.3440285 51.7450256 52.1942406 52.6270676 53.1182022 53.5715981 53.9627647 54.42453 54.9109955 55.420723 55.9756279 56.598465 57.2730484 57.9545021 58.7429581 59.554039 60.4490738 61.392395 62.4197197 63.4609261 64.6747894 65.8459702 67.3162842 68.9036713 70.8926392 73.037468 75.2019653 78.3357544 81.8321304 87.0937347 95.2999802 113.075317 363.523895 ------------------------------ Transdef: Tab for variable 9 49.0944328 62.3110199 63.9199677 65.4343109 66.6156845 67.6942596 68.5515137 69.4301453 70.1250153 70.7077332 71.455307 72.0984497 72.8328552 73.4065399 74.0320587 74.5541687 75.1266632 75.585434 76.0427856 76.5770111 76.9867859 77.4211426 77.9176331 78.3615723 78.7534637 79.2845383 79.698288 80.1083832 80.6520538 81.0717087 81.6122131 82.1292267 82.5556564 83.1004257 83.5990601 84.1419067 84.7595749 85.3373566 85.9699249 86.6499329 87.1192398 87.7008743 88.3219452 88.8340454 89.393631 90.1086731 90.8309021 91.5504608 92.2413025 92.8914185 93.5939484 94.3020935 94.8302002 95.4615784 96.0840912 96.7674408 97.4335785 98.0953522 98.7117767 99.3719711 99.9768372 100.680466 101.304245 101.859245 102.444771 103.071274 103.640228 104.283981 104.902992 105.529518 106.152473 106.796822 107.425484 108.084335 108.719101 109.367393 110.050011 110.690323 111.386192 112.065186 112.872864 113.753952 114.640015 115.563652 116.499352 117.48735 118.674484 119.991257 121.341675 122.919746 124.90181 127.182816 129.836243 132.802094 136.515991 141.513763 147.645752 154.29126 166.108124 194.176865 434.914825 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.755662858 1.0623498 1.28074813 1.42895341 1.55848455 1.67071486 1.77035856 1.84948826 1.9233979 1.99079394 2.05988884 2.1202271 2.17637229 2.22880793 2.27651191 2.320086 2.36369514 2.40644288 2.44173408 2.47509146 2.50774312 2.53852797 2.56789589 2.59344602 2.61705232 2.64267421 2.6694119 2.69309878 2.71629381 2.7371316 2.75778627 2.77512074 2.7922771 2.8088131 2.82272291 2.83416939 2.84486294 2.85713243 2.86830831 2.87917805 2.88930702 2.90064716 2.9104104 2.91889548 2.92737865 2.93428946 2.94230938 2.94964218 2.95572925 2.96247816 2.96805 2.97470045 2.98031116 2.98502445 2.99016953 2.99388599 2.99899149 3.00394678 3.00891542 3.0139246 3.01873469 3.02325869 3.02761912 3.03132033 3.03498292 3.03939772 3.04338384 3.04718447 3.05143023 3.05530643 3.05885577 3.06193018 3.06586313 3.06863308 3.07201433 3.07516003 3.07809067 3.08173084 3.0850029 3.08840132 3.09155297 3.09452415 3.09678388 3.09960651 3.10243893 3.10472536 3.10785866 3.11047363 3.11365294 3.11615849 3.11861181 3.12096786 3.12376165 3.12663555 3.12903857 3.13139391 3.13376808 3.13647842 3.13891554 3.14159131 ------------------------------ Transdef: Tab for variable 11 1.62124634E-05 0.00560092926 0.0105530638 0.0176019631 0.0237996504 0.0302757621 0.0397928953 0.0475357622 0.0563895702 0.0632908344 0.073248744 0.0824733973 0.0915347338 0.0997216702 0.108170077 0.116080046 0.124512434 0.132935598 0.143055558 0.151910782 0.159493685 0.167497158 0.175166905 0.182841659 0.190101862 0.197668552 0.204940319 0.21249783 0.219539642 0.226532221 0.233234391 0.239829481 0.246938229 0.254167914 0.260249734 0.26566115 0.27188313 0.278479964 0.284492373 0.290703773 0.296701789 0.302645326 0.308405876 0.314280868 0.32042098 0.326089144 0.331594586 0.337771297 0.343551666 0.349890709 0.355645239 0.361053884 0.367217064 0.37352851 0.379773855 0.386048079 0.39145869 0.397097945 0.402313232 0.408766508 0.414554715 0.420265108 0.426042557 0.431935251 0.438040614 0.444478571 0.4497962 0.456091881 0.462018967 0.468820572 0.474689841 0.479933858 0.486465126 0.493699074 0.501178861 0.508942664 0.515958309 0.522658229 0.529394031 0.538011968 0.544253469 0.550607204 0.557897568 0.566682577 0.575885534 0.584348917 0.594032526 0.60515821 0.615211189 0.62744689 0.63839066 0.650441527 0.66294539 0.678066611 0.695901513 0.714956522 0.735637546 0.770407557 0.802864075 0.863780618 1.11657131 ------------------------------ Transdef: Tab for variable 12 0.20003137 0.2300632 0.248541817 0.265320957 0.278046727 0.288112849 0.300201356 0.309252679 0.319382787 0.328294098 0.33765316 0.346182823 0.353438616 0.359706223 0.36768797 0.375612199 0.382111251 0.389407247 0.395567209 0.401299477 0.40671593 0.411664188 0.41583246 0.420610368 0.425025046 0.429919869 0.433924198 0.438419163 0.443158418 0.446613252 0.451193273 0.455639988 0.459703267 0.463649809 0.467153788 0.471161634 0.475303531 0.479344755 0.48284176 0.486768723 0.490317941 0.494117171 0.49787733 0.501971602 0.506190658 0.510275602 0.513763964 0.517775476 0.521781564 0.525683522 0.530150533 0.534256935 0.538863242 0.543027043 0.547429681 0.550850451 0.554872155 0.559511304 0.563337207 0.567724228 0.571876228 0.576744318 0.581337333 0.585796833 0.590632319 0.595041513 0.599676609 0.60498929 0.609938145 0.615489125 0.6210922 0.626584053 0.631607175 0.637066841 0.642890334 0.648143113 0.654436111 0.660568714 0.665959775 0.671236396 0.676701903 0.682845592 0.689684033 0.697313368 0.704346061 0.712077618 0.719381809 0.727065086 0.735903025 0.745002627 0.754833937 0.763513207 0.773638964 0.787259221 0.800502777 0.816508651 0.835915744 0.855352104 0.886430502 0.924821377 1.13453126 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3913727 22.1211414 22.6029739 23.1598358 23.7094116 24.2491398 24.6876183 25.1291275 25.4601822 25.8307266 26.1869507 26.5960197 27.0189629 27.3207207 27.6888733 27.9812431 28.2712479 28.6057129 28.8650131 29.1789856 29.4308243 29.7525024 30.0732841 30.3577499 30.623703 30.909832 31.1797523 31.4473381 31.7747097 32.0738678 32.3640022 32.6543198 32.9686661 33.2458496 33.5847015 33.9076996 34.2398262 34.5148468 34.8557129 35.134655 35.4411545 35.7777939 36.0839005 36.3316269 36.6989441 37.0323639 37.3700485 37.7431488 38.0865707 38.4551735 38.7977142 39.1928329 39.6023979 39.98703 40.3928642 40.8205643 41.2870255 41.7484474 42.2207031 42.672924 43.1313477 43.5664024 44.0572586 44.5144958 45.0459518 45.6208878 46.1958351 46.6994781 47.3330078 47.8743134 48.5058136 49.2312546 49.9134407 50.5996437 51.3945541 52.2195663 53.0176315 53.9775391 54.9062347 55.7846069 56.772644 57.7258873 58.7126503 60.0218887 61.3601952 62.652298 64.2536621 65.9100876 67.52005 68.994812 71.0711288 73.5002823 75.7369537 78.5470428 82.1381683 86.4492798 90.8498001 97.3807831 108.006851 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0093269 10.5090656 10.8165874 11.0519104 11.2923727 11.4972868 11.7239876 11.9030247 12.1419945 12.3327961 12.5149364 12.721777 12.9096918 13.1148767 13.3083019 13.4882269 13.6608057 13.8392153 14.0217381 14.2113419 14.374836 14.5557318 14.7315197 14.9089317 15.0853052 15.2588701 15.4677792 15.6616173 15.8371544 16.0253391 16.2276192 16.3735199 16.5359936 16.7198563 16.882473 17.0624809 17.2391472 17.4197807 17.6383514 17.7772198 17.9633484 18.1584225 18.3696022 18.596283 18.7861423 18.9957581 19.1728172 19.3923416 19.6002598 19.8274498 20.0317383 20.2599449 20.4901161 20.7146435 20.9411736 21.166666 21.3808365 21.6143265 21.8143635 22.0454216 22.3091354 22.5715237 22.8367577 23.0652275 23.3431206 23.6064568 23.8987808 24.1625137 24.4845562 24.805912 25.1177444 25.4297085 25.7098427 26.0529652 26.3730392 26.7698421 27.1601257 27.6129265 27.9611187 28.3279972 28.832901 29.2629051 29.7241611 30.3495636 30.9703751 31.4573784 32.0614166 32.7635193 33.5171967 34.3248901 35.1912155 36.3197327 37.3707695 38.819809 40.079525 41.9087982 44.1028366 47.030365 50.8238029 58.3244247 124.551949 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 52.1 39.1 23.5 3.5 28.4 50.7 34.3 47.4 -30.4 -6.0 -17.5 5.7 -7.9 2 52.1 100.0 63.8 42.8 12.0 54.8 93.8 60.4 89.4 -54.1 -17.8 -39.2 31.6 13.8 3 39.1 63.8 100.0 19.2 -9.1 22.5 67.5 44.6 69.2 -22.4 -18.5 -43.5 63.4 0.4 4 23.5 42.8 19.2 100.0 -4.6 15.9 45.0 30.7 46.5 -14.6 -23.1 -47.0 6.4 65.6 5 3.5 12.0 -9.1 -4.6 100.0 79.0 -15.7 42.7 40.6 30.1 3.0 6.3 -12.6 -7.2 6 28.4 54.8 22.5 15.9 79.0 100.0 32.0 69.3 72.3 -3.1 -5.8 -13.4 4.8 0.4 7 50.7 93.8 67.5 45.0 -15.7 32.0 100.0 54.1 76.6 -60.0 -17.4 -40.5 36.3 16.9 8 34.3 60.4 44.6 30.7 42.7 69.3 54.1 100.0 73.7 -10.5 -14.6 -28.6 21.7 10.6 9 47.4 89.4 69.2 46.5 40.6 72.3 76.6 73.7 100.0 -28.4 -19.4 -43.8 35.8 17.2 10 -30.4 -54.1 -22.4 -14.6 30.1 -3.1 -60.0 -10.5 -28.4 100.0 4.5 11.3 -9.3 -2.0 11 -6.0 -17.8 -18.5 -23.1 3.0 -5.8 -17.4 -14.6 -19.4 4.5 100.0 53.6 -8.2 -14.5 12 -17.5 -39.2 -43.5 -47.0 6.3 -13.4 -40.5 -28.6 -43.8 11.3 53.6 100.0 -21.8 -23.6 13 5.7 31.6 63.4 6.4 -12.6 4.8 36.3 21.7 35.8 -9.3 -8.2 -21.8 100.0 36.9 14 -7.9 13.8 0.4 65.6 -7.2 0.4 16.9 10.6 17.2 -2.0 -14.5 -23.6 36.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 113.89741 TOTAL CORRELATION OF ALL VARIABLES 58.2495631 ROUND 1: MAX CORR ( 58.2456272) AFTER KILLING INPUT VARIABLE 7 CONTR 0.677138414 ROUND 2: MAX CORR ( 58.2397259) AFTER KILLING INPUT VARIABLE 11 CONTR 0.829101498 ROUND 3: MAX CORR ( 58.2240519) AFTER KILLING INPUT VARIABLE 5 CONTR 1.35109483 ROUND 4: MAX CORR ( 58.1521737) AFTER KILLING INPUT VARIABLE 6 CONTR 2.89221648 ROUND 5: MAX CORR ( 58.1228479) AFTER KILLING INPUT VARIABLE 9 CONTR 1.84657885 ROUND 6: MAX CORR ( 57.9983252) AFTER KILLING INPUT VARIABLE 8 CONTR 3.80259426 ROUND 7: MAX CORR ( 57.8300232) AFTER KILLING INPUT VARIABLE 10 CONTR 4.41521736 ROUND 8: MAX CORR ( 57.4381604) AFTER KILLING INPUT VARIABLE 13 CONTR 6.72081236 ROUND 9: MAX CORR ( 56.8869234) AFTER KILLING INPUT VARIABLE 12 CONTR 7.93852696 ROUND 10: MAX CORR ( 56.4684206) AFTER KILLING INPUT VARIABLE 3 CONTR 6.88763638 ROUND 11: MAX CORR ( 54.3159284) AFTER KILLING INPUT VARIABLE 4 CONTR 15.4422294 ROUND 12: MAX CORR ( 52.1204833) AFTER KILLING INPUT VARIABLE 14 CONTR 15.2864414 LAST REMAINING VARIABLE: 2 total correlation to target: 58.2495631 % total significance: 110.767158 sigma correlations of single variables to target: variable 2: 52.1204833 % , in sigma: 99.1121223 variable 3: 39.1259528 % , in sigma: 74.4017702 variable 4: 23.4971796 % , in sigma: 44.6821516 variable 5: 3.49486709 % , in sigma: 6.6458266 variable 6: 28.3657144 % , in sigma: 53.9401398 variable 7: 50.6573522 % , in sigma: 96.3298374 variable 8: 34.3179812 % , in sigma: 65.2589488 variable 9: 47.4415945 % , in sigma: 90.2147643 variable 10: -30.3789518 % , in sigma: 57.7685047 variable 11: -6.03710209 % , in sigma: 11.4801315 variable 12: -17.5146935 % , in sigma: 33.3058777 variable 13: 5.71848238 % , in sigma: 10.8742454 variable 14: -7.93099962 % , in sigma: 15.0815601 variables sorted by significance: 1 most relevant variable 2 corr 52.1204834 , in sigma: 99.1121224 2 most relevant variable 14 corr 15.2864418 , in sigma: 29.0686424 3 most relevant variable 4 corr 15.4422293 , in sigma: 29.3648872 4 most relevant variable 3 corr 6.88763618 , in sigma: 13.097504 5 most relevant variable 12 corr 7.93852711 , in sigma: 15.0958744 6 most relevant variable 13 corr 6.72081232 , in sigma: 12.7802724 7 most relevant variable 10 corr 4.4152174 , in sigma: 8.39596141 8 most relevant variable 8 corr 3.80259418 , in sigma: 7.23099933 9 most relevant variable 9 corr 1.84657884 , in sigma: 3.51144763 10 most relevant variable 6 corr 2.89221644 , in sigma: 5.49982831 11 most relevant variable 5 corr 1.35109484 , in sigma: 2.56923706 12 most relevant variable 11 corr 0.829101503 , in sigma: 1.57661641 13 most relevant variable 7 corr 0.677138388 , in sigma: 1.28764391 global correlations between input variables: variable 2: 98.9071017 % variable 3: 93.5747677 % variable 4: 88.7276706 % variable 5: 94.2879566 % variable 6: 92.7016459 % variable 7: 98.360561 % variable 8: 84.2937322 % variable 9: 98.6255383 % variable 10: 72.4936576 % variable 11: 54.8122611 % variable 12: 71.0631093 % variable 13: 83.9475035 % variable 14: 85.1542553 % significance loss when removing single variables: variable 2: corr = 4.63198093 % , sigma = 8.80815816 variable 3: corr = 8.87292168 % , sigma = 16.8727157 variable 4: corr = 10.5102184 % , sigma = 19.9861933 variable 5: corr = 1.0471081 % , sigma = 1.99117697 variable 6: corr = 3.21785567 % , sigma = 6.11906268 variable 7: corr = 0.677138414 % , sigma = 1.28764396 variable 8: corr = 2.25689136 % , sigma = 4.29169643 variable 9: corr = 1.49586508 % , sigma = 2.84453162 variable 10: corr = 3.96208068 % , sigma = 7.53427827 variable 11: corr = 0.77157156 % , sigma = 1.46721768 variable 12: corr = 6.47869361 % , sigma = 12.3198603 variable 13: corr = 6.71839672 % , sigma = 12.7756789 variable 14: corr = 10.677232 % , sigma = 20.3037858 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 23.4517574 sigma out 15 active outputs RANK 2 NODE 4 --> 20.623167 sigma out 15 active outputs RANK 3 NODE 7 --> 17.6443005 sigma out 15 active outputs RANK 4 NODE 10 --> 16.3899555 sigma out 15 active outputs RANK 5 NODE 5 --> 15.8643169 sigma out 15 active outputs RANK 6 NODE 9 --> 13.9120102 sigma out 15 active outputs RANK 7 NODE 6 --> 13.5067062 sigma out 15 active outputs RANK 8 NODE 8 --> 12.7082748 sigma out 15 active outputs RANK 9 NODE 11 --> 12.6734009 sigma out 15 active outputs RANK 10 NODE 2 --> 10.7681694 sigma out 15 active outputs RANK 11 NODE 1 --> 9.30205536 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 30.2777328 sigma in 11act. ( 32.7785683 sig out 1act.) RANK 2 NODE 2 --> 27.1941605 sigma in 11act. ( 27.0258331 sig out 1act.) RANK 3 NODE 11 --> 15.3247585 sigma in 11act. ( 15.7995358 sig out 1act.) RANK 4 NODE 15 --> 13.8647404 sigma in 11act. ( 14.417387 sig out 1act.) RANK 5 NODE 1 --> 11.9899921 sigma in 11act. ( 12.1833992 sig out 1act.) RANK 6 NODE 10 --> 10.2091789 sigma in 11act. ( 9.73897743 sig out 1act.) RANK 7 NODE 13 --> 8.76224995 sigma in 11act. ( 10.5228157 sig out 1act.) RANK 8 NODE 4 --> 8.3133707 sigma in 11act. ( 8.24484062 sig out 1act.) RANK 9 NODE 7 --> 7.5511055 sigma in 11act. ( 5.4299655 sig out 1act.) RANK 10 NODE 9 --> 6.91635275 sigma in 11act. ( 8.04760838 sig out 1act.) RANK 11 NODE 12 --> 6.79971218 sigma in 11act. ( 5.09972286 sig out 1act.) RANK 12 NODE 8 --> 5.06994581 sigma in 11act. ( 6.16545153 sig out 1act.) RANK 13 NODE 6 --> 4.93343687 sigma in 11act. ( 4.65065145 sig out 1act.) RANK 14 NODE 3 --> 3.85468054 sigma in 11act. ( 4.41411066 sig out 1act.) RANK 15 NODE 14 --> 3.78000474 sigma in 11act. ( 2.0122273 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 32.7785683 sigma out 1act.( 30.2777328 sig in 11act.) RANK 2 NODE 2 --> 27.0258331 sigma out 1act.( 27.1941605 sig in 11act.) RANK 3 NODE 11 --> 15.7995358 sigma out 1act.( 15.3247585 sig in 11act.) RANK 4 NODE 15 --> 14.417387 sigma out 1act.( 13.8647404 sig in 11act.) RANK 5 NODE 1 --> 12.1833992 sigma out 1act.( 11.9899921 sig in 11act.) RANK 6 NODE 13 --> 10.5228157 sigma out 1act.( 8.76224995 sig in 11act.) RANK 7 NODE 10 --> 9.73897743 sigma out 1act.( 10.2091789 sig in 11act.) RANK 8 NODE 4 --> 8.24484062 sigma out 1act.( 8.3133707 sig in 11act.) RANK 9 NODE 9 --> 8.04760838 sigma out 1act.( 6.91635275 sig in 11act.) RANK 10 NODE 8 --> 6.16545153 sigma out 1act.( 5.06994581 sig in 11act.) RANK 11 NODE 7 --> 5.4299655 sigma out 1act.( 7.5511055 sig in 11act.) RANK 12 NODE 12 --> 5.09972286 sigma out 1act.( 6.79971218 sig in 11act.) RANK 13 NODE 6 --> 4.65065145 sigma out 1act.( 4.93343687 sig in 11act.) RANK 14 NODE 3 --> 4.41411066 sigma out 1act.( 3.85468054 sig in 11act.) RANK 15 NODE 14 --> 2.0122273 sigma out 1act.( 3.78000474 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.7376671 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 24.2858276 sigma out 15 active outputs RANK 2 NODE 4 --> 22.5598297 sigma out 15 active outputs RANK 3 NODE 10 --> 18.087326 sigma out 15 active outputs RANK 4 NODE 7 --> 17.5643978 sigma out 15 active outputs RANK 5 NODE 5 --> 17.0267696 sigma out 15 active outputs RANK 6 NODE 9 --> 16.9684887 sigma out 15 active outputs RANK 7 NODE 2 --> 15.8241796 sigma out 15 active outputs RANK 8 NODE 8 --> 15.0921326 sigma out 15 active outputs RANK 9 NODE 6 --> 14.2108622 sigma out 15 active outputs RANK 10 NODE 11 --> 13.3983765 sigma out 15 active outputs RANK 11 NODE 1 --> 12.0058784 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 33.3193893 sigma in 11act. ( 31.6549053 sig out 1act.) RANK 2 NODE 2 --> 26.4115982 sigma in 11act. ( 26.3028774 sig out 1act.) RANK 3 NODE 11 --> 16.2181396 sigma in 11act. ( 15.3842478 sig out 1act.) RANK 4 NODE 15 --> 14.4724302 sigma in 11act. ( 14.0567999 sig out 1act.) RANK 5 NODE 1 --> 12.0800047 sigma in 11act. ( 11.4282703 sig out 1act.) RANK 6 NODE 13 --> 11.4391012 sigma in 11act. ( 10.3966732 sig out 1act.) RANK 7 NODE 3 --> 10.9624128 sigma in 11act. ( 5.5795784 sig out 1act.) RANK 8 NODE 9 --> 10.2294149 sigma in 11act. ( 8.61645699 sig out 1act.) RANK 9 NODE 4 --> 10.0925627 sigma in 11act. ( 8.27851772 sig out 1act.) RANK 10 NODE 10 --> 9.68059635 sigma in 11act. ( 8.86990452 sig out 1act.) RANK 11 NODE 8 --> 9.48462677 sigma in 11act. ( 7.84989452 sig out 1act.) RANK 12 NODE 7 --> 9.30580235 sigma in 11act. ( 4.65747976 sig out 1act.) RANK 13 NODE 6 --> 8.2635746 sigma in 11act. ( 4.67661762 sig out 1act.) RANK 14 NODE 12 --> 7.83521557 sigma in 11act. ( 4.39842558 sig out 1act.) RANK 15 NODE 14 --> 5.69166899 sigma in 11act. ( 1.6391325 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 31.6549053 sigma out 1act.( 33.3193893 sig in 11act.) RANK 2 NODE 2 --> 26.3028774 sigma out 1act.( 26.4115982 sig in 11act.) RANK 3 NODE 11 --> 15.3842478 sigma out 1act.( 16.2181396 sig in 11act.) RANK 4 NODE 15 --> 14.0567999 sigma out 1act.( 14.4724302 sig in 11act.) RANK 5 NODE 1 --> 11.4282703 sigma out 1act.( 12.0800047 sig in 11act.) RANK 6 NODE 13 --> 10.3966732 sigma out 1act.( 11.4391012 sig in 11act.) RANK 7 NODE 10 --> 8.86990452 sigma out 1act.( 9.68059635 sig in 11act.) RANK 8 NODE 9 --> 8.61645699 sigma out 1act.( 10.2294149 sig in 11act.) RANK 9 NODE 4 --> 8.27851772 sigma out 1act.( 10.0925627 sig in 11act.) RANK 10 NODE 8 --> 7.84989452 sigma out 1act.( 9.48462677 sig in 11act.) RANK 11 NODE 3 --> 5.5795784 sigma out 1act.( 10.9624128 sig in 11act.) RANK 12 NODE 6 --> 4.67661762 sigma out 1act.( 8.2635746 sig in 11act.) RANK 13 NODE 7 --> 4.65747976 sigma out 1act.( 9.30580235 sig in 11act.) RANK 14 NODE 12 --> 4.39842558 sigma out 1act.( 7.83521557 sig in 11act.) RANK 15 NODE 14 --> 1.6391325 sigma out 1act.( 5.69166899 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.4084015 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.440276235 *** contribution from regularisation: 0.0039830897 *** contribution from error: -0.444259316 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.468828768 *** contribution from regularisation: 0.00251324149 *** contribution from error: -0.471341997 *********************************************** -----------------> Test sample ENTER BFGS code START -43288.221 0.106628388 0.372325361 EXIT FROM BFGS code FG_START 0. 0.106628388 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.484397948 *** contribution from regularisation: 0.00219485466 *** contribution from error: -0.486592799 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -44716.2278 0.106628388 324.262512 EXIT FROM BFGS code FG_LNSRCH 0. 0.194871724 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.505458534 *** contribution from regularisation: 0.00300228992 *** contribution from error: -0.50846082 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46660.3946 0.194871724 -101.894783 EXIT FROM BFGS code NEW_X -46660.3946 0.194871724 -101.894783 ENTER BFGS code NEW_X -46660.3946 0.194871724 -101.894783 EXIT FROM BFGS code FG_LNSRCH 0. 0.180878118 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.509249687 *** contribution from regularisation: 0.0028792345 *** contribution from error: -0.512128949 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47010.3668 0.180878118 -16.5370846 EXIT FROM BFGS code NEW_X -47010.3668 0.180878118 -16.5370846 ENTER BFGS code NEW_X -47010.3668 0.180878118 -16.5370846 EXIT FROM BFGS code FG_LNSRCH 0. 0.179708898 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.510976553 *** contribution from regularisation: 0.00281351223 *** contribution from error: -0.513790071 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47169.778 0.179708898 -11.5166836 EXIT FROM BFGS code NEW_X -47169.778 0.179708898 -11.5166836 ENTER BFGS code NEW_X -47169.778 0.179708898 -11.5166836 EXIT FROM BFGS code FG_LNSRCH 0. 0.170231983 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.511784613 *** contribution from regularisation: 0.00270232372 *** contribution from error: -0.514486909 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47244.3746 0.170231983 -11.1310692 EXIT FROM BFGS code NEW_X -47244.3746 0.170231983 -11.1310692 ENTER BFGS code NEW_X -47244.3746 0.170231983 -11.1310692 EXIT FROM BFGS code FG_LNSRCH 0. 0.151979029 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.512448907 *** contribution from regularisation: 0.00269534532 *** contribution from error: -0.515144229 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47305.6957 0.151979029 -3.92454433 EXIT FROM BFGS code NEW_X -47305.6957 0.151979029 -3.92454433 ENTER BFGS code NEW_X -47305.6957 0.151979029 -3.92454433 EXIT FROM BFGS code FG_LNSRCH 0. 0.00590720773 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.51544553 *** contribution from regularisation: 0.00310459407 *** contribution from error: -0.518550098 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47582.3226 0.00590720773 147.558884 EXIT FROM BFGS code NEW_X -47582.3226 0.00590720773 147.558884 ENTER BFGS code NEW_X -47582.3226 0.00590720773 147.558884 EXIT FROM BFGS code FG_LNSRCH 0. 0.0250311662 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 56.2169724 sigma out 15 active outputs RANK 2 NODE 1 --> 31.7163658 sigma out 15 active outputs RANK 3 NODE 8 --> 23.72295 sigma out 15 active outputs RANK 4 NODE 10 --> 23.573473 sigma out 15 active outputs RANK 5 NODE 6 --> 20.5920792 sigma out 15 active outputs RANK 6 NODE 3 --> 19.4926357 sigma out 15 active outputs RANK 7 NODE 9 --> 19.4781837 sigma out 15 active outputs RANK 8 NODE 7 --> 16.7899799 sigma out 15 active outputs RANK 9 NODE 11 --> 11.8208523 sigma out 15 active outputs RANK 10 NODE 4 --> 11.065052 sigma out 15 active outputs RANK 11 NODE 5 --> 10.2074718 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 64.9311295 sigma in 11act. ( 66.9560013 sig out 1act.) RANK 2 NODE 8 --> 37.0789185 sigma in 11act. ( 25.7934895 sig out 1act.) RANK 3 NODE 2 --> 26.7755394 sigma in 11act. ( 27.9773293 sig out 1act.) RANK 4 NODE 4 --> 12.1350174 sigma in 11act. ( 9.6822443 sig out 1act.) RANK 5 NODE 13 --> 11.8284922 sigma in 11act. ( 10.8183994 sig out 1act.) RANK 6 NODE 9 --> 10.9863682 sigma in 11act. ( 11.7174797 sig out 1act.) RANK 7 NODE 15 --> 10.5809011 sigma in 11act. ( 7.71887064 sig out 1act.) RANK 8 NODE 7 --> 7.63135767 sigma in 11act. ( 7.2965107 sig out 1act.) RANK 9 NODE 6 --> 6.91287994 sigma in 11act. ( 6.15613556 sig out 1act.) RANK 10 NODE 1 --> 6.53073168 sigma in 11act. ( 6.43025589 sig out 1act.) RANK 11 NODE 12 --> 6.20312214 sigma in 11act. ( 5.6958251 sig out 1act.) RANK 12 NODE 5 --> 5.53047371 sigma in 11act. ( 2.20502329 sig out 1act.) RANK 13 NODE 11 --> 5.49697447 sigma in 11act. ( 3.88151097 sig out 1act.) RANK 14 NODE 10 --> 4.96672249 sigma in 11act. ( 4.88835716 sig out 1act.) RANK 15 NODE 14 --> 4.01780844 sigma in 11act. ( 3.28542495 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 66.9560013 sigma out 1act.( 64.9311295 sig in 11act.) RANK 2 NODE 2 --> 27.9773293 sigma out 1act.( 26.7755394 sig in 11act.) RANK 3 NODE 8 --> 25.7934895 sigma out 1act.( 37.0789185 sig in 11act.) RANK 4 NODE 9 --> 11.7174797 sigma out 1act.( 10.9863682 sig in 11act.) RANK 5 NODE 13 --> 10.8183994 sigma out 1act.( 11.8284922 sig in 11act.) RANK 6 NODE 4 --> 9.6822443 sigma out 1act.( 12.1350174 sig in 11act.) RANK 7 NODE 15 --> 7.71887064 sigma out 1act.( 10.5809011 sig in 11act.) RANK 8 NODE 7 --> 7.2965107 sigma out 1act.( 7.63135767 sig in 11act.) RANK 9 NODE 1 --> 6.43025589 sigma out 1act.( 6.53073168 sig in 11act.) RANK 10 NODE 6 --> 6.15613556 sigma out 1act.( 6.91287994 sig in 11act.) RANK 11 NODE 12 --> 5.6958251 sigma out 1act.( 6.20312214 sig in 11act.) RANK 12 NODE 10 --> 4.88835716 sigma out 1act.( 4.96672249 sig in 11act.) RANK 13 NODE 11 --> 3.88151097 sigma out 1act.( 5.49697447 sig in 11act.) RANK 14 NODE 14 --> 3.28542495 sigma out 1act.( 4.01780844 sig in 11act.) RANK 15 NODE 5 --> 2.20502329 sigma out 1act.( 5.53047371 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 80.9836502 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.519800484 *** contribution from regularisation: 0.00296694972 *** contribution from error: -0.522767425 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47984.3446 0.0250311662 89.2151337 EXIT FROM BFGS code NEW_X -47984.3446 0.0250311662 89.2151337 ENTER BFGS code NEW_X -47984.3446 0.0250311662 89.2151337 EXIT FROM BFGS code FG_LNSRCH 0. 0.0110281762 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.520973325 *** contribution from regularisation: 0.0040407991 *** contribution from error: -0.525014102 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48092.609 0.0110281762 132.788071 EXIT FROM BFGS code NEW_X -48092.609 0.0110281762 132.788071 ENTER BFGS code NEW_X -48092.609 0.0110281762 132.788071 EXIT FROM BFGS code FG_LNSRCH 0. 0.101942793 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.52272594 *** contribution from regularisation: 0.00269599701 *** contribution from error: -0.525421917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48254.3988 0.101942793 -15.6617212 EXIT FROM BFGS code NEW_X -48254.3988 0.101942793 -15.6617212 ENTER BFGS code NEW_X -48254.3988 0.101942793 -15.6617212 EXIT FROM BFGS code FG_LNSRCH 0. 0.0984665528 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.523010373 *** contribution from regularisation: 0.00316324527 *** contribution from error: -0.526173592 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48280.6587 0.0984665528 38.7388 EXIT FROM BFGS code NEW_X -48280.6587 0.0984665528 38.7388 ENTER BFGS code NEW_X -48280.6587 0.0984665528 38.7388 EXIT FROM BFGS code FG_LNSRCH 0. 0.124487743 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.523882031 *** contribution from regularisation: 0.00315988157 *** contribution from error: -0.527041912 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48361.121 0.124487743 91.9585648 EXIT FROM BFGS code NEW_X -48361.121 0.124487743 91.9585648 ENTER BFGS code NEW_X -48361.121 0.124487743 91.9585648 EXIT FROM BFGS code FG_LNSRCH 0. 0.254358292 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.525089502 *** contribution from regularisation: 0.00316351699 *** contribution from error: -0.528253019 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48472.5854 0.254358292 108.604927 EXIT FROM BFGS code NEW_X -48472.5854 0.254358292 108.604927 ENTER BFGS code NEW_X -48472.5854 0.254358292 108.604927 EXIT FROM BFGS code FG_LNSRCH 0. 0.368183941 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.52562952 *** contribution from regularisation: 0.00310865836 *** contribution from error: -0.528738201 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48522.4379 0.368183941 107.678596 EXIT FROM BFGS code NEW_X -48522.4379 0.368183941 107.678596 ENTER BFGS code NEW_X -48522.4379 0.368183941 107.678596 EXIT FROM BFGS code FG_LNSRCH 0. 0.401478976 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.526102662 *** contribution from regularisation: 0.00303340913 *** contribution from error: -0.529136062 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48566.1141 0.401478976 30.2038441 EXIT FROM BFGS code NEW_X -48566.1141 0.401478976 30.2038441 ENTER BFGS code NEW_X -48566.1141 0.401478976 30.2038441 EXIT FROM BFGS code FG_LNSRCH 0. 0.431119859 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.526216269 *** contribution from regularisation: 0.00305182487 *** contribution from error: -0.529268086 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48576.6035 0.431119859 -4.80406618 EXIT FROM BFGS code NEW_X -48576.6035 0.431119859 -4.80406618 ENTER BFGS code NEW_X -48576.6035 0.431119859 -4.80406618 EXIT FROM BFGS code FG_LNSRCH 0. 0.492537498 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.526487768 *** contribution from regularisation: 0.00301185809 *** contribution from error: -0.52949965 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48601.6647 0.492537498 -47.3790321 EXIT FROM BFGS code NEW_X -48601.6647 0.492537498 -47.3790321 ENTER BFGS code NEW_X -48601.6647 0.492537498 -47.3790321 EXIT FROM BFGS code FG_LNSRCH 0. 0.603023052 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 80.1078644 sigma out 15 active outputs RANK 2 NODE 3 --> 34.1451302 sigma out 15 active outputs RANK 3 NODE 1 --> 30.370718 sigma out 15 active outputs RANK 4 NODE 8 --> 27.9822807 sigma out 15 active outputs RANK 5 NODE 10 --> 27.3767166 sigma out 15 active outputs RANK 6 NODE 7 --> 24.4539108 sigma out 15 active outputs RANK 7 NODE 9 --> 23.5743752 sigma out 15 active outputs RANK 8 NODE 6 --> 21.8354473 sigma out 15 active outputs RANK 9 NODE 5 --> 16.064003 sigma out 15 active outputs RANK 10 NODE 4 --> 13.2603769 sigma out 15 active outputs RANK 11 NODE 11 --> 12.1804266 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 92.7282639 sigma in 11act. ( 116.40374 sig out 1act.) RANK 2 NODE 2 --> 34.9369164 sigma in 11act. ( 39.0813179 sig out 1act.) RANK 3 NODE 8 --> 33.2444763 sigma in 11act. ( 27.6461048 sig out 1act.) RANK 4 NODE 13 --> 20.1117725 sigma in 11act. ( 20.0458927 sig out 1act.) RANK 5 NODE 9 --> 15.6696768 sigma in 11act. ( 19.0628033 sig out 1act.) RANK 6 NODE 7 --> 13.3905468 sigma in 11act. ( 13.1172371 sig out 1act.) RANK 7 NODE 12 --> 11.1008797 sigma in 11act. ( 12.0180368 sig out 1act.) RANK 8 NODE 1 --> 8.82879639 sigma in 11act. ( 10.5400534 sig out 1act.) RANK 9 NODE 10 --> 8.7438221 sigma in 11act. ( 10.1401844 sig out 1act.) RANK 10 NODE 15 --> 8.1919136 sigma in 11act. ( 5.55504131 sig out 1act.) RANK 11 NODE 11 --> 7.10375595 sigma in 11act. ( 6.68342018 sig out 1act.) RANK 12 NODE 14 --> 6.06308508 sigma in 11act. ( 6.27502728 sig out 1act.) RANK 13 NODE 4 --> 5.39463568 sigma in 11act. ( 3.41965175 sig out 1act.) RANK 14 NODE 6 --> 4.60757065 sigma in 11act. ( 3.85409451 sig out 1act.) RANK 15 NODE 5 --> 3.85731554 sigma in 11act. ( 1.5063318 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 116.40374 sigma out 1act.( 92.7282639 sig in 11act.) RANK 2 NODE 2 --> 39.0813179 sigma out 1act.( 34.9369164 sig in 11act.) RANK 3 NODE 8 --> 27.6461048 sigma out 1act.( 33.2444763 sig in 11act.) RANK 4 NODE 13 --> 20.0458927 sigma out 1act.( 20.1117725 sig in 11act.) RANK 5 NODE 9 --> 19.0628033 sigma out 1act.( 15.6696768 sig in 11act.) RANK 6 NODE 7 --> 13.1172371 sigma out 1act.( 13.3905468 sig in 11act.) RANK 7 NODE 12 --> 12.0180368 sigma out 1act.( 11.1008797 sig in 11act.) RANK 8 NODE 1 --> 10.5400534 sigma out 1act.( 8.82879639 sig in 11act.) RANK 9 NODE 10 --> 10.1401844 sigma out 1act.( 8.7438221 sig in 11act.) RANK 10 NODE 11 --> 6.68342018 sigma out 1act.( 7.10375595 sig in 11act.) RANK 11 NODE 14 --> 6.27502728 sigma out 1act.( 6.06308508 sig in 11act.) RANK 12 NODE 15 --> 5.55504131 sigma out 1act.( 8.1919136 sig in 11act.) RANK 13 NODE 6 --> 3.85409451 sigma out 1act.( 4.60757065 sig in 11act.) RANK 14 NODE 4 --> 3.41965175 sigma out 1act.( 5.39463568 sig in 11act.) RANK 15 NODE 5 --> 1.5063318 sigma out 1act.( 3.85731554 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 131.456635 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.526974201 *** contribution from regularisation: 0.00299617741 *** contribution from error: -0.529970407 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48646.5687 0.603023052 -64.9951782 EXIT FROM BFGS code NEW_X -48646.5687 0.603023052 -64.9951782 ENTER BFGS code NEW_X -48646.5687 0.603023052 -64.9951782 EXIT FROM BFGS code FG_LNSRCH 0. 0.759649098 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.526682079 *** contribution from regularisation: 0.00316529861 *** contribution from error: -0.529847383 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48619.6021 0.759649098 -118.32692 EXIT FROM BFGS code FG_LNSRCH 0. 0.662928104 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.527135134 *** contribution from regularisation: 0.00316253118 *** contribution from error: -0.530297637 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48661.4258 0.662928104 -96.7171402 EXIT FROM BFGS code NEW_X -48661.4258 0.662928104 -96.7171402 ENTER BFGS code NEW_X -48661.4258 0.662928104 -96.7171402 EXIT FROM BFGS code FG_LNSRCH 0. 0.701424479 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.527520239 *** contribution from regularisation: 0.00315590855 *** contribution from error: -0.530676126 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48696.9746 0.701424479 -5.8225975 EXIT FROM BFGS code NEW_X -48696.9746 0.701424479 -5.8225975 ENTER BFGS code NEW_X -48696.9746 0.701424479 -5.8225975 EXIT FROM BFGS code FG_LNSRCH 0. 0.685378194 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.527900696 *** contribution from regularisation: 0.00319523294 *** contribution from error: -0.531095922 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48732.0953 0.685378194 4.78972435 EXIT FROM BFGS code NEW_X -48732.0953 0.685378194 4.78972435 ENTER BFGS code NEW_X -48732.0953 0.685378194 4.78972435 EXIT FROM BFGS code FG_LNSRCH 0. 0.62951225 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.528359294 *** contribution from regularisation: 0.00321060373 *** contribution from error: -0.531569898 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48774.4314 0.62951225 55.7773781 EXIT FROM BFGS code NEW_X -48774.4314 0.62951225 55.7773781 ENTER BFGS code NEW_X -48774.4314 0.62951225 55.7773781 EXIT FROM BFGS code FG_LNSRCH 0. 0.635846913 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.528459609 *** contribution from regularisation: 0.00318300189 *** contribution from error: -0.531642616 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48783.6911 0.635846913 -32.7886009 EXIT FROM BFGS code NEW_X -48783.6911 0.635846913 -32.7886009 ENTER BFGS code NEW_X -48783.6911 0.635846913 -32.7886009 EXIT FROM BFGS code FG_LNSRCH 0. 0.637971461 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.528597951 *** contribution from regularisation: 0.00322225527 *** contribution from error: -0.531820178 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48796.4614 0.637971461 -21.1673832 EXIT FROM BFGS code NEW_X -48796.4614 0.637971461 -21.1673832 ENTER BFGS code NEW_X -48796.4614 0.637971461 -21.1673832 EXIT FROM BFGS code FG_LNSRCH 0. 0.633421421 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.528688908 *** contribution from regularisation: 0.00320693199 *** contribution from error: -0.531895816 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48804.8609 0.633421421 -12.5860882 EXIT FROM BFGS code NEW_X -48804.8609 0.633421421 -12.5860882 ENTER BFGS code NEW_X -48804.8609 0.633421421 -12.5860882 EXIT FROM BFGS code FG_LNSRCH 0. 0.616726756 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.528875947 *** contribution from regularisation: 0.003156021 *** contribution from error: -0.532031953 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48822.1267 0.616726756 -16.1073494 EXIT FROM BFGS code NEW_X -48822.1267 0.616726756 -16.1073494 ENTER BFGS code NEW_X -48822.1267 0.616726756 -16.1073494 EXIT FROM BFGS code FG_LNSRCH 0. 0.588994503 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 91.8454819 sigma out 15 active outputs RANK 2 NODE 1 --> 40.0528336 sigma out 15 active outputs RANK 3 NODE 10 --> 39.2803688 sigma out 15 active outputs RANK 4 NODE 8 --> 38.6881104 sigma out 15 active outputs RANK 5 NODE 9 --> 36.3872414 sigma out 15 active outputs RANK 6 NODE 3 --> 36.098175 sigma out 15 active outputs RANK 7 NODE 7 --> 29.9785805 sigma out 15 active outputs RANK 8 NODE 6 --> 26.7149849 sigma out 15 active outputs RANK 9 NODE 5 --> 23.1539059 sigma out 15 active outputs RANK 10 NODE 4 --> 19.1399498 sigma out 15 active outputs RANK 11 NODE 11 --> 15.3624258 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 104.328827 sigma in 11act. ( 129.406738 sig out 1act.) RANK 2 NODE 8 --> 54.0450325 sigma in 11act. ( 49.7669029 sig out 1act.) RANK 3 NODE 2 --> 44.0483284 sigma in 11act. ( 48.9455528 sig out 1act.) RANK 4 NODE 13 --> 34.0276947 sigma in 11act. ( 34.7885246 sig out 1act.) RANK 5 NODE 7 --> 22.4510994 sigma in 11act. ( 21.7221584 sig out 1act.) RANK 6 NODE 9 --> 18.8588676 sigma in 11act. ( 23.3192558 sig out 1act.) RANK 7 NODE 12 --> 12.773016 sigma in 11act. ( 14.65446 sig out 1act.) RANK 8 NODE 1 --> 12.3585796 sigma in 11act. ( 15.587678 sig out 1act.) RANK 9 NODE 10 --> 11.1296911 sigma in 11act. ( 13.28545 sig out 1act.) RANK 10 NODE 15 --> 10.2311239 sigma in 11act. ( 8.60144806 sig out 1act.) RANK 11 NODE 11 --> 8.13128281 sigma in 11act. ( 8.63387108 sig out 1act.) RANK 12 NODE 14 --> 6.51021576 sigma in 11act. ( 7.05793381 sig out 1act.) RANK 13 NODE 6 --> 4.97422647 sigma in 11act. ( 4.61509991 sig out 1act.) RANK 14 NODE 4 --> 3.11759448 sigma in 11act. ( 1.21141493 sig out 1act.) RANK 15 NODE 5 --> 2.62444019 sigma in 11act. ( 1.03031063 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 129.406738 sigma out 1act.( 104.328827 sig in 11act.) RANK 2 NODE 8 --> 49.7669029 sigma out 1act.( 54.0450325 sig in 11act.) RANK 3 NODE 2 --> 48.9455528 sigma out 1act.( 44.0483284 sig in 11act.) RANK 4 NODE 13 --> 34.7885246 sigma out 1act.( 34.0276947 sig in 11act.) RANK 5 NODE 9 --> 23.3192558 sigma out 1act.( 18.8588676 sig in 11act.) RANK 6 NODE 7 --> 21.7221584 sigma out 1act.( 22.4510994 sig in 11act.) RANK 7 NODE 1 --> 15.587678 sigma out 1act.( 12.3585796 sig in 11act.) RANK 8 NODE 12 --> 14.65446 sigma out 1act.( 12.773016 sig in 11act.) RANK 9 NODE 10 --> 13.28545 sigma out 1act.( 11.1296911 sig in 11act.) RANK 10 NODE 11 --> 8.63387108 sigma out 1act.( 8.13128281 sig in 11act.) RANK 11 NODE 15 --> 8.60144806 sigma out 1act.( 10.2311239 sig in 11act.) RANK 12 NODE 14 --> 7.05793381 sigma out 1act.( 6.51021576 sig in 11act.) RANK 13 NODE 6 --> 4.61509991 sigma out 1act.( 4.97422647 sig in 11act.) RANK 14 NODE 4 --> 1.21141493 sigma out 1act.( 3.11759448 sig in 11act.) RANK 15 NODE 5 --> 1.03031063 sigma out 1act.( 2.62444019 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 157.164886 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.528960109 *** contribution from regularisation: 0.00317244628 *** contribution from error: -0.532132566 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48829.8969 0.588994503 35.2082558 EXIT FROM BFGS code NEW_X -48829.8969 0.588994503 35.2082558 ENTER BFGS code NEW_X -48829.8969 0.588994503 35.2082558 EXIT FROM BFGS code FG_LNSRCH 0. 0.563555181 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.528968692 *** contribution from regularisation: 0.00317056943 *** contribution from error: -0.532139242 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48830.6843 0.563555181 -76.4071808 EXIT FROM BFGS code NEW_X -48830.6843 0.563555181 -76.4071808 ENTER BFGS code NEW_X -48830.6843 0.563555181 -76.4071808 EXIT FROM BFGS code FG_LNSRCH 0. 0.557364881 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.529028535 *** contribution from regularisation: 0.00326621858 *** contribution from error: -0.53229475 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48836.2089 0.557364881 -14.6437006 EXIT FROM BFGS code NEW_X -48836.2089 0.557364881 -14.6437006 ENTER BFGS code NEW_X -48836.2089 0.557364881 -14.6437006 EXIT FROM BFGS code FG_LNSRCH 0. 0.54192853 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.529203475 *** contribution from regularisation: 0.00324486033 *** contribution from error: -0.532448351 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48852.3621 0.54192853 24.90765 EXIT FROM BFGS code NEW_X -48852.3621 0.54192853 24.90765 ENTER BFGS code NEW_X -48852.3621 0.54192853 24.90765 EXIT FROM BFGS code FG_LNSRCH 0. 0.498874307 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.529413283 *** contribution from regularisation: 0.00323767634 *** contribution from error: -0.532650948 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48871.7303 0.498874307 68.2137451 EXIT FROM BFGS code NEW_X -48871.7303 0.498874307 68.2137451 ENTER BFGS code NEW_X -48871.7303 0.498874307 68.2137451 EXIT FROM BFGS code FG_LNSRCH 0. 0.460971117 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.529439211 *** contribution from regularisation: 0.00327555835 *** contribution from error: -0.532714784 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48874.1203 0.460971117 -33.9344597 EXIT FROM BFGS code NEW_X -48874.1203 0.460971117 -33.9344597 ENTER BFGS code NEW_X -48874.1203 0.460971117 -33.9344597 EXIT FROM BFGS code FG_LNSRCH 0. 0.449272364 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.529541552 *** contribution from regularisation: 0.00334471604 *** contribution from error: -0.532886267 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48883.5715 0.449272364 7.57282257 EXIT FROM BFGS code NEW_X -48883.5715 0.449272364 7.57282257 ENTER BFGS code NEW_X -48883.5715 0.449272364 7.57282257 EXIT FROM BFGS code FG_LNSRCH 0. 0.449416995 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.529646337 *** contribution from regularisation: 0.00334221777 *** contribution from error: -0.532988548 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48893.2424 0.449416995 12.4384298 EXIT FROM BFGS code NEW_X -48893.2424 0.449416995 12.4384298 ENTER BFGS code NEW_X -48893.2424 0.449416995 12.4384298 EXIT FROM BFGS code FG_LNSRCH 0. 0.426232874 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.530015886 *** contribution from regularisation: 0.00334563502 *** contribution from error: -0.533361495 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48927.354 0.426232874 94.2396927 EXIT FROM BFGS code NEW_X -48927.354 0.426232874 94.2396927 ENTER BFGS code NEW_X -48927.354 0.426232874 94.2396927 EXIT FROM BFGS code FG_LNSRCH 0. 0.424647063 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.530183196 *** contribution from regularisation: 0.00340181449 *** contribution from error: -0.533585012 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48942.8023 0.424647063 -30.0464478 EXIT FROM BFGS code NEW_X -48942.8023 0.424647063 -30.0464478 ENTER BFGS code NEW_X -48942.8023 0.424647063 -30.0464478 EXIT FROM BFGS code FG_LNSRCH 0. 0.416174918 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 103.989029 sigma out 15 active outputs RANK 2 NODE 1 --> 67.1461639 sigma out 15 active outputs RANK 3 NODE 8 --> 50.6042671 sigma out 15 active outputs RANK 4 NODE 9 --> 49.7297173 sigma out 15 active outputs RANK 5 NODE 3 --> 44.1740074 sigma out 15 active outputs RANK 6 NODE 10 --> 43.642498 sigma out 15 active outputs RANK 7 NODE 7 --> 40.2423706 sigma out 15 active outputs RANK 8 NODE 4 --> 33.3023224 sigma out 15 active outputs RANK 9 NODE 6 --> 24.6136189 sigma out 15 active outputs RANK 10 NODE 5 --> 23.9578037 sigma out 15 active outputs RANK 11 NODE 11 --> 16.8924618 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 112.039093 sigma in 11act. ( 141.849289 sig out 1act.) RANK 2 NODE 8 --> 77.3505707 sigma in 11act. ( 78.1469345 sig out 1act.) RANK 3 NODE 7 --> 55.7468872 sigma in 11act. ( 51.8595619 sig out 1act.) RANK 4 NODE 13 --> 54.5492897 sigma in 11act. ( 57.684845 sig out 1act.) RANK 5 NODE 2 --> 48.0685883 sigma in 11act. ( 54.2637901 sig out 1act.) RANK 6 NODE 9 --> 20.3105698 sigma in 11act. ( 25.2168484 sig out 1act.) RANK 7 NODE 1 --> 19.6287594 sigma in 11act. ( 24.2334518 sig out 1act.) RANK 8 NODE 12 --> 14.2325029 sigma in 11act. ( 16.2774677 sig out 1act.) RANK 9 NODE 10 --> 12.8712206 sigma in 11act. ( 14.5739174 sig out 1act.) RANK 10 NODE 15 --> 11.4525585 sigma in 11act. ( 8.72999954 sig out 1act.) RANK 11 NODE 11 --> 9.57361507 sigma in 11act. ( 10.5551157 sig out 1act.) RANK 12 NODE 14 --> 7.50410175 sigma in 11act. ( 8.05969334 sig out 1act.) RANK 13 NODE 6 --> 5.07138205 sigma in 11act. ( 4.92675257 sig out 1act.) RANK 14 NODE 5 --> 1.65008473 sigma in 11act. ( 1.21433306 sig out 1act.) RANK 15 NODE 4 --> 1.55644941 sigma in 11act. ( 0.443235636 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 141.849289 sigma out 1act.( 112.039093 sig in 11act.) RANK 2 NODE 8 --> 78.1469345 sigma out 1act.( 77.3505707 sig in 11act.) RANK 3 NODE 13 --> 57.684845 sigma out 1act.( 54.5492897 sig in 11act.) RANK 4 NODE 2 --> 54.2637901 sigma out 1act.( 48.0685883 sig in 11act.) RANK 5 NODE 7 --> 51.8595619 sigma out 1act.( 55.7468872 sig in 11act.) RANK 6 NODE 9 --> 25.2168484 sigma out 1act.( 20.3105698 sig in 11act.) RANK 7 NODE 1 --> 24.2334518 sigma out 1act.( 19.6287594 sig in 11act.) RANK 8 NODE 12 --> 16.2774677 sigma out 1act.( 14.2325029 sig in 11act.) RANK 9 NODE 10 --> 14.5739174 sigma out 1act.( 12.8712206 sig in 11act.) RANK 10 NODE 11 --> 10.5551157 sigma out 1act.( 9.57361507 sig in 11act.) RANK 11 NODE 15 --> 8.72999954 sigma out 1act.( 11.4525585 sig in 11act.) RANK 12 NODE 14 --> 8.05969334 sigma out 1act.( 7.50410175 sig in 11act.) RANK 13 NODE 6 --> 4.92675257 sigma out 1act.( 5.07138205 sig in 11act.) RANK 14 NODE 5 --> 1.21433306 sigma out 1act.( 1.65008473 sig in 11act.) RANK 15 NODE 4 --> 0.443235636 sigma out 1act.( 1.55644941 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 192.791885 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.530364931 *** contribution from regularisation: 0.00341828447 *** contribution from error: -0.533783197 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48959.577 0.416174918 59.7898254 EXIT FROM BFGS code NEW_X -48959.577 0.416174918 59.7898254 ENTER BFGS code NEW_X -48959.577 0.416174918 59.7898254 EXIT FROM BFGS code FG_LNSRCH 0. 0.423200756 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.530427754 *** contribution from regularisation: 0.00341243204 *** contribution from error: -0.533840179 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48965.3777 0.423200756 15.7377853 EXIT FROM BFGS code NEW_X -48965.3777 0.423200756 15.7377853 ENTER BFGS code NEW_X -48965.3777 0.423200756 15.7377853 EXIT FROM BFGS code FG_LNSRCH 0. 0.430194855 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.530511081 *** contribution from regularisation: 0.00340629998 *** contribution from error: -0.533917367 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48973.0679 0.430194855 -3.23476481 EXIT FROM BFGS code NEW_X -48973.0679 0.430194855 -3.23476481 ENTER BFGS code NEW_X -48973.0679 0.430194855 -3.23476481 EXIT FROM BFGS code FG_LNSRCH 0. 0.455345213 0. --------------------------------------------------- Iteration : 43 *********************************************** *** Learn Path 43 *** loss function: -0.530703664 *** contribution from regularisation: 0.00343546667 *** contribution from error: -0.534139156 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48990.8463 0.455345213 -45.5955544 EXIT FROM BFGS code NEW_X -48990.8463 0.455345213 -45.5955544 ENTER BFGS code NEW_X -48990.8463 0.455345213 -45.5955544 EXIT FROM BFGS code FG_LNSRCH 0. 0.474123836 0. --------------------------------------------------- Iteration : 44 *********************************************** *** Learn Path 44 *** loss function: -0.530732393 *** contribution from regularisation: 0.00344258174 *** contribution from error: -0.534174979 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48993.5008 0.474123836 93.9914474 EXIT FROM BFGS code FG_LNSRCH 0. 0.465218633 0. --------------------------------------------------- Iteration : 45 *********************************************** *** Learn Path 45 *** loss function: -0.530786574 *** contribution from regularisation: 0.00343828602 *** contribution from error: -0.534224868 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48998.5022 0.465218633 25.2591515 EXIT FROM BFGS code NEW_X -48998.5022 0.465218633 25.2591515 ENTER BFGS code NEW_X -48998.5022 0.465218633 25.2591515 EXIT FROM BFGS code FG_LNSRCH 0. 0.4795883 0. --------------------------------------------------- Iteration : 46 *********************************************** *** Learn Path 46 *** loss function: -0.530887067 *** contribution from regularisation: 0.00343658216 *** contribution from error: -0.534323633 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49007.7787 0.4795883 32.2207108 EXIT FROM BFGS code NEW_X -49007.7787 0.4795883 32.2207108 ENTER BFGS code NEW_X -49007.7787 0.4795883 32.2207108 EXIT FROM BFGS code FG_LNSRCH 0. 0.493019104 0. --------------------------------------------------- Iteration : 47 *********************************************** *** Learn Path 47 *** loss function: -0.530936778 *** contribution from regularisation: 0.00345053128 *** contribution from error: -0.53438729 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49012.3648 0.493019104 12.6132946 EXIT FROM BFGS code NEW_X -49012.3648 0.493019104 12.6132946 ENTER BFGS code NEW_X -49012.3648 0.493019104 12.6132946 EXIT FROM BFGS code FG_LNSRCH 0. 0.517174244 0. --------------------------------------------------- Iteration : 48 *********************************************** *** Learn Path 48 *** loss function: -0.531049013 *** contribution from regularisation: 0.00344498712 *** contribution from error: -0.534493983 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49022.7269 0.517174244 61.1946182 EXIT FROM BFGS code NEW_X -49022.7269 0.517174244 61.1946182 ENTER BFGS code NEW_X -49022.7269 0.517174244 61.1946182 EXIT FROM BFGS code FG_LNSRCH 0. 0.55185014 0. --------------------------------------------------- Iteration : 49 *********************************************** *** Learn Path 49 *** loss function: -0.531154335 *** contribution from regularisation: 0.00345978257 *** contribution from error: -0.534614146 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49032.4498 0.55185014 -1.46730828 EXIT FROM BFGS code NEW_X -49032.4498 0.55185014 -1.46730828 ENTER BFGS code NEW_X -49032.4498 0.55185014 -1.46730828 EXIT FROM BFGS code FG_LNSRCH 0. 0.586375952 0. --------------------------------------------------- Iteration : 50 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 113.026459 sigma out 15 active outputs RANK 2 NODE 1 --> 87.3254013 sigma out 15 active outputs RANK 3 NODE 9 --> 52.0363197 sigma out 15 active outputs RANK 4 NODE 3 --> 49.5374908 sigma out 15 active outputs RANK 5 NODE 10 --> 49.2569504 sigma out 15 active outputs RANK 6 NODE 8 --> 48.077198 sigma out 15 active outputs RANK 7 NODE 7 --> 40.5903091 sigma out 15 active outputs RANK 8 NODE 4 --> 39.7880363 sigma out 15 active outputs RANK 9 NODE 5 --> 29.7582359 sigma out 15 active outputs RANK 10 NODE 6 --> 27.1645164 sigma out 15 active outputs RANK 11 NODE 11 --> 21.0020313 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 115.907372 sigma in 11act. ( 154.917618 sig out 1act.) RANK 2 NODE 8 --> 82.5581665 sigma in 11act. ( 89.7676926 sig out 1act.) RANK 3 NODE 7 --> 79.5318527 sigma in 11act. ( 75.0097961 sig out 1act.) RANK 4 NODE 13 --> 59.6702614 sigma in 11act. ( 62.7656174 sig out 1act.) RANK 5 NODE 2 --> 57.6464157 sigma in 11act. ( 62.58955 sig out 1act.) RANK 6 NODE 1 --> 26.7319336 sigma in 11act. ( 30.932066 sig out 1act.) RANK 7 NODE 9 --> 23.7704182 sigma in 11act. ( 27.3864079 sig out 1act.) RANK 8 NODE 12 --> 16.543932 sigma in 11act. ( 18.0886784 sig out 1act.) RANK 9 NODE 10 --> 15.4951553 sigma in 11act. ( 15.87327 sig out 1act.) RANK 10 NODE 15 --> 11.9034863 sigma in 11act. ( 10.1932526 sig out 1act.) RANK 11 NODE 11 --> 9.69391823 sigma in 11act. ( 10.7824087 sig out 1act.) RANK 12 NODE 14 --> 8.74385834 sigma in 11act. ( 9.05605793 sig out 1act.) RANK 13 NODE 6 --> 5.30248642 sigma in 11act. ( 5.20964146 sig out 1act.) RANK 14 NODE 5 --> 1.33320582 sigma in 11act. ( 1.24954855 sig out 1act.) RANK 15 NODE 4 --> 0.735121548 sigma in 11act. ( 0.242023364 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 154.917618 sigma out 1act.( 115.907372 sig in 11act.) RANK 2 NODE 8 --> 89.7676926 sigma out 1act.( 82.5581665 sig in 11act.) RANK 3 NODE 7 --> 75.0097961 sigma out 1act.( 79.5318527 sig in 11act.) RANK 4 NODE 13 --> 62.7656174 sigma out 1act.( 59.6702614 sig in 11act.) RANK 5 NODE 2 --> 62.58955 sigma out 1act.( 57.6464157 sig in 11act.) RANK 6 NODE 1 --> 30.932066 sigma out 1act.( 26.7319336 sig in 11act.) RANK 7 NODE 9 --> 27.3864079 sigma out 1act.( 23.7704182 sig in 11act.) RANK 8 NODE 12 --> 18.0886784 sigma out 1act.( 16.543932 sig in 11act.) RANK 9 NODE 10 --> 15.87327 sigma out 1act.( 15.4951553 sig in 11act.) RANK 10 NODE 11 --> 10.7824087 sigma out 1act.( 9.69391823 sig in 11act.) RANK 11 NODE 15 --> 10.1932526 sigma out 1act.( 11.9034863 sig in 11act.) RANK 12 NODE 14 --> 9.05605793 sigma out 1act.( 8.74385834 sig in 11act.) RANK 13 NODE 6 --> 5.20964146 sigma out 1act.( 5.30248642 sig in 11act.) RANK 14 NODE 5 --> 1.24954855 sigma out 1act.( 1.33320582 sig in 11act.) RANK 15 NODE 4 --> 0.242023364 sigma out 1act.( 0.735121548 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 219.449448 sigma in 15 active inputs *********************************************** *** Learn Path 50 *** loss function: -0.531230807 *** contribution from regularisation: 0.0034566212 *** contribution from error: -0.5346874 *********************************************** -----------------> Test sample Iteration No: 50 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49039.5084 0.586375952 83.3139267 EXIT FROM BFGS code NEW_X -49039.5084 0.586375952 83.3139267 ENTER BFGS code NEW_X -49039.5084 0.586375952 83.3139267 EXIT FROM BFGS code FG_LNSRCH 0. 0.595205188 0. --------------------------------------------------- Iteration : 51 *********************************************** *** Learn Path 51 *** loss function: -0.531274974 *** contribution from regularisation: 0.00346661801 *** contribution from error: -0.53474158 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49043.588 0.595205188 33.2262268 EXIT FROM BFGS code NEW_X -49043.588 0.595205188 33.2262268 ENTER BFGS code NEW_X -49043.588 0.595205188 33.2262268 EXIT FROM BFGS code FG_LNSRCH 0. 0.601203263 0. --------------------------------------------------- Iteration : 52 *********************************************** *** Learn Path 52 *** loss function: -0.53130734 *** contribution from regularisation: 0.00345976604 *** contribution from error: -0.534767091 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49046.5739 0.601203263 7.45181179 EXIT FROM BFGS code NEW_X -49046.5739 0.601203263 7.45181179 ENTER BFGS code NEW_X -49046.5739 0.601203263 7.45181179 EXIT FROM BFGS code FG_LNSRCH 0. 0.637821734 0. --------------------------------------------------- Iteration : 53 *********************************************** *** Learn Path 53 *** loss function: -0.531406939 *** contribution from regularisation: 0.00341602811 *** contribution from error: -0.534822941 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49055.7708 0.637821734 14.0821705 EXIT FROM BFGS code NEW_X -49055.7708 0.637821734 14.0821705 ENTER BFGS code NEW_X -49055.7708 0.637821734 14.0821705 EXIT FROM BFGS code FG_LNSRCH 0. 0.703285813 0. --------------------------------------------------- Iteration : 54 *********************************************** *** Learn Path 54 *** loss function: -0.531163573 *** contribution from regularisation: 0.00339985476 *** contribution from error: -0.534563422 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49033.3052 0.703285813 -260.739014 EXIT FROM BFGS code FG_LNSRCH 0. 0.649505794 0. --------------------------------------------------- Iteration : 55 *********************************************** *** Learn Path 55 *** loss function: -0.531308055 *** contribution from regularisation: 0.00353596942 *** contribution from error: -0.534844041 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49046.643 0.649505794 -33.5338936 EXIT FROM BFGS code FG_LNSRCH 0. 0.638451576 0. --------------------------------------------------- Iteration : 56 *********************************************** *** Learn Path 56 *** loss function: -0.531342208 *** contribution from regularisation: 0.00348299416 *** contribution from error: -0.534825206 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49049.7947 0.638451576 11.5053902 EXIT FROM BFGS code FG_LNSRCH 0. 0.637825191 0. --------------------------------------------------- Iteration : 57 *********************************************** *** Learn Path 57 *** loss function: -0.531358123 *** contribution from regularisation: 0.00346486969 *** contribution from error: -0.534823 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49051.26 0.637825191 14.0647297 EXIT FROM BFGS code FG_LNSRCH 0. 0.637821734 0. --------------------------------------------------- Iteration : 58 *********************************************** *** Learn Path 58 *** loss function: -0.531343579 *** contribution from regularisation: 0.00347943162 *** contribution from error: -0.534823 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49049.9178 0.637821734 14.080121 EXIT FROM BFGS code FG_LNSRCH 0. 0.637821734 0. --------------------------------------------------- Iteration : 59 *********************************************** *** Learn Path 59 *** loss function: -0.53134799 *** contribution from regularisation: 0.00347497733 *** contribution from error: -0.534822941 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49050.329 0.637821734 14.0852003 EXIT FROM BFGS code FG_LNSRCH 0. 0.637821734 0. --------------------------------------------------- Iteration : 60 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 113.906036 sigma out 15 active outputs RANK 2 NODE 1 --> 89.9238052 sigma out 15 active outputs RANK 3 NODE 9 --> 52.9915619 sigma out 15 active outputs RANK 4 NODE 10 --> 50.4291725 sigma out 15 active outputs RANK 5 NODE 3 --> 49.1030312 sigma out 15 active outputs RANK 6 NODE 8 --> 48.6669617 sigma out 15 active outputs RANK 7 NODE 7 --> 41.3809891 sigma out 15 active outputs RANK 8 NODE 4 --> 36.9394722 sigma out 15 active outputs RANK 9 NODE 5 --> 28.5538731 sigma out 15 active outputs RANK 10 NODE 6 --> 28.2338581 sigma out 15 active outputs RANK 11 NODE 11 --> 19.4683323 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 118.195595 sigma in 11act. ( 152.321365 sig out 1act.) RANK 2 NODE 8 --> 83.9029236 sigma in 11act. ( 89.3418121 sig out 1act.) RANK 3 NODE 7 --> 79.7881775 sigma in 11act. ( 76.3555756 sig out 1act.) RANK 4 NODE 2 --> 58.4377556 sigma in 11act. ( 65.1424866 sig out 1act.) RANK 5 NODE 13 --> 57.3555756 sigma in 11act. ( 61.4618874 sig out 1act.) RANK 6 NODE 1 --> 27.7895679 sigma in 11act. ( 31.6099606 sig out 1act.) RANK 7 NODE 9 --> 23.5530682 sigma in 11act. ( 27.5574169 sig out 1act.) RANK 8 NODE 12 --> 16.6835594 sigma in 11act. ( 18.139658 sig out 1act.) RANK 9 NODE 10 --> 15.4787455 sigma in 11act. ( 15.716856 sig out 1act.) RANK 10 NODE 15 --> 12.2087955 sigma in 11act. ( 9.58080387 sig out 1act.) RANK 11 NODE 11 --> 9.25751877 sigma in 11act. ( 10.2725487 sig out 1act.) RANK 12 NODE 14 --> 8.40901947 sigma in 11act. ( 8.73377609 sig out 1act.) RANK 13 NODE 6 --> 5.1832552 sigma in 11act. ( 4.82652283 sig out 1act.) RANK 14 NODE 5 --> 1.28717875 sigma in 11act. ( 1.19587874 sig out 1act.) RANK 15 NODE 4 --> 0.670970738 sigma in 11act. ( 0.199737757 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 152.321365 sigma out 1act.( 118.195595 sig in 11act.) RANK 2 NODE 8 --> 89.3418121 sigma out 1act.( 83.9029236 sig in 11act.) RANK 3 NODE 7 --> 76.3555756 sigma out 1act.( 79.7881775 sig in 11act.) RANK 4 NODE 2 --> 65.1424866 sigma out 1act.( 58.4377556 sig in 11act.) RANK 5 NODE 13 --> 61.4618874 sigma out 1act.( 57.3555756 sig in 11act.) RANK 6 NODE 1 --> 31.6099606 sigma out 1act.( 27.7895679 sig in 11act.) RANK 7 NODE 9 --> 27.5574169 sigma out 1act.( 23.5530682 sig in 11act.) RANK 8 NODE 12 --> 18.139658 sigma out 1act.( 16.6835594 sig in 11act.) RANK 9 NODE 10 --> 15.716856 sigma out 1act.( 15.4787455 sig in 11act.) RANK 10 NODE 11 --> 10.2725487 sigma out 1act.( 9.25751877 sig in 11act.) RANK 11 NODE 15 --> 9.58080387 sigma out 1act.( 12.2087955 sig in 11act.) RANK 12 NODE 14 --> 8.73377609 sigma out 1act.( 8.40901947 sig in 11act.) RANK 13 NODE 6 --> 4.82652283 sigma out 1act.( 5.1832552 sig in 11act.) RANK 14 NODE 5 --> 1.19587874 sigma out 1act.( 1.28717875 sig in 11act.) RANK 15 NODE 4 --> 0.199737757 sigma out 1act.( 0.670970738 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 218.330154 sigma in 15 active inputs *********************************************** *** Learn Path 60 *** loss function: -0.531348109 *** contribution from regularisation: 0.00347489631 *** contribution from error: -0.534823 *********************************************** -----------------> Test sample Iteration No: 60 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49050.3365 0.637821734 14.0805721 EXIT FROM BFGS code FG_LNSRCH 0. 0.637821734 0. --------------------------------------------------- Iteration : 61 *********************************************** *** Learn Path 61 *** loss function: -0.531356752 *** contribution from regularisation: 0.0034662392 *** contribution from error: -0.534823 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49051.1357 0.637821734 14.0874472 EXIT FROM BFGS code NEW_X -49051.1357 0.637821734 14.0874472 ENTER BFGS code NEW_X -49051.1357 0.637821734 14.0874472 EXIT FROM BFGS code CONVERGENC -49051.1357 0.637821734 14.0874472 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 177.846603 sigma out 15 active outputs RANK 2 NODE 1 --> 141.812012 sigma out 15 active outputs RANK 3 NODE 9 --> 83.8613892 sigma out 15 active outputs RANK 4 NODE 10 --> 82.0216751 sigma out 15 active outputs RANK 5 NODE 8 --> 79.2748184 sigma out 15 active outputs RANK 6 NODE 3 --> 78.7904282 sigma out 15 active outputs RANK 7 NODE 7 --> 67.3478165 sigma out 15 active outputs RANK 8 NODE 4 --> 61.9503212 sigma out 15 active outputs RANK 9 NODE 5 --> 44.384304 sigma out 15 active outputs RANK 10 NODE 6 --> 44.2300491 sigma out 15 active outputs RANK 11 NODE 11 --> 30.3806076 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 184.896744 sigma in 11act. ( 245.057358 sig out 1act.) RANK 2 NODE 8 --> 133.825821 sigma in 11act. ( 143.471313 sig out 1act.) RANK 3 NODE 7 --> 127.037544 sigma in 11act. ( 121.388474 sig out 1act.) RANK 4 NODE 2 --> 93.9678116 sigma in 11act. ( 103.19017 sig out 1act.) RANK 5 NODE 13 --> 92.7205124 sigma in 11act. ( 97.7225113 sig out 1act.) RANK 6 NODE 1 --> 44.2838745 sigma in 11act. ( 51.9275055 sig out 1act.) RANK 7 NODE 9 --> 38.1140099 sigma in 11act. ( 43.6106949 sig out 1act.) RANK 8 NODE 12 --> 26.556879 sigma in 11act. ( 29.329628 sig out 1act.) RANK 9 NODE 10 --> 24.8722744 sigma in 11act. ( 25.2797985 sig out 1act.) RANK 10 NODE 15 --> 18.776123 sigma in 11act. ( 16.5160866 sig out 1act.) RANK 11 NODE 11 --> 14.6749268 sigma in 11act. ( 16.7242393 sig out 1act.) RANK 12 NODE 14 --> 13.4074602 sigma in 11act. ( 14.0434179 sig out 1act.) RANK 13 NODE 6 --> 8.03580952 sigma in 11act. ( 8.14722157 sig out 1act.) RANK 14 NODE 5 --> 1.86195779 sigma in 11act. ( 1.87469947 sig out 1act.) RANK 15 NODE 4 --> 0.718985558 sigma in 11act. ( 0.339602143 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 245.057358 sigma out 1act.( 184.896744 sig in 11act.) RANK 2 NODE 8 --> 143.471313 sigma out 1act.( 133.825821 sig in 11act.) RANK 3 NODE 7 --> 121.388474 sigma out 1act.( 127.037544 sig in 11act.) RANK 4 NODE 2 --> 103.19017 sigma out 1act.( 93.9678116 sig in 11act.) RANK 5 NODE 13 --> 97.7225113 sigma out 1act.( 92.7205124 sig in 11act.) RANK 6 NODE 1 --> 51.9275055 sigma out 1act.( 44.2838745 sig in 11act.) RANK 7 NODE 9 --> 43.6106949 sigma out 1act.( 38.1140099 sig in 11act.) RANK 8 NODE 12 --> 29.329628 sigma out 1act.( 26.556879 sig in 11act.) RANK 9 NODE 10 --> 25.2797985 sigma out 1act.( 24.8722744 sig in 11act.) RANK 10 NODE 11 --> 16.7242393 sigma out 1act.( 14.6749268 sig in 11act.) RANK 11 NODE 15 --> 16.5160866 sigma out 1act.( 18.776123 sig in 11act.) RANK 12 NODE 14 --> 14.0434179 sigma out 1act.( 13.4074602 sig in 11act.) RANK 13 NODE 6 --> 8.14722157 sigma out 1act.( 8.03580952 sig in 11act.) RANK 14 NODE 5 --> 1.87469947 sigma out 1act.( 1.86195779 sig in 11act.) RANK 15 NODE 4 --> 0.339602143 sigma out 1act.( 0.718985558 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 349.982208 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.531355083 *** contribution from regularisation: 0.00346790301 *** contribution from error: -0.534823 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 33955 Closing output file done