NNInput NNInputs_165.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 192111 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 55775 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 55775 Chosen entries: 55775 Signal fraction: 1 Background fraction: 0.4091 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 55775 Entries to split: 55775 Test with : 27887 Train with : 27887 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 55775 for Signal Prepared event 0 for Signal with 55775 events ====Entry 0 Variable Ht : 267.874 Variable LepAPt : 45.292 Variable LepBPt : 35.604 Variable MetSigLeptonsJets : 7.24556 Variable MetSpec : 95.2083 Variable SumEtLeptonsJets : 172.666 Variable VSumJetLeptonsPt : 107.325 Variable addEt : 176.104 Variable dPhiLepSumMet : 2.28406 Variable dPhiLeptons : 0.0254087 Variable dRLeptons : 0.325152 Variable lep1_E : 46.0978 Variable lep2_E : 40.383 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2165 Ht = 267.874 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 45.2922 LepAPt = 45.292 LepBEt = 35.604 LepBPt = 35.604 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 95.2083 MetDelPhi = 2.19471 MetSig = 6.53886 MetSigLeptonsJets = 7.24556 MetSpec = 95.2083 Mjj = 0 MostCentralJetEta = -1.47546 MtllMet = 179.575 Njets = 1 SB = 0 SumEt = 212.005 SumEtJets = 0 SumEtLeptonsJets = 172.666 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 107.325 addEt = 176.104 dPhiLepSumMet = 2.28406 dPhiLeptons = 0.0254087 dRLeptons = 0.325152 diltype = 52 dimass = 13.1154 event = 77 jet1_Et = 91.7697 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.0978 lep2_E = 40.383 rand = 0.999742 run = 237144 weight = 4.01724e-06 ===Show End Prepared event 10000 for Signal with 55775 events Prepared event 20000 for Signal with 55775 events Prepared event 30000 for Signal with 55775 events Prepared event 40000 for Signal with 55775 events Prepared event 50000 for Signal with 55775 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.401215 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4362 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 192111 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4362 negative weights. Signal fraction: 62.3745499 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.5992584 66.0638733 67.3902969 68.5633392 69.7943878 70.7371368 71.6665878 72.5639343 73.5213928 74.374588 75.1562805 75.8234482 76.6270142 77.1060638 77.9333878 78.6973419 79.361618 79.9466019 80.7141418 81.3691254 82.2880402 82.9842224 83.7581482 84.7678833 85.9843979 87.0054932 88.4787674 89.3946304 91.1163483 92.4805832 93.6782303 95.4609375 97.0541 98.85112 100.229057 101.887222 103.513916 104.803658 106.48616 108.325073 110.060387 111.78891 113.562416 115.457748 117.235573 119.105721 121.014267 122.811371 124.556137 126.329948 128.094177 129.738403 131.352921 133.069321 134.461334 136.15155 137.736328 139.260284 140.755371 142.425018 144.014633 145.50386 146.762344 148.147217 149.526672 150.817688 152.34845 153.684509 155.085358 156.372559 157.822952 159.167236 160.675751 162.280029 164.065521 165.814728 167.809784 169.813049 171.953903 174.404327 177.00769 179.56662 182.358383 185.400238 188.477402 191.666092 194.788239 198.263962 202.305389 206.805969 211.400452 217.244568 223.227844 230.556458 239.35643 250.12442 265.893494 288.135712 336.240784 928.238586 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.422802 20.8077545 21.1438293 21.4493275 21.6824455 21.9493771 22.1999779 22.4623814 22.7121582 22.8906898 23.1284294 23.2793293 23.5279903 23.7865849 24.0720825 24.3350086 24.5611267 24.7803574 25.0337811 25.2112789 25.416832 25.6535339 25.8817863 26.1257133 26.3355217 26.5826225 26.8123856 27.0727558 27.228653 27.4968224 27.7182465 27.9712563 28.2301483 28.5311394 28.7851009 29.0606308 29.3298073 29.6340504 29.8379669 30.1229286 30.390852 30.6387253 30.9297218 31.2472382 31.5313034 31.8092861 32.0621452 32.3462524 32.6461563 32.932518 33.2095413 33.5413895 33.8306503 34.1449699 34.4266815 34.7634964 35.1006889 35.4178925 35.7137146 36.044529 36.3559418 36.6363754 36.9351044 37.2643127 37.5946045 37.9306793 38.2819977 38.6323891 38.9495735 39.2717934 39.6236534 39.9609528 40.3263397 40.659977 40.8818741 41.2750549 41.6676331 42.0392609 42.4302216 42.8793869 43.3327484 43.7850647 44.2807617 44.777256 45.3380814 45.905777 46.4589996 47.1276474 47.8111115 48.5500717 49.3442116 50.2511673 51.364357 52.635376 54.1999588 56.2360497 58.7360077 62.4334335 68.7814484 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1247177 10.2971449 10.4018564 10.5030098 10.6250582 10.7621918 10.8949261 11.0293465 11.187912 11.3596859 11.5075493 11.6734877 11.8232021 11.9876471 12.1473637 12.2864838 12.4415207 12.6091242 12.776207 12.9254494 13.1308937 13.3280487 13.4958401 13.6747084 13.8156109 13.9957476 14.2147789 14.4234142 14.660697 14.905014 15.1318188 15.3237743 15.5369167 15.7723904 16.0232773 16.3224316 16.5731277 16.8199768 17.0921555 17.3983955 17.6889114 17.9741306 18.1797962 18.4888115 18.7537308 19.0834961 19.4322243 19.7768745 20.1250153 20.3159657 20.6406479 20.9482422 21.2364864 21.5496044 21.8357201 22.155901 22.4643459 22.7857933 23.1264267 23.4436188 23.7933064 24.1053391 24.4500847 24.7424393 25.0971508 25.4445267 25.8228035 26.1467781 26.4987545 26.9011574 27.2520714 27.6201553 27.9872189 28.3412399 28.7096119 29.0969963 29.4646835 29.8512878 30.2203255 30.5977612 30.9992371 31.3982925 31.7873707 32.2252426 32.659565 33.0666733 33.4830475 33.9315186 34.4354515 34.9719849 35.5217209 36.1417999 36.8297501 37.5534439 38.5031052 39.6668015 41.1647034 43.4730759 47.8471107 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.13770258 2.78302383 3.22928452 3.55273199 3.80323815 4.02282333 4.17937469 4.31100273 4.44747019 4.58561039 4.68541813 4.79136276 4.88766861 4.98374176 5.06147099 5.14077663 5.20368385 5.27366352 5.33186531 5.39671898 5.45099354 5.50406075 5.54795074 5.59593534 5.64699125 5.7024188 5.75603104 5.80854511 5.86112452 5.91166496 5.96156454 6.01123047 6.05553198 6.1056242 6.15935326 6.20686531 6.24728489 6.28255033 6.33117199 6.38718605 6.42968655 6.47701168 6.52191114 6.57045794 6.62376308 6.66745853 6.72639465 6.77460957 6.8213625 6.86781502 6.90977859 6.96656275 7.01035786 7.0578022 7.11517906 7.17237949 7.21602249 7.26301289 7.3121438 7.37028933 7.41907692 7.47237635 7.52504063 7.57787037 7.63232899 7.68792105 7.75033331 7.81526852 7.8726902 7.93060064 7.98991966 8.05457783 8.10561752 8.16674232 8.22484303 8.2739706 8.33609867 8.40087318 8.4638443 8.52431011 8.59002495 8.65593719 8.72598076 8.79435253 8.85751915 8.93627167 9.00463676 9.08146191 9.17038631 9.26524734 9.36405945 9.47146893 9.59686756 9.73656273 9.91100502 10.1141071 10.3651886 10.6916275 11.2237682 12.2432232 19.6634274 ------------------------------ Transdef: Tab for variable 6 15.0039139 21.6071014 25.653656 26.8398476 27.886097 28.9999771 29.8482552 30.7071877 31.3392944 31.9976196 32.626503 33.1112747 33.5817719 34.0643768 34.5815277 34.973568 35.4601402 35.8881912 36.3003159 36.704628 37.1478119 37.5995407 38.000679 38.37603 38.7747421 39.1545486 39.5772095 40.0921555 40.4253082 40.8388672 41.2673607 41.7588844 42.2194595 42.6899719 43.1150513 43.4359589 43.9577141 44.4523621 44.9178429 45.4874268 46.2754593 46.8861618 47.5233192 48.1208878 48.804657 49.4520531 50.1991501 50.8333359 51.6973724 52.4753952 53.4163933 54.1892014 54.9169159 55.7070847 56.4924545 57.2417221 58.0118179 58.6942368 59.4948349 60.3040771 61.1952362 62.0281143 62.9022522 63.6599884 64.4566269 65.238205 65.9787674 66.787796 67.5949173 68.353775 69.1940155 70.0102844 70.7956161 71.5941925 72.3293304 73.0960922 73.9104996 74.6519394 75.3759766 76.2373657 76.7184372 77.5305481 78.3317719 79.1836548 80.0755615 81.0416183 82.0695343 82.9623413 84.110199 85.4288483 86.9120636 88.6768723 90.5182877 92.7201691 95.1382751 98.2251434 102.056625 107.326324 114.266312 126.384018 255.462097 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.6781273 33.7811813 34.5774002 35.1657867 35.66399 36.1932487 36.6146431 36.9340973 37.3370857 37.7340508 38.0463791 38.3707962 38.721283 39.1035385 39.4464607 39.8293152 40.1704788 40.4670296 40.8740387 41.2286568 41.5718079 41.9972458 42.4435806 43.0376892 43.5464249 44.3329239 44.9172325 45.4917068 46.1760406 47.0563126 47.9354401 48.7970428 49.59729 50.5742874 51.7589264 52.6993408 53.6741333 54.7291183 55.8470383 56.7593498 57.7871017 58.8277512 59.8286591 60.8498535 61.454895 62.4362717 63.3103943 64.2180481 65.1300812 66.0587006 66.9675293 67.8795166 68.8232422 69.7800751 70.5844955 71.416748 72.3097458 73.0927353 73.8872223 74.7603912 75.5559692 76.4897385 77.2895966 78.1276932 78.9773254 79.8865356 80.99086 82.0646286 83.2098541 84.4626694 85.9631195 87.44767 88.9239807 90.4315186 92.0224686 93.7512054 95.3272095 97.1293411 99.0088348 100.743805 102.685242 104.643768 106.646164 108.803879 111.260551 113.938744 116.554733 119.52298 123.091278 127.017433 130.993881 135.674286 141.031067 147.124176 154.739441 163.53891 177.024994 194.668289 233.184784 582.217407 ------------------------------ Transdef: Tab for variable 8 0.44022572 26.49963 29.7971802 31.3792 32.4057961 33.0664291 33.731308 34.1445312 34.6556244 35.0791168 35.4439316 35.8147354 36.1583672 36.5067444 36.7965088 37.0837784 37.3886032 37.7070923 38.0133667 38.2559586 38.5973434 38.897171 39.2136307 39.4517746 39.7391815 40.0535774 40.4268265 40.7848854 41.1884232 41.5725822 42.0301704 42.4537277 42.9196548 43.3852539 43.8071365 44.3175888 44.9110641 45.443676 46.0677681 46.6911392 47.3263397 48.0200195 48.4012375 49.0453949 49.6981049 50.3826752 51.0842972 51.8594856 52.61446 53.395565 54.0924149 54.8657684 55.6134033 56.3794594 57.14077 57.9208679 58.6421585 59.353569 60.0744095 60.7674866 61.543026 62.2579613 62.9848213 63.6848831 64.4393616 65.1157837 65.8372955 66.5818481 67.2722321 67.9685516 68.69664 69.4068832 70.0992889 70.807724 71.5580292 72.3486023 73.0417328 73.7400665 74.3936157 75.1246338 75.926178 76.679718 77.4492798 78.2826691 79.0196381 79.948288 80.9873657 82.0000534 83.1950684 84.5683975 86.2142487 88.0468597 90.0626831 92.3873444 95.2596588 98.964386 103.412292 109.134827 117.885216 138.214996 347.479309 ------------------------------ Transdef: Tab for variable 9 49.2546883 63.1523743 65.3713379 67.0285645 67.9749069 69.0573044 69.9829941 70.8956451 71.7509155 72.5648956 73.4398346 74.2197495 74.9273376 75.5465393 76.2053909 76.8592529 77.3312988 78.067276 78.7069244 79.3286285 79.8084869 80.4248734 81.0080719 81.7226105 82.5413208 83.1425934 83.8504944 84.6584625 85.4724884 86.4125977 87.2154083 88.3525085 89.2703552 90.3521881 91.5055618 92.7380676 93.5819702 95.2097473 96.3231506 97.6573029 99.0517273 100.449783 101.749962 103.066788 104.577332 105.964058 107.499016 108.925682 110.213699 111.636215 113.143684 114.496727 115.7733 117.054161 118.44574 119.78624 121.142883 122.562042 123.909966 125.21701 126.59919 127.854477 129.16922 130.510773 131.736176 133.045715 134.220612 135.524597 136.857727 138.089264 139.385925 140.501709 141.816162 143.043961 144.276001 145.415131 146.435638 147.641174 148.758987 149.878891 150.894531 152.055908 153.154877 154.22583 155.262054 156.368408 157.467529 158.634613 159.812042 161.026062 162.383728 163.795303 165.561584 167.468994 169.55188 171.852875 175.296982 179.852417 188.521317 212.209534 459.46109 ------------------------------ Transdef: Tab for variable 10 0.00602381537 1.00873113 1.3774817 1.60993004 1.7842381 1.91212034 2.01337337 2.09457803 2.1741128 2.23476982 2.28561735 2.33309197 2.38087416 2.41917801 2.45158505 2.48662353 2.52192116 2.55165339 2.58033514 2.60654116 2.62998962 2.65438795 2.67591071 2.69729185 2.71780372 2.737149 2.75477695 2.769063 2.78376651 2.79795814 2.81066704 2.82515359 2.83754849 2.8481946 2.85940862 2.8683989 2.87866068 2.88712311 2.89658213 2.90600348 2.91385508 2.92088985 2.92892432 2.93663144 2.94406605 2.95076466 2.95748758 2.96315479 2.96868634 2.97455215 2.98022223 2.98555851 2.98992443 2.99382114 2.998698 3.00340986 3.00816917 3.01276112 3.01691556 3.02174711 3.02632046 3.02971172 3.03348041 3.03683209 3.04085612 3.04408288 3.0478096 3.05160451 3.05459785 3.05784416 3.0615077 3.06463051 3.06772614 3.07116795 3.07452798 3.07786846 3.08098269 3.08408165 3.08720255 3.08994675 3.09296584 3.0954957 3.09800744 3.10086989 3.10314322 3.1052289 3.10820007 3.11032343 3.11307812 3.11525869 3.11767578 3.12010241 3.12265587 3.12505102 3.12745428 3.1295352 3.13193464 3.13422728 3.13663292 3.1391468 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00577210635 0.0103690624 0.0170094967 0.0241239667 0.0304850414 0.0389150083 0.0468378067 0.0539660379 0.0604509339 0.0676243305 0.0749900341 0.0825173855 0.0897105336 0.0974040627 0.103954673 0.111305147 0.118631363 0.125881046 0.133021593 0.140167117 0.147295281 0.154208958 0.160443589 0.166980565 0.172920465 0.179406852 0.18443799 0.190432429 0.195734024 0.201132536 0.206317633 0.210652173 0.215683222 0.221165597 0.22625111 0.231609523 0.236458659 0.242005229 0.246352002 0.251154602 0.2559129 0.261053324 0.265879393 0.270491302 0.275876999 0.280441284 0.285543531 0.290134311 0.2949332 0.300293684 0.305394948 0.310785413 0.315956354 0.321326166 0.326501369 0.332305312 0.337513089 0.343291521 0.348255396 0.353435278 0.358895421 0.364787698 0.370226979 0.376375794 0.382577896 0.387890786 0.392041922 0.399356961 0.40552181 0.412094831 0.418692827 0.42547667 0.432313323 0.439189434 0.446440399 0.453715563 0.460289776 0.468254924 0.476662397 0.485679388 0.495264471 0.503955126 0.513663948 0.524423242 0.534412503 0.543309927 0.553931952 0.568582416 0.580581903 0.594449162 0.609002829 0.628245831 0.64481461 0.660006404 0.682221353 0.708107412 0.739623189 0.779087067 0.844913006 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.210166305 0.219151735 0.227285787 0.234636635 0.24193573 0.249337465 0.255718291 0.262392253 0.269200206 0.275032371 0.28080982 0.286480069 0.29210943 0.297549397 0.302827179 0.30794102 0.31297788 0.318451524 0.323797524 0.328859091 0.33422941 0.339677155 0.34484452 0.34930259 0.354183733 0.358051211 0.362968266 0.367984176 0.372897327 0.377974093 0.382991433 0.388438106 0.392948568 0.397703499 0.401631832 0.405495644 0.409295529 0.412733048 0.416394532 0.420037329 0.423750043 0.427306861 0.430561632 0.434521079 0.438330799 0.442301393 0.446127415 0.450436026 0.455045462 0.459262282 0.462602377 0.466800004 0.470775396 0.474569708 0.478802323 0.483038187 0.487568259 0.492246926 0.496812254 0.501423061 0.506728649 0.511489272 0.516318083 0.521996498 0.527610898 0.53271538 0.538834572 0.544905365 0.548737466 0.55494976 0.560333252 0.567005634 0.572451353 0.579158425 0.586400986 0.5922122 0.599629402 0.606060624 0.61438334 0.621754646 0.630663395 0.638844609 0.648089409 0.656958461 0.66544652 0.675536156 0.685248971 0.694329023 0.704502463 0.715711236 0.72782743 0.742483318 0.756188512 0.771408796 0.790262938 0.808522344 0.836192131 0.867718816 0.912077963 1.13414526 ------------------------------ Transdef: Tab for variable 13 20.0277634 21.7250729 22.675354 23.5167236 24.1617489 24.7837982 25.3055954 25.8066063 26.3427162 26.8218079 27.218256 27.6238976 28.0795612 28.5075436 28.8738861 29.282629 29.637043 29.9776096 30.3145542 30.6410217 30.9999046 31.3348579 31.7284889 32.0836868 32.3982773 32.7658463 33.1626892 33.5478935 33.9520111 34.3447762 34.5400696 34.8609886 35.1262741 35.4218674 35.7927666 36.1051178 36.3867416 36.7438812 37.1515236 37.4662933 37.8153419 38.1759186 38.5531425 38.8760109 39.2431831 39.5932083 39.9443741 40.3163757 40.6555901 41.0382767 41.418644 41.8026505 42.239357 42.6282082 43.0093842 43.3316956 43.6873589 44.0907021 44.5354156 44.9493141 45.3506699 45.7744141 46.2081985 46.6170425 47.0718079 47.4920464 47.9735794 48.4910126 49.0085144 49.483078 49.9581299 50.4837494 50.9610786 51.5008354 52.0439072 52.6713562 53.3301468 53.9943924 54.6592178 55.3662567 56.0176163 56.7610092 57.6748772 58.5124207 59.4420013 60.4821968 61.6133041 62.7954636 64.2413406 65.6491241 67.1965027 68.2910309 70.0695496 72.3928528 74.930481 77.7115173 81.2158966 85.7432404 91.5975952 100.290749 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6883955 11.1614475 11.5671997 11.9295826 12.3031616 12.5761042 12.9062672 13.2808876 13.6269722 13.9400368 14.3283958 14.6453724 14.9562473 15.2933369 15.6023827 15.9726934 16.3470459 16.6832504 16.995903 17.366642 17.7299652 18.0234528 18.3323135 18.6431408 18.9370079 19.2323093 19.5512886 19.9321327 20.2775402 20.6295319 20.972435 21.3211212 21.6699524 21.9766388 22.3019028 22.6184921 22.9832039 23.3062515 23.6546574 23.9852943 24.3321609 24.6587505 25.0120239 25.3019066 25.5590706 25.8713379 26.194603 26.5394478 26.8734932 27.2483864 27.5544777 27.8722839 28.0839272 28.384409 28.7315559 29.0813828 29.4444847 29.8077488 30.1227894 30.4442272 30.823103 31.1721344 31.5118027 31.8529854 32.2076797 32.5331726 32.9019775 33.2674942 33.6677284 34.0168228 34.3907242 34.7750931 35.1544113 35.5547638 35.9472923 36.3616142 36.7815018 37.2258759 37.696991 38.1454773 38.632988 39.1610107 39.7461243 40.166153 40.7270584 41.3338318 42.0798264 42.8271408 43.6334839 44.3318405 45.3082504 46.368576 47.6930389 48.9291916 50.7266541 52.9725266 55.4815445 59.6797562 66.0353622 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.0 50.9 57.6 31.7 51.6 62.5 56.2 64.0 -22.5 -24.4 -44.2 16.4 34.5 2 65.0 100.0 66.3 64.0 40.5 71.3 94.7 78.4 92.3 -44.7 -28.0 -53.0 32.0 40.9 3 50.9 66.3 100.0 53.4 12.0 35.9 69.9 55.5 71.9 -15.5 -30.6 -59.6 62.0 32.8 4 57.6 64.0 53.4 100.0 21.6 42.7 64.2 57.1 70.9 -10.8 -35.6 -67.8 25.7 75.2 5 31.7 40.5 12.0 21.6 100.0 84.3 14.4 60.2 60.1 18.6 -9.4 -16.1 -2.5 11.2 6 51.6 71.3 35.9 42.7 84.3 100.0 51.5 79.9 80.7 -9.1 -19.5 -34.4 10.8 25.7 7 62.5 94.7 69.9 64.2 14.4 51.5 100.0 70.5 81.8 -52.6 -27.4 -53.4 36.8 42.1 8 56.2 78.4 55.5 57.1 60.2 79.9 70.5 100.0 85.4 -13.8 -27.1 -48.2 26.5 37.7 9 64.0 92.3 71.9 70.9 60.1 80.7 81.8 85.4 100.0 -21.9 -30.9 -59.6 36.3 47.0 10 -22.5 -44.7 -15.5 -10.8 18.6 -9.1 -52.6 -13.8 -21.9 100.0 2.7 7.7 -6.2 -4.7 11 -24.4 -28.0 -30.6 -35.6 -9.4 -19.5 -27.4 -27.1 -30.9 2.7 100.0 56.3 -13.3 -26.6 12 -44.2 -53.0 -59.6 -67.8 -16.1 -34.4 -53.4 -48.2 -59.6 7.7 56.3 100.0 -29.1 -45.4 13 16.4 32.0 62.0 25.7 -2.5 10.8 36.8 26.5 36.3 -6.2 -13.3 -29.1 100.0 50.5 14 34.5 40.9 32.8 75.2 11.2 25.7 42.1 37.7 47.0 -4.7 -26.6 -45.4 50.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 171.704149 TOTAL CORRELATION OF ALL VARIABLES 72.3072279 ROUND 1: MAX CORR ( 72.3028506) AFTER KILLING INPUT VARIABLE 11 CONTR 0.795618016 ROUND 2: MAX CORR ( 72.2985502) AFTER KILLING INPUT VARIABLE 8 CONTR 0.788571946 ROUND 3: MAX CORR ( 72.2869723) AFTER KILLING INPUT VARIABLE 14 CONTR 1.29382744 ROUND 4: MAX CORR ( 72.2567485) AFTER KILLING INPUT VARIABLE 12 CONTR 2.09013543 ROUND 5: MAX CORR ( 72.2186295) AFTER KILLING INPUT VARIABLE 10 CONTR 2.34675446 ROUND 6: MAX CORR ( 72.0979672) AFTER KILLING INPUT VARIABLE 2 CONTR 4.1729563 ROUND 7: MAX CORR ( 71.7995709) AFTER KILLING INPUT VARIABLE 6 CONTR 6.55274713 ROUND 8: MAX CORR ( 70.9492723) AFTER KILLING INPUT VARIABLE 13 CONTR 11.0172203 ROUND 9: MAX CORR ( 69.6580718) AFTER KILLING INPUT VARIABLE 9 CONTR 13.4741335 ROUND 10: MAX CORR ( 69.3412089) AFTER KILLING INPUT VARIABLE 3 CONTR 6.63654388 ROUND 11: MAX CORR ( 66.6018442) AFTER KILLING INPUT VARIABLE 4 CONTR 19.297606 ROUND 12: MAX CORR ( 62.5400574) AFTER KILLING INPUT VARIABLE 5 CONTR 22.9029884 LAST REMAINING VARIABLE: 7 total correlation to target: 72.3072279 % total significance: 153.360701 sigma correlations of single variables to target: variable 2: 64.9909886 % , in sigma: 137.843254 variable 3: 50.9347639 % , in sigma: 108.030571 variable 4: 57.6128964 % , in sigma: 122.194619 variable 5: 31.6901693 % , in sigma: 67.2135653 variable 6: 51.5900478 % , in sigma: 109.420402 variable 7: 62.5400574 % , in sigma: 132.644928 variable 8: 56.2257523 % , in sigma: 119.252543 variable 9: 64.0023773 % , in sigma: 135.74645 variable 10: -22.5031495 % , in sigma: 47.7282686 variable 11: -24.3506999 % , in sigma: 51.646848 variable 12: -44.2077949 % , in sigma: 93.7629422 variable 13: 16.3520983 % , in sigma: 34.682138 variable 14: 34.4836694 % , in sigma: 73.1384658 variables sorted by significance: 1 most relevant variable 7 corr 62.5400581 , in sigma: 132.64493 2 most relevant variable 5 corr 22.9029884 , in sigma: 48.5763107 3 most relevant variable 4 corr 19.2976055 , in sigma: 40.9294396 4 most relevant variable 3 corr 6.63654375 , in sigma: 14.0758405 5 most relevant variable 9 corr 13.4741335 , in sigma: 28.5780913 6 most relevant variable 13 corr 11.0172205 , in sigma: 23.3670784 7 most relevant variable 6 corr 6.55274725 , in sigma: 13.8981115 8 most relevant variable 2 corr 4.17295647 , in sigma: 8.85067162 9 most relevant variable 10 corr 2.34675455 , in sigma: 4.97737134 10 most relevant variable 12 corr 2.09013534 , in sigma: 4.43309238 11 most relevant variable 14 corr 1.29382741 , in sigma: 2.74415553 12 most relevant variable 8 corr 0.788571954 , in sigma: 1.67252917 13 most relevant variable 11 corr 0.795617998 , in sigma: 1.68747354 global correlations between input variables: variable 2: 99.19016 % variable 3: 92.2472342 % variable 4: 92.931318 % variable 5: 95.1824625 % variable 6: 94.4058764 % variable 7: 98.8049523 % variable 8: 90.7398003 % variable 9: 98.7799751 % variable 10: 71.2272408 % variable 11: 57.4674508 % variable 12: 79.7330308 % variable 13: 83.8505706 % variable 14: 88.8617043 % significance loss when removing single variables: variable 2: corr = 3.09597972 % , sigma = 6.56644756 variable 3: corr = 16.8647539 % , sigma = 35.7694599 variable 4: corr = 14.3527013 % , sigma = 30.441498 variable 5: corr = 12.0035598 % , sigma = 25.459064 variable 6: corr = 5.55628679 % , sigma = 11.7846592 variable 7: corr = 6.68957745 % , sigma = 14.1883228 variable 8: corr = 0.832552307 % , sigma = 1.76580972 variable 9: corr = 12.9164876 % , sigma = 27.395347 variable 10: corr = 2.16785398 % , sigma = 4.59793047 variable 11: corr = 0.795618016 % , sigma = 1.68747358 variable 12: corr = 2.16304351 % , sigma = 4.58772766 variable 13: corr = 8.3582386 % , sigma = 17.7274855 variable 14: corr = 1.22215144 % , sigma = 2.59213369 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 17.8505058 sigma out 15 active outputs RANK 2 NODE 9 --> 16.936882 sigma out 15 active outputs RANK 3 NODE 7 --> 16.8131466 sigma out 15 active outputs RANK 4 NODE 10 --> 15.7095547 sigma out 15 active outputs RANK 5 NODE 3 --> 15.0221214 sigma out 15 active outputs RANK 6 NODE 2 --> 14.991313 sigma out 15 active outputs RANK 7 NODE 1 --> 14.6127834 sigma out 15 active outputs RANK 8 NODE 5 --> 14.5168867 sigma out 15 active outputs RANK 9 NODE 6 --> 13.7378645 sigma out 15 active outputs RANK 10 NODE 4 --> 12.3611784 sigma out 15 active outputs RANK 11 NODE 8 --> 11.0189772 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 24.431366 sigma in 11act. ( 24.5354939 sig out 1act.) RANK 2 NODE 13 --> 19.7613201 sigma in 11act. ( 21.4268456 sig out 1act.) RANK 3 NODE 5 --> 18.5727119 sigma in 11act. ( 23.4821815 sig out 1act.) RANK 4 NODE 3 --> 17.4667282 sigma in 11act. ( 19.0018787 sig out 1act.) RANK 5 NODE 7 --> 13.7624769 sigma in 11act. ( 18.2071075 sig out 1act.) RANK 6 NODE 8 --> 13.4337444 sigma in 11act. ( 9.50802517 sig out 1act.) RANK 7 NODE 1 --> 12.0953884 sigma in 11act. ( 16.8364906 sig out 1act.) RANK 8 NODE 12 --> 11.7630281 sigma in 11act. ( 13.3078222 sig out 1act.) RANK 9 NODE 11 --> 7.84079838 sigma in 11act. ( 7.54815865 sig out 1act.) RANK 10 NODE 2 --> 7.31329346 sigma in 11act. ( 6.60889196 sig out 1act.) RANK 11 NODE 6 --> 5.50387573 sigma in 11act. ( 6.99120331 sig out 1act.) RANK 12 NODE 14 --> 3.6365757 sigma in 11act. ( 6.58270264 sig out 1act.) RANK 13 NODE 4 --> 3.27850962 sigma in 11act. ( 3.9703474 sig out 1act.) RANK 14 NODE 15 --> 2.80633235 sigma in 11act. ( 2.37808704 sig out 1act.) RANK 15 NODE 9 --> 1.87540269 sigma in 11act. ( 3.17219782 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 24.5354939 sigma out 1act.( 24.431366 sig in 11act.) RANK 2 NODE 5 --> 23.4821815 sigma out 1act.( 18.5727119 sig in 11act.) RANK 3 NODE 13 --> 21.4268456 sigma out 1act.( 19.7613201 sig in 11act.) RANK 4 NODE 3 --> 19.0018787 sigma out 1act.( 17.4667282 sig in 11act.) RANK 5 NODE 7 --> 18.2071075 sigma out 1act.( 13.7624769 sig in 11act.) RANK 6 NODE 1 --> 16.8364906 sigma out 1act.( 12.0953884 sig in 11act.) RANK 7 NODE 12 --> 13.3078222 sigma out 1act.( 11.7630281 sig in 11act.) RANK 8 NODE 8 --> 9.50802517 sigma out 1act.( 13.4337444 sig in 11act.) RANK 9 NODE 11 --> 7.54815865 sigma out 1act.( 7.84079838 sig in 11act.) RANK 10 NODE 6 --> 6.99120331 sigma out 1act.( 5.50387573 sig in 11act.) RANK 11 NODE 2 --> 6.60889196 sigma out 1act.( 7.31329346 sig in 11act.) RANK 12 NODE 14 --> 6.58270264 sigma out 1act.( 3.6365757 sig in 11act.) RANK 13 NODE 4 --> 3.9703474 sigma out 1act.( 3.27850962 sig in 11act.) RANK 14 NODE 9 --> 3.17219782 sigma out 1act.( 1.87540269 sig in 11act.) RANK 15 NODE 15 --> 2.37808704 sigma out 1act.( 2.80633235 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.501297 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 28.4037018 sigma out 15 active outputs RANK 2 NODE 11 --> 18.711235 sigma out 15 active outputs RANK 3 NODE 7 --> 17.6583881 sigma out 15 active outputs RANK 4 NODE 1 --> 17.5950451 sigma out 15 active outputs RANK 5 NODE 3 --> 16.372263 sigma out 15 active outputs RANK 6 NODE 10 --> 16.2842407 sigma out 15 active outputs RANK 7 NODE 6 --> 16.0060806 sigma out 15 active outputs RANK 8 NODE 5 --> 15.4693165 sigma out 15 active outputs RANK 9 NODE 2 --> 14.9922476 sigma out 15 active outputs RANK 10 NODE 4 --> 13.8500633 sigma out 15 active outputs RANK 11 NODE 8 --> 13.4521589 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 25.0188255 sigma in 11act. ( 22.4444656 sig out 1act.) RANK 2 NODE 10 --> 21.7733707 sigma in 11act. ( 22.3763523 sig out 1act.) RANK 3 NODE 13 --> 20.3992882 sigma in 11act. ( 20.4097443 sig out 1act.) RANK 4 NODE 7 --> 19.0206642 sigma in 11act. ( 17.4968376 sig out 1act.) RANK 5 NODE 1 --> 18.0576115 sigma in 11act. ( 16.5818653 sig out 1act.) RANK 6 NODE 3 --> 17.7780838 sigma in 11act. ( 17.5172882 sig out 1act.) RANK 7 NODE 12 --> 13.1050797 sigma in 11act. ( 12.478281 sig out 1act.) RANK 8 NODE 8 --> 11.1790943 sigma in 11act. ( 8.22045517 sig out 1act.) RANK 9 NODE 14 --> 11.0685816 sigma in 11act. ( 7.75395393 sig out 1act.) RANK 10 NODE 4 --> 9.90039921 sigma in 11act. ( 4.00757551 sig out 1act.) RANK 11 NODE 9 --> 9.68089008 sigma in 11act. ( 4.43967962 sig out 1act.) RANK 12 NODE 11 --> 9.30609703 sigma in 11act. ( 6.95139027 sig out 1act.) RANK 13 NODE 6 --> 8.60413647 sigma in 11act. ( 6.63690329 sig out 1act.) RANK 14 NODE 2 --> 7.64222288 sigma in 11act. ( 5.95706272 sig out 1act.) RANK 15 NODE 15 --> 7.38099337 sigma in 11act. ( 3.38547301 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 22.4444656 sigma out 1act.( 25.0188255 sig in 11act.) RANK 2 NODE 10 --> 22.3763523 sigma out 1act.( 21.7733707 sig in 11act.) RANK 3 NODE 13 --> 20.4097443 sigma out 1act.( 20.3992882 sig in 11act.) RANK 4 NODE 3 --> 17.5172882 sigma out 1act.( 17.7780838 sig in 11act.) RANK 5 NODE 7 --> 17.4968376 sigma out 1act.( 19.0206642 sig in 11act.) RANK 6 NODE 1 --> 16.5818653 sigma out 1act.( 18.0576115 sig in 11act.) RANK 7 NODE 12 --> 12.478281 sigma out 1act.( 13.1050797 sig in 11act.) RANK 8 NODE 8 --> 8.22045517 sigma out 1act.( 11.1790943 sig in 11act.) RANK 9 NODE 14 --> 7.75395393 sigma out 1act.( 11.0685816 sig in 11act.) RANK 10 NODE 11 --> 6.95139027 sigma out 1act.( 9.30609703 sig in 11act.) RANK 11 NODE 6 --> 6.63690329 sigma out 1act.( 8.60413647 sig in 11act.) RANK 12 NODE 2 --> 5.95706272 sigma out 1act.( 7.64222288 sig in 11act.) RANK 13 NODE 9 --> 4.43967962 sigma out 1act.( 9.68089008 sig in 11act.) RANK 14 NODE 4 --> 4.00757551 sigma out 1act.( 9.90039921 sig in 11act.) RANK 15 NODE 15 --> 3.38547301 sigma out 1act.( 7.38099337 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.606678 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.41749686 *** contribution from regularisation: 0.00417939527 *** contribution from error: -0.421676248 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.465261757 *** contribution from regularisation: 0.00253155478 *** contribution from error: -0.467793316 *********************************************** -----------------> Test sample ENTER BFGS code START -44700.3223 -0.379651457 -0.293759316 EXIT FROM BFGS code FG_START 0. -0.379651457 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.48333171 *** contribution from regularisation: 0.00241367659 *** contribution from error: -0.4857454 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46426.4265 -0.379651457 -125.448814 EXIT FROM BFGS code FG_LNSRCH 0. -0.394985735 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.526597857 *** contribution from regularisation: 0.00320666586 *** contribution from error: -0.529804528 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50582.3583 -0.394985735 -151.80304 EXIT FROM BFGS code NEW_X -50582.3583 -0.394985735 -151.80304 ENTER BFGS code NEW_X -50582.3583 -0.394985735 -151.80304 EXIT FROM BFGS code FG_LNSRCH 0. -0.415178955 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.53202039 *** contribution from regularisation: 0.00330998469 *** contribution from error: -0.535330355 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51103.2208 -0.415178955 -81.6725845 EXIT FROM BFGS code NEW_X -51103.2208 -0.415178955 -81.6725845 ENTER BFGS code NEW_X -51103.2208 -0.415178955 -81.6725845 EXIT FROM BFGS code FG_LNSRCH 0. -0.439548582 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.534802496 *** contribution from regularisation: 0.00329374406 *** contribution from error: -0.538096249 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51370.4538 -0.439548582 -4.35719156 EXIT FROM BFGS code NEW_X -51370.4538 -0.439548582 -4.35719156 ENTER BFGS code NEW_X -51370.4538 -0.439548582 -4.35719156 EXIT FROM BFGS code FG_LNSRCH 0. -0.453693599 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.536217213 *** contribution from regularisation: 0.00325365039 *** contribution from error: -0.539470851 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51506.3444 -0.453693599 50.7661705 EXIT FROM BFGS code NEW_X -51506.3444 -0.453693599 50.7661705 ENTER BFGS code NEW_X -51506.3444 -0.453693599 50.7661705 EXIT FROM BFGS code FG_LNSRCH 0. -0.453214139 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.537778974 *** contribution from regularisation: 0.00319477986 *** contribution from error: -0.540973783 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51656.3576 -0.453214139 55.7461624 EXIT FROM BFGS code NEW_X -51656.3576 -0.453214139 55.7461624 ENTER BFGS code NEW_X -51656.3576 -0.453214139 55.7461624 EXIT FROM BFGS code FG_LNSRCH 0. -0.434505671 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.539770305 *** contribution from regularisation: 0.00329442578 *** contribution from error: -0.543064713 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51847.6389 -0.434505671 12.1718502 EXIT FROM BFGS code NEW_X -51847.6389 -0.434505671 12.1718502 ENTER BFGS code NEW_X -51847.6389 -0.434505671 12.1718502 EXIT FROM BFGS code FG_LNSRCH 0. -0.439535111 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 48.3498383 sigma out 15 active outputs RANK 2 NODE 1 --> 30.3882637 sigma out 15 active outputs RANK 3 NODE 7 --> 28.2332325 sigma out 15 active outputs RANK 4 NODE 2 --> 26.0051785 sigma out 15 active outputs RANK 5 NODE 8 --> 23.1499405 sigma out 15 active outputs RANK 6 NODE 10 --> 20.3624706 sigma out 15 active outputs RANK 7 NODE 11 --> 18.8438244 sigma out 15 active outputs RANK 8 NODE 4 --> 13.7830267 sigma out 15 active outputs RANK 9 NODE 3 --> 13.5567837 sigma out 15 active outputs RANK 10 NODE 5 --> 13.4624414 sigma out 15 active outputs RANK 11 NODE 6 --> 12.7403831 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 46.7521553 sigma in 11act. ( 36.6591072 sig out 1act.) RANK 2 NODE 5 --> 31.0725956 sigma in 11act. ( 24.0463486 sig out 1act.) RANK 3 NODE 1 --> 29.6967716 sigma in 11act. ( 25.6652679 sig out 1act.) RANK 4 NODE 14 --> 23.0461922 sigma in 11act. ( 22.2128258 sig out 1act.) RANK 5 NODE 9 --> 20.3155174 sigma in 11act. ( 19.7297173 sig out 1act.) RANK 6 NODE 15 --> 18.647007 sigma in 11act. ( 16.5080776 sig out 1act.) RANK 7 NODE 4 --> 17.5340118 sigma in 11act. ( 15.4750242 sig out 1act.) RANK 8 NODE 12 --> 16.6276627 sigma in 11act. ( 15.9955168 sig out 1act.) RANK 9 NODE 2 --> 13.326232 sigma in 11act. ( 12.995307 sig out 1act.) RANK 10 NODE 13 --> 12.6681471 sigma in 11act. ( 14.1316175 sig out 1act.) RANK 11 NODE 10 --> 11.9801092 sigma in 11act. ( 10.3951283 sig out 1act.) RANK 12 NODE 6 --> 11.637269 sigma in 11act. ( 10.4062119 sig out 1act.) RANK 13 NODE 3 --> 11.0704288 sigma in 11act. ( 9.71472645 sig out 1act.) RANK 14 NODE 8 --> 7.42198563 sigma in 11act. ( 5.05261755 sig out 1act.) RANK 15 NODE 11 --> 7.36096573 sigma in 11act. ( 5.20486975 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 36.6591072 sigma out 1act.( 46.7521553 sig in 11act.) RANK 2 NODE 1 --> 25.6652679 sigma out 1act.( 29.6967716 sig in 11act.) RANK 3 NODE 5 --> 24.0463486 sigma out 1act.( 31.0725956 sig in 11act.) RANK 4 NODE 14 --> 22.2128258 sigma out 1act.( 23.0461922 sig in 11act.) RANK 5 NODE 9 --> 19.7297173 sigma out 1act.( 20.3155174 sig in 11act.) RANK 6 NODE 15 --> 16.5080776 sigma out 1act.( 18.647007 sig in 11act.) RANK 7 NODE 12 --> 15.9955168 sigma out 1act.( 16.6276627 sig in 11act.) RANK 8 NODE 4 --> 15.4750242 sigma out 1act.( 17.5340118 sig in 11act.) RANK 9 NODE 13 --> 14.1316175 sigma out 1act.( 12.6681471 sig in 11act.) RANK 10 NODE 2 --> 12.995307 sigma out 1act.( 13.326232 sig in 11act.) RANK 11 NODE 6 --> 10.4062119 sigma out 1act.( 11.637269 sig in 11act.) RANK 12 NODE 10 --> 10.3951283 sigma out 1act.( 11.9801092 sig in 11act.) RANK 13 NODE 3 --> 9.71472645 sigma out 1act.( 11.0704288 sig in 11act.) RANK 14 NODE 11 --> 5.20486975 sigma out 1act.( 7.36096573 sig in 11act.) RANK 15 NODE 8 --> 5.05261755 sigma out 1act.( 7.42198563 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 70.4504623 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.539588511 *** contribution from regularisation: 0.00341551658 *** contribution from error: -0.543004036 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51830.1749 -0.439535111 42.7334595 EXIT FROM BFGS code FG_LNSRCH 0. -0.43686831 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.540821731 *** contribution from regularisation: 0.00306675304 *** contribution from error: -0.543888509 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51948.6322 -0.43686831 27.8717709 EXIT FROM BFGS code NEW_X -51948.6322 -0.43686831 27.8717709 ENTER BFGS code NEW_X -51948.6322 -0.43686831 27.8717709 EXIT FROM BFGS code FG_LNSRCH 0. -0.428313255 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.541149855 *** contribution from regularisation: 0.00323432148 *** contribution from error: -0.544384181 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51980.1504 -0.428313255 -19.7255745 EXIT FROM BFGS code NEW_X -51980.1504 -0.428313255 -19.7255745 ENTER BFGS code NEW_X -51980.1504 -0.428313255 -19.7255745 EXIT FROM BFGS code FG_LNSRCH 0. -0.432640195 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.541645527 *** contribution from regularisation: 0.00323833548 *** contribution from error: -0.544883847 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52027.7596 -0.432640195 -18.7062702 EXIT FROM BFGS code NEW_X -52027.7596 -0.432640195 -18.7062702 ENTER BFGS code NEW_X -52027.7596 -0.432640195 -18.7062702 EXIT FROM BFGS code FG_LNSRCH 0. -0.440890998 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.542334378 *** contribution from regularisation: 0.00328670023 *** contribution from error: -0.545621097 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52093.928 -0.440890998 -77.1286087 EXIT FROM BFGS code NEW_X -52093.928 -0.440890998 -77.1286087 ENTER BFGS code NEW_X -52093.928 -0.440890998 -77.1286087 EXIT FROM BFGS code FG_LNSRCH 0. -0.499650866 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.543412566 *** contribution from regularisation: 0.00352256605 *** contribution from error: -0.546935141 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52197.4924 -0.499650866 -61.1342087 EXIT FROM BFGS code NEW_X -52197.4924 -0.499650866 -61.1342087 ENTER BFGS code NEW_X -52197.4924 -0.499650866 -61.1342087 EXIT FROM BFGS code FG_LNSRCH 0. -0.540461898 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.544104099 *** contribution from regularisation: 0.00326845981 *** contribution from error: -0.54737258 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52263.9165 -0.540461898 7.25786734 EXIT FROM BFGS code NEW_X -52263.9165 -0.540461898 7.25786734 ENTER BFGS code NEW_X -52263.9165 -0.540461898 7.25786734 EXIT FROM BFGS code FG_LNSRCH 0. -0.531092227 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.544662893 *** contribution from regularisation: 0.00311466958 *** contribution from error: -0.547777534 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52317.5924 -0.531092227 -3.81591129 EXIT FROM BFGS code NEW_X -52317.5924 -0.531092227 -3.81591129 ENTER BFGS code NEW_X -52317.5924 -0.531092227 -3.81591129 EXIT FROM BFGS code FG_LNSRCH 0. -0.5399611 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.54471302 *** contribution from regularisation: 0.00323627098 *** contribution from error: -0.547949314 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52322.4101 -0.5399611 -11.6441526 EXIT FROM BFGS code NEW_X -52322.4101 -0.5399611 -11.6441526 ENTER BFGS code NEW_X -52322.4101 -0.5399611 -11.6441526 EXIT FROM BFGS code FG_LNSRCH 0. -0.566156685 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.544987142 *** contribution from regularisation: 0.00326057826 *** contribution from error: -0.548247695 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52348.7397 -0.566156685 -2.92597747 EXIT FROM BFGS code NEW_X -52348.7397 -0.566156685 -2.92597747 ENTER BFGS code NEW_X -52348.7397 -0.566156685 -2.92597747 EXIT FROM BFGS code FG_LNSRCH 0. -0.596434653 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 52.445446 sigma out 15 active outputs RANK 2 NODE 7 --> 41.3384438 sigma out 15 active outputs RANK 3 NODE 1 --> 33.8946419 sigma out 15 active outputs RANK 4 NODE 2 --> 33.0247078 sigma out 15 active outputs RANK 5 NODE 4 --> 30.9358387 sigma out 15 active outputs RANK 6 NODE 10 --> 24.3746567 sigma out 15 active outputs RANK 7 NODE 11 --> 23.3777409 sigma out 15 active outputs RANK 8 NODE 3 --> 21.6844578 sigma out 15 active outputs RANK 9 NODE 8 --> 18.7759171 sigma out 15 active outputs RANK 10 NODE 5 --> 17.2902622 sigma out 15 active outputs RANK 11 NODE 6 --> 16.1583862 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 52.5247307 sigma in 11act. ( 47.0111656 sig out 1act.) RANK 2 NODE 1 --> 38.3874359 sigma in 11act. ( 39.2107849 sig out 1act.) RANK 3 NODE 5 --> 32.9566422 sigma in 11act. ( 36.6615524 sig out 1act.) RANK 4 NODE 12 --> 32.3751564 sigma in 11act. ( 33.9965439 sig out 1act.) RANK 5 NODE 2 --> 30.0120659 sigma in 11act. ( 34.5000687 sig out 1act.) RANK 6 NODE 14 --> 27.0545769 sigma in 11act. ( 27.6673946 sig out 1act.) RANK 7 NODE 9 --> 22.1028347 sigma in 11act. ( 22.1264954 sig out 1act.) RANK 8 NODE 4 --> 21.6706181 sigma in 11act. ( 21.2061653 sig out 1act.) RANK 9 NODE 15 --> 17.7379875 sigma in 11act. ( 16.0915871 sig out 1act.) RANK 10 NODE 3 --> 16.4417343 sigma in 11act. ( 15.9138861 sig out 1act.) RANK 11 NODE 13 --> 16.3232803 sigma in 11act. ( 18.3017063 sig out 1act.) RANK 12 NODE 6 --> 14.6376381 sigma in 11act. ( 14.0699749 sig out 1act.) RANK 13 NODE 10 --> 10.2231436 sigma in 11act. ( 8.54938316 sig out 1act.) RANK 14 NODE 8 --> 5.54682159 sigma in 11act. ( 4.19609308 sig out 1act.) RANK 15 NODE 11 --> 4.56286716 sigma in 11act. ( 2.78987098 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 47.0111656 sigma out 1act.( 52.5247307 sig in 11act.) RANK 2 NODE 1 --> 39.2107849 sigma out 1act.( 38.3874359 sig in 11act.) RANK 3 NODE 5 --> 36.6615524 sigma out 1act.( 32.9566422 sig in 11act.) RANK 4 NODE 2 --> 34.5000687 sigma out 1act.( 30.0120659 sig in 11act.) RANK 5 NODE 12 --> 33.9965439 sigma out 1act.( 32.3751564 sig in 11act.) RANK 6 NODE 14 --> 27.6673946 sigma out 1act.( 27.0545769 sig in 11act.) RANK 7 NODE 9 --> 22.1264954 sigma out 1act.( 22.1028347 sig in 11act.) RANK 8 NODE 4 --> 21.2061653 sigma out 1act.( 21.6706181 sig in 11act.) RANK 9 NODE 13 --> 18.3017063 sigma out 1act.( 16.3232803 sig in 11act.) RANK 10 NODE 15 --> 16.0915871 sigma out 1act.( 17.7379875 sig in 11act.) RANK 11 NODE 3 --> 15.9138861 sigma out 1act.( 16.4417343 sig in 11act.) RANK 12 NODE 6 --> 14.0699749 sigma out 1act.( 14.6376381 sig in 11act.) RANK 13 NODE 10 --> 8.54938316 sigma out 1act.( 10.2231436 sig in 11act.) RANK 14 NODE 8 --> 4.19609308 sigma out 1act.( 5.54682159 sig in 11act.) RANK 15 NODE 11 --> 2.78987098 sigma out 1act.( 4.56286716 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 101.41983 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.545386732 *** contribution from regularisation: 0.00327114644 *** contribution from error: -0.548657894 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52387.1224 -0.596434653 -18.1421642 EXIT FROM BFGS code NEW_X -52387.1224 -0.596434653 -18.1421642 ENTER BFGS code NEW_X -52387.1224 -0.596434653 -18.1421642 EXIT FROM BFGS code FG_LNSRCH 0. -0.704004109 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.545538366 *** contribution from regularisation: 0.00339554809 *** contribution from error: -0.548933923 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52401.6895 -0.704004109 187.536453 EXIT FROM BFGS code FG_LNSRCH 0. -0.646165311 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.545794666 *** contribution from regularisation: 0.00334432535 *** contribution from error: -0.549138963 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52426.3067 -0.646165311 65.7327881 EXIT FROM BFGS code NEW_X -52426.3067 -0.646165311 65.7327881 ENTER BFGS code NEW_X -52426.3067 -0.646165311 65.7327881 EXIT FROM BFGS code FG_LNSRCH 0. -0.699372053 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.545953214 *** contribution from regularisation: 0.0033983225 *** contribution from error: -0.549351513 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52441.5334 -0.699372053 -5.37001705 EXIT FROM BFGS code FG_LNSRCH 0. -0.672186375 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.546157956 *** contribution from regularisation: 0.00337492791 *** contribution from error: -0.54953289 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52461.2005 -0.672186375 31.8483028 EXIT FROM BFGS code NEW_X -52461.2005 -0.672186375 31.8483028 ENTER BFGS code NEW_X -52461.2005 -0.672186375 31.8483028 EXIT FROM BFGS code FG_LNSRCH 0. -0.672517478 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.546385467 *** contribution from regularisation: 0.00333079789 *** contribution from error: -0.549716294 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52483.0548 -0.672517478 12.7934227 EXIT FROM BFGS code NEW_X -52483.0548 -0.672517478 12.7934227 ENTER BFGS code NEW_X -52483.0548 -0.672517478 12.7934227 EXIT FROM BFGS code FG_LNSRCH 0. -0.667556643 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.546486497 *** contribution from regularisation: 0.00332734827 *** contribution from error: -0.549813867 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52492.7582 -0.667556643 -42.5991135 EXIT FROM BFGS code NEW_X -52492.7582 -0.667556643 -42.5991135 ENTER BFGS code NEW_X -52492.7582 -0.667556643 -42.5991135 EXIT FROM BFGS code FG_LNSRCH 0. -0.662356079 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.546622932 *** contribution from regularisation: 0.00328983366 *** contribution from error: -0.549912751 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52505.8678 -0.662356079 3.01879716 EXIT FROM BFGS code NEW_X -52505.8678 -0.662356079 3.01879716 ENTER BFGS code NEW_X -52505.8678 -0.662356079 3.01879716 EXIT FROM BFGS code FG_LNSRCH 0. -0.648738682 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.546761215 *** contribution from regularisation: 0.00330967084 *** contribution from error: -0.550070882 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52519.1491 -0.648738682 -27.9902878 EXIT FROM BFGS code NEW_X -52519.1491 -0.648738682 -27.9902878 ENTER BFGS code NEW_X -52519.1491 -0.648738682 -27.9902878 EXIT FROM BFGS code FG_LNSRCH 0. -0.644222796 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.54681623 *** contribution from regularisation: 0.00329376408 *** contribution from error: -0.550109982 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52524.4324 -0.644222796 18.2639713 EXIT FROM BFGS code NEW_X -52524.4324 -0.644222796 18.2639713 ENTER BFGS code NEW_X -52524.4324 -0.644222796 18.2639713 EXIT FROM BFGS code FG_LNSRCH 0. -0.64468801 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 53.6136932 sigma out 15 active outputs RANK 2 NODE 7 --> 40.6147003 sigma out 15 active outputs RANK 3 NODE 1 --> 38.7494926 sigma out 15 active outputs RANK 4 NODE 4 --> 31.5970764 sigma out 15 active outputs RANK 5 NODE 2 --> 31.3085155 sigma out 15 active outputs RANK 6 NODE 11 --> 28.8167782 sigma out 15 active outputs RANK 7 NODE 10 --> 28.422102 sigma out 15 active outputs RANK 8 NODE 5 --> 25.147234 sigma out 15 active outputs RANK 9 NODE 3 --> 23.968832 sigma out 15 active outputs RANK 10 NODE 8 --> 21.6566334 sigma out 15 active outputs RANK 11 NODE 6 --> 21.153614 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 50.4779968 sigma in 11act. ( 44.00317 sig out 1act.) RANK 2 NODE 2 --> 40.9570351 sigma in 11act. ( 46.1194458 sig out 1act.) RANK 3 NODE 1 --> 37.4343071 sigma in 11act. ( 43.6208572 sig out 1act.) RANK 4 NODE 12 --> 36.472332 sigma in 11act. ( 36.9772415 sig out 1act.) RANK 5 NODE 5 --> 33.0153313 sigma in 11act. ( 36.426651 sig out 1act.) RANK 6 NODE 14 --> 27.0401459 sigma in 11act. ( 29.0155334 sig out 1act.) RANK 7 NODE 4 --> 26.3789577 sigma in 11act. ( 27.3535156 sig out 1act.) RANK 8 NODE 9 --> 23.8343506 sigma in 11act. ( 24.2458801 sig out 1act.) RANK 9 NODE 13 --> 21.4619408 sigma in 11act. ( 25.1238918 sig out 1act.) RANK 10 NODE 3 --> 20.1439152 sigma in 11act. ( 19.1663876 sig out 1act.) RANK 11 NODE 6 --> 19.6386013 sigma in 11act. ( 18.9146194 sig out 1act.) RANK 12 NODE 15 --> 16.7785015 sigma in 11act. ( 15.6928167 sig out 1act.) RANK 13 NODE 10 --> 10.6870604 sigma in 11act. ( 9.50551319 sig out 1act.) RANK 14 NODE 8 --> 6.79596329 sigma in 11act. ( 5.76419258 sig out 1act.) RANK 15 NODE 11 --> 5.43541574 sigma in 11act. ( 4.42183208 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 46.1194458 sigma out 1act.( 40.9570351 sig in 11act.) RANK 2 NODE 7 --> 44.00317 sigma out 1act.( 50.4779968 sig in 11act.) RANK 3 NODE 1 --> 43.6208572 sigma out 1act.( 37.4343071 sig in 11act.) RANK 4 NODE 12 --> 36.9772415 sigma out 1act.( 36.472332 sig in 11act.) RANK 5 NODE 5 --> 36.426651 sigma out 1act.( 33.0153313 sig in 11act.) RANK 6 NODE 14 --> 29.0155334 sigma out 1act.( 27.0401459 sig in 11act.) RANK 7 NODE 4 --> 27.3535156 sigma out 1act.( 26.3789577 sig in 11act.) RANK 8 NODE 13 --> 25.1238918 sigma out 1act.( 21.4619408 sig in 11act.) RANK 9 NODE 9 --> 24.2458801 sigma out 1act.( 23.8343506 sig in 11act.) RANK 10 NODE 3 --> 19.1663876 sigma out 1act.( 20.1439152 sig in 11act.) RANK 11 NODE 6 --> 18.9146194 sigma out 1act.( 19.6386013 sig in 11act.) RANK 12 NODE 15 --> 15.6928167 sigma out 1act.( 16.7785015 sig in 11act.) RANK 13 NODE 10 --> 9.50551319 sigma out 1act.( 10.6870604 sig in 11act.) RANK 14 NODE 8 --> 5.76419258 sigma out 1act.( 6.79596329 sig in 11act.) RANK 15 NODE 11 --> 4.42183208 sigma out 1act.( 5.43541574 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 112.178337 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.546823978 *** contribution from regularisation: 0.00342570595 *** contribution from error: -0.550249696 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52525.1776 -0.64468801 30.5696564 EXIT FROM BFGS code NEW_X -52525.1776 -0.64468801 30.5696564 ENTER BFGS code NEW_X -52525.1776 -0.64468801 30.5696564 EXIT FROM BFGS code FG_LNSRCH 0. -0.644087434 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.546867549 *** contribution from regularisation: 0.00345061114 *** contribution from error: -0.550318182 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52529.365 -0.644087434 -6.47101259 EXIT FROM BFGS code NEW_X -52529.365 -0.644087434 -6.47101259 ENTER BFGS code NEW_X -52529.365 -0.644087434 -6.47101259 EXIT FROM BFGS code FG_LNSRCH 0. -0.646122217 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.54700774 *** contribution from regularisation: 0.00343612721 *** contribution from error: -0.550443888 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52542.83 -0.646122217 -28.6368065 EXIT FROM BFGS code NEW_X -52542.83 -0.646122217 -28.6368065 ENTER BFGS code NEW_X -52542.83 -0.646122217 -28.6368065 EXIT FROM BFGS code FG_LNSRCH 0. -0.651011944 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.547206283 *** contribution from regularisation: 0.00345076108 *** contribution from error: -0.550657034 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52561.9018 -0.651011944 -37.602047 EXIT FROM BFGS code NEW_X -52561.9018 -0.651011944 -37.602047 ENTER BFGS code NEW_X -52561.9018 -0.651011944 -37.602047 EXIT FROM BFGS code FG_LNSRCH 0. -0.645212948 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.547431707 *** contribution from regularisation: 0.00342721981 *** contribution from error: -0.550858915 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52583.5504 -0.645212948 -144.918823 EXIT FROM BFGS code NEW_X -52583.5504 -0.645212948 -144.918823 ENTER BFGS code NEW_X -52583.5504 -0.645212948 -144.918823 EXIT FROM BFGS code FG_LNSRCH 0. -0.660097063 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.54759115 *** contribution from regularisation: 0.00346954376 *** contribution from error: -0.551060677 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52598.8666 -0.660097063 2.81034827 EXIT FROM BFGS code NEW_X -52598.8666 -0.660097063 2.81034827 ENTER BFGS code NEW_X -52598.8666 -0.660097063 2.81034827 EXIT FROM BFGS code FG_LNSRCH 0. -0.658753395 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.547780454 *** contribution from regularisation: 0.00347623928 *** contribution from error: -0.551256716 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52617.05 -0.658753395 -19.0767536 EXIT FROM BFGS code NEW_X -52617.05 -0.658753395 -19.0767536 ENTER BFGS code NEW_X -52617.05 -0.658753395 -19.0767536 EXIT FROM BFGS code FG_LNSRCH 0. -0.668015957 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.548204541 *** contribution from regularisation: 0.0034622578 *** contribution from error: -0.551666796 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52657.7854 -0.668015957 -89.9293747 EXIT FROM BFGS code NEW_X -52657.7854 -0.668015957 -89.9293747 ENTER BFGS code NEW_X -52657.7854 -0.668015957 -89.9293747 EXIT FROM BFGS code FG_LNSRCH 0. -0.702533722 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.548351705 *** contribution from regularisation: 0.00358485617 *** contribution from error: -0.551936567 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52671.9243 -0.702533722 -8.95075417 EXIT FROM BFGS code NEW_X -52671.9243 -0.702533722 -8.95075417 ENTER BFGS code NEW_X -52671.9243 -0.702533722 -8.95075417 EXIT FROM BFGS code FG_LNSRCH 0. -0.709557354 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.548583388 *** contribution from regularisation: 0.00358634582 *** contribution from error: -0.55216974 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52694.1771 -0.709557354 -64.0358429 EXIT FROM BFGS code NEW_X -52694.1771 -0.709557354 -64.0358429 ENTER BFGS code NEW_X -52694.1771 -0.709557354 -64.0358429 EXIT FROM BFGS code FG_LNSRCH 0. -0.714647353 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 67.2464752 sigma out 15 active outputs RANK 2 NODE 1 --> 55.5791817 sigma out 15 active outputs RANK 3 NODE 7 --> 44.3845406 sigma out 15 active outputs RANK 4 NODE 5 --> 42.8988533 sigma out 15 active outputs RANK 5 NODE 10 --> 41.6708183 sigma out 15 active outputs RANK 6 NODE 4 --> 40.7232857 sigma out 15 active outputs RANK 7 NODE 11 --> 39.8387451 sigma out 15 active outputs RANK 8 NODE 3 --> 36.1021271 sigma out 15 active outputs RANK 9 NODE 2 --> 34.6650009 sigma out 15 active outputs RANK 10 NODE 6 --> 31.6990376 sigma out 15 active outputs RANK 11 NODE 8 --> 26.8615341 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 58.8232613 sigma in 11act. ( 62.0738525 sig out 1act.) RANK 2 NODE 7 --> 56.1623459 sigma in 11act. ( 51.8531494 sig out 1act.) RANK 3 NODE 1 --> 51.1836357 sigma in 11act. ( 56.9793129 sig out 1act.) RANK 4 NODE 12 --> 47.6689072 sigma in 11act. ( 47.1398697 sig out 1act.) RANK 5 NODE 4 --> 42.974041 sigma in 11act. ( 45.7301979 sig out 1act.) RANK 6 NODE 5 --> 42.4614334 sigma in 11act. ( 48.9776764 sig out 1act.) RANK 7 NODE 14 --> 41.4094429 sigma in 11act. ( 45.2284966 sig out 1act.) RANK 8 NODE 13 --> 34.6085129 sigma in 11act. ( 39.6080399 sig out 1act.) RANK 9 NODE 6 --> 30.2582378 sigma in 11act. ( 30.6137238 sig out 1act.) RANK 10 NODE 9 --> 25.2480278 sigma in 11act. ( 24.3471279 sig out 1act.) RANK 11 NODE 3 --> 21.1789875 sigma in 11act. ( 21.7004414 sig out 1act.) RANK 12 NODE 15 --> 16.3273487 sigma in 11act. ( 15.6447725 sig out 1act.) RANK 13 NODE 10 --> 14.6643791 sigma in 11act. ( 14.4586382 sig out 1act.) RANK 14 NODE 8 --> 7.90202856 sigma in 11act. ( 7.81728315 sig out 1act.) RANK 15 NODE 11 --> 4.52211952 sigma in 11act. ( 4.32956219 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 62.0738525 sigma out 1act.( 58.8232613 sig in 11act.) RANK 2 NODE 1 --> 56.9793129 sigma out 1act.( 51.1836357 sig in 11act.) RANK 3 NODE 7 --> 51.8531494 sigma out 1act.( 56.1623459 sig in 11act.) RANK 4 NODE 5 --> 48.9776764 sigma out 1act.( 42.4614334 sig in 11act.) RANK 5 NODE 12 --> 47.1398697 sigma out 1act.( 47.6689072 sig in 11act.) RANK 6 NODE 4 --> 45.7301979 sigma out 1act.( 42.974041 sig in 11act.) RANK 7 NODE 14 --> 45.2284966 sigma out 1act.( 41.4094429 sig in 11act.) RANK 8 NODE 13 --> 39.6080399 sigma out 1act.( 34.6085129 sig in 11act.) RANK 9 NODE 6 --> 30.6137238 sigma out 1act.( 30.2582378 sig in 11act.) RANK 10 NODE 9 --> 24.3471279 sigma out 1act.( 25.2480278 sig in 11act.) RANK 11 NODE 3 --> 21.7004414 sigma out 1act.( 21.1789875 sig in 11act.) RANK 12 NODE 15 --> 15.6447725 sigma out 1act.( 16.3273487 sig in 11act.) RANK 13 NODE 10 --> 14.4586382 sigma out 1act.( 14.6643791 sig in 11act.) RANK 14 NODE 8 --> 7.81728315 sigma out 1act.( 7.90202856 sig in 11act.) RANK 15 NODE 11 --> 4.32956219 sigma out 1act.( 4.52211952 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 150.498367 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.548656821 *** contribution from regularisation: 0.00357200275 *** contribution from error: -0.552228808 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52701.2305 -0.714647353 -22.8023605 EXIT FROM BFGS code NEW_X -52701.2305 -0.714647353 -22.8023605 ENTER BFGS code NEW_X -52701.2305 -0.714647353 -22.8023605 EXIT FROM BFGS code FG_LNSRCH 0. -0.730061114 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.548741162 *** contribution from regularisation: 0.0035985047 *** contribution from error: -0.552339673 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52709.3323 -0.730061114 12.9521885 EXIT FROM BFGS code NEW_X -52709.3323 -0.730061114 12.9521885 ENTER BFGS code NEW_X -52709.3323 -0.730061114 12.9521885 EXIT FROM BFGS code FG_LNSRCH 0. -0.746718109 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.548842669 *** contribution from regularisation: 0.00360272056 *** contribution from error: -0.552445412 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52719.0822 -0.746718109 48.4335289 EXIT FROM BFGS code NEW_X -52719.0822 -0.746718109 48.4335289 ENTER BFGS code NEW_X -52719.0822 -0.746718109 48.4335289 EXIT FROM BFGS code FG_LNSRCH 0. -0.778966129 0. --------------------------------------------------- Iteration : 43 *********************************************** *** Learn Path 43 *** loss function: -0.548955321 *** contribution from regularisation: 0.00365078705 *** contribution from error: -0.552606106 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52729.9042 -0.778966129 -84.7682266 EXIT FROM BFGS code NEW_X -52729.9042 -0.778966129 -84.7682266 ENTER BFGS code NEW_X -52729.9042 -0.778966129 -84.7682266 EXIT FROM BFGS code FG_LNSRCH 0. -0.791017413 0. --------------------------------------------------- Iteration : 44 *********************************************** *** Learn Path 44 *** loss function: -0.549142301 *** contribution from regularisation: 0.00360011263 *** contribution from error: -0.552742422 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52747.8643 -0.791017413 11.4901609 EXIT FROM BFGS code NEW_X -52747.8643 -0.791017413 11.4901609 ENTER BFGS code NEW_X -52747.8643 -0.791017413 11.4901609 EXIT FROM BFGS code FG_LNSRCH 0. -0.791482329 0. --------------------------------------------------- Iteration : 45 *********************************************** *** Learn Path 45 *** loss function: -0.549225926 *** contribution from regularisation: 0.00357589917 *** contribution from error: -0.552801847 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52755.8952 -0.791482329 -1.93300796 EXIT FROM BFGS code NEW_X -52755.8952 -0.791482329 -1.93300796 ENTER BFGS code NEW_X -52755.8952 -0.791482329 -1.93300796 EXIT FROM BFGS code FG_LNSRCH 0. -0.810783982 0. --------------------------------------------------- Iteration : 46 *********************************************** *** Learn Path 46 *** loss function: -0.549344242 *** contribution from regularisation: 0.00357484259 *** contribution from error: -0.55291909 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52767.2584 -0.810783982 26.4073105 EXIT FROM BFGS code NEW_X -52767.2584 -0.810783982 26.4073105 ENTER BFGS code NEW_X -52767.2584 -0.810783982 26.4073105 EXIT FROM BFGS code FG_LNSRCH 0. -0.852904558 0. --------------------------------------------------- Iteration : 47 *********************************************** *** Learn Path 47 *** loss function: -0.549489796 *** contribution from regularisation: 0.00358106289 *** contribution from error: -0.553070843 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52781.2452 -0.852904558 -68.1219788 EXIT FROM BFGS code NEW_X -52781.2452 -0.852904558 -68.1219788 ENTER BFGS code NEW_X -52781.2452 -0.852904558 -68.1219788 EXIT FROM BFGS code FG_LNSRCH 0. -0.8760674 0. --------------------------------------------------- Iteration : 48 *********************************************** *** Learn Path 48 *** loss function: -0.549629688 *** contribution from regularisation: 0.00360847753 *** contribution from error: -0.553238153 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52794.681 -0.8760674 -26.8813057 EXIT FROM BFGS code NEW_X -52794.681 -0.8760674 -26.8813057 ENTER BFGS code NEW_X -52794.681 -0.8760674 -26.8813057 EXIT FROM BFGS code FG_LNSRCH 0. -0.893537223 0. --------------------------------------------------- Iteration : 49 *********************************************** *** Learn Path 49 *** loss function: -0.549688339 *** contribution from regularisation: 0.00361573556 *** contribution from error: -0.553304076 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52800.3156 -0.893537223 19.8628426 EXIT FROM BFGS code NEW_X -52800.3156 -0.893537223 19.8628426 ENTER BFGS code NEW_X -52800.3156 -0.893537223 19.8628426 EXIT FROM BFGS code FG_LNSRCH 0. -0.898758531 0. --------------------------------------------------- Iteration : 50 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 80.5655746 sigma out 15 active outputs RANK 2 NODE 1 --> 74.962471 sigma out 15 active outputs RANK 3 NODE 4 --> 54.4344521 sigma out 15 active outputs RANK 4 NODE 7 --> 50.0513649 sigma out 15 active outputs RANK 5 NODE 5 --> 48.2999763 sigma out 15 active outputs RANK 6 NODE 10 --> 42.8387718 sigma out 15 active outputs RANK 7 NODE 11 --> 40.2540321 sigma out 15 active outputs RANK 8 NODE 6 --> 39.3445129 sigma out 15 active outputs RANK 9 NODE 3 --> 38.548439 sigma out 15 active outputs RANK 10 NODE 2 --> 38.1583939 sigma out 15 active outputs RANK 11 NODE 8 --> 29.9164009 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 71.174324 sigma in 11act. ( 81.6119003 sig out 1act.) RANK 2 NODE 1 --> 66.977272 sigma in 11act. ( 72.2538528 sig out 1act.) RANK 3 NODE 7 --> 61.3085289 sigma in 11act. ( 57.6390343 sig out 1act.) RANK 4 NODE 12 --> 57.8380966 sigma in 11act. ( 60.0617523 sig out 1act.) RANK 5 NODE 14 --> 49.6288834 sigma in 11act. ( 57.1606674 sig out 1act.) RANK 6 NODE 4 --> 49.4570503 sigma in 11act. ( 51.6883011 sig out 1act.) RANK 7 NODE 5 --> 47.0389137 sigma in 11act. ( 52.9385185 sig out 1act.) RANK 8 NODE 13 --> 44.8443451 sigma in 11act. ( 50.4437981 sig out 1act.) RANK 9 NODE 6 --> 35.6519814 sigma in 11act. ( 37.9546852 sig out 1act.) RANK 10 NODE 9 --> 24.7263317 sigma in 11act. ( 21.6900673 sig out 1act.) RANK 11 NODE 3 --> 20.9564304 sigma in 11act. ( 20.8628139 sig out 1act.) RANK 12 NODE 10 --> 16.7852993 sigma in 11act. ( 17.1082859 sig out 1act.) RANK 13 NODE 15 --> 15.6602669 sigma in 11act. ( 15.5494728 sig out 1act.) RANK 14 NODE 8 --> 9.70462608 sigma in 11act. ( 9.97416592 sig out 1act.) RANK 15 NODE 11 --> 4.54723263 sigma in 11act. ( 4.5589118 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 81.6119003 sigma out 1act.( 71.174324 sig in 11act.) RANK 2 NODE 1 --> 72.2538528 sigma out 1act.( 66.977272 sig in 11act.) RANK 3 NODE 12 --> 60.0617523 sigma out 1act.( 57.8380966 sig in 11act.) RANK 4 NODE 7 --> 57.6390343 sigma out 1act.( 61.3085289 sig in 11act.) RANK 5 NODE 14 --> 57.1606674 sigma out 1act.( 49.6288834 sig in 11act.) RANK 6 NODE 5 --> 52.9385185 sigma out 1act.( 47.0389137 sig in 11act.) RANK 7 NODE 4 --> 51.6883011 sigma out 1act.( 49.4570503 sig in 11act.) RANK 8 NODE 13 --> 50.4437981 sigma out 1act.( 44.8443451 sig in 11act.) RANK 9 NODE 6 --> 37.9546852 sigma out 1act.( 35.6519814 sig in 11act.) RANK 10 NODE 9 --> 21.6900673 sigma out 1act.( 24.7263317 sig in 11act.) RANK 11 NODE 3 --> 20.8628139 sigma out 1act.( 20.9564304 sig in 11act.) RANK 12 NODE 10 --> 17.1082859 sigma out 1act.( 16.7852993 sig in 11act.) RANK 13 NODE 15 --> 15.5494728 sigma out 1act.( 15.6602669 sig in 11act.) RANK 14 NODE 8 --> 9.97416592 sigma out 1act.( 9.70462608 sig in 11act.) RANK 15 NODE 11 --> 4.5589118 sigma out 1act.( 4.54723263 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 181.928284 sigma in 15 active inputs *********************************************** *** Learn Path 50 *** loss function: -0.549725533 *** contribution from regularisation: 0.00361265638 *** contribution from error: -0.55333817 *********************************************** -----------------> Test sample Iteration No: 50 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52803.8834 -0.898758531 18.2578945 EXIT FROM BFGS code NEW_X -52803.8834 -0.898758531 18.2578945 ENTER BFGS code NEW_X -52803.8834 -0.898758531 18.2578945 EXIT FROM BFGS code FG_LNSRCH 0. -0.917427361 0. --------------------------------------------------- Iteration : 51 *********************************************** *** Learn Path 51 *** loss function: -0.549826384 *** contribution from regularisation: 0.00359004457 *** contribution from error: -0.553416431 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52813.5752 -0.917427361 123.2481 EXIT FROM BFGS code NEW_X -52813.5752 -0.917427361 123.2481 ENTER BFGS code NEW_X -52813.5752 -0.917427361 123.2481 EXIT FROM BFGS code FG_LNSRCH 0. -0.920972645 0. --------------------------------------------------- Iteration : 52 *********************************************** *** Learn Path 52 *** loss function: -0.549913824 *** contribution from regularisation: 0.00358721404 *** contribution from error: -0.55350101 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52821.9708 -0.920972645 6.71168137 EXIT FROM BFGS code NEW_X -52821.9708 -0.920972645 6.71168137 ENTER BFGS code NEW_X -52821.9708 -0.920972645 6.71168137 EXIT FROM BFGS code FG_LNSRCH 0. -0.919723332 0. --------------------------------------------------- Iteration : 53 *********************************************** *** Learn Path 53 *** loss function: -0.549986601 *** contribution from regularisation: 0.00359668513 *** contribution from error: -0.553583264 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52828.9653 -0.919723332 0.655897617 EXIT FROM BFGS code NEW_X -52828.9653 -0.919723332 0.655897617 ENTER BFGS code NEW_X -52828.9653 -0.919723332 0.655897617 EXIT FROM BFGS code FG_LNSRCH 0. -0.912930667 0. --------------------------------------------------- Iteration : 54 *********************************************** *** Learn Path 54 *** loss function: -0.549995542 *** contribution from regularisation: 0.00357066235 *** contribution from error: -0.553566217 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52829.8201 -0.912930667 -8.7503233 EXIT FROM BFGS code NEW_X -52829.8201 -0.912930667 -8.7503233 ENTER BFGS code NEW_X -52829.8201 -0.912930667 -8.7503233 EXIT FROM BFGS code FG_LNSRCH 0. -0.909823895 0. --------------------------------------------------- Iteration : 55 *********************************************** *** Learn Path 55 *** loss function: -0.550003171 *** contribution from regularisation: 0.00363837392 *** contribution from error: -0.553641558 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52830.556 -0.909823895 -18.8661728 EXIT FROM BFGS code NEW_X -52830.556 -0.909823895 -18.8661728 ENTER BFGS code NEW_X -52830.556 -0.909823895 -18.8661728 EXIT FROM BFGS code FG_LNSRCH 0. -0.911079168 0. --------------------------------------------------- Iteration : 56 *********************************************** *** Learn Path 56 *** loss function: -0.550036728 *** contribution from regularisation: 0.00362215866 *** contribution from error: -0.553658903 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52833.7759 -0.911079168 9.41626453 EXIT FROM BFGS code NEW_X -52833.7759 -0.911079168 9.41626453 ENTER BFGS code NEW_X -52833.7759 -0.911079168 9.41626453 EXIT FROM BFGS code FG_LNSRCH 0. -0.910384834 0. --------------------------------------------------- Iteration : 57 *********************************************** *** Learn Path 57 *** loss function: -0.550048888 *** contribution from regularisation: 0.0036187903 *** contribution from error: -0.553667665 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52834.944 -0.910384834 4.11809444 EXIT FROM BFGS code NEW_X -52834.944 -0.910384834 4.11809444 ENTER BFGS code NEW_X -52834.944 -0.910384834 4.11809444 EXIT FROM BFGS code FG_LNSRCH 0. -0.907385886 0. --------------------------------------------------- Iteration : 58 *********************************************** *** Learn Path 58 *** loss function: -0.550079584 *** contribution from regularisation: 0.00360751012 *** contribution from error: -0.553687096 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52837.8939 -0.907385886 2.14721704 EXIT FROM BFGS code NEW_X -52837.8939 -0.907385886 2.14721704 ENTER BFGS code NEW_X -52837.8939 -0.907385886 2.14721704 EXIT FROM BFGS code FG_LNSRCH 0. -0.903966963 0. --------------------------------------------------- Iteration : 59 *********************************************** *** Learn Path 59 *** loss function: -0.550104082 *** contribution from regularisation: 0.00359390862 *** contribution from error: -0.553698003 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52840.2481 -0.903966963 -2.46127152 EXIT FROM BFGS code NEW_X -52840.2481 -0.903966963 -2.46127152 ENTER BFGS code NEW_X -52840.2481 -0.903966963 -2.46127152 EXIT FROM BFGS code FG_LNSRCH 0. -0.898245692 0. --------------------------------------------------- Iteration : 60 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 85.0774918 sigma out 15 active outputs RANK 2 NODE 1 --> 82.0593872 sigma out 15 active outputs RANK 3 NODE 4 --> 56.2578316 sigma out 15 active outputs RANK 4 NODE 7 --> 50.2336807 sigma out 15 active outputs RANK 5 NODE 5 --> 50.2052231 sigma out 15 active outputs RANK 6 NODE 11 --> 43.1862373 sigma out 15 active outputs RANK 7 NODE 10 --> 42.7994118 sigma out 15 active outputs RANK 8 NODE 3 --> 42.6993141 sigma out 15 active outputs RANK 9 NODE 6 --> 41.2286339 sigma out 15 active outputs RANK 10 NODE 2 --> 39.4029236 sigma out 15 active outputs RANK 11 NODE 8 --> 30.0395241 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 75.2866135 sigma in 11act. ( 86.5503769 sig out 1act.) RANK 2 NODE 1 --> 72.7607117 sigma in 11act. ( 78.1582642 sig out 1act.) RANK 3 NODE 7 --> 62.1908607 sigma in 11act. ( 58.6027489 sig out 1act.) RANK 4 NODE 12 --> 57.8398094 sigma in 11act. ( 60.5061226 sig out 1act.) RANK 5 NODE 14 --> 55.2799377 sigma in 11act. ( 62.5767517 sig out 1act.) RANK 6 NODE 4 --> 51.5833168 sigma in 11act. ( 52.6836777 sig out 1act.) RANK 7 NODE 5 --> 50.144886 sigma in 11act. ( 54.9494476 sig out 1act.) RANK 8 NODE 13 --> 48.9400291 sigma in 11act. ( 55.5063858 sig out 1act.) RANK 9 NODE 6 --> 35.8661232 sigma in 11act. ( 39.1960487 sig out 1act.) RANK 10 NODE 9 --> 24.7419338 sigma in 11act. ( 21.0002117 sig out 1act.) RANK 11 NODE 3 --> 22.3338833 sigma in 11act. ( 22.9292126 sig out 1act.) RANK 12 NODE 10 --> 17.3680477 sigma in 11act. ( 18.1173134 sig out 1act.) RANK 13 NODE 15 --> 14.8858986 sigma in 11act. ( 14.9031343 sig out 1act.) RANK 14 NODE 8 --> 10.5120287 sigma in 11act. ( 10.7752209 sig out 1act.) RANK 15 NODE 11 --> 4.78711081 sigma in 11act. ( 4.86534166 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 86.5503769 sigma out 1act.( 75.2866135 sig in 11act.) RANK 2 NODE 1 --> 78.1582642 sigma out 1act.( 72.7607117 sig in 11act.) RANK 3 NODE 14 --> 62.5767517 sigma out 1act.( 55.2799377 sig in 11act.) RANK 4 NODE 12 --> 60.5061226 sigma out 1act.( 57.8398094 sig in 11act.) RANK 5 NODE 7 --> 58.6027489 sigma out 1act.( 62.1908607 sig in 11act.) RANK 6 NODE 13 --> 55.5063858 sigma out 1act.( 48.9400291 sig in 11act.) RANK 7 NODE 5 --> 54.9494476 sigma out 1act.( 50.144886 sig in 11act.) RANK 8 NODE 4 --> 52.6836777 sigma out 1act.( 51.5833168 sig in 11act.) RANK 9 NODE 6 --> 39.1960487 sigma out 1act.( 35.8661232 sig in 11act.) RANK 10 NODE 3 --> 22.9292126 sigma out 1act.( 22.3338833 sig in 11act.) RANK 11 NODE 9 --> 21.0002117 sigma out 1act.( 24.7419338 sig in 11act.) RANK 12 NODE 10 --> 18.1173134 sigma out 1act.( 17.3680477 sig in 11act.) RANK 13 NODE 15 --> 14.9031343 sigma out 1act.( 14.8858986 sig in 11act.) RANK 14 NODE 8 --> 10.7752209 sigma out 1act.( 10.5120287 sig in 11act.) RANK 15 NODE 11 --> 4.86534166 sigma out 1act.( 4.78711081 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 191.520187 sigma in 15 active inputs *********************************************** *** Learn Path 60 *** loss function: -0.55000478 *** contribution from regularisation: 0.0035744207 *** contribution from error: -0.553579211 *********************************************** -----------------> Test sample Iteration No: 60 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52830.7091 -0.898245692 -26.0174809 EXIT FROM BFGS code FG_LNSRCH 0. -0.90280652 0. --------------------------------------------------- Iteration : 61 *********************************************** *** Learn Path 61 *** loss function: -0.550032258 *** contribution from regularisation: 0.00366976787 *** contribution from error: -0.553701997 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52833.3489 -0.90280652 -7.24924278 EXIT FROM BFGS code FG_LNSRCH 0. -0.903918028 0. --------------------------------------------------- Iteration : 62 *********************************************** *** Learn Path 62 *** loss function: -0.550065041 *** contribution from regularisation: 0.00363353267 *** contribution from error: -0.553698599 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52836.4971 -0.903918028 -2.67391086 EXIT FROM BFGS code FG_LNSRCH 0. -0.903966784 0. --------------------------------------------------- Iteration : 63 *********************************************** *** Learn Path 63 *** loss function: -0.550072253 *** contribution from regularisation: 0.00362577476 *** contribution from error: -0.553698003 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52837.1876 -0.903966784 -2.47336245 EXIT FROM BFGS code FG_LNSRCH 0. -0.903966963 0. --------------------------------------------------- Iteration : 64 *********************************************** *** Learn Path 64 *** loss function: -0.550073206 *** contribution from regularisation: 0.00362478034 *** contribution from error: -0.553698003 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52837.2827 -0.903966963 -2.48373652 EXIT FROM BFGS code FG_LNSRCH 0. -0.903966963 0. --------------------------------------------------- Iteration : 65 *********************************************** *** Learn Path 65 *** loss function: -0.550076067 *** contribution from regularisation: 0.0036219405 *** contribution from error: -0.553698003 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52837.5555 -0.903966963 -2.48085594 EXIT FROM BFGS code FG_LNSRCH 0. -0.903966963 0. --------------------------------------------------- Iteration : 66 *********************************************** *** Learn Path 66 *** loss function: -0.550072074 *** contribution from regularisation: 0.00362592936 *** contribution from error: -0.553698003 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52837.1724 -0.903966963 -2.49788547 EXIT FROM BFGS code FG_LNSRCH 0. -0.903966963 0. --------------------------------------------------- Iteration : 67 *********************************************** *** Learn Path 67 *** loss function: -0.550072968 *** contribution from regularisation: 0.00362505205 *** contribution from error: -0.553698003 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52837.2566 -0.903966963 -2.49694729 EXIT FROM BFGS code NEW_X -52837.2566 -0.903966963 -2.49694729 ENTER BFGS code NEW_X -52837.2566 -0.903966963 -2.49694729 EXIT FROM BFGS code CONVERGENC -52837.2566 -0.903966963 -2.49694729 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 122.891029 sigma out 15 active outputs RANK 2 NODE 1 --> 118.150261 sigma out 15 active outputs RANK 3 NODE 4 --> 79.918869 sigma out 15 active outputs RANK 4 NODE 5 --> 73.9995193 sigma out 15 active outputs RANK 5 NODE 7 --> 72.5954056 sigma out 15 active outputs RANK 6 NODE 11 --> 63.6521683 sigma out 15 active outputs RANK 7 NODE 3 --> 63.284771 sigma out 15 active outputs RANK 8 NODE 10 --> 61.367672 sigma out 15 active outputs RANK 9 NODE 6 --> 60.9107094 sigma out 15 active outputs RANK 10 NODE 2 --> 56.9152489 sigma out 15 active outputs RANK 11 NODE 8 --> 43.5774994 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 111.10778 sigma in 11act. ( 125.443817 sig out 1act.) RANK 2 NODE 1 --> 105.022682 sigma in 11act. ( 112.707794 sig out 1act.) RANK 3 NODE 7 --> 89.7589722 sigma in 11act. ( 84.9965897 sig out 1act.) RANK 4 NODE 12 --> 83.5966415 sigma in 11act. ( 89.3468475 sig out 1act.) RANK 5 NODE 14 --> 79.0771408 sigma in 11act. ( 90.921051 sig out 1act.) RANK 6 NODE 4 --> 74.6967621 sigma in 11act. ( 77.321228 sig out 1act.) RANK 7 NODE 5 --> 72.9072418 sigma in 11act. ( 80.6627579 sig out 1act.) RANK 8 NODE 13 --> 69.5641022 sigma in 11act. ( 79.3387985 sig out 1act.) RANK 9 NODE 6 --> 52.2532463 sigma in 11act. ( 57.1171074 sig out 1act.) RANK 10 NODE 9 --> 35.8223991 sigma in 11act. ( 30.7664299 sig out 1act.) RANK 11 NODE 3 --> 32.465889 sigma in 11act. ( 33.5364647 sig out 1act.) RANK 12 NODE 10 --> 25.5708485 sigma in 11act. ( 26.942564 sig out 1act.) RANK 13 NODE 15 --> 21.5129967 sigma in 11act. ( 21.7393303 sig out 1act.) RANK 14 NODE 8 --> 15.1051636 sigma in 11act. ( 15.8442135 sig out 1act.) RANK 15 NODE 11 --> 6.78379965 sigma in 11act. ( 7.14037466 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 125.443817 sigma out 1act.( 111.10778 sig in 11act.) RANK 2 NODE 1 --> 112.707794 sigma out 1act.( 105.022682 sig in 11act.) RANK 3 NODE 14 --> 90.921051 sigma out 1act.( 79.0771408 sig in 11act.) RANK 4 NODE 12 --> 89.3468475 sigma out 1act.( 83.5966415 sig in 11act.) RANK 5 NODE 7 --> 84.9965897 sigma out 1act.( 89.7589722 sig in 11act.) RANK 6 NODE 5 --> 80.6627579 sigma out 1act.( 72.9072418 sig in 11act.) RANK 7 NODE 13 --> 79.3387985 sigma out 1act.( 69.5641022 sig in 11act.) RANK 8 NODE 4 --> 77.321228 sigma out 1act.( 74.6967621 sig in 11act.) RANK 9 NODE 6 --> 57.1171074 sigma out 1act.( 52.2532463 sig in 11act.) RANK 10 NODE 3 --> 33.5364647 sigma out 1act.( 32.465889 sig in 11act.) RANK 11 NODE 9 --> 30.7664299 sigma out 1act.( 35.8223991 sig in 11act.) RANK 12 NODE 10 --> 26.942564 sigma out 1act.( 25.5708485 sig in 11act.) RANK 13 NODE 15 --> 21.7393303 sigma out 1act.( 21.5129967 sig in 11act.) RANK 14 NODE 8 --> 15.8442135 sigma out 1act.( 15.1051636 sig in 11act.) RANK 15 NODE 11 --> 7.14037466 sigma out 1act.( 6.78379965 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 278.436676 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.550073147 *** contribution from regularisation: 0.00362483179 *** contribution from error: -0.553698003 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 33955 Closing output file done