NNInput NNInputs_160.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 196440 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 59008 nbkg = 137432 Bkg Entries: 137432 Sig Entries: 59008 Chosen entries: 59008 Signal fraction: 1 Background fraction: 0.429361 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 137432 Actual Signal Entries: 59008 Entries to split: 59008 Test with : 29504 Train with : 29504 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 59008 for Signal Prepared event 0 for Signal with 59008 events ====Entry 0 Variable Ht : 120.598 Variable LepAPt : 29.9056 Variable LepBPt : 13.5082 Variable MetSigLeptonsJets : 11.7141 Variable MetSpec : 77.1834 Variable SumEtLeptonsJets : 43.4138 Variable VSumJetLeptonsPt : 43.304 Variable addEt : 120.598 Variable dPhiLepSumMet : 2.82377 Variable dPhiLeptons : 0.153702 Variable dRLeptons : 0.732968 Variable lep1_E : 40.451 Variable lep2_E : 32.7603 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2160 Ht = 120.598 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 29.9058 LepAPt = 29.9056 LepBEt = 13.5084 LepBPt = 13.5082 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 77.1834 MetDelPhi = 2.77599 MetSig = 6.78472 MetSigLeptonsJets = 11.7141 MetSpec = 77.1834 Mjj = 0 MostCentralJetEta = 0 MtllMet = 139.14 Njets = 0 SB = 0 SumEt = 129.415 SumEtJets = 0 SumEtLeptonsJets = 43.4138 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 43.304 addEt = 120.598 dPhiLepSumMet = 2.82377 dPhiLeptons = 0.153702 dRLeptons = 0.732968 diltype = 34 dimass = 15.0375 event = 2600 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.451 lep2_E = 32.7603 rand = 0.999742 run = 233650 weight = 2.30027e-06 ===Show End Prepared event 10000 for Signal with 59008 events Prepared event 20000 for Signal with 59008 events Prepared event 30000 for Signal with 59008 events Prepared event 40000 for Signal with 59008 events Prepared event 50000 for Signal with 59008 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 137432 for Background Prepared event 0 for Background with 137432 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.424405 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 137432 events Prepared event 20000 for Background with 137432 events Prepared event 30000 for Background with 137432 events Prepared event 40000 for Background with 137432 events Prepared event 50000 for Background with 137432 events Prepared event 60000 for Background with 137432 events Prepared event 70000 for Background with 137432 events Prepared event 80000 for Background with 137432 events Prepared event 90000 for Background with 137432 events Prepared event 100000 for Background with 137432 events Prepared event 110000 for Background with 137432 events Prepared event 120000 for Background with 137432 events Prepared event 130000 for Background with 137432 events Warning: found 4451 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 196440 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4451 negative weights. Signal fraction: 63.1321411 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0048981 63.8276901 66.0533905 67.76577 68.9093704 70.2084961 71.0968094 71.9224243 72.8109283 73.6108475 74.3735199 75.1739655 75.8685455 76.6545258 77.1520386 77.9113007 78.6385422 79.3130722 79.9597473 80.708847 81.2574921 82.0705566 82.9670563 83.7585526 84.7489014 85.9428558 87.0957489 88.3115845 89.3588562 90.7903976 92.2647934 93.7275085 95.1516495 96.7012634 98.0895004 99.604126 101.268799 102.909271 104.395187 105.901215 107.57695 109.133629 110.81797 112.785103 114.586189 116.278351 118.032547 119.793205 121.496506 123.333542 124.958939 126.676102 128.215607 129.849258 131.403381 132.959091 134.496704 136.03006 137.675201 139.204224 140.683319 142.217834 143.578583 144.934052 146.45224 147.830383 149.210083 150.644073 151.944977 153.250961 154.587433 155.959961 157.322784 158.845428 160.323181 162.057266 163.96167 166.053223 168.226776 170.520111 172.916687 175.274887 177.905273 180.786957 183.816284 186.791687 189.938171 192.821381 196.4216 200.288727 204.406982 209.08522 214.752838 220.670929 227.84964 235.988632 246.92926 261.523376 281.70636 318.307617 1486.89319 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.3995972 20.8060303 21.1058617 21.3782101 21.6110229 21.8917179 22.124054 22.3548965 22.6146126 22.823513 23.0507545 23.2934914 23.5341187 23.7664108 24.050787 24.2806492 24.5139618 24.7314053 24.9813538 25.2057705 25.4413338 25.6960449 25.9147682 26.1623306 26.3809624 26.6042595 26.8390579 27.0875778 27.2982788 27.6043491 27.819355 28.0444221 28.2935944 28.567215 28.8390274 29.104969 29.3401814 29.6174641 29.885643 30.2046318 30.4946709 30.7256012 31.0010166 31.2884789 31.5523834 31.829689 32.0701523 32.3011551 32.5919685 32.8947525 33.1639519 33.4483948 33.7411499 34.0271568 34.3167191 34.6300049 34.9244804 35.2466927 35.5295715 35.8183975 36.1425056 36.4270935 36.7331009 37.0579224 37.3704491 37.6562881 37.986351 38.3195343 38.6499023 38.9528275 39.2676544 39.6094208 39.9481277 40.2808533 40.6217957 41.0090942 41.3989105 41.79319 42.1971664 42.5954742 42.9919739 43.4402695 43.9213028 44.4260674 45.006031 45.6018219 46.2376785 46.9331741 47.6464996 48.4607849 49.3810654 50.4110413 51.696579 53.2192764 55.054882 57.3487396 60.2519073 64.7046967 72.2505341 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1413097 10.3072014 10.4320164 10.5359783 10.6995687 10.8411579 10.9772987 11.1426239 11.2843208 11.4205484 11.5740089 11.7272263 11.8885756 12.0404949 12.1905699 12.3572922 12.5261345 12.7106819 12.8578835 13.0607119 13.2716436 13.4663906 13.6091557 13.7483063 13.8879814 14.0666256 14.2927685 14.4856653 14.7311993 14.9798088 15.1884594 15.3676081 15.604414 15.8498211 16.0289764 16.3101273 16.5723686 16.7836056 17.0624142 17.3438454 17.6187077 17.9015846 18.1793461 18.4839821 18.8136253 19.1160202 19.4482765 19.7977982 20.1117439 20.3887024 20.6697426 20.9811935 21.3053894 21.6122112 21.9526234 22.2872276 22.6235008 22.97715 23.3003426 23.6320877 23.9601269 24.3110504 24.6708565 25.0636711 25.4431458 25.7966862 26.1458359 26.4621105 26.8224487 27.1858826 27.5694847 27.9714317 28.3319817 28.7136536 29.1172009 29.5167046 29.9099846 30.2795868 30.7039185 31.1268044 31.5316391 31.9500866 32.3840141 32.7821121 33.2135658 33.7021751 34.2055702 34.7373734 35.3059807 35.8825531 36.5239944 37.2100296 38.0341339 39.0166245 40.2365837 41.7382355 43.7279701 46.6714554 52.1169739 118.205795 ------------------------------ Transdef: Tab for variable 5 1.07485831 2.66838408 3.10857058 3.39051795 3.69883204 3.91027069 4.08471966 4.21299362 4.34152985 4.46552944 4.58614826 4.6672883 4.7802434 4.872859 4.95654106 5.03970194 5.11997223 5.18778419 5.26332903 5.32433271 5.3797121 5.4419241 5.49309921 5.53871107 5.58475208 5.6392045 5.69217396 5.74347687 5.79465485 5.84404612 5.89523745 5.94103813 5.98300266 6.02365541 6.07808113 6.12359524 6.17371082 6.21483517 6.25680256 6.29501724 6.34474993 6.39778423 6.44419956 6.48475647 6.52519989 6.57497978 6.6190958 6.66761303 6.72035122 6.77279854 6.82222843 6.86757088 6.89955235 6.95223713 6.99889946 7.04641438 7.0988102 7.15761185 7.20760155 7.25684452 7.30634308 7.36037064 7.40579605 7.46354485 7.52281427 7.57828093 7.62938213 7.68719673 7.74816799 7.80848789 7.86448574 7.92952442 7.99217844 8.0569725 8.10904503 8.1630497 8.22057915 8.27636909 8.33757973 8.40090275 8.46187782 8.5308075 8.59261894 8.65417862 8.72777748 8.79076004 8.86962318 8.95107174 9.03556252 9.12626457 9.22361374 9.32894516 9.44882584 9.58648586 9.73695374 9.9146986 10.1437664 10.4338379 10.8885288 11.6547871 26.9916515 ------------------------------ Transdef: Tab for variable 6 15.0022345 21.6666183 25.5235558 26.7491627 27.8667259 28.8051319 29.6511612 30.4892616 31.1872444 31.9024391 32.4505844 33.0012093 33.4293137 33.8741379 34.3520317 34.80439 35.2242241 35.6577759 36.0884018 36.4875984 36.8633499 37.2791977 37.7153511 38.044899 38.4291687 38.7967911 39.1638985 39.6042862 40.0438499 40.4252243 40.833725 41.2152252 41.6782913 42.179718 42.627964 43.0028801 43.5317001 43.8754807 44.4026794 44.9326019 45.5112381 46.1369133 46.8160706 47.3808746 48.0550232 48.6542053 49.290493 49.9188156 50.4226761 51.1481476 51.9315033 52.718708 53.5867767 54.3020477 54.9813309 55.7693977 56.5626984 57.2986603 58.0715561 58.8733749 59.5999832 60.4157715 61.1922531 61.9613266 62.8015213 63.5591774 64.3885117 65.1818542 65.9537659 66.7136841 67.4680023 68.2227631 68.9794617 69.7515564 70.4837723 71.2860947 71.9997101 72.7336655 73.5118103 74.2872162 75.0188293 75.7524948 76.6214676 77.3945923 78.1542358 79.0336304 80.0097351 81.0183868 82.1231842 83.3894653 84.8836365 86.4203949 88.2827454 90.4206924 93.0576477 96.1890869 99.9030914 104.655685 111.904877 125.23877 738.435913 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.628891 33.7696915 34.4813576 35.114193 35.7030258 36.1603432 36.6622849 37.0452805 37.4949875 37.8711472 38.214592 38.5272827 38.8047333 39.1501007 39.4380722 39.7929192 40.1407547 40.4628983 40.8976288 41.3095169 41.6941872 42.092308 42.5992966 43.053299 43.5287247 44.2242279 44.7395554 45.3528366 46.0389061 46.918602 47.6216774 48.4827499 49.394928 50.4555435 51.4514542 52.3801498 53.3560066 54.4063492 55.3801956 56.3560638 57.3147812 58.2506561 59.28125 60.1963425 61.16008 61.9972191 62.8663406 63.7857132 64.593399 65.4760361 66.3524399 67.2088318 68.0355988 68.8522644 69.7776489 70.6339722 71.4956512 72.3142624 73.1116333 73.9842529 74.8711624 75.6924591 76.6048889 77.505127 78.4755859 79.4146271 80.5015335 81.7178802 82.897171 84.2286911 85.6797791 87.1122437 88.6671753 90.3330994 91.87323 93.541275 95.2055817 96.9922485 98.8538208 100.779404 102.588684 104.795212 106.930191 109.077271 111.779381 114.631035 117.488342 120.297462 123.683914 127.434441 131.799591 136.055725 141.21991 147.955444 155.742203 164.902405 176.923401 193.737427 226.214081 748.456726 ------------------------------ Transdef: Tab for variable 8 1.768857 25.5541573 29.5937119 31.2891769 32.2441444 32.9852066 33.6066132 34.0802383 34.5415382 35.0332222 35.4443016 35.8494148 36.1519775 36.5234985 36.8016663 37.1252098 37.4377441 37.7425995 38.0308914 38.2982254 38.5737839 38.8442459 39.1174889 39.4236603 39.7171173 40.0225334 40.4278793 40.7818451 41.1881218 41.4920197 41.9170799 42.2992439 42.6934433 43.1987228 43.6766739 44.0443382 44.5880966 45.1793289 45.6446991 46.2688255 46.8379288 47.4623871 48.1692581 48.8154793 49.4075012 50.1078568 50.8220215 51.4370003 52.1848869 52.828949 53.5449448 54.2690697 55.0103531 55.6849289 56.4456024 57.1202927 57.8336449 58.4834442 59.1864853 59.8146553 60.5215073 61.2135353 61.8793259 62.520359 63.1988373 63.896637 64.5637589 65.2161255 65.9677124 66.6299591 67.3135986 67.9915009 68.7403717 69.4211121 70.1334076 70.8486481 71.5336609 72.2288971 72.9711151 73.7184296 74.4427948 75.1812973 75.9563293 76.7668991 77.6164474 78.4849167 79.3912354 80.4668121 81.6573944 82.9632416 84.3727264 85.9910126 87.9641876 90.2297058 93.0116272 96.1264496 100.195175 105.145569 112.37886 126.148148 744.690247 ------------------------------ Transdef: Tab for variable 9 49.6710663 63.3587341 65.4571686 67.103775 68.415863 69.5780029 70.4442749 71.3207245 72.0713043 72.8380737 73.5766449 74.2519684 74.9685822 75.5591431 76.3137817 76.9181137 77.3432312 78.0136108 78.6385422 79.2225876 79.7740021 80.4280243 80.9873352 81.5363388 82.2933502 83.0163345 83.6579971 84.5036926 85.3282318 86.2076645 87.1909866 88.1667786 89.1300049 89.9453888 91.256546 92.4288101 93.5383301 94.6882324 95.9567413 97.3737946 98.7510223 99.9727325 101.541519 102.858719 104.091293 105.439362 106.698303 108.151772 109.526398 110.894798 112.249268 113.64917 114.977325 116.317947 117.673248 119.03717 120.301849 121.591751 122.905502 124.239685 125.540054 126.829773 128.015121 129.23027 130.503723 131.661102 132.757477 133.923264 135.030243 136.219788 137.3797 138.587341 139.728439 140.962189 142.129181 143.245605 144.304108 145.412811 146.566193 147.617035 148.754547 149.811874 150.845306 151.906982 152.913818 153.946533 155.025146 156.144226 157.287369 158.505493 159.792236 161.1362 162.688965 164.506363 166.692963 169.458038 172.95343 178.367615 187.378723 206.686066 801.871094 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.16747487 1.47471285 1.67785394 1.83336496 1.94291031 2.0328846 2.11650181 2.1827786 2.24504638 2.29911518 2.34729195 2.38911438 2.42850232 2.46473265 2.49564242 2.52426863 2.5532465 2.57975531 2.60591984 2.62686825 2.64969921 2.67170262 2.69195604 2.7125442 2.73014903 2.74694586 2.76238823 2.77706718 2.79338551 2.80815887 2.82198811 2.83453703 2.84571218 2.85547805 2.86605501 2.87635946 2.88589883 2.89469624 2.90206623 2.91164064 2.91990948 2.9277513 2.93527555 2.94257331 2.94966602 2.95561767 2.9622426 2.96815205 2.97470379 2.98022223 2.9845736 2.98938465 2.99427199 2.9994998 3.0039463 3.00861502 3.01378894 3.01827168 3.02254629 3.02675271 3.03023171 3.03441906 3.03830147 3.04209304 3.04546928 3.04926872 3.05302858 3.05661583 3.05925465 3.06278872 3.06601763 3.06902528 3.07231379 3.07547665 3.07814598 3.08098269 3.08389235 3.08695793 3.08965969 3.09217215 3.09487343 3.09783888 3.10097075 3.10371447 3.10589027 3.10849857 3.11107445 3.11334705 3.11572981 3.11815739 3.12064719 3.12292862 3.12522197 3.12782001 3.13043261 3.13258028 3.13464022 3.13683248 3.13911438 3.1415906 ------------------------------ Transdef: Tab for variable 11 2.8014183E-06 0.00585324597 0.011588336 0.0181307197 0.0244133472 0.0304896813 0.038097918 0.0457851142 0.053000927 0.0605931208 0.0669820309 0.074170433 0.0806134939 0.0882074833 0.0949146152 0.102610588 0.109909296 0.11636591 0.122627318 0.129303098 0.135157108 0.141437054 0.147592068 0.15356718 0.158600986 0.163847029 0.169604063 0.175553828 0.180663049 0.18616277 0.192136168 0.196959257 0.202306509 0.207792997 0.212736309 0.218253374 0.223686621 0.229355812 0.234316602 0.239465654 0.24497813 0.250049323 0.255365431 0.260714293 0.265366495 0.270970106 0.276305318 0.281640857 0.286362886 0.291561186 0.296465605 0.301787019 0.307165504 0.312383085 0.318050146 0.323658705 0.328845263 0.334517837 0.340235114 0.346067786 0.351878345 0.357921064 0.36431694 0.370689631 0.376070142 0.381788135 0.38722229 0.3924793 0.398767829 0.404670238 0.410699725 0.417524159 0.424716145 0.430668652 0.437289119 0.443294525 0.450754642 0.457786173 0.465964317 0.473145008 0.480053306 0.489875436 0.49876976 0.507692575 0.517914891 0.528211176 0.539390862 0.550590992 0.562709093 0.575913906 0.589508057 0.604999781 0.620857239 0.635300457 0.65447247 0.677085578 0.700357616 0.729729176 0.774695337 0.840555429 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.10008774 0.163403064 0.183591798 0.197844207 0.207863718 0.218667269 0.228490308 0.237065911 0.245076567 0.252637893 0.259267449 0.266499579 0.273888111 0.280924261 0.287476242 0.293907225 0.300339937 0.305901945 0.310651541 0.316252708 0.32197687 0.327895045 0.332931161 0.338537991 0.344277263 0.34944427 0.354774296 0.360569835 0.365794122 0.371264815 0.375970006 0.381189167 0.386368155 0.39117527 0.395833731 0.400593936 0.404382557 0.408025444 0.411978304 0.415097475 0.419011891 0.422710955 0.426364541 0.430294871 0.43427372 0.437786162 0.441435605 0.444928885 0.448651016 0.453271925 0.457478225 0.461478889 0.465940118 0.470041782 0.473993868 0.478596568 0.483329952 0.487936139 0.492047012 0.496391773 0.501099467 0.506035447 0.510339379 0.515665174 0.520846605 0.525984526 0.531046271 0.536599755 0.542420745 0.549277306 0.554565549 0.560856581 0.567087412 0.572517693 0.579105496 0.586613595 0.593869686 0.600441754 0.606410027 0.614768744 0.622442961 0.631027877 0.640066028 0.649147153 0.658484399 0.667377889 0.676372945 0.685390472 0.695315242 0.704502463 0.716375709 0.726220429 0.738112867 0.752094388 0.770040274 0.787175775 0.807831764 0.83371377 0.866341114 0.911070704 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0361443 21.808466 22.6415024 23.4097137 23.972208 24.5421829 25.1585217 25.6020412 26.0908642 26.5907269 27.0504704 27.4851723 27.8762589 28.3237476 28.7477264 29.1831512 29.5317345 29.8092403 30.216465 30.5603447 30.8897629 31.2091103 31.5040531 31.8606834 32.2528152 32.5309639 32.8892937 33.2464828 33.611599 33.952301 34.3722954 34.6434822 35.0054169 35.4005127 35.7689705 36.0756378 36.3653336 36.7545357 37.1263809 37.4448471 37.749649 38.0844154 38.4401588 38.7247391 39.0702057 39.4524612 39.7800674 40.1359978 40.4936981 40.8156815 41.1745605 41.5560837 41.9448547 42.3456345 42.6817245 43.0638885 43.456337 43.8035431 44.1835785 44.6015244 45.0362854 45.4637337 45.8979988 46.3423309 46.7627106 47.2118378 47.6890106 48.1523972 48.6491318 49.1433754 49.6574554 50.1672478 50.6625214 51.2328453 51.8183441 52.3589401 52.9757156 53.6771469 54.3610039 55.105732 55.9234009 56.7359848 57.5794601 58.4942398 59.5383263 60.5562363 61.7216263 63.1391449 64.4314117 65.7304993 67.2621002 69.0026703 70.8597183 73.0461731 75.8274307 78.9450684 82.6970062 86.9863358 91.8353043 100.864082 230.602936 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.79807 11.2886639 11.6192064 11.9948063 12.3362865 12.7419386 13.1387148 13.5073309 13.7901936 14.0730553 14.4481506 14.7262383 15.0665855 15.4218168 15.6928415 16.0170746 16.3733311 16.599081 16.8820362 17.1942749 17.5923939 17.8523254 18.1722431 18.5280037 18.8055515 19.168541 19.5040321 19.8808022 20.2314892 20.5890465 20.9442215 21.2863235 21.6438713 21.903986 22.2325115 22.5727806 22.9330864 23.2169266 23.5359879 23.8791542 24.2197361 24.5518494 24.918045 25.2729187 25.5843849 25.8802109 26.2093582 26.525465 26.9275684 27.2486019 27.5884209 27.9363575 28.2342281 28.5788651 28.9491615 29.3059959 29.6665115 30.0393753 30.3892212 30.7507286 31.1108093 31.4751549 31.8219852 32.1595993 32.5124779 32.8987732 33.2421303 33.6076584 33.9769821 34.3762741 34.7395172 35.1492119 35.5837555 36.0080032 36.4413185 36.8862686 37.3102341 37.7463837 38.2419739 38.7407455 39.2597961 39.8331146 40.4085083 41.0189514 41.6447067 42.3963051 43.0658112 43.8635674 44.7382851 45.6936417 46.7355042 47.8887978 49.1429977 50.6792221 52.7236404 54.83284 57.5873756 62.2819672 69.7615204 172.308975 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.1 50.8 57.3 29.3 50.0 64.7 56.9 65.5 -25.5 -24.1 -44.5 15.9 34.6 2 67.1 100.0 68.0 66.8 33.0 67.6 94.6 75.1 92.0 -43.5 -31.0 -56.6 32.4 43.3 3 50.8 68.0 100.0 54.4 6.6 33.1 71.7 54.2 72.9 -16.6 -33.2 -61.9 62.6 34.7 4 57.3 66.8 54.4 100.0 17.7 40.8 67.1 57.8 73.5 -12.8 -36.3 -69.4 26.5 76.1 5 29.3 33.0 6.6 17.7 100.0 83.6 6.2 56.6 53.8 25.9 -9.4 -12.4 -7.0 8.0 6 50.0 67.6 33.1 40.8 83.6 100.0 47.1 79.0 78.0 -5.7 -19.4 -32.7 8.7 24.4 7 64.7 94.6 71.7 67.1 6.2 47.1 100.0 67.0 81.3 -51.7 -30.2 -57.3 37.4 44.7 8 56.9 75.1 54.2 57.8 56.6 79.0 67.0 100.0 83.2 -9.5 -29.0 -49.8 24.9 38.6 9 65.5 92.0 72.9 73.5 53.8 78.0 81.3 83.2 100.0 -19.5 -34.3 -62.8 36.4 49.6 10 -25.5 -43.5 -16.6 -12.8 25.9 -5.7 -51.7 -9.5 -19.5 100.0 4.6 10.8 -6.1 -6.2 11 -24.1 -31.0 -33.2 -36.3 -9.4 -19.4 -30.2 -29.0 -34.3 4.6 100.0 57.1 -15.2 -26.5 12 -44.5 -56.6 -61.9 -69.4 -12.4 -32.7 -57.3 -49.8 -62.8 10.8 57.1 100.0 -31.9 -47.6 13 15.9 32.4 62.6 26.5 -7.0 8.7 37.4 24.9 36.4 -6.1 -15.2 -31.9 100.0 51.4 14 34.6 43.3 34.7 76.1 8.0 24.4 44.7 38.6 49.6 -6.2 -26.5 -47.6 51.4 100.0 TOTAL CORRELATION TO TARGET (diagonal) 173.441811 TOTAL CORRELATION OF ALL VARIABLES 73.1609748 ROUND 1: MAX CORR ( 73.1609745) AFTER KILLING INPUT VARIABLE 6 CONTR 0.00709368828 ROUND 2: MAX CORR ( 73.1605615) AFTER KILLING INPUT VARIABLE 8 CONTR 0.245824312 ROUND 3: MAX CORR ( 73.159819) AFTER KILLING INPUT VARIABLE 11 CONTR 0.329610939 ROUND 4: MAX CORR ( 73.1543096) AFTER KILLING INPUT VARIABLE 2 CONTR 0.897833023 ROUND 5: MAX CORR ( 73.1402644) AFTER KILLING INPUT VARIABLE 14 CONTR 1.433433 ROUND 6: MAX CORR ( 73.0925375) AFTER KILLING INPUT VARIABLE 12 CONTR 2.64182479 ROUND 7: MAX CORR ( 72.8817966) AFTER KILLING INPUT VARIABLE 10 CONTR 5.54641865 ROUND 8: MAX CORR ( 72.1407419) AFTER KILLING INPUT VARIABLE 13 CONTR 10.3667562 ROUND 9: MAX CORR ( 71.2875585) AFTER KILLING INPUT VARIABLE 3 CONTR 11.0621265 ROUND 10: MAX CORR ( 70.9467195) AFTER KILLING INPUT VARIABLE 9 CONTR 6.96268553 ROUND 11: MAX CORR ( 69.4970033) AFTER KILLING INPUT VARIABLE 4 CONTR 14.2689714 ROUND 12: MAX CORR ( 64.7005692) AFTER KILLING INPUT VARIABLE 5 CONTR 25.3706486 LAST REMAINING VARIABLE: 7 total correlation to target: 73.1609748 % total significance: 158.729155 sigma correlations of single variables to target: variable 2: 67.0812472 % , in sigma: 145.538652 variable 3: 50.7845818 % , in sigma: 110.181607 variable 4: 57.2702714 % , in sigma: 124.252879 variable 5: 29.3370964 % , in sigma: 63.649405 variable 6: 50.0291571 % , in sigma: 108.542646 variable 7: 64.7005692 % , in sigma: 140.373563 variable 8: 56.8520648 % , in sigma: 123.345543 variable 9: 65.4983059 % , in sigma: 142.104322 variable 10: -25.4757474 % , in sigma: 55.2718695 variable 11: -24.0664208 % , in sigma: 52.2142119 variable 12: -44.453439 % , in sigma: 96.4456369 variable 13: 15.9026664 % , in sigma: 34.5022302 variable 14: 34.5553214 % , in sigma: 74.9708021 variables sorted by significance: 1 most relevant variable 7 corr 64.7005692 , in sigma: 140.373562 2 most relevant variable 5 corr 25.3706493 , in sigma: 55.0438501 3 most relevant variable 4 corr 14.2689714 , in sigma: 30.9577857 4 most relevant variable 9 corr 6.96268559 , in sigma: 15.1061574 5 most relevant variable 3 corr 11.0621262 , in sigma: 24.0002534 6 most relevant variable 13 corr 10.3667564 , in sigma: 22.4915878 7 most relevant variable 10 corr 5.54641867 , in sigma: 12.033442 8 most relevant variable 12 corr 2.64182472 , in sigma: 5.73167056 9 most relevant variable 14 corr 1.43343306 , in sigma: 3.1099588 10 most relevant variable 2 corr 0.897833049 , in sigma: 1.94792759 11 most relevant variable 11 corr 0.329610944 , in sigma: 0.715119866 12 most relevant variable 8 corr 0.245824307 , in sigma: 0.533337406 13 most relevant variable 6 corr 0.00709368847 , in sigma: 0.0153903796 global correlations between input variables: variable 2: 99.1850236 % variable 3: 92.7461943 % variable 4: 93.6198364 % variable 5: 95.1377906 % variable 6: 94.8926937 % variable 7: 98.8121861 % variable 8: 89.9794163 % variable 9: 98.7373083 % variable 10: 72.1959105 % variable 11: 58.043463 % variable 12: 81.0835458 % variable 13: 84.5014684 % variable 14: 89.4787928 % significance loss when removing single variables: variable 2: corr = 0.915369485 % , sigma = 1.98597442 variable 3: corr = 13.9875984 % , sigma = 30.3473222 variable 4: corr = 11.4679587 % , sigma = 24.8807428 variable 5: corr = 15.2269918 % , sigma = 33.0362948 variable 6: corr = 0.00709368838 % , sigma = 0.0153903794 variable 7: corr = 9.09471327 % , sigma = 19.7317785 variable 8: corr = 0.225024537 % , sigma = 0.488210479 variable 9: corr = 9.8980459 % , sigma = 21.4746792 variable 10: corr = 5.19436729 % , sigma = 11.2696357 variable 11: corr = 0.33986957 % , sigma = 0.737376857 variable 12: corr = 2.1587072 % , sigma = 4.68350471 variable 13: corr = 8.2750978 % , sigma = 17.9535508 variable 14: corr = 1.46939916 % , sigma = 3.18799042 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 22.7825356 sigma out 15 active outputs RANK 2 NODE 3 --> 21.9853306 sigma out 15 active outputs RANK 3 NODE 8 --> 20.0406818 sigma out 15 active outputs RANK 4 NODE 6 --> 18.1381054 sigma out 15 active outputs RANK 5 NODE 2 --> 14.6135168 sigma out 15 active outputs RANK 6 NODE 5 --> 13.3218594 sigma out 15 active outputs RANK 7 NODE 4 --> 12.8473558 sigma out 15 active outputs RANK 8 NODE 7 --> 12.1040354 sigma out 15 active outputs RANK 9 NODE 9 --> 12.0797815 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 23.6841869 sigma in 9act. ( 31.0007801 sig out 1act.) RANK 2 NODE 5 --> 20.5688591 sigma in 9act. ( 20.4045315 sig out 1act.) RANK 3 NODE 10 --> 18.4665966 sigma in 9act. ( 18.8926353 sig out 1act.) RANK 4 NODE 8 --> 14.1075268 sigma in 9act. ( 16.1882877 sig out 1act.) RANK 5 NODE 7 --> 13.0835161 sigma in 9act. ( 11.6479683 sig out 1act.) RANK 6 NODE 11 --> 13.0684509 sigma in 9act. ( 14.9347715 sig out 1act.) RANK 7 NODE 12 --> 12.7763643 sigma in 9act. ( 13.2884855 sig out 1act.) RANK 8 NODE 13 --> 12.76791 sigma in 9act. ( 11.6028347 sig out 1act.) RANK 9 NODE 2 --> 9.95616817 sigma in 9act. ( 14.079421 sig out 1act.) RANK 10 NODE 9 --> 8.63432884 sigma in 9act. ( 5.58323145 sig out 1act.) RANK 11 NODE 14 --> 8.02743244 sigma in 9act. ( 10.8470068 sig out 1act.) RANK 12 NODE 4 --> 7.36062574 sigma in 9act. ( 11.6707449 sig out 1act.) RANK 13 NODE 15 --> 7.13435459 sigma in 9act. ( 8.82027531 sig out 1act.) RANK 14 NODE 6 --> 5.77122688 sigma in 9act. ( 10.3930826 sig out 1act.) RANK 15 NODE 3 --> 3.57114577 sigma in 9act. ( 5.62238121 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 31.0007801 sigma out 1act.( 23.6841869 sig in 9act.) RANK 2 NODE 5 --> 20.4045315 sigma out 1act.( 20.5688591 sig in 9act.) RANK 3 NODE 10 --> 18.8926353 sigma out 1act.( 18.4665966 sig in 9act.) RANK 4 NODE 8 --> 16.1882877 sigma out 1act.( 14.1075268 sig in 9act.) RANK 5 NODE 11 --> 14.9347715 sigma out 1act.( 13.0684509 sig in 9act.) RANK 6 NODE 2 --> 14.079421 sigma out 1act.( 9.95616817 sig in 9act.) RANK 7 NODE 12 --> 13.2884855 sigma out 1act.( 12.7763643 sig in 9act.) RANK 8 NODE 4 --> 11.6707449 sigma out 1act.( 7.36062574 sig in 9act.) RANK 9 NODE 7 --> 11.6479683 sigma out 1act.( 13.0835161 sig in 9act.) RANK 10 NODE 13 --> 11.6028347 sigma out 1act.( 12.76791 sig in 9act.) RANK 11 NODE 14 --> 10.8470068 sigma out 1act.( 8.02743244 sig in 9act.) RANK 12 NODE 6 --> 10.3930826 sigma out 1act.( 5.77122688 sig in 9act.) RANK 13 NODE 15 --> 8.82027531 sigma out 1act.( 7.13435459 sig in 9act.) RANK 14 NODE 3 --> 5.62238121 sigma out 1act.( 3.57114577 sig in 9act.) RANK 15 NODE 9 --> 5.58323145 sigma out 1act.( 8.63432884 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 58.0259285 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 25.2028141 sigma out 15 active outputs RANK 2 NODE 1 --> 22.7868385 sigma out 15 active outputs RANK 3 NODE 2 --> 21.6401653 sigma out 15 active outputs RANK 4 NODE 6 --> 20.0407429 sigma out 15 active outputs RANK 5 NODE 8 --> 19.9636688 sigma out 15 active outputs RANK 6 NODE 4 --> 15.6353827 sigma out 15 active outputs RANK 7 NODE 5 --> 15.4003067 sigma out 15 active outputs RANK 8 NODE 9 --> 14.1749058 sigma out 15 active outputs RANK 9 NODE 7 --> 12.4197111 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 28.8448181 sigma in 9act. ( 28.2425671 sig out 1act.) RANK 2 NODE 5 --> 18.0274658 sigma in 9act. ( 18.9975872 sig out 1act.) RANK 3 NODE 10 --> 16.3969002 sigma in 9act. ( 16.9222202 sig out 1act.) RANK 4 NODE 8 --> 15.8231125 sigma in 9act. ( 15.2680988 sig out 1act.) RANK 5 NODE 2 --> 14.3553858 sigma in 9act. ( 13.9147148 sig out 1act.) RANK 6 NODE 11 --> 14.2707109 sigma in 9act. ( 14.3282318 sig out 1act.) RANK 7 NODE 4 --> 13.5825462 sigma in 9act. ( 11.8024778 sig out 1act.) RANK 8 NODE 13 --> 13.1793451 sigma in 9act. ( 10.7667656 sig out 1act.) RANK 9 NODE 6 --> 12.9550896 sigma in 9act. ( 10.7865114 sig out 1act.) RANK 10 NODE 12 --> 12.6803217 sigma in 9act. ( 12.5439806 sig out 1act.) RANK 11 NODE 14 --> 11.4573536 sigma in 9act. ( 11.0177412 sig out 1act.) RANK 12 NODE 7 --> 11.1657724 sigma in 9act. ( 10.5888195 sig out 1act.) RANK 13 NODE 15 --> 10.1268816 sigma in 9act. ( 8.75595284 sig out 1act.) RANK 14 NODE 3 --> 8.38165569 sigma in 9act. ( 6.63964462 sig out 1act.) RANK 15 NODE 9 --> 7.62761593 sigma in 9act. ( 4.77715731 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 28.2425671 sigma out 1act.( 28.8448181 sig in 9act.) RANK 2 NODE 5 --> 18.9975872 sigma out 1act.( 18.0274658 sig in 9act.) RANK 3 NODE 10 --> 16.9222202 sigma out 1act.( 16.3969002 sig in 9act.) RANK 4 NODE 8 --> 15.2680988 sigma out 1act.( 15.8231125 sig in 9act.) RANK 5 NODE 11 --> 14.3282318 sigma out 1act.( 14.2707109 sig in 9act.) RANK 6 NODE 2 --> 13.9147148 sigma out 1act.( 14.3553858 sig in 9act.) RANK 7 NODE 12 --> 12.5439806 sigma out 1act.( 12.6803217 sig in 9act.) RANK 8 NODE 4 --> 11.8024778 sigma out 1act.( 13.5825462 sig in 9act.) RANK 9 NODE 14 --> 11.0177412 sigma out 1act.( 11.4573536 sig in 9act.) RANK 10 NODE 6 --> 10.7865114 sigma out 1act.( 12.9550896 sig in 9act.) RANK 11 NODE 13 --> 10.7667656 sigma out 1act.( 13.1793451 sig in 9act.) RANK 12 NODE 7 --> 10.5888195 sigma out 1act.( 11.1657724 sig in 9act.) RANK 13 NODE 15 --> 8.75595284 sigma out 1act.( 10.1268816 sig in 9act.) RANK 14 NODE 3 --> 6.63964462 sigma out 1act.( 8.38165569 sig in 9act.) RANK 15 NODE 9 --> 4.77715731 sigma out 1act.( 7.62761593 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.6164246 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.395805031 *** contribution from regularisation: 0.00327873067 *** contribution from error: -0.399083763 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.448961139 *** contribution from regularisation: 0.00246467465 *** contribution from error: -0.451425821 *********************************************** -----------------> Test sample ENTER BFGS code START -44106.7858 0.0377274863 0.108175464 EXIT FROM BFGS code FG_START 0. 0.0377274863 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.479299992 *** contribution from regularisation: 0.00230861758 *** contribution from error: -0.481608599 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47076.8465 0.0377274863 337.895874 EXIT FROM BFGS code FG_LNSRCH 0. 0.0790862665 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.528327167 *** contribution from regularisation: 0.00312093878 *** contribution from error: -0.531448126 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51892.2955 0.0790862665 201.245224 EXIT FROM BFGS code NEW_X -51892.2955 0.0790862665 201.245224 ENTER BFGS code NEW_X -51892.2955 0.0790862665 201.245224 EXIT FROM BFGS code FG_LNSRCH 0. 0.115851291 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.534579277 *** contribution from regularisation: 0.00325625762 *** contribution from error: -0.537835538 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52506.3782 0.115851291 5.31482601 EXIT FROM BFGS code NEW_X -52506.3782 0.115851291 5.31482601 ENTER BFGS code NEW_X -52506.3782 0.115851291 5.31482601 EXIT FROM BFGS code FG_LNSRCH 0. 0.119244345 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.536581039 *** contribution from regularisation: 0.00295011094 *** contribution from error: -0.539531171 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52702.9923 0.119244345 8.80492973 EXIT FROM BFGS code NEW_X -52702.9923 0.119244345 8.80492973 ENTER BFGS code NEW_X -52702.9923 0.119244345 8.80492973 EXIT FROM BFGS code FG_LNSRCH 0. 0.13038294 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.537262917 *** contribution from regularisation: 0.00269985967 *** contribution from error: -0.539962769 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52769.9613 0.13038294 -105.400856 EXIT FROM BFGS code NEW_X -52769.9613 0.13038294 -105.400856 ENTER BFGS code NEW_X -52769.9613 0.13038294 -105.400856 EXIT FROM BFGS code FG_LNSRCH 0. 0.113518119 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.537641704 *** contribution from regularisation: 0.00266820099 *** contribution from error: -0.540309906 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52807.166 0.113518119 6.69725418 EXIT FROM BFGS code NEW_X -52807.166 0.113518119 6.69725418 ENTER BFGS code NEW_X -52807.166 0.113518119 6.69725418 EXIT FROM BFGS code FG_LNSRCH 0. 0.107144102 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.537843764 *** contribution from regularisation: 0.00266064075 *** contribution from error: -0.540504396 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52827.0133 0.107144102 24.0948868 EXIT FROM BFGS code NEW_X -52827.0133 0.107144102 24.0948868 ENTER BFGS code NEW_X -52827.0133 0.107144102 24.0948868 EXIT FROM BFGS code FG_LNSRCH 0. 0.0252827387 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 38.6592941 sigma out 15 active outputs RANK 2 NODE 1 --> 28.4268951 sigma out 15 active outputs RANK 3 NODE 8 --> 25.3013859 sigma out 15 active outputs RANK 4 NODE 4 --> 23.8343277 sigma out 15 active outputs RANK 5 NODE 3 --> 22.6830235 sigma out 15 active outputs RANK 6 NODE 6 --> 19.2468262 sigma out 15 active outputs RANK 7 NODE 9 --> 17.6029778 sigma out 15 active outputs RANK 8 NODE 7 --> 16.5779018 sigma out 15 active outputs RANK 9 NODE 5 --> 15.6043377 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 40.2562981 sigma in 9act. ( 42.5455627 sig out 1act.) RANK 2 NODE 4 --> 23.6920147 sigma in 9act. ( 22.7770729 sig out 1act.) RANK 3 NODE 14 --> 23.2752132 sigma in 9act. ( 22.7754536 sig out 1act.) RANK 4 NODE 8 --> 20.8840847 sigma in 9act. ( 20.2286663 sig out 1act.) RANK 5 NODE 6 --> 20.3774033 sigma in 9act. ( 17.3178387 sig out 1act.) RANK 6 NODE 3 --> 19.9189892 sigma in 9act. ( 20.1148739 sig out 1act.) RANK 7 NODE 11 --> 17.0526524 sigma in 9act. ( 13.550808 sig out 1act.) RANK 8 NODE 2 --> 15.72437 sigma in 9act. ( 16.7116394 sig out 1act.) RANK 9 NODE 15 --> 13.9111414 sigma in 9act. ( 14.9734488 sig out 1act.) RANK 10 NODE 12 --> 12.0199585 sigma in 9act. ( 11.2210398 sig out 1act.) RANK 11 NODE 5 --> 11.3939457 sigma in 9act. ( 12.1983042 sig out 1act.) RANK 12 NODE 13 --> 11.0740013 sigma in 9act. ( 9.65722942 sig out 1act.) RANK 13 NODE 9 --> 7.31465721 sigma in 9act. ( 6.1572814 sig out 1act.) RANK 14 NODE 10 --> 6.49670076 sigma in 9act. ( 6.30845356 sig out 1act.) RANK 15 NODE 7 --> 5.29439449 sigma in 9act. ( 4.11976337 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 42.5455627 sigma out 1act.( 40.2562981 sig in 9act.) RANK 2 NODE 4 --> 22.7770729 sigma out 1act.( 23.6920147 sig in 9act.) RANK 3 NODE 14 --> 22.7754536 sigma out 1act.( 23.2752132 sig in 9act.) RANK 4 NODE 8 --> 20.2286663 sigma out 1act.( 20.8840847 sig in 9act.) RANK 5 NODE 3 --> 20.1148739 sigma out 1act.( 19.9189892 sig in 9act.) RANK 6 NODE 6 --> 17.3178387 sigma out 1act.( 20.3774033 sig in 9act.) RANK 7 NODE 2 --> 16.7116394 sigma out 1act.( 15.72437 sig in 9act.) RANK 8 NODE 15 --> 14.9734488 sigma out 1act.( 13.9111414 sig in 9act.) RANK 9 NODE 11 --> 13.550808 sigma out 1act.( 17.0526524 sig in 9act.) RANK 10 NODE 5 --> 12.1983042 sigma out 1act.( 11.3939457 sig in 9act.) RANK 11 NODE 12 --> 11.2210398 sigma out 1act.( 12.0199585 sig in 9act.) RANK 12 NODE 13 --> 9.65722942 sigma out 1act.( 11.0740013 sig in 9act.) RANK 13 NODE 10 --> 6.30845356 sigma out 1act.( 6.49670076 sig in 9act.) RANK 14 NODE 9 --> 6.1572814 sigma out 1act.( 7.31465721 sig in 9act.) RANK 15 NODE 7 --> 4.11976337 sigma out 1act.( 5.29439449 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 71.4920731 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.539672971 *** contribution from regularisation: 0.00255127368 *** contribution from error: -0.542224228 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53006.677 0.0252827387 104.951622 EXIT FROM BFGS code NEW_X -53006.677 0.0252827387 104.951622 ENTER BFGS code NEW_X -53006.677 0.0252827387 104.951622 EXIT FROM BFGS code FG_LNSRCH 0. 0.00799782947 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.540117264 *** contribution from regularisation: 0.00281853508 *** contribution from error: -0.542935789 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53050.3202 0.00799782947 72.9499969 EXIT FROM BFGS code NEW_X -53050.3202 0.00799782947 72.9499969 ENTER BFGS code NEW_X -53050.3202 0.00799782947 72.9499969 EXIT FROM BFGS code FG_LNSRCH 0. 0.0139769567 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.540809929 *** contribution from regularisation: 0.00269168452 *** contribution from error: -0.543501616 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53118.3498 0.0139769567 16.4029732 EXIT FROM BFGS code NEW_X -53118.3498 0.0139769567 16.4029732 ENTER BFGS code NEW_X -53118.3498 0.0139769567 16.4029732 EXIT FROM BFGS code FG_LNSRCH 0. 0.0203180574 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.541206837 *** contribution from regularisation: 0.0027054979 *** contribution from error: -0.543912351 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53157.3374 0.0203180574 -6.41953754 EXIT FROM BFGS code NEW_X -53157.3374 0.0203180574 -6.41953754 ENTER BFGS code NEW_X -53157.3374 0.0203180574 -6.41953754 EXIT FROM BFGS code FG_LNSRCH 0. 0.018891003 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.54143846 *** contribution from regularisation: 0.00274618343 *** contribution from error: -0.544184625 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53180.0838 0.018891003 2.26832318 EXIT FROM BFGS code NEW_X -53180.0838 0.018891003 2.26832318 ENTER BFGS code NEW_X -53180.0838 0.018891003 2.26832318 EXIT FROM BFGS code FG_LNSRCH 0. 0.0239884872 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.541795611 *** contribution from regularisation: 0.00285729952 *** contribution from error: -0.544652939 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53215.1661 0.0239884872 -5.3443079 EXIT FROM BFGS code NEW_X -53215.1661 0.0239884872 -5.3443079 ENTER BFGS code NEW_X -53215.1661 0.0239884872 -5.3443079 EXIT FROM BFGS code FG_LNSRCH 0. 0.0248863008 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.542321086 *** contribution from regularisation: 0.00274016988 *** contribution from error: -0.545061231 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53266.7781 0.0248863008 11.8072615 EXIT FROM BFGS code NEW_X -53266.7781 0.0248863008 11.8072615 ENTER BFGS code NEW_X -53266.7781 0.0248863008 11.8072615 EXIT FROM BFGS code FG_LNSRCH 0. 0.0297808461 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.54256624 *** contribution from regularisation: 0.00272474252 *** contribution from error: -0.545291007 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53290.8539 0.0297808461 21.8281765 EXIT FROM BFGS code NEW_X -53290.8539 0.0297808461 21.8281765 ENTER BFGS code NEW_X -53290.8539 0.0297808461 21.8281765 EXIT FROM BFGS code FG_LNSRCH 0. 0.0434561744 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.542741418 *** contribution from regularisation: 0.00271938182 *** contribution from error: -0.54546082 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53308.0602 0.0434561744 2.98773003 EXIT FROM BFGS code NEW_X -53308.0602 0.0434561744 2.98773003 ENTER BFGS code NEW_X -53308.0602 0.0434561744 2.98773003 EXIT FROM BFGS code FG_LNSRCH 0. 0.0595193207 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.542950392 *** contribution from regularisation: 0.00269452692 *** contribution from error: -0.545644939 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53328.5899 0.0595193207 25.9944382 EXIT FROM BFGS code NEW_X -53328.5899 0.0595193207 25.9944382 ENTER BFGS code NEW_X -53328.5899 0.0595193207 25.9944382 EXIT FROM BFGS code FG_LNSRCH 0. 0.0818493143 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 46.8873978 sigma out 15 active outputs RANK 2 NODE 1 --> 45.4456291 sigma out 15 active outputs RANK 3 NODE 4 --> 40.6467934 sigma out 15 active outputs RANK 4 NODE 7 --> 38.7370148 sigma out 15 active outputs RANK 5 NODE 6 --> 29.7363968 sigma out 15 active outputs RANK 6 NODE 8 --> 29.3134575 sigma out 15 active outputs RANK 7 NODE 3 --> 27.0009804 sigma out 15 active outputs RANK 8 NODE 9 --> 25.5378265 sigma out 15 active outputs RANK 9 NODE 5 --> 17.6261902 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 67.5119934 sigma in 9act. ( 70.6763535 sig out 1act.) RANK 2 NODE 4 --> 38.2047806 sigma in 9act. ( 40.7698326 sig out 1act.) RANK 3 NODE 14 --> 34.1666298 sigma in 9act. ( 37.7492752 sig out 1act.) RANK 4 NODE 3 --> 29.6545219 sigma in 9act. ( 33.2973404 sig out 1act.) RANK 5 NODE 6 --> 28.2242336 sigma in 9act. ( 28.2181301 sig out 1act.) RANK 6 NODE 8 --> 23.6738338 sigma in 9act. ( 25.0954342 sig out 1act.) RANK 7 NODE 15 --> 19.9596672 sigma in 9act. ( 22.5325985 sig out 1act.) RANK 8 NODE 2 --> 17.9747295 sigma in 9act. ( 23.4741287 sig out 1act.) RANK 9 NODE 5 --> 15.9877853 sigma in 9act. ( 19.036335 sig out 1act.) RANK 10 NODE 12 --> 13.2492495 sigma in 9act. ( 17.0728111 sig out 1act.) RANK 11 NODE 11 --> 11.41043 sigma in 9act. ( 8.66055965 sig out 1act.) RANK 12 NODE 13 --> 8.37481785 sigma in 9act. ( 7.98117161 sig out 1act.) RANK 13 NODE 9 --> 7.62145948 sigma in 9act. ( 7.91343641 sig out 1act.) RANK 14 NODE 7 --> 3.47967386 sigma in 9act. ( 2.72419 sig out 1act.) RANK 15 NODE 10 --> 2.73079443 sigma in 9act. ( 1.01035297 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 70.6763535 sigma out 1act.( 67.5119934 sig in 9act.) RANK 2 NODE 4 --> 40.7698326 sigma out 1act.( 38.2047806 sig in 9act.) RANK 3 NODE 14 --> 37.7492752 sigma out 1act.( 34.1666298 sig in 9act.) RANK 4 NODE 3 --> 33.2973404 sigma out 1act.( 29.6545219 sig in 9act.) RANK 5 NODE 6 --> 28.2181301 sigma out 1act.( 28.2242336 sig in 9act.) RANK 6 NODE 8 --> 25.0954342 sigma out 1act.( 23.6738338 sig in 9act.) RANK 7 NODE 2 --> 23.4741287 sigma out 1act.( 17.9747295 sig in 9act.) RANK 8 NODE 15 --> 22.5325985 sigma out 1act.( 19.9596672 sig in 9act.) RANK 9 NODE 5 --> 19.036335 sigma out 1act.( 15.9877853 sig in 9act.) RANK 10 NODE 12 --> 17.0728111 sigma out 1act.( 13.2492495 sig in 9act.) RANK 11 NODE 11 --> 8.66055965 sigma out 1act.( 11.41043 sig in 9act.) RANK 12 NODE 13 --> 7.98117161 sigma out 1act.( 8.37481785 sig in 9act.) RANK 13 NODE 9 --> 7.91343641 sigma out 1act.( 7.62145948 sig in 9act.) RANK 14 NODE 7 --> 2.72419 sigma out 1act.( 3.47967386 sig in 9act.) RANK 15 NODE 10 --> 1.01035297 sigma out 1act.( 2.73079443 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 111.97979 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.54316175 *** contribution from regularisation: 0.00265556038 *** contribution from error: -0.545817316 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53349.3457 0.0818493143 35.8411369 EXIT FROM BFGS code NEW_X -53349.3457 0.0818493143 35.8411369 ENTER BFGS code NEW_X -53349.3457 0.0818493143 35.8411369 EXIT FROM BFGS code FG_LNSRCH 0. 0.152009577 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.543286324 *** contribution from regularisation: 0.00262976787 *** contribution from error: -0.54591608 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53361.5822 0.152009577 12.4944077 EXIT FROM BFGS code NEW_X -53361.5822 0.152009577 12.4944077 ENTER BFGS code NEW_X -53361.5822 0.152009577 12.4944077 EXIT FROM BFGS code FG_LNSRCH 0. 0.149865866 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.543493867 *** contribution from regularisation: 0.00260926341 *** contribution from error: -0.54610312 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53381.9659 0.149865866 26.3469868 EXIT FROM BFGS code NEW_X -53381.9659 0.149865866 26.3469868 ENTER BFGS code NEW_X -53381.9659 0.149865866 26.3469868 EXIT FROM BFGS code FG_LNSRCH 0. 0.161204487 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.543503463 *** contribution from regularisation: 0.00263974513 *** contribution from error: -0.546143234 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53382.9112 0.161204487 20.5328121 EXIT FROM BFGS code NEW_X -53382.9112 0.161204487 20.5328121 ENTER BFGS code NEW_X -53382.9112 0.161204487 20.5328121 EXIT FROM BFGS code FG_LNSRCH 0. 0.211408764 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.543687522 *** contribution from regularisation: 0.00255799736 *** contribution from error: -0.546245515 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53400.9863 0.211408764 21.997879 EXIT FROM BFGS code NEW_X -53400.9863 0.211408764 21.997879 ENTER BFGS code NEW_X -53400.9863 0.211408764 21.997879 EXIT FROM BFGS code FG_LNSRCH 0. 0.279980868 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.543457985 *** contribution from regularisation: 0.00264456077 *** contribution from error: -0.546102524 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53378.4461 0.279980868 -59.8866806 EXIT FROM BFGS code FG_LNSRCH 0. 0.228030011 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.543545485 *** contribution from regularisation: 0.00275085494 *** contribution from error: -0.546296358 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53387.0346 0.228030011 2.88854551 EXIT FROM BFGS code FG_LNSRCH 0. 0.212677136 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.543543458 *** contribution from regularisation: 0.00270721316 *** contribution from error: -0.546250641 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53386.8385 0.212677136 20.626606 EXIT FROM BFGS code FG_LNSRCH 0. 0.211418688 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.543548942 *** contribution from regularisation: 0.00269665918 *** contribution from error: -0.546245575 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53387.3744 0.211418688 22.1306801 EXIT FROM BFGS code FG_LNSRCH 0. 0.211408764 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.543554425 *** contribution from regularisation: 0.00269107847 *** contribution from error: -0.546245515 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53387.9151 0.211408764 22.1496315 EXIT FROM BFGS code FG_LNSRCH 0. 0.211408764 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 48.8640862 sigma out 15 active outputs RANK 2 NODE 1 --> 46.8704185 sigma out 15 active outputs RANK 3 NODE 4 --> 36.4564819 sigma out 15 active outputs RANK 4 NODE 7 --> 36.0025024 sigma out 15 active outputs RANK 5 NODE 6 --> 31.7381172 sigma out 15 active outputs RANK 6 NODE 3 --> 30.2435188 sigma out 15 active outputs RANK 7 NODE 8 --> 26.7694416 sigma out 15 active outputs RANK 8 NODE 9 --> 24.707962 sigma out 15 active outputs RANK 9 NODE 5 --> 16.5332851 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 67.0220642 sigma in 9act. ( 69.9388123 sig out 1act.) RANK 2 NODE 4 --> 33.8396797 sigma in 9act. ( 35.1652679 sig out 1act.) RANK 3 NODE 14 --> 33.120285 sigma in 9act. ( 35.7312241 sig out 1act.) RANK 4 NODE 3 --> 30.3636398 sigma in 9act. ( 32.4779892 sig out 1act.) RANK 5 NODE 6 --> 30.1096802 sigma in 9act. ( 27.7008858 sig out 1act.) RANK 6 NODE 8 --> 23.6953754 sigma in 9act. ( 25.5791855 sig out 1act.) RANK 7 NODE 15 --> 21.3529129 sigma in 9act. ( 23.5261574 sig out 1act.) RANK 8 NODE 2 --> 19.5633755 sigma in 9act. ( 24.6080093 sig out 1act.) RANK 9 NODE 5 --> 16.3705215 sigma in 9act. ( 19.9642334 sig out 1act.) RANK 10 NODE 12 --> 13.6258545 sigma in 9act. ( 17.5397053 sig out 1act.) RANK 11 NODE 13 --> 10.5373058 sigma in 9act. ( 10.5835419 sig out 1act.) RANK 12 NODE 11 --> 9.98720837 sigma in 9act. ( 7.90440083 sig out 1act.) RANK 13 NODE 9 --> 8.95011425 sigma in 9act. ( 9.4452734 sig out 1act.) RANK 14 NODE 7 --> 4.21724653 sigma in 9act. ( 3.65634656 sig out 1act.) RANK 15 NODE 10 --> 2.6751647 sigma in 9act. ( 1.33625591 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 69.9388123 sigma out 1act.( 67.0220642 sig in 9act.) RANK 2 NODE 14 --> 35.7312241 sigma out 1act.( 33.120285 sig in 9act.) RANK 3 NODE 4 --> 35.1652679 sigma out 1act.( 33.8396797 sig in 9act.) RANK 4 NODE 3 --> 32.4779892 sigma out 1act.( 30.3636398 sig in 9act.) RANK 5 NODE 6 --> 27.7008858 sigma out 1act.( 30.1096802 sig in 9act.) RANK 6 NODE 8 --> 25.5791855 sigma out 1act.( 23.6953754 sig in 9act.) RANK 7 NODE 2 --> 24.6080093 sigma out 1act.( 19.5633755 sig in 9act.) RANK 8 NODE 15 --> 23.5261574 sigma out 1act.( 21.3529129 sig in 9act.) RANK 9 NODE 5 --> 19.9642334 sigma out 1act.( 16.3705215 sig in 9act.) RANK 10 NODE 12 --> 17.5397053 sigma out 1act.( 13.6258545 sig in 9act.) RANK 11 NODE 13 --> 10.5835419 sigma out 1act.( 10.5373058 sig in 9act.) RANK 12 NODE 9 --> 9.4452734 sigma out 1act.( 8.95011425 sig in 9act.) RANK 13 NODE 11 --> 7.90440083 sigma out 1act.( 9.98720837 sig in 9act.) RANK 14 NODE 7 --> 3.65634656 sigma out 1act.( 4.21724653 sig in 9act.) RANK 15 NODE 10 --> 1.33625591 sigma out 1act.( 2.6751647 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 109.659988 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.543546379 *** contribution from regularisation: 0.00269910297 *** contribution from error: -0.546245456 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53387.127 0.211408764 22.1943932 EXIT FROM BFGS code FG_LNSRCH 0. 0.211408764 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.543548763 *** contribution from regularisation: 0.00269673043 *** contribution from error: -0.546245515 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53387.36 0.211408764 22.2206326 EXIT FROM BFGS code FG_LNSRCH 0. 0.211408764 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.543550968 *** contribution from regularisation: 0.00269454997 *** contribution from error: -0.546245515 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53387.5742 0.211408764 22.2417278 EXIT FROM BFGS code NEW_X -53387.5742 0.211408764 22.2417278 ENTER BFGS code NEW_X -53387.5742 0.211408764 22.2417278 EXIT FROM BFGS code CONVERGENC -53387.5742 0.211408764 22.2417278 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 68.2946701 sigma out 15 active outputs RANK 2 NODE 1 --> 67.3384171 sigma out 15 active outputs RANK 3 NODE 4 --> 52.0022354 sigma out 15 active outputs RANK 4 NODE 7 --> 50.892643 sigma out 15 active outputs RANK 5 NODE 6 --> 44.8208313 sigma out 15 active outputs RANK 6 NODE 3 --> 42.9455147 sigma out 15 active outputs RANK 7 NODE 8 --> 38.5380974 sigma out 15 active outputs RANK 8 NODE 9 --> 34.7578964 sigma out 15 active outputs RANK 9 NODE 5 --> 23.0324764 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 95.7016983 sigma in 9act. ( 99.6221313 sig out 1act.) RANK 2 NODE 4 --> 47.3426323 sigma in 9act. ( 50.2313499 sig out 1act.) RANK 3 NODE 14 --> 46.6364098 sigma in 9act. ( 50.8971176 sig out 1act.) RANK 4 NODE 3 --> 43.2934494 sigma in 9act. ( 45.4112854 sig out 1act.) RANK 5 NODE 6 --> 43.047596 sigma in 9act. ( 38.2249794 sig out 1act.) RANK 6 NODE 8 --> 33.637001 sigma in 9act. ( 36.3473167 sig out 1act.) RANK 7 NODE 15 --> 29.6136951 sigma in 9act. ( 33.5609627 sig out 1act.) RANK 8 NODE 2 --> 27.1962891 sigma in 9act. ( 34.6784058 sig out 1act.) RANK 9 NODE 5 --> 23.3654442 sigma in 9act. ( 28.6061096 sig out 1act.) RANK 10 NODE 12 --> 19.3827057 sigma in 9act. ( 24.9752045 sig out 1act.) RANK 11 NODE 13 --> 14.3979282 sigma in 9act. ( 14.8862267 sig out 1act.) RANK 12 NODE 11 --> 13.9546309 sigma in 9act. ( 11.4450035 sig out 1act.) RANK 13 NODE 9 --> 12.5580587 sigma in 9act. ( 13.5365324 sig out 1act.) RANK 14 NODE 7 --> 5.4176836 sigma in 9act. ( 5.23498917 sig out 1act.) RANK 15 NODE 10 --> 2.93969274 sigma in 9act. ( 1.89011693 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 99.6221313 sigma out 1act.( 95.7016983 sig in 9act.) RANK 2 NODE 14 --> 50.8971176 sigma out 1act.( 46.6364098 sig in 9act.) RANK 3 NODE 4 --> 50.2313499 sigma out 1act.( 47.3426323 sig in 9act.) RANK 4 NODE 3 --> 45.4112854 sigma out 1act.( 43.2934494 sig in 9act.) RANK 5 NODE 6 --> 38.2249794 sigma out 1act.( 43.047596 sig in 9act.) RANK 6 NODE 8 --> 36.3473167 sigma out 1act.( 33.637001 sig in 9act.) RANK 7 NODE 2 --> 34.6784058 sigma out 1act.( 27.1962891 sig in 9act.) RANK 8 NODE 15 --> 33.5609627 sigma out 1act.( 29.6136951 sig in 9act.) RANK 9 NODE 5 --> 28.6061096 sigma out 1act.( 23.3654442 sig in 9act.) RANK 10 NODE 12 --> 24.9752045 sigma out 1act.( 19.3827057 sig in 9act.) RANK 11 NODE 13 --> 14.8862267 sigma out 1act.( 14.3979282 sig in 9act.) RANK 12 NODE 9 --> 13.5365324 sigma out 1act.( 12.5580587 sig in 9act.) RANK 13 NODE 11 --> 11.4450035 sigma out 1act.( 13.9546309 sig in 9act.) RANK 14 NODE 7 --> 5.23498917 sigma out 1act.( 5.4176836 sig in 9act.) RANK 15 NODE 10 --> 1.89011693 sigma out 1act.( 2.93969274 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 155.629486 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.543550432 *** contribution from regularisation: 0.00269509549 *** contribution from error: -0.546245515 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27724 Closing output file done