NNInput NNInputs_160.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 195906 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 56106 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 56106 Chosen entries: 56106 Signal fraction: 1 Background fraction: 0.40133 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 56106 Entries to split: 56106 Test with : 28053 Train with : 28053 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 56106 for Signal Prepared event 0 for Signal with 56106 events ====Entry 0 Variable Ht : 120.598 Variable LepAPt : 29.9056 Variable LepBPt : 13.5082 Variable MetSigLeptonsJets : 11.7141 Variable MetSpec : 77.1834 Variable SumEtLeptonsJets : 43.4138 Variable VSumJetLeptonsPt : 43.304 Variable addEt : 120.598 Variable dPhiLepSumMet : 2.82377 Variable dPhiLeptons : 0.153702 Variable dRLeptons : 0.732968 Variable lep1_E : 40.451 Variable lep2_E : 32.7603 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2160 Ht = 120.598 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 29.9058 LepAPt = 29.9056 LepBEt = 13.5084 LepBPt = 13.5082 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 77.1834 MetDelPhi = 2.77599 MetSig = 6.78472 MetSigLeptonsJets = 11.7141 MetSpec = 77.1834 Mjj = 0 MostCentralJetEta = 0 MtllMet = 139.14 Njets = 0 SB = 0 SumEt = 129.415 SumEtJets = 0 SumEtLeptonsJets = 43.4138 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 43.304 addEt = 120.598 dPhiLepSumMet = 2.82377 dPhiLeptons = 0.153702 dRLeptons = 0.732968 diltype = 34 dimass = 15.0375 event = 2600 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.451 lep2_E = 32.7603 rand = 0.999742 run = 233650 weight = 2.30027e-06 ===Show End Prepared event 10000 for Signal with 56106 events Prepared event 20000 for Signal with 56106 events Prepared event 30000 for Signal with 56106 events Prepared event 40000 for Signal with 56106 events Prepared event 50000 for Signal with 56106 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.319689 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4433 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 195906 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4433 negative weights. Signal fraction: 63.0320969 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.065033 65.0471954 66.7504578 68.2561646 69.2847366 70.2943878 71.09655 72.0201035 72.9867706 73.8228455 74.4304657 75.3125916 75.9909363 76.7069473 77.248291 77.9578629 78.6253738 79.2594452 79.7744141 80.6381836 81.300827 82.1891479 82.793335 83.6264191 84.5776672 85.4956436 86.4853363 87.8549957 88.962326 90.3875275 92.2553406 94.0206528 95.4091492 96.8657684 98.7535095 100.257774 101.760147 103.4627 104.808029 106.270851 107.772842 109.418625 111.207275 112.777611 114.444992 116.083321 117.797623 119.434402 120.737473 122.362289 124.107025 125.673958 127.456146 129.016418 130.663177 132.353165 133.891388 135.484039 137.082764 138.580963 140.070618 141.654861 143.013687 144.414307 145.916046 147.365021 148.641785 149.985565 151.349976 152.63739 153.987732 155.318481 156.661514 158.219757 159.769119 161.362244 163.145081 165.148193 167.562088 169.858582 171.993729 174.452454 177.031143 179.80394 182.776459 185.684326 188.97258 192.272202 195.850006 199.709412 204.014648 209.215805 215.14743 221.53363 229.364136 239.480743 252.527313 271.925995 302.038422 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3398476 20.6492386 20.9823608 21.2604694 21.5195122 21.7857361 22.0152283 22.2282829 22.4511547 22.7099724 22.9217377 23.1481056 23.3084049 23.5877571 23.7929573 24.0447006 24.288826 24.4924145 24.7342701 24.9952774 25.2013474 25.4181862 25.6521206 25.8698864 26.0962791 26.3100319 26.5365543 26.7760048 27.0108757 27.2319088 27.5048523 27.7188339 27.9787636 28.1888466 28.4244747 28.6697922 28.9504433 29.1800423 29.4369698 29.6657448 29.9280052 30.209507 30.497488 30.7475777 31.0228386 31.3002415 31.567812 31.8297615 32.0844345 32.3705521 32.6613426 32.9526749 33.2286186 33.5204964 33.7665253 34.0650024 34.3707123 34.679081 35.001236 35.307312 35.5849686 35.8693924 36.1948776 36.4970512 36.8217163 37.1160889 37.4417877 37.7557983 38.0975342 38.4175758 38.747097 39.0552368 39.2853699 39.6309586 39.9711037 40.3251038 40.6676559 41.0396461 41.4498672 41.8544693 42.2611923 42.6602974 43.1218109 43.5726433 44.0561752 44.5832443 45.2276382 45.8394241 46.5896301 47.292717 48.1198578 49.0631714 50.168354 51.4106216 52.9680252 54.7436829 57.2489548 60.7916794 66.6187057 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1312714 10.2663708 10.4029598 10.4950209 10.6243992 10.76297 10.8855381 11.0094357 11.1377201 11.2837181 11.4258499 11.5605364 11.7211704 11.8487053 12.0253754 12.1928892 12.3560944 12.5239487 12.6938782 12.8452425 13.0177011 13.2253227 13.4432287 13.6091557 13.7756424 13.9206257 14.1300545 14.3106146 14.5103674 14.7437649 14.9799366 15.216567 15.4108315 15.6088676 15.8232174 16.028801 16.2888184 16.5696716 16.8383751 17.1189823 17.4175377 17.7027378 17.9777451 18.2748489 18.5540543 18.8098507 19.0932884 19.4084129 19.7165833 20.0457649 20.2983112 20.5508156 20.8607349 21.1801682 21.4858131 21.7713585 22.0101643 22.344532 22.6637974 22.995739 23.3248806 23.6657829 24.0232697 24.3589363 24.7227478 25.0953827 25.4826775 25.8212566 26.183857 26.5189438 26.8980656 27.2942314 27.6673889 28.0031204 28.3547554 28.7614784 29.1476231 29.5651016 29.9600945 30.3179607 30.7790947 31.1931 31.6170845 32.045784 32.5002213 32.9533882 33.4165649 33.9500465 34.4623489 35.0261917 35.6229324 36.2218819 36.9156265 37.7145844 38.7283783 39.9057693 41.5139351 43.9444313 47.8546219 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.02583945 2.78062034 3.16327953 3.50743484 3.77245736 4.00380564 4.15004015 4.29019928 4.42538786 4.54590988 4.64221334 4.7507062 4.83949566 4.93399477 5.0114069 5.08022499 5.15090513 5.21856117 5.28521347 5.34242678 5.39343071 5.45009995 5.5077734 5.54300404 5.59950638 5.6427331 5.68967819 5.73428392 5.78513336 5.83421898 5.87828732 5.92363739 5.97670841 6.01960564 6.06925726 6.10846996 6.15049839 6.19708729 6.24842596 6.29257107 6.33109379 6.37362576 6.42064953 6.47010136 6.50983524 6.561656 6.61009121 6.65228987 6.69621468 6.75008154 6.79111481 6.84262609 6.87872028 6.92816448 6.9736948 7.0251298 7.07761478 7.13040686 7.18218517 7.2292943 7.28159332 7.33033276 7.38818073 7.4470377 7.49380112 7.54623795 7.60513353 7.65959501 7.71869564 7.78036404 7.83820724 7.89682579 7.94716167 8.01392365 8.07534981 8.13297939 8.19229317 8.25109291 8.31161308 8.37821674 8.44102097 8.51107979 8.57374191 8.63353634 8.70563602 8.77384853 8.84539223 8.92186546 9.00660324 9.09462738 9.19056702 9.29729652 9.41195107 9.55282784 9.70380878 9.89306927 10.1071692 10.4016113 10.8252811 11.5959387 19.1346054 ------------------------------ Transdef: Tab for variable 6 15.0050735 21.5903473 25.6767082 26.7844391 27.6836071 28.6902199 29.5590286 30.332056 31.0162697 31.6403465 32.3346748 32.8255692 33.3018532 33.7778854 34.3483162 34.7379951 35.0934982 35.5512085 35.9709625 36.3034668 36.6722412 37.0069046 37.4449959 37.8299789 38.2287445 38.5742416 38.9079132 39.2835846 39.6232986 39.9611015 40.4101562 40.8240433 41.339592 41.8247986 42.231781 42.6627731 43.0307884 43.3907127 43.81633 44.3509293 44.8127899 45.4374695 46.0624352 46.7896042 47.365139 47.9740639 48.7380104 49.3743248 50.0728073 50.7185593 51.4712753 52.3214111 53.1738968 53.9439621 54.7059555 55.4366798 56.1572876 56.9036674 57.7077332 58.4225922 59.0337715 59.865284 60.6503983 61.4294739 62.2523804 63.0888519 63.914257 64.7474365 65.604454 66.3775024 67.0861053 67.8565826 68.6133118 69.4039001 70.1193085 70.9424973 71.6670685 72.4271469 73.1529999 73.9314423 74.7227783 75.4750061 76.3053818 77.133667 77.8715286 78.7732925 79.7731476 80.8135452 81.8841248 83.1862488 84.5785828 86.1217499 87.8607788 90.082489 92.7904892 95.683197 99.3211975 104.092636 110.761841 123.626221 284.632782 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7048645 33.718132 34.2795105 34.8790703 35.4800644 35.9805222 36.3822556 36.8298721 37.1343079 37.4859962 37.8297806 38.1646423 38.5243073 38.8342056 39.1107483 39.3868484 39.7011414 40.0852432 40.4069557 40.7644119 41.1100845 41.4962502 41.8730316 42.4236984 42.8884964 43.5306892 44.2055588 44.8563652 45.3645782 46.1760902 47.0158157 47.8272934 48.6477814 49.5935516 50.6955261 51.7576485 52.6618423 53.5617294 54.7094536 55.7810478 56.7691956 57.7089653 58.6545944 59.5376854 60.4776459 61.1720085 61.8547668 62.67939 63.4989243 64.3994827 65.1816177 66.0458069 66.8825378 67.8109741 68.6749496 69.6483612 70.4817276 71.3389359 72.2257843 73.0097046 73.8839569 74.7360535 75.6118011 76.4943085 77.443924 78.3595657 79.2479248 80.3110504 81.3464813 82.5371857 83.8678741 85.2068329 86.5661163 88.0543671 89.6546783 91.3260651 92.9927673 94.6213455 96.4074402 98.0962219 99.9438324 101.880493 103.90126 106.198486 108.387833 111.027908 113.654831 116.649994 119.594971 122.833794 126.722816 131.158295 135.795563 141.345215 148.169601 157.178558 167.349579 181.907837 207.178085 474.677399 ------------------------------ Transdef: Tab for variable 8 2.50452757 25.2866058 29.543808 31.238102 32.0632629 32.8887825 33.4351883 33.856842 34.3839417 34.8197098 35.1948929 35.5361099 35.910553 36.1997452 36.5196686 36.8304825 37.1333733 37.4194107 37.735508 38.0207825 38.2252579 38.5616074 38.8331223 39.1170044 39.4757729 39.7996979 40.1103287 40.4071198 40.7555695 41.1235275 41.464756 41.8732109 42.2805939 42.765152 43.2475586 43.7018318 44.110527 44.6613731 45.1963539 45.7829247 46.4236412 47.0121346 47.710762 48.2110901 48.8498535 49.4664116 50.1727524 50.8861771 51.5191956 52.2569046 52.9720612 53.5916138 54.335125 55.082489 55.7631989 56.5112762 57.2280426 57.8993378 58.5707703 59.2806396 59.9659424 60.6564255 61.1515541 61.7826309 62.4852791 63.1595726 63.9059448 64.5319519 65.2201691 65.9806976 66.6390533 67.3206024 68.0495071 68.8153229 69.5309753 70.245697 70.9700165 71.6949463 72.4437256 73.1689453 73.9533768 74.708519 75.459549 76.270401 77.0578918 77.9642944 78.8129578 79.7713547 80.9512634 82.1842041 83.5419922 85.0835266 86.9832001 89.1223755 91.5804749 94.6459808 98.414032 103.376007 110.007919 123.978989 326.868286 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7099228 64.5487747 66.2129669 67.4906769 68.6143494 69.6493607 70.4602966 71.2376404 72.0376816 72.9170685 73.6695557 74.3026123 75.0137177 75.6573944 76.2768021 76.9067917 77.4154816 78.0433197 78.6169434 79.192215 79.6625061 80.2431946 80.9619904 81.5841217 82.2771606 82.7840424 83.4854202 84.3106689 84.9714355 85.8595886 86.690033 87.4788895 88.4671021 89.3450012 90.4036026 91.8114929 93.0623932 94.4098663 95.5424042 96.8489075 98.4013367 99.728653 101.031593 102.305855 103.679031 104.983307 106.270851 107.639114 109.131546 110.530243 111.838257 113.132591 114.435562 115.742302 116.983459 118.396156 119.641258 120.592987 121.866547 123.187256 124.427727 125.741684 127.048843 128.297577 129.512878 130.732971 132.023132 133.19371 134.414215 135.63591 136.85733 138.098557 139.277817 140.401123 141.649109 142.701706 143.82254 144.867981 146.031784 147.190857 148.227676 149.344589 150.372101 151.415497 152.468353 153.538361 154.680603 155.809433 156.938812 158.279434 159.606201 161.018951 162.564865 164.428314 167.0112 170.031509 174.27182 181.278107 195.942398 386.642853 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.18464327 1.50896597 1.70852232 1.85450912 1.96844435 2.05931258 2.137568 2.2037797 2.26133728 2.31267023 2.35403657 2.39647913 2.43464231 2.47135687 2.50388384 2.53153992 2.56167269 2.58819509 2.61591911 2.63773966 2.66121268 2.68042326 2.70071554 2.71989965 2.7393322 2.75515962 2.7709167 2.7848568 2.79868841 2.81280422 2.82422638 2.83644485 2.84700775 2.85743332 2.86788988 2.87762785 2.88792753 2.89798141 2.90616632 2.9147625 2.92262578 2.92949867 2.93702507 2.94501686 2.95172477 2.95923352 2.96603823 2.97277093 2.97855902 2.98393178 2.98798418 2.9917872 2.99543405 3.00078011 3.00571847 3.01024485 3.01475334 3.01944065 3.02411556 3.02859783 3.0319047 3.03576994 3.0398488 3.04378986 3.04743648 3.05141354 3.05509377 3.05888367 3.06173658 3.06488967 3.06786823 3.07135534 3.07452297 3.07705927 3.080585 3.08328676 3.08596754 3.08877802 3.09168506 3.09439945 3.09704685 3.09980202 3.10248923 3.10502315 3.10744619 3.10950446 3.1122179 3.11456633 3.11649275 3.11884928 3.12116003 3.12376213 3.12626457 3.12889147 3.13091278 3.13231492 3.13438988 3.13645077 3.13898945 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.8014183E-06 0.00564646535 0.0093266964 0.0152071714 0.0212862492 0.0276765823 0.0340955257 0.0414488316 0.0487582684 0.0562381148 0.0617098957 0.0692563057 0.0774559975 0.0854951143 0.0932378173 0.100370288 0.108079851 0.114294887 0.120503411 0.127960086 0.134462595 0.140661716 0.146831751 0.15339601 0.159452677 0.166211247 0.173155308 0.179651767 0.185530096 0.191259474 0.196706221 0.20206812 0.20736599 0.212666899 0.217614755 0.22284472 0.227981091 0.23323822 0.238088816 0.243818879 0.249406427 0.254602432 0.259237885 0.263981581 0.269174993 0.274127722 0.278857827 0.283660233 0.288113296 0.293756545 0.29867816 0.303435504 0.309108138 0.314273357 0.319610536 0.324541807 0.330401003 0.33611834 0.341968775 0.34803021 0.35299027 0.358992815 0.364441216 0.369476587 0.375150442 0.381103039 0.38681519 0.393171877 0.399059296 0.404924512 0.411207199 0.417882681 0.42448014 0.431327939 0.437513947 0.444889724 0.451466203 0.459079742 0.467271447 0.475281835 0.482435405 0.492466658 0.502857566 0.511632323 0.520481527 0.530201912 0.541379869 0.550814748 0.563235641 0.57644999 0.588752151 0.604656458 0.62097168 0.636065006 0.658894479 0.682139277 0.704667807 0.73374927 0.780019879 0.84892714 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200000316 0.210732386 0.221210629 0.231148034 0.238626987 0.24609372 0.253530711 0.259706646 0.266800344 0.273247242 0.279400229 0.285950363 0.29199183 0.297784984 0.303560674 0.308916301 0.31400311 0.31928286 0.32434094 0.329910636 0.334902883 0.340375304 0.346113145 0.351358712 0.35582599 0.360963762 0.365416288 0.370395571 0.375410914 0.380412042 0.3857795 0.390678942 0.395417482 0.399605155 0.403586328 0.407432646 0.411365688 0.414451301 0.418231845 0.421992391 0.425542384 0.42946431 0.433308721 0.437365979 0.440482974 0.444541544 0.448442012 0.452715814 0.457089454 0.460815877 0.46549648 0.469960153 0.473487467 0.476800442 0.480844319 0.484751344 0.488886774 0.492815733 0.497663438 0.502445638 0.507903993 0.512494802 0.516911626 0.521692574 0.526677608 0.53184557 0.537552238 0.543205976 0.549028397 0.55392921 0.559301198 0.565058351 0.570379138 0.57673496 0.582461357 0.589213789 0.595526576 0.603499293 0.610483527 0.617103338 0.624329746 0.631553829 0.640338898 0.648503065 0.658177972 0.666672707 0.67479527 0.684719801 0.695520401 0.704499245 0.716199636 0.727671146 0.742401004 0.754555345 0.768090189 0.788298905 0.808798611 0.833513975 0.866207242 0.914980531 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.6506596 22.4915085 23.1382389 23.8136673 24.4558029 25.0286942 25.5331459 26.0311699 26.5272903 27.0076523 27.3703461 27.7916374 28.2363968 28.6528473 29.0367508 29.4212036 29.7968521 30.1755447 30.5146484 30.8265991 31.1202164 31.4283676 31.7460804 32.0553017 32.3892212 32.7485275 33.1240005 33.4659424 33.8168182 34.1907921 34.4560089 34.8270035 35.1545181 35.4878349 35.8093262 36.1210938 36.4535065 36.7954979 37.1449356 37.4681931 37.8184319 38.1631165 38.5006027 38.8135834 39.1846542 39.5657272 39.883934 40.257164 40.5869217 40.9360046 41.2952194 41.6789322 42.0648117 42.4693451 42.8646202 43.1899109 43.5726662 43.963871 44.353447 44.7562065 45.1715622 45.6208115 46.055809 46.4593735 46.9100914 47.3701515 47.8568153 48.3029633 48.8453979 49.3457947 49.8616943 50.4600906 50.9857025 51.5994568 52.209137 52.8236008 53.5326309 54.1959076 54.969799 55.7441559 56.5942535 57.4257965 58.3983688 59.2072449 60.1670074 61.202137 62.3166656 63.5516891 65.0600128 66.8559723 68.6372681 70.3936005 72.82341 75.2868652 78.068634 81.7097168 86.3305664 89.943367 99.9009094 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6551275 11.1434259 11.5325975 11.9824181 12.3331366 12.7005787 13.1046371 13.4579163 13.7480812 14.0809498 14.4609232 14.7206039 15.1027584 15.4512405 15.7495604 16.1228294 16.4230022 16.6933174 16.9728127 17.3003578 17.6328278 17.886116 18.1585255 18.4938164 18.7650356 19.0915756 19.3777466 19.7696419 20.1338062 20.4791031 20.849617 21.1918545 21.4989929 21.808857 22.1491203 22.5061264 22.8505878 23.1371422 23.4117317 23.7531109 24.1077805 24.4200439 24.74259 25.0489941 25.3727303 25.637661 25.9298096 26.2882996 26.630497 26.9785843 27.341198 27.6399593 27.9284058 28.2264843 28.5640259 28.9346104 29.2720718 29.6327152 29.9693108 30.3431683 30.6884899 31.0552711 31.4043503 31.7595863 32.0879784 32.4407043 32.8016357 33.2166481 33.5266228 33.8994064 34.2740555 34.6790657 35.0554199 35.5105896 35.9943161 36.4300613 36.8675041 37.3104362 37.7496033 38.23246 38.783123 39.2902565 39.8328171 40.2182426 40.9117584 41.5440407 42.3111343 43.0195007 43.867939 44.7143326 45.6803474 46.8780403 48.0126343 49.4702606 51.0687714 52.9322968 55.4172096 59.4354782 65.8491592 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.0 52.1 57.3 32.7 51.7 65.3 57.8 66.6 -26.6 -18.8 -43.3 12.8 31.8 2 68.0 100.0 66.8 65.0 37.5 70.2 94.7 76.6 92.0 -43.6 -26.4 -53.2 28.4 40.4 3 52.1 66.8 100.0 52.0 10.8 35.2 70.2 54.4 72.0 -15.8 -28.1 -57.7 60.2 32.0 4 57.3 65.0 52.0 100.0 21.2 42.1 65.0 57.5 72.0 -12.0 -31.8 -67.0 21.7 74.3 5 32.7 37.5 10.8 21.2 100.0 84.4 10.6 58.9 58.2 23.1 -9.8 -16.2 -4.7 9.9 6 51.7 70.2 35.2 42.1 84.4 100.0 49.8 80.1 80.3 -7.5 -18.0 -33.8 8.5 24.1 7 65.3 94.7 70.2 65.0 10.6 49.8 100.0 68.0 81.1 -52.1 -25.4 -53.3 32.9 41.5 8 57.8 76.6 54.4 57.5 58.9 80.1 68.0 100.0 84.4 -10.6 -25.9 -48.3 22.2 36.5 9 66.6 92.0 72.0 72.0 58.2 80.3 81.1 84.4 100.0 -19.7 -29.7 -60.0 32.6 46.6 10 -26.6 -43.6 -15.8 -12.0 23.1 -7.5 -52.1 -10.6 -19.7 100.0 3.5 8.3 -3.3 -4.7 11 -18.8 -26.4 -28.1 -31.8 -9.8 -18.0 -25.4 -25.9 -29.7 3.5 100.0 53.6 -11.1 -22.6 12 -43.3 -53.2 -57.7 -67.0 -16.2 -33.8 -53.3 -48.3 -60.0 8.3 53.6 100.0 -26.1 -44.5 13 12.8 28.4 60.2 21.7 -4.7 8.5 32.9 22.2 32.6 -3.3 -11.1 -26.1 100.0 49.0 14 31.8 40.4 32.0 74.3 9.9 24.1 41.5 36.5 46.6 -4.7 -22.6 -44.5 49.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.710935 TOTAL CORRELATION OF ALL VARIABLES 74.8802698 ROUND 1: MAX CORR ( 74.8777646) AFTER KILLING INPUT VARIABLE 8 CONTR 0.612511048 ROUND 2: MAX CORR ( 74.8751236) AFTER KILLING INPUT VARIABLE 14 CONTR 0.628891645 ROUND 3: MAX CORR ( 74.8685278) AFTER KILLING INPUT VARIABLE 6 CONTR 0.993815137 ROUND 4: MAX CORR ( 74.8599499) AFTER KILLING INPUT VARIABLE 2 CONTR 1.13329437 ROUND 5: MAX CORR ( 74.8494385) AFTER KILLING INPUT VARIABLE 12 CONTR 1.25445437 ROUND 6: MAX CORR ( 74.7600513) AFTER KILLING INPUT VARIABLE 11 CONTR 3.65693487 ROUND 7: MAX CORR ( 74.4596881) AFTER KILLING INPUT VARIABLE 10 CONTR 6.69478344 ROUND 8: MAX CORR ( 73.4615813) AFTER KILLING INPUT VARIABLE 13 CONTR 12.1507704 ROUND 9: MAX CORR ( 72.1436442) AFTER KILLING INPUT VARIABLE 3 CONTR 13.8527443 ROUND 10: MAX CORR ( 71.8384951) AFTER KILLING INPUT VARIABLE 9 CONTR 6.62842532 ROUND 11: MAX CORR ( 70.253789) AFTER KILLING INPUT VARIABLE 4 CONTR 15.0058159 ROUND 12: MAX CORR ( 65.2877449) AFTER KILLING INPUT VARIABLE 5 CONTR 25.9442716 LAST REMAINING VARIABLE: 7 total correlation to target: 74.8802698 % total significance: 158.639261 sigma correlations of single variables to target: variable 2: 67.9699516 % , in sigma: 143.999252 variable 3: 52.1187359 % , in sigma: 110.417307 variable 4: 57.3421451 % , in sigma: 121.483477 variable 5: 32.739281 % , in sigma: 69.3605317 variable 6: 51.7493112 % , in sigma: 109.634654 variable 7: 65.2877449 % , in sigma: 138.316804 variable 8: 57.7770797 % , in sigma: 122.404917 variable 9: 66.6138177 % , in sigma: 141.126185 variable 10: -26.5966948 % , in sigma: 56.3470192 variable 11: -18.8252502 % , in sigma: 39.8826525 variable 12: -43.2632973 % , in sigma: 91.6564206 variable 13: 12.8360857 % , in sigma: 27.1941747 variable 14: 31.8327965 % , in sigma: 67.4400789 variables sorted by significance: 1 most relevant variable 7 corr 65.2877426 , in sigma: 138.316799 2 most relevant variable 5 corr 25.9442711 , in sigma: 54.9648124 3 most relevant variable 4 corr 15.0058155 , in sigma: 31.7909041 4 most relevant variable 9 corr 6.62842512 , in sigma: 14.0427974 5 most relevant variable 3 corr 13.8527441 , in sigma: 29.3480391 6 most relevant variable 13 corr 12.1507702 , in sigma: 25.7422844 7 most relevant variable 10 corr 6.69478321 , in sigma: 14.1833818 8 most relevant variable 11 corr 3.65693498 , in sigma: 7.74748091 9 most relevant variable 12 corr 1.25445437 , in sigma: 2.65765221 10 most relevant variable 2 corr 1.13329434 , in sigma: 2.40096593 11 most relevant variable 6 corr 0.993815124 , in sigma: 2.10546913 12 most relevant variable 14 corr 0.628891647 , in sigma: 1.33235238 13 most relevant variable 8 corr 0.612511039 , in sigma: 1.29764888 global correlations between input variables: variable 2: 99.2037978 % variable 3: 92.2224213 % variable 4: 92.9483504 % variable 5: 95.5084224 % variable 6: 95.0943621 % variable 7: 98.86031 % variable 8: 90.0617238 % variable 9: 98.7539206 % variable 10: 71.6852146 % variable 11: 54.5839129 % variable 12: 78.6144187 % variable 13: 83.4637252 % variable 14: 88.4622712 % significance loss when removing single variables: variable 2: corr = 1.36503101 % , sigma = 2.8919168 variable 3: corr = 16.6021095 % , sigma = 35.1727682 variable 4: corr = 13.1629137 % , sigma = 27.8865835 variable 5: corr = 17.0104342 % , sigma = 36.0378337 variable 6: corr = 1.15238498 % , sigma = 2.44141082 variable 7: corr = 8.7593861 % , sigma = 18.5573922 variable 8: corr = 0.612511048 % , sigma = 1.2976489 variable 9: corr = 11.6042516 % , sigma = 24.5844452 variable 10: corr = 6.42959818 % , sigma = 13.6215682 variable 11: corr = 2.84745934 % , sigma = 6.0325483 variable 12: corr = 1.19129624 % , sigma = 2.52384713 variable 13: corr = 8.98617345 % , sigma = 19.0378576 variable 14: corr = 0.629061691 % , sigma = 1.33271263 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 14.7056379 sigma out 15 active outputs RANK 2 NODE 7 --> 14.1905556 sigma out 15 active outputs RANK 3 NODE 4 --> 12.9662428 sigma out 15 active outputs RANK 4 NODE 9 --> 12.8230104 sigma out 15 active outputs RANK 5 NODE 5 --> 12.3054781 sigma out 15 active outputs RANK 6 NODE 2 --> 12.2297983 sigma out 15 active outputs RANK 7 NODE 1 --> 11.9735689 sigma out 15 active outputs RANK 8 NODE 8 --> 10.1442623 sigma out 15 active outputs RANK 9 NODE 3 --> 9.63543797 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 22.5395145 sigma in 9act. ( 27.1468067 sig out 1act.) RANK 2 NODE 9 --> 14.859561 sigma in 9act. ( 11.7851934 sig out 1act.) RANK 3 NODE 8 --> 14.4945593 sigma in 9act. ( 7.32280874 sig out 1act.) RANK 4 NODE 7 --> 11.0289831 sigma in 9act. ( 9.34625149 sig out 1act.) RANK 5 NODE 11 --> 9.39853573 sigma in 9act. ( 16.7394505 sig out 1act.) RANK 6 NODE 6 --> 7.79335403 sigma in 9act. ( 6.30410862 sig out 1act.) RANK 7 NODE 14 --> 6.71255589 sigma in 9act. ( 5.2959981 sig out 1act.) RANK 8 NODE 1 --> 6.36113214 sigma in 9act. ( 5.78177071 sig out 1act.) RANK 9 NODE 15 --> 5.37412405 sigma in 9act. ( 7.16195154 sig out 1act.) RANK 10 NODE 13 --> 5.37272644 sigma in 9act. ( 7.87555742 sig out 1act.) RANK 11 NODE 2 --> 3.72817993 sigma in 9act. ( 3.50842857 sig out 1act.) RANK 12 NODE 5 --> 3.62444711 sigma in 9act. ( 1.24783778 sig out 1act.) RANK 13 NODE 3 --> 2.15035415 sigma in 9act. ( 3.28517199 sig out 1act.) RANK 14 NODE 10 --> 2.07752824 sigma in 9act. ( 2.62549758 sig out 1act.) RANK 15 NODE 4 --> 1.18568242 sigma in 9act. ( 0.739458442 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 27.1468067 sigma out 1act.( 22.5395145 sig in 9act.) RANK 2 NODE 11 --> 16.7394505 sigma out 1act.( 9.39853573 sig in 9act.) RANK 3 NODE 9 --> 11.7851934 sigma out 1act.( 14.859561 sig in 9act.) RANK 4 NODE 7 --> 9.34625149 sigma out 1act.( 11.0289831 sig in 9act.) RANK 5 NODE 13 --> 7.87555742 sigma out 1act.( 5.37272644 sig in 9act.) RANK 6 NODE 8 --> 7.32280874 sigma out 1act.( 14.4945593 sig in 9act.) RANK 7 NODE 15 --> 7.16195154 sigma out 1act.( 5.37412405 sig in 9act.) RANK 8 NODE 6 --> 6.30410862 sigma out 1act.( 7.79335403 sig in 9act.) RANK 9 NODE 1 --> 5.78177071 sigma out 1act.( 6.36113214 sig in 9act.) RANK 10 NODE 14 --> 5.2959981 sigma out 1act.( 6.71255589 sig in 9act.) RANK 11 NODE 2 --> 3.50842857 sigma out 1act.( 3.72817993 sig in 9act.) RANK 12 NODE 3 --> 3.28517199 sigma out 1act.( 2.15035415 sig in 9act.) RANK 13 NODE 10 --> 2.62549758 sigma out 1act.( 2.07752824 sig in 9act.) RANK 14 NODE 5 --> 1.24783778 sigma out 1act.( 3.62444711 sig in 9act.) RANK 15 NODE 4 --> 0.739458442 sigma out 1act.( 1.18568242 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 39.2894402 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.6051121 sigma out 15 active outputs RANK 2 NODE 5 --> 16.0495872 sigma out 15 active outputs RANK 3 NODE 1 --> 15.0517921 sigma out 15 active outputs RANK 4 NODE 7 --> 14.7006798 sigma out 15 active outputs RANK 5 NODE 8 --> 14.4806519 sigma out 15 active outputs RANK 6 NODE 9 --> 14.1992702 sigma out 15 active outputs RANK 7 NODE 6 --> 13.0845327 sigma out 15 active outputs RANK 8 NODE 4 --> 12.5903997 sigma out 15 active outputs RANK 9 NODE 3 --> 9.67675304 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 25.6502037 sigma in 9act. ( 25.6992569 sig out 1act.) RANK 2 NODE 11 --> 19.9073009 sigma in 9act. ( 17.2293339 sig out 1act.) RANK 3 NODE 9 --> 12.1153469 sigma in 9act. ( 10.3147802 sig out 1act.) RANK 4 NODE 3 --> 11.4754553 sigma in 9act. ( 5.4648571 sig out 1act.) RANK 5 NODE 13 --> 11.0230808 sigma in 9act. ( 8.50819492 sig out 1act.) RANK 6 NODE 10 --> 10.6388988 sigma in 9act. ( 4.49676418 sig out 1act.) RANK 7 NODE 15 --> 9.68518543 sigma in 9act. ( 7.99904633 sig out 1act.) RANK 8 NODE 8 --> 9.31785393 sigma in 9act. ( 5.76779699 sig out 1act.) RANK 9 NODE 2 --> 8.49598789 sigma in 9act. ( 5.0325346 sig out 1act.) RANK 10 NODE 7 --> 8.20567989 sigma in 9act. ( 7.71277142 sig out 1act.) RANK 11 NODE 14 --> 6.93414021 sigma in 9act. ( 4.4940443 sig out 1act.) RANK 12 NODE 6 --> 6.70450211 sigma in 9act. ( 5.36242247 sig out 1act.) RANK 13 NODE 4 --> 6.57606697 sigma in 9act. ( 2.72748542 sig out 1act.) RANK 14 NODE 1 --> 6.32069349 sigma in 9act. ( 5.36383533 sig out 1act.) RANK 15 NODE 5 --> 5.32577467 sigma in 9act. ( 0.91155237 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 25.6992569 sigma out 1act.( 25.6502037 sig in 9act.) RANK 2 NODE 11 --> 17.2293339 sigma out 1act.( 19.9073009 sig in 9act.) RANK 3 NODE 9 --> 10.3147802 sigma out 1act.( 12.1153469 sig in 9act.) RANK 4 NODE 13 --> 8.50819492 sigma out 1act.( 11.0230808 sig in 9act.) RANK 5 NODE 15 --> 7.99904633 sigma out 1act.( 9.68518543 sig in 9act.) RANK 6 NODE 7 --> 7.71277142 sigma out 1act.( 8.20567989 sig in 9act.) RANK 7 NODE 8 --> 5.76779699 sigma out 1act.( 9.31785393 sig in 9act.) RANK 8 NODE 3 --> 5.4648571 sigma out 1act.( 11.4754553 sig in 9act.) RANK 9 NODE 1 --> 5.36383533 sigma out 1act.( 6.32069349 sig in 9act.) RANK 10 NODE 6 --> 5.36242247 sigma out 1act.( 6.70450211 sig in 9act.) RANK 11 NODE 2 --> 5.0325346 sigma out 1act.( 8.49598789 sig in 9act.) RANK 12 NODE 10 --> 4.49676418 sigma out 1act.( 10.6388988 sig in 9act.) RANK 13 NODE 14 --> 4.4940443 sigma out 1act.( 6.93414021 sig in 9act.) RANK 14 NODE 4 --> 2.72748542 sigma out 1act.( 6.57606697 sig in 9act.) RANK 15 NODE 5 --> 0.91155237 sigma out 1act.( 5.32577467 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.1343651 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.388599336 *** contribution from regularisation: 0.00402404601 *** contribution from error: -0.392623395 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.453771532 *** contribution from regularisation: 0.00166450627 *** contribution from error: -0.455436051 *********************************************** -----------------> Test sample ENTER BFGS code START -44458.078 0.39163509 -0.276430547 EXIT FROM BFGS code FG_START 0. 0.39163509 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.479323149 *** contribution from regularisation: 0.00185083842 *** contribution from error: -0.481173992 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46951.139 0.39163509 91.8547287 EXIT FROM BFGS code FG_LNSRCH 0. 0.399626195 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.544272006 *** contribution from regularisation: 0.0030884922 *** contribution from error: -0.54736048 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53313.0779 0.399626195 159.028503 EXIT FROM BFGS code NEW_X -53313.0779 0.399626195 159.028503 ENTER BFGS code NEW_X -53313.0779 0.399626195 159.028503 EXIT FROM BFGS code FG_LNSRCH 0. 0.417292655 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.548438191 *** contribution from regularisation: 0.00307620945 *** contribution from error: -0.551514387 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53721.1633 0.417292655 90.6110458 EXIT FROM BFGS code NEW_X -53721.1633 0.417292655 90.6110458 ENTER BFGS code NEW_X -53721.1633 0.417292655 90.6110458 EXIT FROM BFGS code FG_LNSRCH 0. 0.439274073 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.551919758 *** contribution from regularisation: 0.0026459354 *** contribution from error: -0.554565668 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54062.1941 0.439274073 21.207428 EXIT FROM BFGS code NEW_X -54062.1941 0.439274073 21.207428 ENTER BFGS code NEW_X -54062.1941 0.439274073 21.207428 EXIT FROM BFGS code FG_LNSRCH 0. 0.446569473 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.553390801 *** contribution from regularisation: 0.00228539389 *** contribution from error: -0.555676222 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54206.2899 0.446569473 -14.4135141 EXIT FROM BFGS code NEW_X -54206.2899 0.446569473 -14.4135141 ENTER BFGS code NEW_X -54206.2899 0.446569473 -14.4135141 EXIT FROM BFGS code FG_LNSRCH 0. 0.443950087 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.553663075 *** contribution from regularisation: 0.00221016794 *** contribution from error: -0.555873215 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54232.9574 0.443950087 -10.9953289 EXIT FROM BFGS code NEW_X -54232.9574 0.443950087 -10.9953289 ENTER BFGS code NEW_X -54232.9574 0.443950087 -10.9953289 EXIT FROM BFGS code FG_LNSRCH 0. 0.438462675 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.553867698 *** contribution from regularisation: 0.0021916416 *** contribution from error: -0.556059361 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54252.9998 0.438462675 5.23812056 EXIT FROM BFGS code NEW_X -54252.9998 0.438462675 5.23812056 ENTER BFGS code NEW_X -54252.9998 0.438462675 5.23812056 EXIT FROM BFGS code FG_LNSRCH 0. 0.420467019 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 41.8321457 sigma out 15 active outputs RANK 2 NODE 1 --> 24.5350742 sigma out 15 active outputs RANK 3 NODE 8 --> 21.4821415 sigma out 15 active outputs RANK 4 NODE 5 --> 17.7950954 sigma out 15 active outputs RANK 5 NODE 4 --> 15.5408154 sigma out 15 active outputs RANK 6 NODE 7 --> 13.7576342 sigma out 15 active outputs RANK 7 NODE 9 --> 13.0230141 sigma out 15 active outputs RANK 8 NODE 3 --> 12.9551382 sigma out 15 active outputs RANK 9 NODE 6 --> 9.80450916 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 26.5731354 sigma in 9act. ( 22.6147976 sig out 1act.) RANK 2 NODE 10 --> 25.2118721 sigma in 9act. ( 21.4114857 sig out 1act.) RANK 3 NODE 3 --> 23.6678734 sigma in 9act. ( 22.4085617 sig out 1act.) RANK 4 NODE 4 --> 22.89571 sigma in 9act. ( 18.8985062 sig out 1act.) RANK 5 NODE 15 --> 22.8576603 sigma in 9act. ( 20.7014198 sig out 1act.) RANK 6 NODE 2 --> 17.7052059 sigma in 9act. ( 12.7965288 sig out 1act.) RANK 7 NODE 13 --> 17.5356979 sigma in 9act. ( 16.5559959 sig out 1act.) RANK 8 NODE 12 --> 14.15096 sigma in 9act. ( 11.2942533 sig out 1act.) RANK 9 NODE 6 --> 9.00741959 sigma in 9act. ( 7.83823633 sig out 1act.) RANK 10 NODE 1 --> 6.14031982 sigma in 9act. ( 5.71219063 sig out 1act.) RANK 11 NODE 7 --> 6.04541874 sigma in 9act. ( 5.83029604 sig out 1act.) RANK 12 NODE 9 --> 5.69819593 sigma in 9act. ( 4.45017004 sig out 1act.) RANK 13 NODE 8 --> 4.07287693 sigma in 9act. ( 0.575055659 sig out 1act.) RANK 14 NODE 14 --> 3.23799062 sigma in 9act. ( 0.172638789 sig out 1act.) RANK 15 NODE 5 --> 3.1020298 sigma in 9act. ( 0.7329849 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 22.6147976 sigma out 1act.( 26.5731354 sig in 9act.) RANK 2 NODE 3 --> 22.4085617 sigma out 1act.( 23.6678734 sig in 9act.) RANK 3 NODE 10 --> 21.4114857 sigma out 1act.( 25.2118721 sig in 9act.) RANK 4 NODE 15 --> 20.7014198 sigma out 1act.( 22.8576603 sig in 9act.) RANK 5 NODE 4 --> 18.8985062 sigma out 1act.( 22.89571 sig in 9act.) RANK 6 NODE 13 --> 16.5559959 sigma out 1act.( 17.5356979 sig in 9act.) RANK 7 NODE 2 --> 12.7965288 sigma out 1act.( 17.7052059 sig in 9act.) RANK 8 NODE 12 --> 11.2942533 sigma out 1act.( 14.15096 sig in 9act.) RANK 9 NODE 6 --> 7.83823633 sigma out 1act.( 9.00741959 sig in 9act.) RANK 10 NODE 7 --> 5.83029604 sigma out 1act.( 6.04541874 sig in 9act.) RANK 11 NODE 1 --> 5.71219063 sigma out 1act.( 6.14031982 sig in 9act.) RANK 12 NODE 9 --> 4.45017004 sigma out 1act.( 5.69819593 sig in 9act.) RANK 13 NODE 5 --> 0.7329849 sigma out 1act.( 3.1020298 sig in 9act.) RANK 14 NODE 8 --> 0.575055659 sigma out 1act.( 4.07287693 sig in 9act.) RANK 15 NODE 14 --> 0.172638789 sigma out 1act.( 3.23799062 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.5151405 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.554674685 *** contribution from regularisation: 0.00211279234 *** contribution from error: -0.556787491 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54332.0476 0.420467019 35.3135185 EXIT FROM BFGS code NEW_X -54332.0476 0.420467019 35.3135185 ENTER BFGS code NEW_X -54332.0476 0.420467019 35.3135185 EXIT FROM BFGS code FG_LNSRCH 0. 0.413372099 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.555206835 *** contribution from regularisation: 0.00227073766 *** contribution from error: -0.557477593 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54384.1761 0.413372099 54.7973595 EXIT FROM BFGS code NEW_X -54384.1761 0.413372099 54.7973595 ENTER BFGS code NEW_X -54384.1761 0.413372099 54.7973595 EXIT FROM BFGS code FG_LNSRCH 0. 0.416119695 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.555857658 *** contribution from regularisation: 0.00252533937 *** contribution from error: -0.558382988 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54447.9274 0.416119695 14.3144226 EXIT FROM BFGS code NEW_X -54447.9274 0.416119695 14.3144226 ENTER BFGS code NEW_X -54447.9274 0.416119695 14.3144226 EXIT FROM BFGS code FG_LNSRCH 0. 0.426484734 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.556061804 *** contribution from regularisation: 0.00252109906 *** contribution from error: -0.558582902 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54467.9193 0.426484734 -28.8610592 EXIT FROM BFGS code NEW_X -54467.9193 0.426484734 -28.8610592 ENTER BFGS code NEW_X -54467.9193 0.426484734 -28.8610592 EXIT FROM BFGS code FG_LNSRCH 0. 0.421847701 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.556256473 *** contribution from regularisation: 0.00248248014 *** contribution from error: -0.558738947 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54486.9874 0.421847701 0.860536695 EXIT FROM BFGS code NEW_X -54486.9874 0.421847701 0.860536695 ENTER BFGS code NEW_X -54486.9874 0.421847701 0.860536695 EXIT FROM BFGS code FG_LNSRCH 0. 0.421404272 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.556314647 *** contribution from regularisation: 0.00250672223 *** contribution from error: -0.55882138 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54492.6868 0.421404272 3.95976973 EXIT FROM BFGS code NEW_X -54492.6868 0.421404272 3.95976973 ENTER BFGS code NEW_X -54492.6868 0.421404272 3.95976973 EXIT FROM BFGS code FG_LNSRCH 0. 0.421014935 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.556414127 *** contribution from regularisation: 0.00252959854 *** contribution from error: -0.558943748 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54502.4327 0.421014935 10.9728489 EXIT FROM BFGS code NEW_X -54502.4327 0.421014935 10.9728489 ENTER BFGS code NEW_X -54502.4327 0.421014935 10.9728489 EXIT FROM BFGS code FG_LNSRCH 0. 0.424661815 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.556633472 *** contribution from regularisation: 0.00256109936 *** contribution from error: -0.559194565 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54523.9193 0.424661815 13.3740435 EXIT FROM BFGS code NEW_X -54523.9193 0.424661815 13.3740435 ENTER BFGS code NEW_X -54523.9193 0.424661815 13.3740435 EXIT FROM BFGS code FG_LNSRCH 0. 0.43599245 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.557040751 *** contribution from regularisation: 0.00270060054 *** contribution from error: -0.559741378 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54563.8113 0.43599245 16.8395348 EXIT FROM BFGS code NEW_X -54563.8113 0.43599245 16.8395348 ENTER BFGS code NEW_X -54563.8113 0.43599245 16.8395348 EXIT FROM BFGS code FG_LNSRCH 0. 0.451150894 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.5571962 *** contribution from regularisation: 0.0027807015 *** contribution from error: -0.559976876 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54579.0366 0.451150894 -25.0168209 EXIT FROM BFGS code FG_LNSRCH 0. 0.443601519 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 54.1765251 sigma out 15 active outputs RANK 2 NODE 1 --> 35.5987129 sigma out 15 active outputs RANK 3 NODE 8 --> 29.4897709 sigma out 15 active outputs RANK 4 NODE 4 --> 29.3551598 sigma out 15 active outputs RANK 5 NODE 7 --> 25.1452942 sigma out 15 active outputs RANK 6 NODE 5 --> 22.5497189 sigma out 15 active outputs RANK 7 NODE 3 --> 20.411581 sigma out 15 active outputs RANK 8 NODE 6 --> 17.2296066 sigma out 15 active outputs RANK 9 NODE 9 --> 16.8039856 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 45.3017311 sigma in 9act. ( 41.3032112 sig out 1act.) RANK 2 NODE 13 --> 37.4181786 sigma in 9act. ( 35.7339668 sig out 1act.) RANK 3 NODE 10 --> 33.4290123 sigma in 9act. ( 39.4847946 sig out 1act.) RANK 4 NODE 4 --> 31.9314232 sigma in 9act. ( 26.6121922 sig out 1act.) RANK 5 NODE 11 --> 29.6668186 sigma in 9act. ( 31.1675243 sig out 1act.) RANK 6 NODE 3 --> 24.2321835 sigma in 9act. ( 24.8327198 sig out 1act.) RANK 7 NODE 2 --> 18.3653889 sigma in 9act. ( 15.5150909 sig out 1act.) RANK 8 NODE 7 --> 16.1393871 sigma in 9act. ( 18.242485 sig out 1act.) RANK 9 NODE 6 --> 12.4619904 sigma in 9act. ( 13.1102209 sig out 1act.) RANK 10 NODE 1 --> 10.5228033 sigma in 9act. ( 11.5133057 sig out 1act.) RANK 11 NODE 9 --> 9.24790573 sigma in 9act. ( 10.6289272 sig out 1act.) RANK 12 NODE 5 --> 4.96021223 sigma in 9act. ( 4.92611933 sig out 1act.) RANK 13 NODE 12 --> 4.74268389 sigma in 9act. ( 3.50594902 sig out 1act.) RANK 14 NODE 14 --> 3.42524433 sigma in 9act. ( 2.84531426 sig out 1act.) RANK 15 NODE 8 --> 2.32950234 sigma in 9act. ( 0.972295225 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 41.3032112 sigma out 1act.( 45.3017311 sig in 9act.) RANK 2 NODE 10 --> 39.4847946 sigma out 1act.( 33.4290123 sig in 9act.) RANK 3 NODE 13 --> 35.7339668 sigma out 1act.( 37.4181786 sig in 9act.) RANK 4 NODE 11 --> 31.1675243 sigma out 1act.( 29.6668186 sig in 9act.) RANK 5 NODE 4 --> 26.6121922 sigma out 1act.( 31.9314232 sig in 9act.) RANK 6 NODE 3 --> 24.8327198 sigma out 1act.( 24.2321835 sig in 9act.) RANK 7 NODE 7 --> 18.242485 sigma out 1act.( 16.1393871 sig in 9act.) RANK 8 NODE 2 --> 15.5150909 sigma out 1act.( 18.3653889 sig in 9act.) RANK 9 NODE 6 --> 13.1102209 sigma out 1act.( 12.4619904 sig in 9act.) RANK 10 NODE 1 --> 11.5133057 sigma out 1act.( 10.5228033 sig in 9act.) RANK 11 NODE 9 --> 10.6289272 sigma out 1act.( 9.24790573 sig in 9act.) RANK 12 NODE 5 --> 4.92611933 sigma out 1act.( 4.96021223 sig in 9act.) RANK 13 NODE 12 --> 3.50594902 sigma out 1act.( 4.74268389 sig in 9act.) RANK 14 NODE 14 --> 2.84531426 sigma out 1act.( 3.42524433 sig in 9act.) RANK 15 NODE 8 --> 0.972295225 sigma out 1act.( 2.32950234 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 88.7396317 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.557504714 *** contribution from regularisation: 0.00251359469 *** contribution from error: -0.560018301 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54609.26 0.443601519 -3.19656944 EXIT FROM BFGS code NEW_X -54609.26 0.443601519 -3.19656944 ENTER BFGS code NEW_X -54609.26 0.443601519 -3.19656944 EXIT FROM BFGS code FG_LNSRCH 0. 0.444800138 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.557550311 *** contribution from regularisation: 0.00260043447 *** contribution from error: -0.560150743 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54613.7264 0.444800138 -16.3709335 EXIT FROM BFGS code NEW_X -54613.7264 0.444800138 -16.3709335 ENTER BFGS code NEW_X -54613.7264 0.444800138 -16.3709335 EXIT FROM BFGS code FG_LNSRCH 0. 0.441334784 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.557617307 *** contribution from regularisation: 0.00256857718 *** contribution from error: -0.560185909 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54620.2891 0.441334784 -4.54165125 EXIT FROM BFGS code NEW_X -54620.2891 0.441334784 -4.54165125 ENTER BFGS code NEW_X -54620.2891 0.441334784 -4.54165125 EXIT FROM BFGS code FG_LNSRCH 0. 0.437489659 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.557756126 *** contribution from regularisation: 0.00248356466 *** contribution from error: -0.560239673 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54633.886 0.437489659 -24.6845989 EXIT FROM BFGS code NEW_X -54633.886 0.437489659 -24.6845989 ENTER BFGS code NEW_X -54633.886 0.437489659 -24.6845989 EXIT FROM BFGS code FG_LNSRCH 0. 0.405329764 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.557617486 *** contribution from regularisation: 0.00244049239 *** contribution from error: -0.560057998 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54620.3082 0.405329764 83.5724182 EXIT FROM BFGS code FG_LNSRCH 0. 0.427669048 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.557553828 *** contribution from regularisation: 0.002736961 *** contribution from error: -0.560290813 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54614.0689 0.427669048 7.45832586 EXIT FROM BFGS code FG_LNSRCH 0. 0.436666697 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.557597756 *** contribution from regularisation: 0.00264937687 *** contribution from error: -0.560247123 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54618.3729 0.436666697 -21.9442482 EXIT FROM BFGS code FG_LNSRCH 0. 0.437479466 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.55763495 *** contribution from regularisation: 0.0026048657 *** contribution from error: -0.560239792 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54622.0172 0.437479466 -24.571167 EXIT FROM BFGS code FG_LNSRCH 0. 0.437489659 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.557639301 *** contribution from regularisation: 0.00260038604 *** contribution from error: -0.560239673 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54622.443 0.437489659 -24.6091805 EXIT FROM BFGS code FG_LNSRCH 0. 0.437489659 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.5576334 *** contribution from regularisation: 0.00260629621 *** contribution from error: -0.560239673 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54621.8641 0.437489659 -24.6035347 EXIT FROM BFGS code FG_LNSRCH 0. 0.437489659 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 53.1462135 sigma out 15 active outputs RANK 2 NODE 1 --> 34.4391212 sigma out 15 active outputs RANK 3 NODE 4 --> 27.9986496 sigma out 15 active outputs RANK 4 NODE 8 --> 26.7446899 sigma out 15 active outputs RANK 5 NODE 7 --> 22.4544373 sigma out 15 active outputs RANK 6 NODE 5 --> 21.8583984 sigma out 15 active outputs RANK 7 NODE 3 --> 19.1270428 sigma out 15 active outputs RANK 8 NODE 6 --> 17.5669689 sigma out 15 active outputs RANK 9 NODE 9 --> 15.1911535 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 42.9919624 sigma in 9act. ( 39.2547646 sig out 1act.) RANK 2 NODE 13 --> 37.7776756 sigma in 9act. ( 36.0172653 sig out 1act.) RANK 3 NODE 10 --> 33.3991508 sigma in 9act. ( 38.1972046 sig out 1act.) RANK 4 NODE 4 --> 29.7869453 sigma in 9act. ( 24.6056156 sig out 1act.) RANK 5 NODE 11 --> 25.5439625 sigma in 9act. ( 26.9392033 sig out 1act.) RANK 6 NODE 3 --> 22.116478 sigma in 9act. ( 22.3446522 sig out 1act.) RANK 7 NODE 2 --> 18.3572826 sigma in 9act. ( 15.3896599 sig out 1act.) RANK 8 NODE 7 --> 15.6145039 sigma in 9act. ( 17.9973545 sig out 1act.) RANK 9 NODE 6 --> 11.7138624 sigma in 9act. ( 12.0837364 sig out 1act.) RANK 10 NODE 1 --> 9.97514439 sigma in 9act. ( 10.9502201 sig out 1act.) RANK 11 NODE 9 --> 9.40184212 sigma in 9act. ( 10.6630325 sig out 1act.) RANK 12 NODE 5 --> 5.21374989 sigma in 9act. ( 5.13805819 sig out 1act.) RANK 13 NODE 12 --> 5.1961832 sigma in 9act. ( 4.07714939 sig out 1act.) RANK 14 NODE 14 --> 3.3390522 sigma in 9act. ( 2.68237972 sig out 1act.) RANK 15 NODE 8 --> 2.42327905 sigma in 9act. ( 0.893499732 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 39.2547646 sigma out 1act.( 42.9919624 sig in 9act.) RANK 2 NODE 10 --> 38.1972046 sigma out 1act.( 33.3991508 sig in 9act.) RANK 3 NODE 13 --> 36.0172653 sigma out 1act.( 37.7776756 sig in 9act.) RANK 4 NODE 11 --> 26.9392033 sigma out 1act.( 25.5439625 sig in 9act.) RANK 5 NODE 4 --> 24.6056156 sigma out 1act.( 29.7869453 sig in 9act.) RANK 6 NODE 3 --> 22.3446522 sigma out 1act.( 22.116478 sig in 9act.) RANK 7 NODE 7 --> 17.9973545 sigma out 1act.( 15.6145039 sig in 9act.) RANK 8 NODE 2 --> 15.3896599 sigma out 1act.( 18.3572826 sig in 9act.) RANK 9 NODE 6 --> 12.0837364 sigma out 1act.( 11.7138624 sig in 9act.) RANK 10 NODE 1 --> 10.9502201 sigma out 1act.( 9.97514439 sig in 9act.) RANK 11 NODE 9 --> 10.6630325 sigma out 1act.( 9.40184212 sig in 9act.) RANK 12 NODE 5 --> 5.13805819 sigma out 1act.( 5.21374989 sig in 9act.) RANK 13 NODE 12 --> 4.07714939 sigma out 1act.( 5.1961832 sig in 9act.) RANK 14 NODE 14 --> 2.68237972 sigma out 1act.( 3.3390522 sig in 9act.) RANK 15 NODE 8 --> 0.893499732 sigma out 1act.( 2.42327905 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 84.3743668 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.557635963 *** contribution from regularisation: 0.00260372134 *** contribution from error: -0.560239673 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54622.1163 0.437489659 -24.5627041 EXIT FROM BFGS code FG_LNSRCH 0. 0.437489659 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.557640791 *** contribution from regularisation: 0.00259892154 *** contribution from error: -0.560239732 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54622.5864 0.437489659 -24.5781689 EXIT FROM BFGS code NEW_X -54622.5864 0.437489659 -24.5781689 ENTER BFGS code NEW_X -54622.5864 0.437489659 -24.5781689 EXIT FROM BFGS code CONVERGENC -54622.5864 0.437489659 -24.5781689 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 77.3588104 sigma out 15 active outputs RANK 2 NODE 1 --> 51.56884 sigma out 15 active outputs RANK 3 NODE 4 --> 40.767868 sigma out 15 active outputs RANK 4 NODE 8 --> 40.6146126 sigma out 15 active outputs RANK 5 NODE 7 --> 32.8946457 sigma out 15 active outputs RANK 6 NODE 5 --> 32.2350044 sigma out 15 active outputs RANK 7 NODE 3 --> 28.3897343 sigma out 15 active outputs RANK 8 NODE 6 --> 26.1636353 sigma out 15 active outputs RANK 9 NODE 9 --> 23.5366802 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 63.5177307 sigma in 9act. ( 59.4280548 sig out 1act.) RANK 2 NODE 13 --> 56.1330109 sigma in 9act. ( 54.5712814 sig out 1act.) RANK 3 NODE 10 --> 48.1645241 sigma in 9act. ( 58.4450569 sig out 1act.) RANK 4 NODE 4 --> 44.1428375 sigma in 9act. ( 37.0996933 sig out 1act.) RANK 5 NODE 11 --> 38.1695747 sigma in 9act. ( 40.1585541 sig out 1act.) RANK 6 NODE 3 --> 32.9808235 sigma in 9act. ( 33.3020287 sig out 1act.) RANK 7 NODE 2 --> 27.6057167 sigma in 9act. ( 23.5268593 sig out 1act.) RANK 8 NODE 7 --> 23.1265221 sigma in 9act. ( 26.8511448 sig out 1act.) RANK 9 NODE 6 --> 17.1521492 sigma in 9act. ( 18.871645 sig out 1act.) RANK 10 NODE 1 --> 14.4608765 sigma in 9act. ( 16.2995987 sig out 1act.) RANK 11 NODE 9 --> 13.712594 sigma in 9act. ( 16.5898418 sig out 1act.) RANK 12 NODE 5 --> 7.61717415 sigma in 9act. ( 7.76832676 sig out 1act.) RANK 13 NODE 12 --> 6.97375202 sigma in 9act. ( 6.19492102 sig out 1act.) RANK 14 NODE 14 --> 4.5741601 sigma in 9act. ( 4.07912111 sig out 1act.) RANK 15 NODE 8 --> 2.57307935 sigma in 9act. ( 1.32661605 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 59.4280548 sigma out 1act.( 63.5177307 sig in 9act.) RANK 2 NODE 10 --> 58.4450569 sigma out 1act.( 48.1645241 sig in 9act.) RANK 3 NODE 13 --> 54.5712814 sigma out 1act.( 56.1330109 sig in 9act.) RANK 4 NODE 11 --> 40.1585541 sigma out 1act.( 38.1695747 sig in 9act.) RANK 5 NODE 4 --> 37.0996933 sigma out 1act.( 44.1428375 sig in 9act.) RANK 6 NODE 3 --> 33.3020287 sigma out 1act.( 32.9808235 sig in 9act.) RANK 7 NODE 7 --> 26.8511448 sigma out 1act.( 23.1265221 sig in 9act.) RANK 8 NODE 2 --> 23.5268593 sigma out 1act.( 27.6057167 sig in 9act.) RANK 9 NODE 6 --> 18.871645 sigma out 1act.( 17.1521492 sig in 9act.) RANK 10 NODE 9 --> 16.5898418 sigma out 1act.( 13.712594 sig in 9act.) RANK 11 NODE 1 --> 16.2995987 sigma out 1act.( 14.4608765 sig in 9act.) RANK 12 NODE 5 --> 7.76832676 sigma out 1act.( 7.61717415 sig in 9act.) RANK 13 NODE 12 --> 6.19492102 sigma out 1act.( 6.97375202 sig in 9act.) RANK 14 NODE 14 --> 4.07912111 sigma out 1act.( 4.5741601 sig in 9act.) RANK 15 NODE 8 --> 1.32661605 sigma out 1act.( 2.57307935 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 127.719704 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.557634354 *** contribution from regularisation: 0.00260531693 *** contribution from error: -0.560239673 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27724 Closing output file done