NNInput NNInputs_110.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 182798 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 42998 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 42998 Chosen entries: 42998 Signal fraction: 1 Background fraction: 0.307568 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 42998 Entries to split: 42998 Test with : 21499 Train with : 21499 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 42998 for Signal Prepared event 0 for Signal with 42998 events ====Entry 0 Variable Ht : 103.037 Variable LepAPt : 29.4151 Variable LepBPt : 16.2907 Variable MetSigLeptonsJets : 3.90375 Variable MetSpec : 32.7321 Variable SumEtLeptonsJets : 70.3044 Variable VSumJetLeptonsPt : 47.5713 Variable addEt : 78.4382 Variable dPhiLepSumMet : 2.69477 Variable dPhiLeptons : 0.316822 Variable dRLeptons : 0.339778 Variable lep1_E : 29.4179 Variable lep2_E : 16.3887 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2110 Ht = 103.037 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 29.4154 LepAPt = 29.4151 LepBEt = 16.2907 LepBPt = 16.2907 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 32.7321 MetDelPhi = 1.84515 MetSig = 2.82942 MetSigLeptonsJets = 3.90375 MetSpec = 32.7321 Mjj = 0 MostCentralJetEta = 1.57834 MtllMet = 78.5262 Njets = 1 SB = 0 SumEt = 133.83 SumEtJets = 0 SumEtLeptonsJets = 70.3044 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 47.5713 addEt = 78.4382 dPhiLepSumMet = 2.69477 dPhiLeptons = 0.316822 dRLeptons = 0.339778 diltype = 3 dimass = 7.41356 event = 59 jet1_Et = 24.5987 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 29.4179 lep2_E = 16.3887 rand = 0.999742 run = 229664 weight = 4.83121e-07 ===Show End Prepared event 10000 for Signal with 42998 events Prepared event 20000 for Signal with 42998 events Prepared event 30000 for Signal with 42998 events Prepared event 40000 for Signal with 42998 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.242636 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4397 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 182798 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4397 negative weights. Signal fraction: 62.8974686 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0004501 63.0912971 64.8650818 66.3924789 67.3982544 68.4830017 69.3971252 70.2084961 70.8585052 71.5981445 72.2875061 73.1262817 73.7892303 74.3200684 74.9410172 75.5632629 76.1446762 76.7446671 77.2088776 77.7622375 78.2571869 78.8117905 79.3286743 79.8439026 80.4570312 80.9730606 81.55336 82.1528168 82.6593704 83.2483063 83.9277344 84.6818161 85.3290482 86.1067505 86.8858185 87.5684738 88.3743134 88.951767 89.7019806 90.4834518 91.371109 92.1786194 93.0087738 93.885788 94.707756 95.5754242 96.3232269 97.1604919 97.9635239 98.7448273 99.4779968 100.201462 100.980118 101.695656 102.518356 103.376785 104.167938 105.015579 105.951233 106.753998 107.782074 108.692825 109.745972 110.830078 111.936905 113.244476 114.514008 116.094353 117.648743 119.28537 121.191696 122.668579 124.394211 126.174049 128.029846 129.984573 131.796143 133.706909 135.984802 138.114838 140.493881 142.832047 145.045273 147.687683 149.955109 153.046387 156.23111 159.666748 163.062164 167.343811 171.637421 176.769165 182.140686 189.087097 196.550354 205.316803 218.078094 234.442474 259.013855 295.040253 708.24054 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2739372 20.5274105 20.8000336 21.0491924 21.2972412 21.4965477 21.7054214 21.907692 22.1248074 22.3190727 22.490345 22.691555 22.8680191 23.089077 23.270298 23.4857922 23.6654987 23.8348656 24.0534134 24.2385693 24.4441833 24.6432343 24.8141975 24.9992943 25.172554 25.3233376 25.4925957 25.6541462 25.8303051 26.016758 26.1951637 26.3735962 26.5687447 26.7771225 26.9909344 27.1935902 27.388546 27.5946217 27.8215027 27.9791107 28.1463203 28.3313103 28.5582314 28.785881 29.006485 29.247715 29.45047 29.669178 29.8548393 30.0696735 30.3258591 30.5762291 30.8049049 31.0781174 31.3409328 31.5609798 31.7828598 31.9682693 32.2443771 32.5201111 32.7659416 33.0565338 33.3141556 33.5978317 33.8633957 34.1582108 34.479248 34.8249359 35.1606827 35.4519348 35.7931671 36.1228104 36.4732895 36.8097916 37.1686707 37.5813828 38.0279541 38.4656754 38.9208984 39.4012489 39.8929443 40.4324493 41.0164642 41.5975647 42.2737732 42.9776917 43.7480392 44.6198349 45.5307846 46.6153336 47.8842697 49.3876801 50.9124069 52.7127724 55.0142746 57.8045273 61.7418747 67.2666626 78.0510254 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.0907211 10.1525755 10.2422714 10.3171978 10.4065971 10.4843359 10.5677347 10.6395493 10.7208624 10.7976875 10.8853493 10.9598389 11.0278311 11.1071434 11.1989899 11.2823439 11.3709402 11.4531488 11.5451851 11.6183605 11.7198639 11.7965412 11.888052 11.9898968 12.0702038 12.1758041 12.2706804 12.3554955 12.4359989 12.5400658 12.6311598 12.7143192 12.8132133 12.8898029 12.9905071 13.093482 13.2029114 13.3118143 13.4225283 13.5290184 13.6399975 13.7411366 13.8350945 13.9395294 14.0552511 14.1752663 14.3021774 14.3991928 14.5244198 14.6423016 14.7729149 14.8966475 15.0214005 15.1583738 15.2955818 15.4215717 15.537015 15.6810265 15.8316755 15.9610901 16.1104927 16.263958 16.42136 16.586319 16.7416477 16.9061241 17.0484161 17.2413445 17.4232101 17.6308823 17.8041172 17.984478 18.1948395 18.4015274 18.5968132 18.8066292 19.0163536 19.2265873 19.4777298 19.7038002 19.973196 20.2292881 20.46521 20.7589264 21.0397148 21.3378201 21.6704292 21.9996033 22.3781948 22.753088 23.2824097 23.8387718 24.4566154 25.1815224 25.9917774 27.0215607 28.2807159 30.2133675 33.8546944 68.4152985 ------------------------------ Transdef: Tab for variable 5 1.07720709 2.23610497 2.63413906 2.87873077 3.07275987 3.25637436 3.43224835 3.60122657 3.74731255 3.87945914 4.00813437 4.09617519 4.18502045 4.2700491 4.34842587 4.4197464 4.4983387 4.56833267 4.63441563 4.70581865 4.77585697 4.83510447 4.90007401 4.95732403 5.01914024 5.07750654 5.13551188 5.18233776 5.23759651 5.28378105 5.33436012 5.37753773 5.42122746 5.45706177 5.49711609 5.53376484 5.57185745 5.61061764 5.64847851 5.68650055 5.72948599 5.77194691 5.81039238 5.84994984 5.8909955 5.92834759 5.96338272 5.99819946 6.02767467 6.06782341 6.10087109 6.13415718 6.17168522 6.20571804 6.24904156 6.28255033 6.31539631 6.3475771 6.38505268 6.42070007 6.45308876 6.48782206 6.51940346 6.55731344 6.59829712 6.64199543 6.68043423 6.72075653 6.75617695 6.79515982 6.82820129 6.86709309 6.90182209 6.93982983 6.9736104 7.02451515 7.06332731 7.11076021 7.15950489 7.20633888 7.25508118 7.3114233 7.35746098 7.41127968 7.46515465 7.53060865 7.59455204 7.66413307 7.74099064 7.82259035 7.90477562 7.98760319 8.0976305 8.21610641 8.35856056 8.53222275 8.73447704 8.95427322 9.33301544 10.0187874 18.1234589 ------------------------------ Transdef: Tab for variable 6 15.0000525 18.8112679 22.341713 25.2103367 26.0667343 26.8486328 27.5907993 28.2945175 28.9096947 29.5446663 30.068573 30.6464119 31.0884781 31.4824257 31.9043064 32.2835922 32.7466736 33.1312675 33.4723053 33.8337288 34.1921844 34.5082779 34.7798538 35.0445633 35.3849182 35.7022934 36.0134888 36.2870216 36.576561 36.8899765 37.1937981 37.4507751 37.7188339 38.0410461 38.3416519 38.6091652 38.906601 39.1725311 39.4697113 39.7412872 40.0285187 40.2803192 40.5358505 40.8289032 41.1272545 41.4359207 41.7918892 42.0914993 42.3394127 42.6596527 42.9363289 43.19907 43.4884567 43.7574463 44.0821381 44.4134827 44.6928864 45.0382881 45.4174461 45.7593956 46.1446381 46.5213165 46.85495 47.2400665 47.570694 47.9320717 48.2988129 48.6673355 49.0572624 49.4358215 49.8426743 50.2809486 50.664566 51.1285896 51.5555153 52.0263672 52.53685 53.0218315 53.5053101 54.0030899 54.5079384 55.0655518 55.651226 56.3474808 57.0518112 57.7753258 58.5318375 59.5189323 60.4662094 61.69487 62.9146347 64.3463745 65.9631042 67.8907776 70.1071396 72.8066559 75.9796066 79.6403961 85.3792877 95.7725525 214.544067 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.5462456 33.5115891 34.1772766 34.7571259 35.2563248 35.6656647 36.0436172 36.361824 36.6996574 37.0204201 37.3469238 37.6414642 37.9520645 38.1728058 38.3938217 38.6641235 38.88694 39.146389 39.3821716 39.6148376 39.8835869 40.1275368 40.40065 40.6764603 40.9341927 41.2115021 41.4862099 41.8043442 42.1261597 42.4862404 42.8830643 43.286129 43.6945724 44.1681061 44.5595055 44.9396973 45.3118973 45.6861649 46.1758881 46.6091309 47.0774956 47.5971565 48.0883179 48.5311966 48.9750824 49.5110588 50.0039673 50.5144882 51.0705948 51.5940399 52.1645279 52.6793442 53.2513962 53.9187813 54.741066 55.446907 56.1808357 56.9815102 57.8915787 58.9256706 59.9161072 61.1453476 62.3638382 63.6155472 64.7878418 65.9627914 67.243721 68.6650772 70.0557404 71.4030457 72.814743 74.1584778 75.6835098 76.9336853 78.5980988 80.063446 81.8383102 83.4043274 85.2814789 87.4402771 89.7109299 91.8473969 94.2121429 96.5491943 99.3775711 101.853897 105.017471 108.188385 111.936722 115.640221 120.338516 125.832489 131.887756 138.018921 145.802032 155.340546 167.532959 185.670441 216.645493 511.516205 ------------------------------ Transdef: Tab for variable 8 0.245947659 20.2410126 24.9300613 27.9232178 29.7116241 30.8823071 31.6722679 32.239151 32.7949486 33.2563858 33.67173 34.0540771 34.4126129 34.7927322 35.0714951 35.3292618 35.5547066 35.8664856 36.1114235 36.3669052 36.6203613 36.8638611 37.1333618 37.3481102 37.5992126 37.7835464 37.9996071 38.1729279 38.4373512 38.6399689 38.8590965 39.0445328 39.278511 39.5000763 39.7205887 39.9468307 40.1483307 40.3747101 40.5668297 40.842514 41.0666962 41.345665 41.627861 41.877655 42.1645508 42.478775 42.7690277 43.082016 43.3331757 43.667469 43.9825478 44.2768745 44.593071 44.8916931 45.2190132 45.5543556 45.8893051 46.276226 46.5945816 46.9762421 47.3232231 47.6759796 48.0516319 48.3700867 48.738472 49.0770874 49.4303818 49.8164291 50.1683731 50.569252 50.9311752 51.2926788 51.7393227 52.2157097 52.6922073 53.1431046 53.6185608 54.1348419 54.7218094 55.2757034 55.8330002 56.4989395 57.1928177 57.9630508 58.7903748 59.6976776 60.7736588 61.9524994 63.1218796 64.3203125 65.70578 67.1961746 69.0616226 71.1680603 73.5937805 76.7467804 79.8363571 84.7056503 92.2481995 104.668777 289.322327 ------------------------------ Transdef: Tab for variable 9 49.6214828 62.5848007 64.1524658 65.6072845 66.7986221 67.6327209 68.5073242 69.3713989 70.0143204 70.6713867 71.3492432 71.8700714 72.5496368 73.2109528 73.7578583 74.2538452 74.7385483 75.3546753 75.7963562 76.2667694 76.8160782 77.1630249 77.6946945 78.0845947 78.5180893 78.9800415 79.4275055 79.8371735 80.2820053 80.7782898 81.1888123 81.6530914 82.1446152 82.5556564 83.0003662 83.4514923 84.0951996 84.6307831 85.1473999 85.6769028 86.2078323 86.8247833 87.3113708 87.8415604 88.4522552 88.9016266 89.4250793 90.0631638 90.5776825 91.1846542 91.8259811 92.3728256 92.939415 93.5317307 94.2038727 94.7343597 95.3626099 95.9502258 96.5348358 97.1285706 97.7167664 98.2982788 98.85112 99.4042282 99.9379425 100.490128 101.108131 101.647659 102.214401 102.812714 103.404419 103.964325 104.591354 105.204666 105.78669 106.466782 107.173721 107.874481 108.57283 109.286346 110.081772 110.940628 111.757278 112.759964 113.700607 114.757553 115.833115 117.195641 118.702141 120.357513 122.315826 124.633163 127.406479 130.505402 134.455276 139.004532 144.815948 152.320755 162.79068 183.380676 424.390259 ------------------------------ Transdef: Tab for variable 10 0.000599204504 0.844662547 1.07284498 1.25883293 1.40501142 1.53350115 1.64304709 1.74388266 1.82629263 1.89460039 1.9677161 2.03440833 2.09358215 2.15198565 2.20560837 2.2509377 2.30048728 2.34172058 2.3799963 2.41983938 2.45182991 2.48811436 2.5229311 2.55405235 2.57986689 2.60483265 2.62648034 2.64991903 2.67367554 2.69580984 2.71772575 2.73650217 2.75665879 2.77535391 2.79069376 2.8053546 2.82077217 2.83572102 2.84975958 2.8594389 2.87127113 2.88093424 2.89159203 2.90263939 2.91125727 2.9193368 2.92723465 2.93514395 2.94353342 2.95012856 2.95786047 2.96406698 2.97050285 2.97649336 2.98151445 2.98674989 2.99091482 2.99545431 3.00154638 3.00738239 3.01133299 3.01553774 3.01998425 3.02444053 3.02825332 3.03202748 3.03632832 3.04037952 3.04478788 3.04922986 3.05327845 3.05691481 3.06029582 3.06431484 3.06763792 3.07132721 3.07485056 3.07772231 3.08121967 3.08426857 3.08754635 3.09060884 3.09374237 3.0965867 3.09965658 3.10234737 3.10482359 3.10797548 3.11006117 3.11318445 3.11553907 3.11794639 3.12045741 3.12295246 3.12590408 3.12845469 3.13052678 3.13291168 3.13555026 3.13843489 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00591134094 0.0120500028 0.0194085557 0.0268890858 0.0338220298 0.0420168638 0.0502253175 0.0585344955 0.069083631 0.0776822567 0.0864477158 0.0949194431 0.103372931 0.113635421 0.121723652 0.130105734 0.139227986 0.147609234 0.156435758 0.164176702 0.172213733 0.179390073 0.185393348 0.193742752 0.200559616 0.207215548 0.213602543 0.221439674 0.228469014 0.23389025 0.24059023 0.247314915 0.253976345 0.260170698 0.266134709 0.272666693 0.278199077 0.284082353 0.290757775 0.296531767 0.302225053 0.308460593 0.314267993 0.320206404 0.326033592 0.332906604 0.338917375 0.344790578 0.350422502 0.355796903 0.362143338 0.369050205 0.3751477 0.381398559 0.388118505 0.394023895 0.39982605 0.406018734 0.411602139 0.417464018 0.423486948 0.429476261 0.434956074 0.440335959 0.446757317 0.452112675 0.458408594 0.464975834 0.470898628 0.476264179 0.483030319 0.490081549 0.497398406 0.50417459 0.51166755 0.518482327 0.525025964 0.532173336 0.539652348 0.547825933 0.55637598 0.565644026 0.573927522 0.582480192 0.591113567 0.600010037 0.609831572 0.621522427 0.634050369 0.644424438 0.656799734 0.674282789 0.689276099 0.706826806 0.723674893 0.74630475 0.774736941 0.810992122 0.866910219 1.14321351 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.231481224 0.252430201 0.267110258 0.280891567 0.292751312 0.303073704 0.313592374 0.322689772 0.331708163 0.340282559 0.348136306 0.356052577 0.363533914 0.370653868 0.377314329 0.385460585 0.392323494 0.398631036 0.40391922 0.40900147 0.413713366 0.418266416 0.423123419 0.427378535 0.432295799 0.436061561 0.440325141 0.444971681 0.449103832 0.454257697 0.458641082 0.462813258 0.466793418 0.470960498 0.474333227 0.478525341 0.482498139 0.486800492 0.490454197 0.494567931 0.498933375 0.503515124 0.508225203 0.512281954 0.516443133 0.520176947 0.523387671 0.527475834 0.532084584 0.536401927 0.541102827 0.545671225 0.550231755 0.554111779 0.558716059 0.563171506 0.567307234 0.571404934 0.576154351 0.579903841 0.584057033 0.58848995 0.59389329 0.597858071 0.602476597 0.60677135 0.611655474 0.616438746 0.621627629 0.626467764 0.63174808 0.63781929 0.643279791 0.64868629 0.655091763 0.660961092 0.665959775 0.671877027 0.67764461 0.68377769 0.690948248 0.699974656 0.706001818 0.713734269 0.721588969 0.728505135 0.737733245 0.74586153 0.754196286 0.763777971 0.773163676 0.784346223 0.796470642 0.810680568 0.824653268 0.841857433 0.862424731 0.888605177 0.934325457 1.14349747 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3645039 22.1333084 22.5786476 23.1382389 23.6356583 24.1350365 24.5810623 24.9954453 25.3350525 25.6985588 26.0524673 26.4215775 26.8041325 27.1371231 27.4911423 27.8250618 28.1293545 28.4747581 28.7864189 29.1292877 29.421627 29.7186909 30.0345001 30.341177 30.6407394 30.9250793 31.2006149 31.509491 31.8015938 32.0873566 32.365303 32.6685028 32.9592819 33.2700195 33.6136475 33.9810486 34.3580475 34.640152 34.9510345 35.2028503 35.5128632 35.8445778 36.121109 36.3829956 36.7472992 37.1153984 37.4795151 37.8150368 38.1700134 38.5495758 38.9190979 39.2952957 39.7111588 40.1077347 40.4550781 40.8255234 41.2882614 41.7041092 42.1808624 42.6977158 43.1607971 43.5610847 44.1232491 44.66996 45.2046204 45.7597198 46.3650894 46.9547195 47.5458298 48.0965157 48.7474136 49.4157333 50.1877518 50.9271698 51.7625809 52.5254784 53.3750687 54.2327385 55.1370697 56.1253777 57.2048187 58.2626801 59.2569046 60.3914452 61.6740189 62.6771317 64.1272583 65.889061 67.7470245 69.4712906 71.5652924 73.9511108 76.4935989 78.9344025 82.3756866 85.8648529 89.9182281 96.4372101 107.895233 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.4585171 10.7839565 11.0143728 11.2471285 11.4212456 11.6264248 11.8024359 11.9964943 12.2048225 12.3451405 12.5013199 12.6781082 12.8430862 13.0141659 13.1921425 13.3396931 13.5036736 13.6614771 13.8404751 13.9737844 14.1447258 14.3115482 14.4662094 14.6261749 14.7724247 14.917345 15.09515 15.2545319 15.4336309 15.5885582 15.731781 15.9091196 16.1042824 16.2731514 16.427803 16.605278 16.7901726 16.9558868 17.1322498 17.3225594 17.4991455 17.697525 17.861227 18.0350685 18.2345047 18.4219208 18.6072273 18.7845459 18.9904633 19.1601105 19.3408356 19.5463219 19.7830772 20.0136299 20.2353287 20.4718056 20.7090969 20.9422703 21.1653709 21.4254379 21.6674862 21.9140072 22.141037 22.3929138 22.6748085 22.9692001 23.2394562 23.5172691 23.8461075 24.1723328 24.5248852 24.8602829 25.2312603 25.5577278 25.9091187 26.297699 26.7061138 27.0867653 27.4632339 27.7953186 28.1969337 28.7579041 29.2990322 29.8451805 30.5036736 31.2536201 31.8226013 32.638298 33.4616394 34.285984 35.3652191 36.6309662 37.7976913 39.0646744 40.5813103 42.8157692 45.8314896 49.9825974 56.4701309 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 52.9 40.1 17.0 -0.3 25.6 52.0 32.6 47.3 -33.0 -2.2 -14.7 6.9 -12.7 2 52.9 100.0 64.2 39.1 5.6 51.2 93.7 56.8 88.9 -54.3 -17.9 -39.7 32.2 10.4 3 40.1 64.2 100.0 16.0 -13.2 20.0 68.0 42.8 70.1 -23.2 -18.2 -43.9 63.6 -1.9 4 17.0 39.1 16.0 100.0 -8.3 11.2 42.1 26.4 42.2 -13.1 -22.0 -45.4 5.2 64.8 5 -0.3 5.6 -13.2 -8.3 100.0 78.5 -22.2 38.4 35.1 35.2 2.0 6.3 -15.0 -9.6 6 25.6 51.2 20.0 11.2 78.5 100.0 27.8 66.0 69.8 -0.1 -6.4 -13.3 3.6 -3.0 7 52.0 93.7 68.0 42.1 -22.2 27.8 100.0 51.2 76.2 -60.2 -17.0 -40.4 36.9 14.1 8 32.6 56.8 42.8 26.4 38.4 66.0 51.2 100.0 70.4 -8.4 -15.1 -29.0 20.6 6.9 9 47.3 88.9 70.1 42.2 35.1 69.8 76.2 70.4 100.0 -27.9 -20.0 -45.1 36.7 13.1 10 -33.0 -54.3 -23.2 -13.1 35.2 -0.1 -60.2 -8.4 -27.9 100.0 4.6 11.8 -9.6 -0.6 11 -2.2 -17.9 -18.2 -22.0 2.0 -6.4 -17.0 -15.1 -20.0 4.6 100.0 53.7 -9.1 -13.2 12 -14.7 -39.7 -43.9 -45.4 6.3 -13.3 -40.4 -29.0 -45.1 11.8 53.7 100.0 -22.8 -21.3 13 6.9 32.2 63.6 5.2 -15.0 3.6 36.9 20.6 36.7 -9.6 -9.1 -22.8 100.0 35.5 14 -12.7 10.4 -1.9 64.8 -9.6 -3.0 14.1 6.9 13.1 -0.6 -13.2 -21.3 35.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 113.475422 TOTAL CORRELATION OF ALL VARIABLES 59.4209104 ROUND 1: MAX CORR ( 59.4187341) AFTER KILLING INPUT VARIABLE 5 CONTR 0.508557999 ROUND 2: MAX CORR ( 59.4109419) AFTER KILLING INPUT VARIABLE 9 CONTR 0.96225638 ROUND 3: MAX CORR ( 59.3833092) AFTER KILLING INPUT VARIABLE 6 CONTR 1.81179858 ROUND 4: MAX CORR ( 59.3001759) AFTER KILLING INPUT VARIABLE 11 CONTR 3.14110678 ROUND 5: MAX CORR ( 59.1972391) AFTER KILLING INPUT VARIABLE 7 CONTR 3.49252609 ROUND 6: MAX CORR ( 59.0430433) AFTER KILLING INPUT VARIABLE 8 CONTR 4.26991341 ROUND 7: MAX CORR ( 58.7224768) AFTER KILLING INPUT VARIABLE 10 CONTR 6.14423913 ROUND 8: MAX CORR ( 58.2924641) AFTER KILLING INPUT VARIABLE 13 CONTR 7.09351188 ROUND 9: MAX CORR ( 57.461056) AFTER KILLING INPUT VARIABLE 3 CONTR 9.81011787 ROUND 10: MAX CORR ( 57.0085968) AFTER KILLING INPUT VARIABLE 12 CONTR 7.19672527 ROUND 11: MAX CORR ( 55.9647029) AFTER KILLING INPUT VARIABLE 4 CONTR 10.8596563 ROUND 12: MAX CORR ( 52.8829575) AFTER KILLING INPUT VARIABLE 14 CONTR 18.3150424 LAST REMAINING VARIABLE: 2 total correlation to target: 59.4209104 % total significance: 110.151467 sigma correlations of single variables to target: variable 2: 52.8829575 % , in sigma: 98.0317417 variable 3: 40.147765 % , in sigma: 74.4238885 variable 4: 16.9837415 % , in sigma: 31.4835977 variable 5: -0.315108976 % , in sigma: 0.584133021 variable 6: 25.589034 % , in sigma: 47.4356521 variable 7: 52.0410679 % , in sigma: 96.4710894 variable 8: 32.6375296 % , in sigma: 60.5017952 variable 9: 47.2751449 % , in sigma: 87.6362633 variable 10: -32.9581876 % , in sigma: 61.0962148 variable 11: -2.19356559 % , in sigma: 4.06632052 variable 12: -14.7067785 % , in sigma: 27.2626793 variable 13: 6.91467706 % , in sigma: 12.8180773 variable 14: -12.7003727 % , in sigma: 23.543306 variables sorted by significance: 1 most relevant variable 2 corr 52.8829575 , in sigma: 98.0317416 2 most relevant variable 14 corr 18.3150425 , in sigma: 33.9514959 3 most relevant variable 4 corr 10.8596563 , in sigma: 20.1310795 4 most relevant variable 12 corr 7.19672537 , in sigma: 13.3409241 5 most relevant variable 3 corr 9.81011772 , in sigma: 18.1854982 6 most relevant variable 13 corr 7.09351206 , in sigma: 13.1495925 7 most relevant variable 10 corr 6.14423895 , in sigma: 11.3898782 8 most relevant variable 8 corr 4.2699132 , in sigma: 7.91534829 9 most relevant variable 7 corr 3.49252605 , in sigma: 6.47426748 10 most relevant variable 11 corr 3.14110684 , in sigma: 5.82282439 11 most relevant variable 6 corr 1.81179857 , in sigma: 3.35862021 12 most relevant variable 9 corr 0.962256372 , in sigma: 1.78378201 13 most relevant variable 5 corr 0.508557975 , in sigma: 0.942738954 global correlations between input variables: variable 2: 98.8402676 % variable 3: 93.6356336 % variable 4: 87.8087989 % variable 5: 94.5518857 % variable 6: 92.7365104 % variable 7: 98.3983846 % variable 8: 82.0953434 % variable 9: 98.4679786 % variable 10: 73.2773463 % variable 11: 54.9529006 % variable 12: 71.3540469 % variable 13: 83.2692486 % variable 14: 84.1683165 % significance loss when removing single variables: variable 2: corr = 2.2499303 % , sigma = 4.17080655 variable 3: corr = 7.56769726 % , sigma = 14.028613 variable 4: corr = 6.71993869 % , sigma = 12.4570812 variable 5: corr = 0.508557999 % , sigma = 0.942738998 variable 6: corr = 0.7940559 % , sigma = 1.47198051 variable 7: corr = 3.66317158 % , sigma = 6.79060149 variable 8: corr = 1.76039697 % , sigma = 3.26333452 variable 9: corr = 0.613599328 % , sigma = 1.13745928 variable 10: corr = 5.24912482 % , sigma = 9.73056108 variable 11: corr = 2.96224692 % , sigma = 5.49126294 variable 12: corr = 6.97054566 % , sigma = 12.9216436 variable 13: corr = 7.20531552 % , sigma = 13.3568481 variable 14: corr = 10.3285303 % , sigma = 19.1465051 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 14.9253235 sigma out 15 active outputs RANK 2 NODE 7 --> 14.5569382 sigma out 15 active outputs RANK 3 NODE 11 --> 13.9491529 sigma out 15 active outputs RANK 4 NODE 3 --> 13.6260576 sigma out 15 active outputs RANK 5 NODE 2 --> 13.600625 sigma out 15 active outputs RANK 6 NODE 6 --> 13.506526 sigma out 15 active outputs RANK 7 NODE 9 --> 13.4981918 sigma out 15 active outputs RANK 8 NODE 4 --> 12.8910789 sigma out 15 active outputs RANK 9 NODE 8 --> 11.1312819 sigma out 15 active outputs RANK 10 NODE 1 --> 10.8898745 sigma out 15 active outputs RANK 11 NODE 5 --> 10.4607344 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 22.3977966 sigma in 11act. ( 21.2866116 sig out 1act.) RANK 2 NODE 15 --> 15.1226149 sigma in 11act. ( 15.3769503 sig out 1act.) RANK 3 NODE 8 --> 14.1063662 sigma in 11act. ( 15.8594913 sig out 1act.) RANK 4 NODE 1 --> 13.4939823 sigma in 11act. ( 16.3217354 sig out 1act.) RANK 5 NODE 6 --> 11.0201645 sigma in 11act. ( 11.1338863 sig out 1act.) RANK 6 NODE 3 --> 10.8337402 sigma in 11act. ( 10.8915062 sig out 1act.) RANK 7 NODE 7 --> 10.5136728 sigma in 11act. ( 7.95536613 sig out 1act.) RANK 8 NODE 14 --> 10.3540163 sigma in 11act. ( 9.86289787 sig out 1act.) RANK 9 NODE 2 --> 9.42859173 sigma in 11act. ( 10.8760166 sig out 1act.) RANK 10 NODE 10 --> 8.76773357 sigma in 11act. ( 6.35879803 sig out 1act.) RANK 11 NODE 11 --> 7.56635571 sigma in 11act. ( 9.0105896 sig out 1act.) RANK 12 NODE 4 --> 7.05970907 sigma in 11act. ( 7.25801373 sig out 1act.) RANK 13 NODE 9 --> 5.00909805 sigma in 11act. ( 4.26094389 sig out 1act.) RANK 14 NODE 12 --> 3.83222198 sigma in 11act. ( 3.61147571 sig out 1act.) RANK 15 NODE 13 --> 1.4133544 sigma in 11act. ( 1.09606636 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 21.2866116 sigma out 1act.( 22.3977966 sig in 11act.) RANK 2 NODE 1 --> 16.3217354 sigma out 1act.( 13.4939823 sig in 11act.) RANK 3 NODE 8 --> 15.8594913 sigma out 1act.( 14.1063662 sig in 11act.) RANK 4 NODE 15 --> 15.3769503 sigma out 1act.( 15.1226149 sig in 11act.) RANK 5 NODE 6 --> 11.1338863 sigma out 1act.( 11.0201645 sig in 11act.) RANK 6 NODE 3 --> 10.8915062 sigma out 1act.( 10.8337402 sig in 11act.) RANK 7 NODE 2 --> 10.8760166 sigma out 1act.( 9.42859173 sig in 11act.) RANK 8 NODE 14 --> 9.86289787 sigma out 1act.( 10.3540163 sig in 11act.) RANK 9 NODE 11 --> 9.0105896 sigma out 1act.( 7.56635571 sig in 11act.) RANK 10 NODE 7 --> 7.95536613 sigma out 1act.( 10.5136728 sig in 11act.) RANK 11 NODE 4 --> 7.25801373 sigma out 1act.( 7.05970907 sig in 11act.) RANK 12 NODE 10 --> 6.35879803 sigma out 1act.( 8.76773357 sig in 11act.) RANK 13 NODE 9 --> 4.26094389 sigma out 1act.( 5.00909805 sig in 11act.) RANK 14 NODE 12 --> 3.61147571 sigma out 1act.( 3.83222198 sig in 11act.) RANK 15 NODE 13 --> 1.09606636 sigma out 1act.( 1.4133544 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 43.9958763 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 17.1565723 sigma out 15 active outputs RANK 2 NODE 10 --> 16.4828873 sigma out 15 active outputs RANK 3 NODE 2 --> 16.3730907 sigma out 15 active outputs RANK 4 NODE 11 --> 16.0589237 sigma out 15 active outputs RANK 5 NODE 7 --> 15.8097363 sigma out 15 active outputs RANK 6 NODE 9 --> 14.4016047 sigma out 15 active outputs RANK 7 NODE 1 --> 14.2587919 sigma out 15 active outputs RANK 8 NODE 6 --> 13.7685595 sigma out 15 active outputs RANK 9 NODE 4 --> 13.7105265 sigma out 15 active outputs RANK 10 NODE 8 --> 12.6459885 sigma out 15 active outputs RANK 11 NODE 5 --> 11.3362293 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 21.5048695 sigma in 11act. ( 20.1540642 sig out 1act.) RANK 2 NODE 1 --> 17.6217861 sigma in 11act. ( 16.699316 sig out 1act.) RANK 3 NODE 8 --> 16.2523174 sigma in 11act. ( 15.5812998 sig out 1act.) RANK 4 NODE 15 --> 16.1764164 sigma in 11act. ( 15.8164101 sig out 1act.) RANK 5 NODE 2 --> 12.4060326 sigma in 11act. ( 11.8140717 sig out 1act.) RANK 6 NODE 3 --> 12.3851957 sigma in 11act. ( 10.6286287 sig out 1act.) RANK 7 NODE 6 --> 11.9873028 sigma in 11act. ( 10.94666 sig out 1act.) RANK 8 NODE 11 --> 11.1922102 sigma in 11act. ( 9.3015852 sig out 1act.) RANK 9 NODE 14 --> 10.5805292 sigma in 11act. ( 9.19043255 sig out 1act.) RANK 10 NODE 4 --> 10.2215567 sigma in 11act. ( 7.74602222 sig out 1act.) RANK 11 NODE 7 --> 10.044961 sigma in 11act. ( 6.9792614 sig out 1act.) RANK 12 NODE 9 --> 8.98850918 sigma in 11act. ( 4.08009863 sig out 1act.) RANK 13 NODE 10 --> 8.84768581 sigma in 11act. ( 5.19688559 sig out 1act.) RANK 14 NODE 13 --> 6.31526232 sigma in 11act. ( 1.82789385 sig out 1act.) RANK 15 NODE 12 --> 5.22489595 sigma in 11act. ( 3.94569468 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 20.1540642 sigma out 1act.( 21.5048695 sig in 11act.) RANK 2 NODE 1 --> 16.699316 sigma out 1act.( 17.6217861 sig in 11act.) RANK 3 NODE 15 --> 15.8164101 sigma out 1act.( 16.1764164 sig in 11act.) RANK 4 NODE 8 --> 15.5812998 sigma out 1act.( 16.2523174 sig in 11act.) RANK 5 NODE 2 --> 11.8140717 sigma out 1act.( 12.4060326 sig in 11act.) RANK 6 NODE 6 --> 10.94666 sigma out 1act.( 11.9873028 sig in 11act.) RANK 7 NODE 3 --> 10.6286287 sigma out 1act.( 12.3851957 sig in 11act.) RANK 8 NODE 11 --> 9.3015852 sigma out 1act.( 11.1922102 sig in 11act.) RANK 9 NODE 14 --> 9.19043255 sigma out 1act.( 10.5805292 sig in 11act.) RANK 10 NODE 4 --> 7.74602222 sigma out 1act.( 10.2215567 sig in 11act.) RANK 11 NODE 7 --> 6.9792614 sigma out 1act.( 10.044961 sig in 11act.) RANK 12 NODE 10 --> 5.19688559 sigma out 1act.( 8.84768581 sig in 11act.) RANK 13 NODE 9 --> 4.08009863 sigma out 1act.( 8.98850918 sig in 11act.) RANK 14 NODE 12 --> 3.94569468 sigma out 1act.( 5.22489595 sig in 11act.) RANK 15 NODE 13 --> 1.82789385 sigma out 1act.( 6.31526232 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 43.5042229 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.443933129 *** contribution from regularisation: 0.00394760491 *** contribution from error: -0.447880745 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.477135539 *** contribution from regularisation: 0.00253053335 *** contribution from error: -0.479666084 *********************************************** -----------------> Test sample ENTER BFGS code START -43618.851 -0.282743305 -1.41717124 EXIT FROM BFGS code FG_START 0. -0.282743305 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.498371869 *** contribution from regularisation: 0.00224402663 *** contribution from error: -0.500615895 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -45550.6898 -0.282743305 -119.13092 EXIT FROM BFGS code FG_LNSRCH 0. -0.316888332 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.520617783 *** contribution from regularisation: 0.00326108094 *** contribution from error: -0.523878872 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47583.9458 -0.316888332 115.066856 EXIT FROM BFGS code NEW_X -47583.9458 -0.316888332 115.066856 ENTER BFGS code NEW_X -47583.9458 -0.316888332 115.066856 EXIT FROM BFGS code FG_LNSRCH 0. -0.28917399 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.52189368 *** contribution from regularisation: 0.00315714604 *** contribution from error: -0.525050819 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47700.5625 -0.28917399 13.6002846 EXIT FROM BFGS code NEW_X -47700.5625 -0.28917399 13.6002846 ENTER BFGS code NEW_X -47700.5625 -0.28917399 13.6002846 EXIT FROM BFGS code FG_LNSRCH 0. -0.282331645 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.522287369 *** contribution from regularisation: 0.00299748895 *** contribution from error: -0.525284886 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47736.5417 -0.282331645 4.0125165 EXIT FROM BFGS code NEW_X -47736.5417 -0.282331645 4.0125165 ENTER BFGS code NEW_X -47736.5417 -0.282331645 4.0125165 EXIT FROM BFGS code FG_LNSRCH 0. -0.261029154 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.52277565 *** contribution from regularisation: 0.00286157615 *** contribution from error: -0.525637209 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47781.1713 -0.261029154 -2.69178271 EXIT FROM BFGS code NEW_X -47781.1713 -0.261029154 -2.69178271 ENTER BFGS code NEW_X -47781.1713 -0.261029154 -2.69178271 EXIT FROM BFGS code FG_LNSRCH 0. -0.234918401 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.523273647 *** contribution from regularisation: 0.00287364936 *** contribution from error: -0.526147306 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47826.6883 -0.234918401 -4.71232557 EXIT FROM BFGS code NEW_X -47826.6883 -0.234918401 -4.71232557 ENTER BFGS code NEW_X -47826.6883 -0.234918401 -4.71232557 EXIT FROM BFGS code FG_LNSRCH 0. 0.143640503 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.515636921 *** contribution from regularisation: 0.00471788878 *** contribution from error: -0.520354807 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47128.701 0.143640503 70.8762665 EXIT FROM BFGS code FG_LNSRCH 0. -0.12365184 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 31.3365822 sigma out 15 active outputs RANK 2 NODE 10 --> 21.860733 sigma out 15 active outputs RANK 3 NODE 3 --> 18.9265881 sigma out 15 active outputs RANK 4 NODE 1 --> 16.6978302 sigma out 15 active outputs RANK 5 NODE 8 --> 14.8226776 sigma out 15 active outputs RANK 6 NODE 7 --> 11.600091 sigma out 15 active outputs RANK 7 NODE 6 --> 9.54058552 sigma out 15 active outputs RANK 8 NODE 11 --> 8.74058723 sigma out 15 active outputs RANK 9 NODE 9 --> 8.08135033 sigma out 15 active outputs RANK 10 NODE 5 --> 8.02216244 sigma out 15 active outputs RANK 11 NODE 4 --> 7.90720606 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 27.260088 sigma in 11act. ( 28.8893661 sig out 1act.) RANK 2 NODE 13 --> 27.028862 sigma in 11act. ( 27.4548531 sig out 1act.) RANK 3 NODE 2 --> 16.3476181 sigma in 11act. ( 16.2008114 sig out 1act.) RANK 4 NODE 9 --> 13.6895313 sigma in 11act. ( 13.7963543 sig out 1act.) RANK 5 NODE 8 --> 11.6754208 sigma in 11act. ( 10.5552254 sig out 1act.) RANK 6 NODE 1 --> 11.5761404 sigma in 11act. ( 9.37285137 sig out 1act.) RANK 7 NODE 4 --> 11.3788118 sigma in 11act. ( 10.8082933 sig out 1act.) RANK 8 NODE 11 --> 10.7810497 sigma in 11act. ( 9.46104145 sig out 1act.) RANK 9 NODE 6 --> 9.28872108 sigma in 11act. ( 8.53374481 sig out 1act.) RANK 10 NODE 14 --> 8.53303623 sigma in 11act. ( 7.47875023 sig out 1act.) RANK 11 NODE 3 --> 8.03786659 sigma in 11act. ( 7.19407177 sig out 1act.) RANK 12 NODE 5 --> 6.82181072 sigma in 11act. ( 5.72732735 sig out 1act.) RANK 13 NODE 12 --> 6.44894028 sigma in 11act. ( 5.47703552 sig out 1act.) RANK 14 NODE 7 --> 5.51828861 sigma in 11act. ( 4.58864784 sig out 1act.) RANK 15 NODE 10 --> 4.91523981 sigma in 11act. ( 4.03355885 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 28.8893661 sigma out 1act.( 27.260088 sig in 11act.) RANK 2 NODE 13 --> 27.4548531 sigma out 1act.( 27.028862 sig in 11act.) RANK 3 NODE 2 --> 16.2008114 sigma out 1act.( 16.3476181 sig in 11act.) RANK 4 NODE 9 --> 13.7963543 sigma out 1act.( 13.6895313 sig in 11act.) RANK 5 NODE 4 --> 10.8082933 sigma out 1act.( 11.3788118 sig in 11act.) RANK 6 NODE 8 --> 10.5552254 sigma out 1act.( 11.6754208 sig in 11act.) RANK 7 NODE 11 --> 9.46104145 sigma out 1act.( 10.7810497 sig in 11act.) RANK 8 NODE 1 --> 9.37285137 sigma out 1act.( 11.5761404 sig in 11act.) RANK 9 NODE 6 --> 8.53374481 sigma out 1act.( 9.28872108 sig in 11act.) RANK 10 NODE 14 --> 7.47875023 sigma out 1act.( 8.53303623 sig in 11act.) RANK 11 NODE 3 --> 7.19407177 sigma out 1act.( 8.03786659 sig in 11act.) RANK 12 NODE 5 --> 5.72732735 sigma out 1act.( 6.82181072 sig in 11act.) RANK 13 NODE 12 --> 5.47703552 sigma out 1act.( 6.44894028 sig in 11act.) RANK 14 NODE 7 --> 4.58864784 sigma out 1act.( 5.51828861 sig in 11act.) RANK 15 NODE 10 --> 4.03355885 sigma out 1act.( 4.91523981 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.2245178 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.526758134 *** contribution from regularisation: 0.00169859279 *** contribution from error: -0.528456748 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48145.1657 -0.12365184 8.2807436 EXIT FROM BFGS code NEW_X -48145.1657 -0.12365184 8.2807436 ENTER BFGS code NEW_X -48145.1657 -0.12365184 8.2807436 EXIT FROM BFGS code FG_LNSRCH 0. 0.131470621 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.526709139 *** contribution from regularisation: 0.00506901368 *** contribution from error: -0.531778157 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48140.6862 0.131470621 -23.1124172 EXIT FROM BFGS code FG_LNSRCH 0. -0.0143714668 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.528685629 *** contribution from regularisation: 0.00205512042 *** contribution from error: -0.530740738 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48321.3381 -0.0143714668 -9.0547142 EXIT FROM BFGS code NEW_X -48321.3381 -0.0143714668 -9.0547142 ENTER BFGS code NEW_X -48321.3381 -0.0143714668 -9.0547142 EXIT FROM BFGS code FG_LNSRCH 0. 0.100970119 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.523336947 *** contribution from regularisation: 0.00468592439 *** contribution from error: -0.528022885 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47832.4715 0.100970119 -39.1007309 EXIT FROM BFGS code FG_LNSRCH 0. 0.00383998407 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.529407263 *** contribution from regularisation: 0.00207783887 *** contribution from error: -0.531485081 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48387.2917 0.00383998407 -6.15462923 EXIT FROM BFGS code NEW_X -48387.2917 0.00383998407 -6.15462923 ENTER BFGS code NEW_X -48387.2917 0.00383998407 -6.15462923 EXIT FROM BFGS code FG_LNSRCH 0. 0.0529718101 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.528854907 *** contribution from regularisation: 0.0037595185 *** contribution from error: -0.53261441 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48336.8089 0.0529718101 -51.0730629 EXIT FROM BFGS code FG_LNSRCH 0. 0.0164445378 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.529389441 *** contribution from regularisation: 0.00272889179 *** contribution from error: -0.53211832 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48385.665 0.0164445378 -15.7536926 EXIT FROM BFGS code FG_LNSRCH 0. 0.00674301805 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.528568387 *** contribution from regularisation: 0.00308433082 *** contribution from error: -0.531652689 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48310.6214 0.00674301805 -8.30340385 EXIT FROM BFGS code FG_LNSRCH 0. 0.0038941938 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.528418899 *** contribution from regularisation: 0.00306925829 *** contribution from error: -0.53148818 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48296.9579 0.0038941938 -6.23363304 EXIT FROM BFGS code FG_LNSRCH 0. 0.00384000177 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.528389513 *** contribution from regularisation: 0.00309557444 *** contribution from error: -0.531485081 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48294.2718 0.00384000177 -6.22680187 EXIT FROM BFGS code FG_LNSRCH 0. 0.00383998407 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 42.3875732 sigma out 15 active outputs RANK 2 NODE 10 --> 32.4366493 sigma out 15 active outputs RANK 3 NODE 8 --> 24.0938282 sigma out 15 active outputs RANK 4 NODE 1 --> 21.1322861 sigma out 15 active outputs RANK 5 NODE 3 --> 19.4600468 sigma out 15 active outputs RANK 6 NODE 7 --> 13.241107 sigma out 15 active outputs RANK 7 NODE 6 --> 12.8851395 sigma out 15 active outputs RANK 8 NODE 11 --> 9.77340317 sigma out 15 active outputs RANK 9 NODE 5 --> 8.71508312 sigma out 15 active outputs RANK 10 NODE 9 --> 8.62348652 sigma out 15 active outputs RANK 11 NODE 4 --> 7.03653479 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 41.4622307 sigma in 11act. ( 39.4843826 sig out 1act.) RANK 2 NODE 15 --> 41.1812096 sigma in 11act. ( 39.1658287 sig out 1act.) RANK 3 NODE 9 --> 19.5002022 sigma in 11act. ( 20.7380657 sig out 1act.) RANK 4 NODE 2 --> 18.8113079 sigma in 11act. ( 21.566267 sig out 1act.) RANK 5 NODE 4 --> 10.6694374 sigma in 11act. ( 10.3630981 sig out 1act.) RANK 6 NODE 8 --> 10.1509714 sigma in 11act. ( 9.21211147 sig out 1act.) RANK 7 NODE 6 --> 9.51983547 sigma in 11act. ( 8.71270084 sig out 1act.) RANK 8 NODE 14 --> 9.10007954 sigma in 11act. ( 7.72099447 sig out 1act.) RANK 9 NODE 1 --> 8.92170525 sigma in 11act. ( 6.52259731 sig out 1act.) RANK 10 NODE 11 --> 8.61823177 sigma in 11act. ( 7.24615812 sig out 1act.) RANK 11 NODE 3 --> 7.62815189 sigma in 11act. ( 6.22974396 sig out 1act.) RANK 12 NODE 7 --> 6.6443367 sigma in 11act. ( 6.07008553 sig out 1act.) RANK 13 NODE 10 --> 5.83192396 sigma in 11act. ( 5.48104954 sig out 1act.) RANK 14 NODE 12 --> 5.6395359 sigma in 11act. ( 4.14652061 sig out 1act.) RANK 15 NODE 5 --> 5.46379757 sigma in 11act. ( 3.86276579 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 39.4843826 sigma out 1act.( 41.4622307 sig in 11act.) RANK 2 NODE 15 --> 39.1658287 sigma out 1act.( 41.1812096 sig in 11act.) RANK 3 NODE 2 --> 21.566267 sigma out 1act.( 18.8113079 sig in 11act.) RANK 4 NODE 9 --> 20.7380657 sigma out 1act.( 19.5002022 sig in 11act.) RANK 5 NODE 4 --> 10.3630981 sigma out 1act.( 10.6694374 sig in 11act.) RANK 6 NODE 8 --> 9.21211147 sigma out 1act.( 10.1509714 sig in 11act.) RANK 7 NODE 6 --> 8.71270084 sigma out 1act.( 9.51983547 sig in 11act.) RANK 8 NODE 14 --> 7.72099447 sigma out 1act.( 9.10007954 sig in 11act.) RANK 9 NODE 11 --> 7.24615812 sigma out 1act.( 8.61823177 sig in 11act.) RANK 10 NODE 1 --> 6.52259731 sigma out 1act.( 8.92170525 sig in 11act.) RANK 11 NODE 3 --> 6.22974396 sigma out 1act.( 7.62815189 sig in 11act.) RANK 12 NODE 7 --> 6.07008553 sigma out 1act.( 6.6443367 sig in 11act.) RANK 13 NODE 10 --> 5.48104954 sigma out 1act.( 5.83192396 sig in 11act.) RANK 14 NODE 12 --> 4.14652061 sigma out 1act.( 5.6395359 sig in 11act.) RANK 15 NODE 5 --> 3.86276579 sigma out 1act.( 5.46379757 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 67.4447556 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.528386295 *** contribution from regularisation: 0.00309875631 *** contribution from error: -0.531485081 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48293.9809 0.00383998407 -6.26032734 EXIT FROM BFGS code FG_LNSRCH 0. 0.00383998407 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.528391838 *** contribution from regularisation: 0.00309321773 *** contribution from error: -0.531485081 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48294.4871 0.00383998407 -6.29038286 EXIT FROM BFGS code FG_LNSRCH 0. 0.00383998407 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.528389812 *** contribution from regularisation: 0.00309527363 *** contribution from error: -0.531485081 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48294.2992 0.00383998407 -6.31824636 EXIT FROM BFGS code NEW_X -48294.2992 0.00383998407 -6.31824636 ENTER BFGS code NEW_X -48294.2992 0.00383998407 -6.31824636 EXIT FROM BFGS code CONVERGENC -48294.2992 0.00383998407 -6.31824636 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 66.1106873 sigma out 15 active outputs RANK 2 NODE 10 --> 52.2761536 sigma out 15 active outputs RANK 3 NODE 8 --> 37.1691971 sigma out 15 active outputs RANK 4 NODE 1 --> 32.8807335 sigma out 15 active outputs RANK 5 NODE 3 --> 29.7392464 sigma out 15 active outputs RANK 6 NODE 7 --> 20.2764893 sigma out 15 active outputs RANK 7 NODE 6 --> 20.1709061 sigma out 15 active outputs RANK 8 NODE 11 --> 15.2187319 sigma out 15 active outputs RANK 9 NODE 5 --> 13.471571 sigma out 15 active outputs RANK 10 NODE 9 --> 12.9957333 sigma out 15 active outputs RANK 11 NODE 4 --> 11.2456093 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 65.4040146 sigma in 11act. ( 65.1716766 sig out 1act.) RANK 2 NODE 15 --> 65.1064072 sigma in 11act. ( 64.3941269 sig out 1act.) RANK 3 NODE 9 --> 30.7127838 sigma in 11act. ( 34.1448669 sig out 1act.) RANK 4 NODE 2 --> 29.6747723 sigma in 11act. ( 34.8052406 sig out 1act.) RANK 5 NODE 4 --> 16.1282253 sigma in 11act. ( 16.9464035 sig out 1act.) RANK 6 NODE 8 --> 15.3911657 sigma in 11act. ( 14.8733473 sig out 1act.) RANK 7 NODE 6 --> 14.3655806 sigma in 11act. ( 14.0737553 sig out 1act.) RANK 8 NODE 14 --> 14.0438366 sigma in 11act. ( 12.476222 sig out 1act.) RANK 9 NODE 11 --> 12.7943449 sigma in 11act. ( 11.7079163 sig out 1act.) RANK 10 NODE 1 --> 12.7467575 sigma in 11act. ( 10.4890575 sig out 1act.) RANK 11 NODE 3 --> 10.8168259 sigma in 11act. ( 9.93642235 sig out 1act.) RANK 12 NODE 7 --> 9.94533443 sigma in 11act. ( 9.99355984 sig out 1act.) RANK 13 NODE 10 --> 8.63909245 sigma in 11act. ( 8.90603352 sig out 1act.) RANK 14 NODE 12 --> 8.24986649 sigma in 11act. ( 6.74385691 sig out 1act.) RANK 15 NODE 5 --> 7.15502596 sigma in 11act. ( 6.24019432 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 65.1716766 sigma out 1act.( 65.4040146 sig in 11act.) RANK 2 NODE 15 --> 64.3941269 sigma out 1act.( 65.1064072 sig in 11act.) RANK 3 NODE 2 --> 34.8052406 sigma out 1act.( 29.6747723 sig in 11act.) RANK 4 NODE 9 --> 34.1448669 sigma out 1act.( 30.7127838 sig in 11act.) RANK 5 NODE 4 --> 16.9464035 sigma out 1act.( 16.1282253 sig in 11act.) RANK 6 NODE 8 --> 14.8733473 sigma out 1act.( 15.3911657 sig in 11act.) RANK 7 NODE 6 --> 14.0737553 sigma out 1act.( 14.3655806 sig in 11act.) RANK 8 NODE 14 --> 12.476222 sigma out 1act.( 14.0438366 sig in 11act.) RANK 9 NODE 11 --> 11.7079163 sigma out 1act.( 12.7943449 sig in 11act.) RANK 10 NODE 1 --> 10.4890575 sigma out 1act.( 12.7467575 sig in 11act.) RANK 11 NODE 7 --> 9.99355984 sigma out 1act.( 9.94533443 sig in 11act.) RANK 12 NODE 3 --> 9.93642235 sigma out 1act.( 10.8168259 sig in 11act.) RANK 13 NODE 10 --> 8.90603352 sigma out 1act.( 8.63909245 sig in 11act.) RANK 14 NODE 12 --> 6.74385691 sigma out 1act.( 8.24986649 sig in 11act.) RANK 15 NODE 5 --> 6.24019432 sigma out 1act.( 7.15502596 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 110.647133 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.528370738 *** contribution from regularisation: 0.0031143229 *** contribution from error: -0.531485081 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27567 Closing output file done