NNInput NNInputs_145.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 45694 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 9491 nbkg = 36203 Bkg Entries: 36203 Sig Entries: 9491 Chosen entries: 9491 Signal fraction: 1 Background fraction: 0.262161 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 36203 Actual Signal Entries: 9491 Entries to split: 9491 Test with : 4745 Train with : 4745 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 9491 for Signal Prepared event 0 for Signal with 9491 events ====Entry 0 Variable Ht : 283.618 Variable LepAPt : 42.2926 Variable LepBPt : 21.3849 Variable MetSigLeptonsJets : 8.1027 Variable MetSpec : 107.523 Variable SumEtLeptonsJets : 176.094 Variable VSumJetLeptonsPt : 97.0209 Variable addEt : 171.201 Variable dPhiLepSumMet : 1.6156 Variable dPhiLeptons : 0.0774474 Variable dRLeptons : 0.454636 Variable lep1_E : 43.1272 Variable lep2_E : 22.0548 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2145 Ht = 283.618 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 42.2926 LepAPt = 42.2926 LepBEt = 21.3849 LepBPt = 21.3849 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 107.523 MetDelPhi = 1.5896 MetSig = 7.12778 MetSigLeptonsJets = 8.1027 MetSpec = 107.523 Mjj = 0 MostCentralJetEta = -1.9773 MtllMet = 172.678 Njets = 1 SB = 0 SumEt = 227.56 SumEtJets = 0 SumEtLeptonsJets = 176.094 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 97.0209 addEt = 171.201 dPhiLepSumMet = 1.6156 dPhiLeptons = 0.0774474 dRLeptons = 0.454635 diltype = 45 dimass = 13.7838 event = 835 jet1_Et = 112.417 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 43.1272 lep2_E = 22.0548 rand = 0.999742 run = 236580 weight = 3.16653e-06 ===Show End Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 36203 for Background Prepared event 0 for Background with 36203 events ====Entry 0 Variable Ht : 80.3296 Variable LepAPt : 25.5911 Variable LepBPt : 11.162 Variable MetSigLeptonsJets : 7.18795 Variable MetSpec : 43.5765 Variable SumEtLeptonsJets : 36.7531 Variable VSumJetLeptonsPt : 34.1227 Variable addEt : 80.3296 Variable dPhiLepSumMet : 2.89659 Variable dPhiLeptons : 0.831637 Variable dRLeptons : 0.924544 Variable lep1_E : 25.6567 Variable lep2_E : 12.448 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 80.3296 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 25.5911 LepAPt = 25.5911 LepBEt = 11.162 LepBPt = 11.162 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 43.5765 MetDelPhi = 2.65242 MetSig = 3.63746 MetSigLeptonsJets = 7.18795 MetSpec = 43.5765 Mjj = 0 MostCentralJetEta = 0 MtllMet = 81.3504 Njets = 0 SB = 0 SumEt = 143.519 SumEtJets = 0 SumEtLeptonsJets = 36.7531 Target = 0 TrainWeight = 0.314226 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 34.1227 addEt = 80.3296 dPhiLepSumMet = 2.89659 dPhiLeptons = 0.831637 dRLeptons = 0.924544 diltype = 45 dimass = 15.2865 event = 23115824 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 25.6567 lep2_E = 12.448 rand = 0.999742 run = 271104 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 36203 events Prepared event 20000 for Background with 36203 events Prepared event 30000 for Background with 36203 events Warning: found 878 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 45694 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 878 negative weights. Signal fraction: 62.1615906 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 55.3054924 62.0773163 64.4348755 66.065506 67.4481506 68.4245148 69.4457855 70.3053589 71.0691376 71.7523956 72.3798904 73.0595703 73.8126755 74.2575073 74.7612152 75.2609711 75.7583618 76.3960648 77.007019 77.5040207 78.0088501 78.4779282 79.0038147 79.5046539 80.045845 80.6337433 81.0270309 81.552475 82.1927414 82.7814484 83.3697357 84.3150635 85.1574097 86.0169983 86.9755096 88.4249268 89.6158905 90.8078537 92.3227081 93.7269592 95.1411743 96.3124847 97.5743256 99.1772461 100.591156 101.869797 103.715607 105.055115 106.263474 107.403717 109.101059 110.534393 111.880547 113.417221 114.800362 116.553894 118.078735 119.404648 120.928986 122.09198 123.510376 124.717178 125.942184 127.360687 128.85434 130.049164 131.420654 132.650391 133.836273 135.245697 136.681549 138.284485 139.57579 141.246704 142.845093 144.384262 145.689774 147.405518 149.384979 151.358063 153.610046 155.971436 158.863831 161.037048 163.946243 166.570282 169.013672 172.35434 176.179321 179.531464 183.536469 188.899307 192.99115 198.635895 205.038895 212.818985 222.218689 236.375427 254.044617 286.204956 635.513123 ------------------------------ Transdef: Tab for variable 3 20.0012817 20.2567139 20.5263309 20.8075562 21.0662861 21.278923 21.4787159 21.6945839 21.8615665 22.020628 22.1898117 22.3722858 22.6093845 22.8020077 23.0017471 23.2173138 23.3779964 23.5701637 23.7203484 23.8739319 24.063179 24.2380676 24.4247322 24.5993919 24.7725983 24.9311523 25.1067543 25.2879868 25.4582291 25.6269932 25.7748833 25.9701176 26.1590691 26.3031349 26.47892 26.7209988 26.8961906 27.0613098 27.2728271 27.458046 27.7075462 27.8721695 28.0553665 28.2345963 28.418623 28.6165695 28.8492393 29.1133003 29.3050385 29.5873909 29.7710915 30.0511589 30.2990341 30.5751228 30.8458157 31.0843601 31.4116745 31.6504555 31.885067 32.1775246 32.429512 32.7205582 33.0150909 33.3344193 33.6311951 33.9275055 34.2468185 34.5290565 34.8253555 35.1209564 35.4445801 35.7321243 36.091568 36.4647064 36.8194466 37.2328796 37.6165237 38.015892 38.3740158 38.8541908 39.3190613 39.7891617 40.3000565 40.8066101 41.363327 41.9042511 42.5756607 43.2031174 43.8440323 44.6720352 45.4730606 46.3261604 47.2910843 48.4798279 49.6977615 51.4313316 53.3832283 55.7998276 59.5307693 66.97229 159.211807 ------------------------------ Transdef: Tab for variable 4 10.0008726 10.09655 10.194128 10.2967224 10.3937168 10.4872093 10.606781 10.7534981 10.8724318 10.9596348 11.0464392 11.1656857 11.3019934 11.3787079 11.4873123 11.6066761 11.755332 11.8464823 11.9919672 12.0966721 12.2508011 12.3972406 12.5155201 12.6864929 12.8327847 12.9526062 13.0902519 13.2368574 13.3832741 13.5056705 13.631278 13.824091 13.9362526 14.0974064 14.2435608 14.3527813 14.4786797 14.6138496 14.812232 14.980423 15.1324863 15.2676172 15.4177437 15.5750513 15.7367458 15.9037552 16.0709724 16.3092594 16.475359 16.6655273 16.869194 17.1115303 17.3189964 17.4725227 17.6734238 17.9001598 18.109951 18.3151245 18.474884 18.706356 18.9223385 19.146965 19.3536282 19.550415 19.7831192 20.0055389 20.2526932 20.4810486 20.7960091 21.0820274 21.3755169 21.5999756 21.8457756 22.1568489 22.4272861 22.6956997 22.9514256 23.3391399 23.7773933 24.174284 24.5567245 24.9349346 25.3504257 25.7461624 26.1183186 26.4436455 26.8949318 27.3152733 27.7794876 28.2913322 28.8292732 29.4947929 30.0222893 30.6235981 31.3527908 32.0374985 33.0414124 34.6144333 36.7346344 40.5037079 66.5097427 ------------------------------ Transdef: Tab for variable 5 1.79273057 2.93949223 3.27892876 3.5405972 3.78186798 3.97352862 4.11422443 4.22664452 4.33913803 4.42032051 4.50264645 4.60337782 4.69517517 4.77525473 4.85487318 4.92252779 4.98645163 5.05776691 5.11586237 5.17067242 5.23010921 5.28895187 5.35147572 5.41287422 5.44963884 5.49194908 5.54222775 5.58319092 5.62016487 5.66607857 5.70645714 5.74980164 5.799788 5.84353161 5.88370705 5.91737747 5.95235443 5.99223709 6.03386879 6.06894207 6.1089077 6.14366102 6.18622112 6.23689461 6.27342701 6.30524063 6.34370184 6.37864113 6.42269325 6.4547925 6.5003047 6.5344162 6.58089924 6.60907269 6.66126728 6.70375776 6.7485342 6.79644823 6.83266735 6.86748505 6.91231823 6.96637392 7.00285912 7.04564476 7.11302185 7.16414928 7.22090435 7.27592468 7.31889915 7.37246132 7.42903519 7.47575188 7.53287458 7.58838511 7.64051723 7.6941185 7.76059723 7.81328869 7.88157558 7.95280313 8.01848984 8.07279205 8.13920784 8.20078087 8.2819252 8.36190414 8.42504501 8.51992607 8.61380863 8.71041489 8.79238892 8.88445282 8.99235058 9.11307335 9.23368168 9.39878654 9.61142826 9.94758224 10.350028 11.074728 17.7251911 ------------------------------ Transdef: Tab for variable 6 25.000145 25.7944603 26.5279999 27.2597923 28.0204124 28.6783733 29.4648285 30.080225 30.697773 31.2312012 31.7577171 32.2181396 32.7312012 33.0824509 33.468235 33.9268761 34.2876053 34.638588 34.9587097 35.3344612 35.6941605 36.0884018 36.3970566 36.6905518 36.9676437 37.2440948 37.5302353 37.9564896 38.2189941 38.5683899 38.9315376 39.2683563 39.4685593 39.8047256 40.1347656 40.4406128 40.7789917 41.1495667 41.4666901 41.7700043 42.0688591 42.4216919 42.7746429 43.1467819 43.5161972 43.9780579 44.3827171 44.8311234 45.343895 45.9002304 46.5258789 47.0770798 47.84478 48.3896179 49.0378723 49.7528763 50.4363251 51.0934372 51.5495529 52.3605576 53.0987663 53.772377 54.5167007 55.2543869 55.9987106 56.6212997 57.209671 57.8348007 58.4475937 59.0789337 59.7281113 60.4180145 61.0039482 61.7758522 62.4962692 63.1576996 63.8871002 64.6477966 65.3793945 66.2108612 66.9338989 67.651123 68.4456711 69.2737274 70.1530914 71.0565338 72.0842361 73.0325775 74.0589142 75.1878204 76.6956711 78.240097 79.963356 81.5781326 83.776329 86.9604645 90.4330139 94.6267242 100.645615 112.349358 259.076752 ------------------------------ Transdef: Tab for variable 7 30.1907654 32.6684799 33.4963989 34.1725311 34.7340164 35.2764816 35.6588364 36.0970688 36.4295425 36.8144608 37.0689545 37.3667068 37.6057053 37.8835144 38.1632309 38.3198509 38.5846634 38.8029823 39.0239029 39.2801208 39.4500732 39.6467361 39.9622307 40.2747383 40.5761948 40.8770981 41.1533966 41.4449997 41.7550049 42.0880356 42.4336662 42.851181 43.3519821 43.9024582 44.404129 44.9290009 45.3898277 46.0389061 46.9286423 47.6602936 48.5021172 49.337883 50.2200928 51.0594368 52.0481873 53.0494843 53.7448578 54.6936798 55.6349335 56.3316498 56.9985504 57.7381516 58.5378494 59.4323807 60.2260551 60.9295578 61.6150856 62.2848053 63.0127106 63.6434402 64.5847321 65.361351 66.2570877 67.1644135 68.0671692 69.0398254 69.9965973 70.9973602 71.8658142 72.9288559 74.1257706 75.2995377 76.7025452 78.0719604 79.5578766 81.0673676 82.5751648 83.96978 85.3665619 86.9777222 88.6095276 91.0694351 92.9435959 94.9093094 97.1091766 99.4728241 101.673706 104.165634 107.386833 110.418434 113.844299 117.163834 120.764473 125.833466 130.441177 137.891571 146.453873 157.088989 171.943634 200.586288 493.953003 ------------------------------ Transdef: Tab for variable 8 3.53889132 26.0864868 29.7063637 31.2694664 31.950613 32.6481781 33.3160973 33.7362671 34.048851 34.5382423 34.8598328 35.1699944 35.4435387 35.8160858 36.0859756 36.3711395 36.5566063 36.7882652 37.0701485 37.3304634 37.530468 37.7209625 37.9132729 38.1087036 38.2648354 38.4995689 38.7123375 38.9011154 39.1285553 39.3164062 39.5861893 39.8743439 40.0968094 40.3435516 40.6576233 40.8627129 41.1901703 41.4519653 41.79282 42.1159821 42.5175095 42.9111862 43.246006 43.5507736 43.8721046 44.2931671 44.7161293 45.3214149 45.8101654 46.332737 46.9208336 47.387207 47.9691162 48.5532532 49.1097832 49.7471085 50.3333435 50.9427109 51.5332642 52.1418228 52.6217575 53.2354431 53.9005737 54.5735283 55.230545 55.8081131 56.4096031 57.1050644 57.7262878 58.4163284 59.03479 59.7478981 60.2521286 60.8876762 61.4079247 62.0015106 62.6097336 63.299778 64.0304718 64.6153717 65.3820953 66.1879349 67.0518036 67.8817444 68.7514191 69.5961227 70.5382767 71.5000153 72.5892944 73.8077545 75.2663574 76.6023407 78.2896423 80.292511 82.5472336 85.8473969 89.6810989 94.8620911 102.52446 114.903229 251.591461 ------------------------------ Transdef: Tab for variable 9 55.3054924 61.8946152 64.1656265 65.6837463 67.0654755 67.9272919 68.8859711 69.7976913 70.5227203 71.1985474 71.7527847 72.3112793 72.8994904 73.4051208 73.9641418 74.3829956 74.839798 75.2947235 75.7346725 76.2441025 76.8045197 77.3011322 77.7736816 78.1208115 78.5491486 79.1080704 79.5113983 79.9821014 80.4873962 80.8754044 81.2952423 81.8038483 82.2739716 82.757309 83.2930908 83.8824539 84.6315308 85.2322617 85.9942322 86.6122513 87.5789108 88.5766296 89.4736938 90.53685 91.66436 92.7509613 93.9170685 94.9409332 95.9003143 96.9594116 97.9978027 99.2097626 100.490189 101.458176 102.657455 104.006699 105.088043 106.163124 107.203033 108.55983 109.544838 110.590942 111.751144 112.680969 113.970322 115.04248 116.131294 117.313492 118.334221 119.580002 120.82299 121.805771 122.894615 123.927109 124.967941 125.982285 127.062477 128.026138 129.174927 130.133942 131.161606 132.282074 133.066345 134.22644 135.287048 136.374146 137.699982 138.921631 140.029816 141.349762 142.639313 144.231384 145.663818 147.487457 149.377045 151.769257 154.567871 158.236847 164.366776 182.435822 346.688507 ------------------------------ Transdef: Tab for variable 10 0.0879002884 1.07562637 1.4036957 1.60069227 1.75850415 1.85847139 1.9407115 2.04959989 2.11742282 2.18380332 2.23032975 2.28514862 2.32515121 2.37025976 2.41641665 2.4544611 2.48740482 2.52050662 2.54841828 2.57670069 2.59967518 2.61710358 2.64096308 2.66194916 2.68411851 2.70804524 2.73089886 2.74986839 2.76720619 2.78291988 2.7990675 2.8150425 2.8279922 2.83851027 2.84900475 2.86077857 2.86743808 2.87890649 2.88913202 2.89857459 2.90763283 2.91601944 2.92269897 2.93060231 2.93784857 2.94467616 2.94990015 2.9569912 2.96472836 2.97063947 2.97713065 2.98335648 2.98827314 2.99294806 2.99864197 3.00353098 3.00811052 3.01280832 3.01839852 3.02233553 3.02584767 3.02944374 3.03324413 3.03665257 3.04037952 3.04366732 3.04675364 3.05050993 3.05457401 3.05892563 3.06166863 3.06533289 3.06834316 3.07196259 3.07448769 3.07685709 3.07927132 3.08238554 3.08484459 3.08749318 3.09051371 3.0937295 3.09642649 3.09969163 3.10207367 3.10425162 3.10709524 3.10999727 3.11265588 3.11569881 3.11767912 3.11960053 3.12222815 3.12525439 3.1275239 3.12996984 3.1325202 3.13517714 3.13741136 3.13914633 3.14156938 ------------------------------ Transdef: Tab for variable 11 1.91926956E-05 0.00690746307 0.0122420788 0.0203728154 0.027374506 0.0340890288 0.0408688746 0.0492107868 0.0574784204 0.0647087693 0.0728853941 0.0796229243 0.0879031718 0.0945483446 0.101340711 0.109451294 0.115392655 0.123151682 0.130383939 0.139704227 0.148644298 0.155380607 0.161659718 0.168917477 0.175251603 0.181421548 0.189599752 0.196494579 0.201588869 0.206258714 0.210217759 0.216486812 0.222634077 0.226691842 0.231196046 0.235285342 0.240355492 0.246712387 0.252723962 0.257313073 0.262040615 0.267503977 0.273213863 0.279741764 0.28485623 0.291565537 0.297955036 0.302827954 0.308329791 0.314304769 0.320600271 0.32602334 0.33302927 0.339244694 0.345331013 0.351040483 0.357481837 0.362868309 0.368324816 0.374091029 0.380833954 0.386848897 0.392048717 0.398969024 0.40495944 0.409249842 0.415008783 0.421439648 0.428383887 0.434906125 0.44145143 0.447717547 0.45314914 0.460312188 0.46706152 0.474989295 0.480300069 0.487918377 0.496482134 0.503751278 0.511673331 0.519051433 0.527936578 0.538050294 0.548139215 0.557425618 0.568627 0.579036951 0.59103775 0.602281868 0.614522576 0.630614877 0.64966929 0.668991208 0.682985663 0.705168962 0.728671789 0.754449606 0.791382194 0.85065937 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.200196758 0.211222902 0.220594212 0.229335368 0.237005085 0.244908541 0.255145997 0.260617763 0.266424567 0.273284703 0.280284584 0.286536098 0.29371953 0.30088219 0.306701511 0.315443188 0.322223932 0.328977674 0.336226672 0.343075275 0.348983109 0.354777455 0.361318856 0.367944479 0.374620497 0.380087674 0.386034429 0.391477108 0.396196604 0.40104416 0.405502111 0.410262704 0.414336562 0.418095887 0.422545493 0.426463276 0.431001842 0.43489629 0.438792944 0.442636222 0.446729153 0.450785398 0.454429418 0.458355963 0.462157726 0.466290772 0.470708311 0.475311399 0.480012417 0.483880371 0.487125158 0.491508782 0.495001256 0.498303235 0.502651751 0.50679785 0.510754883 0.514685512 0.518580079 0.523613155 0.528090179 0.533166289 0.538519621 0.543078899 0.548398674 0.55312717 0.558425188 0.564739585 0.569764733 0.575214624 0.579674006 0.585564017 0.590806484 0.59761703 0.603907108 0.610216022 0.615821481 0.622641087 0.630000651 0.63784343 0.646492779 0.65593493 0.661057174 0.668121934 0.677348375 0.684868038 0.694742739 0.70094192 0.713153005 0.723702788 0.734294593 0.744325399 0.754628301 0.769235015 0.783764362 0.801763237 0.821636498 0.843676209 0.869897246 0.911080837 1.14129901 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.4643421 22.184494 22.8693237 23.4612179 23.9329033 24.5505867 25.0799999 25.4214363 25.8677158 26.2607594 26.7239723 27.1181831 27.5397243 27.9910011 28.3890114 28.661869 29.0291939 29.2598858 29.5271835 29.9149933 30.2254753 30.5705376 30.8858376 31.2095089 31.5786171 31.8878708 32.2618256 32.5521545 32.9410439 33.2688904 33.6499252 33.9930191 34.366703 34.741539 35.0556412 35.4544373 35.8338661 36.2039566 36.4957123 36.8892326 37.2274933 37.6004677 38.0069885 38.4045753 38.8075943 39.2780762 39.6655273 40.1490173 40.5244598 40.9120026 41.3933487 41.7800102 42.2815247 42.7220306 43.1422768 43.4678917 43.9575653 44.5388489 45.0048866 45.4600868 45.9950333 46.5473022 47.0710602 47.5134125 48.030777 48.6215134 49.1033173 49.658844 50.2433853 50.8759537 51.5211067 52.2238426 52.9297028 53.7727814 54.4748459 55.2992859 56.155014 56.9010468 57.78125 58.733963 59.7248268 61.0071335 62.199749 63.6119041 65.1301346 66.5998688 67.9773941 69.7483978 71.6630783 73.768959 75.7390442 77.9032745 80.7290421 83.4144821 86.3261414 89.3912048 93.6442566 100.625374 111.469131 216.87648 ------------------------------ Transdef: Tab for variable 14 10.041399 10.6526966 11.1476974 11.4329987 11.7560015 12.1266289 12.4091511 12.70436 12.9812241 13.3185558 13.5356388 13.8424177 14.0564117 14.3158092 14.5985088 14.90275 15.1425476 15.3688087 15.6022015 15.838418 16.1063423 16.3358231 16.635498 16.8737774 17.1038971 17.3985901 17.6557961 17.9547043 18.1835785 18.476202 18.7754784 19.0207253 19.2043114 19.4625511 19.7501698 20.0557327 20.3359642 20.5970116 20.8615608 21.1433277 21.4709892 21.7402496 22.0160408 22.3498135 22.6637764 22.8968163 23.1736469 23.4966965 23.7564335 24.0470772 24.3634949 24.6676483 24.9727478 25.2972794 25.6267395 25.8642235 26.1600857 26.4098301 26.7085609 27.0231781 27.3736534 27.7084389 27.9888191 28.251606 28.5877647 28.9341087 29.3239632 29.7419682 30.0786858 30.4750977 30.8929024 31.2463226 31.6277428 32.0594482 32.5532341 33.0540695 33.5898819 34.023098 34.4309578 35.0063477 35.5523262 36.1187897 36.8694916 37.4382019 37.9823227 38.7597656 39.5019913 40.3677826 41.1553383 42.0934143 43.0899963 44.2949524 45.3860016 47.1416931 48.8760223 51.0957947 53.6428452 56.4992447 61.5967979 69.4913635 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.5 47.4 49.3 30.6 53.8 62.1 56.0 64.7 -28.8 -11.1 -21.1 4.6 11.0 2 65.5 100.0 63.4 56.1 33.1 72.4 94.3 74.3 91.9 -47.5 -19.0 -34.5 20.6 20.0 3 47.4 63.4 100.0 36.0 7.1 36.1 67.0 53.3 69.5 -17.3 -19.2 -37.9 53.3 10.8 4 49.3 56.1 36.0 100.0 15.5 37.9 56.6 48.8 62.8 -13.3 -23.3 -46.5 7.8 60.0 5 30.6 33.1 7.1 15.5 100.0 82.3 5.9 52.9 55.2 23.8 -5.6 -6.8 -8.4 0.9 6 53.8 72.4 36.1 37.9 82.3 100.0 51.5 77.2 82.8 -9.8 -13.0 -22.0 4.5 10.6 7 62.1 94.3 67.0 56.6 5.9 51.5 100.0 67.7 80.5 -55.0 -17.1 -33.7 26.0 22.7 8 56.0 74.3 53.3 48.8 52.9 77.2 67.7 100.0 82.0 -13.8 -19.0 -31.2 17.7 19.2 9 64.7 91.9 69.5 62.8 55.2 82.8 80.5 82.0 100.0 -23.7 -21.7 -40.3 24.7 25.4 10 -28.8 -47.5 -17.3 -13.3 23.8 -9.8 -55.0 -13.8 -23.7 100.0 3.0 6.2 -2.6 -1.3 11 -11.1 -19.0 -19.2 -23.3 -5.6 -13.0 -17.1 -19.0 -21.7 3.0 100.0 54.5 4.3 -2.5 12 -21.1 -34.5 -37.9 -46.5 -6.8 -22.0 -33.7 -31.2 -40.3 6.2 54.5 100.0 -2.8 -12.0 13 4.6 20.6 53.3 7.8 -8.4 4.5 26.0 17.7 24.7 -2.6 4.3 -2.8 100.0 49.9 14 11.0 20.0 10.8 60.0 0.9 10.6 22.7 19.2 25.4 -1.3 -2.5 -12.0 49.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 159.747299 TOTAL CORRELATION OF ALL VARIABLES 73.0381647 ROUND 1: MAX CORR ( 73.0343674) AFTER KILLING INPUT VARIABLE 11 CONTR 0.744771001 ROUND 2: MAX CORR ( 73.0109396) AFTER KILLING INPUT VARIABLE 8 CONTR 1.84973494 ROUND 3: MAX CORR ( 72.9602995) AFTER KILLING INPUT VARIABLE 2 CONTR 2.7188231 ROUND 4: MAX CORR ( 72.8633197) AFTER KILLING INPUT VARIABLE 6 CONTR 3.76057871 ROUND 5: MAX CORR ( 72.6618092) AFTER KILLING INPUT VARIABLE 13 CONTR 5.41524065 ROUND 6: MAX CORR ( 72.1825436) AFTER KILLING INPUT VARIABLE 10 CONTR 8.33180222 ROUND 7: MAX CORR ( 71.5979835) AFTER KILLING INPUT VARIABLE 9 CONTR 9.16778899 ROUND 8: MAX CORR ( 71.024333) AFTER KILLING INPUT VARIABLE 3 CONTR 9.04518454 ROUND 9: MAX CORR ( 70.3937882) AFTER KILLING INPUT VARIABLE 12 CONTR 9.44301143 ROUND 10: MAX CORR ( 69.0358988) AFTER KILLING INPUT VARIABLE 14 CONTR 13.7597269 ROUND 11: MAX CORR ( 67.7315116) AFTER KILLING INPUT VARIABLE 4 CONTR 13.3565591 ROUND 12: MAX CORR ( 62.1222815) AFTER KILLING INPUT VARIABLE 5 CONTR 26.9885123 LAST REMAINING VARIABLE: 7 total correlation to target: 73.0381647 % total significance: 63.900025 sigma correlations of single variables to target: variable 2: 65.5339237 % , in sigma: 57.334674 variable 3: 47.3934337 % , in sigma: 41.4638239 variable 4: 49.3342203 % , in sigma: 43.1617898 variable 5: 30.5846819 % , in sigma: 26.7580921 variable 6: 53.7543186 % , in sigma: 47.0288693 variable 7: 62.1222815 % , in sigma: 54.349878 variable 8: 55.9534803 % , in sigma: 48.9528838 variable 9: 64.736389 % , in sigma: 56.6369225 variable 10: -28.7854541 % , in sigma: 25.1839739 variable 11: -11.1423865 % , in sigma: 9.74831141 variable 12: -21.0791634 % , in sigma: 18.4418526 variable 13: 4.62330123 % , in sigma: 4.04485881 variable 14: 10.969086 % , in sigma: 9.59669334 variables sorted by significance: 1 most relevant variable 7 corr 62.1222801 , in sigma: 54.3498768 2 most relevant variable 5 corr 26.988512 , in sigma: 23.6118555 3 most relevant variable 4 corr 13.3565588 , in sigma: 11.6854585 4 most relevant variable 14 corr 13.7597265 , in sigma: 12.038184 5 most relevant variable 12 corr 9.44301128 , in sigma: 8.26155284 6 most relevant variable 3 corr 9.04518414 , in sigma: 7.91349967 7 most relevant variable 9 corr 9.16778946 , in sigma: 8.02076528 8 most relevant variable 10 corr 8.33180237 , in sigma: 7.28937237 9 most relevant variable 13 corr 5.41524076 , in sigma: 4.73771516 10 most relevant variable 6 corr 3.76057863 , in sigma: 3.29007539 11 most relevant variable 2 corr 2.71882319 , in sigma: 2.37865876 12 most relevant variable 8 corr 1.8497349 , in sigma: 1.61830609 13 most relevant variable 11 corr 0.744771004 , in sigma: 0.651589288 global correlations between input variables: variable 2: 99.1866957 % variable 3: 92.0990045 % variable 4: 90.3501035 % variable 5: 95.4521324 % variable 6: 95.757494 % variable 7: 98.6829238 % variable 8: 88.5511274 % variable 9: 98.8478454 % variable 10: 71.5262059 % variable 11: 55.6402731 % variable 12: 68.7660856 % variable 13: 85.1889635 % variable 14: 86.8455074 % significance loss when removing single variables: variable 2: corr = 3.3016021 % , sigma = 2.88852352 variable 3: corr = 15.5885621 % , sigma = 13.6382056 variable 4: corr = 18.3864482 % , sigma = 16.0860354 variable 5: corr = 11.9602688 % , sigma = 10.4638647 variable 6: corr = 2.34048597 % , sigma = 2.04765704 variable 7: corr = 5.41135839 % , sigma = 4.73431852 variable 8: corr = 1.90507663 % , sigma = 1.66672376 variable 9: corr = 9.83110728 % , sigma = 8.60109237 variable 10: corr = 7.14819564 % , sigma = 6.2538521 variable 11: corr = 0.744771001 % , sigma = 0.651589286 variable 12: corr = 9.00117383 % , sigma = 7.87499569 variable 13: corr = 5.37549168 % , sigma = 4.70293926 variable 14: corr = 5.43108198 % , sigma = 4.7515744 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 8.51903057 sigma out 15 active outputs RANK 2 NODE 10 --> 7.43073463 sigma out 15 active outputs RANK 3 NODE 7 --> 7.20484161 sigma out 15 active outputs RANK 4 NODE 1 --> 6.86043167 sigma out 15 active outputs RANK 5 NODE 5 --> 6.69932842 sigma out 15 active outputs RANK 6 NODE 4 --> 6.03693485 sigma out 15 active outputs RANK 7 NODE 3 --> 5.91146183 sigma out 15 active outputs RANK 8 NODE 6 --> 5.73492575 sigma out 15 active outputs RANK 9 NODE 2 --> 5.30337572 sigma out 15 active outputs RANK 10 NODE 9 --> 3.6348424 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 10.5116234 sigma in 10act. ( 10.5569067 sig out 1act.) RANK 2 NODE 6 --> 7.37488508 sigma in 10act. ( 7.29019928 sig out 1act.) RANK 3 NODE 15 --> 7.21127987 sigma in 10act. ( 6.87934351 sig out 1act.) RANK 4 NODE 9 --> 6.32396507 sigma in 10act. ( 6.44263458 sig out 1act.) RANK 5 NODE 14 --> 5.75144529 sigma in 10act. ( 6.17991352 sig out 1act.) RANK 6 NODE 13 --> 5.34749079 sigma in 10act. ( 5.44265604 sig out 1act.) RANK 7 NODE 3 --> 5.32239962 sigma in 10act. ( 5.33020449 sig out 1act.) RANK 8 NODE 1 --> 3.8866322 sigma in 10act. ( 4.05925465 sig out 1act.) RANK 9 NODE 8 --> 3.44636321 sigma in 10act. ( 2.84600663 sig out 1act.) RANK 10 NODE 10 --> 3.3952117 sigma in 10act. ( 3.18087578 sig out 1act.) RANK 11 NODE 4 --> 3.3937676 sigma in 10act. ( 3.40838051 sig out 1act.) RANK 12 NODE 12 --> 3.01189685 sigma in 10act. ( 3.3935802 sig out 1act.) RANK 13 NODE 2 --> 2.49940991 sigma in 10act. ( 2.29328489 sig out 1act.) RANK 14 NODE 7 --> 1.72942293 sigma in 10act. ( 0.473001033 sig out 1act.) RANK 15 NODE 5 --> 1.42979002 sigma in 10act. ( 0.363150507 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 10.5569067 sigma out 1act.( 10.5116234 sig in 10act.) RANK 2 NODE 6 --> 7.29019928 sigma out 1act.( 7.37488508 sig in 10act.) RANK 3 NODE 15 --> 6.87934351 sigma out 1act.( 7.21127987 sig in 10act.) RANK 4 NODE 9 --> 6.44263458 sigma out 1act.( 6.32396507 sig in 10act.) RANK 5 NODE 14 --> 6.17991352 sigma out 1act.( 5.75144529 sig in 10act.) RANK 6 NODE 13 --> 5.44265604 sigma out 1act.( 5.34749079 sig in 10act.) RANK 7 NODE 3 --> 5.33020449 sigma out 1act.( 5.32239962 sig in 10act.) RANK 8 NODE 1 --> 4.05925465 sigma out 1act.( 3.8866322 sig in 10act.) RANK 9 NODE 4 --> 3.40838051 sigma out 1act.( 3.3937676 sig in 10act.) RANK 10 NODE 12 --> 3.3935802 sigma out 1act.( 3.01189685 sig in 10act.) RANK 11 NODE 10 --> 3.18087578 sigma out 1act.( 3.3952117 sig in 10act.) RANK 12 NODE 8 --> 2.84600663 sigma out 1act.( 3.44636321 sig in 10act.) RANK 13 NODE 2 --> 2.29328489 sigma out 1act.( 2.49940991 sig in 10act.) RANK 14 NODE 7 --> 0.473001033 sigma out 1act.( 1.72942293 sig in 10act.) RANK 15 NODE 5 --> 0.363150507 sigma out 1act.( 1.42979002 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 20.3247776 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 11.2482529 sigma out 15 active outputs RANK 2 NODE 8 --> 10.363966 sigma out 15 active outputs RANK 3 NODE 10 --> 9.67227554 sigma out 15 active outputs RANK 4 NODE 5 --> 9.25045681 sigma out 15 active outputs RANK 5 NODE 7 --> 9.04844093 sigma out 15 active outputs RANK 6 NODE 1 --> 8.93372822 sigma out 15 active outputs RANK 7 NODE 6 --> 8.74809074 sigma out 15 active outputs RANK 8 NODE 3 --> 7.83977175 sigma out 15 active outputs RANK 9 NODE 4 --> 7.42339802 sigma out 15 active outputs RANK 10 NODE 9 --> 5.41608715 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 11.3509054 sigma in 10act. ( 10.253747 sig out 1act.) RANK 2 NODE 12 --> 10.3089323 sigma in 10act. ( 5.06183577 sig out 1act.) RANK 3 NODE 6 --> 8.5654068 sigma in 10act. ( 6.9162612 sig out 1act.) RANK 4 NODE 15 --> 8.53534698 sigma in 10act. ( 6.64888191 sig out 1act.) RANK 5 NODE 3 --> 7.60589552 sigma in 10act. ( 4.90233946 sig out 1act.) RANK 6 NODE 9 --> 7.50313711 sigma in 10act. ( 6.91199207 sig out 1act.) RANK 7 NODE 14 --> 7.36174202 sigma in 10act. ( 6.42407656 sig out 1act.) RANK 8 NODE 13 --> 7.07125759 sigma in 10act. ( 6.11648846 sig out 1act.) RANK 9 NODE 4 --> 6.50506973 sigma in 10act. ( 4.40180922 sig out 1act.) RANK 10 NODE 10 --> 6.27434397 sigma in 10act. ( 3.15015531 sig out 1act.) RANK 11 NODE 2 --> 6.13704967 sigma in 10act. ( 2.49221826 sig out 1act.) RANK 12 NODE 1 --> 5.44237661 sigma in 10act. ( 3.70283103 sig out 1act.) RANK 13 NODE 7 --> 4.26587963 sigma in 10act. ( 0.0700149834 sig out 1act.) RANK 14 NODE 8 --> 4.0699482 sigma in 10act. ( 1.81143308 sig out 1act.) RANK 15 NODE 5 --> 3.71053839 sigma in 10act. ( 0.273243785 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 10.253747 sigma out 1act.( 11.3509054 sig in 10act.) RANK 2 NODE 6 --> 6.9162612 sigma out 1act.( 8.5654068 sig in 10act.) RANK 3 NODE 9 --> 6.91199207 sigma out 1act.( 7.50313711 sig in 10act.) RANK 4 NODE 15 --> 6.64888191 sigma out 1act.( 8.53534698 sig in 10act.) RANK 5 NODE 14 --> 6.42407656 sigma out 1act.( 7.36174202 sig in 10act.) RANK 6 NODE 13 --> 6.11648846 sigma out 1act.( 7.07125759 sig in 10act.) RANK 7 NODE 12 --> 5.06183577 sigma out 1act.( 10.3089323 sig in 10act.) RANK 8 NODE 3 --> 4.90233946 sigma out 1act.( 7.60589552 sig in 10act.) RANK 9 NODE 4 --> 4.40180922 sigma out 1act.( 6.50506973 sig in 10act.) RANK 10 NODE 1 --> 3.70283103 sigma out 1act.( 5.44237661 sig in 10act.) RANK 11 NODE 10 --> 3.15015531 sigma out 1act.( 6.27434397 sig in 10act.) RANK 12 NODE 2 --> 2.49221826 sigma out 1act.( 6.13704967 sig in 10act.) RANK 13 NODE 8 --> 1.81143308 sigma out 1act.( 4.0699482 sig in 10act.) RANK 14 NODE 5 --> 0.273243785 sigma out 1act.( 3.71053839 sig in 10act.) RANK 15 NODE 7 --> 0.0700149834 sigma out 1act.( 4.26587963 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 20.6367378 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.452041626 *** contribution from regularisation: 0.0116138998 *** contribution from error: -0.463655531 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.509383976 *** contribution from regularisation: 0.00580786774 *** contribution from error: -0.515191853 *********************************************** -----------------> Test sample ENTER BFGS code START -11640.1801 0.048359748 0.108744912 EXIT FROM BFGS code FG_START 0. 0.048359748 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.531187952 *** contribution from regularisation: 0.00457320502 *** contribution from error: -0.535761178 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -12136.0516 0.048359748 15.8427534 EXIT FROM BFGS code FG_LNSRCH 0. 0.0647073686 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.570401132 *** contribution from regularisation: 0.00749438023 *** contribution from error: -0.577895522 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13031.9547 0.0647073686 22.7915535 EXIT FROM BFGS code NEW_X -13031.9547 0.0647073686 22.7915535 ENTER BFGS code NEW_X -13031.9547 0.0647073686 22.7915535 EXIT FROM BFGS code FG_LNSRCH 0. 0.104753852 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.576937675 *** contribution from regularisation: 0.0089378003 *** contribution from error: -0.585875452 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13181.2952 0.104753852 8.48253059 EXIT FROM BFGS code NEW_X -13181.2952 0.104753852 8.48253059 ENTER BFGS code NEW_X -13181.2952 0.104753852 8.48253059 EXIT FROM BFGS code FG_LNSRCH 0. 0.12470457 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.578358293 *** contribution from regularisation: 0.00820795074 *** contribution from error: -0.586566269 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13213.7524 0.12470457 1.1689961 EXIT FROM BFGS code NEW_X -13213.7524 0.12470457 1.1689961 ENTER BFGS code NEW_X -13213.7524 0.12470457 1.1689961 EXIT FROM BFGS code FG_LNSRCH 0. 0.183664352 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.579312384 *** contribution from regularisation: 0.00679293228 *** contribution from error: -0.586105287 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13235.5502 0.183664352 -16.4246349 EXIT FROM BFGS code NEW_X -13235.5502 0.183664352 -16.4246349 ENTER BFGS code NEW_X -13235.5502 0.183664352 -16.4246349 EXIT FROM BFGS code FG_LNSRCH 0. 0.187876388 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.579088151 *** contribution from regularisation: 0.00759029435 *** contribution from error: -0.586678445 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13230.4264 0.187876388 -14.9345226 EXIT FROM BFGS code FG_LNSRCH 0. 0.184461862 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.577769339 *** contribution from regularisation: 0.00846940931 *** contribution from error: -0.586238742 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13200.2956 0.184461862 -16.006712 EXIT FROM BFGS code FG_LNSRCH 0. 0.183685809 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 20.1332169 sigma out 15 active outputs RANK 2 NODE 1 --> 10.3220797 sigma out 15 active outputs RANK 3 NODE 5 --> 9.01153183 sigma out 15 active outputs RANK 4 NODE 3 --> 6.91486692 sigma out 15 active outputs RANK 5 NODE 6 --> 6.33028555 sigma out 15 active outputs RANK 6 NODE 8 --> 6.26654959 sigma out 15 active outputs RANK 7 NODE 7 --> 6.12360477 sigma out 15 active outputs RANK 8 NODE 10 --> 6.12074137 sigma out 15 active outputs RANK 9 NODE 4 --> 5.79778862 sigma out 15 active outputs RANK 10 NODE 9 --> 5.36298895 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 15.6984072 sigma in 10act. ( 14.0719643 sig out 1act.) RANK 2 NODE 4 --> 9.92622757 sigma in 10act. ( 8.32215881 sig out 1act.) RANK 3 NODE 13 --> 9.48410034 sigma in 10act. ( 6.47635126 sig out 1act.) RANK 4 NODE 11 --> 8.20492744 sigma in 10act. ( 6.13631344 sig out 1act.) RANK 5 NODE 10 --> 7.49191189 sigma in 10act. ( 5.14822721 sig out 1act.) RANK 6 NODE 15 --> 7.1332202 sigma in 10act. ( 5.17074394 sig out 1act.) RANK 7 NODE 14 --> 6.95065784 sigma in 10act. ( 4.71542406 sig out 1act.) RANK 8 NODE 2 --> 6.80882645 sigma in 10act. ( 4.27172947 sig out 1act.) RANK 9 NODE 3 --> 6.6245122 sigma in 10act. ( 4.61259174 sig out 1act.) RANK 10 NODE 9 --> 6.44897842 sigma in 10act. ( 4.53587341 sig out 1act.) RANK 11 NODE 6 --> 4.91135025 sigma in 10act. ( 2.99908662 sig out 1act.) RANK 12 NODE 1 --> 4.37698555 sigma in 10act. ( 2.72759247 sig out 1act.) RANK 13 NODE 5 --> 3.58629298 sigma in 10act. ( 2.16550708 sig out 1act.) RANK 14 NODE 7 --> 2.71050644 sigma in 10act. ( 0.718084872 sig out 1act.) RANK 15 NODE 8 --> 2.17060971 sigma in 10act. ( 0.199356645 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 14.0719643 sigma out 1act.( 15.6984072 sig in 10act.) RANK 2 NODE 4 --> 8.32215881 sigma out 1act.( 9.92622757 sig in 10act.) RANK 3 NODE 13 --> 6.47635126 sigma out 1act.( 9.48410034 sig in 10act.) RANK 4 NODE 11 --> 6.13631344 sigma out 1act.( 8.20492744 sig in 10act.) RANK 5 NODE 15 --> 5.17074394 sigma out 1act.( 7.1332202 sig in 10act.) RANK 6 NODE 10 --> 5.14822721 sigma out 1act.( 7.49191189 sig in 10act.) RANK 7 NODE 14 --> 4.71542406 sigma out 1act.( 6.95065784 sig in 10act.) RANK 8 NODE 3 --> 4.61259174 sigma out 1act.( 6.6245122 sig in 10act.) RANK 9 NODE 9 --> 4.53587341 sigma out 1act.( 6.44897842 sig in 10act.) RANK 10 NODE 2 --> 4.27172947 sigma out 1act.( 6.80882645 sig in 10act.) RANK 11 NODE 6 --> 2.99908662 sigma out 1act.( 4.91135025 sig in 10act.) RANK 12 NODE 1 --> 2.72759247 sigma out 1act.( 4.37698555 sig in 10act.) RANK 13 NODE 5 --> 2.16550708 sigma out 1act.( 3.58629298 sig in 10act.) RANK 14 NODE 7 --> 0.718084872 sigma out 1act.( 2.71050644 sig in 10act.) RANK 15 NODE 8 --> 0.199356645 sigma out 1act.( 2.17060971 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 22.452816 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.57834816 *** contribution from regularisation: 0.0077607804 *** contribution from error: -0.586108923 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -13213.5201 0.183685809 -16.4798088 EXIT FROM BFGS code FG_LNSRCH 0. 0.183664382 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.578070521 *** contribution from regularisation: 0.0080348216 *** contribution from error: -0.586105347 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13207.1768 0.183664382 -16.4522057 EXIT FROM BFGS code FG_LNSRCH 0. 0.183664352 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.578245342 *** contribution from regularisation: 0.00785997324 *** contribution from error: -0.586105287 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13211.1715 0.183664352 -16.5276127 EXIT FROM BFGS code FG_LNSRCH 0. 0.183664352 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.578223407 *** contribution from regularisation: 0.00788192917 *** contribution from error: -0.586105347 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13210.6698 0.183664352 -16.6183567 EXIT FROM BFGS code FG_LNSRCH 0. 0.183664352 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.577970862 *** contribution from regularisation: 0.00813446287 *** contribution from error: -0.586105347 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13204.9002 0.183664352 -16.5443516 EXIT FROM BFGS code NEW_X -13204.9002 0.183664352 -16.5443516 ENTER BFGS code NEW_X -13204.9002 0.183664352 -16.5443516 EXIT FROM BFGS code CONVERGENC -13204.9002 0.183664352 -16.5443516 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 31.7518311 sigma out 15 active outputs RANK 2 NODE 1 --> 16.1915417 sigma out 15 active outputs RANK 3 NODE 5 --> 13.7406759 sigma out 15 active outputs RANK 4 NODE 3 --> 10.4582424 sigma out 15 active outputs RANK 5 NODE 6 --> 9.73117828 sigma out 15 active outputs RANK 6 NODE 4 --> 9.50537968 sigma out 15 active outputs RANK 7 NODE 7 --> 9.18424892 sigma out 15 active outputs RANK 8 NODE 10 --> 8.99096584 sigma out 15 active outputs RANK 9 NODE 8 --> 8.82418919 sigma out 15 active outputs RANK 10 NODE 9 --> 7.92077875 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 25.0433121 sigma in 10act. ( 24.8526192 sig out 1act.) RANK 2 NODE 4 --> 15.8433352 sigma in 10act. ( 14.5929794 sig out 1act.) RANK 3 NODE 13 --> 15.6154108 sigma in 10act. ( 10.8946218 sig out 1act.) RANK 4 NODE 11 --> 12.7469521 sigma in 10act. ( 10.352499 sig out 1act.) RANK 5 NODE 10 --> 11.5270767 sigma in 10act. ( 8.70131016 sig out 1act.) RANK 6 NODE 15 --> 10.967803 sigma in 10act. ( 8.84132385 sig out 1act.) RANK 7 NODE 14 --> 10.6537561 sigma in 10act. ( 7.87880325 sig out 1act.) RANK 8 NODE 2 --> 10.219326 sigma in 10act. ( 7.14114285 sig out 1act.) RANK 9 NODE 3 --> 9.95179367 sigma in 10act. ( 7.70210981 sig out 1act.) RANK 10 NODE 9 --> 9.70486832 sigma in 10act. ( 7.81285858 sig out 1act.) RANK 11 NODE 6 --> 6.17866898 sigma in 10act. ( 5.14023638 sig out 1act.) RANK 12 NODE 1 --> 5.95564127 sigma in 10act. ( 4.50554323 sig out 1act.) RANK 13 NODE 5 --> 4.87760782 sigma in 10act. ( 3.53814387 sig out 1act.) RANK 14 NODE 7 --> 2.87007666 sigma in 10act. ( 1.16477478 sig out 1act.) RANK 15 NODE 8 --> 2.20507193 sigma in 10act. ( 0.323870182 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 24.8526192 sigma out 1act.( 25.0433121 sig in 10act.) RANK 2 NODE 4 --> 14.5929794 sigma out 1act.( 15.8433352 sig in 10act.) RANK 3 NODE 13 --> 10.8946218 sigma out 1act.( 15.6154108 sig in 10act.) RANK 4 NODE 11 --> 10.352499 sigma out 1act.( 12.7469521 sig in 10act.) RANK 5 NODE 15 --> 8.84132385 sigma out 1act.( 10.967803 sig in 10act.) RANK 6 NODE 10 --> 8.70131016 sigma out 1act.( 11.5270767 sig in 10act.) RANK 7 NODE 14 --> 7.87880325 sigma out 1act.( 10.6537561 sig in 10act.) RANK 8 NODE 9 --> 7.81285858 sigma out 1act.( 9.70486832 sig in 10act.) RANK 9 NODE 3 --> 7.70210981 sigma out 1act.( 9.95179367 sig in 10act.) RANK 10 NODE 2 --> 7.14114285 sigma out 1act.( 10.219326 sig in 10act.) RANK 11 NODE 6 --> 5.14023638 sigma out 1act.( 6.17866898 sig in 10act.) RANK 12 NODE 1 --> 4.50554323 sigma out 1act.( 5.95564127 sig in 10act.) RANK 13 NODE 5 --> 3.53814387 sigma out 1act.( 4.87760782 sig in 10act.) RANK 14 NODE 7 --> 1.16477478 sigma out 1act.( 2.87007666 sig in 10act.) RANK 15 NODE 8 --> 0.323870182 sigma out 1act.( 2.20507193 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.7877998 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.578206897 *** contribution from regularisation: 0.00789841823 *** contribution from error: -0.586105287 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25490 Closing output file done