NNInput NNInputs_185.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 173203 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 33403 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 33403 Chosen entries: 33403 Signal fraction: 1 Background fraction: 0.238934 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 33403 Entries to split: 33403 Test with : 16701 Train with : 16701 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 33403 for Signal Prepared event 0 for Signal with 33403 events ====Entry 0 Variable Ht : 147.006 Variable LepAPt : 30.5393 Variable LepBPt : 15.4876 Variable MetSigLeptonsJets : 2.11691 Variable MetSpec : 17.0117 Variable SumEtLeptonsJets : 123.482 Variable VSumJetLeptonsPt : 38.8269 Variable addEt : 69.5511 Variable dPhiLepSumMet : 0.952509 Variable dPhiLeptons : 0.431247 Variable dRLeptons : 0.583611 Variable lep1_E : 46.6216 Variable lep2_E : 18.2884 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2185 Ht = 147.006 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.5393 LepAPt = 30.5393 LepBEt = 15.4881 LepBPt = 15.4876 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 23.5237 MetDelPhi = 0.808389 MetSig = 1.71418 MetSigLeptonsJets = 2.11691 MetSpec = 17.0117 Mjj = 0 MostCentralJetEta = -1.43393 MtllMet = 76.1567 Njets = 1 SB = 0 SumEt = 188.32 SumEtJets = 0 SumEtLeptonsJets = 123.482 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 38.8269 addEt = 69.5511 dPhiLepSumMet = 0.952509 dPhiLeptons = 0.431247 dRLeptons = 0.583611 diltype = 52 dimass = 12.6791 event = 96 jet1_Et = 77.4552 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.6216 lep2_E = 18.2884 rand = 0.999742 run = 231298 weight = 2.74614e-06 ===Show End Prepared event 10000 for Signal with 33403 events Prepared event 20000 for Signal with 33403 events Prepared event 30000 for Signal with 33403 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.189397 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4368 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 173203 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4368 negative weights. Signal fraction: 62.1503525 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1501465 65.0583801 66.5895081 67.9697418 68.8649292 69.8618011 70.7151871 71.5166397 72.4568787 73.3098297 74.0069275 74.6164551 75.4577637 76.0672531 76.8251495 77.3638916 78.0123062 78.6693954 79.2594452 79.8103638 80.6745148 81.3466797 82.1941071 82.7471161 83.5595856 84.5343933 85.4943085 86.5579834 87.9052887 89.1055374 90.4591217 92.1110229 93.5843506 95.2108459 96.5939484 98.3450928 99.9657135 101.632919 103.380699 104.762466 106.359779 107.987564 109.635948 111.628868 113.380463 115.058022 116.999451 118.816528 120.391449 122.142517 123.871979 125.685074 127.531464 129.4263 130.996597 132.587753 134.2267 135.873047 137.407501 139.124481 140.76358 142.295639 144.006012 145.566956 147.135345 148.546539 150.347244 152.09407 153.824997 155.686462 157.421326 159.271393 161.121506 163.049011 164.909058 166.926758 168.813339 170.841095 173.235199 175.622192 178.062866 180.149628 183.026184 185.80278 188.651306 191.514374 195.032867 199.129333 203.390732 207.728149 212.548538 218.190887 224.113831 232.116638 240.753372 252.221161 267.030853 292.5672 337.730194 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0002613 20.3265743 20.6491661 20.9468346 21.2367306 21.501236 21.7517776 21.9623871 22.1703701 22.4078827 22.6337318 22.8649063 23.1183853 23.3057556 23.5364647 23.7401123 23.9453506 24.2073936 24.4441833 24.6707687 24.879406 25.094574 25.2758102 25.4594803 25.6360741 25.8188286 26.0426254 26.2563591 26.5022068 26.764637 26.9900856 27.2210979 27.4975643 27.7212753 27.9789963 28.2418995 28.4944687 28.7723351 29.0280437 29.204958 29.462719 29.7252235 30.0040035 30.329443 30.6293182 30.9899139 31.3243179 31.606142 31.851326 32.1966705 32.5341759 32.8567352 33.2273483 33.5834465 33.9134712 34.3299065 34.7333641 35.1102791 35.4668045 35.9006424 36.2537918 36.6364899 37.0170135 37.4544182 37.8514137 38.3699455 38.8273163 39.2334976 39.6937599 40.155304 40.6840744 41.0266571 41.5899811 42.0852966 42.6362534 43.2164001 43.8130951 44.4447098 45.0708961 45.6944771 46.3416176 47.069725 47.8605652 48.675827 49.4242744 50.2141457 51.0593109 51.9440117 52.8924522 53.818779 54.8769226 56.1107941 57.3981438 58.797081 60.2859955 61.963356 64.0200043 66.6568451 70.3518524 77.7252502 212.48645 ------------------------------ Transdef: Tab for variable 4 10.0003643 10.1400833 10.2524939 10.3672981 10.4901657 10.6255093 10.7585506 10.8892879 10.9976749 11.1378422 11.2697735 11.4080791 11.5457335 11.6865578 11.8381195 11.9978294 12.1500454 12.3111296 12.4751644 12.6280136 12.7952976 12.9208393 13.0981045 13.2892771 13.4686165 13.650444 13.8401337 14.0448761 14.2225018 14.3723898 14.6027098 14.8218918 15.0189667 15.2070408 15.3843021 15.5616417 15.751771 15.8860598 16.1052818 16.359623 16.5895805 16.841568 17.0852318 17.3488674 17.5988274 17.807827 18.00634 18.2564392 18.4908867 18.7536087 18.9800453 19.2228394 19.4906597 19.7664871 20.0399857 20.2284164 20.4163857 20.6642914 20.9175892 21.1601944 21.3702164 21.5889091 21.8150444 22.0102768 22.2251701 22.4540405 22.7073669 22.9342957 23.1911011 23.4471893 23.6908417 23.9521732 24.2207184 24.5074387 24.7828026 25.0416183 25.333313 25.6152115 25.9216347 26.2094536 26.5142403 26.8547516 27.1914902 27.5361443 27.8867016 28.2784996 28.718441 29.1209774 29.6082268 30.0959873 30.5970917 31.219017 31.7299728 32.4064255 33.093132 33.9081192 34.9343567 36.4262543 38.479538 41.9516335 72.7606735 ------------------------------ Transdef: Tab for variable 5 1.0227313 2.72551465 3.16129827 3.49930239 3.77067685 3.9977107 4.15664864 4.28048611 4.40731525 4.51447392 4.62437057 4.7200737 4.81548929 4.90836143 4.99627399 5.06772757 5.1360383 5.19824982 5.26944923 5.32847786 5.3849535 5.43890762 5.49592209 5.53230286 5.58413172 5.63247538 5.68219471 5.72977257 5.78481483 5.8374095 5.88298225 5.93523264 5.98289061 6.02824211 6.07268858 6.11572933 6.15820122 6.20056295 6.24193192 6.27834225 6.31794739 6.35772038 6.40143394 6.44998932 6.49573231 6.54951859 6.59935188 6.65230656 6.70038509 6.74353313 6.78798866 6.83366585 6.87176371 6.91957188 6.9764967 7.03672266 7.08846617 7.14468288 7.19711971 7.24505615 7.29750872 7.35998392 7.41726875 7.47862625 7.52365971 7.58755875 7.6450758 7.70534134 7.7732687 7.83618784 7.89614105 7.96355247 8.02727127 8.08605003 8.1485939 8.21121693 8.27562904 8.34119606 8.40322399 8.47217751 8.54170799 8.61026669 8.68883991 8.76454544 8.84085178 8.92114544 9.00474358 9.088274 9.18768406 9.28667259 9.39037323 9.50000191 9.63051224 9.77710342 9.95839119 10.1525249 10.3922157 10.7444916 11.2128372 12.2614746 21.1559963 ------------------------------ Transdef: Tab for variable 6 15.0042896 21.0116272 25.4420776 26.5358715 27.4397278 28.3718548 29.2288666 29.9927139 30.7114601 31.3109913 31.9150791 32.4047508 32.9606552 33.4070282 33.9328003 34.4310074 34.8457413 35.2744293 35.7507248 36.1459274 36.4875984 36.866375 37.1814728 37.5217743 37.8676376 38.2265091 38.6330605 39.0753326 39.4717407 39.8721008 40.2734642 40.564064 41.0098877 41.4818573 41.9070129 42.2920609 42.6753197 43.1154213 43.5350075 43.9576683 44.4719467 44.9763603 45.6570282 46.3508453 47.102951 47.6815948 48.3984985 49.0806046 49.7635803 50.4225769 51.1480942 51.9966278 52.9062424 53.7479668 54.4984589 55.3261948 56.125412 56.9668007 57.7539635 58.5347137 59.275795 60.1609421 61.1140442 62.0039444 62.8195877 63.745163 64.5634766 65.3985443 66.1260986 66.9774475 67.7961197 68.7012253 69.5615997 70.4504166 71.2563477 72.0702515 72.9915619 73.8637772 74.7091064 75.7159119 76.6687469 77.3626556 78.4730148 79.4416046 80.4408112 81.7246933 82.8379974 84.172905 85.5174179 86.9864655 88.4442749 90.2762451 92.214386 94.4505081 96.8334808 99.7096939 103.442108 108.612823 116.513245 128.472473 280.715759 ------------------------------ Transdef: Tab for variable 7 30.1484737 32.6468658 33.6397858 34.3122597 35.0739136 35.5652237 35.9462814 36.2987366 36.6598206 37.0953751 37.4454498 37.7971954 38.0857925 38.3941154 38.7608948 38.9906082 39.2509995 39.5253334 39.8193283 40.155304 40.538414 40.9267311 41.3092041 41.6181831 41.9863701 42.4197044 42.8233795 43.3571739 44.0280075 44.6518784 45.3457184 45.9886208 46.9919815 47.8490372 48.7217522 49.6568794 50.7436523 51.7677002 52.8630219 53.8162766 55.0705338 56.0034561 57.018074 58.1046066 59.2373734 60.2349358 61.0345383 61.685791 62.5669632 63.4729538 64.40979 65.2474899 66.1447372 67.0319824 67.9881439 68.9506378 69.9234467 70.7882843 71.781311 72.701355 73.7127075 74.7110443 75.7248001 76.7477798 77.6861877 78.6162567 79.7657318 80.9328613 82.1118622 83.360199 84.4923706 85.9093246 87.1296082 88.4748535 90.0736237 91.5090408 93.261261 95.0929565 96.7125931 98.4160004 100.298874 102.087784 104.232407 106.397392 108.750122 111.142342 113.504303 116.540344 119.43956 122.807892 126.540947 130.713226 135.81131 140.928284 147.109955 154.894745 164.325989 177.359085 196.127625 234.168198 517.957397 ------------------------------ Transdef: Tab for variable 8 3.10723281 24.6878815 29.1559868 31.0905533 32.0030594 32.7896729 33.3424835 33.856842 34.3539085 34.7516098 35.1093521 35.4375839 35.8411293 36.1055756 36.4511108 36.7548523 37.1152344 37.3569374 37.6480408 37.8578644 38.1064224 38.4261398 38.6762199 38.9219322 39.1990814 39.493454 39.79282 40.1043396 40.4258118 40.7773666 41.0848923 41.4305267 41.7874222 42.1293602 42.608757 43.0268326 43.5494919 44.0170326 44.6149445 45.1525536 45.681366 46.3339386 47.0078506 47.7392426 48.2605591 48.8069458 49.4610977 50.2051315 50.9437904 51.6836777 52.4171867 53.2061615 53.9133797 54.7493286 55.4535332 56.2239609 57.0392685 57.8643799 58.6981812 59.4844856 60.2419357 60.940239 61.5368118 62.325943 63.0053978 63.7486496 64.4465637 65.1976929 65.8823776 66.5799866 67.3142166 68.2073975 69.0243073 69.8559875 70.5746613 71.3645554 72.0839691 72.9080963 73.7048111 74.6474152 75.5484161 76.5186005 77.4707947 78.4897003 79.4324188 80.6461182 81.8213654 83.0547333 84.4153748 85.8565521 87.3685913 89.0792542 90.8469849 93.1593933 96.0008545 99.4045868 103.664108 109.034012 117.787872 135.208923 326.868286 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7807465 64.4871979 66.1371918 67.3944473 68.4294434 69.2717438 70.1242371 70.8554306 71.5463257 72.4193115 73.1938553 73.8243561 74.3722763 75.1345062 75.7136383 76.2666168 76.9083862 77.4521637 78.0159149 78.5822754 79.1025314 79.5795898 80.2360229 80.9618073 81.5722351 82.2084198 82.6794891 83.3737335 84.0386429 84.7609024 85.6775513 86.5363617 87.1616364 88.2994232 89.285141 90.2117615 91.3599167 92.7272797 93.8449478 95.1294022 96.3153381 97.8032379 99.2096405 100.82428 102.104965 103.67453 105.174973 106.677467 108.017212 109.694992 111.33728 112.793503 114.240585 115.769234 117.266006 118.743591 119.808731 121.187866 122.56456 124.004807 125.385193 126.786095 128.078766 129.597137 130.745697 132.025757 133.232788 134.565201 135.72171 136.878906 138.172882 139.565002 140.869568 142.016022 143.255508 144.439423 145.636902 146.884018 148.113144 149.379272 150.822556 152.167358 153.591873 154.993042 156.533203 158.00589 159.798309 161.49884 163.327026 165.105042 167.098663 169.455231 171.699097 174.441559 177.7314 181.368423 186.443573 194.323853 211.706238 385.879456 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.02268863 1.3715415 1.61608195 1.77066016 1.89066136 1.98439419 2.0703485 2.14873695 2.21660066 2.2752831 2.32759333 2.37676764 2.41772318 2.45593357 2.4892149 2.52067828 2.54896164 2.57545328 2.60082054 2.62820387 2.65063381 2.67419839 2.69641066 2.71564102 2.73361254 2.75056076 2.76711941 2.78057766 2.7958107 2.80987978 2.82314825 2.83551192 2.84513259 2.8562665 2.86501908 2.87461305 2.8842206 2.89372349 2.90258455 2.91065073 2.916991 2.92401314 2.9309907 2.93869686 2.94612479 2.95268536 2.95935559 2.96606469 2.97259188 2.97824907 2.9833343 2.98734188 2.9921751 2.99594736 3.00146079 3.00623131 3.01119304 3.01576972 3.01997924 3.02401495 3.02831602 3.03175163 3.03560638 3.0394299 3.04299593 3.04716539 3.05135155 3.05483913 3.05808568 3.06148624 3.065207 3.0686357 3.07231474 3.07514858 3.07794833 3.08097792 3.08384705 3.08733988 3.08976364 3.09253597 3.09510589 3.09776211 3.10050249 3.10315752 3.10523009 3.10806561 3.11003566 3.11308193 3.11537266 3.11770391 3.12017918 3.12289524 3.12559843 3.12794924 3.12985659 3.13169789 3.13407636 3.13679075 3.13926601 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00610196125 0.0102976467 0.015830636 0.0224197656 0.0293735266 0.0371095538 0.045042038 0.0528344214 0.0586876497 0.0664604902 0.0741834641 0.0819582939 0.0895810053 0.0961906984 0.10459137 0.110103682 0.117040157 0.124627829 0.132309079 0.13975656 0.14678961 0.153781682 0.160526574 0.167013407 0.173732519 0.17995441 0.186071396 0.191828549 0.197695404 0.20349884 0.208445549 0.213384748 0.218597233 0.22444132 0.229480147 0.233854473 0.238353103 0.243649185 0.248782754 0.25421685 0.258752704 0.263282061 0.26732567 0.272507161 0.277685404 0.282974422 0.28824544 0.293289661 0.298638612 0.303094417 0.308507204 0.313683867 0.319440126 0.324839234 0.331202745 0.336086035 0.342149943 0.347507298 0.352483541 0.358323336 0.363224685 0.368919164 0.375076294 0.380679667 0.386823177 0.392593741 0.398553967 0.404709905 0.410506368 0.417687058 0.424450457 0.430559874 0.437277853 0.44401145 0.450057566 0.458390594 0.465655327 0.473603249 0.480996311 0.490217209 0.499469399 0.508818626 0.517427683 0.526012719 0.536003351 0.54502809 0.556759238 0.570379496 0.582410216 0.595371127 0.609161735 0.625282466 0.640512705 0.657475352 0.68038702 0.703634679 0.733674824 0.77658534 0.840616584 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.213359833 0.222873852 0.231999815 0.240683675 0.248625398 0.255030751 0.262194425 0.269135058 0.276141554 0.282591403 0.288955152 0.295947254 0.30194366 0.30740422 0.313293874 0.318653882 0.323976398 0.330047071 0.335928857 0.341305286 0.34637773 0.350402176 0.355557024 0.360228568 0.3652004 0.370167077 0.375436515 0.380536884 0.385862947 0.390585303 0.395247132 0.399367332 0.403405726 0.407322556 0.411338627 0.414826512 0.418908209 0.422555745 0.426026702 0.429723799 0.433645189 0.437191516 0.440957308 0.44500801 0.448914886 0.453325927 0.457120478 0.46087575 0.464583814 0.469084948 0.472789586 0.476502419 0.47930783 0.483171165 0.487110704 0.491085768 0.495311975 0.499805808 0.505238771 0.510113895 0.515409112 0.520730495 0.525295675 0.530337811 0.535785973 0.54148078 0.546538353 0.550618351 0.556131005 0.56190145 0.568154693 0.575235724 0.581798792 0.588230491 0.594875097 0.601138353 0.608041644 0.614853978 0.62209785 0.628658533 0.635877848 0.643321276 0.652243674 0.661635458 0.668740273 0.67787385 0.687194109 0.698549747 0.708469212 0.71886456 0.73009479 0.743064165 0.756283224 0.771147549 0.791916609 0.810695887 0.832967281 0.86388886 0.909335852 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.6021423 22.3976383 23.1257305 23.8281784 24.4320736 24.8853951 25.353447 25.8184204 26.2118301 26.7084389 27.2075043 27.6596661 28.0678062 28.5046272 28.852953 29.2106667 29.5481472 29.9016361 30.2895432 30.6236076 30.9848042 31.3502121 31.6956291 32.0361099 32.4154396 32.8276024 33.1882401 33.5954514 34.0087357 34.3449059 34.7439957 35.0973206 35.5277405 35.9224243 36.1957855 36.6247139 36.971962 37.3167343 37.7236557 38.1843796 38.6140556 39.0827942 39.525795 40.0313911 40.4655762 40.9526443 41.437973 41.9156952 42.4753647 42.9898033 43.3670502 43.8225861 44.2913551 44.7938614 45.2803116 45.7353363 46.3352661 46.7922707 47.3729172 47.8714638 48.3951569 48.9722519 49.5241089 50.1802826 50.791626 51.3739014 51.9998283 52.5910683 53.3064651 54.0237122 54.6550751 55.3088989 56.0067215 56.6982956 57.4597168 58.2476463 58.892128 59.6750717 60.4772263 61.3842468 62.3513718 63.3241653 64.4151001 65.6200409 66.841095 67.8637848 68.8808899 70.1362915 71.7201385 73.3544235 75.0465698 76.9443741 78.9698257 81.6103821 84.2938385 87.6026688 91.1951294 97.0563431 106.750488 316.641113 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.6451616 11.0988617 11.4817524 11.8921986 12.2834206 12.6402245 13.0262814 13.379467 13.7177391 14.0595303 14.3928852 14.6646585 14.9581776 15.246954 15.5542374 15.8632307 16.1319256 16.460722 16.7134647 16.9867554 17.2902756 17.5718956 17.8129692 18.0990829 18.3694649 18.6556129 18.9526443 19.1723862 19.4455433 19.7770195 20.0341072 20.3358727 20.6365833 20.9046478 21.1997414 21.4923592 21.7298641 21.9672508 22.2228107 22.5260658 22.7952919 23.067028 23.3395042 23.5574818 23.8146667 24.0769577 24.3017311 24.5942879 24.8822899 25.1012154 25.3494339 25.5700474 25.8166046 26.0619431 26.3273239 26.5908546 26.9027634 27.1448822 27.4393768 27.7024002 27.9611168 28.17659 28.4455566 28.7246246 29.0005283 29.2797356 29.5724354 29.8723602 30.2275181 30.5575409 30.9150505 31.2513199 31.5667305 31.9099846 32.3145599 32.7451096 33.1234436 33.4473801 33.8439865 34.2864456 34.7274857 35.2005692 35.7012405 36.3205795 36.8816223 37.4627609 38.081131 38.7670898 39.5219688 40.1910553 41.062912 42.0787048 43.2600479 44.3014183 45.8107605 47.9314957 51.1008835 54.735527 60.4739761 115.518631 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.9 53.4 53.7 32.6 51.9 63.8 55.9 64.3 -25.9 -19.1 -41.5 18.2 21.5 2 65.9 100.0 69.9 59.6 42.4 72.0 94.7 77.9 92.7 -44.2 -25.6 -51.9 37.2 30.8 3 53.4 69.9 100.0 46.1 21.7 44.1 71.5 60.6 76.8 -13.7 -27.7 -58.7 66.7 22.5 4 53.7 59.6 46.1 100.0 17.7 37.9 61.2 51.0 63.2 -13.5 -30.4 -61.8 21.2 68.9 5 32.6 42.4 21.7 17.7 100.0 84.7 16.2 61.7 62.1 19.0 -10.0 -17.5 5.7 3.6 6 51.9 72.0 44.1 37.9 84.7 100.0 52.5 80.7 81.6 -8.9 -18.5 -34.5 18.9 15.5 7 63.8 94.7 71.5 61.2 16.2 52.5 100.0 70.2 82.0 -52.3 -24.6 -52.0 40.3 33.7 8 55.9 77.9 60.6 51.0 61.7 80.7 70.2 100.0 85.3 -13.1 -25.8 -47.3 32.7 26.7 9 64.3 92.7 76.8 63.2 62.1 81.6 82.0 85.3 100.0 -21.3 -28.5 -57.7 43.2 33.6 10 -25.9 -44.2 -13.7 -13.5 19.0 -8.9 -52.3 -13.1 -21.3 100.0 1.6 7.9 -4.3 -5.2 11 -19.1 -25.6 -27.7 -30.4 -10.0 -18.5 -24.6 -25.8 -28.5 1.6 100.0 54.7 -12.1 -17.9 12 -41.5 -51.9 -58.7 -61.8 -17.5 -34.5 -52.0 -47.3 -57.7 7.9 54.7 100.0 -31.2 -34.5 13 18.2 37.2 66.7 21.2 5.7 18.9 40.3 32.7 43.2 -4.3 -12.1 -31.2 100.0 46.0 14 21.5 30.8 22.5 68.9 3.6 15.5 33.7 26.7 33.6 -5.2 -17.9 -34.5 46.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 169.476191 TOTAL CORRELATION OF ALL VARIABLES 73.1103898 ROUND 1: MAX CORR ( 73.1023807) AFTER KILLING INPUT VARIABLE 11 CONTR 1.08214475 ROUND 2: MAX CORR ( 73.0862111) AFTER KILLING INPUT VARIABLE 8 CONTR 1.5374678 ROUND 3: MAX CORR ( 73.0376052) AFTER KILLING INPUT VARIABLE 2 CONTR 2.66504801 ROUND 4: MAX CORR ( 72.9647815) AFTER KILLING INPUT VARIABLE 12 CONTR 3.26074089 ROUND 5: MAX CORR ( 72.8652471) AFTER KILLING INPUT VARIABLE 14 CONTR 3.80986865 ROUND 6: MAX CORR ( 72.7350403) AFTER KILLING INPUT VARIABLE 6 CONTR 4.3540961 ROUND 7: MAX CORR ( 72.5009981) AFTER KILLING INPUT VARIABLE 10 CONTR 5.83021138 ROUND 8: MAX CORR ( 71.5318756) AFTER KILLING INPUT VARIABLE 9 CONTR 11.8146309 ROUND 9: MAX CORR ( 70.0055661) AFTER KILLING INPUT VARIABLE 13 CONTR 14.6979567 ROUND 10: MAX CORR ( 69.6100671) AFTER KILLING INPUT VARIABLE 3 CONTR 7.43087136 ROUND 11: MAX CORR ( 67.6607055) AFTER KILLING INPUT VARIABLE 4 CONTR 16.3581897 ROUND 12: MAX CORR ( 63.7905864) AFTER KILLING INPUT VARIABLE 5 CONTR 22.5550916 LAST REMAINING VARIABLE: 7 total correlation to target: 73.1103898 % total significance: 120.169864 sigma correlations of single variables to target: variable 2: 65.9031128 % , in sigma: 108.323429 variable 3: 53.3778616 % , in sigma: 87.735962 variable 4: 53.7100618 % , in sigma: 88.2819917 variable 5: 32.6170161 % , in sigma: 53.6118382 variable 6: 51.9107661 % , in sigma: 85.3245309 variable 7: 63.7905864 % , in sigma: 104.851118 variable 8: 55.8922374 % , in sigma: 91.8687835 variable 9: 64.3354543 % , in sigma: 105.746705 variable 10: -25.9358789 % , in sigma: 42.6302069 variable 11: -19.1286343 % , in sigma: 31.4412957 variable 12: -41.5114588 % , in sigma: 68.2314289 variable 13: 18.1500192 % , in sigma: 29.8327687 variable 14: 21.5165992 % , in sigma: 35.3663386 variables sorted by significance: 1 most relevant variable 7 corr 63.7905846 , in sigma: 104.851115 2 most relevant variable 5 corr 22.5550919 , in sigma: 37.0732851 3 most relevant variable 4 corr 16.3581905 , in sigma: 26.8875811 4 most relevant variable 3 corr 7.43087149 , in sigma: 12.2139523 5 most relevant variable 13 corr 14.697957 , in sigma: 24.1586935 6 most relevant variable 9 corr 11.8146305 , in sigma: 19.4194361 7 most relevant variable 10 corr 5.83021116 , in sigma: 9.58298383 8 most relevant variable 6 corr 4.35409594 , in sigma: 7.15672722 9 most relevant variable 14 corr 3.80986857 , in sigma: 6.26219324 10 most relevant variable 12 corr 3.260741 , in sigma: 5.35960489 11 most relevant variable 2 corr 2.66504812 , in sigma: 4.38047823 12 most relevant variable 8 corr 1.53746784 , in sigma: 2.52710048 13 most relevant variable 11 corr 1.08214474 , in sigma: 1.77869639 global correlations between input variables: variable 2: 99.2268547 % variable 3: 93.727943 % variable 4: 91.2022566 % variable 5: 95.4128976 % variable 6: 94.5071612 % variable 7: 98.8349099 % variable 8: 90.964768 % variable 9: 98.8868736 % variable 10: 71.5863459 % variable 11: 55.839575 % variable 12: 78.131313 % variable 13: 86.1160897 % variable 14: 86.8543463 % significance loss when removing single variables: variable 2: corr = 1.81961823 % , sigma = 2.99086458 variable 3: corr = 16.0704918 % , sigma = 26.4146974 variable 4: corr = 16.3032758 % , sigma = 26.797319 variable 5: corr = 12.1654915 % , sigma = 19.9961382 variable 6: corr = 4.26653543 % , sigma = 7.01280604 variable 7: corr = 7.29284899 % , sigma = 11.9870879 variable 8: corr = 1.4617198 % , sigma = 2.40259518 variable 9: corr = 10.7649062 % , sigma = 17.6940284 variable 10: corr = 4.5099444 % , sigma = 7.41289175 variable 11: corr = 1.08214475 % , sigma = 1.7786964 variable 12: corr = 2.34819225 % , sigma = 3.85966953 variable 13: corr = 6.86957995 % , sigma = 11.2913704 variable 14: corr = 3.82892995 % , sigma = 6.29352398 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 11.9947767 sigma out 15 active outputs RANK 2 NODE 1 --> 11.9246521 sigma out 15 active outputs RANK 3 NODE 3 --> 11.6296244 sigma out 15 active outputs RANK 4 NODE 4 --> 10.8790359 sigma out 15 active outputs RANK 5 NODE 10 --> 10.577157 sigma out 15 active outputs RANK 6 NODE 11 --> 10.3211918 sigma out 15 active outputs RANK 7 NODE 8 --> 10.3200359 sigma out 15 active outputs RANK 8 NODE 6 --> 10.0179844 sigma out 15 active outputs RANK 9 NODE 9 --> 9.94177628 sigma out 15 active outputs RANK 10 NODE 7 --> 9.4666605 sigma out 15 active outputs RANK 11 NODE 5 --> 8.27254772 sigma out 15 active outputs RANK 12 NODE 2 --> 7.44502687 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 16.7928295 sigma in 12act. ( 18.4602833 sig out 1act.) RANK 2 NODE 2 --> 12.5821018 sigma in 12act. ( 12.6334038 sig out 1act.) RANK 3 NODE 8 --> 10.4425898 sigma in 12act. ( 8.69638634 sig out 1act.) RANK 4 NODE 5 --> 10.2787132 sigma in 12act. ( 11.4104061 sig out 1act.) RANK 5 NODE 4 --> 9.24890995 sigma in 12act. ( 9.34082603 sig out 1act.) RANK 6 NODE 10 --> 8.92419338 sigma in 12act. ( 8.18070221 sig out 1act.) RANK 7 NODE 1 --> 8.75413036 sigma in 12act. ( 10.37148 sig out 1act.) RANK 8 NODE 13 --> 8.63260174 sigma in 12act. ( 7.82836199 sig out 1act.) RANK 9 NODE 7 --> 8.507267 sigma in 12act. ( 9.38227367 sig out 1act.) RANK 10 NODE 12 --> 7.70851088 sigma in 12act. ( 8.1926403 sig out 1act.) RANK 11 NODE 3 --> 7.00481081 sigma in 12act. ( 8.99061871 sig out 1act.) RANK 12 NODE 6 --> 6.28550959 sigma in 12act. ( 7.14786005 sig out 1act.) RANK 13 NODE 11 --> 6.28185511 sigma in 12act. ( 6.30157471 sig out 1act.) RANK 14 NODE 15 --> 4.87782764 sigma in 12act. ( 3.95040727 sig out 1act.) RANK 15 NODE 14 --> 4.72092199 sigma in 12act. ( 5.36566305 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 18.4602833 sigma out 1act.( 16.7928295 sig in 12act.) RANK 2 NODE 2 --> 12.6334038 sigma out 1act.( 12.5821018 sig in 12act.) RANK 3 NODE 5 --> 11.4104061 sigma out 1act.( 10.2787132 sig in 12act.) RANK 4 NODE 1 --> 10.37148 sigma out 1act.( 8.75413036 sig in 12act.) RANK 5 NODE 7 --> 9.38227367 sigma out 1act.( 8.507267 sig in 12act.) RANK 6 NODE 4 --> 9.34082603 sigma out 1act.( 9.24890995 sig in 12act.) RANK 7 NODE 3 --> 8.99061871 sigma out 1act.( 7.00481081 sig in 12act.) RANK 8 NODE 8 --> 8.69638634 sigma out 1act.( 10.4425898 sig in 12act.) RANK 9 NODE 12 --> 8.1926403 sigma out 1act.( 7.70851088 sig in 12act.) RANK 10 NODE 10 --> 8.18070221 sigma out 1act.( 8.92419338 sig in 12act.) RANK 11 NODE 13 --> 7.82836199 sigma out 1act.( 8.63260174 sig in 12act.) RANK 12 NODE 6 --> 7.14786005 sigma out 1act.( 6.28550959 sig in 12act.) RANK 13 NODE 11 --> 6.30157471 sigma out 1act.( 6.28185511 sig in 12act.) RANK 14 NODE 14 --> 5.36566305 sigma out 1act.( 4.72092199 sig in 12act.) RANK 15 NODE 15 --> 3.95040727 sigma out 1act.( 4.87782764 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 37.4220581 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 23.3671093 sigma out 15 active outputs RANK 2 NODE 1 --> 14.1497593 sigma out 15 active outputs RANK 3 NODE 3 --> 14.0412703 sigma out 15 active outputs RANK 4 NODE 4 --> 12.5566206 sigma out 15 active outputs RANK 5 NODE 11 --> 12.524826 sigma out 15 active outputs RANK 6 NODE 7 --> 12.2602434 sigma out 15 active outputs RANK 7 NODE 10 --> 12.2086439 sigma out 15 active outputs RANK 8 NODE 9 --> 12.1654453 sigma out 15 active outputs RANK 9 NODE 6 --> 11.9808187 sigma out 15 active outputs RANK 10 NODE 8 --> 11.6815557 sigma out 15 active outputs RANK 11 NODE 5 --> 10.1296415 sigma out 15 active outputs RANK 12 NODE 2 --> 8.91669941 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 19.5587482 sigma in 12act. ( 18.6978874 sig out 1act.) RANK 2 NODE 5 --> 14.6111088 sigma in 12act. ( 12.2313089 sig out 1act.) RANK 3 NODE 1 --> 13.8133612 sigma in 12act. ( 11.7688875 sig out 1act.) RANK 4 NODE 2 --> 13.0698223 sigma in 12act. ( 12.0046711 sig out 1act.) RANK 5 NODE 3 --> 12.7854395 sigma in 12act. ( 10.3330603 sig out 1act.) RANK 6 NODE 7 --> 11.6748238 sigma in 12act. ( 9.62954521 sig out 1act.) RANK 7 NODE 13 --> 11.6357298 sigma in 12act. ( 7.08058882 sig out 1act.) RANK 8 NODE 6 --> 11.5899792 sigma in 12act. ( 8.18120193 sig out 1act.) RANK 9 NODE 10 --> 11.3136339 sigma in 12act. ( 7.7813797 sig out 1act.) RANK 10 NODE 14 --> 11.2468491 sigma in 12act. ( 6.16779137 sig out 1act.) RANK 11 NODE 12 --> 10.4597616 sigma in 12act. ( 8.51284313 sig out 1act.) RANK 12 NODE 4 --> 9.97278595 sigma in 12act. ( 9.25923729 sig out 1act.) RANK 13 NODE 8 --> 9.64795494 sigma in 12act. ( 7.16139126 sig out 1act.) RANK 14 NODE 11 --> 8.45915127 sigma in 12act. ( 6.06142807 sig out 1act.) RANK 15 NODE 15 --> 3.50357366 sigma in 12act. ( 1.94322968 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 18.6978874 sigma out 1act.( 19.5587482 sig in 12act.) RANK 2 NODE 5 --> 12.2313089 sigma out 1act.( 14.6111088 sig in 12act.) RANK 3 NODE 2 --> 12.0046711 sigma out 1act.( 13.0698223 sig in 12act.) RANK 4 NODE 1 --> 11.7688875 sigma out 1act.( 13.8133612 sig in 12act.) RANK 5 NODE 3 --> 10.3330603 sigma out 1act.( 12.7854395 sig in 12act.) RANK 6 NODE 7 --> 9.62954521 sigma out 1act.( 11.6748238 sig in 12act.) RANK 7 NODE 4 --> 9.25923729 sigma out 1act.( 9.97278595 sig in 12act.) RANK 8 NODE 12 --> 8.51284313 sigma out 1act.( 10.4597616 sig in 12act.) RANK 9 NODE 6 --> 8.18120193 sigma out 1act.( 11.5899792 sig in 12act.) RANK 10 NODE 10 --> 7.7813797 sigma out 1act.( 11.3136339 sig in 12act.) RANK 11 NODE 8 --> 7.16139126 sigma out 1act.( 9.64795494 sig in 12act.) RANK 12 NODE 13 --> 7.08058882 sigma out 1act.( 11.6357298 sig in 12act.) RANK 13 NODE 14 --> 6.16779137 sigma out 1act.( 11.2468491 sig in 12act.) RANK 14 NODE 11 --> 6.06142807 sigma out 1act.( 8.45915127 sig in 12act.) RANK 15 NODE 15 --> 1.94322968 sigma out 1act.( 3.50357366 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.0394287 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.500784397 *** contribution from regularisation: 0.00501212664 *** contribution from error: -0.505796552 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.550542235 *** contribution from regularisation: 0.00280055124 *** contribution from error: -0.55334276 *********************************************** -----------------> Test sample ENTER BFGS code START -47686.1662 0.688281119 0.0109322788 EXIT FROM BFGS code FG_START 0. 0.688281119 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.574928164 *** contribution from regularisation: 0.00252213445 *** contribution from error: -0.577450275 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49789.3556 0.688281119 53.3878632 EXIT FROM BFGS code FG_LNSRCH 0. 0.718998134 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.58649528 *** contribution from regularisation: 0.00345710409 *** contribution from error: -0.589952409 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50791.0792 0.718998134 34.6044884 EXIT FROM BFGS code NEW_X -50791.0792 0.718998134 34.6044884 ENTER BFGS code NEW_X -50791.0792 0.718998134 34.6044884 EXIT FROM BFGS code FG_LNSRCH 0. 0.732518196 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.588923156 *** contribution from regularisation: 0.00324536557 *** contribution from error: -0.59216851 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51001.3347 0.732518196 -4.1642108 EXIT FROM BFGS code NEW_X -51001.3347 0.732518196 -4.1642108 ENTER BFGS code NEW_X -51001.3347 0.732518196 -4.1642108 EXIT FROM BFGS code FG_LNSRCH 0. 0.731760085 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.589882731 *** contribution from regularisation: 0.00305632944 *** contribution from error: -0.592939079 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51084.4344 0.731760085 -13.6030607 EXIT FROM BFGS code NEW_X -51084.4344 0.731760085 -13.6030607 ENTER BFGS code NEW_X -51084.4344 0.731760085 -13.6030607 EXIT FROM BFGS code FG_LNSRCH 0. 0.723442852 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.59044838 *** contribution from regularisation: 0.00301793031 *** contribution from error: -0.593466282 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51133.4221 0.723442852 -21.4559116 EXIT FROM BFGS code NEW_X -51133.4221 0.723442852 -21.4559116 ENTER BFGS code NEW_X -51133.4221 0.723442852 -21.4559116 EXIT FROM BFGS code FG_LNSRCH 0. 0.698527873 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.591281533 *** contribution from regularisation: 0.0028723767 *** contribution from error: -0.594153881 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51205.5724 0.698527873 -20.9575977 EXIT FROM BFGS code NEW_X -51205.5724 0.698527873 -20.9575977 ENTER BFGS code NEW_X -51205.5724 0.698527873 -20.9575977 EXIT FROM BFGS code FG_LNSRCH 0. 0.603666663 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.592382252 *** contribution from regularisation: 0.00294368784 *** contribution from error: -0.595325947 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51300.893 0.603666663 -31.2083435 EXIT FROM BFGS code NEW_X -51300.893 0.603666663 -31.2083435 ENTER BFGS code NEW_X -51300.893 0.603666663 -31.2083435 EXIT FROM BFGS code FG_LNSRCH 0. 0.462958425 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 32.6729546 sigma out 15 active outputs RANK 2 NODE 9 --> 18.2646828 sigma out 15 active outputs RANK 3 NODE 4 --> 16.6598663 sigma out 15 active outputs RANK 4 NODE 2 --> 15.1001205 sigma out 15 active outputs RANK 5 NODE 8 --> 13.2699394 sigma out 15 active outputs RANK 6 NODE 1 --> 11.6345015 sigma out 15 active outputs RANK 7 NODE 11 --> 9.66431713 sigma out 15 active outputs RANK 8 NODE 10 --> 9.4947176 sigma out 15 active outputs RANK 9 NODE 3 --> 8.80805874 sigma out 15 active outputs RANK 10 NODE 6 --> 7.94773769 sigma out 15 active outputs RANK 11 NODE 7 --> 7.5513792 sigma out 15 active outputs RANK 12 NODE 5 --> 6.7883954 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 21.4721298 sigma in 12act. ( 16.1171894 sig out 1act.) RANK 2 NODE 6 --> 20.4939251 sigma in 12act. ( 13.6492701 sig out 1act.) RANK 3 NODE 3 --> 19.644516 sigma in 12act. ( 15.1024151 sig out 1act.) RANK 4 NODE 9 --> 17.1616745 sigma in 12act. ( 16.9919739 sig out 1act.) RANK 5 NODE 14 --> 16.8768749 sigma in 12act. ( 13.1736937 sig out 1act.) RANK 6 NODE 7 --> 15.1440306 sigma in 12act. ( 14.1192751 sig out 1act.) RANK 7 NODE 12 --> 12.4644775 sigma in 12act. ( 9.09138298 sig out 1act.) RANK 8 NODE 5 --> 11.6775942 sigma in 12act. ( 10.6365042 sig out 1act.) RANK 9 NODE 11 --> 10.6244602 sigma in 12act. ( 10.2082157 sig out 1act.) RANK 10 NODE 4 --> 7.35510874 sigma in 12act. ( 4.578125 sig out 1act.) RANK 11 NODE 13 --> 5.77136946 sigma in 12act. ( 2.9623034 sig out 1act.) RANK 12 NODE 2 --> 5.55345488 sigma in 12act. ( 4.13498449 sig out 1act.) RANK 13 NODE 8 --> 5.13510132 sigma in 12act. ( 4.01395035 sig out 1act.) RANK 14 NODE 10 --> 4.42699432 sigma in 12act. ( 2.30103898 sig out 1act.) RANK 15 NODE 15 --> 1.03142595 sigma in 12act. ( 0.413334519 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 16.9919739 sigma out 1act.( 17.1616745 sig in 12act.) RANK 2 NODE 1 --> 16.1171894 sigma out 1act.( 21.4721298 sig in 12act.) RANK 3 NODE 3 --> 15.1024151 sigma out 1act.( 19.644516 sig in 12act.) RANK 4 NODE 7 --> 14.1192751 sigma out 1act.( 15.1440306 sig in 12act.) RANK 5 NODE 6 --> 13.6492701 sigma out 1act.( 20.4939251 sig in 12act.) RANK 6 NODE 14 --> 13.1736937 sigma out 1act.( 16.8768749 sig in 12act.) RANK 7 NODE 5 --> 10.6365042 sigma out 1act.( 11.6775942 sig in 12act.) RANK 8 NODE 11 --> 10.2082157 sigma out 1act.( 10.6244602 sig in 12act.) RANK 9 NODE 12 --> 9.09138298 sigma out 1act.( 12.4644775 sig in 12act.) RANK 10 NODE 4 --> 4.578125 sigma out 1act.( 7.35510874 sig in 12act.) RANK 11 NODE 2 --> 4.13498449 sigma out 1act.( 5.55345488 sig in 12act.) RANK 12 NODE 8 --> 4.01395035 sigma out 1act.( 5.13510132 sig in 12act.) RANK 13 NODE 13 --> 2.9623034 sigma out 1act.( 5.77136946 sig in 12act.) RANK 14 NODE 10 --> 2.30103898 sigma out 1act.( 4.42699432 sig in 12act.) RANK 15 NODE 15 --> 0.413334519 sigma out 1act.( 1.03142595 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 41.2817459 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.586965144 *** contribution from regularisation: 0.00316514657 *** contribution from error: -0.59013027 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50831.768 0.462958425 93.5147095 EXIT FROM BFGS code FG_LNSRCH 0. 0.590516448 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.59225142 *** contribution from regularisation: 0.00329609541 *** contribution from error: -0.595547497 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51289.5677 0.590516448 -14.3240404 EXIT FROM BFGS code FG_LNSRCH 0. 0.602050841 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.592286646 *** contribution from regularisation: 0.00307395472 *** contribution from error: -0.595360577 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51292.6143 0.602050841 -29.2491913 EXIT FROM BFGS code FG_LNSRCH 0. 0.603611767 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.592200041 *** contribution from regularisation: 0.00312702823 *** contribution from error: -0.595327079 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51285.1154 0.603611767 -30.323555 EXIT FROM BFGS code FG_LNSRCH 0. 0.603666604 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.592207015 *** contribution from regularisation: 0.00311892433 *** contribution from error: -0.595325947 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51285.7174 0.603666604 -30.3257275 EXIT FROM BFGS code FG_LNSRCH 0. 0.603666663 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.592236936 *** contribution from regularisation: 0.0030889546 *** contribution from error: -0.595325887 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51288.3127 0.603666663 -30.2837963 EXIT FROM BFGS code FG_LNSRCH 0. 0.603666663 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.59220612 *** contribution from regularisation: 0.00311977975 *** contribution from error: -0.595325887 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51285.6432 0.603666663 -30.41992 EXIT FROM BFGS code FG_LNSRCH 0. 0.603666663 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.592231274 *** contribution from regularisation: 0.00309466757 *** contribution from error: -0.595325947 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51287.818 0.603666663 -30.322855 EXIT FROM BFGS code NEW_X -51287.818 0.603666663 -30.322855 ENTER BFGS code NEW_X -51287.818 0.603666663 -30.322855 EXIT FROM BFGS code CONVERGENC -51287.818 0.603666663 -30.322855 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 47.1216202 sigma out 15 active outputs RANK 2 NODE 9 --> 25.949667 sigma out 15 active outputs RANK 3 NODE 1 --> 24.2076263 sigma out 15 active outputs RANK 4 NODE 8 --> 22.2689438 sigma out 15 active outputs RANK 5 NODE 4 --> 21.812151 sigma out 15 active outputs RANK 6 NODE 2 --> 20.8600025 sigma out 15 active outputs RANK 7 NODE 10 --> 14.7277622 sigma out 15 active outputs RANK 8 NODE 6 --> 12.9512911 sigma out 15 active outputs RANK 9 NODE 11 --> 12.704401 sigma out 15 active outputs RANK 10 NODE 3 --> 12.3775063 sigma out 15 active outputs RANK 11 NODE 7 --> 10.5383654 sigma out 15 active outputs RANK 12 NODE 5 --> 10.0830107 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 31.7637558 sigma in 12act. ( 25.32164 sig out 1act.) RANK 2 NODE 6 --> 30.8297768 sigma in 12act. ( 22.4123936 sig out 1act.) RANK 3 NODE 3 --> 29.2614746 sigma in 12act. ( 24.2555676 sig out 1act.) RANK 4 NODE 9 --> 26.3348083 sigma in 12act. ( 25.8270245 sig out 1act.) RANK 5 NODE 14 --> 25.1218109 sigma in 12act. ( 20.8081951 sig out 1act.) RANK 6 NODE 7 --> 19.255518 sigma in 12act. ( 18.8255291 sig out 1act.) RANK 7 NODE 12 --> 17.946682 sigma in 12act. ( 15.3863535 sig out 1act.) RANK 8 NODE 5 --> 17.3240032 sigma in 12act. ( 14.4704161 sig out 1act.) RANK 9 NODE 11 --> 13.1495924 sigma in 12act. ( 13.2544775 sig out 1act.) RANK 10 NODE 2 --> 11.1581745 sigma in 12act. ( 9.49597168 sig out 1act.) RANK 11 NODE 4 --> 10.8836842 sigma in 12act. ( 8.74315357 sig out 1act.) RANK 12 NODE 10 --> 9.77135563 sigma in 12act. ( 7.64567614 sig out 1act.) RANK 13 NODE 13 --> 8.83955765 sigma in 12act. ( 7.57963467 sig out 1act.) RANK 14 NODE 8 --> 8.61682129 sigma in 12act. ( 7.26053858 sig out 1act.) RANK 15 NODE 15 --> 1.28011596 sigma in 12act. ( 0.466168076 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 25.8270245 sigma out 1act.( 26.3348083 sig in 12act.) RANK 2 NODE 1 --> 25.32164 sigma out 1act.( 31.7637558 sig in 12act.) RANK 3 NODE 3 --> 24.2555676 sigma out 1act.( 29.2614746 sig in 12act.) RANK 4 NODE 6 --> 22.4123936 sigma out 1act.( 30.8297768 sig in 12act.) RANK 5 NODE 14 --> 20.8081951 sigma out 1act.( 25.1218109 sig in 12act.) RANK 6 NODE 7 --> 18.8255291 sigma out 1act.( 19.255518 sig in 12act.) RANK 7 NODE 12 --> 15.3863535 sigma out 1act.( 17.946682 sig in 12act.) RANK 8 NODE 5 --> 14.4704161 sigma out 1act.( 17.3240032 sig in 12act.) RANK 9 NODE 11 --> 13.2544775 sigma out 1act.( 13.1495924 sig in 12act.) RANK 10 NODE 2 --> 9.49597168 sigma out 1act.( 11.1581745 sig in 12act.) RANK 11 NODE 4 --> 8.74315357 sigma out 1act.( 10.8836842 sig in 12act.) RANK 12 NODE 10 --> 7.64567614 sigma out 1act.( 9.77135563 sig in 12act.) RANK 13 NODE 13 --> 7.57963467 sigma out 1act.( 8.83955765 sig in 12act.) RANK 14 NODE 8 --> 7.26053858 sigma out 1act.( 8.61682129 sig in 12act.) RANK 15 NODE 15 --> 0.466168076 sigma out 1act.( 1.28011596 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.3701782 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.592232049 *** contribution from regularisation: 0.00309387408 *** contribution from error: -0.595325947 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done