NNInput NNInputs_195.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 165339 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 25539 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 25539 Chosen entries: 25539 Signal fraction: 1 Background fraction: 0.182682 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 25539 Entries to split: 25539 Test with : 12769 Train with : 12769 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 25539 for Signal Prepared event 0 for Signal with 25539 events ====Entry 0 Variable Ht : 225.901 Variable LepAPt : 63.638 Variable LepBPt : 23.389 Variable MetSigLeptonsJets : 9.51092 Variable MetSpec : 104.705 Variable SumEtLeptonsJets : 121.196 Variable VSumJetLeptonsPt : 96.1224 Variable addEt : 191.732 Variable dPhiLepSumMet : 2.687 Variable dPhiLeptons : 0.342211 Variable dRLeptons : 0.346978 Variable lep1_E : 71.8454 Variable lep2_E : 25.7459 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2195 Ht = 225.901 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 63.6382 LepAPt = 63.638 LepBEt = 23.389 LepBPt = 23.389 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 104.705 MetDelPhi = 2.13998 MetSig = 7.54777 MetSigLeptonsJets = 9.51092 MetSpec = 104.705 Mjj = 0 MostCentralJetEta = 2.45448 MtllMet = 197.429 Njets = 1 SB = 0 SumEt = 192.44 SumEtJets = 0 SumEtLeptonsJets = 121.196 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 96.1224 addEt = 191.732 dPhiLepSumMet = 2.687 dPhiLeptons = 0.342211 dRLeptons = 0.346978 diltype = 47 dimass = 13.3241 event = 561 jet1_Et = 34.1693 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.8454 lep2_E = 25.7459 rand = 0.999742 run = 228576 weight = 1.92787e-06 ===Show End Prepared event 10000 for Signal with 25539 events Prepared event 20000 for Signal with 25539 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.145208 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4489 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 165339 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4489 negative weights. Signal fraction: 62.4512177 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1206551 65.3497543 67.3083191 68.6109924 69.6481781 70.5043945 71.3599472 72.1359711 73.0359344 73.7353821 74.3134613 75.0531693 75.6778717 76.4407654 77.0657654 77.6946945 78.4313049 79.1113892 79.6647339 80.4063721 81.1632843 81.8215027 82.5718994 83.4150848 84.3308487 85.3327789 86.4958496 87.4172363 88.6290131 89.6545563 91.3544998 92.9326172 94.6669846 96.1816254 97.7346268 99.4610138 100.957947 102.697525 104.119644 105.752213 107.345444 109.051689 110.897018 112.48053 113.94693 115.804573 117.424629 119.177002 120.502968 122.4328 123.950737 125.897568 127.739929 129.191681 130.733673 132.446823 134.150452 135.65451 137.21431 138.813721 140.615051 142.257294 143.81044 145.388947 147.085083 148.736526 150.463745 152.403625 154.200348 156.224457 158.232162 160.071411 161.988739 163.904083 165.910583 167.995453 170.168655 172.440002 174.96611 177.678711 180.409119 182.853363 185.623444 188.620712 191.487213 194.727814 198.075592 202.050262 206.249435 211.147308 216.696732 222.526306 228.854202 235.620682 244.470917 258.144623 272.785034 298.290802 342.067596 850.621887 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3570805 20.6866894 21.0228443 21.3168907 21.5735855 21.8238144 22.0251331 22.2807007 22.5373039 22.7627525 22.9656982 23.150774 23.3129978 23.5333996 23.7092075 23.923378 24.1715546 24.4133263 24.5907898 24.8398552 25.0935669 25.3165131 25.5208778 25.6699104 25.8809376 26.1208611 26.3339043 26.559145 26.8296356 27.086422 27.319809 27.5473061 27.822031 28.0444756 28.2548523 28.5422955 28.7779808 29.0630474 29.2813148 29.6225929 29.8772964 30.1277218 30.4288921 30.693264 31.0216446 31.4034081 31.6741867 31.9558983 32.2829514 32.6561584 32.9930649 33.3431015 33.6822052 34.0698242 34.4461899 34.8474236 35.2984734 35.67453 36.1437149 36.6207008 37.0161514 37.5154419 37.978096 38.419754 38.9211731 39.2675323 39.8107681 40.3376007 40.8137054 41.2304153 41.8218842 42.3920021 43.0213776 43.5474319 44.2001495 44.7565308 45.4041214 46.1479721 46.860878 47.552597 48.3066483 49.2159271 50.0615616 51.0270386 52.0099487 52.9816017 54.0172501 55.154213 56.4722023 57.7077637 58.915184 60.328289 62.20681 64.0463867 65.7894058 68.3036194 71.7701874 75.6641922 82.3719559 169.089767 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1231613 10.2728186 10.3938808 10.4789534 10.5900126 10.7085571 10.8522072 10.9904089 11.1206827 11.2628155 11.4004955 11.524457 11.7057743 11.8467999 11.9947014 12.1523333 12.309473 12.4751644 12.6321411 12.8033123 12.9640503 13.1459007 13.3404331 13.5145454 13.6895981 13.8464527 14.0199165 14.1846962 14.3707771 14.5899963 14.7916031 14.9931812 15.1875629 15.3660316 15.5381298 15.7367458 15.9458199 16.1544571 16.3607197 16.5687141 16.7659569 16.9499092 17.154335 17.3731194 17.6156006 17.8105698 17.9862728 18.2399139 18.4441643 18.6329727 18.8589058 19.06287 19.2933617 19.5188751 19.7243805 19.9703712 20.1655197 20.2983437 20.5068169 20.7177429 20.9260464 21.1221008 21.3259087 21.5248985 21.7285156 21.9379883 22.1022015 22.3362808 22.5898438 22.8132935 23.0591488 23.2678623 23.5085564 23.7435875 24.0096283 24.2716351 24.5398979 24.8286438 25.1127892 25.4152412 25.7188759 26.0271645 26.3908119 26.7059364 27.0793438 27.4879189 27.8493118 28.2653198 28.7321815 29.2008209 29.6953106 30.248436 30.8742676 31.6154289 32.5100708 33.5233078 34.8369179 36.8593597 40.5020523 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.1656847 2.71386814 3.08585477 3.45378566 3.71484876 3.94656515 4.11242676 4.22102642 4.34275579 4.45563507 4.55578852 4.65602446 4.77129459 4.86483622 4.95620823 5.03361225 5.11353207 5.1683712 5.24860287 5.30866289 5.37084579 5.42171764 5.47140884 5.52012348 5.57189941 5.62354183 5.67098141 5.72461557 5.77898598 5.81864262 5.86413574 5.91293669 5.96197796 6.01340723 6.0558939 6.09928608 6.14372063 6.18491936 6.2305789 6.27742481 6.32069731 6.36073446 6.40562105 6.44760418 6.49921513 6.54709148 6.59721756 6.63596153 6.67426586 6.72276783 6.76510048 6.81254959 6.86345005 6.91471958 6.96655703 7.01145267 7.06269264 7.12748241 7.18336153 7.25134802 7.30856323 7.36774063 7.42917347 7.48364782 7.53352833 7.59332657 7.65062237 7.70685291 7.7842617 7.84204197 7.90097666 7.95972919 8.01841354 8.08400345 8.14439201 8.20665455 8.26491737 8.33033371 8.39699936 8.46488571 8.54058838 8.60816956 8.68848324 8.76782036 8.84405518 8.92300224 9.00828934 9.10520935 9.21936607 9.32699299 9.42240334 9.53271103 9.67241573 9.8116436 9.98126125 10.201767 10.4586544 10.7677803 11.2227058 12.1254168 19.0882549 ------------------------------ Transdef: Tab for variable 6 15.024827 22.0120869 25.625927 26.6051693 27.5975285 28.6315422 29.4414654 30.1990204 30.88517 31.4957256 32.0739746 32.5911331 33.0574722 33.5547485 34.0437546 34.5222206 34.90625 35.3331985 35.7854958 36.2474174 36.5972176 37.0038795 37.3644562 37.7309418 38.1517487 38.5097885 38.8955765 39.269043 39.6151123 39.9060974 40.2662811 40.5225067 40.9845543 41.4622231 41.9241638 42.3056107 42.8466415 43.124897 43.704525 44.1185722 44.6261826 45.1856232 45.8538704 46.4917831 47.0751648 47.7762375 48.4444885 49.0203705 49.8215218 50.3830261 51.0944366 51.9688492 52.7860298 53.4986115 54.3876686 55.2553711 56.0026321 56.8468513 57.5205536 58.3397751 58.8903732 59.7794647 60.6170769 61.470932 62.3489723 63.2327881 64.018158 64.835434 65.6954346 66.5907974 67.4536819 68.4136658 69.2791901 70.1430206 71.0355225 71.9264145 72.8824005 73.8565521 74.9302673 75.929245 76.7117691 77.5342026 78.7699738 79.8795624 81.1494904 82.4215546 83.7172623 85.0402832 86.4712677 88.1036682 89.8935699 91.6951599 93.6796951 96.0195236 98.562355 101.373184 105.676201 111.159889 118.991463 131.777313 252.419907 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.957386 33.9193192 34.6482544 35.3087578 35.716877 36.1341896 36.4802322 36.9097176 37.2843781 37.6476784 38.0120163 38.3201065 38.6627235 38.9531555 39.2392769 39.5084648 39.8450127 40.222435 40.5266724 40.9008369 41.2519302 41.5274734 41.8954659 42.3018265 42.7589035 43.2384262 43.9199524 44.5190773 45.1029587 45.6932297 46.5953369 47.5318489 48.4953842 49.4139824 50.4529648 51.5165863 52.6913147 53.6893768 54.9109993 56.0160599 57.0108261 57.892746 58.8130035 59.7843437 60.8000679 61.3359795 62.2119637 63.0286255 63.9094772 64.8889999 65.8082809 66.7422333 67.6476212 68.5802307 69.4573593 70.4155426 71.3492126 72.166153 73.1370392 74.1237946 75.2121277 76.376152 77.2784576 78.4477692 79.6402588 80.7659302 81.9453278 83.1449127 84.376564 85.6181183 86.8192291 88.1877747 89.6022949 91.0742035 92.5237656 94.2101288 95.9184036 97.6114883 99.5731049 101.444885 103.324066 105.392502 107.631607 110.04847 112.44825 115.317604 118.309074 121.671501 125.041695 129.189453 133.914368 138.750717 144.24173 150.292816 157.044769 166.381134 181.058441 200.498016 237.331009 533.67572 ------------------------------ Transdef: Tab for variable 8 3.10723281 25.6228828 29.6322575 31.2651405 32.1562119 32.9497757 33.453331 33.9350128 34.4597931 34.9236069 35.2172699 35.5356293 35.9326706 36.2423859 36.57407 36.9160843 37.2142181 37.4930916 37.754715 38.0607605 38.3484879 38.6304703 38.8560791 39.1288338 39.3336868 39.6955643 40.0207367 40.2949944 40.5927505 40.9386902 41.3257256 41.6814919 42.0645294 42.479126 42.8875732 43.3465805 43.7237167 44.2449493 44.8236923 45.3560028 46.0163879 46.6746254 47.3524551 48.0202026 48.6707153 49.2333298 49.8595657 50.621933 51.2998428 52.1145287 52.9011383 53.6191864 54.4227142 55.1971436 55.9434357 56.6504211 57.3949661 58.1433334 58.8063087 59.6461258 60.4124908 61.0986443 61.7500153 62.4372826 63.1705017 63.9362259 64.6988068 65.4261703 66.161026 66.7908478 67.5267105 68.3258362 69.1631165 69.913208 70.6777191 71.5446854 72.2887573 73.2181549 74.1103973 75.0360413 75.9627228 76.9944611 77.9497986 78.9742966 80.0303802 81.3763123 82.6789703 84.0629425 85.499588 87.0350723 88.6015167 90.5435333 92.971756 95.3403473 97.8513718 101.408394 106.049271 111.534775 120.495422 137.397766 344.837463 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7685928 64.7364807 66.4830933 67.9063644 68.993576 69.852684 70.5450287 71.3595963 72.0096436 72.838913 73.4499207 74.0260468 74.7081146 75.3352661 75.9159088 76.5854797 77.0922089 77.6520996 78.2599716 78.856041 79.3626328 79.934021 80.5471039 81.2460327 81.7797928 82.4030609 83.1583099 83.827301 84.5343933 85.3673096 86.3037338 86.9334259 87.7280273 88.7194061 89.6243896 90.6996155 92.0008316 93.2106323 94.6876373 95.9181366 97.0351715 98.5380325 99.9000397 101.376968 102.654526 104.125595 105.608482 106.977524 108.334488 109.826744 111.409294 112.784943 114.147705 115.630936 116.882683 118.281128 119.717735 120.734489 122.067841 123.559067 124.830826 126.272133 127.536926 128.790955 129.963074 131.342529 132.620911 133.968109 135.157928 136.440094 137.640396 138.88356 140.08902 141.3508 142.645889 143.992722 145.338699 146.756561 148.243652 149.660461 151.1008 152.607101 154.16037 155.890228 157.513885 159.101135 160.962433 162.888702 165.034485 167.058594 169.357269 171.821014 174.542908 177.799896 181.392578 185.805267 191.607712 198.829285 215.297394 422.705414 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.939740717 1.30340004 1.54336739 1.72661948 1.86442721 1.97272205 2.07025671 2.15089655 2.21306419 2.26588058 2.31561995 2.35787392 2.39437103 2.4343183 2.4662528 2.49943805 2.53000522 2.56011486 2.58410549 2.6102047 2.6327436 2.65786982 2.6834445 2.70380878 2.72227001 2.74040079 2.75700474 2.77236938 2.78610969 2.80212831 2.8158617 2.82778192 2.83989525 2.85166025 2.86046791 2.870399 2.87998819 2.88928246 2.89817071 2.90592146 2.91458464 2.92236423 2.92953825 2.93659806 2.94440508 2.95055485 2.95691729 2.96367121 2.96912956 2.97575712 2.98153591 2.98659396 2.99092102 2.99406862 2.99963188 3.00496721 3.00937963 3.01399112 3.01817608 3.02243042 3.02624702 3.0294733 3.03374577 3.03704143 3.04138732 3.04564333 3.04985309 3.05338573 3.05752945 3.06066656 3.06427097 3.06710172 3.07075214 3.07370615 3.07633853 3.07977915 3.08308434 3.08623695 3.08894515 3.09203959 3.09469604 3.0972383 3.10012007 3.10265422 3.10526657 3.1082325 3.11114478 3.11343527 3.11586428 3.11821961 3.1203208 3.12256098 3.12513113 3.12746859 3.12947464 3.13158464 3.13384676 3.13622189 3.13875246 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.62124634E-05 0.00537742162 0.0092035532 0.015762452 0.0233559608 0.0296888351 0.037198782 0.0452108383 0.0523769855 0.0594890155 0.0663727447 0.0739735365 0.081912756 0.0897451639 0.0972268134 0.105183959 0.110554814 0.117772222 0.124129534 0.131822199 0.139493108 0.146427155 0.15364778 0.159283996 0.165497899 0.173105016 0.179410696 0.184749246 0.189695269 0.196169615 0.201447964 0.206554651 0.210835576 0.216576934 0.222382069 0.227601647 0.233025432 0.239028513 0.244130254 0.249288559 0.254860938 0.259971023 0.264999211 0.269654512 0.274790287 0.280132473 0.284765512 0.290834188 0.296026826 0.300733089 0.306629717 0.311602175 0.31713751 0.322837174 0.328569114 0.333921194 0.339613855 0.345093191 0.350484252 0.355455518 0.360767365 0.366412818 0.37203908 0.377815843 0.38445133 0.38975513 0.39588362 0.400719404 0.406708717 0.413294554 0.419506431 0.426274776 0.432860434 0.439146906 0.446103632 0.452445298 0.45952034 0.466275215 0.47393024 0.481148124 0.490273058 0.499217033 0.507736266 0.516919374 0.52583456 0.536557794 0.544446349 0.553686857 0.566273868 0.579948187 0.592661262 0.608321428 0.626066089 0.644760907 0.65986377 0.681965232 0.708092272 0.735530496 0.781512618 0.845724344 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.212773308 0.223588943 0.233176619 0.242244661 0.250939131 0.259059817 0.265976429 0.272523135 0.278593212 0.285493344 0.291460186 0.297998518 0.303726494 0.310226589 0.315741301 0.321161449 0.326598942 0.331515014 0.337314665 0.343522429 0.348395556 0.353054225 0.35719049 0.362404943 0.368158817 0.373567253 0.378228903 0.38457036 0.389597416 0.394436657 0.39875257 0.403498352 0.407734096 0.41110301 0.414439589 0.418253481 0.421853453 0.425454438 0.428787649 0.432538837 0.43626231 0.439525604 0.443298459 0.446526289 0.450437427 0.454779088 0.458448648 0.462689102 0.46616739 0.470445395 0.473745137 0.476881683 0.480963796 0.484862566 0.489283562 0.493347347 0.497326374 0.501294255 0.506176829 0.510781407 0.515673757 0.520386696 0.524340987 0.53008616 0.534967542 0.539994955 0.545008004 0.548912764 0.553919852 0.559205711 0.564387202 0.570261955 0.576842904 0.582030773 0.588824868 0.596450806 0.602514148 0.611062169 0.618629634 0.626243711 0.633460939 0.640618622 0.64999783 0.659274817 0.667295456 0.676026583 0.685446024 0.69742465 0.706630945 0.720545292 0.734977782 0.747455478 0.759282887 0.775525689 0.795119166 0.812962651 0.834628642 0.864432096 0.915789902 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0123215 21.7606163 22.4943047 23.2388039 23.7617817 24.374115 24.905983 25.3878574 25.8656425 26.3561287 26.8707085 27.3132458 27.6986752 28.1226807 28.5650406 28.9139462 29.3445396 29.6790657 30.0720406 30.4252071 30.8064079 31.0792809 31.5248222 31.8851604 32.2805862 32.6285172 33.0503426 33.4205399 33.7770691 34.1622696 34.5079842 34.8970413 35.2662926 35.6977081 36.1012955 36.3741531 36.8576736 37.3013573 37.7470627 38.1965408 38.6657219 39.1268959 39.6147766 40.1263008 40.5484238 40.9994202 41.4211349 41.9194946 42.4246902 42.8811913 43.3923111 43.8431778 44.3573074 44.8544159 45.3354149 45.8765793 46.4135971 46.9567108 47.5101852 48.0399284 48.525238 49.096489 49.680809 50.3239517 50.9347458 51.6706161 52.3367081 53.0095863 53.7596817 54.5783768 55.2808304 56.0011673 56.7738457 57.5462646 58.2989273 59.0581512 59.9258957 60.701828 61.5687943 62.3631439 63.2730637 64.3446045 65.3509674 66.3988724 67.3099365 68.188324 69.4204025 70.5417938 72.0956421 73.5673218 74.9314575 76.7497406 78.5766068 80.8992691 83.1921158 86.8683014 89.3036194 93.1960983 99.0639954 109.554871 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.6296511 11.0907898 11.4971428 11.8703899 12.2763729 12.6027927 12.9727859 13.3121815 13.6287365 13.9052601 14.230896 14.5564451 14.8341579 15.1763182 15.4834003 15.7919083 16.0528393 16.370945 16.671505 16.9255333 17.1865349 17.4178543 17.7175426 17.9258804 18.2035141 18.4733391 18.7036762 18.9843044 19.1696033 19.4372978 19.7289906 19.9834099 20.236948 20.5109253 20.7433434 20.9697304 21.2131348 21.448616 21.6587906 21.8940182 22.140789 22.3690758 22.630249 22.9021759 23.1371307 23.3966637 23.6368103 23.8812428 24.1464176 24.380991 24.5993977 24.8771687 25.0906715 25.3305397 25.5444069 25.808075 26.0486832 26.3031387 26.5426712 26.8034592 27.0871754 27.3804817 27.6487465 27.8977032 28.066288 28.3267822 28.5914307 28.9049492 29.2161789 29.5102806 29.8027573 30.1105347 30.4640923 30.8704681 31.2121887 31.5157127 31.9080391 32.3047104 32.7034721 33.0987091 33.4475403 33.8595657 34.3026047 34.8476906 35.3928223 35.9114532 36.6426544 37.2838058 37.9799843 38.8464813 39.8293114 40.7148552 41.884037 43.2448196 45.0011978 47.2729454 50.0484543 53.6000443 60.2444763 112.712608 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.8 52.7 51.3 31.7 51.3 63.5 55.7 64.1 -25.1 -18.4 -40.7 18.6 16.8 2 65.8 100.0 69.3 55.1 42.5 72.1 94.7 78.0 92.6 -43.5 -24.6 -51.4 38.2 23.9 3 52.7 69.3 100.0 40.9 22.2 44.7 70.5 60.7 77.0 -12.8 -27.5 -58.6 68.1 14.9 4 51.3 55.1 40.9 100.0 13.2 33.1 57.4 45.8 57.7 -12.9 -28.8 -59.4 18.5 67.2 5 31.7 42.5 22.2 13.2 100.0 85.2 16.3 62.5 62.3 20.5 -7.1 -15.3 7.3 -1.9 6 51.3 72.1 44.7 33.1 85.2 100.0 52.3 81.1 82.2 -6.6 -16.2 -33.4 20.6 9.0 7 63.5 94.7 70.5 57.4 16.3 52.3 100.0 70.0 81.8 -52.5 -24.4 -51.9 40.4 27.7 8 55.7 78.0 60.7 45.8 62.5 81.1 70.0 100.0 85.6 -12.2 -24.3 -46.4 33.6 19.0 9 64.1 92.6 77.0 57.7 62.3 82.2 81.8 85.6 100.0 -20.0 -26.7 -56.8 45.1 25.7 10 -25.1 -43.5 -12.8 -12.9 20.5 -6.6 -52.5 -12.2 -20.0 100.0 2.9 8.4 -3.6 -4.1 11 -18.4 -24.6 -27.5 -28.8 -7.1 -16.2 -24.4 -24.3 -26.7 2.9 100.0 53.5 -14.4 -16.7 12 -40.7 -51.4 -58.6 -59.4 -15.3 -33.4 -51.9 -46.4 -56.8 8.4 53.5 100.0 -33.6 -31.2 13 18.6 38.2 68.1 18.5 7.3 20.6 40.4 33.6 45.1 -3.6 -14.4 -33.6 100.0 41.4 14 16.8 23.9 14.9 67.2 -1.9 9.0 27.7 19.0 25.7 -4.1 -16.7 -31.2 41.4 100.0 TOTAL CORRELATION TO TARGET (diagonal) 166.964229 TOTAL CORRELATION OF ALL VARIABLES 72.5416381 ROUND 1: MAX CORR ( 72.5403176) AFTER KILLING INPUT VARIABLE 8 CONTR 0.4377026 ROUND 2: MAX CORR ( 72.5342526) AFTER KILLING INPUT VARIABLE 11 CONTR 0.938021675 ROUND 3: MAX CORR ( 72.4520414) AFTER KILLING INPUT VARIABLE 12 CONTR 3.45246121 ROUND 4: MAX CORR ( 72.3580943) AFTER KILLING INPUT VARIABLE 10 CONTR 3.68842662 ROUND 5: MAX CORR ( 72.2459212) AFTER KILLING INPUT VARIABLE 14 CONTR 4.02749205 ROUND 6: MAX CORR ( 72.1222638) AFTER KILLING INPUT VARIABLE 6 CONTR 4.22518556 ROUND 7: MAX CORR ( 71.8913618) AFTER KILLING INPUT VARIABLE 2 CONTR 5.76654428 ROUND 8: MAX CORR ( 71.2602233) AFTER KILLING INPUT VARIABLE 9 CONTR 9.50518108 ROUND 9: MAX CORR ( 69.6718312) AFTER KILLING INPUT VARIABLE 13 CONTR 14.9617971 ROUND 10: MAX CORR ( 69.2129133) AFTER KILLING INPUT VARIABLE 3 CONTR 7.98352653 ROUND 11: MAX CORR ( 67.0677547) AFTER KILLING INPUT VARIABLE 4 CONTR 17.0980597 ROUND 12: MAX CORR ( 63.4804538) AFTER KILLING INPUT VARIABLE 5 CONTR 21.6406031 LAST REMAINING VARIABLE: 7 total correlation to target: 72.5416381 % total significance: 103.869905 sigma correlations of single variables to target: variable 2: 65.8054554 % , in sigma: 94.2245941 variable 3: 52.6729884 % , in sigma: 75.4206611 variable 4: 51.267647 % , in sigma: 73.4084005 variable 5: 31.7272034 % , in sigma: 45.4291037 variable 6: 51.3435507 % , in sigma: 73.5170845 variable 7: 63.4804538 % , in sigma: 90.8955034 variable 8: 55.7171538 % , in sigma: 79.779498 variable 9: 64.1204706 % , in sigma: 91.8119217 variable 10: -25.0642151 % , in sigma: 35.8885974 variable 11: -18.4349022 % , in sigma: 26.3963096 variable 12: -40.7473296 % , in sigma: 58.3447159 variable 13: 18.5543084 % , in sigma: 26.5672834 variable 14: 16.8176395 % , in sigma: 24.0806062 variables sorted by significance: 1 most relevant variable 7 corr 63.4804535 , in sigma: 90.895503 2 most relevant variable 5 corr 21.640604 , in sigma: 30.9864451 3 most relevant variable 4 corr 17.0980606 , in sigma: 24.4821316 4 most relevant variable 3 corr 7.98352671 , in sigma: 11.4313404 5 most relevant variable 13 corr 14.9617968 , in sigma: 21.4232881 6 most relevant variable 9 corr 9.50518131 , in sigma: 13.6101459 7 most relevant variable 2 corr 5.76654434 , in sigma: 8.25691878 8 most relevant variable 6 corr 4.22518539 , in sigma: 6.04989931 9 most relevant variable 14 corr 4.02749205 , in sigma: 5.76682892 10 most relevant variable 10 corr 3.68842673 , in sigma: 5.28133283 11 most relevant variable 12 corr 3.45246124 , in sigma: 4.94346187 12 most relevant variable 11 corr 0.93802166 , in sigma: 1.34312132 13 most relevant variable 8 corr 0.437702596 , in sigma: 0.626731465 global correlations between input variables: variable 2: 99.2538003 % variable 3: 94.1539996 % variable 4: 90.5489299 % variable 5: 95.6324871 % variable 6: 94.7838736 % variable 7: 98.8491965 % variable 8: 91.1775666 % variable 9: 98.9656488 % variable 10: 71.9506257 % variable 11: 54.6469619 % variable 12: 77.5387515 % variable 13: 86.7213073 % variable 14: 86.6010237 % significance loss when removing single variables: variable 2: corr = 3.66129161 % , sigma = 5.24247897 variable 3: corr = 15.5681948 % , sigma = 22.2915689 variable 4: corr = 16.5911653 % , sigma = 23.7563255 variable 5: corr = 10.0344941 % , sigma = 14.3680509 variable 6: corr = 4.04746018 % , sigma = 5.79542061 variable 7: corr = 5.06260636 % , sigma = 7.24897391 variable 8: corr = 0.4377026 % , sigma = 0.626731471 variable 9: corr = 10.0857089 % , sigma = 14.4413837 variable 10: corr = 3.52043297 % , sigma = 5.04078827 variable 11: corr = 0.901471606 % , sigma = 1.29078654 variable 12: corr = 2.65646029 % , sigma = 3.80369516 variable 13: corr = 6.64445752 % , sigma = 9.51397281 variable 14: corr = 4.11636471 % , sigma = 5.89408267 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 15.883462 sigma out 15 active outputs RANK 2 NODE 1 --> 15.0779276 sigma out 15 active outputs RANK 3 NODE 11 --> 14.5459118 sigma out 15 active outputs RANK 4 NODE 3 --> 12.7667913 sigma out 15 active outputs RANK 5 NODE 6 --> 12.6925831 sigma out 15 active outputs RANK 6 NODE 5 --> 12.3581486 sigma out 15 active outputs RANK 7 NODE 12 --> 11.6889801 sigma out 15 active outputs RANK 8 NODE 4 --> 9.68847656 sigma out 15 active outputs RANK 9 NODE 7 --> 8.51823044 sigma out 15 active outputs RANK 10 NODE 2 --> 7.29992962 sigma out 15 active outputs RANK 11 NODE 10 --> 6.02175283 sigma out 15 active outputs RANK 12 NODE 9 --> 5.75167465 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 20.3538971 sigma in 12act. ( 20.6637783 sig out 1act.) RANK 2 NODE 4 --> 19.2034206 sigma in 12act. ( 20.194931 sig out 1act.) RANK 3 NODE 9 --> 16.3937225 sigma in 12act. ( 17.2310638 sig out 1act.) RANK 4 NODE 10 --> 14.0466547 sigma in 12act. ( 14.3769541 sig out 1act.) RANK 5 NODE 14 --> 8.02600098 sigma in 12act. ( 7.46366978 sig out 1act.) RANK 6 NODE 13 --> 7.15529156 sigma in 12act. ( 6.56883383 sig out 1act.) RANK 7 NODE 15 --> 6.79729128 sigma in 12act. ( 8.07515717 sig out 1act.) RANK 8 NODE 8 --> 6.35566759 sigma in 12act. ( 7.53403854 sig out 1act.) RANK 9 NODE 5 --> 6.20308542 sigma in 12act. ( 5.73854542 sig out 1act.) RANK 10 NODE 7 --> 5.19535875 sigma in 12act. ( 5.31140327 sig out 1act.) RANK 11 NODE 1 --> 4.65231991 sigma in 12act. ( 4.90602684 sig out 1act.) RANK 12 NODE 11 --> 4.54990959 sigma in 12act. ( 2.54298735 sig out 1act.) RANK 13 NODE 6 --> 3.98032165 sigma in 12act. ( 3.03520083 sig out 1act.) RANK 14 NODE 2 --> 3.68758726 sigma in 12act. ( 4.25669956 sig out 1act.) RANK 15 NODE 3 --> 2.26603889 sigma in 12act. ( 1.16184795 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 20.6637783 sigma out 1act.( 20.3538971 sig in 12act.) RANK 2 NODE 4 --> 20.194931 sigma out 1act.( 19.2034206 sig in 12act.) RANK 3 NODE 9 --> 17.2310638 sigma out 1act.( 16.3937225 sig in 12act.) RANK 4 NODE 10 --> 14.3769541 sigma out 1act.( 14.0466547 sig in 12act.) RANK 5 NODE 15 --> 8.07515717 sigma out 1act.( 6.79729128 sig in 12act.) RANK 6 NODE 8 --> 7.53403854 sigma out 1act.( 6.35566759 sig in 12act.) RANK 7 NODE 14 --> 7.46366978 sigma out 1act.( 8.02600098 sig in 12act.) RANK 8 NODE 13 --> 6.56883383 sigma out 1act.( 7.15529156 sig in 12act.) RANK 9 NODE 5 --> 5.73854542 sigma out 1act.( 6.20308542 sig in 12act.) RANK 10 NODE 7 --> 5.31140327 sigma out 1act.( 5.19535875 sig in 12act.) RANK 11 NODE 1 --> 4.90602684 sigma out 1act.( 4.65231991 sig in 12act.) RANK 12 NODE 2 --> 4.25669956 sigma out 1act.( 3.68758726 sig in 12act.) RANK 13 NODE 6 --> 3.03520083 sigma out 1act.( 3.98032165 sig in 12act.) RANK 14 NODE 11 --> 2.54298735 sigma out 1act.( 4.54990959 sig in 12act.) RANK 15 NODE 3 --> 1.16184795 sigma out 1act.( 2.26603889 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 40.9831505 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 24.5043049 sigma out 15 active outputs RANK 2 NODE 11 --> 16.3129177 sigma out 15 active outputs RANK 3 NODE 1 --> 15.7259636 sigma out 15 active outputs RANK 4 NODE 6 --> 14.2206688 sigma out 15 active outputs RANK 5 NODE 3 --> 13.6914358 sigma out 15 active outputs RANK 6 NODE 12 --> 13.4791737 sigma out 15 active outputs RANK 7 NODE 5 --> 13.3794079 sigma out 15 active outputs RANK 8 NODE 4 --> 10.4627399 sigma out 15 active outputs RANK 9 NODE 7 --> 9.56833839 sigma out 15 active outputs RANK 10 NODE 9 --> 8.8244915 sigma out 15 active outputs RANK 11 NODE 2 --> 8.57944679 sigma out 15 active outputs RANK 12 NODE 10 --> 6.35969782 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 23.0981236 sigma in 12act. ( 19.6315689 sig out 1act.) RANK 2 NODE 12 --> 19.9998417 sigma in 12act. ( 19.185667 sig out 1act.) RANK 3 NODE 9 --> 17.9372635 sigma in 12act. ( 16.2597275 sig out 1act.) RANK 4 NODE 10 --> 14.1613531 sigma in 12act. ( 13.1880817 sig out 1act.) RANK 5 NODE 15 --> 12.0210228 sigma in 12act. ( 9.02860737 sig out 1act.) RANK 6 NODE 8 --> 11.4132519 sigma in 12act. ( 8.24684525 sig out 1act.) RANK 7 NODE 5 --> 10.5127907 sigma in 12act. ( 5.68525219 sig out 1act.) RANK 8 NODE 2 --> 10.0183229 sigma in 12act. ( 6.88924837 sig out 1act.) RANK 9 NODE 14 --> 8.43710041 sigma in 12act. ( 6.36104822 sig out 1act.) RANK 10 NODE 1 --> 8.18676376 sigma in 12act. ( 5.67344522 sig out 1act.) RANK 11 NODE 13 --> 7.08812094 sigma in 12act. ( 4.55999899 sig out 1act.) RANK 12 NODE 11 --> 7.06760931 sigma in 12act. ( 1.39542496 sig out 1act.) RANK 13 NODE 7 --> 6.39601707 sigma in 12act. ( 5.30356741 sig out 1act.) RANK 14 NODE 6 --> 4.30952168 sigma in 12act. ( 1.44937396 sig out 1act.) RANK 15 NODE 3 --> 4.22652197 sigma in 12act. ( 0.680930495 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 19.6315689 sigma out 1act.( 23.0981236 sig in 12act.) RANK 2 NODE 12 --> 19.185667 sigma out 1act.( 19.9998417 sig in 12act.) RANK 3 NODE 9 --> 16.2597275 sigma out 1act.( 17.9372635 sig in 12act.) RANK 4 NODE 10 --> 13.1880817 sigma out 1act.( 14.1613531 sig in 12act.) RANK 5 NODE 15 --> 9.02860737 sigma out 1act.( 12.0210228 sig in 12act.) RANK 6 NODE 8 --> 8.24684525 sigma out 1act.( 11.4132519 sig in 12act.) RANK 7 NODE 2 --> 6.88924837 sigma out 1act.( 10.0183229 sig in 12act.) RANK 8 NODE 14 --> 6.36104822 sigma out 1act.( 8.43710041 sig in 12act.) RANK 9 NODE 5 --> 5.68525219 sigma out 1act.( 10.5127907 sig in 12act.) RANK 10 NODE 1 --> 5.67344522 sigma out 1act.( 8.18676376 sig in 12act.) RANK 11 NODE 7 --> 5.30356741 sigma out 1act.( 6.39601707 sig in 12act.) RANK 12 NODE 13 --> 4.55999899 sigma out 1act.( 7.08812094 sig in 12act.) RANK 13 NODE 6 --> 1.44937396 sigma out 1act.( 4.30952168 sig in 12act.) RANK 14 NODE 11 --> 1.39542496 sigma out 1act.( 7.06760931 sig in 12act.) RANK 15 NODE 3 --> 0.680930495 sigma out 1act.( 4.22652197 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 39.3342896 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.534973621 *** contribution from regularisation: 0.00486655068 *** contribution from error: -0.539840162 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.574910343 *** contribution from regularisation: 0.00243055355 *** contribution from error: -0.577340901 *********************************************** -----------------> Test sample ENTER BFGS code START -47535.5285 0.426003247 0.268629521 EXIT FROM BFGS code FG_START 0. 0.426003247 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.59649545 *** contribution from regularisation: 0.00209211279 *** contribution from error: -0.598587573 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49311.6805 0.426003247 36.1641388 EXIT FROM BFGS code FG_LNSRCH 0. 0.457691759 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.6080091 *** contribution from regularisation: 0.00289369817 *** contribution from error: -0.610902786 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50263.5048 0.457691759 60.9130669 EXIT FROM BFGS code NEW_X -50263.5048 0.457691759 60.9130669 ENTER BFGS code NEW_X -50263.5048 0.457691759 60.9130669 EXIT FROM BFGS code FG_LNSRCH 0. 0.498366773 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.609453321 *** contribution from regularisation: 0.00282749906 *** contribution from error: -0.612280846 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50382.8978 0.498366773 11.5833378 EXIT FROM BFGS code NEW_X -50382.8978 0.498366773 11.5833378 ENTER BFGS code NEW_X -50382.8978 0.498366773 11.5833378 EXIT FROM BFGS code FG_LNSRCH 0. 0.51816988 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.610016465 *** contribution from regularisation: 0.00267114886 *** contribution from error: -0.612687588 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50429.4522 0.51816988 -6.7665925 EXIT FROM BFGS code NEW_X -50429.4522 0.51816988 -6.7665925 ENTER BFGS code NEW_X -50429.4522 0.51816988 -6.7665925 EXIT FROM BFGS code FG_LNSRCH 0. 0.542373002 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.61035943 *** contribution from regularisation: 0.00262778951 *** contribution from error: -0.61298722 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50457.8044 0.542373002 -30.8306713 EXIT FROM BFGS code NEW_X -50457.8044 0.542373002 -30.8306713 ENTER BFGS code NEW_X -50457.8044 0.542373002 -30.8306713 EXIT FROM BFGS code FG_LNSRCH 0. 0.541738868 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.610940635 *** contribution from regularisation: 0.00251935096 *** contribution from error: -0.613460004 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50505.8497 0.541738868 -29.3813744 EXIT FROM BFGS code NEW_X -50505.8497 0.541738868 -29.3813744 ENTER BFGS code NEW_X -50505.8497 0.541738868 -29.3813744 EXIT FROM BFGS code FG_LNSRCH 0. 0.523440599 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.612156034 *** contribution from regularisation: 0.00241289684 *** contribution from error: -0.614568949 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50606.3247 0.523440599 -35.409111 EXIT FROM BFGS code NEW_X -50606.3247 0.523440599 -35.409111 ENTER BFGS code NEW_X -50606.3247 0.523440599 -35.409111 EXIT FROM BFGS code FG_LNSRCH 0. 0.419926077 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 26.5270672 sigma out 15 active outputs RANK 2 NODE 2 --> 17.0353451 sigma out 15 active outputs RANK 3 NODE 9 --> 14.4893398 sigma out 15 active outputs RANK 4 NODE 11 --> 13.5390978 sigma out 15 active outputs RANK 5 NODE 1 --> 11.8336906 sigma out 15 active outputs RANK 6 NODE 12 --> 8.27954483 sigma out 15 active outputs RANK 7 NODE 6 --> 6.9248724 sigma out 15 active outputs RANK 8 NODE 7 --> 6.87884235 sigma out 15 active outputs RANK 9 NODE 10 --> 6.00140572 sigma out 15 active outputs RANK 10 NODE 3 --> 4.88994646 sigma out 15 active outputs RANK 11 NODE 5 --> 4.62611389 sigma out 15 active outputs RANK 12 NODE 4 --> 3.77834535 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 25.9703197 sigma in 12act. ( 19.3603153 sig out 1act.) RANK 2 NODE 4 --> 20.1963768 sigma in 12act. ( 20.6696529 sig out 1act.) RANK 3 NODE 15 --> 11.4153757 sigma in 12act. ( 11.2867498 sig out 1act.) RANK 4 NODE 7 --> 11.1894045 sigma in 12act. ( 8.37229538 sig out 1act.) RANK 5 NODE 10 --> 10.8867254 sigma in 12act. ( 7.65568399 sig out 1act.) RANK 6 NODE 9 --> 10.0909023 sigma in 12act. ( 9.05503368 sig out 1act.) RANK 7 NODE 8 --> 8.18273926 sigma in 12act. ( 5.71429586 sig out 1act.) RANK 8 NODE 12 --> 8.17425442 sigma in 12act. ( 5.8132844 sig out 1act.) RANK 9 NODE 5 --> 7.4351902 sigma in 12act. ( 7.27821684 sig out 1act.) RANK 10 NODE 1 --> 4.39612389 sigma in 12act. ( 2.69387031 sig out 1act.) RANK 11 NODE 14 --> 3.17893219 sigma in 12act. ( 2.12548757 sig out 1act.) RANK 12 NODE 6 --> 1.91241312 sigma in 12act. ( 1.38398254 sig out 1act.) RANK 13 NODE 11 --> 1.47708023 sigma in 12act. ( 0.010209321 sig out 1act.) RANK 14 NODE 13 --> 1.43176329 sigma in 12act. ( 0.366109759 sig out 1act.) RANK 15 NODE 3 --> 1.41814744 sigma in 12act. ( 0.255861849 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 20.6696529 sigma out 1act.( 20.1963768 sig in 12act.) RANK 2 NODE 2 --> 19.3603153 sigma out 1act.( 25.9703197 sig in 12act.) RANK 3 NODE 15 --> 11.2867498 sigma out 1act.( 11.4153757 sig in 12act.) RANK 4 NODE 9 --> 9.05503368 sigma out 1act.( 10.0909023 sig in 12act.) RANK 5 NODE 7 --> 8.37229538 sigma out 1act.( 11.1894045 sig in 12act.) RANK 6 NODE 10 --> 7.65568399 sigma out 1act.( 10.8867254 sig in 12act.) RANK 7 NODE 5 --> 7.27821684 sigma out 1act.( 7.4351902 sig in 12act.) RANK 8 NODE 12 --> 5.8132844 sigma out 1act.( 8.17425442 sig in 12act.) RANK 9 NODE 8 --> 5.71429586 sigma out 1act.( 8.18273926 sig in 12act.) RANK 10 NODE 1 --> 2.69387031 sigma out 1act.( 4.39612389 sig in 12act.) RANK 11 NODE 14 --> 2.12548757 sigma out 1act.( 3.17893219 sig in 12act.) RANK 12 NODE 6 --> 1.38398254 sigma out 1act.( 1.91241312 sig in 12act.) RANK 13 NODE 13 --> 0.366109759 sigma out 1act.( 1.43176329 sig in 12act.) RANK 14 NODE 3 --> 0.255861849 sigma out 1act.( 1.41814744 sig in 12act.) RANK 15 NODE 11 --> 0.010209321 sigma out 1act.( 1.47708023 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 35.6855011 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.609767735 *** contribution from regularisation: 0.00247447984 *** contribution from error: -0.612242222 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50408.8868 0.419926077 93.6077728 EXIT FROM BFGS code FG_LNSRCH 0. 0.51118803 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.611737669 *** contribution from regularisation: 0.0030360911 *** contribution from error: -0.61477375 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50571.7401 0.51118803 -19.2068787 EXIT FROM BFGS code FG_LNSRCH 0. 0.522780359 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.612046182 *** contribution from regularisation: 0.0025372745 *** contribution from error: -0.614583433 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50597.246 0.522780359 -33.4288025 EXIT FROM BFGS code FG_LNSRCH 0. 0.523431778 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.611949146 *** contribution from regularisation: 0.0026199345 *** contribution from error: -0.614569068 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50589.2244 0.523431778 -33.6583214 EXIT FROM BFGS code FG_LNSRCH 0. 0.523440599 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.611917853 *** contribution from regularisation: 0.00265104044 *** contribution from error: -0.614568889 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50586.6376 0.523440599 -33.9168282 EXIT FROM BFGS code FG_LNSRCH 0. 0.523440599 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.611940145 *** contribution from regularisation: 0.0026287334 *** contribution from error: -0.614568889 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50588.4817 0.523440599 -33.8099861 EXIT FROM BFGS code FG_LNSRCH 0. 0.523440599 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.611905158 *** contribution from regularisation: 0.00266376347 *** contribution from error: -0.614568949 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50585.5858 0.523440599 -33.7047806 EXIT FROM BFGS code FG_LNSRCH 0. 0.523440599 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.611964464 *** contribution from regularisation: 0.0026044168 *** contribution from error: -0.614568889 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50590.4919 0.523440599 -33.7316513 EXIT FROM BFGS code NEW_X -50590.4919 0.523440599 -33.7316513 ENTER BFGS code NEW_X -50590.4919 0.523440599 -33.7316513 EXIT FROM BFGS code CONVERGENC -50590.4919 0.523440599 -33.7316513 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 47.6411972 sigma out 15 active outputs RANK 2 NODE 1 --> 27.0914078 sigma out 15 active outputs RANK 3 NODE 2 --> 26.2704067 sigma out 15 active outputs RANK 4 NODE 11 --> 24.9842205 sigma out 15 active outputs RANK 5 NODE 9 --> 24.8983879 sigma out 15 active outputs RANK 6 NODE 12 --> 15.8097744 sigma out 15 active outputs RANK 7 NODE 10 --> 14.3150616 sigma out 15 active outputs RANK 8 NODE 6 --> 12.9184628 sigma out 15 active outputs RANK 9 NODE 5 --> 10.4771929 sigma out 15 active outputs RANK 10 NODE 3 --> 10.4759684 sigma out 15 active outputs RANK 11 NODE 7 --> 10.1007433 sigma out 15 active outputs RANK 12 NODE 4 --> 7.22332191 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 50.8101425 sigma in 12act. ( 39.1498642 sig out 1act.) RANK 2 NODE 4 --> 32.9214706 sigma in 12act. ( 35.9183121 sig out 1act.) RANK 3 NODE 7 --> 21.10709 sigma in 12act. ( 17.8480854 sig out 1act.) RANK 4 NODE 10 --> 20.1543369 sigma in 12act. ( 16.8057194 sig out 1act.) RANK 5 NODE 15 --> 19.2247162 sigma in 12act. ( 19.6039238 sig out 1act.) RANK 6 NODE 9 --> 17.3472843 sigma in 12act. ( 16.5788918 sig out 1act.) RANK 7 NODE 12 --> 16.515625 sigma in 12act. ( 15.0237474 sig out 1act.) RANK 8 NODE 8 --> 15.0565977 sigma in 12act. ( 12.7426796 sig out 1act.) RANK 9 NODE 5 --> 10.8875799 sigma in 12act. ( 10.7789516 sig out 1act.) RANK 10 NODE 1 --> 8.65605259 sigma in 12act. ( 7.20400667 sig out 1act.) RANK 11 NODE 14 --> 5.66027737 sigma in 12act. ( 4.60168266 sig out 1act.) RANK 12 NODE 6 --> 2.5634141 sigma in 12act. ( 1.90086079 sig out 1act.) RANK 13 NODE 11 --> 2.25848031 sigma in 12act. ( 0.114450783 sig out 1act.) RANK 14 NODE 3 --> 2.17017913 sigma in 12act. ( 1.24752581 sig out 1act.) RANK 15 NODE 13 --> 2.07518578 sigma in 12act. ( 0.898088694 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 39.1498642 sigma out 1act.( 50.8101425 sig in 12act.) RANK 2 NODE 4 --> 35.9183121 sigma out 1act.( 32.9214706 sig in 12act.) RANK 3 NODE 15 --> 19.6039238 sigma out 1act.( 19.2247162 sig in 12act.) RANK 4 NODE 7 --> 17.8480854 sigma out 1act.( 21.10709 sig in 12act.) RANK 5 NODE 10 --> 16.8057194 sigma out 1act.( 20.1543369 sig in 12act.) RANK 6 NODE 9 --> 16.5788918 sigma out 1act.( 17.3472843 sig in 12act.) RANK 7 NODE 12 --> 15.0237474 sigma out 1act.( 16.515625 sig in 12act.) RANK 8 NODE 8 --> 12.7426796 sigma out 1act.( 15.0565977 sig in 12act.) RANK 9 NODE 5 --> 10.7789516 sigma out 1act.( 10.8875799 sig in 12act.) RANK 10 NODE 1 --> 7.20400667 sigma out 1act.( 8.65605259 sig in 12act.) RANK 11 NODE 14 --> 4.60168266 sigma out 1act.( 5.66027737 sig in 12act.) RANK 12 NODE 6 --> 1.90086079 sigma out 1act.( 2.5634141 sig in 12act.) RANK 13 NODE 3 --> 1.24752581 sigma out 1act.( 2.17017913 sig in 12act.) RANK 14 NODE 13 --> 0.898088694 sigma out 1act.( 2.07518578 sig in 12act.) RANK 15 NODE 11 --> 0.114450783 sigma out 1act.( 2.25848031 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 68.3105698 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.611893952 *** contribution from regularisation: 0.00267494353 *** contribution from error: -0.614568889 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done