NNInput NNInputs_190.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 168912 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 29112 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 29112 Chosen entries: 29112 Signal fraction: 1 Background fraction: 0.20824 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 29112 Entries to split: 29112 Test with : 14556 Train with : 14556 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 29112 for Signal Prepared event 0 for Signal with 29112 events ====Entry 0 Variable Ht : 164.033 Variable LepAPt : 20.0646 Variable LepBPt : 18.6389 Variable MetSigLeptonsJets : 6.96649 Variable MetSpec : 68.1982 Variable SumEtLeptonsJets : 95.8338 Variable VSumJetLeptonsPt : 84.1337 Variable addEt : 106.903 Variable dPhiLepSumMet : 2.65696 Variable dPhiLeptons : 0.471814 Variable dRLeptons : 0.543149 Variable lep1_E : 20.1541 Variable lep2_E : 18.9253 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2190 Ht = 164.033 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 20.0651 LepAPt = 20.0646 LepBEt = 18.6394 LepBPt = 18.6389 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 68.1982 MetDelPhi = 2.4122 MetSig = 5.50681 MetSigLeptonsJets = 6.96649 MetSpec = 68.1982 Mjj = 0 MostCentralJetEta = -1.38092 MtllMet = 107.269 Njets = 1 SB = 0 SumEt = 153.372 SumEtJets = 0 SumEtLeptonsJets = 95.8338 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 84.1337 addEt = 106.903 dPhiLepSumMet = 2.65696 dPhiLeptons = 0.471814 dRLeptons = 0.543149 diltype = 41 dimass = 10.4421 event = 86 jet1_Et = 57.1302 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 20.1541 lep2_E = 18.9253 rand = 0.999742 run = 228406 weight = 1.62738e-06 ===Show End Prepared event 10000 for Signal with 29112 events Prepared event 20000 for Signal with 29112 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.164474 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4395 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 168912 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4395 negative weights. Signal fraction: 62.3512917 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.3545532 65.6049042 67.2536316 68.5262756 69.7827301 70.7165146 71.666687 72.6758728 73.4430008 74.1081848 74.6989822 75.3752518 75.859169 76.654274 77.1725769 77.8183441 78.4443207 79.0836029 79.5962677 80.1799088 80.8498459 81.501236 82.2082825 82.7141724 83.4641266 84.4950714 85.5098419 86.4380798 87.5490646 88.8028259 90.1229858 91.8673248 92.9778137 94.4342346 96.1206894 97.9990311 99.5079956 101.155388 103.103119 104.843742 106.337479 108.097862 109.802055 111.704109 113.391968 115.191574 116.892471 119.001953 120.746857 122.496162 124.296425 126.012421 127.875427 129.686371 131.484863 133.342499 135.076813 136.753906 138.286804 139.898544 141.4263 143.115936 144.615387 146.282089 147.994415 149.658081 151.492279 153.168488 154.778656 156.473053 158.365768 160.097183 161.957092 164.047485 166.117233 168.182129 170.102432 172.249573 174.613861 177.285065 179.787338 182.308594 185.035904 188.02327 191.003036 194.3078 197.885651 201.503983 206.029419 210.665527 215.88385 221.133987 227.327698 235.397598 244.110931 255.993011 271.2966 294.191223 339.676941 748.909973 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2987022 20.6041451 20.8990784 21.2448196 21.5046043 21.7739735 22.0028648 22.2461262 22.4623814 22.6627312 22.8644371 23.0766449 23.2916088 23.5103245 23.7402458 23.9719696 24.1786003 24.3874588 24.5998383 24.8263893 25.0653534 25.2522888 25.4588814 25.622879 25.8550758 26.0603218 26.2690659 26.4794426 26.7160988 26.9083652 27.1349297 27.3705635 27.6707153 27.8787994 28.1319866 28.4161377 28.6699905 28.9287891 29.1889572 29.4196854 29.711132 29.982439 30.3017349 30.56707 30.9080467 31.1988564 31.4629784 31.7526741 32.0580902 32.3571167 32.717865 33.0844536 33.4184608 33.7839355 34.1332626 34.4892921 34.8856201 35.3030624 35.6921387 36.1867561 36.6251831 37.0586624 37.4856758 37.8790588 38.3844147 38.8522644 39.3249474 39.803627 40.2775993 40.8129501 41.1486168 41.7326508 42.3174324 42.8734055 43.4931984 44.1012115 44.822319 45.4813995 46.1532211 46.8252792 47.5550117 48.2690887 49.0851517 49.8502274 50.7676926 51.7309494 52.835907 53.9543991 55.0345306 56.2722626 57.5306396 59.0595665 60.534462 62.1945038 64.1401978 66.2892151 69.2075653 73.2821884 80.5919647 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1424522 10.2884521 10.4147549 10.5052967 10.6384287 10.7753601 10.9124813 11.0649204 11.2113628 11.3454666 11.4696493 11.6233082 11.761734 11.9090023 12.043417 12.1904812 12.3307161 12.5039387 12.658926 12.8234797 12.9487391 13.1400394 13.2892456 13.4710064 13.6434011 13.7901745 13.9367933 14.1326752 14.2934456 14.4848166 14.6923771 14.8966475 15.090457 15.3011417 15.4746437 15.6863804 15.8627892 16.0503616 16.2916145 16.5185242 16.7561016 16.9659805 17.2007923 17.4262695 17.6901455 17.8925514 18.0732155 18.3132133 18.4954147 18.7496452 18.9976273 19.2303238 19.4613514 19.705164 19.9432526 20.1827126 20.343874 20.54916 20.7559319 20.9847851 21.182003 21.4088078 21.6247368 21.8627853 22.0942516 22.3270149 22.5501442 22.7595558 22.9835148 23.2342567 23.4869537 23.726841 24.0030689 24.2703285 24.5266361 24.8339729 25.1258774 25.4085121 25.7228642 26.0152664 26.2946415 26.6495895 27.0117531 27.359129 27.7008133 28.0762444 28.4494934 28.9009323 29.3751183 29.8611984 30.4097252 30.9379234 31.595211 32.2665634 33.176712 34.3147354 35.6273651 37.4544487 40.9881134 74.3859253 ------------------------------ Transdef: Tab for variable 5 0.951345682 2.72914934 3.1531601 3.47302818 3.78606033 4.01035786 4.13183975 4.27575111 4.40718222 4.54265976 4.64792728 4.75195456 4.84523916 4.94019413 5.01735592 5.08984852 5.1575737 5.23613453 5.29094982 5.36598778 5.4224453 5.47650957 5.52784157 5.57705688 5.62766266 5.67461157 5.72818613 5.7752285 5.81632948 5.85801983 5.90934086 5.95253754 6.00089359 6.0447731 6.08614254 6.12750053 6.17457676 6.21484375 6.25762749 6.28979206 6.33222008 6.3809433 6.42586422 6.4660244 6.51071548 6.56006527 6.60876846 6.65388966 6.70372772 6.75147724 6.79135609 6.84079075 6.87848568 6.92174816 6.96843815 7.01425695 7.07341099 7.13128185 7.18335152 7.23048306 7.29106331 7.34897041 7.40136862 7.4658289 7.52666759 7.59639454 7.66122532 7.7341814 7.79427004 7.84726906 7.90438366 7.96393061 8.03441429 8.09837627 8.15784836 8.22293758 8.28144455 8.34837914 8.41598892 8.4749651 8.55121231 8.63155556 8.70103073 8.77886009 8.86496162 8.94335461 9.02409554 9.11732483 9.22558403 9.3326025 9.44643784 9.55268002 9.68557549 9.82655907 9.98846054 10.1957245 10.4510536 10.8370609 11.3233776 12.3247547 19.6063156 ------------------------------ Transdef: Tab for variable 6 15.0261002 21.4999161 25.4899921 26.7927589 27.6737823 28.6286736 29.5504398 30.3525085 31.0843086 31.6519775 32.363739 32.8431473 33.3555832 33.8623543 34.3792191 34.7447128 35.1747055 35.5864754 35.9801292 36.3731613 36.7389069 37.0976715 37.4700241 37.8172035 38.0964279 38.4843597 38.8491058 39.2435226 39.5329475 39.9411316 40.305027 40.5865631 40.9391594 41.4235191 41.8853531 42.2971802 42.7711182 43.2064133 43.7038727 44.0281067 44.5096741 44.9593582 45.6599312 46.3357925 47.0426559 47.7247467 48.4145966 49.0931168 49.807251 50.4634895 51.1889801 52.0678787 52.9775314 53.8464928 54.6069717 55.3668137 56.2166672 57.1206551 57.9667282 58.8711243 59.6318932 60.4702911 61.3489456 62.1295853 62.9486618 63.7793503 64.5132828 65.4480743 66.2261505 67.1355438 68.0175629 68.8127594 69.690033 70.5554047 71.3751984 72.2772064 73.1577606 74.1183243 74.9566956 75.9526825 76.7138062 77.8358154 78.9827118 80.1233292 81.223114 82.3649139 83.6942444 84.9390564 86.4306183 88.1078186 89.7234039 91.5449219 93.5206833 95.8321075 98.488266 101.488068 105.504364 111.231064 118.232239 132.053955 290.769653 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7147369 33.7367859 34.4057083 35.0235138 35.5599403 36.0850372 36.460804 36.8737831 37.2746582 37.6483917 37.9502335 38.2334099 38.5671349 38.8178711 39.136673 39.4011459 39.6184883 39.9837875 40.3174286 40.6496124 41.019928 41.4178619 41.7715302 42.1461716 42.5972214 43.0456467 43.5293961 44.1851654 44.7336006 45.3413925 46.094986 46.9599915 47.8508759 48.7740135 49.6940842 50.9225693 52.0997467 53.1736641 54.1956558 55.2221222 56.1771698 57.1911011 58.0977859 58.9673538 59.8424225 60.7685623 61.806057 62.7190323 63.7513657 64.5913467 65.5710678 66.4282074 67.4124069 68.412117 69.3185196 70.1702881 71.0243683 71.929657 72.861702 73.888382 74.9968109 76.1352921 77.1126862 78.2004395 79.2715912 80.5100861 81.7118073 82.9997101 84.29953 85.6564407 86.980629 88.3768158 89.8182831 91.4248123 93.1461182 94.6786804 96.4000626 98.1312485 100.009262 102.076874 103.789017 105.813484 107.824005 110.243011 112.78508 115.499435 118.191879 121.357048 124.886078 128.302612 132.037048 136.773422 142.355743 147.993271 154.749512 166.05304 178.668106 196.272766 230.702209 476.899628 ------------------------------ Transdef: Tab for variable 8 2.09815502 24.4975319 29.0940094 30.9230766 32.0474777 32.8356628 33.3508186 33.856842 34.3839417 34.8454056 35.2262268 35.6095619 35.9738388 36.3220444 36.6081238 36.899601 37.2195625 37.4823494 37.7626419 38.0311775 38.2545929 38.5405083 38.7741432 39.028389 39.3065948 39.6270485 39.932785 40.24646 40.5510941 40.8965073 41.2197876 41.5417099 41.9074097 42.3445969 42.6675072 43.1435471 43.6277847 44.0597954 44.6613541 45.1963539 45.7450714 46.3428726 46.9230042 47.8003311 48.3954163 49.0971603 49.7555237 50.6066208 51.3802719 52.1774368 52.9253082 53.6487465 54.378952 55.1322861 55.8881798 56.6320801 57.3091278 58.0900726 58.8542633 59.5948372 60.2993774 61.0627785 61.7971573 62.5744133 63.3348465 64.037384 64.7909546 65.4733734 66.1918335 66.9230194 67.7174683 68.4737549 69.2148666 69.9998322 70.7682495 71.5196686 72.4110947 73.3720016 74.2233047 75.1258392 75.9790802 76.9009705 77.8841858 78.8556747 79.9536514 81.0370483 82.1790466 83.6233749 85.0311966 86.7067184 88.3191681 90.2807159 92.3949432 94.6289215 97.2756958 100.990952 105.426056 111.584763 121.104919 138.623032 296.803314 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.8018761 64.8959351 66.491806 67.7789993 68.8022385 69.9431152 70.7317734 71.5599518 72.3424377 73.2047272 73.8971863 74.3851318 74.9654999 75.5216675 76.0197754 76.6858902 77.112915 77.7086029 78.2763214 78.8266296 79.3273926 79.7855072 80.3467484 80.9422379 81.4804764 82.0948334 82.5778656 83.203743 83.8367157 84.6585083 85.4483337 86.2710419 87.1126709 88.1490936 89.1351776 90.1668854 91.4901581 92.820076 93.8386536 95.103981 96.3966522 97.9163132 99.1929626 100.832382 102.271652 103.934372 105.288635 106.614792 108.279312 109.891357 111.462234 112.86087 114.566025 115.869843 117.181931 118.692757 120.039375 121.309242 122.68985 123.901726 125.354736 126.777122 128.097092 129.315247 130.501236 131.851257 133.124329 134.433899 135.69455 136.916718 138.104843 139.266174 140.618927 141.87851 143.162216 144.354233 145.542725 146.967087 148.221298 149.632996 151.058319 152.463928 153.987061 155.549927 157.203018 158.864929 160.639328 162.526459 164.506439 166.521973 168.611023 171.389526 174.133331 177.189651 180.477875 184.640228 190.570618 197.913635 216.294586 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0335818008 0.989077866 1.32839656 1.5628581 1.73739862 1.86988831 1.97778153 2.06203508 2.13534546 2.20390987 2.26071763 2.31464434 2.36131263 2.40288329 2.44116187 2.47494841 2.50754881 2.53843951 2.56636143 2.59340096 2.61665416 2.64189577 2.66563082 2.68635511 2.70613456 2.72601461 2.74319434 2.75879979 2.77351117 2.7874341 2.80137157 2.81510258 2.82673931 2.83675098 2.8491559 2.85895777 2.86825228 2.87796402 2.88824081 2.89635682 2.90380335 2.91175604 2.91910458 2.92593145 2.93351793 2.94153547 2.94791746 2.95441771 2.96144819 2.96758604 2.97412777 2.9798789 2.98457146 2.98913765 2.99367857 2.99916816 3.00495219 3.00938487 3.0138011 3.01911569 3.02305984 3.02707291 3.03074336 3.0346272 3.03842258 3.0421958 3.04616547 3.05003405 3.05377531 3.05771065 3.06048632 3.06418276 3.06741691 3.07076025 3.07380247 3.07651854 3.07944298 3.08265972 3.08565426 3.08862996 3.09115314 3.09419823 3.09698105 3.09991932 3.10249162 3.10543013 3.10855818 3.1105485 3.11336255 3.11553574 3.11769342 3.1203208 3.1228621 3.12552643 3.12803888 3.13034582 3.13248849 3.13454199 3.13683414 3.13905716 3.14158654 ------------------------------ Transdef: Tab for variable 11 8.10623169E-06 0.00519537274 0.0109462738 0.0174611211 0.0235904548 0.0300284326 0.0381813645 0.0462324619 0.0532355309 0.0595755279 0.0671830326 0.0753910989 0.0832135379 0.0905280113 0.0973658562 0.105261207 0.112645626 0.119653106 0.127030343 0.133911043 0.141872883 0.148129582 0.154901743 0.160941005 0.167476654 0.174859405 0.180978596 0.187101364 0.192649454 0.198231936 0.203463346 0.208779648 0.214165241 0.21999979 0.225239754 0.230340481 0.235246196 0.2401907 0.246059522 0.251036942 0.2563968 0.261421621 0.265880287 0.270486414 0.27575922 0.280311018 0.284608364 0.289667368 0.2950176 0.30016613 0.304489136 0.310037196 0.315884113 0.321559668 0.326986194 0.332737118 0.338382691 0.343691945 0.34922576 0.354966879 0.359120905 0.365199506 0.370760202 0.37591815 0.382184505 0.387816608 0.393337846 0.39904952 0.404850602 0.41113323 0.417856127 0.423944682 0.430020094 0.436093569 0.441931963 0.447589874 0.455282807 0.463182896 0.469575882 0.476176918 0.483499825 0.49273175 0.501054406 0.511753857 0.520771921 0.530816853 0.539795578 0.549824715 0.562217236 0.576001763 0.589925587 0.603721499 0.618980646 0.634952545 0.652282655 0.669217825 0.700383306 0.732825339 0.776292562 0.838726759 1.11657131 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.212414175 0.223092288 0.231331959 0.240316018 0.248397142 0.256575286 0.263939142 0.271215767 0.277789414 0.284016013 0.290171206 0.296226442 0.302262485 0.307903677 0.313874245 0.31932795 0.325231403 0.331433773 0.336882472 0.342793703 0.348442614 0.353133351 0.358300775 0.363552004 0.368823111 0.37410754 0.379293323 0.384794503 0.389564931 0.39441663 0.39923197 0.403475046 0.406931341 0.41045624 0.413769424 0.417664647 0.421031743 0.424640119 0.428530395 0.432176083 0.435269177 0.438910961 0.442282438 0.4456186 0.44911772 0.453497052 0.457298011 0.460797966 0.465418756 0.46953541 0.473597765 0.477471113 0.481172025 0.484903157 0.489137381 0.493607074 0.498037517 0.501716137 0.506817043 0.511005282 0.515989542 0.520472527 0.525000095 0.529969454 0.535508275 0.541597545 0.546925187 0.551175714 0.556151807 0.561644197 0.567776442 0.573877454 0.580107927 0.586644292 0.592580676 0.598042309 0.604967952 0.612932086 0.620239556 0.626526713 0.633840322 0.643031955 0.65173173 0.659943461 0.667590678 0.67619729 0.684683681 0.697958231 0.710407972 0.720598876 0.731514513 0.743812025 0.756398439 0.771609545 0.792285502 0.810721099 0.835214853 0.864524782 0.914491415 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.6506386 22.3974857 22.9821453 23.6026421 24.2255116 24.7137947 25.1841812 25.6160736 26.0215549 26.5369492 27.0085754 27.3790474 27.8186188 28.2101135 28.6019173 28.9539032 29.3762856 29.7219543 30.1068478 30.4990768 30.8473053 31.1096497 31.4829025 31.7970352 32.1831741 32.5283127 32.940506 33.3706131 33.7786369 34.2372131 34.5995026 34.9854622 35.3412247 35.7277298 36.1250687 36.5042191 36.9931183 37.4630928 37.8633118 38.2852173 38.6924324 39.1486702 39.6115952 40.1094131 40.5723114 41.0166016 41.5050964 42.0460167 42.5005302 42.9863434 43.4320908 43.89814 44.4298401 44.9770088 45.5463982 46.1151657 46.5647049 47.0732498 47.6530991 48.1420975 48.7020683 49.2918091 49.8762703 50.50214 51.1089287 51.7425842 52.4122162 53.0963516 53.8131409 54.554245 55.2679825 56.0245934 56.7361832 57.4240761 58.1798096 58.9581299 59.7192917 60.4527206 61.4587936 62.2248688 63.0291824 64.0388641 65.0971756 66.2884064 67.3484802 68.3353271 69.4609909 70.7568512 72.2647858 74.0041351 75.7865143 77.4543762 79.4926834 82.0067444 85.0641708 88.391983 92.423233 98.4263763 108.018074 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7443953 11.2292976 11.545311 11.924202 12.3178196 12.7004375 13.0499458 13.3896866 13.697319 13.9491615 14.298666 14.5942411 14.9250765 15.1936874 15.5042582 15.792243 16.0839386 16.3638706 16.6502075 16.9076099 17.2137756 17.4998512 17.7331009 17.9554443 18.2285995 18.5099487 18.7662849 19.0165806 19.2284145 19.566658 19.8621407 20.1610413 20.4314899 20.7044582 20.9226952 21.188961 21.4226761 21.6673813 21.8862114 22.100708 22.3915291 22.6648941 22.9105835 23.1300507 23.3328934 23.5423927 23.7762451 24.0403175 24.2998371 24.556118 24.8260975 25.0352325 25.3364353 25.5658054 25.7917252 26.0586624 26.3457165 26.6130486 26.9105034 27.2018719 27.4503307 27.6638012 27.9124489 28.0921516 28.3377075 28.6388741 28.9247169 29.1937828 29.4912224 29.7766819 30.0834332 30.4102726 30.776535 31.137331 31.462019 31.7921295 32.1573486 32.5902824 32.9994507 33.3891258 33.852005 34.3293152 34.8116455 35.4011269 35.9625015 36.573555 37.2004089 37.834816 38.6171227 39.546093 40.4363327 41.5353966 42.7105026 43.971611 45.1520538 47.4429703 49.8090897 53.6168671 59.6022911 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.9 53.6 53.2 32.8 52.0 63.8 56.6 64.9 -25.5 -19.7 -41.6 19.2 21.2 2 65.9 100.0 68.9 57.0 43.2 72.2 94.6 78.9 92.6 -44.8 -24.7 -50.7 37.4 28.0 3 53.6 68.9 100.0 44.1 21.4 43.9 70.6 61.0 76.7 -14.1 -27.2 -58.4 67.7 20.2 4 53.2 57.0 44.1 100.0 16.1 36.2 59.1 49.7 60.6 -13.6 -30.1 -61.2 19.7 68.1 5 32.8 43.2 21.4 16.1 100.0 84.9 16.8 61.8 62.4 18.4 -9.3 -16.9 5.3 2.4 6 52.0 72.2 43.9 36.2 84.9 100.0 52.5 80.5 82.0 -8.6 -17.5 -33.8 19.3 14.3 7 63.8 94.6 70.6 59.1 16.8 52.5 100.0 71.2 81.8 -53.3 -23.9 -51.2 40.5 31.2 8 56.6 78.9 61.0 49.7 61.8 80.5 71.2 100.0 86.1 -14.2 -24.3 -46.8 33.2 24.8 9 64.9 92.6 76.7 60.6 62.4 82.0 81.8 86.1 100.0 -21.5 -27.6 -57.1 43.9 30.8 10 -25.5 -44.8 -14.1 -13.6 18.4 -8.6 -53.3 -14.2 -21.5 100.0 3.1 8.2 -5.1 -5.6 11 -19.7 -24.7 -27.2 -30.1 -9.3 -17.5 -23.9 -24.3 -27.6 3.1 100.0 53.7 -12.9 -17.1 12 -41.6 -50.7 -58.4 -61.2 -16.9 -33.8 -51.2 -46.8 -57.1 8.2 53.7 100.0 -31.7 -33.4 13 19.2 37.4 67.7 19.7 5.3 19.3 40.5 33.2 43.9 -5.1 -12.9 -31.7 100.0 43.7 14 21.2 28.0 20.2 68.1 2.4 14.3 31.2 24.8 30.8 -5.6 -17.1 -33.4 43.7 100.0 TOTAL CORRELATION TO TARGET (diagonal) 169.95473 TOTAL CORRELATION OF ALL VARIABLES 72.9805384 ROUND 1: MAX CORR ( 72.9801025) AFTER KILLING INPUT VARIABLE 11 CONTR 0.252231165 ROUND 2: MAX CORR ( 72.9688458) AFTER KILLING INPUT VARIABLE 2 CONTR 1.28176169 ROUND 3: MAX CORR ( 72.9059068) AFTER KILLING INPUT VARIABLE 8 CONTR 3.03004927 ROUND 4: MAX CORR ( 72.8344357) AFTER KILLING INPUT VARIABLE 14 CONTR 3.22741709 ROUND 5: MAX CORR ( 72.7670792) AFTER KILLING INPUT VARIABLE 12 CONTR 3.13164681 ROUND 6: MAX CORR ( 72.6371019) AFTER KILLING INPUT VARIABLE 10 CONTR 4.34732613 ROUND 7: MAX CORR ( 72.4770369) AFTER KILLING INPUT VARIABLE 6 CONTR 4.81951231 ROUND 8: MAX CORR ( 71.768104) AFTER KILLING INPUT VARIABLE 9 CONTR 10.1123751 ROUND 9: MAX CORR ( 70.3614444) AFTER KILLING INPUT VARIABLE 13 CONTR 14.1395859 ROUND 10: MAX CORR ( 69.8386654) AFTER KILLING INPUT VARIABLE 3 CONTR 8.56117236 ROUND 11: MAX CORR ( 67.5920036) AFTER KILLING INPUT VARIABLE 4 CONTR 17.5715744 ROUND 12: MAX CORR ( 63.7618734) AFTER KILLING INPUT VARIABLE 5 CONTR 22.4299454 LAST REMAINING VARIABLE: 7 total correlation to target: 72.9805384 % total significance: 111.714473 sigma correlations of single variables to target: variable 2: 65.8965079 % , in sigma: 100.870641 variable 3: 53.5763672 % , in sigma: 82.0116673 variable 4: 53.2332173 % , in sigma: 81.4863928 variable 5: 32.8347784 % , in sigma: 50.2616183 variable 6: 51.9745992 % , in sigma: 79.5597715 variable 7: 63.7618734 % , in sigma: 97.6030631 variable 8: 56.5572725 % , in sigma: 86.5746683 variable 9: 64.8602142 % , in sigma: 99.2843409 variable 10: -25.5208967 % , in sigma: 39.0659426 variable 11: -19.7267375 % , in sigma: 30.1965721 variable 12: -41.5601696 % , in sigma: 63.6179528 variable 13: 19.2009776 % , in sigma: 29.3917687 variable 14: 21.2377401 % , in sigma: 32.5095292 variables sorted by significance: 1 most relevant variable 7 corr 63.7618752 , in sigma: 97.6030657 2 most relevant variable 5 corr 22.429945 , in sigma: 34.3344889 3 most relevant variable 4 corr 17.5715752 , in sigma: 26.8975717 4 most relevant variable 3 corr 8.56117249 , in sigma: 13.1049578 5 most relevant variable 13 corr 14.1395855 , in sigma: 21.6440763 6 most relevant variable 9 corr 10.1123753 , in sigma: 15.4794511 7 most relevant variable 6 corr 4.81951237 , in sigma: 7.37743646 8 most relevant variable 10 corr 4.34732628 , in sigma: 6.65464075 9 most relevant variable 12 corr 3.13164687 , in sigma: 4.79374759 10 most relevant variable 14 corr 3.22741699 , in sigma: 4.94034707 11 most relevant variable 8 corr 3.03004932 , in sigma: 4.63822782 12 most relevant variable 2 corr 1.28176165 , in sigma: 1.9620481 13 most relevant variable 11 corr 0.252231151 , in sigma: 0.386101154 global correlations between input variables: variable 2: 99.2330094 % variable 3: 93.7916036 % variable 4: 90.9221822 % variable 5: 95.4141826 % variable 6: 94.3677856 % variable 7: 98.8443173 % variable 8: 91.2639383 % variable 9: 98.9225575 % variable 10: 71.8153728 % variable 11: 54.5531348 % variable 12: 77.7513613 % variable 13: 86.2170843 % variable 14: 86.2625345 % significance loss when removing single variables: variable 2: corr = 1.29501299 % , sigma = 1.98233251 variable 3: corr = 15.74052 % , sigma = 24.0946961 variable 4: corr = 15.4353988 % , sigma = 23.627634 variable 5: corr = 11.0449939 % , sigma = 16.9070508 variable 6: corr = 4.68098433 % , sigma = 7.16538558 variable 7: corr = 7.22877515 % , sigma = 11.0653994 variable 8: corr = 2.18740085 % , sigma = 3.34834929 variable 9: corr = 9.00921261 % , sigma = 13.7907922 variable 10: corr = 3.49383072 % , sigma = 5.34815811 variable 11: corr = 0.252231165 % , sigma = 0.386101176 variable 12: corr = 2.75120805 % , sigma = 4.21139339 variable 13: corr = 7.13010558 % , sigma = 10.9143616 variable 14: corr = 3.15755389 % , sigma = 4.83340459 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 16.317276 sigma out 15 active outputs RANK 2 NODE 5 --> 14.4905567 sigma out 15 active outputs RANK 3 NODE 10 --> 13.8028975 sigma out 15 active outputs RANK 4 NODE 12 --> 13.5602112 sigma out 15 active outputs RANK 5 NODE 11 --> 13.3950815 sigma out 15 active outputs RANK 6 NODE 9 --> 13.249342 sigma out 15 active outputs RANK 7 NODE 4 --> 13.0830679 sigma out 15 active outputs RANK 8 NODE 6 --> 11.1219797 sigma out 15 active outputs RANK 9 NODE 7 --> 10.6331511 sigma out 15 active outputs RANK 10 NODE 1 --> 9.39784431 sigma out 15 active outputs RANK 11 NODE 3 --> 8.84680367 sigma out 15 active outputs RANK 12 NODE 2 --> 8.7959547 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 24.593462 sigma in 12act. ( 25.0890102 sig out 1act.) RANK 2 NODE 15 --> 18.4818459 sigma in 12act. ( 17.598753 sig out 1act.) RANK 3 NODE 4 --> 14.7550154 sigma in 12act. ( 14.9706259 sig out 1act.) RANK 4 NODE 3 --> 12.3326092 sigma in 12act. ( 12.9616966 sig out 1act.) RANK 5 NODE 12 --> 9.9086113 sigma in 12act. ( 9.65103054 sig out 1act.) RANK 6 NODE 6 --> 9.74045658 sigma in 12act. ( 10.7705612 sig out 1act.) RANK 7 NODE 1 --> 8.99347687 sigma in 12act. ( 7.81553221 sig out 1act.) RANK 8 NODE 13 --> 8.76904774 sigma in 12act. ( 8.91425991 sig out 1act.) RANK 9 NODE 14 --> 7.12353516 sigma in 12act. ( 7.48825836 sig out 1act.) RANK 10 NODE 9 --> 6.68634129 sigma in 12act. ( 6.52610397 sig out 1act.) RANK 11 NODE 2 --> 6.46865368 sigma in 12act. ( 5.73645735 sig out 1act.) RANK 12 NODE 7 --> 5.70791864 sigma in 12act. ( 2.85798955 sig out 1act.) RANK 13 NODE 11 --> 3.84908462 sigma in 12act. ( 2.47724056 sig out 1act.) RANK 14 NODE 8 --> 2.00528741 sigma in 12act. ( 2.00981832 sig out 1act.) RANK 15 NODE 5 --> 1.31018054 sigma in 12act. ( 0.677396655 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 25.0890102 sigma out 1act.( 24.593462 sig in 12act.) RANK 2 NODE 15 --> 17.598753 sigma out 1act.( 18.4818459 sig in 12act.) RANK 3 NODE 4 --> 14.9706259 sigma out 1act.( 14.7550154 sig in 12act.) RANK 4 NODE 3 --> 12.9616966 sigma out 1act.( 12.3326092 sig in 12act.) RANK 5 NODE 6 --> 10.7705612 sigma out 1act.( 9.74045658 sig in 12act.) RANK 6 NODE 12 --> 9.65103054 sigma out 1act.( 9.9086113 sig in 12act.) RANK 7 NODE 13 --> 8.91425991 sigma out 1act.( 8.76904774 sig in 12act.) RANK 8 NODE 1 --> 7.81553221 sigma out 1act.( 8.99347687 sig in 12act.) RANK 9 NODE 14 --> 7.48825836 sigma out 1act.( 7.12353516 sig in 12act.) RANK 10 NODE 9 --> 6.52610397 sigma out 1act.( 6.68634129 sig in 12act.) RANK 11 NODE 2 --> 5.73645735 sigma out 1act.( 6.46865368 sig in 12act.) RANK 12 NODE 7 --> 2.85798955 sigma out 1act.( 5.70791864 sig in 12act.) RANK 13 NODE 11 --> 2.47724056 sigma out 1act.( 3.84908462 sig in 12act.) RANK 14 NODE 8 --> 2.00981832 sigma out 1act.( 2.00528741 sig in 12act.) RANK 15 NODE 5 --> 0.677396655 sigma out 1act.( 1.31018054 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.7944832 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 21.9241829 sigma out 15 active outputs RANK 2 NODE 8 --> 17.3169041 sigma out 15 active outputs RANK 3 NODE 5 --> 15.743824 sigma out 15 active outputs RANK 4 NODE 11 --> 15.04566 sigma out 15 active outputs RANK 5 NODE 10 --> 14.7191839 sigma out 15 active outputs RANK 6 NODE 4 --> 13.4989843 sigma out 15 active outputs RANK 7 NODE 9 --> 13.4113455 sigma out 15 active outputs RANK 8 NODE 6 --> 12.1846552 sigma out 15 active outputs RANK 9 NODE 7 --> 11.5680571 sigma out 15 active outputs RANK 10 NODE 1 --> 11.3417788 sigma out 15 active outputs RANK 11 NODE 3 --> 10.8941422 sigma out 15 active outputs RANK 12 NODE 2 --> 9.80650616 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 25.9487667 sigma in 12act. ( 25.7668457 sig out 1act.) RANK 2 NODE 15 --> 18.6811867 sigma in 12act. ( 16.4551506 sig out 1act.) RANK 3 NODE 4 --> 14.9806881 sigma in 12act. ( 14.1047029 sig out 1act.) RANK 4 NODE 3 --> 14.6739693 sigma in 12act. ( 12.2373743 sig out 1act.) RANK 5 NODE 6 --> 12.2710419 sigma in 12act. ( 12.1111975 sig out 1act.) RANK 6 NODE 1 --> 10.9219122 sigma in 12act. ( 7.0390687 sig out 1act.) RANK 7 NODE 5 --> 10.6403637 sigma in 12act. ( 2.45296574 sig out 1act.) RANK 8 NODE 12 --> 10.6341448 sigma in 12act. ( 9.32595634 sig out 1act.) RANK 9 NODE 13 --> 10.4923506 sigma in 12act. ( 8.87299728 sig out 1act.) RANK 10 NODE 9 --> 9.09340286 sigma in 12act. ( 6.7251339 sig out 1act.) RANK 11 NODE 8 --> 9.0925045 sigma in 12act. ( 4.21309662 sig out 1act.) RANK 12 NODE 2 --> 8.6859436 sigma in 12act. ( 5.12679434 sig out 1act.) RANK 13 NODE 14 --> 8.51448441 sigma in 12act. ( 7.07333374 sig out 1act.) RANK 14 NODE 7 --> 6.65437889 sigma in 12act. ( 1.0910157 sig out 1act.) RANK 15 NODE 11 --> 5.77763176 sigma in 12act. ( 2.05167675 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 25.7668457 sigma out 1act.( 25.9487667 sig in 12act.) RANK 2 NODE 15 --> 16.4551506 sigma out 1act.( 18.6811867 sig in 12act.) RANK 3 NODE 4 --> 14.1047029 sigma out 1act.( 14.9806881 sig in 12act.) RANK 4 NODE 3 --> 12.2373743 sigma out 1act.( 14.6739693 sig in 12act.) RANK 5 NODE 6 --> 12.1111975 sigma out 1act.( 12.2710419 sig in 12act.) RANK 6 NODE 12 --> 9.32595634 sigma out 1act.( 10.6341448 sig in 12act.) RANK 7 NODE 13 --> 8.87299728 sigma out 1act.( 10.4923506 sig in 12act.) RANK 8 NODE 14 --> 7.07333374 sigma out 1act.( 8.51448441 sig in 12act.) RANK 9 NODE 1 --> 7.0390687 sigma out 1act.( 10.9219122 sig in 12act.) RANK 10 NODE 9 --> 6.7251339 sigma out 1act.( 9.09340286 sig in 12act.) RANK 11 NODE 2 --> 5.12679434 sigma out 1act.( 8.6859436 sig in 12act.) RANK 12 NODE 8 --> 4.21309662 sigma out 1act.( 9.0925045 sig in 12act.) RANK 13 NODE 5 --> 2.45296574 sigma out 1act.( 10.6403637 sig in 12act.) RANK 14 NODE 11 --> 2.05167675 sigma out 1act.( 5.77763176 sig in 12act.) RANK 15 NODE 7 --> 1.0910157 sigma out 1act.( 6.65437889 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.379734 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.513082206 *** contribution from regularisation: 0.00468888227 *** contribution from error: -0.517771065 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.56182456 *** contribution from regularisation: 0.00257575745 *** contribution from error: -0.564400315 *********************************************** -----------------> Test sample ENTER BFGS code START -47457.8999 0.398830146 -0.0375880897 EXIT FROM BFGS code FG_START 0. 0.398830146 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.589280486 *** contribution from regularisation: 0.0023364001 *** contribution from error: -0.591616869 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49768.271 0.398830146 25.7860203 EXIT FROM BFGS code FG_LNSRCH 0. 0.417224854 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.599049628 *** contribution from regularisation: 0.0031043503 *** contribution from error: -0.602153957 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50593.3342 0.417224854 9.87935448 EXIT FROM BFGS code NEW_X -50593.3342 0.417224854 9.87935448 ENTER BFGS code NEW_X -50593.3342 0.417224854 9.87935448 EXIT FROM BFGS code FG_LNSRCH 0. 0.421594888 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.600880682 *** contribution from regularisation: 0.00305919815 *** contribution from error: -0.603939891 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50747.9777 0.421594888 -3.70246315 EXIT FROM BFGS code NEW_X -50747.9777 0.421594888 -3.70246315 ENTER BFGS code NEW_X -50747.9777 0.421594888 -3.70246315 EXIT FROM BFGS code FG_LNSRCH 0. 0.418698668 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.601518631 *** contribution from regularisation: 0.00295867259 *** contribution from error: -0.604477286 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50801.8562 0.418698668 -10.7006865 EXIT FROM BFGS code NEW_X -50801.8562 0.418698668 -10.7006865 ENTER BFGS code NEW_X -50801.8562 0.418698668 -10.7006865 EXIT FROM BFGS code FG_LNSRCH 0. 0.408061236 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.601943314 *** contribution from regularisation: 0.00287918863 *** contribution from error: -0.604822516 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50837.726 0.408061236 -17.1834984 EXIT FROM BFGS code NEW_X -50837.726 0.408061236 -17.1834984 ENTER BFGS code NEW_X -50837.726 0.408061236 -17.1834984 EXIT FROM BFGS code FG_LNSRCH 0. 0.375163883 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.602440536 *** contribution from regularisation: 0.00288167619 *** contribution from error: -0.605322242 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50879.7162 0.375163883 -18.9513626 EXIT FROM BFGS code NEW_X -50879.7162 0.375163883 -18.9513626 ENTER BFGS code NEW_X -50879.7162 0.375163883 -18.9513626 EXIT FROM BFGS code FG_LNSRCH 0. 0.297222942 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.603635013 *** contribution from regularisation: 0.00267421501 *** contribution from error: -0.606309235 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50980.5981 0.297222942 -14.9341784 EXIT FROM BFGS code NEW_X -50980.5981 0.297222942 -14.9341784 ENTER BFGS code NEW_X -50980.5981 0.297222942 -14.9341784 EXIT FROM BFGS code FG_LNSRCH 0. 0.146515697 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 32.3410835 sigma out 15 active outputs RANK 2 NODE 3 --> 18.718935 sigma out 15 active outputs RANK 3 NODE 11 --> 17.3499718 sigma out 15 active outputs RANK 4 NODE 1 --> 14.2380495 sigma out 15 active outputs RANK 5 NODE 8 --> 12.5915098 sigma out 15 active outputs RANK 6 NODE 10 --> 11.7151709 sigma out 15 active outputs RANK 7 NODE 7 --> 10.3808937 sigma out 15 active outputs RANK 8 NODE 4 --> 9.62653255 sigma out 15 active outputs RANK 9 NODE 9 --> 9.41791725 sigma out 15 active outputs RANK 10 NODE 2 --> 8.03110409 sigma out 15 active outputs RANK 11 NODE 6 --> 7.72897768 sigma out 15 active outputs RANK 12 NODE 5 --> 7.05924368 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 26.550293 sigma in 12act. ( 17.3757153 sig out 1act.) RANK 2 NODE 6 --> 24.3459568 sigma in 12act. ( 19.7364101 sig out 1act.) RANK 3 NODE 9 --> 20.9885845 sigma in 12act. ( 15.5112362 sig out 1act.) RANK 4 NODE 5 --> 13.0601797 sigma in 12act. ( 13.0457239 sig out 1act.) RANK 5 NODE 13 --> 12.4865313 sigma in 12act. ( 10.3025532 sig out 1act.) RANK 6 NODE 8 --> 12.112566 sigma in 12act. ( 11.2192974 sig out 1act.) RANK 7 NODE 4 --> 11.458849 sigma in 12act. ( 9.94501591 sig out 1act.) RANK 8 NODE 14 --> 8.65050507 sigma in 12act. ( 8.23974991 sig out 1act.) RANK 9 NODE 1 --> 8.54493237 sigma in 12act. ( 8.86946774 sig out 1act.) RANK 10 NODE 3 --> 8.3983469 sigma in 12act. ( 6.84319878 sig out 1act.) RANK 11 NODE 12 --> 7.12556076 sigma in 12act. ( 5.81149864 sig out 1act.) RANK 12 NODE 15 --> 5.12259436 sigma in 12act. ( 2.34091711 sig out 1act.) RANK 13 NODE 11 --> 3.01276326 sigma in 12act. ( 1.38884246 sig out 1act.) RANK 14 NODE 2 --> 2.73770905 sigma in 12act. ( 1.45525897 sig out 1act.) RANK 15 NODE 7 --> 2.10874605 sigma in 12act. ( 0.9852705 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 19.7364101 sigma out 1act.( 24.3459568 sig in 12act.) RANK 2 NODE 10 --> 17.3757153 sigma out 1act.( 26.550293 sig in 12act.) RANK 3 NODE 9 --> 15.5112362 sigma out 1act.( 20.9885845 sig in 12act.) RANK 4 NODE 5 --> 13.0457239 sigma out 1act.( 13.0601797 sig in 12act.) RANK 5 NODE 8 --> 11.2192974 sigma out 1act.( 12.112566 sig in 12act.) RANK 6 NODE 13 --> 10.3025532 sigma out 1act.( 12.4865313 sig in 12act.) RANK 7 NODE 4 --> 9.94501591 sigma out 1act.( 11.458849 sig in 12act.) RANK 8 NODE 1 --> 8.86946774 sigma out 1act.( 8.54493237 sig in 12act.) RANK 9 NODE 14 --> 8.23974991 sigma out 1act.( 8.65050507 sig in 12act.) RANK 10 NODE 3 --> 6.84319878 sigma out 1act.( 8.3983469 sig in 12act.) RANK 11 NODE 12 --> 5.81149864 sigma out 1act.( 7.12556076 sig in 12act.) RANK 12 NODE 15 --> 2.34091711 sigma out 1act.( 5.12259436 sig in 12act.) RANK 13 NODE 2 --> 1.45525897 sigma out 1act.( 2.73770905 sig in 12act.) RANK 14 NODE 11 --> 1.38884246 sigma out 1act.( 3.01276326 sig in 12act.) RANK 15 NODE 7 --> 0.9852705 sigma out 1act.( 2.10874605 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 40.8755455 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.598343968 *** contribution from regularisation: 0.00287388591 *** contribution from error: -0.601217866 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50533.7379 0.146515697 16.2351551 EXIT FROM BFGS code FG_LNSRCH 0. 0.281987816 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.602953553 *** contribution from regularisation: 0.00360257807 *** contribution from error: -0.606556118 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50923.0448 0.281987816 -10.6975098 EXIT FROM BFGS code FG_LNSRCH 0. 0.296498477 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.603487432 *** contribution from regularisation: 0.00283654314 *** contribution from error: -0.606323957 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50968.1365 0.296498477 -14.6564398 EXIT FROM BFGS code FG_LNSRCH 0. 0.297214091 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.60336411 *** contribution from regularisation: 0.00294525339 *** contribution from error: -0.606309354 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50957.7198 0.297214091 -14.2994356 EXIT FROM BFGS code FG_LNSRCH 0. 0.297222942 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.603395641 *** contribution from regularisation: 0.00291357189 *** contribution from error: -0.606309235 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50960.383 0.297222942 -14.5287991 EXIT FROM BFGS code FG_LNSRCH 0. 0.297222942 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.603307366 *** contribution from regularisation: 0.00300184195 *** contribution from error: -0.606309235 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50952.9281 0.297222942 -14.427949 EXIT FROM BFGS code FG_LNSRCH 0. 0.297222942 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.603402376 *** contribution from regularisation: 0.00290684612 *** contribution from error: -0.606309235 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50960.951 0.297222942 -14.4750576 EXIT FROM BFGS code FG_LNSRCH 0. 0.297222942 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.603347659 *** contribution from regularisation: 0.00296153803 *** contribution from error: -0.606309175 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50956.332 0.297222942 -14.3541441 EXIT FROM BFGS code NEW_X -50956.332 0.297222942 -14.3541441 ENTER BFGS code NEW_X -50956.332 0.297222942 -14.3541441 EXIT FROM BFGS code CONVERGENC -50956.332 0.297222942 -14.3541441 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 43.7870598 sigma out 15 active outputs RANK 2 NODE 1 --> 24.9039364 sigma out 15 active outputs RANK 3 NODE 11 --> 23.2775517 sigma out 15 active outputs RANK 4 NODE 3 --> 20.7810135 sigma out 15 active outputs RANK 5 NODE 10 --> 15.0413208 sigma out 15 active outputs RANK 6 NODE 5 --> 13.7811594 sigma out 15 active outputs RANK 7 NODE 6 --> 13.6694336 sigma out 15 active outputs RANK 8 NODE 8 --> 13.3537197 sigma out 15 active outputs RANK 9 NODE 7 --> 13.1134033 sigma out 15 active outputs RANK 10 NODE 4 --> 11.3443937 sigma out 15 active outputs RANK 11 NODE 9 --> 10.0022335 sigma out 15 active outputs RANK 12 NODE 2 --> 9.0263052 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 36.7642632 sigma in 12act. ( 25.3442631 sig out 1act.) RANK 2 NODE 6 --> 26.6511707 sigma in 12act. ( 21.2583866 sig out 1act.) RANK 3 NODE 9 --> 23.6861782 sigma in 12act. ( 17.3921108 sig out 1act.) RANK 4 NODE 8 --> 19.093214 sigma in 12act. ( 15.3657761 sig out 1act.) RANK 5 NODE 5 --> 18.5901222 sigma in 12act. ( 17.6154499 sig out 1act.) RANK 6 NODE 13 --> 17.7351379 sigma in 12act. ( 16.3089504 sig out 1act.) RANK 7 NODE 4 --> 17.6788826 sigma in 12act. ( 16.4689217 sig out 1act.) RANK 8 NODE 3 --> 16.0193691 sigma in 12act. ( 11.6532221 sig out 1act.) RANK 9 NODE 12 --> 12.7916374 sigma in 12act. ( 11.0293818 sig out 1act.) RANK 10 NODE 14 --> 11.1712875 sigma in 12act. ( 10.5021839 sig out 1act.) RANK 11 NODE 15 --> 9.89452076 sigma in 12act. ( 7.5550189 sig out 1act.) RANK 12 NODE 1 --> 9.86552906 sigma in 12act. ( 9.06724548 sig out 1act.) RANK 13 NODE 2 --> 5.82380533 sigma in 12act. ( 4.1158123 sig out 1act.) RANK 14 NODE 11 --> 4.83481407 sigma in 12act. ( 3.07274246 sig out 1act.) RANK 15 NODE 7 --> 4.12324762 sigma in 12act. ( 2.49542594 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 25.3442631 sigma out 1act.( 36.7642632 sig in 12act.) RANK 2 NODE 6 --> 21.2583866 sigma out 1act.( 26.6511707 sig in 12act.) RANK 3 NODE 5 --> 17.6154499 sigma out 1act.( 18.5901222 sig in 12act.) RANK 4 NODE 9 --> 17.3921108 sigma out 1act.( 23.6861782 sig in 12act.) RANK 5 NODE 4 --> 16.4689217 sigma out 1act.( 17.6788826 sig in 12act.) RANK 6 NODE 13 --> 16.3089504 sigma out 1act.( 17.7351379 sig in 12act.) RANK 7 NODE 8 --> 15.3657761 sigma out 1act.( 19.093214 sig in 12act.) RANK 8 NODE 3 --> 11.6532221 sigma out 1act.( 16.0193691 sig in 12act.) RANK 9 NODE 12 --> 11.0293818 sigma out 1act.( 12.7916374 sig in 12act.) RANK 10 NODE 14 --> 10.5021839 sigma out 1act.( 11.1712875 sig in 12act.) RANK 11 NODE 1 --> 9.06724548 sigma out 1act.( 9.86552906 sig in 12act.) RANK 12 NODE 15 --> 7.5550189 sigma out 1act.( 9.89452076 sig in 12act.) RANK 13 NODE 2 --> 4.1158123 sigma out 1act.( 5.82380533 sig in 12act.) RANK 14 NODE 11 --> 3.07274246 sigma out 1act.( 4.83481407 sig in 12act.) RANK 15 NODE 7 --> 2.49542594 sigma out 1act.( 4.12324762 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.9545021 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.603408158 *** contribution from regularisation: 0.00290106144 *** contribution from error: -0.606309235 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done