NNInput NNInputs_120.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 195942 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 49007 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 49007 Chosen entries: 49007 Signal fraction: 1 Background fraction: 0.333528 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 49007 Entries to split: 49007 Test with : 24503 Train with : 24503 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 49007 for Signal Prepared event 0 for Signal with 49007 events ====Entry 0 Variable Ht : 156.497 Variable LepAPt : 24.4462 Variable LepBPt : 15.2546 Variable MetSigLeptonsJets : 4.03888 Variable MetSpec : 26.0087 Variable SumEtLeptonsJets : 113.473 Variable VSumJetLeptonsPt : 37.0367 Variable addEt : 82.7245 Variable dPhiLepSumMet : 0.85328 Variable dPhiLeptons : 0.330941 Variable dRLeptons : 0.538617 Variable lep1_E : 30.9903 Variable lep2_E : 15.9065 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2120 Ht = 156.497 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 24.4462 LepAPt = 24.4462 LepBEt = 15.2546 LepBPt = 15.2546 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 43.0236 MetDelPhi = 0.649165 MetSig = 3.00203 MetSigLeptonsJets = 4.03888 MetSpec = 26.0087 Mjj = 0 MostCentralJetEta = -1.64867 MtllMet = 86.7807 Njets = 1 SB = 0 SumEt = 205.392 SumEtJets = 0 SumEtLeptonsJets = 113.473 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 37.0367 addEt = 82.7245 dPhiLepSumMet = 0.85328 dPhiLeptons = 0.330941 dRLeptons = 0.538617 diltype = 45 dimass = 10.4324 event = 71 jet1_Et = 73.7722 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 30.9903 lep2_E = 15.9065 rand = 0.999742 run = 232428 weight = 1.10299e-06 ===Show End Prepared event 10000 for Signal with 49007 events Prepared event 20000 for Signal with 49007 events Prepared event 30000 for Signal with 49007 events Prepared event 40000 for Signal with 49007 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.26048 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4491 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 195942 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4491 negative weights. Signal fraction: 62.286396 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 61.4197693 63.8401642 65.7433472 67.3408203 68.3988495 69.3139954 70.1622467 70.9450073 71.6298065 72.4199829 73.2620544 73.8813477 74.3373871 75.0144348 75.5418854 76.2082977 76.870285 77.3465042 77.8778 78.3954315 78.8935013 79.4324646 79.9380722 80.5879974 81.118103 81.6719208 82.3271866 82.9136353 83.5260391 84.3426285 85.1647644 85.9835358 86.7315979 87.6652679 88.5376358 89.3763123 90.348999 91.386795 92.3063507 93.1555862 94.1371231 95.1879501 95.9736252 96.8064728 97.7327728 98.6516876 99.6455688 100.627083 101.520187 102.303757 103.242142 104.167671 105.073563 105.981903 106.909119 107.847122 108.635544 109.541565 110.582664 111.477402 112.369843 113.368958 114.351349 115.395561 116.499588 117.57843 118.798874 120.211945 121.595795 122.980698 124.738434 126.458191 128.103027 129.786011 131.843018 133.416428 135.386383 137.376007 139.440521 141.463745 143.783463 146.097855 148.576202 151.046875 153.741806 156.730698 160.063812 163.375519 167.268555 171.700165 176.602905 181.84201 188.073334 195.394531 203.845154 213.97435 227.53067 249.138672 290.389709 893.967896 ------------------------------ Transdef: Tab for variable 3 20.0002613 20.250412 20.5044937 20.7380447 20.9874363 21.2273064 21.430294 21.6162758 21.8360405 22.0203171 22.2203274 22.4128494 22.5883598 22.7897987 22.9936485 23.1631546 23.3377953 23.5441628 23.6896935 23.8227329 24.0468407 24.2172775 24.4259262 24.5992603 24.7866135 24.9573059 25.132412 25.3001976 25.4468079 25.615799 25.7747765 25.9348755 26.1287613 26.266571 26.4525719 26.6915245 26.9025612 27.0677757 27.2548714 27.453949 27.664854 27.8780975 28.0848427 28.2571239 28.4880695 28.7037334 28.9146118 29.1146469 29.3109703 29.5376701 29.7404881 29.9631844 30.1686592 30.429636 30.6451588 30.8936348 31.1349773 31.3940029 31.6532097 31.8786163 32.118763 32.3516541 32.623703 32.8556747 33.1360779 33.4430695 33.7655716 34.0611801 34.3412056 34.6372833 34.9829254 35.3422546 35.6788712 36.0389099 36.4127884 36.8150749 37.1913719 37.5691833 37.9966888 38.4786148 38.9638062 39.4528961 39.9497871 40.4618454 40.9656944 41.557106 42.2459793 42.9127693 43.6430626 44.4064789 45.3320732 46.3863907 47.5926933 48.9953575 50.6989746 52.4274292 54.9339294 58.4636726 63.3387527 71.3380432 162.429443 ------------------------------ Transdef: Tab for variable 4 10.0000496 10.0987759 10.1866436 10.2871265 10.3829422 10.4772587 10.5793648 10.6648798 10.7546825 10.8555393 10.9600487 11.0337753 11.1377201 11.2374744 11.3227596 11.4133472 11.521843 11.6249027 11.7313671 11.8290682 11.9470348 12.0539398 12.163806 12.2740917 12.3776779 12.4995728 12.6126308 12.7207985 12.843792 12.9472237 13.0563908 13.1693726 13.3117743 13.4314575 13.5536842 13.6745071 13.7963715 13.9071484 14.0327358 14.1684818 14.2846661 14.3876801 14.5246239 14.6735706 14.7998333 14.9459305 15.0747566 15.2164669 15.3467388 15.4674387 15.6106796 15.7515392 15.8848104 16.0307636 16.2090893 16.3639488 16.5237312 16.6723175 16.813364 16.9869576 17.1659718 17.3630123 17.5409279 17.7440491 17.9360771 18.1377106 18.3293571 18.5196095 18.7190304 18.9207535 19.1235352 19.3534393 19.5950489 19.8152523 20.0248699 20.2401886 20.4466057 20.6665077 20.8774643 21.1176643 21.3663368 21.612606 21.8855247 22.1825542 22.4872284 22.780735 23.1314659 23.4984608 23.891098 24.3157368 24.7405663 25.2293015 25.7948093 26.4101639 27.0782852 27.8611259 28.8819084 30.2437973 32.3608513 36.2852516 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.06199944 2.35917926 2.70216942 2.95910978 3.14262295 3.308496 3.48046255 3.63050866 3.76464844 3.88596392 4.00577164 4.11592865 4.20911121 4.30965233 4.39393044 4.47645521 4.55981064 4.63389397 4.70638466 4.77969551 4.84359026 4.91223049 4.97812271 5.03848171 5.09951353 5.15557909 5.21651506 5.27099037 5.3198452 5.36782265 5.41848278 5.45859861 5.5043726 5.54783821 5.5922308 5.63717699 5.67661381 5.7210989 5.76391554 5.80731869 5.84153032 5.88408327 5.92437649 5.96203899 5.99857521 6.03745651 6.07368565 6.10749483 6.14098787 6.18194008 6.2209425 6.2617979 6.29629421 6.32848454 6.35715246 6.39815426 6.43625259 6.47747517 6.50987816 6.54970551 6.59110975 6.6223793 6.66355562 6.70516777 6.7430706 6.7789588 6.81830215 6.85563755 6.89321756 6.93487835 6.97674894 7.01451588 7.05601788 7.10579729 7.14853477 7.19292593 7.23432255 7.28013992 7.32768869 7.38379097 7.43940592 7.49201488 7.54797173 7.61134624 7.67076015 7.73065996 7.7966423 7.85987377 7.93084049 8.01387405 8.09763908 8.19007111 8.29147339 8.40467834 8.53311157 8.6861763 8.88050079 9.12207413 9.45520782 10.0935001 18.191782 ------------------------------ Transdef: Tab for variable 6 15.0050735 18.694973 22.2538357 25.1383877 25.8816833 26.6049271 27.2709961 27.9390068 28.6663017 29.3224125 29.8286285 30.4635944 31.031353 31.4667912 32.0162964 32.4703522 32.8958893 33.2167053 33.6223068 34.0358276 34.4487152 34.7508659 35.0536842 35.3916855 35.7533531 36.0825157 36.3880692 36.6768608 36.9696045 37.2736244 37.5312347 37.8291092 38.118309 38.4292336 38.7340851 39.0449371 39.3465843 39.6229706 39.9218254 40.2268219 40.471199 40.8244095 41.1099243 41.4254684 41.7510071 42.1005096 42.4226532 42.8286819 43.1177902 43.484375 43.8358536 44.1858749 44.5456619 44.889473 45.2754402 45.7186317 46.1170082 46.5673409 46.936924 47.3885269 47.8326874 48.237072 48.6392517 49.0411224 49.4152603 49.8480835 50.2595062 50.6600494 51.1120071 51.5562859 52.086853 52.5458908 53.0958748 53.5719528 54.1181641 54.5692673 55.0741501 55.6202698 56.1739769 56.7100296 57.2895203 57.8532524 58.3897858 59.0311203 59.7264862 60.5121231 61.3256454 62.2081757 63.233551 64.3407288 65.6009521 66.9734116 68.5783234 70.2644806 72.390564 74.8127899 77.8308105 81.7951965 87.0075989 96.5588455 250.623764 ------------------------------ Transdef: Tab for variable 7 30.1484737 32.2942047 33.3605347 33.9885063 34.5207977 35.0728798 35.5190659 35.9169312 36.2957306 36.6319618 36.9638214 37.2688522 37.57761 37.8731461 38.1634369 38.3953819 38.6627235 38.8965263 39.1597977 39.404747 39.647789 39.9495087 40.2089539 40.4662323 40.8131256 41.0935974 41.3953285 41.7202606 42.0485077 42.3465805 42.756424 43.2120285 43.6036377 44.0533142 44.5202179 44.9481049 45.3589516 45.8751488 46.4183578 46.9207611 47.4728432 48.0443115 48.6452179 49.1823883 49.7868423 50.4180412 50.9701347 51.5170898 52.1195984 52.6262321 53.1902809 53.7741013 54.417099 55.1066132 55.7064247 56.2963753 56.9517212 57.6242065 58.3618622 59.0672989 59.8689728 60.7339325 61.6374893 62.686821 63.8639641 65.0071259 66.2306976 67.5648346 68.8016052 70.2711792 71.536026 72.944313 74.1226044 75.3720169 76.8376236 78.2428665 79.7791138 81.3749084 82.9713135 84.894455 86.7754745 88.759697 90.9584045 93.0698547 95.4933929 97.9111023 100.532936 103.407043 106.478836 110.042267 113.736214 118.070496 122.485191 128.062347 134.716797 142.918335 152.149323 164.1064 180.481537 210.989441 521.871643 ------------------------------ Transdef: Tab for variable 8 2.18757391 19.8761978 24.7878017 27.897728 29.6919518 30.8812675 31.6098099 32.2952461 32.8917961 33.2952881 33.7275314 34.0473557 34.4291458 34.7979431 35.1050224 35.4063187 35.7114563 35.9879074 36.2589493 36.5145798 36.7616348 37.0464363 37.2898407 37.5265274 37.7388077 37.9617958 38.1703873 38.3807907 38.593605 38.831749 39.0303726 39.2748871 39.5268021 39.7518921 40.0327721 40.2626877 40.4657784 40.7419434 40.9479675 41.2449684 41.5256882 41.7864456 42.0645294 42.3864288 42.6767769 42.9879761 43.2986908 43.6581726 44.0070724 44.3059006 44.715168 45.0639801 45.4096756 45.8089638 46.1685638 46.5939865 46.9565735 47.3863983 47.8303299 48.2713013 48.672966 49.0364761 49.4457512 49.9031677 50.2941284 50.7483864 51.117569 51.534111 51.9256973 52.3762207 52.815239 53.269146 53.7500687 54.2095337 54.7067871 55.1645203 55.6473389 56.1427193 56.6782455 57.2442703 57.8963737 58.4366531 59.0890808 59.8702774 60.6112785 61.4888306 62.4506607 63.4666061 64.611908 65.7364426 67.1755829 68.8196106 70.4264526 72.5161133 74.8155212 77.6429901 80.9839706 85.0745621 91.5096588 104.879967 406.55069 ------------------------------ Transdef: Tab for variable 9 46.2588196 60.7144623 63.0645294 64.7318649 66.162384 67.4324951 68.3679657 69.1663513 69.9474487 70.6410599 71.2677155 71.8068695 72.5491943 73.2713318 73.7734451 74.2539215 74.762619 75.2728424 75.7592316 76.2621765 76.8457336 77.2410431 77.7278214 78.1162186 78.5849457 78.9878998 79.429306 79.8218079 80.3194351 80.8561707 81.2961426 81.7769547 82.3038483 82.7328262 83.2931519 83.806778 84.4815826 85.0269775 85.6608429 86.289917 86.879364 87.5972824 88.233284 88.9603653 89.6207123 90.3425369 91.0354309 91.7821884 92.4382553 93.103302 93.7152863 94.4389801 95.2101898 95.8569336 96.5103455 97.1750717 97.9509888 98.606308 99.3275681 100.067589 100.782913 101.506317 102.125038 102.841461 103.626892 104.29541 104.969696 105.634491 106.318863 107.029152 107.684792 108.28038 108.994629 109.686531 110.400558 111.117661 111.829346 112.537231 113.227921 114.001038 114.771408 115.556053 116.3974 117.209305 118.105209 119.089378 120.186813 121.27951 122.497704 123.710464 125.307938 127.091522 129.251526 131.627472 134.393036 138.208527 143.201248 149.520065 159.597076 177.689056 446.331207 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.89832592 1.14854002 1.33785605 1.48647308 1.61849356 1.7378186 1.82797956 1.9031713 1.98718667 2.05254173 2.11558485 2.17086124 2.22155333 2.2703836 2.31628466 2.35427594 2.39417887 2.43116069 2.4634347 2.49655008 2.52657652 2.55732012 2.58531451 2.61048889 2.62948036 2.65281272 2.67737341 2.69973421 2.72042608 2.73996401 2.76013517 2.77816582 2.79364967 2.80940819 2.82385683 2.83590746 2.85027027 2.86184502 2.87108517 2.88061261 2.89056063 2.90019679 2.90900755 2.91716504 2.92589855 2.9340167 2.94088316 2.94830298 2.95496368 2.96151543 2.9681859 2.97529364 2.98022485 2.98596525 2.99051952 2.9948616 3.00049925 3.00542164 3.01024628 3.01526022 3.02033782 3.02444601 3.02825332 3.03240776 3.03612661 3.04040146 3.04427719 3.04816341 3.05206013 3.05578852 3.05933428 3.06219959 3.06649303 3.06972647 3.07334733 3.0766263 3.0796442 3.08293438 3.08617377 3.08909512 3.0926671 3.09566355 3.09870243 3.10138178 3.10403419 3.10631156 3.1093235 3.11213589 3.11452746 3.11668444 3.11906147 3.12159061 3.12443447 3.12701368 3.12949228 3.13202167 3.13390064 3.13647699 3.13882327 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00598122459 0.0112880394 0.0185111798 0.0255916379 0.0328294039 0.041505672 0.0496022403 0.0583934784 0.0665890723 0.0748102665 0.0828243345 0.0901530385 0.0980213061 0.1056301 0.112721644 0.119990826 0.127130836 0.134820223 0.142055064 0.149372041 0.155651569 0.162484065 0.169503927 0.176077336 0.182572484 0.189447641 0.196264148 0.202510953 0.207908869 0.212836474 0.21882844 0.224308729 0.229831815 0.234356463 0.239883661 0.24595201 0.251635313 0.257864892 0.263062119 0.26856482 0.274499416 0.280993223 0.286768109 0.292711318 0.298638612 0.304669738 0.310378522 0.316716731 0.322825193 0.329300404 0.335772276 0.341462851 0.34836483 0.354011416 0.360011458 0.367144585 0.373554289 0.379431903 0.386251181 0.391981959 0.398522317 0.404242247 0.410993099 0.417423785 0.423321843 0.429644555 0.436239779 0.441585004 0.447754622 0.45495376 0.460551739 0.467564136 0.474110603 0.480688572 0.487495452 0.495573252 0.503726423 0.51073122 0.517721176 0.525426865 0.532501459 0.540858865 0.548885226 0.557071328 0.567262053 0.577187955 0.587130308 0.599422991 0.612474084 0.626020908 0.636467576 0.652278543 0.666186452 0.683824718 0.70395565 0.725160599 0.75173527 0.795425892 0.848911762 1.14463592 ------------------------------ Transdef: Tab for variable 12 0.200026914 0.211902678 0.221699238 0.231082827 0.238995761 0.24798131 0.256144553 0.264823675 0.272946715 0.281337053 0.288831294 0.297120541 0.303996384 0.311745793 0.319399297 0.326958954 0.334743977 0.342388332 0.349874377 0.35727492 0.365041822 0.372224867 0.379465044 0.386898279 0.393227696 0.399300814 0.404806614 0.409860671 0.414401025 0.419147432 0.423973382 0.428197861 0.432938635 0.437233031 0.441324472 0.44565326 0.449386209 0.45450604 0.458828211 0.46319139 0.467776954 0.471906215 0.475891173 0.480575264 0.484284222 0.488626033 0.493328393 0.49754107 0.501448035 0.505631864 0.509661674 0.513995469 0.518101215 0.521875262 0.525999427 0.530464172 0.535450816 0.539911628 0.544414759 0.54891634 0.552923322 0.557375073 0.561758041 0.566120148 0.570784748 0.575223505 0.579422116 0.584564805 0.589843154 0.59463346 0.600065708 0.605577469 0.610980272 0.616446495 0.622143388 0.628369689 0.634406924 0.641151667 0.647875309 0.65478766 0.660989404 0.666910946 0.672829807 0.679378211 0.686702669 0.694887042 0.702421308 0.712356806 0.72139895 0.730583549 0.739988387 0.7504704 0.759832025 0.772913814 0.788978577 0.803063631 0.823401332 0.843876958 0.875290751 0.921874404 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0361443 21.3387966 22.0445786 22.5354156 23.044323 23.5080395 23.898571 24.3336906 24.7579021 25.1230259 25.4536629 25.7837944 26.0944614 26.4790382 26.8295498 27.1784744 27.5385246 27.8527946 28.1518002 28.4538021 28.7545319 29.030304 29.3317337 29.6166878 29.9108448 30.1943874 30.465683 30.7643566 31.0193634 31.2955246 31.5698051 31.8812752 32.1515732 32.4485168 32.7397232 33.01931 33.2594681 33.5892105 33.8976822 34.2112045 34.5225067 34.7787704 35.1357689 35.4732437 35.8047218 36.1002922 36.3857574 36.7289619 37.0701447 37.388649 37.7666626 38.1089935 38.465271 38.8505783 39.2262535 39.5992203 39.9981766 40.4718857 40.8505936 41.2739029 41.7810707 42.2484856 42.7489014 43.1816788 43.6418304 44.1271667 44.6823959 45.264389 45.7754517 46.3739014 46.956131 47.559967 48.1584396 48.8118324 49.4521713 50.1701279 50.9618378 51.8164139 52.5482635 53.4724808 54.3902664 55.3682594 56.4227867 57.4798813 58.616478 59.7921371 61.1322784 62.4256439 64.0896149 65.8428345 67.5443726 69.5583496 71.6502762 74.3694611 76.8578415 79.6877213 83.6779175 88.3660583 94.3631973 104.798279 225.703049 ------------------------------ Transdef: Tab for variable 14 10.0034533 10.5674896 10.9239273 11.212203 11.4047947 11.6371689 11.8591576 12.1140156 12.3316107 12.5314655 12.7453556 12.9357891 13.1369324 13.3387585 13.5335941 13.6975746 13.8734341 14.0652962 14.2525387 14.4454117 14.6493492 14.8320045 15.0256605 15.1899014 15.3705578 15.5579824 15.7484064 15.9547653 16.1569462 16.3378716 16.5242653 16.6926746 16.8644848 17.0358791 17.2273045 17.4198818 17.6468391 17.8358784 18.0201302 18.1991329 18.3775978 18.585144 18.794651 19.0115261 19.2070427 19.4272652 19.6121426 19.8435593 20.0358963 20.275423 20.5154572 20.7244339 20.9628468 21.1968956 21.4129333 21.6463852 21.8688297 22.1006851 22.3404884 22.5960464 22.8319473 23.0810509 23.3483601 23.5873585 23.8577156 24.1382637 24.4295349 24.6853638 24.9873104 25.2776756 25.6050377 25.9103184 26.2655525 26.5776119 26.9342728 27.2735538 27.600584 27.9369698 28.299984 28.7701702 29.2795467 29.7464771 30.2588673 30.7665482 31.2809486 31.7898464 32.3857956 33.0605164 33.8696251 34.6956177 35.5650101 36.6363602 37.6070061 39.0106735 40.4701843 42.3635101 44.4977112 47.7325287 51.5753784 57.7149582 115.645821 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 55.8 40.1 29.9 7.1 31.6 54.0 37.8 51.1 -30.9 -5.8 -13.6 7.4 -0.2 2 55.8 100.0 63.6 46.3 11.9 55.3 93.9 59.8 88.9 -52.2 -17.5 -32.1 30.5 17.6 3 40.1 63.6 100.0 22.7 -9.1 22.2 67.3 43.7 68.7 -21.5 -18.3 -35.2 64.1 5.2 4 29.9 46.3 22.7 100.0 -3.1 18.9 48.3 33.5 50.4 -14.7 -19.9 -38.9 7.3 66.8 5 7.1 11.9 -9.1 -3.1 100.0 79.9 -16.3 42.8 41.5 33.2 2.3 6.0 -12.7 -7.3 6 31.6 55.3 22.2 18.9 79.9 100.0 31.9 69.5 73.4 -0.8 -5.8 -9.8 4.6 3.0 7 54.0 93.9 67.3 48.3 -16.3 31.9 100.0 52.7 75.9 -58.9 -17.4 -33.1 35.1 21.0 8 37.8 59.8 43.7 33.5 42.8 69.5 52.7 100.0 73.5 -7.8 -15.1 -23.5 20.3 13.5 9 51.1 88.9 68.7 50.4 41.5 73.4 75.9 73.5 100.0 -25.0 -18.7 -35.1 35.1 21.5 10 -30.9 -52.2 -21.5 -14.7 33.2 -0.8 -58.9 -7.8 -25.0 100.0 5.6 10.3 -7.9 -3.2 11 -5.8 -17.5 -18.3 -19.9 2.3 -5.8 -17.4 -15.1 -18.7 5.6 100.0 55.5 -6.4 -10.0 12 -13.6 -32.1 -35.2 -38.9 6.0 -9.8 -33.1 -23.5 -35.1 10.3 55.5 100.0 -13.3 -15.7 13 7.4 30.5 64.1 7.3 -12.7 4.6 35.1 20.3 35.1 -7.9 -6.4 -13.3 100.0 38.8 14 -0.2 17.6 5.2 66.8 -7.3 3.0 21.0 13.5 21.5 -3.2 -10.0 -15.7 38.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 121.855208 TOTAL CORRELATION OF ALL VARIABLES 61.1315943 ROUND 1: MAX CORR ( 61.1299931) AFTER KILLING INPUT VARIABLE 6 CONTR 0.442462121 ROUND 2: MAX CORR ( 61.1162506) AFTER KILLING INPUT VARIABLE 11 CONTR 1.29613493 ROUND 3: MAX CORR ( 61.0498238) AFTER KILLING INPUT VARIABLE 7 CONTR 2.84870233 ROUND 4: MAX CORR ( 60.7873116) AFTER KILLING INPUT VARIABLE 9 CONTR 5.65541555 ROUND 5: MAX CORR ( 60.7523637) AFTER KILLING INPUT VARIABLE 5 CONTR 2.06096052 ROUND 6: MAX CORR ( 60.4763673) AFTER KILLING INPUT VARIABLE 8 CONTR 5.78434906 ROUND 7: MAX CORR ( 60.3240116) AFTER KILLING INPUT VARIABLE 10 CONTR 4.29006198 ROUND 8: MAX CORR ( 59.9602662) AFTER KILLING INPUT VARIABLE 13 CONTR 6.61459408 ROUND 9: MAX CORR ( 59.3586921) AFTER KILLING INPUT VARIABLE 3 CONTR 8.47226027 ROUND 10: MAX CORR ( 58.7690038) AFTER KILLING INPUT VARIABLE 12 CONTR 8.3461678 ROUND 11: MAX CORR ( 56.6965919) AFTER KILLING INPUT VARIABLE 4 CONTR 15.4690749 ROUND 12: MAX CORR ( 55.7767145) AFTER KILLING INPUT VARIABLE 14 CONTR 10.17161 LAST REMAINING VARIABLE: 2 total correlation to target: 61.1315943 % total significance: 121.757778 sigma correlations of single variables to target: variable 2: 55.7767145 % , in sigma: 111.092291 variable 3: 40.1347164 % , in sigma: 79.9376159 variable 4: 29.9207592 % , in sigma: 59.5941462 variable 5: 7.12620392 % , in sigma: 14.1934914 variable 6: 31.6398366 % , in sigma: 63.0180883 variable 7: 53.9990565 % , in sigma: 107.551672 variable 8: 37.7609718 % , in sigma: 75.2097517 variable 9: 51.0889543 % , in sigma: 101.755527 variable 10: -30.898425 % , in sigma: 61.5413948 variable 11: -5.79470438 % , in sigma: 11.5415006 variable 12: -13.5760495 % , in sigma: 27.0398579 variable 13: 7.43163025 % , in sigma: 14.8018189 variable 14: -0.201393809 % , in sigma: 0.401122579 variables sorted by significance: 1 most relevant variable 2 corr 55.7767143 , in sigma: 111.09229 2 most relevant variable 14 corr 10.1716099 , in sigma: 20.2591252 3 most relevant variable 4 corr 15.4690752 , in sigma: 30.8102586 4 most relevant variable 12 corr 8.34616756 , in sigma: 16.6233325 5 most relevant variable 3 corr 8.47226048 , in sigma: 16.8744759 6 most relevant variable 13 corr 6.61459398 , in sigma: 13.1745013 7 most relevant variable 10 corr 4.29006195 , in sigma: 8.54465547 8 most relevant variable 8 corr 5.78434896 , in sigma: 11.5208754 9 most relevant variable 5 corr 2.06096053 , in sigma: 4.10488191 10 most relevant variable 9 corr 5.65541553 , in sigma: 11.2640745 11 most relevant variable 7 corr 2.84870243 , in sigma: 5.67385299 12 most relevant variable 11 corr 1.29613495 , in sigma: 2.581554 13 most relevant variable 6 corr 0.442462116 , in sigma: 0.881266142 global correlations between input variables: variable 2: 99.017768 % variable 3: 93.6631029 % variable 4: 89.7978885 % variable 5: 94.8559705 % variable 6: 93.6492652 % variable 7: 98.5384684 % variable 8: 84.0535278 % variable 9: 98.6817644 % variable 10: 72.6990031 % variable 11: 56.1731712 % variable 12: 66.6368045 % variable 13: 84.897447 % variable 14: 86.0891778 % significance loss when removing single variables: variable 2: corr = 4.54764326 % , sigma = 9.05768852 variable 3: corr = 10.7504611 % , sigma = 21.4120418 variable 4: corr = 12.2497047 % , sigma = 24.3981339 variable 5: corr = 5.46238956 % , sigma = 10.8796184 variable 6: corr = 0.442462121 % , sigma = 0.88126615 variable 7: corr = 2.81385779 % , sigma = 5.60445179 variable 8: corr = 3.53082612 % , sigma = 7.03246084 variable 9: corr = 4.67279599 % , sigma = 9.30695927 variable 10: corr = 5.86264418 % , sigma = 11.6768185 variable 11: corr = 1.283517 % , sigma = 2.55642241 variable 12: corr = 7.64887186 % , sigma = 15.2345061 variable 13: corr = 6.15308666 % , sigma = 12.2553022 variable 14: corr = 8.66413722 % , sigma = 17.256643 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 20.2852859 sigma out 15 active outputs RANK 2 NODE 9 --> 20.121933 sigma out 15 active outputs RANK 3 NODE 5 --> 18.0524483 sigma out 15 active outputs RANK 4 NODE 3 --> 17.2534142 sigma out 15 active outputs RANK 5 NODE 7 --> 17.0961514 sigma out 15 active outputs RANK 6 NODE 6 --> 16.5876884 sigma out 15 active outputs RANK 7 NODE 10 --> 16.1350689 sigma out 15 active outputs RANK 8 NODE 12 --> 15.3920679 sigma out 15 active outputs RANK 9 NODE 2 --> 14.3512001 sigma out 15 active outputs RANK 10 NODE 11 --> 14.2073393 sigma out 15 active outputs RANK 11 NODE 1 --> 14.155036 sigma out 15 active outputs RANK 12 NODE 4 --> 10.3313065 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 26.6573715 sigma in 12act. ( 31.3056297 sig out 1act.) RANK 2 NODE 13 --> 26.3118877 sigma in 12act. ( 26.1905422 sig out 1act.) RANK 3 NODE 1 --> 21.8489685 sigma in 12act. ( 20.8521805 sig out 1act.) RANK 4 NODE 4 --> 20.6578484 sigma in 12act. ( 19.0856266 sig out 1act.) RANK 5 NODE 2 --> 18.0453568 sigma in 12act. ( 19.9812412 sig out 1act.) RANK 6 NODE 8 --> 18.0299416 sigma in 12act. ( 15.8996248 sig out 1act.) RANK 7 NODE 12 --> 8.84679222 sigma in 12act. ( 5.64594793 sig out 1act.) RANK 8 NODE 6 --> 6.91348743 sigma in 12act. ( 6.20864439 sig out 1act.) RANK 9 NODE 9 --> 6.29564571 sigma in 12act. ( 7.55426979 sig out 1act.) RANK 10 NODE 3 --> 5.93365908 sigma in 12act. ( 5.80238104 sig out 1act.) RANK 11 NODE 14 --> 4.65111494 sigma in 12act. ( 1.80018842 sig out 1act.) RANK 12 NODE 11 --> 4.57046795 sigma in 12act. ( 5.16584682 sig out 1act.) RANK 13 NODE 15 --> 2.59525061 sigma in 12act. ( 2.41759634 sig out 1act.) RANK 14 NODE 10 --> 2.47881222 sigma in 12act. ( 2.14297175 sig out 1act.) RANK 15 NODE 7 --> 2.33929324 sigma in 12act. ( 3.72979999 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 31.3056297 sigma out 1act.( 26.6573715 sig in 12act.) RANK 2 NODE 13 --> 26.1905422 sigma out 1act.( 26.3118877 sig in 12act.) RANK 3 NODE 1 --> 20.8521805 sigma out 1act.( 21.8489685 sig in 12act.) RANK 4 NODE 2 --> 19.9812412 sigma out 1act.( 18.0453568 sig in 12act.) RANK 5 NODE 4 --> 19.0856266 sigma out 1act.( 20.6578484 sig in 12act.) RANK 6 NODE 8 --> 15.8996248 sigma out 1act.( 18.0299416 sig in 12act.) RANK 7 NODE 9 --> 7.55426979 sigma out 1act.( 6.29564571 sig in 12act.) RANK 8 NODE 6 --> 6.20864439 sigma out 1act.( 6.91348743 sig in 12act.) RANK 9 NODE 3 --> 5.80238104 sigma out 1act.( 5.93365908 sig in 12act.) RANK 10 NODE 12 --> 5.64594793 sigma out 1act.( 8.84679222 sig in 12act.) RANK 11 NODE 11 --> 5.16584682 sigma out 1act.( 4.57046795 sig in 12act.) RANK 12 NODE 7 --> 3.72979999 sigma out 1act.( 2.33929324 sig in 12act.) RANK 13 NODE 15 --> 2.41759634 sigma out 1act.( 2.59525061 sig in 12act.) RANK 14 NODE 10 --> 2.14297175 sigma out 1act.( 2.47881222 sig in 12act.) RANK 15 NODE 14 --> 1.80018842 sigma out 1act.( 4.65111494 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 57.7281837 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 21.0430565 sigma out 15 active outputs RANK 2 NODE 8 --> 20.6722221 sigma out 15 active outputs RANK 3 NODE 9 --> 19.4204788 sigma out 15 active outputs RANK 4 NODE 5 --> 18.523325 sigma out 15 active outputs RANK 5 NODE 7 --> 18.1033268 sigma out 15 active outputs RANK 6 NODE 10 --> 17.0308781 sigma out 15 active outputs RANK 7 NODE 3 --> 16.7307091 sigma out 15 active outputs RANK 8 NODE 6 --> 15.9053602 sigma out 15 active outputs RANK 9 NODE 2 --> 15.2783737 sigma out 15 active outputs RANK 10 NODE 1 --> 15.1006031 sigma out 15 active outputs RANK 11 NODE 11 --> 14.3199644 sigma out 15 active outputs RANK 12 NODE 4 --> 9.85254383 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 28.755888 sigma in 12act. ( 29.7896442 sig out 1act.) RANK 2 NODE 13 --> 25.8844414 sigma in 12act. ( 25.0285015 sig out 1act.) RANK 3 NODE 2 --> 20.7712326 sigma in 12act. ( 19.1127224 sig out 1act.) RANK 4 NODE 1 --> 19.5032444 sigma in 12act. ( 19.0329971 sig out 1act.) RANK 5 NODE 4 --> 17.0591011 sigma in 12act. ( 16.6884708 sig out 1act.) RANK 6 NODE 8 --> 15.0110826 sigma in 12act. ( 14.0569153 sig out 1act.) RANK 7 NODE 7 --> 12.2442322 sigma in 12act. ( 5.77240515 sig out 1act.) RANK 8 NODE 9 --> 9.58189392 sigma in 12act. ( 8.45084381 sig out 1act.) RANK 9 NODE 12 --> 8.97400475 sigma in 12act. ( 4.70268917 sig out 1act.) RANK 10 NODE 3 --> 8.91293526 sigma in 12act. ( 5.80872822 sig out 1act.) RANK 11 NODE 11 --> 8.73028851 sigma in 12act. ( 5.719944 sig out 1act.) RANK 12 NODE 14 --> 7.96435785 sigma in 12act. ( 2.81423426 sig out 1act.) RANK 13 NODE 6 --> 7.80557299 sigma in 12act. ( 5.83285093 sig out 1act.) RANK 14 NODE 15 --> 6.35928106 sigma in 12act. ( 2.85159326 sig out 1act.) RANK 15 NODE 10 --> 6.07400322 sigma in 12act. ( 2.41695046 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 29.7896442 sigma out 1act.( 28.755888 sig in 12act.) RANK 2 NODE 13 --> 25.0285015 sigma out 1act.( 25.8844414 sig in 12act.) RANK 3 NODE 2 --> 19.1127224 sigma out 1act.( 20.7712326 sig in 12act.) RANK 4 NODE 1 --> 19.0329971 sigma out 1act.( 19.5032444 sig in 12act.) RANK 5 NODE 4 --> 16.6884708 sigma out 1act.( 17.0591011 sig in 12act.) RANK 6 NODE 8 --> 14.0569153 sigma out 1act.( 15.0110826 sig in 12act.) RANK 7 NODE 9 --> 8.45084381 sigma out 1act.( 9.58189392 sig in 12act.) RANK 8 NODE 6 --> 5.83285093 sigma out 1act.( 7.80557299 sig in 12act.) RANK 9 NODE 3 --> 5.80872822 sigma out 1act.( 8.91293526 sig in 12act.) RANK 10 NODE 7 --> 5.77240515 sigma out 1act.( 12.2442322 sig in 12act.) RANK 11 NODE 11 --> 5.719944 sigma out 1act.( 8.73028851 sig in 12act.) RANK 12 NODE 12 --> 4.70268917 sigma out 1act.( 8.97400475 sig in 12act.) RANK 13 NODE 15 --> 2.85159326 sigma out 1act.( 6.35928106 sig in 12act.) RANK 14 NODE 14 --> 2.81423426 sigma out 1act.( 7.96435785 sig in 12act.) RANK 15 NODE 10 --> 2.41695046 sigma out 1act.( 6.07400322 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.4676895 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.410042793 *** contribution from regularisation: 0.0043058251 *** contribution from error: -0.414348632 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.453015119 *** contribution from regularisation: 0.00232934579 *** contribution from error: -0.455344468 *********************************************** -----------------> Test sample ENTER BFGS code START -44392.1401 0.105112314 -0.378296047 EXIT FROM BFGS code FG_START 0. 0.105112314 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.480772674 *** contribution from regularisation: 0.0022506211 *** contribution from error: -0.483023286 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47101.7809 0.105112314 -342.97998 EXIT FROM BFGS code FG_LNSRCH 0. 0.0445663258 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.511236548 *** contribution from regularisation: 0.00302295992 *** contribution from error: -0.514259517 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50086.3567 0.0445663258 -140.247543 EXIT FROM BFGS code NEW_X -50086.3567 0.0445663258 -140.247543 ENTER BFGS code NEW_X -50086.3567 0.0445663258 -140.247543 EXIT FROM BFGS code FG_LNSRCH 0. 0.0213893 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.512929738 *** contribution from regularisation: 0.00304420339 *** contribution from error: -0.515973926 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50252.2383 0.0213893 -78.7477417 EXIT FROM BFGS code NEW_X -50252.2383 0.0213893 -78.7477417 ENTER BFGS code NEW_X -50252.2383 0.0213893 -78.7477417 EXIT FROM BFGS code FG_LNSRCH 0. -0.00726475846 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.513788819 *** contribution from regularisation: 0.00303462916 *** contribution from error: -0.516823471 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50336.4057 -0.00726475846 -28.1830387 EXIT FROM BFGS code NEW_X -50336.4057 -0.00726475846 -28.1830387 ENTER BFGS code NEW_X -50336.4057 -0.00726475846 -28.1830387 EXIT FROM BFGS code FG_LNSRCH 0. -0.0348445065 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.514268577 *** contribution from regularisation: 0.00301489932 *** contribution from error: -0.517283499 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50383.4054 -0.0348445065 7.2407198 EXIT FROM BFGS code NEW_X -50383.4054 -0.0348445065 7.2407198 ENTER BFGS code NEW_X -50383.4054 -0.0348445065 7.2407198 EXIT FROM BFGS code FG_LNSRCH 0. -0.0686887726 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.515087545 *** contribution from regularisation: 0.00297178514 *** contribution from error: -0.518059313 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50463.6399 -0.0686887726 23.6243839 EXIT FROM BFGS code NEW_X -50463.6399 -0.0686887726 23.6243839 ENTER BFGS code NEW_X -50463.6399 -0.0686887726 23.6243839 EXIT FROM BFGS code FG_LNSRCH 0. -0.452965349 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.50288105 *** contribution from regularisation: 0.00464521535 *** contribution from error: -0.507526278 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49267.7614 -0.452965349 -4.25836945 EXIT FROM BFGS code FG_LNSRCH 0. -0.178525284 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 38.7061501 sigma out 15 active outputs RANK 2 NODE 10 --> 22.1436043 sigma out 15 active outputs RANK 3 NODE 3 --> 21.2457829 sigma out 15 active outputs RANK 4 NODE 1 --> 20.534687 sigma out 15 active outputs RANK 5 NODE 7 --> 15.0331059 sigma out 15 active outputs RANK 6 NODE 6 --> 13.1368237 sigma out 15 active outputs RANK 7 NODE 9 --> 12.2468348 sigma out 15 active outputs RANK 8 NODE 5 --> 11.9065027 sigma out 15 active outputs RANK 9 NODE 8 --> 11.3295546 sigma out 15 active outputs RANK 10 NODE 2 --> 9.17572498 sigma out 15 active outputs RANK 11 NODE 11 --> 8.72921085 sigma out 15 active outputs RANK 12 NODE 4 --> 5.69620085 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 42.8128853 sigma in 12act. ( 55.0861015 sig out 1act.) RANK 2 NODE 13 --> 28.8115063 sigma in 12act. ( 26.6217003 sig out 1act.) RANK 3 NODE 9 --> 16.1908703 sigma in 12act. ( 15.4525805 sig out 1act.) RANK 4 NODE 5 --> 16.1149082 sigma in 12act. ( 15.6304111 sig out 1act.) RANK 5 NODE 10 --> 11.0894146 sigma in 12act. ( 10.0730801 sig out 1act.) RANK 6 NODE 14 --> 10.2506828 sigma in 12act. ( 9.04579926 sig out 1act.) RANK 7 NODE 11 --> 10.193655 sigma in 12act. ( 9.36852551 sig out 1act.) RANK 8 NODE 2 --> 9.9020462 sigma in 12act. ( 8.49584484 sig out 1act.) RANK 9 NODE 3 --> 8.27449417 sigma in 12act. ( 7.65123129 sig out 1act.) RANK 10 NODE 8 --> 7.142241 sigma in 12act. ( 6.25072241 sig out 1act.) RANK 11 NODE 15 --> 7.08781481 sigma in 12act. ( 5.03669071 sig out 1act.) RANK 12 NODE 12 --> 6.22569466 sigma in 12act. ( 5.16982079 sig out 1act.) RANK 13 NODE 1 --> 5.13406181 sigma in 12act. ( 3.54871249 sig out 1act.) RANK 14 NODE 6 --> 3.82859325 sigma in 12act. ( 1.98204327 sig out 1act.) RANK 15 NODE 4 --> 2.94882417 sigma in 12act. ( 1.99661732 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 55.0861015 sigma out 1act.( 42.8128853 sig in 12act.) RANK 2 NODE 13 --> 26.6217003 sigma out 1act.( 28.8115063 sig in 12act.) RANK 3 NODE 5 --> 15.6304111 sigma out 1act.( 16.1149082 sig in 12act.) RANK 4 NODE 9 --> 15.4525805 sigma out 1act.( 16.1908703 sig in 12act.) RANK 5 NODE 10 --> 10.0730801 sigma out 1act.( 11.0894146 sig in 12act.) RANK 6 NODE 11 --> 9.36852551 sigma out 1act.( 10.193655 sig in 12act.) RANK 7 NODE 14 --> 9.04579926 sigma out 1act.( 10.2506828 sig in 12act.) RANK 8 NODE 2 --> 8.49584484 sigma out 1act.( 9.9020462 sig in 12act.) RANK 9 NODE 3 --> 7.65123129 sigma out 1act.( 8.27449417 sig in 12act.) RANK 10 NODE 8 --> 6.25072241 sigma out 1act.( 7.142241 sig in 12act.) RANK 11 NODE 12 --> 5.16982079 sigma out 1act.( 6.22569466 sig in 12act.) RANK 12 NODE 15 --> 5.03669071 sigma out 1act.( 7.08781481 sig in 12act.) RANK 13 NODE 1 --> 3.54871249 sigma out 1act.( 5.13406181 sig in 12act.) RANK 14 NODE 4 --> 1.99661732 sigma out 1act.( 2.94882417 sig in 12act.) RANK 15 NODE 6 --> 1.98204327 sigma out 1act.( 3.82859325 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 68.8458023 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.519136727 *** contribution from regularisation: 0.00163781084 *** contribution from error: -0.520774543 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50860.3421 -0.178525284 10.2000427 EXIT FROM BFGS code NEW_X -50860.3421 -0.178525284 10.2000427 ENTER BFGS code NEW_X -50860.3421 -0.178525284 10.2000427 EXIT FROM BFGS code FG_LNSRCH 0. -0.512436628 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.505988657 *** contribution from regularisation: 0.00521333888 *** contribution from error: -0.511201978 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49572.2134 -0.512436628 37.4696159 EXIT FROM BFGS code FG_LNSRCH 0. -0.241869912 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.520683289 *** contribution from regularisation: 0.00155576074 *** contribution from error: -0.522239029 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51011.8601 -0.241869912 -3.44494224 EXIT FROM BFGS code NEW_X -51011.8601 -0.241869912 -3.44494224 ENTER BFGS code NEW_X -51011.8601 -0.241869912 -3.44494224 EXIT FROM BFGS code FG_LNSRCH 0. -0.51618278 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.515810072 *** contribution from regularisation: 0.00464413594 *** contribution from error: -0.520454228 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50534.4269 -0.51618278 25.2589321 EXIT FROM BFGS code FG_LNSRCH 0. -0.316410482 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.52227807 *** contribution from regularisation: 0.00172422151 *** contribution from error: -0.524002314 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51168.1064 -0.316410482 -10.6910086 EXIT FROM BFGS code NEW_X -51168.1064 -0.316410482 -10.6910086 ENTER BFGS code NEW_X -51168.1064 -0.316410482 -10.6910086 EXIT FROM BFGS code FG_LNSRCH 0. -0.432054907 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.522713423 *** contribution from regularisation: 0.00342526427 *** contribution from error: -0.526138663 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51210.7539 -0.432054907 1.98750341 EXIT FROM BFGS code NEW_X -51210.7539 -0.432054907 1.98750341 ENTER BFGS code NEW_X -51210.7539 -0.432054907 1.98750341 EXIT FROM BFGS code FG_LNSRCH 0. -0.382042944 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.5240677 *** contribution from regularisation: 0.00239298004 *** contribution from error: -0.526460707 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51343.4352 -0.382042944 8.71763992 EXIT FROM BFGS code NEW_X -51343.4352 -0.382042944 8.71763992 ENTER BFGS code NEW_X -51343.4352 -0.382042944 8.71763992 EXIT FROM BFGS code FG_LNSRCH 0. -0.372978777 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.524059653 *** contribution from regularisation: 0.00267108576 *** contribution from error: -0.526730716 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51342.6459 -0.372978777 8.61410999 EXIT FROM BFGS code FG_LNSRCH 0. -0.379867911 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.523882568 *** contribution from regularisation: 0.00265808846 *** contribution from error: -0.526540637 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51325.2972 -0.379867911 8.57289982 EXIT FROM BFGS code FG_LNSRCH 0. -0.381929815 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.523807228 *** contribution from regularisation: 0.00265750545 *** contribution from error: -0.52646476 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51317.9201 -0.381929815 8.57204056 EXIT FROM BFGS code FG_LNSRCH 0. -0.382042646 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 58.4415894 sigma out 15 active outputs RANK 2 NODE 10 --> 46.0332489 sigma out 15 active outputs RANK 3 NODE 3 --> 26.6739006 sigma out 15 active outputs RANK 4 NODE 7 --> 21.7593899 sigma out 15 active outputs RANK 5 NODE 1 --> 21.2216167 sigma out 15 active outputs RANK 6 NODE 9 --> 20.9088135 sigma out 15 active outputs RANK 7 NODE 8 --> 15.0572968 sigma out 15 active outputs RANK 8 NODE 2 --> 11.1766405 sigma out 15 active outputs RANK 9 NODE 11 --> 9.31799221 sigma out 15 active outputs RANK 10 NODE 5 --> 8.15078735 sigma out 15 active outputs RANK 11 NODE 6 --> 7.63503122 sigma out 15 active outputs RANK 12 NODE 4 --> 6.61303473 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 73.4339523 sigma in 12act. ( 98.7986069 sig out 1act.) RANK 2 NODE 13 --> 40.2531013 sigma in 12act. ( 44.2136116 sig out 1act.) RANK 3 NODE 9 --> 19.7391148 sigma in 12act. ( 18.4833469 sig out 1act.) RANK 4 NODE 5 --> 14.9230614 sigma in 12act. ( 16.4624786 sig out 1act.) RANK 5 NODE 10 --> 14.1276579 sigma in 12act. ( 14.8326302 sig out 1act.) RANK 6 NODE 8 --> 8.65455627 sigma in 12act. ( 8.58669758 sig out 1act.) RANK 7 NODE 14 --> 7.98124409 sigma in 12act. ( 6.09569025 sig out 1act.) RANK 8 NODE 12 --> 7.81959248 sigma in 12act. ( 7.48825693 sig out 1act.) RANK 9 NODE 11 --> 7.63855791 sigma in 12act. ( 5.08038521 sig out 1act.) RANK 10 NODE 15 --> 6.22719955 sigma in 12act. ( 4.43521547 sig out 1act.) RANK 11 NODE 2 --> 5.63865376 sigma in 12act. ( 2.96444368 sig out 1act.) RANK 12 NODE 3 --> 5.08646536 sigma in 12act. ( 2.41604042 sig out 1act.) RANK 13 NODE 6 --> 3.83710551 sigma in 12act. ( 1.94145572 sig out 1act.) RANK 14 NODE 1 --> 3.68368769 sigma in 12act. ( 1.46777582 sig out 1act.) RANK 15 NODE 4 --> 2.50919914 sigma in 12act. ( 1.32490039 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 98.7986069 sigma out 1act.( 73.4339523 sig in 12act.) RANK 2 NODE 13 --> 44.2136116 sigma out 1act.( 40.2531013 sig in 12act.) RANK 3 NODE 9 --> 18.4833469 sigma out 1act.( 19.7391148 sig in 12act.) RANK 4 NODE 5 --> 16.4624786 sigma out 1act.( 14.9230614 sig in 12act.) RANK 5 NODE 10 --> 14.8326302 sigma out 1act.( 14.1276579 sig in 12act.) RANK 6 NODE 8 --> 8.58669758 sigma out 1act.( 8.65455627 sig in 12act.) RANK 7 NODE 12 --> 7.48825693 sigma out 1act.( 7.81959248 sig in 12act.) RANK 8 NODE 14 --> 6.09569025 sigma out 1act.( 7.98124409 sig in 12act.) RANK 9 NODE 11 --> 5.08038521 sigma out 1act.( 7.63855791 sig in 12act.) RANK 10 NODE 15 --> 4.43521547 sigma out 1act.( 6.22719955 sig in 12act.) RANK 11 NODE 2 --> 2.96444368 sigma out 1act.( 5.63865376 sig in 12act.) RANK 12 NODE 3 --> 2.41604042 sigma out 1act.( 5.08646536 sig in 12act.) RANK 13 NODE 6 --> 1.94145572 sigma out 1act.( 3.83710551 sig in 12act.) RANK 14 NODE 1 --> 1.46777582 sigma out 1act.( 3.68368769 sig in 12act.) RANK 15 NODE 4 --> 1.32490039 sigma out 1act.( 2.50919914 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 113.063744 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.523786128 *** contribution from regularisation: 0.00267452607 *** contribution from error: -0.526460648 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51315.8536 -0.382042646 8.48951244 EXIT FROM BFGS code FG_LNSRCH 0. -0.382042944 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.523818552 *** contribution from regularisation: 0.00264214166 *** contribution from error: -0.526460707 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51319.0246 -0.382042944 8.5350523 EXIT FROM BFGS code FG_LNSRCH 0. -0.382042944 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.523785532 *** contribution from regularisation: 0.00267510954 *** contribution from error: -0.526460648 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51315.7947 -0.382042944 8.50833797 EXIT FROM BFGS code FG_LNSRCH 0. -0.382042944 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.523794949 *** contribution from regularisation: 0.00266570435 *** contribution from error: -0.526460648 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51316.7161 -0.382042944 8.45504284 EXIT FROM BFGS code NEW_X -51316.7161 -0.382042944 8.45504284 ENTER BFGS code NEW_X -51316.7161 -0.382042944 8.45504284 EXIT FROM BFGS code CONVERGENC -51316.7161 -0.382042944 8.45504284 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 90.8921814 sigma out 15 active outputs RANK 2 NODE 10 --> 73.2117996 sigma out 15 active outputs RANK 3 NODE 3 --> 42.2163773 sigma out 15 active outputs RANK 4 NODE 7 --> 35.1759491 sigma out 15 active outputs RANK 5 NODE 1 --> 32.8435936 sigma out 15 active outputs RANK 6 NODE 9 --> 32.6341972 sigma out 15 active outputs RANK 7 NODE 8 --> 23.8922787 sigma out 15 active outputs RANK 8 NODE 2 --> 17.4161205 sigma out 15 active outputs RANK 9 NODE 11 --> 14.9532223 sigma out 15 active outputs RANK 10 NODE 5 --> 12.6474152 sigma out 15 active outputs RANK 11 NODE 6 --> 11.3568974 sigma out 15 active outputs RANK 12 NODE 4 --> 10.0487089 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 115.519371 sigma in 12act. ( 156.200073 sig out 1act.) RANK 2 NODE 13 --> 65.1568375 sigma in 12act. ( 69.2521744 sig out 1act.) RANK 3 NODE 9 --> 30.3717194 sigma in 12act. ( 29.4613209 sig out 1act.) RANK 4 NODE 5 --> 22.7232704 sigma in 12act. ( 26.256012 sig out 1act.) RANK 5 NODE 10 --> 22.2809734 sigma in 12act. ( 23.0635605 sig out 1act.) RANK 6 NODE 8 --> 13.1567297 sigma in 12act. ( 13.7341509 sig out 1act.) RANK 7 NODE 12 --> 12.0042572 sigma in 12act. ( 12.0996065 sig out 1act.) RANK 8 NODE 14 --> 11.1648016 sigma in 12act. ( 9.81084728 sig out 1act.) RANK 9 NODE 11 --> 10.0189648 sigma in 12act. ( 8.02910328 sig out 1act.) RANK 10 NODE 15 --> 8.81683636 sigma in 12act. ( 7.03889656 sig out 1act.) RANK 11 NODE 2 --> 6.81320333 sigma in 12act. ( 4.67253828 sig out 1act.) RANK 12 NODE 3 --> 5.75979042 sigma in 12act. ( 3.87741423 sig out 1act.) RANK 13 NODE 6 --> 4.70148039 sigma in 12act. ( 3.08152819 sig out 1act.) RANK 14 NODE 1 --> 4.0766139 sigma in 12act. ( 2.32779288 sig out 1act.) RANK 15 NODE 4 --> 2.93857718 sigma in 12act. ( 2.15003562 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 156.200073 sigma out 1act.( 115.519371 sig in 12act.) RANK 2 NODE 13 --> 69.2521744 sigma out 1act.( 65.1568375 sig in 12act.) RANK 3 NODE 9 --> 29.4613209 sigma out 1act.( 30.3717194 sig in 12act.) RANK 4 NODE 5 --> 26.256012 sigma out 1act.( 22.7232704 sig in 12act.) RANK 5 NODE 10 --> 23.0635605 sigma out 1act.( 22.2809734 sig in 12act.) RANK 6 NODE 8 --> 13.7341509 sigma out 1act.( 13.1567297 sig in 12act.) RANK 7 NODE 12 --> 12.0996065 sigma out 1act.( 12.0042572 sig in 12act.) RANK 8 NODE 14 --> 9.81084728 sigma out 1act.( 11.1648016 sig in 12act.) RANK 9 NODE 11 --> 8.02910328 sigma out 1act.( 10.0189648 sig in 12act.) RANK 10 NODE 15 --> 7.03889656 sigma out 1act.( 8.81683636 sig in 12act.) RANK 11 NODE 2 --> 4.67253828 sigma out 1act.( 6.81320333 sig in 12act.) RANK 12 NODE 3 --> 3.87741423 sigma out 1act.( 5.75979042 sig in 12act.) RANK 13 NODE 6 --> 3.08152819 sigma out 1act.( 4.70148039 sig in 12act.) RANK 14 NODE 1 --> 2.32779288 sigma out 1act.( 4.0766139 sig in 12act.) RANK 15 NODE 4 --> 2.15003562 sigma out 1act.( 2.93857718 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 178.564545 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.523822665 *** contribution from regularisation: 0.00263801985 *** contribution from error: -0.526460707 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done