NNInput NNInputs_175.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 44840 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 8637 nbkg = 36203 Bkg Entries: 36203 Sig Entries: 8637 Chosen entries: 8637 Signal fraction: 1 Background fraction: 0.238571 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 36203 Actual Signal Entries: 8637 Entries to split: 8637 Test with : 4318 Train with : 4318 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 8637 for Signal Prepared event 0 for Signal with 8637 events ====Entry 0 Variable Ht : 109.328 Variable LepAPt : 50.6397 Variable LepBPt : 11.0578 Variable MetSigLeptonsJets : 6.06392 Variable MetSpec : 47.6307 Variable SumEtLeptonsJets : 61.6975 Variable VSumJetLeptonsPt : 60.6478 Variable addEt : 109.328 Variable dPhiLepSumMet : 2.32261 Variable dPhiLeptons : 0.483604 Variable dRLeptons : 0.649189 Variable lep1_E : 59.8503 Variable lep2_E : 11.2018 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2175 Ht = 109.328 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 50.6397 LepAPt = 50.6397 LepBEt = 11.0578 LepBPt = 11.0578 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 47.6307 MetDelPhi = 2.23774 MetSig = 3.10739 MetSigLeptonsJets = 6.06392 MetSpec = 47.6307 Mjj = 0 MostCentralJetEta = 0 MtllMet = 113.8 Njets = 0 SB = 0 SumEt = 234.954 SumEtJets = 0 SumEtLeptonsJets = 61.6975 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 60.6478 addEt = 109.328 dPhiLepSumMet = 2.32261 dPhiLeptons = 0.483604 dRLeptons = 0.649189 diltype = 55 dimass = 15.3334 event = 1309 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 59.8503 lep2_E = 11.2018 rand = 0.999742 run = 236503 weight = 3.84833e-06 ===Show End Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 36203 for Background Prepared event 0 for Background with 36203 events ====Entry 0 Variable Ht : 80.3296 Variable LepAPt : 25.5911 Variable LepBPt : 11.162 Variable MetSigLeptonsJets : 7.18795 Variable MetSpec : 43.5765 Variable SumEtLeptonsJets : 36.7531 Variable VSumJetLeptonsPt : 34.1227 Variable addEt : 80.3296 Variable dPhiLepSumMet : 2.89659 Variable dPhiLeptons : 0.831637 Variable dRLeptons : 0.924544 Variable lep1_E : 25.6567 Variable lep2_E : 12.448 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 80.3296 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 25.5911 LepAPt = 25.5911 LepBEt = 11.162 LepBPt = 11.162 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 43.5765 MetDelPhi = 2.65242 MetSig = 3.63746 MetSigLeptonsJets = 7.18795 MetSpec = 43.5765 Mjj = 0 MostCentralJetEta = 0 MtllMet = 81.3504 Njets = 0 SB = 0 SumEt = 143.519 SumEtJets = 0 SumEtLeptonsJets = 36.7531 Target = 0 TrainWeight = 0.276019 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 34.1227 addEt = 80.3296 dPhiLepSumMet = 2.89659 dPhiLeptons = 0.831637 dRLeptons = 0.924544 diltype = 45 dimass = 15.2865 event = 23115824 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 25.6567 lep2_E = 12.448 rand = 0.999742 run = 271104 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 36203 events Prepared event 20000 for Background with 36203 events Prepared event 30000 for Background with 36203 events Warning: found 899 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 44840 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 899 negative weights. Signal fraction: 63.3134422 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 55.8830566 62.6126938 64.7426453 66.5548325 67.7529907 68.5706711 69.7237167 70.5935974 71.3544769 72.0938873 72.9255753 73.6272507 74.2183762 74.8214417 75.4425201 76.0334015 76.6405334 77.2698898 77.6885529 78.0693207 78.5763855 79.2755508 79.7955017 80.4456024 80.9947433 81.654541 82.2662888 83.0583572 83.8422394 84.9997559 86.2014771 87.5062256 88.5766296 89.9450684 91.8686371 93.7522202 95.4464569 97.1181641 99.2119446 101.230743 103.197243 105.419296 107.334106 108.981491 111.566216 113.378235 115.651352 117.667938 119.524452 121.867706 124.061386 125.919327 127.84066 129.734436 131.566742 133.169342 134.70285 136.548615 138.337311 140.056656 141.671814 143.310181 144.757751 146.38237 148.035507 149.598801 150.805267 152.66124 154.264771 155.664886 157.100983 158.862137 160.486206 162.422119 164.603165 166.127747 167.524597 169.443604 171.511902 174.039764 176.230545 178.817703 181.489166 184.598297 187.453644 190.236725 193.657486 197.629822 201.163345 204.832458 208.749481 213.24704 217.892822 224.857376 233.995087 241.527649 251.159088 266.028076 290.267303 323.876038 702.77301 ------------------------------ Transdef: Tab for variable 3 20.002533 20.3166351 20.5947876 20.8616714 21.1325817 21.4690628 21.7212181 21.9204941 22.1132507 22.3453178 22.5745068 22.8446236 23.0446968 23.2457619 23.4627304 23.6707554 23.8635178 24.0527267 24.2370262 24.4501171 24.6014462 24.8269424 25.019886 25.2404118 25.4117126 25.5691071 25.7821007 25.98069 26.1625099 26.4074059 26.7123222 26.9084492 27.1425591 27.3209782 27.6328087 27.8670692 28.0656567 28.2577991 28.5323448 28.7744255 29.0457268 29.2380562 29.5621471 29.7999191 30.0826759 30.3810234 30.6732101 31.0096245 31.3568878 31.7100639 32.0944519 32.4012337 32.7343788 33.0451431 33.3431129 33.6925964 34.0775146 34.4588013 34.8707352 35.3305435 35.719532 36.1365547 36.5663147 36.9534607 37.3332825 37.7657776 38.2876434 38.6530685 39.1902313 39.6137085 40.0768394 40.4818039 40.9561806 41.3680878 41.8858032 42.3786926 42.9156761 43.4505386 43.9599304 44.5548592 45.1033783 45.6809845 46.1466866 46.8790054 47.4554367 48.2659149 49.0610123 49.947258 50.7033691 51.5580177 52.5616531 53.7067032 54.6520996 55.9276581 57.5723495 59.4748764 61.2382736 63.6324844 67.267952 73.0402832 151.031479 ------------------------------ Transdef: Tab for variable 4 10.0006418 10.098814 10.2191925 10.326479 10.4396009 10.5499668 10.7073059 10.8196449 10.9382792 11.0396786 11.1689625 11.3329315 11.4159908 11.5900745 11.7384987 11.8644733 12.0054646 12.1508865 12.3239574 12.4989233 12.6346149 12.7757759 12.9127827 13.0460958 13.1907501 13.3587952 13.5231056 13.6860237 13.8743343 14.0423489 14.2405834 14.4205189 14.6023073 14.7927189 14.9823151 15.1599808 15.3636379 15.5567226 15.7774239 16.0105305 16.2363319 16.4441757 16.6538448 16.8679466 17.0909748 17.2974014 17.5164642 17.805294 18.0464954 18.2840672 18.5390358 18.8721542 19.133112 19.3497658 19.6521568 19.8991985 20.2443295 20.5049477 20.7584305 21.0381222 21.2975178 21.5869904 21.832119 22.1496162 22.4630432 22.8334618 23.1719322 23.4777279 23.8159828 24.144928 24.4461479 24.7920551 25.1854706 25.4980183 25.8821144 26.1868782 26.5423279 26.907093 27.2064972 27.6562691 27.9847107 28.3272133 28.7444916 29.0896797 29.4856834 29.91255 30.4348488 30.9247246 31.3271599 31.8323593 32.3771896 33.1089287 33.8300171 34.5040894 35.2198296 35.9669113 37.210434 38.6130295 40.9263649 44.7077789 68.9486389 ------------------------------ Transdef: Tab for variable 5 1.6791079 2.99580526 3.30373907 3.63174391 3.83638525 4.02630424 4.18678951 4.32145405 4.41995621 4.5100379 4.60063648 4.70800304 4.80616951 4.88740492 4.97250271 5.03268909 5.10843658 5.18000793 5.24796772 5.31960821 5.3727994 5.43553925 5.49552679 5.54757738 5.59804153 5.63990974 5.68843174 5.73730659 5.78742409 5.83165884 5.88053608 5.92475128 5.96466255 6.00395584 6.03753853 6.07539463 6.12365246 6.1577034 6.20387888 6.25510693 6.29831219 6.34246922 6.38427925 6.42729282 6.46345043 6.50633144 6.54303551 6.58510208 6.63114929 6.69342995 6.74992371 6.80084276 6.84916067 6.90130663 6.96248436 7.01788998 7.06092215 7.11311245 7.17954254 7.23159313 7.29716587 7.35891199 7.44152927 7.50787449 7.55897522 7.62199688 7.6886344 7.75162601 7.81013584 7.88939381 7.96525478 8.04622078 8.12222862 8.20615959 8.28847885 8.35323429 8.44205856 8.51651955 8.57484245 8.64660454 8.71264839 8.79466438 8.85697365 8.93099117 9.00315952 9.07725239 9.14558601 9.25105476 9.33172512 9.41335106 9.49175644 9.60105896 9.71727276 9.87541962 10.018219 10.1578293 10.4042187 10.6854658 11.02355 11.7628689 15.6114082 ------------------------------ Transdef: Tab for variable 6 25.0015602 25.8819942 26.7505836 27.6012383 28.3173313 29.0633183 29.7772617 30.610817 31.228981 31.6863403 32.3229675 32.8911171 33.2952271 33.7634888 34.195015 34.6127777 35.0076141 35.4565887 35.9539337 36.3046875 36.540596 36.8891258 37.1891479 37.407135 37.7658234 38.0783005 38.4103394 38.7719727 39.1382599 39.453228 39.7567062 40.1881866 40.4857407 40.7875824 41.1547165 41.5525246 41.9014053 42.2328644 42.6763725 43.1963959 43.7797241 44.4223557 44.9583511 45.4818726 46.2574654 46.9016151 47.8325729 48.6864815 49.4964294 50.4244537 51.185009 51.9891968 52.9485092 53.8344803 54.7051544 55.5438728 56.6058426 57.4168358 58.3014069 59.2861748 60.2501144 61.1447182 62.2690201 63.1275558 64.0168076 64.9141541 66.004364 67.0284882 68.0644226 68.7728882 69.7197113 70.5234146 71.4366531 72.1869049 72.9610291 73.8794708 74.7820129 75.7032013 76.4879379 77.2261047 78.0916901 79.0985336 80.0667877 80.9345169 82.0393982 83.0495453 83.9432373 85.2542877 86.7751846 87.8655319 89.2629318 90.9319153 92.8436127 95.5384674 98.4047852 101.386581 104.67543 109.630569 117.042099 128.235657 219.814209 ------------------------------ Transdef: Tab for variable 7 30.1895332 32.858902 33.7013016 34.4527016 35.1146469 35.5195007 35.910965 36.2186356 36.6089554 36.9071045 37.1789856 37.5445442 37.800766 38.1641884 38.3787651 38.6578674 38.8891602 39.1463661 39.3771973 39.6318054 39.9789505 40.2756157 40.6161003 40.9280319 41.2004585 41.4484482 41.812561 42.2367477 42.7248154 43.3363113 43.9234543 44.6479416 45.3346024 46.07724 46.9030762 47.8827477 49.0221672 50.3715668 51.5687485 52.9334412 54.1367035 55.4682388 56.4579201 57.6326408 58.7314606 59.8920212 60.9872208 61.9301987 62.8792572 64.0894165 65.2783356 66.1120682 66.9479065 67.8882446 68.7734146 69.8207397 70.7005692 71.5772171 72.616806 73.8166656 74.6292648 75.6473999 76.482193 77.3287354 78.1306915 79.0793076 80.0976334 81.0380096 82.2134857 83.295639 84.5555191 85.7370224 86.8916016 88.2830658 89.9350967 91.764267 93.3223648 94.590065 96.2610626 97.9619141 100.080673 101.901337 104.058662 106.520874 108.737938 111.271561 113.683083 116.481689 119.907318 123.634048 126.803619 131.583496 135.706253 140.849609 147.535995 155.037231 164.667526 177.180374 194.243607 219.733368 397.295502 ------------------------------ Transdef: Tab for variable 8 0.678276479 25.7750053 29.7740192 31.4608994 32.2376938 32.9880295 33.5218201 33.9363022 34.4075279 34.7128983 35.0670242 35.3610687 35.7018356 35.9736252 36.2894287 36.5419159 36.810379 37.1384659 37.3336487 37.5541534 37.7891808 38.009552 38.2229042 38.5102158 38.7556915 38.9849243 39.308548 39.6086807 39.9154358 40.1680984 40.4232445 40.6983681 41.0293159 41.3214798 41.6567345 42.0546837 42.4785919 43.0453339 43.4428101 43.9227142 44.4985199 44.9797134 45.6193314 46.2743301 46.9013901 47.6356506 48.5033379 49.3011475 50.1611252 51.0180359 51.8666878 52.5466805 53.446991 54.4168396 55.2780342 55.8930969 56.7485275 57.5576859 58.4094925 59.3183823 60.0094223 60.9222717 61.5805664 62.295269 63.1383057 64.0227966 64.7259064 65.43013 66.0903854 66.886322 67.6023865 68.4583435 69.2838364 70.0818558 70.9719391 71.8140335 72.5553436 73.4131012 74.0813751 74.8869019 75.8180008 76.6152802 77.6789017 78.6895218 79.5353317 80.4247055 81.5845184 82.7361679 83.9364777 85.4919052 87.1309967 88.7628021 90.9629898 93.5643921 96.003479 99.4708252 103.983139 109.27552 116.508102 130.708771 310.644318 ------------------------------ Transdef: Tab for variable 9 55.8830566 62.5396652 64.5304031 66.183075 67.3801117 68.2919922 69.0107422 70.1204224 70.7462692 71.443512 72.1547241 72.9011688 73.4389877 74.0051804 74.5206757 74.985672 75.6413879 76.0822601 76.6710892 77.259552 77.6391678 77.9864426 78.3957367 78.98246 79.4123383 79.8201141 80.4692459 80.9202881 81.5197601 82.0171814 82.4987946 83.2631683 83.9372559 84.8565521 85.8418121 86.9674835 87.7525711 88.6053543 89.6860428 91.1143799 92.5014496 94.1162415 95.6575012 97.1138153 98.7924652 100.64122 102.341644 104.066071 105.888611 107.405457 109.060295 110.534393 112.405609 114.074471 115.651382 117.32338 118.785446 120.098007 121.531715 123.143555 124.876526 126.299591 127.606354 129.093994 130.657837 131.948425 133.561493 135.030487 136.48764 137.765198 139.134857 140.37616 141.939072 143.286377 144.488403 145.723419 146.790955 148.104736 149.306366 150.408722 151.742111 152.884277 154.225891 155.38147 156.650818 158.09549 159.571579 161.060394 162.79245 164.259857 165.760757 167.562256 169.230972 171.202774 173.540619 176.684937 179.884491 184.037292 191.614655 209.353607 349.840302 ------------------------------ Transdef: Tab for variable 10 0.0879002884 1.16685545 1.45369399 1.69774401 1.8181684 1.92115259 2.04116726 2.12050438 2.1898911 2.24504614 2.29798746 2.34090185 2.38026524 2.41242266 2.44842386 2.48550272 2.51643991 2.55420637 2.58139515 2.6025629 2.6234808 2.64491725 2.66597509 2.68958926 2.70990896 2.72584796 2.74676514 2.76496029 2.77846289 2.793607 2.80898666 2.82212257 2.83384371 2.84368801 2.85557556 2.86779952 2.87765574 2.8871913 2.89482832 2.9034586 2.91068268 2.91804695 2.92422819 2.92999649 2.93676996 2.94350553 2.95181131 2.95995665 2.96593714 2.97291756 2.9782269 2.98281288 2.98726106 2.99110866 2.99544525 3.00081635 3.00584459 3.00961924 3.01439714 3.01968384 3.0234313 3.02761626 3.03162241 3.03495884 3.03848815 3.04254103 3.04681301 3.04985189 3.05304503 3.05680084 3.0605216 3.06365919 3.06741238 3.0708971 3.07415724 3.07642889 3.07997966 3.08313036 3.08587456 3.08824372 3.09125662 3.09416246 3.09676886 3.0994339 3.10242033 3.10489035 3.10736179 3.11022472 3.11282539 3.11542296 3.11707163 3.11930513 3.12178564 3.12454939 3.12678504 3.12908268 3.13164163 3.13393068 3.13661075 3.13888288 3.14158249 ------------------------------ Transdef: Tab for variable 11 1.62124634E-05 0.00660884287 0.0121051222 0.019526761 0.0259633679 0.0306096077 0.0365257896 0.0439510718 0.0501785278 0.0578330755 0.0648948103 0.0726875067 0.0796746612 0.0856478512 0.09116593 0.0985934734 0.105623618 0.11217165 0.118440837 0.124883085 0.132762104 0.141905904 0.147220254 0.154232204 0.159855962 0.166262865 0.17297411 0.17930311 0.185923517 0.192241311 0.197626054 0.202534795 0.207211882 0.21149841 0.21564579 0.219910622 0.224899769 0.229884386 0.234444857 0.239182055 0.24377203 0.248517811 0.251876533 0.257124603 0.26055944 0.265742004 0.270116687 0.275500059 0.279932022 0.284913421 0.289550781 0.294808865 0.30048877 0.305593908 0.310288668 0.316089869 0.321243048 0.326235533 0.331283092 0.336636305 0.342658997 0.349555969 0.353713691 0.359654307 0.366531014 0.37269932 0.379002929 0.385400295 0.391789556 0.398473591 0.406238377 0.412525654 0.419505 0.426317811 0.433828235 0.442824572 0.448956013 0.456870317 0.467278957 0.476096272 0.482234687 0.490779817 0.499402523 0.508256316 0.518435717 0.529338241 0.540939331 0.549778581 0.562756538 0.575316727 0.587995887 0.600723207 0.618484378 0.636925936 0.65678829 0.67873168 0.708124757 0.734842777 0.77850914 0.828735828 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.20012714 0.209882766 0.217716038 0.223254979 0.230321616 0.236021891 0.243005902 0.248622984 0.254746914 0.260705769 0.266013443 0.271308392 0.275762796 0.280143678 0.284771562 0.288982034 0.293538094 0.298493773 0.30308497 0.308149636 0.312895477 0.318286568 0.323218733 0.328755736 0.332949638 0.338578224 0.343890011 0.349023759 0.353535891 0.358105659 0.363241434 0.368458271 0.373395801 0.378370464 0.384055614 0.388677716 0.39346987 0.397987485 0.402177334 0.406545937 0.409601092 0.414226949 0.417267919 0.420409262 0.423592538 0.428424865 0.433303893 0.436944902 0.440871954 0.445318699 0.449052632 0.453836262 0.457439542 0.462108791 0.466813266 0.471639633 0.476187468 0.481242478 0.485343218 0.488469869 0.492538542 0.497931331 0.502550185 0.506604791 0.511216164 0.51669991 0.521723986 0.526320755 0.530993462 0.537976861 0.544725478 0.550007939 0.555806398 0.561383605 0.568163037 0.575138867 0.581817508 0.588600516 0.596432328 0.603086174 0.610413074 0.617033124 0.625665724 0.633680463 0.643487275 0.653066158 0.660968304 0.669095039 0.679231286 0.693943977 0.705177188 0.719343305 0.732604384 0.748593092 0.764725924 0.781796575 0.80850184 0.830157876 0.855834663 0.895878613 1.14129901 ------------------------------ Transdef: Tab for variable 13 20.0454464 21.5120754 22.4420128 23.1870842 23.7975826 24.535244 25.2196903 25.7681923 26.2856216 26.7555351 27.2251511 27.6762848 28.1395111 28.4870338 28.9273872 29.3009529 29.7214775 30.0626812 30.3916359 30.8385048 31.2324371 31.6777706 32.1129532 32.4953079 32.8932953 33.3543777 33.7481003 34.1032028 34.5515709 34.9544525 35.5227737 35.9411583 36.3105011 36.7992935 37.2265625 37.6587753 38.0602722 38.4780159 38.9773636 39.4412117 39.8879395 40.3204803 40.8269577 41.321991 41.7978668 42.235672 42.7002182 43.2470894 43.7349205 44.2612686 44.9074707 45.4279137 45.8827515 46.3475571 46.7825623 47.229866 47.7152176 48.2035408 48.6999664 49.2278404 49.6762505 50.2575493 50.840313 51.4023666 51.9962845 52.4012718 52.9811707 53.6573563 54.1678581 54.6653442 55.2975807 56.0895004 56.7036476 57.3094711 58.1141663 58.7336731 59.5551071 60.4280548 61.3066254 62.1944237 63.0217285 64.037468 65.0533066 66.1609497 67.1827164 68.1374054 69.3380737 70.4643555 71.6890564 73.1315613 74.8635254 76.5271454 78.3539734 80.5239716 82.8576965 85.5080872 88.5706406 92.738205 98.6246872 112.180588 225.703049 ------------------------------ Transdef: Tab for variable 14 10.0074263 10.7394457 11.2018337 11.601284 12.07022 12.5269413 12.9374104 13.310173 13.5649948 13.8581238 14.1541471 14.5172882 14.771677 15.025198 15.3179646 15.638319 15.9761124 16.2707748 16.6636391 16.9405365 17.2691803 17.594101 17.9522972 18.2953758 18.5963078 18.9589748 19.2841282 19.6226177 19.956028 20.2875786 20.5970116 20.9515305 21.246788 21.517849 21.8050175 22.0840187 22.4040852 22.7760429 23.1932373 23.5126152 23.8057594 24.1453266 24.4536057 24.8117142 25.0600014 25.4095364 25.6898174 25.9658794 26.2977448 26.5648232 26.8838921 27.1705246 27.4389935 27.7106667 27.9850807 28.344368 28.6800156 29.0351143 29.3093624 29.6327896 29.9491806 30.3623047 30.7163639 31.1127396 31.4460888 31.8229485 32.1389618 32.4872742 32.8434181 33.2248611 33.6184464 33.9978867 34.4053879 34.7803154 35.125351 35.5952454 36.0456734 36.4664078 36.8784256 37.3179321 37.7622566 38.2091217 38.7572632 39.3223076 39.958416 40.6248894 41.3753586 42.2290878 42.9365959 43.7384262 44.5295868 45.7095566 47.2150078 48.4988022 50.0389938 52.2818756 54.4728394 57.0659981 61.0352173 67.0389404 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 70.9 56.9 56.9 40.5 61.0 67.7 61.4 70.4 -27.1 -17.6 -34.4 12.3 18.9 2 70.9 100.0 69.4 63.0 43.0 76.7 94.7 77.8 93.0 -44.7 -22.5 -44.2 27.1 27.7 3 56.9 69.4 100.0 49.2 19.8 45.4 71.8 58.7 75.2 -17.1 -25.0 -49.4 57.3 21.6 4 56.9 63.0 49.2 100.0 25.5 46.6 62.8 55.3 68.9 -14.2 -26.1 -53.1 17.3 62.8 5 40.5 43.0 19.8 25.5 100.0 84.7 17.4 62.6 62.0 20.5 -10.8 -17.1 -3.7 5.1 6 61.0 76.7 45.4 46.6 84.7 100.0 57.6 82.1 85.2 -10.6 -17.3 -32.2 10.3 16.8 7 67.7 94.7 71.8 62.8 17.4 57.6 100.0 70.1 82.6 -53.4 -20.8 -43.0 32.8 30.4 8 61.4 77.8 58.7 55.3 62.6 82.1 70.1 100.0 84.6 -12.7 -22.3 -40.5 22.7 25.5 9 70.4 93.0 75.2 68.9 62.0 85.2 82.6 84.6 100.0 -22.2 -25.4 -49.7 31.1 32.3 10 -27.1 -44.7 -17.1 -14.2 20.5 -10.6 -53.4 -12.7 -22.2 100.0 3.2 7.9 -6.4 -5.1 11 -17.6 -22.5 -25.0 -26.1 -10.8 -17.3 -20.8 -22.3 -25.4 3.2 100.0 54.4 0.3 -5.5 12 -34.4 -44.2 -49.4 -53.1 -17.1 -32.2 -43.0 -40.5 -49.7 7.9 54.4 100.0 -12.4 -17.7 13 12.3 27.1 57.3 17.3 -3.7 10.3 32.8 22.7 31.1 -6.4 0.3 -12.4 100.0 53.5 14 18.9 27.7 21.6 62.8 5.1 16.8 30.4 25.5 32.3 -5.1 -5.5 -17.7 53.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 181.359485 TOTAL CORRELATION OF ALL VARIABLES 78.3226211 ROUND 1: MAX CORR ( 78.3210236) AFTER KILLING INPUT VARIABLE 2 CONTR 0.50024739 ROUND 2: MAX CORR ( 78.3184455) AFTER KILLING INPUT VARIABLE 11 CONTR 0.63547443 ROUND 3: MAX CORR ( 78.2879531) AFTER KILLING INPUT VARIABLE 14 CONTR 2.18524559 ROUND 4: MAX CORR ( 78.2308022) AFTER KILLING INPUT VARIABLE 8 CONTR 2.99085046 ROUND 5: MAX CORR ( 78.1536399) AFTER KILLING INPUT VARIABLE 6 CONTR 3.47375654 ROUND 6: MAX CORR ( 77.9360837) AFTER KILLING INPUT VARIABLE 10 CONTR 5.82737492 ROUND 7: MAX CORR ( 77.6841494) AFTER KILLING INPUT VARIABLE 12 CONTR 6.26147528 ROUND 8: MAX CORR ( 76.557637) AFTER KILLING INPUT VARIABLE 13 CONTR 13.1816268 ROUND 9: MAX CORR ( 75.2940744) AFTER KILLING INPUT VARIABLE 9 CONTR 13.8518638 ROUND 10: MAX CORR ( 74.8557225) AFTER KILLING INPUT VARIABLE 3 CONTR 8.11285775 ROUND 11: MAX CORR ( 73.6877965) AFTER KILLING INPUT VARIABLE 4 CONTR 13.171478 ROUND 12: MAX CORR ( 67.6508639) AFTER KILLING INPUT VARIABLE 5 CONTR 29.210477 LAST REMAINING VARIABLE: 7 total correlation to target: 78.3226211 % total significance: 64.7414615 sigma correlations of single variables to target: variable 2: 70.933401 % , in sigma: 58.6335338 variable 3: 56.8611821 % , in sigma: 47.0014407 variable 4: 56.9061178 % , in sigma: 47.0385845 variable 5: 40.5119221 % , in sigma: 33.487146 variable 6: 60.9726522 % , in sigma: 50.399981 variable 7: 67.6508639 % , in sigma: 55.9201893 variable 8: 61.3575259 % , in sigma: 50.7181175 variable 9: 70.3585184 % , in sigma: 58.158336 variable 10: -27.1295923 % , in sigma: 22.425315 variable 11: -17.5503919 % , in sigma: 14.5071501 variable 12: -34.4134445 % , in sigma: 28.4461457 variable 13: 12.2948036 % , in sigma: 10.162882 variable 14: 18.9248536 % , in sigma: 15.6432798 variables sorted by significance: 1 most relevant variable 7 corr 67.6508636 , in sigma: 55.9201891 2 most relevant variable 5 corr 29.2104778 , in sigma: 24.1453746 3 most relevant variable 4 corr 13.1714783 , in sigma: 10.8875411 4 most relevant variable 3 corr 8.11285782 , in sigma: 6.7060865 5 most relevant variable 9 corr 13.8518639 , in sigma: 11.4499476 6 most relevant variable 13 corr 13.1816273 , in sigma: 10.8959302 7 most relevant variable 12 corr 6.26147509 , in sigma: 5.17573394 8 most relevant variable 10 corr 5.82737494 , in sigma: 4.81690685 9 most relevant variable 6 corr 3.47375655 , in sigma: 2.87140641 10 most relevant variable 8 corr 2.99085045 , in sigma: 2.47223633 11 most relevant variable 14 corr 2.18524551 , in sigma: 1.80632347 12 most relevant variable 11 corr 0.635474443 , in sigma: 0.525283036 13 most relevant variable 2 corr 0.500247419 , in sigma: 0.413504407 global correlations between input variables: variable 2: 99.207808 % variable 3: 92.7125257 % variable 4: 91.2874455 % variable 5: 95.4182729 % variable 6: 96.2842487 % variable 7: 98.7592711 % variable 8: 90.403175 % variable 9: 98.7897615 % variable 10: 72.0590048 % variable 11: 55.495433 % variable 12: 72.2952647 % variable 13: 86.5888206 % variable 14: 87.8508902 % significance loss when removing single variables: variable 2: corr = 0.50024739 % , sigma = 0.413504383 variable 3: corr = 17.0019091 % , sigma = 14.0537744 variable 4: corr = 14.3198098 % , sigma = 11.8367516 variable 5: corr = 14.7463708 % , sigma = 12.1893469 variable 6: corr = 3.99659579 % , sigma = 3.30358521 variable 7: corr = 10.5314604 % , sigma = 8.7053029 variable 8: corr = 2.8576486 % , sigma = 2.36213171 variable 9: corr = 10.6452089 % , sigma = 8.79932735 variable 10: corr = 4.72168195 % , sigma = 3.90294127 variable 11: corr = 0.610200496 % , sigma = 0.504391597 variable 12: corr = 5.2954659 % , sigma = 4.37723095 variable 13: corr = 7.27435733 % , sigma = 6.01298218 variable 14: corr = 2.14503974 % , sigma = 1.77308938 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 17.6106052 sigma out 15 active outputs RANK 2 NODE 4 --> 16.1846867 sigma out 15 active outputs RANK 3 NODE 9 --> 12.5351791 sigma out 15 active outputs RANK 4 NODE 3 --> 10.7809849 sigma out 15 active outputs RANK 5 NODE 7 --> 10.7489605 sigma out 15 active outputs RANK 6 NODE 2 --> 10.5862694 sigma out 15 active outputs RANK 7 NODE 5 --> 9.13411617 sigma out 15 active outputs RANK 8 NODE 6 --> 8.70707893 sigma out 15 active outputs RANK 9 NODE 8 --> 6.24099588 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 19.0062943 sigma in 9act. ( 20.5504112 sig out 1act.) RANK 2 NODE 13 --> 14.0681286 sigma in 9act. ( 15.7059975 sig out 1act.) RANK 3 NODE 11 --> 13.8204594 sigma in 9act. ( 14.4354525 sig out 1act.) RANK 4 NODE 5 --> 12.0815964 sigma in 9act. ( 13.8645906 sig out 1act.) RANK 5 NODE 15 --> 9.58357143 sigma in 9act. ( 9.21065426 sig out 1act.) RANK 6 NODE 8 --> 8.52452374 sigma in 9act. ( 10.2642822 sig out 1act.) RANK 7 NODE 14 --> 7.23883867 sigma in 9act. ( 8.188097 sig out 1act.) RANK 8 NODE 7 --> 7.08520508 sigma in 9act. ( 6.76913929 sig out 1act.) RANK 9 NODE 4 --> 6.4131074 sigma in 9act. ( 6.6572504 sig out 1act.) RANK 10 NODE 1 --> 4.77863312 sigma in 9act. ( 5.33371401 sig out 1act.) RANK 11 NODE 12 --> 4.59226513 sigma in 9act. ( 4.72966099 sig out 1act.) RANK 12 NODE 2 --> 3.29581094 sigma in 9act. ( 3.35175323 sig out 1act.) RANK 13 NODE 6 --> 2.31760526 sigma in 9act. ( 2.32632375 sig out 1act.) RANK 14 NODE 9 --> 2.08925676 sigma in 9act. ( 1.63081408 sig out 1act.) RANK 15 NODE 10 --> 1.53517079 sigma in 9act. ( 0.233046532 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 20.5504112 sigma out 1act.( 19.0062943 sig in 9act.) RANK 2 NODE 13 --> 15.7059975 sigma out 1act.( 14.0681286 sig in 9act.) RANK 3 NODE 11 --> 14.4354525 sigma out 1act.( 13.8204594 sig in 9act.) RANK 4 NODE 5 --> 13.8645906 sigma out 1act.( 12.0815964 sig in 9act.) RANK 5 NODE 8 --> 10.2642822 sigma out 1act.( 8.52452374 sig in 9act.) RANK 6 NODE 15 --> 9.21065426 sigma out 1act.( 9.58357143 sig in 9act.) RANK 7 NODE 14 --> 8.188097 sigma out 1act.( 7.23883867 sig in 9act.) RANK 8 NODE 7 --> 6.76913929 sigma out 1act.( 7.08520508 sig in 9act.) RANK 9 NODE 4 --> 6.6572504 sigma out 1act.( 6.4131074 sig in 9act.) RANK 10 NODE 1 --> 5.33371401 sigma out 1act.( 4.77863312 sig in 9act.) RANK 11 NODE 12 --> 4.72966099 sigma out 1act.( 4.59226513 sig in 9act.) RANK 12 NODE 2 --> 3.35175323 sigma out 1act.( 3.29581094 sig in 9act.) RANK 13 NODE 6 --> 2.32632375 sigma out 1act.( 2.31760526 sig in 9act.) RANK 14 NODE 9 --> 1.63081408 sigma out 1act.( 2.08925676 sig in 9act.) RANK 15 NODE 10 --> 0.233046532 sigma out 1act.( 1.53517079 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.563736 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 17.1704121 sigma out 15 active outputs RANK 2 NODE 1 --> 16.702013 sigma out 15 active outputs RANK 3 NODE 2 --> 15.9129725 sigma out 15 active outputs RANK 4 NODE 9 --> 13.4281187 sigma out 15 active outputs RANK 5 NODE 7 --> 11.5863113 sigma out 15 active outputs RANK 6 NODE 3 --> 11.1315527 sigma out 15 active outputs RANK 7 NODE 5 --> 9.2928772 sigma out 15 active outputs RANK 8 NODE 6 --> 8.94822216 sigma out 15 active outputs RANK 9 NODE 8 --> 7.05390453 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 16.4997082 sigma in 9act. ( 17.8247776 sig out 1act.) RANK 2 NODE 13 --> 14.2023544 sigma in 9act. ( 14.9754267 sig out 1act.) RANK 3 NODE 11 --> 13.9912043 sigma in 9act. ( 13.0958929 sig out 1act.) RANK 4 NODE 5 --> 11.2717171 sigma in 9act. ( 11.1989346 sig out 1act.) RANK 5 NODE 15 --> 10.9897871 sigma in 9act. ( 9.39743996 sig out 1act.) RANK 6 NODE 8 --> 8.78617096 sigma in 9act. ( 8.09407902 sig out 1act.) RANK 7 NODE 4 --> 8.41916084 sigma in 9act. ( 5.94106102 sig out 1act.) RANK 8 NODE 1 --> 8.14950275 sigma in 9act. ( 4.76930809 sig out 1act.) RANK 9 NODE 2 --> 8.14701653 sigma in 9act. ( 4.63691902 sig out 1act.) RANK 10 NODE 6 --> 8.01107597 sigma in 9act. ( 3.77754617 sig out 1act.) RANK 11 NODE 14 --> 7.99231815 sigma in 9act. ( 6.50043774 sig out 1act.) RANK 12 NODE 12 --> 7.50213099 sigma in 9act. ( 4.81090212 sig out 1act.) RANK 13 NODE 7 --> 7.39353752 sigma in 9act. ( 5.86129999 sig out 1act.) RANK 14 NODE 9 --> 5.30502796 sigma in 9act. ( 1.95620835 sig out 1act.) RANK 15 NODE 10 --> 4.014678 sigma in 9act. ( 0.442476779 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 17.8247776 sigma out 1act.( 16.4997082 sig in 9act.) RANK 2 NODE 13 --> 14.9754267 sigma out 1act.( 14.2023544 sig in 9act.) RANK 3 NODE 11 --> 13.0958929 sigma out 1act.( 13.9912043 sig in 9act.) RANK 4 NODE 5 --> 11.1989346 sigma out 1act.( 11.2717171 sig in 9act.) RANK 5 NODE 15 --> 9.39743996 sigma out 1act.( 10.9897871 sig in 9act.) RANK 6 NODE 8 --> 8.09407902 sigma out 1act.( 8.78617096 sig in 9act.) RANK 7 NODE 14 --> 6.50043774 sigma out 1act.( 7.99231815 sig in 9act.) RANK 8 NODE 4 --> 5.94106102 sigma out 1act.( 8.41916084 sig in 9act.) RANK 9 NODE 7 --> 5.86129999 sigma out 1act.( 7.39353752 sig in 9act.) RANK 10 NODE 12 --> 4.81090212 sigma out 1act.( 7.50213099 sig in 9act.) RANK 11 NODE 1 --> 4.76930809 sigma out 1act.( 8.14950275 sig in 9act.) RANK 12 NODE 2 --> 4.63691902 sigma out 1act.( 8.14701653 sig in 9act.) RANK 13 NODE 6 --> 3.77754617 sigma out 1act.( 8.01107597 sig in 9act.) RANK 14 NODE 9 --> 1.95620835 sigma out 1act.( 5.30502796 sig in 9act.) RANK 15 NODE 10 --> 0.442476779 sigma out 1act.( 4.014678 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 34.5010414 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.492311001 *** contribution from regularisation: 0.0129168918 *** contribution from error: -0.505227864 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.553440332 *** contribution from regularisation: 0.00732983509 *** contribution from error: -0.560770154 *********************************************** -----------------> Test sample ENTER BFGS code START -12410.3744 0.28053534 0.0692428201 EXIT FROM BFGS code FG_START 0. 0.28053534 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.576340437 *** contribution from regularisation: 0.00561192213 *** contribution from error: -0.581952333 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -12921.5526 0.28053534 7.71525145 EXIT FROM BFGS code FG_LNSRCH 0. 0.291465342 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.603262007 *** contribution from regularisation: 0.00704374909 *** contribution from error: -0.610305727 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13525.1337 0.291465342 40.6316566 EXIT FROM BFGS code NEW_X -13525.1337 0.291465342 40.6316566 ENTER BFGS code NEW_X -13525.1337 0.291465342 40.6316566 EXIT FROM BFGS code FG_LNSRCH 0. 0.357767612 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.608131111 *** contribution from regularisation: 0.0075635151 *** contribution from error: -0.615694642 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13634.2989 0.357767612 6.59627104 EXIT FROM BFGS code NEW_X -13634.2989 0.357767612 6.59627104 ENTER BFGS code NEW_X -13634.2989 0.357767612 6.59627104 EXIT FROM BFGS code FG_LNSRCH 0. 0.386213303 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.609989285 *** contribution from regularisation: 0.00736177992 *** contribution from error: -0.617351055 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13675.9601 0.386213303 -6.81451702 EXIT FROM BFGS code NEW_X -13675.9601 0.386213303 -6.81451702 ENTER BFGS code NEW_X -13675.9601 0.386213303 -6.81451702 EXIT FROM BFGS code FG_LNSRCH 0. 0.389795393 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.610762835 *** contribution from regularisation: 0.00696497317 *** contribution from error: -0.617727816 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13693.3033 0.389795393 -18.897583 EXIT FROM BFGS code NEW_X -13693.3033 0.389795393 -18.897583 ENTER BFGS code NEW_X -13693.3033 0.389795393 -18.897583 EXIT FROM BFGS code FG_LNSRCH 0. 0.343860358 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.611394525 *** contribution from regularisation: 0.00608573109 *** contribution from error: -0.617480278 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13707.4659 0.343860358 -23.6863708 EXIT FROM BFGS code NEW_X -13707.4659 0.343860358 -23.6863708 ENTER BFGS code NEW_X -13707.4659 0.343860358 -23.6863708 EXIT FROM BFGS code FG_LNSRCH 0. -0.0148286428 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.578458846 *** contribution from regularisation: 0.0134827737 *** contribution from error: -0.591941595 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12969.0479 -0.0148286428 -126.922157 EXIT FROM BFGS code FG_LNSRCH 0. 0.298085064 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 18.1387024 sigma out 15 active outputs RANK 2 NODE 1 --> 11.022418 sigma out 15 active outputs RANK 3 NODE 7 --> 6.55796957 sigma out 15 active outputs RANK 4 NODE 8 --> 6.36107349 sigma out 15 active outputs RANK 5 NODE 4 --> 4.4370985 sigma out 15 active outputs RANK 6 NODE 9 --> 3.91053867 sigma out 15 active outputs RANK 7 NODE 3 --> 3.76207471 sigma out 15 active outputs RANK 8 NODE 6 --> 3.55467486 sigma out 15 active outputs RANK 9 NODE 5 --> 3.22379327 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 10.6021862 sigma in 9act. ( 6.78145742 sig out 1act.) RANK 2 NODE 13 --> 9.78600311 sigma in 9act. ( 5.62085247 sig out 1act.) RANK 3 NODE 2 --> 9.35781097 sigma in 9act. ( 7.01837063 sig out 1act.) RANK 4 NODE 6 --> 8.12571335 sigma in 9act. ( 5.85095406 sig out 1act.) RANK 5 NODE 15 --> 7.92377186 sigma in 9act. ( 4.52905893 sig out 1act.) RANK 6 NODE 11 --> 6.48021889 sigma in 9act. ( 4.50414133 sig out 1act.) RANK 7 NODE 9 --> 6.42143059 sigma in 9act. ( 3.87964821 sig out 1act.) RANK 8 NODE 4 --> 5.32198143 sigma in 9act. ( 3.07197809 sig out 1act.) RANK 9 NODE 12 --> 4.66575193 sigma in 9act. ( 2.89762473 sig out 1act.) RANK 10 NODE 14 --> 3.38748431 sigma in 9act. ( 2.43556452 sig out 1act.) RANK 11 NODE 8 --> 3.0644536 sigma in 9act. ( 1.86051857 sig out 1act.) RANK 12 NODE 1 --> 3.03747368 sigma in 9act. ( 1.55870998 sig out 1act.) RANK 13 NODE 7 --> 2.70761323 sigma in 9act. ( 1.42614639 sig out 1act.) RANK 14 NODE 5 --> 2.67375851 sigma in 9act. ( 1.57426047 sig out 1act.) RANK 15 NODE 10 --> 1.92121327 sigma in 9act. ( 0.960612833 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 7.01837063 sigma out 1act.( 9.35781097 sig in 9act.) RANK 2 NODE 3 --> 6.78145742 sigma out 1act.( 10.6021862 sig in 9act.) RANK 3 NODE 6 --> 5.85095406 sigma out 1act.( 8.12571335 sig in 9act.) RANK 4 NODE 13 --> 5.62085247 sigma out 1act.( 9.78600311 sig in 9act.) RANK 5 NODE 15 --> 4.52905893 sigma out 1act.( 7.92377186 sig in 9act.) RANK 6 NODE 11 --> 4.50414133 sigma out 1act.( 6.48021889 sig in 9act.) RANK 7 NODE 9 --> 3.87964821 sigma out 1act.( 6.42143059 sig in 9act.) RANK 8 NODE 4 --> 3.07197809 sigma out 1act.( 5.32198143 sig in 9act.) RANK 9 NODE 12 --> 2.89762473 sigma out 1act.( 4.66575193 sig in 9act.) RANK 10 NODE 14 --> 2.43556452 sigma out 1act.( 3.38748431 sig in 9act.) RANK 11 NODE 8 --> 1.86051857 sigma out 1act.( 3.0644536 sig in 9act.) RANK 12 NODE 5 --> 1.57426047 sigma out 1act.( 2.67375851 sig in 9act.) RANK 13 NODE 1 --> 1.55870998 sigma out 1act.( 3.03747368 sig in 9act.) RANK 14 NODE 7 --> 1.42614639 sigma out 1act.( 2.70761323 sig in 9act.) RANK 15 NODE 10 --> 0.960612833 sigma out 1act.( 1.92121327 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 15.8750114 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.612677217 *** contribution from regularisation: 0.00436952012 *** contribution from error: -0.617046714 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -13736.2232 0.298085064 -30.5721798 EXIT FROM BFGS code NEW_X -13736.2232 0.298085064 -30.5721798 ENTER BFGS code NEW_X -13736.2232 0.298085064 -30.5721798 EXIT FROM BFGS code FG_LNSRCH 0. -0.20524855 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.547778845 *** contribution from regularisation: 0.025743423 *** contribution from error: -0.57352227 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12281.2013 -0.20524855 156.337418 EXIT FROM BFGS code FG_LNSRCH 0. 0.251709163 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.614538074 *** contribution from regularisation: 0.00246520946 *** contribution from error: -0.617003262 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13777.9434 0.251709163 -28.8937988 EXIT FROM BFGS code FG_LNSRCH 0. 0.234466568 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.607742667 *** contribution from regularisation: 0.00924926437 *** contribution from error: -0.616991937 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13625.5906 0.234466568 -22.9575653 EXIT FROM BFGS code FG_LNSRCH 0. 0.25150156 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.610794961 *** contribution from regularisation: 0.00620809896 *** contribution from error: -0.617003083 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13694.0231 0.25150156 -26.1470261 EXIT FROM BFGS code FG_LNSRCH 0. 0.251709163 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.609715581 *** contribution from regularisation: 0.0072876676 *** contribution from error: -0.617003262 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13669.8239 0.251709163 -25.9530373 EXIT FROM BFGS code NEW_X -13669.8239 0.251709163 -25.9530373 ENTER BFGS code NEW_X -13669.8239 0.251709163 -25.9530373 EXIT FROM BFGS code CONVERGENC -13669.8239 0.251709163 -25.9530373 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 31.0714741 sigma out 15 active outputs RANK 2 NODE 1 --> 18.1687679 sigma out 15 active outputs RANK 3 NODE 7 --> 11.2938395 sigma out 15 active outputs RANK 4 NODE 8 --> 10.9097643 sigma out 15 active outputs RANK 5 NODE 6 --> 6.56094408 sigma out 15 active outputs RANK 6 NODE 4 --> 6.50037575 sigma out 15 active outputs RANK 7 NODE 9 --> 5.80095577 sigma out 15 active outputs RANK 8 NODE 3 --> 4.95001173 sigma out 15 active outputs RANK 9 NODE 5 --> 4.36593056 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 18.935688 sigma in 9act. ( 11.0865593 sig out 1act.) RANK 2 NODE 13 --> 16.9956932 sigma in 9act. ( 9.79843712 sig out 1act.) RANK 3 NODE 2 --> 16.2155094 sigma in 9act. ( 12.9370527 sig out 1act.) RANK 4 NODE 6 --> 14.0107603 sigma in 9act. ( 10.3626661 sig out 1act.) RANK 5 NODE 15 --> 13.4805393 sigma in 9act. ( 7.7904315 sig out 1act.) RANK 6 NODE 9 --> 10.6972713 sigma in 9act. ( 6.52934933 sig out 1act.) RANK 7 NODE 11 --> 10.0421476 sigma in 9act. ( 6.70673752 sig out 1act.) RANK 8 NODE 4 --> 8.33540916 sigma in 9act. ( 4.65848923 sig out 1act.) RANK 9 NODE 12 --> 6.87494469 sigma in 9act. ( 4.32829952 sig out 1act.) RANK 10 NODE 14 --> 4.90697575 sigma in 9act. ( 3.97015595 sig out 1act.) RANK 11 NODE 8 --> 4.13420677 sigma in 9act. ( 2.62432837 sig out 1act.) RANK 12 NODE 1 --> 3.60942817 sigma in 9act. ( 1.95156908 sig out 1act.) RANK 13 NODE 7 --> 3.58406472 sigma in 9act. ( 2.02772307 sig out 1act.) RANK 14 NODE 5 --> 3.39113593 sigma in 9act. ( 1.99433124 sig out 1act.) RANK 15 NODE 10 --> 2.38404179 sigma in 9act. ( 1.27348351 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 12.9370527 sigma out 1act.( 16.2155094 sig in 9act.) RANK 2 NODE 3 --> 11.0865593 sigma out 1act.( 18.935688 sig in 9act.) RANK 3 NODE 6 --> 10.3626661 sigma out 1act.( 14.0107603 sig in 9act.) RANK 4 NODE 13 --> 9.79843712 sigma out 1act.( 16.9956932 sig in 9act.) RANK 5 NODE 15 --> 7.7904315 sigma out 1act.( 13.4805393 sig in 9act.) RANK 6 NODE 11 --> 6.70673752 sigma out 1act.( 10.0421476 sig in 9act.) RANK 7 NODE 9 --> 6.52934933 sigma out 1act.( 10.6972713 sig in 9act.) RANK 8 NODE 4 --> 4.65848923 sigma out 1act.( 8.33540916 sig in 9act.) RANK 9 NODE 12 --> 4.32829952 sigma out 1act.( 6.87494469 sig in 9act.) RANK 10 NODE 14 --> 3.97015595 sigma out 1act.( 4.90697575 sig in 9act.) RANK 11 NODE 8 --> 2.62432837 sigma out 1act.( 4.13420677 sig in 9act.) RANK 12 NODE 7 --> 2.02772307 sigma out 1act.( 3.58406472 sig in 9act.) RANK 13 NODE 5 --> 1.99433124 sigma out 1act.( 3.39113593 sig in 9act.) RANK 14 NODE 1 --> 1.95156908 sigma out 1act.( 3.60942817 sig in 9act.) RANK 15 NODE 10 --> 1.27348351 sigma out 1act.( 2.38404179 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 26.806366 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.610091746 *** contribution from regularisation: 0.00691150455 *** contribution from error: -0.617003262 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25010 Closing output file done