NNInput NNInputs_155.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 199756 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 52821 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 52821 Chosen entries: 52821 Signal fraction: 1 Background fraction: 0.359485 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 52821 Entries to split: 52821 Test with : 26410 Train with : 26410 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 52821 for Signal Prepared event 0 for Signal with 52821 events ====Entry 0 Variable Ht : 266.323 Variable LepAPt : 64.2176 Variable LepBPt : 58.0643 Variable MetSigLeptonsJets : 2.54404 Variable MetSpec : 36.171 Variable SumEtLeptonsJets : 227.916 Variable VSumJetLeptonsPt : 47.3654 Variable addEt : 160.689 Variable dPhiLepSumMet : 2.30851 Variable dPhiLeptons : 0.188909 Variable dRLeptons : 0.230155 Variable lep1_E : 71.5884 Variable lep2_E : 61.5172 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2155 Ht = 266.323 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 64.2176 LepAPt = 64.2176 LepBEt = 58.0643 LepBPt = 58.0643 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 38.4071 MetDelPhi = 1.22788 MetSig = 2.2508 MetSigLeptonsJets = 2.54404 MetSpec = 36.171 Mjj = 0 MostCentralJetEta = 0.570342 MtllMet = 163.453 Njets = 1 SB = 0 SumEt = 291.171 SumEtJets = 0 SumEtLeptonsJets = 227.916 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 47.3654 addEt = 160.689 dPhiLepSumMet = 2.30851 dPhiLeptons = 0.188909 dRLeptons = 0.230155 diltype = 45 dimass = 14.0433 event = 519 jet1_Et = 105.634 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.5884 lep2_E = 61.5172 rand = 0.999742 run = 236753 weight = 3.57235e-06 ===Show End Prepared event 10000 for Signal with 52821 events Prepared event 20000 for Signal with 52821 events Prepared event 30000 for Signal with 52821 events Prepared event 40000 for Signal with 52821 events Prepared event 50000 for Signal with 52821 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.278678 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4487 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 199756 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4487 negative weights. Signal fraction: 62.4490509 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 62.4678726 64.8850098 66.6418304 67.9834976 69.0894089 70.1333466 71.0312195 71.9552917 72.9014816 73.7575989 74.3022614 74.9049683 75.5219116 76.0750732 76.8104935 77.2517166 77.8021088 78.4136581 79.1003494 79.6056061 80.1379623 80.8626099 81.53685 82.2061996 82.9138107 83.6252747 84.5292511 85.6021118 86.7017975 87.9711304 89.2203369 90.791626 92.0376663 93.5470123 94.8512115 96.1439362 97.3764343 98.9050369 100.347382 101.898003 103.531616 105.128792 106.399475 108.108162 109.754974 111.127388 112.758926 114.254059 115.780838 117.342834 118.838379 120.47345 121.864677 123.337311 124.838394 126.395821 127.824692 129.188339 130.633606 132.19278 133.71524 135.113953 136.53717 138.044312 139.399963 140.804901 142.19368 143.591705 144.964203 146.330322 147.695862 149.118149 150.671844 152.336502 154.100891 155.830353 157.686996 159.87912 161.91275 164.285965 166.745819 169.377213 171.971527 174.789215 177.662018 180.928589 184.098541 187.733459 191.401215 195.435135 200.199341 205.199829 211.138031 217.831894 225.688934 235.415192 250.14209 270.058716 302.847992 888.225952 ------------------------------ Transdef: Tab for variable 3 20.0001068 20.2857246 20.5749474 20.8590355 21.147316 21.4190178 21.633585 21.8684921 22.0856533 22.3117447 22.5287476 22.7396393 22.9885502 23.183815 23.3841934 23.5911598 23.7813492 23.9747391 24.1954231 24.4031582 24.6011963 24.8153534 25.0552425 25.2569084 25.4453545 25.6380501 25.8394127 26.0404243 26.2115097 26.4219799 26.6211891 26.8489876 27.0582104 27.2900085 27.5311527 27.7587357 27.9696693 28.1561661 28.3747559 28.6167564 28.8268738 29.0880833 29.294426 29.533968 29.7752953 30.0036812 30.2632599 30.5403671 30.7663918 31.0382557 31.2789536 31.5634155 31.819828 32.0904007 32.3702393 32.6876869 32.9647064 33.2195282 33.5221405 33.7844505 34.0564156 34.389946 34.6916122 34.9998322 35.3033257 35.6194954 35.9049797 36.2193451 36.5589905 36.8696518 37.2203522 37.5640564 37.919487 38.2685394 38.6445084 39.0262337 39.3549576 39.7713165 40.1711578 40.5330582 40.9416618 41.3780365 41.820343 42.3371048 42.8759766 43.4096107 43.9574356 44.6151886 45.2916069 46.0173607 46.9054909 47.8003006 48.665535 49.8654251 51.23283 52.8638 54.727562 57.451931 61.305542 68.8323975 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1061783 10.2215385 10.3552723 10.4584923 10.5696898 10.707613 10.8308926 10.9474878 11.0466557 11.1954918 11.3298092 11.4381218 11.5622187 11.7013149 11.8479023 12.0212078 12.1755123 12.316081 12.4751329 12.651638 12.7837811 12.9355507 13.0945492 13.2588511 13.4510651 13.6054115 13.7626572 13.9213305 14.1039543 14.2889509 14.4784718 14.6981735 14.9128494 15.0948563 15.2915363 15.4499855 15.6591167 15.8567467 16.0791512 16.3138313 16.5375748 16.7662392 16.9933167 17.2361355 17.4961395 17.7687683 18.0262356 18.2839966 18.5196095 18.7864609 19.0508728 19.2950401 19.5822964 19.8825474 20.1648521 20.4087029 20.6781197 20.9290657 21.1938286 21.4809036 21.7586555 22.0162354 22.3129005 22.5913544 22.9026337 23.2017937 23.5013847 23.7982216 24.1193542 24.4255524 24.7479305 25.0527153 25.3824921 25.7266083 26.054121 26.3833923 26.7519073 27.1150284 27.4621086 27.8568726 28.2325478 28.6413708 29.0442982 29.4583683 29.8895397 30.3159981 30.789566 31.2696152 31.7496128 32.2962952 32.8911781 33.4767075 34.1868172 34.9719315 35.9059715 37.1770668 38.6658325 41.0315132 45.6433334 74.11026 ------------------------------ Transdef: Tab for variable 5 1.34602833 2.60601759 3.00855231 3.2858789 3.52724648 3.72895718 3.90465951 4.06786203 4.19372082 4.31799126 4.44153214 4.5540123 4.65159082 4.75442219 4.84121418 4.92887783 5.00710869 5.08091116 5.15420723 5.21593571 5.28515434 5.34554291 5.40207672 5.45031261 5.4957037 5.54432726 5.60074139 5.65402603 5.69719839 5.74673033 5.79135513 5.83797646 5.88234043 5.92325687 5.97523308 6.02056408 6.0647974 6.10629511 6.14486027 6.18885565 6.2277441 6.27109575 6.31154013 6.3495369 6.38586378 6.42934322 6.47933865 6.51945972 6.55760193 6.60431242 6.65222073 6.69827557 6.74279976 6.78134108 6.83236885 6.87176371 6.91678429 6.97101259 7.01433134 7.06346846 7.11275148 7.16281271 7.20965528 7.26079178 7.30610085 7.35871649 7.41168833 7.47019863 7.52412605 7.58104706 7.63449001 7.69181871 7.75257683 7.81657791 7.88218594 7.93628693 7.99055481 8.06002808 8.11538982 8.18399239 8.24497223 8.30916119 8.37524033 8.44407654 8.52144337 8.5997982 8.67356682 8.75244713 8.84076023 8.93399906 9.03325176 9.15135384 9.27488327 9.40646839 9.54906464 9.7353096 9.97261047 10.28228 10.7244701 11.5105858 23.5595493 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.2049675 24.7313671 25.933424 26.9801731 27.7593479 28.7229919 29.4356422 30.2362652 30.9243965 31.5166779 32.1417618 32.6849747 33.1560097 33.6504974 34.1226273 34.5815048 34.9841614 35.3329849 35.7636032 36.1698112 36.4820824 36.8533478 37.1938019 37.5267639 37.8734741 38.2359734 38.5860634 38.9616699 39.2735558 39.6445961 39.9773674 40.3038216 40.6294098 41.0559006 41.4216881 41.8210907 42.2198181 42.5753288 42.9811249 43.4594345 43.8621902 44.3482361 44.9104843 45.5360489 46.096817 46.6853333 47.3037491 48.078064 48.7176247 49.3051605 49.9891815 50.5504761 51.2661285 51.9421082 52.6678505 53.4783974 54.2130013 54.8890305 55.5298004 56.2721329 56.9703636 57.7021027 58.4003258 59.1261482 59.8595428 60.6272964 61.3989296 62.1334152 62.9330521 63.6648865 64.4749298 65.2273102 65.9878387 66.7128754 67.4438553 68.1848755 69.0168686 69.767189 70.5588531 71.3974304 72.2241287 73.0861969 73.8770905 74.8055649 75.7199402 76.7325592 77.7044678 78.7814178 80.0277634 81.4922867 83.0413666 85.0024567 87.1669922 89.9263229 92.9446869 96.7498474 101.546783 108.779289 120.976509 214.544067 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.5270081 33.5112 34.2151184 34.8123627 35.3606415 35.7805901 36.2022057 36.6071815 36.9820175 37.3048363 37.7076874 38.0189896 38.3033371 38.5947495 38.8507233 39.1515884 39.4052963 39.6580505 39.9927368 40.3489571 40.7074509 41.0286789 41.3714142 41.7096329 42.0564384 42.5120811 43.0083122 43.5982361 44.2104607 44.8406677 45.3732605 46.0610046 46.9196701 47.7083206 48.5718842 49.4740448 50.5512772 51.5576401 52.5381622 53.3322372 54.3528938 55.2781525 56.0460587 56.9925766 57.7833023 58.61409 59.3391876 60.1585503 60.9469757 61.835701 62.683197 63.5056572 64.2511749 65.0777664 65.8480072 66.7050247 67.543869 68.4139633 69.1812897 70.0704041 70.9711304 71.7781219 72.6304016 73.5102158 74.4571381 75.4741364 76.5411682 77.5814819 78.7692871 79.9878159 81.4383621 82.8447571 84.3619308 85.8677979 87.3695831 88.9931793 90.6687164 92.3144684 94.0299301 95.8472443 97.7901001 99.6826019 101.79171 104.198578 106.585678 109.239891 111.89119 114.737152 118.047897 121.556747 125.437241 129.787949 134.7948 140.202042 147.230591 155.488403 167.113373 182.622528 212.070587 532.093323 ------------------------------ Transdef: Tab for variable 8 0.678276479 23.4877319 28.4422035 30.5288239 31.5898857 32.3511505 33.0099335 33.5173264 33.9892502 34.4279747 34.8598328 35.1772156 35.5242043 35.8953133 36.1881409 36.4801865 36.7600555 37.0780258 37.3449173 37.6255112 37.8409996 38.0792885 38.3478775 38.6105881 38.8758965 39.1454468 39.3613892 39.6684952 39.9530029 40.2707176 40.5565643 40.8897858 41.2322388 41.5374718 41.8640213 42.2177124 42.6808014 43.1479874 43.6106186 44.0108948 44.4832993 44.9788055 45.4459152 46.038414 46.6307755 47.1381073 47.7955322 48.450489 49.1476746 49.7868118 50.4453354 51.0517349 51.7476196 52.4048271 53.0190659 53.653389 54.2560806 54.9407158 55.643692 56.2889252 56.9832306 57.6321487 58.253891 58.8883286 59.5560417 60.1657295 60.8138199 61.4851799 62.1009407 62.737114 63.3582993 64.072464 64.7505875 65.421402 66.120636 66.805542 67.5093384 68.2415619 68.9411087 69.637619 70.4229736 71.1816711 71.970253 72.8121185 73.6631165 74.5573273 75.5140839 76.4675064 77.5830383 78.7576599 80.3758392 82.1259384 83.9646912 86.2041626 89.0077972 92.4059753 96.4782867 101.691437 109.623734 123.999077 348.466034 ------------------------------ Transdef: Tab for variable 9 47.1748543 61.930336 64.3361664 65.8392639 67.2038574 68.3611679 69.2569046 70.1244049 70.8269501 71.6437378 72.4555511 73.1786346 73.9199982 74.4114761 75.004715 75.5148697 75.9773407 76.623436 77.054863 77.5409546 78.0124588 78.5774536 79.1072998 79.5840759 80.0129471 80.6351166 81.2289429 81.8116302 82.3979111 83.0309906 83.5885925 84.3022308 85.1781464 86.0567932 86.905365 87.8996201 88.8686218 89.8330917 90.937767 91.9391479 92.9650955 94.213562 95.3632202 96.5405884 97.7134094 98.8862762 100.223663 101.515793 102.800705 104.114059 105.463913 106.621307 107.863846 109.1278 110.417374 111.555496 112.789413 114.088867 115.290222 116.423065 117.583038 118.835815 119.913277 121.070892 122.123779 123.285744 124.506554 125.585373 126.842667 127.995949 129.023132 130.129349 131.288239 132.418182 133.527771 134.653625 135.788986 136.878387 137.967682 139.03949 140.202942 141.352509 142.446976 143.589218 144.674606 145.827835 146.975525 148.166473 149.48996 150.815948 152.151154 153.599319 155.157043 156.838501 158.914612 161.509705 164.764069 169.215851 177.313812 193.498123 450.732758 ------------------------------ Transdef: Tab for variable 10 0.00602381537 1.08319581 1.37657285 1.59477973 1.74550724 1.86553431 1.96297622 2.04849911 2.12136459 2.18720412 2.24183631 2.2929697 2.3348465 2.3772099 2.41679287 2.45224714 2.48327827 2.51254272 2.54213142 2.57116032 2.59906006 2.62170506 2.64467096 2.66797948 2.68942952 2.70951891 2.72955132 2.74752259 2.7659874 2.78038692 2.79473066 2.80939007 2.8227253 2.83282852 2.845263 2.85715747 2.86719847 2.87770271 2.88853931 2.898175 2.90586329 2.9136672 2.92113638 2.929317 2.93707895 2.94415212 2.95103407 2.95802593 2.96472812 2.97085094 2.97694755 2.98261738 2.98799038 2.991956 2.99717569 3.00249195 3.00676465 3.01129413 3.01525998 3.01952362 3.02360582 3.02788115 3.03181791 3.03562546 3.03951597 3.04327822 3.0468154 3.05061984 3.05390859 3.05768418 3.06085467 3.06443644 3.06738329 3.07079434 3.0737865 3.076509 3.07942367 3.08250761 3.08535576 3.08811402 3.0909164 3.09358406 3.09631681 3.09917283 3.1016109 3.10438585 3.10685396 3.10964537 3.11258698 3.11511135 3.11753988 3.11992073 3.12240553 3.12487411 3.12746572 3.12968135 3.13202763 3.13392496 3.13622141 3.13869715 3.14159226 ------------------------------ Transdef: Tab for variable 11 5.7220459E-06 0.00605250895 0.0115034906 0.0187917948 0.0245335102 0.0308390856 0.0375320911 0.0451953337 0.0517947674 0.0589522868 0.0661263466 0.0736513138 0.0804733038 0.0882788301 0.0947322845 0.100996971 0.108093023 0.114752956 0.121307492 0.128200978 0.133908272 0.140510917 0.146701992 0.153918207 0.160195917 0.166865349 0.172502279 0.178872347 0.185114503 0.190499946 0.196336985 0.201509491 0.20638895 0.211319923 0.215582415 0.219976902 0.224661618 0.229735017 0.234659627 0.239741564 0.244433284 0.249257803 0.254080147 0.258695602 0.263346672 0.268708825 0.274260342 0.278959215 0.284587145 0.289752573 0.295305431 0.300207168 0.305083811 0.310945153 0.316512525 0.322073638 0.327662706 0.333574474 0.338865757 0.344215393 0.350422263 0.356302857 0.361894011 0.36820507 0.374585122 0.380874991 0.386862218 0.393488169 0.39926374 0.40475142 0.411647499 0.418460608 0.425176501 0.432181716 0.437484264 0.444356143 0.450967789 0.457993418 0.465561479 0.474097848 0.481794596 0.491682053 0.500869036 0.509525537 0.517780304 0.527510524 0.538042486 0.548899889 0.560003877 0.57391125 0.586699486 0.600726128 0.615276814 0.63353169 0.651787162 0.672757804 0.704027295 0.731148362 0.775868118 0.836836576 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200011998 0.207617387 0.215217084 0.222459078 0.229312688 0.236348152 0.242869928 0.248940378 0.255010843 0.260912567 0.267557263 0.273356646 0.279358536 0.285065174 0.29126066 0.297270417 0.303293288 0.309400976 0.314884931 0.320397973 0.325405031 0.33141005 0.336971104 0.342843264 0.348570585 0.353864074 0.359556705 0.36488831 0.370235175 0.375751495 0.380816221 0.386793673 0.391965687 0.396717846 0.40106535 0.405434638 0.410013378 0.413600832 0.417406321 0.420866251 0.424880445 0.42861554 0.43289116 0.436253875 0.439626098 0.443662912 0.447157681 0.451157629 0.455115229 0.45880276 0.463136375 0.467270911 0.471277297 0.475585699 0.479400694 0.483141363 0.487430245 0.491549432 0.496617585 0.501163065 0.506116509 0.51072681 0.515390337 0.519714296 0.524377406 0.529483974 0.535030484 0.54085362 0.54608798 0.551698446 0.557352424 0.56268537 0.568217695 0.573717356 0.579241037 0.58591485 0.59289968 0.599165916 0.606398821 0.614319205 0.621300399 0.628404021 0.636193097 0.645775914 0.65556848 0.662825465 0.670892 0.679019451 0.691005349 0.702661276 0.714659929 0.727210522 0.740194261 0.752462029 0.768171191 0.786638498 0.807581425 0.829625309 0.863646507 0.911747396 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0361443 21.4764233 22.2752304 22.9031525 23.4083672 23.8650856 24.395546 24.8707008 25.3341751 25.7285309 26.1123085 26.5471897 26.9979324 27.3616676 27.7451611 28.1235828 28.5005169 28.8509483 29.259634 29.5877037 29.9234905 30.2408905 30.5432816 30.8289871 31.1266804 31.461956 31.7742081 32.0969238 32.3991432 32.684761 33.0564117 33.3787384 33.6989746 34.0459824 34.3962364 34.6684532 34.9517746 35.2980614 35.6183548 35.9494019 36.2052841 36.505455 36.8536682 37.1699142 37.4945984 37.8151588 38.1107101 38.4564857 38.7891502 39.1574478 39.5283737 39.8673325 40.2261238 40.5904694 40.9181824 41.2912102 41.6730385 42.0988159 42.4768448 42.8805962 43.2903595 43.6793976 44.1381111 44.6023827 45.0718384 45.5565567 46.0573807 46.5294151 47.0224075 47.5347557 48.0317764 48.5764008 49.1345215 49.7289581 50.359951 51.072361 51.8237381 52.4824829 53.1615524 53.9602127 54.7403183 55.5622215 56.4431801 57.392231 58.4108238 59.4977341 60.597435 61.786026 62.882515 64.3262024 66.0414429 67.6743774 69.6522064 71.962677 74.3455658 77.2985382 80.8505707 85.5329895 92.3502655 101.964142 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.7018185 11.0793428 11.4044781 11.7286606 12.098011 12.4467335 12.7593746 13.0612659 13.3883705 13.6686306 13.925869 14.2163 14.5148335 14.7761106 15.0727291 15.4007397 15.6479235 15.9250994 16.281826 16.611145 16.878746 17.1802979 17.4416504 17.7189217 17.9651184 18.2203293 18.5102654 18.7717533 19.0806122 19.3085213 19.5771523 19.8765163 20.1915798 20.4662342 20.7278442 21.0065422 21.2761326 21.5367222 21.7890282 22.0445995 22.3570175 22.6854362 22.9948425 23.2724895 23.5450516 23.853138 24.1854153 24.4822044 24.8172798 25.1050262 25.407177 25.7214966 26.0092926 26.3273239 26.6634636 26.9764805 27.285181 27.5673256 27.8594131 28.1589699 28.4861641 28.8170528 29.1303215 29.4156685 29.7760277 30.1499157 30.5152664 30.8529701 31.2125435 31.526907 31.8688068 32.2719421 32.6393127 33.0484314 33.4752655 33.8614273 34.2798653 34.7264099 35.1771889 35.6978531 36.1741219 36.7347717 37.2829437 37.8019562 38.3888206 39.032814 39.6946411 40.4463615 41.2509727 42.1345482 43.0847855 44.2081108 45.5090179 47.0369873 48.6029129 50.8388748 53.6684952 57.4786453 63.8194656 139.444885 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 66.0 48.4 54.3 29.3 49.5 63.0 54.7 64.1 -27.0 -13.8 -29.0 12.7 27.6 2 66.0 100.0 65.5 61.7 34.3 68.8 94.3 74.0 91.4 -45.1 -20.6 -40.8 30.4 37.0 3 48.4 65.5 100.0 46.5 8.0 33.7 68.9 52.5 70.6 -16.0 -22.8 -44.8 63.6 28.3 4 54.3 61.7 46.5 100.0 17.3 39.2 61.8 53.3 68.1 -12.2 -26.5 -52.8 20.6 73.0 5 29.3 34.3 8.0 17.3 100.0 84.4 6.4 57.1 57.0 24.4 -5.0 -7.3 -5.2 6.7 6 49.5 68.8 33.7 39.2 84.4 100.0 47.1 79.3 80.6 -6.1 -12.1 -22.8 9.5 21.3 7 63.0 94.3 68.9 61.8 6.4 47.1 100.0 65.2 79.4 -53.3 -20.0 -41.2 35.2 38.6 8 54.7 74.0 52.5 53.3 57.1 79.3 65.2 100.0 83.0 -9.5 -20.2 -35.3 23.7 32.9 9 64.1 91.4 70.6 68.1 57.0 80.6 79.4 83.0 100.0 -20.1 -23.1 -45.5 34.9 42.8 10 -27.0 -45.1 -16.0 -12.2 24.4 -6.1 -53.3 -9.5 -20.1 100.0 3.1 8.3 -4.4 -4.3 11 -13.8 -20.6 -22.8 -26.5 -5.0 -12.1 -20.0 -20.2 -23.1 3.1 100.0 54.2 -6.5 -15.6 12 -29.0 -40.8 -44.8 -52.8 -7.3 -22.8 -41.2 -35.3 -45.5 8.3 54.2 100.0 -17.0 -29.3 13 12.7 30.4 63.6 20.6 -5.2 9.5 35.2 23.7 34.9 -4.4 -6.5 -17.0 100.0 48.7 14 27.6 37.0 28.3 73.0 6.7 21.3 38.6 32.9 42.8 -4.3 -15.6 -29.3 48.7 100.0 TOTAL CORRELATION TO TARGET (diagonal) 163.447805 TOTAL CORRELATION OF ALL VARIABLES 72.6386893 ROUND 1: MAX CORR ( 72.6341818) AFTER KILLING INPUT VARIABLE 6 CONTR 0.809211745 ROUND 2: MAX CORR ( 72.6247677) AFTER KILLING INPUT VARIABLE 11 CONTR 1.16938991 ROUND 3: MAX CORR ( 72.6129535) AFTER KILLING INPUT VARIABLE 8 CONTR 1.30991375 ROUND 4: MAX CORR ( 72.5774874) AFTER KILLING INPUT VARIABLE 14 CONTR 2.26921434 ROUND 5: MAX CORR ( 72.5348537) AFTER KILLING INPUT VARIABLE 2 CONTR 2.48730386 ROUND 6: MAX CORR ( 72.2429849) AFTER KILLING INPUT VARIABLE 12 CONTR 6.50047216 ROUND 7: MAX CORR ( 71.917767) AFTER KILLING INPUT VARIABLE 10 CONTR 6.84716382 ROUND 8: MAX CORR ( 71.0649717) AFTER KILLING INPUT VARIABLE 9 CONTR 11.0424187 ROUND 9: MAX CORR ( 70.0887069) AFTER KILLING INPUT VARIABLE 3 CONTR 11.7389676 ROUND 10: MAX CORR ( 69.6224957) AFTER KILLING INPUT VARIABLE 13 CONTR 8.07062136 ROUND 11: MAX CORR ( 67.888985) AFTER KILLING INPUT VARIABLE 4 CONTR 15.4394825 ROUND 12: MAX CORR ( 63.0141218) AFTER KILLING INPUT VARIABLE 5 CONTR 25.2613291 LAST REMAINING VARIABLE: 7 total correlation to target: 72.6386893 % total significance: 149.825076 sigma correlations of single variables to target: variable 2: 66.0165249 % , in sigma: 136.166152 variable 3: 48.4171365 % , in sigma: 99.8655292 variable 4: 54.286006 % , in sigma: 111.970701 variable 5: 29.2558812 % , in sigma: 60.3433881 variable 6: 49.4997288 % , in sigma: 102.098492 variable 7: 63.0141218 % , in sigma: 129.973374 variable 8: 54.7383407 % , in sigma: 112.90369 variable 9: 64.1438544 % , in sigma: 132.303569 variable 10: -26.9779709 % , in sigma: 55.6449542 variable 11: -13.7683193 % , in sigma: 28.398633 variable 12: -28.9542696 % , in sigma: 59.7212818 variable 13: 12.7474522 % , in sigma: 26.2929853 variable 14: 27.5673651 % , in sigma: 56.8606428 variables sorted by significance: 1 most relevant variable 7 corr 63.014122 , in sigma: 129.973375 2 most relevant variable 5 corr 25.2613297 , in sigma: 52.1041977 3 most relevant variable 4 corr 15.4394827 , in sigma: 31.8455865 4 most relevant variable 13 corr 8.07062149 , in sigma: 16.6465211 5 most relevant variable 3 corr 11.7389679 , in sigma: 24.2128784 6 most relevant variable 9 corr 11.0424185 , in sigma: 22.7761707 7 most relevant variable 10 corr 6.84716368 , in sigma: 14.1230084 8 most relevant variable 12 corr 6.50047207 , in sigma: 13.4079198 9 most relevant variable 2 corr 2.48730397 , in sigma: 5.13033081 10 most relevant variable 14 corr 2.26921439 , in sigma: 4.6804977 11 most relevant variable 8 corr 1.30991375 , in sigma: 2.7018374 12 most relevant variable 11 corr 1.16938996 , in sigma: 2.41199203 13 most relevant variable 6 corr 0.809211731 , in sigma: 1.66908586 global correlations between input variables: variable 2: 99.2028491 % variable 3: 92.3647179 % variable 4: 92.090881 % variable 5: 95.5930257 % variable 6: 95.4017632 % variable 7: 98.8006815 % variable 8: 89.5155555 % variable 9: 98.7601685 % variable 10: 72.0717829 % variable 11: 55.0358103 % variable 12: 70.6473424 % variable 13: 85.1170231 % variable 14: 88.3140808 % significance loss when removing single variables: variable 2: corr = 2.91835946 % , sigma = 6.01942892 variable 3: corr = 15.2087513 % , sigma = 31.3696783 variable 4: corr = 15.7851402 % , sigma = 32.5585421 variable 5: corr = 14.1133335 % , sigma = 29.1102618 variable 6: corr = 0.809211745 % , sigma = 1.66908588 variable 7: corr = 6.45312218 % , sigma = 13.3102556 variable 8: corr = 1.58870223 % , sigma = 3.27686848 variable 9: corr = 10.1814707 % , sigma = 21.0003737 variable 10: corr = 6.29812226 % , sigma = 12.9905516 variable 11: corr = 1.19724336 % , sigma = 2.46944264 variable 12: corr = 5.39789289 % , sigma = 11.1337322 variable 13: corr = 7.76715478 % , sigma = 16.0205885 variable 14: corr = 2.20044052 % , sigma = 4.53864422 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 32.9845695 sigma out 15 active outputs RANK 2 NODE 11 --> 25.8414478 sigma out 15 active outputs RANK 3 NODE 1 --> 25.1179676 sigma out 15 active outputs RANK 4 NODE 9 --> 25.1050186 sigma out 15 active outputs RANK 5 NODE 4 --> 23.4878788 sigma out 15 active outputs RANK 6 NODE 2 --> 22.46562 sigma out 15 active outputs RANK 7 NODE 10 --> 22.2125702 sigma out 15 active outputs RANK 8 NODE 8 --> 21.084816 sigma out 15 active outputs RANK 9 NODE 5 --> 19.0185165 sigma out 15 active outputs RANK 10 NODE 6 --> 17.6261158 sigma out 15 active outputs RANK 11 NODE 7 --> 16.5895767 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 39.1183929 sigma in 11act. ( 40.2675362 sig out 1act.) RANK 2 NODE 6 --> 31.098774 sigma in 11act. ( 32.9633217 sig out 1act.) RANK 3 NODE 13 --> 26.607748 sigma in 11act. ( 25.4150887 sig out 1act.) RANK 4 NODE 9 --> 26.0014725 sigma in 11act. ( 27.0613422 sig out 1act.) RANK 5 NODE 7 --> 23.2502918 sigma in 11act. ( 29.3066368 sig out 1act.) RANK 6 NODE 8 --> 21.439909 sigma in 11act. ( 20.2239208 sig out 1act.) RANK 7 NODE 14 --> 17.5769939 sigma in 11act. ( 16.9175148 sig out 1act.) RANK 8 NODE 15 --> 16.7685184 sigma in 11act. ( 17.3910389 sig out 1act.) RANK 9 NODE 3 --> 11.1185694 sigma in 11act. ( 8.55884361 sig out 1act.) RANK 10 NODE 12 --> 10.5932875 sigma in 11act. ( 7.36424017 sig out 1act.) RANK 11 NODE 10 --> 8.74380493 sigma in 11act. ( 9.17393398 sig out 1act.) RANK 12 NODE 11 --> 8.00114632 sigma in 11act. ( 9.13612938 sig out 1act.) RANK 13 NODE 4 --> 7.26067877 sigma in 11act. ( 8.19101334 sig out 1act.) RANK 14 NODE 2 --> 7.22923756 sigma in 11act. ( 9.91507244 sig out 1act.) RANK 15 NODE 1 --> 2.40490723 sigma in 11act. ( 2.21250343 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 40.2675362 sigma out 1act.( 39.1183929 sig in 11act.) RANK 2 NODE 6 --> 32.9633217 sigma out 1act.( 31.098774 sig in 11act.) RANK 3 NODE 7 --> 29.3066368 sigma out 1act.( 23.2502918 sig in 11act.) RANK 4 NODE 9 --> 27.0613422 sigma out 1act.( 26.0014725 sig in 11act.) RANK 5 NODE 13 --> 25.4150887 sigma out 1act.( 26.607748 sig in 11act.) RANK 6 NODE 8 --> 20.2239208 sigma out 1act.( 21.439909 sig in 11act.) RANK 7 NODE 15 --> 17.3910389 sigma out 1act.( 16.7685184 sig in 11act.) RANK 8 NODE 14 --> 16.9175148 sigma out 1act.( 17.5769939 sig in 11act.) RANK 9 NODE 2 --> 9.91507244 sigma out 1act.( 7.22923756 sig in 11act.) RANK 10 NODE 10 --> 9.17393398 sigma out 1act.( 8.74380493 sig in 11act.) RANK 11 NODE 11 --> 9.13612938 sigma out 1act.( 8.00114632 sig in 11act.) RANK 12 NODE 3 --> 8.55884361 sigma out 1act.( 11.1185694 sig in 11act.) RANK 13 NODE 4 --> 8.19101334 sigma out 1act.( 7.26067877 sig in 11act.) RANK 14 NODE 12 --> 7.36424017 sigma out 1act.( 10.5932875 sig in 11act.) RANK 15 NODE 1 --> 2.21250343 sigma out 1act.( 2.40490723 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 80.0515289 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 31.2457924 sigma out 15 active outputs RANK 2 NODE 2 --> 26.3102379 sigma out 15 active outputs RANK 3 NODE 9 --> 24.7194729 sigma out 15 active outputs RANK 4 NODE 11 --> 24.2943707 sigma out 15 active outputs RANK 5 NODE 1 --> 24.1532536 sigma out 15 active outputs RANK 6 NODE 4 --> 23.4152431 sigma out 15 active outputs RANK 7 NODE 10 --> 20.3851871 sigma out 15 active outputs RANK 8 NODE 8 --> 20.122879 sigma out 15 active outputs RANK 9 NODE 5 --> 18.5081654 sigma out 15 active outputs RANK 10 NODE 6 --> 17.9947548 sigma out 15 active outputs RANK 11 NODE 7 --> 16.9448891 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 37.2485123 sigma in 11act. ( 36.0723534 sig out 1act.) RANK 2 NODE 6 --> 30.6624565 sigma in 11act. ( 29.4130211 sig out 1act.) RANK 3 NODE 7 --> 27.1051502 sigma in 11act. ( 27.1870975 sig out 1act.) RANK 4 NODE 9 --> 24.8424988 sigma in 11act. ( 23.5798016 sig out 1act.) RANK 5 NODE 13 --> 23.012331 sigma in 11act. ( 21.8215446 sig out 1act.) RANK 6 NODE 15 --> 17.9010773 sigma in 11act. ( 16.1437836 sig out 1act.) RANK 7 NODE 8 --> 17.4882298 sigma in 11act. ( 16.8496456 sig out 1act.) RANK 8 NODE 14 --> 14.613245 sigma in 11act. ( 13.9568119 sig out 1act.) RANK 9 NODE 2 --> 13.1827288 sigma in 11act. ( 10.4730854 sig out 1act.) RANK 10 NODE 10 --> 10.5520849 sigma in 11act. ( 9.42956257 sig out 1act.) RANK 11 NODE 11 --> 10.1666183 sigma in 11act. ( 8.58709717 sig out 1act.) RANK 12 NODE 12 --> 9.99944401 sigma in 11act. ( 6.08368492 sig out 1act.) RANK 13 NODE 4 --> 9.84873009 sigma in 11act. ( 8.23547173 sig out 1act.) RANK 14 NODE 3 --> 9.30207348 sigma in 11act. ( 7.03742027 sig out 1act.) RANK 15 NODE 1 --> 7.38548374 sigma in 11act. ( 2.81439137 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 36.0723534 sigma out 1act.( 37.2485123 sig in 11act.) RANK 2 NODE 6 --> 29.4130211 sigma out 1act.( 30.6624565 sig in 11act.) RANK 3 NODE 7 --> 27.1870975 sigma out 1act.( 27.1051502 sig in 11act.) RANK 4 NODE 9 --> 23.5798016 sigma out 1act.( 24.8424988 sig in 11act.) RANK 5 NODE 13 --> 21.8215446 sigma out 1act.( 23.012331 sig in 11act.) RANK 6 NODE 8 --> 16.8496456 sigma out 1act.( 17.4882298 sig in 11act.) RANK 7 NODE 15 --> 16.1437836 sigma out 1act.( 17.9010773 sig in 11act.) RANK 8 NODE 14 --> 13.9568119 sigma out 1act.( 14.613245 sig in 11act.) RANK 9 NODE 2 --> 10.4730854 sigma out 1act.( 13.1827288 sig in 11act.) RANK 10 NODE 10 --> 9.42956257 sigma out 1act.( 10.5520849 sig in 11act.) RANK 11 NODE 11 --> 8.58709717 sigma out 1act.( 10.1666183 sig in 11act.) RANK 12 NODE 4 --> 8.23547173 sigma out 1act.( 9.84873009 sig in 11act.) RANK 13 NODE 3 --> 7.03742027 sigma out 1act.( 9.30207348 sig in 11act.) RANK 14 NODE 12 --> 6.08368492 sigma out 1act.( 9.99944401 sig in 11act.) RANK 15 NODE 1 --> 2.81439137 sigma out 1act.( 7.38548374 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 71.4955292 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.429718286 *** contribution from regularisation: 0.00375409587 *** contribution from error: -0.433472395 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.484789252 *** contribution from regularisation: 0.00277195917 *** contribution from error: -0.487561226 *********************************************** -----------------> Test sample ENTER BFGS code START -48429.77 -0.264284879 -0.335318804 EXIT FROM BFGS code FG_START 0. -0.264284879 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.516266346 *** contribution from regularisation: 0.0025411367 *** contribution from error: -0.518807471 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -51563.6493 -0.264284879 -147.076477 EXIT FROM BFGS code FG_LNSRCH 0. -0.293156087 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.548556387 *** contribution from regularisation: 0.00309837819 *** contribution from error: -0.551654756 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54788.7177 -0.293156087 -119.15345 EXIT FROM BFGS code NEW_X -54788.7177 -0.293156087 -119.15345 ENTER BFGS code NEW_X -54788.7177 -0.293156087 -119.15345 EXIT FROM BFGS code FG_LNSRCH 0. -0.323694348 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.550909579 *** contribution from regularisation: 0.00316545391 *** contribution from error: -0.554075062 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55023.7447 -0.323694348 11.2004652 EXIT FROM BFGS code NEW_X -55023.7447 -0.323694348 11.2004652 ENTER BFGS code NEW_X -55023.7447 -0.323694348 11.2004652 EXIT FROM BFGS code FG_LNSRCH 0. -0.324603736 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.551429868 *** contribution from regularisation: 0.00301827956 *** contribution from error: -0.554448128 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55075.7103 -0.324603736 -21.7903957 EXIT FROM BFGS code NEW_X -55075.7103 -0.324603736 -21.7903957 ENTER BFGS code NEW_X -55075.7103 -0.324603736 -21.7903957 EXIT FROM BFGS code FG_LNSRCH 0. -0.332474142 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.551628292 *** contribution from regularisation: 0.00292693241 *** contribution from error: -0.554555237 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55095.532 -0.332474142 -10.5033188 EXIT FROM BFGS code NEW_X -55095.532 -0.332474142 -10.5033188 ENTER BFGS code NEW_X -55095.532 -0.332474142 -10.5033188 EXIT FROM BFGS code FG_LNSRCH 0. -0.357774317 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.552033365 *** contribution from regularisation: 0.0028214131 *** contribution from error: -0.554854751 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55135.9861 -0.357774317 3.09386683 EXIT FROM BFGS code NEW_X -55135.9861 -0.357774317 3.09386683 ENTER BFGS code NEW_X -55135.9861 -0.357774317 3.09386683 EXIT FROM BFGS code FG_LNSRCH 0. -0.437061042 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.553013504 *** contribution from regularisation: 0.00271364418 *** contribution from error: -0.555727124 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55233.8812 -0.437061042 28.6821404 EXIT FROM BFGS code NEW_X -55233.8812 -0.437061042 28.6821404 ENTER BFGS code NEW_X -55233.8812 -0.437061042 28.6821404 EXIT FROM BFGS code FG_LNSRCH 0. -0.577400029 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 47.3560371 sigma out 15 active outputs RANK 2 NODE 1 --> 32.9243469 sigma out 15 active outputs RANK 3 NODE 11 --> 31.7096939 sigma out 15 active outputs RANK 4 NODE 6 --> 24.6455612 sigma out 15 active outputs RANK 5 NODE 7 --> 24.4378891 sigma out 15 active outputs RANK 6 NODE 5 --> 24.0496788 sigma out 15 active outputs RANK 7 NODE 3 --> 22.7142982 sigma out 15 active outputs RANK 8 NODE 9 --> 19.325758 sigma out 15 active outputs RANK 9 NODE 4 --> 18.8424072 sigma out 15 active outputs RANK 10 NODE 10 --> 14.3429422 sigma out 15 active outputs RANK 11 NODE 8 --> 13.6743622 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 55.8122826 sigma in 11act. ( 50.3106155 sig out 1act.) RANK 2 NODE 7 --> 30.9124775 sigma in 11act. ( 30.1437874 sig out 1act.) RANK 3 NODE 2 --> 26.5484962 sigma in 11act. ( 26.0272827 sig out 1act.) RANK 4 NODE 4 --> 24.1313763 sigma in 11act. ( 24.393568 sig out 1act.) RANK 5 NODE 13 --> 23.4386082 sigma in 11act. ( 24.100996 sig out 1act.) RANK 6 NODE 6 --> 21.930275 sigma in 11act. ( 17.2567081 sig out 1act.) RANK 7 NODE 10 --> 17.7928791 sigma in 11act. ( 16.2289658 sig out 1act.) RANK 8 NODE 11 --> 17.3323975 sigma in 11act. ( 16.6247463 sig out 1act.) RANK 9 NODE 9 --> 15.5419331 sigma in 11act. ( 13.8565702 sig out 1act.) RANK 10 NODE 15 --> 12.6251259 sigma in 11act. ( 13.4929895 sig out 1act.) RANK 11 NODE 1 --> 12.3343649 sigma in 11act. ( 11.4970026 sig out 1act.) RANK 12 NODE 14 --> 10.3737469 sigma in 11act. ( 9.98140049 sig out 1act.) RANK 13 NODE 12 --> 7.49717951 sigma in 11act. ( 6.4505229 sig out 1act.) RANK 14 NODE 8 --> 4.66778326 sigma in 11act. ( 2.70756102 sig out 1act.) RANK 15 NODE 3 --> 2.92338061 sigma in 11act. ( 2.12208796 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 50.3106155 sigma out 1act.( 55.8122826 sig in 11act.) RANK 2 NODE 7 --> 30.1437874 sigma out 1act.( 30.9124775 sig in 11act.) RANK 3 NODE 2 --> 26.0272827 sigma out 1act.( 26.5484962 sig in 11act.) RANK 4 NODE 4 --> 24.393568 sigma out 1act.( 24.1313763 sig in 11act.) RANK 5 NODE 13 --> 24.100996 sigma out 1act.( 23.4386082 sig in 11act.) RANK 6 NODE 6 --> 17.2567081 sigma out 1act.( 21.930275 sig in 11act.) RANK 7 NODE 11 --> 16.6247463 sigma out 1act.( 17.3323975 sig in 11act.) RANK 8 NODE 10 --> 16.2289658 sigma out 1act.( 17.7928791 sig in 11act.) RANK 9 NODE 9 --> 13.8565702 sigma out 1act.( 15.5419331 sig in 11act.) RANK 10 NODE 15 --> 13.4929895 sigma out 1act.( 12.6251259 sig in 11act.) RANK 11 NODE 1 --> 11.4970026 sigma out 1act.( 12.3343649 sig in 11act.) RANK 12 NODE 14 --> 9.98140049 sigma out 1act.( 10.3737469 sig in 11act.) RANK 13 NODE 12 --> 6.4505229 sigma out 1act.( 7.49717951 sig in 11act.) RANK 14 NODE 8 --> 2.70756102 sigma out 1act.( 4.66778326 sig in 11act.) RANK 15 NODE 3 --> 2.12208796 sigma out 1act.( 2.92338061 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 82.401474 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.553030372 *** contribution from regularisation: 0.00342714833 *** contribution from error: -0.55645752 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -55235.5693 -0.577400029 95.2629089 EXIT FROM BFGS code FG_LNSRCH 0. -0.497517884 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.553925335 *** contribution from regularisation: 0.00265724584 *** contribution from error: -0.55658257 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55324.952 -0.497517884 57.5166931 EXIT FROM BFGS code NEW_X -55324.952 -0.497517884 57.5166931 ENTER BFGS code NEW_X -55324.952 -0.497517884 57.5166931 EXIT FROM BFGS code FG_LNSRCH 0. -0.541093886 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.553012729 *** contribution from regularisation: 0.00337271788 *** contribution from error: -0.556385458 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55233.8064 -0.541093886 -95.8683853 EXIT FROM BFGS code FG_LNSRCH 0. -0.509079099 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.55418545 *** contribution from regularisation: 0.00274893269 *** contribution from error: -0.556934357 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55350.9335 -0.509079099 20.9984493 EXIT FROM BFGS code NEW_X -55350.9335 -0.509079099 20.9984493 ENTER BFGS code NEW_X -55350.9335 -0.509079099 20.9984493 EXIT FROM BFGS code FG_LNSRCH 0. -0.510480762 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.554149985 *** contribution from regularisation: 0.00304005295 *** contribution from error: -0.557190061 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55347.3938 -0.510480762 29.4599857 EXIT FROM BFGS code FG_LNSRCH 0. -0.509450018 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.554057777 *** contribution from regularisation: 0.00297950464 *** contribution from error: -0.557037294 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55338.1797 -0.509450018 22.8942547 EXIT FROM BFGS code FG_LNSRCH 0. -0.509108424 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.553958833 *** contribution from regularisation: 0.00298422296 *** contribution from error: -0.556943059 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55328.3021 -0.509108424 20.7896099 EXIT FROM BFGS code FG_LNSRCH 0. -0.509079278 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.553960323 *** contribution from regularisation: 0.00297411997 *** contribution from error: -0.556934416 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55328.4473 -0.509079278 20.6400604 EXIT FROM BFGS code FG_LNSRCH 0. -0.509079099 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.553946495 *** contribution from regularisation: 0.00298784906 *** contribution from error: -0.556934357 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55327.071 -0.509079099 20.5523434 EXIT FROM BFGS code FG_LNSRCH 0. -0.509079099 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.553947031 *** contribution from regularisation: 0.00298732286 *** contribution from error: -0.556934357 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55327.1235 -0.509079099 20.3898964 EXIT FROM BFGS code FG_LNSRCH 0. -0.509079099 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 44.3988533 sigma out 15 active outputs RANK 2 NODE 1 --> 28.6167507 sigma out 15 active outputs RANK 3 NODE 11 --> 27.6862469 sigma out 15 active outputs RANK 4 NODE 5 --> 22.2713432 sigma out 15 active outputs RANK 5 NODE 3 --> 21.4756813 sigma out 15 active outputs RANK 6 NODE 6 --> 20.3504486 sigma out 15 active outputs RANK 7 NODE 7 --> 19.501976 sigma out 15 active outputs RANK 8 NODE 4 --> 17.2636547 sigma out 15 active outputs RANK 9 NODE 9 --> 16.6001453 sigma out 15 active outputs RANK 10 NODE 8 --> 13.1984434 sigma out 15 active outputs RANK 11 NODE 10 --> 12.5760355 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 47.0371933 sigma in 11act. ( 43.3081551 sig out 1act.) RANK 2 NODE 7 --> 28.6810665 sigma in 11act. ( 26.3062096 sig out 1act.) RANK 3 NODE 2 --> 23.721384 sigma in 11act. ( 22.7625103 sig out 1act.) RANK 4 NODE 6 --> 21.6659088 sigma in 11act. ( 17.7360325 sig out 1act.) RANK 5 NODE 4 --> 21.5300255 sigma in 11act. ( 20.7195702 sig out 1act.) RANK 6 NODE 13 --> 20.2116528 sigma in 11act. ( 20.3974705 sig out 1act.) RANK 7 NODE 11 --> 16.5733547 sigma in 11act. ( 14.6056156 sig out 1act.) RANK 8 NODE 10 --> 16.5628662 sigma in 11act. ( 14.6156511 sig out 1act.) RANK 9 NODE 9 --> 14.9900341 sigma in 11act. ( 12.7447977 sig out 1act.) RANK 10 NODE 15 --> 12.8865318 sigma in 11act. ( 13.1829281 sig out 1act.) RANK 11 NODE 1 --> 12.2912531 sigma in 11act. ( 11.2556725 sig out 1act.) RANK 12 NODE 14 --> 9.46471596 sigma in 11act. ( 8.72586823 sig out 1act.) RANK 13 NODE 12 --> 7.68135738 sigma in 11act. ( 6.27787495 sig out 1act.) RANK 14 NODE 8 --> 5.3389039 sigma in 11act. ( 3.80659723 sig out 1act.) RANK 15 NODE 3 --> 2.67271018 sigma in 11act. ( 1.28595114 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 43.3081551 sigma out 1act.( 47.0371933 sig in 11act.) RANK 2 NODE 7 --> 26.3062096 sigma out 1act.( 28.6810665 sig in 11act.) RANK 3 NODE 2 --> 22.7625103 sigma out 1act.( 23.721384 sig in 11act.) RANK 4 NODE 4 --> 20.7195702 sigma out 1act.( 21.5300255 sig in 11act.) RANK 5 NODE 13 --> 20.3974705 sigma out 1act.( 20.2116528 sig in 11act.) RANK 6 NODE 6 --> 17.7360325 sigma out 1act.( 21.6659088 sig in 11act.) RANK 7 NODE 10 --> 14.6156511 sigma out 1act.( 16.5628662 sig in 11act.) RANK 8 NODE 11 --> 14.6056156 sigma out 1act.( 16.5733547 sig in 11act.) RANK 9 NODE 15 --> 13.1829281 sigma out 1act.( 12.8865318 sig in 11act.) RANK 10 NODE 9 --> 12.7447977 sigma out 1act.( 14.9900341 sig in 11act.) RANK 11 NODE 1 --> 11.2556725 sigma out 1act.( 12.2912531 sig in 11act.) RANK 12 NODE 14 --> 8.72586823 sigma out 1act.( 9.46471596 sig in 11act.) RANK 13 NODE 12 --> 6.27787495 sigma out 1act.( 7.68135738 sig in 11act.) RANK 14 NODE 8 --> 3.80659723 sigma out 1act.( 5.3389039 sig in 11act.) RANK 15 NODE 3 --> 1.28595114 sigma out 1act.( 2.67271018 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 72.5755844 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.553959548 *** contribution from regularisation: 0.00297481893 *** contribution from error: -0.556934357 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -55328.3724 -0.509079099 20.4330406 EXIT FROM BFGS code FG_LNSRCH 0. -0.509079099 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.553952456 *** contribution from regularisation: 0.00298192282 *** contribution from error: -0.556934357 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55327.6629 -0.509079099 20.4139423 EXIT FROM BFGS code NEW_X -55327.6629 -0.509079099 20.4139423 ENTER BFGS code NEW_X -55327.6629 -0.509079099 20.4139423 EXIT FROM BFGS code CONVERGENC -55327.6629 -0.509079099 20.4139423 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 67.0482101 sigma out 15 active outputs RANK 2 NODE 1 --> 43.3347969 sigma out 15 active outputs RANK 3 NODE 11 --> 41.1513519 sigma out 15 active outputs RANK 4 NODE 5 --> 33.825943 sigma out 15 active outputs RANK 5 NODE 3 --> 33.497097 sigma out 15 active outputs RANK 6 NODE 6 --> 30.5067482 sigma out 15 active outputs RANK 7 NODE 7 --> 29.2027493 sigma out 15 active outputs RANK 8 NODE 4 --> 26.2896729 sigma out 15 active outputs RANK 9 NODE 9 --> 25.4728928 sigma out 15 active outputs RANK 10 NODE 8 --> 19.8208656 sigma out 15 active outputs RANK 11 NODE 10 --> 18.734663 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 70.9481964 sigma in 11act. ( 67.6548996 sig out 1act.) RANK 2 NODE 7 --> 44.1709709 sigma in 11act. ( 40.8936386 sig out 1act.) RANK 3 NODE 2 --> 35.5767403 sigma in 11act. ( 35.4739761 sig out 1act.) RANK 4 NODE 6 --> 33.1766396 sigma in 11act. ( 27.3126183 sig out 1act.) RANK 5 NODE 4 --> 32.8354912 sigma in 11act. ( 31.7351322 sig out 1act.) RANK 6 NODE 13 --> 30.6001644 sigma in 11act. ( 31.5341396 sig out 1act.) RANK 7 NODE 11 --> 25.1936989 sigma in 11act. ( 22.9968033 sig out 1act.) RANK 8 NODE 10 --> 25.168375 sigma in 11act. ( 22.4850311 sig out 1act.) RANK 9 NODE 9 --> 22.6098003 sigma in 11act. ( 19.3421078 sig out 1act.) RANK 10 NODE 15 --> 18.8988228 sigma in 11act. ( 20.9467831 sig out 1act.) RANK 11 NODE 1 --> 18.2994633 sigma in 11act. ( 17.3227825 sig out 1act.) RANK 12 NODE 14 --> 13.7512865 sigma in 11act. ( 13.6422997 sig out 1act.) RANK 13 NODE 12 --> 10.9468145 sigma in 11act. ( 9.64267254 sig out 1act.) RANK 14 NODE 8 --> 6.69940233 sigma in 11act. ( 6.04649401 sig out 1act.) RANK 15 NODE 3 --> 3.08332777 sigma in 11act. ( 2.0023489 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 67.6548996 sigma out 1act.( 70.9481964 sig in 11act.) RANK 2 NODE 7 --> 40.8936386 sigma out 1act.( 44.1709709 sig in 11act.) RANK 3 NODE 2 --> 35.4739761 sigma out 1act.( 35.5767403 sig in 11act.) RANK 4 NODE 4 --> 31.7351322 sigma out 1act.( 32.8354912 sig in 11act.) RANK 5 NODE 13 --> 31.5341396 sigma out 1act.( 30.6001644 sig in 11act.) RANK 6 NODE 6 --> 27.3126183 sigma out 1act.( 33.1766396 sig in 11act.) RANK 7 NODE 11 --> 22.9968033 sigma out 1act.( 25.1936989 sig in 11act.) RANK 8 NODE 10 --> 22.4850311 sigma out 1act.( 25.168375 sig in 11act.) RANK 9 NODE 15 --> 20.9467831 sigma out 1act.( 18.8988228 sig in 11act.) RANK 10 NODE 9 --> 19.3421078 sigma out 1act.( 22.6098003 sig in 11act.) RANK 11 NODE 1 --> 17.3227825 sigma out 1act.( 18.2994633 sig in 11act.) RANK 12 NODE 14 --> 13.6422997 sigma out 1act.( 13.7512865 sig in 11act.) RANK 13 NODE 12 --> 9.64267254 sigma out 1act.( 10.9468145 sig in 11act.) RANK 14 NODE 8 --> 6.04649401 sigma out 1act.( 6.69940233 sig in 11act.) RANK 15 NODE 3 --> 2.0023489 sigma out 1act.( 3.08332777 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 112.793762 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.553936958 *** contribution from regularisation: 0.00299742399 *** contribution from error: -0.556934357 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27567 Closing output file done