NNInput NNInputs_165.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 201495 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 56797 nbkg = 144698 Bkg Entries: 144698 Sig Entries: 56797 Chosen entries: 56797 Signal fraction: 1 Background fraction: 0.392521 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 144698 Actual Signal Entries: 56797 Entries to split: 56797 Test with : 28398 Train with : 28398 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 56797 for Signal Prepared event 0 for Signal with 56797 events ====Entry 0 Variable Ht : 267.874 Variable LepAPt : 45.292 Variable LepBPt : 35.604 Variable MetSigLeptonsJets : 7.24556 Variable MetSpec : 95.2083 Variable SumEtLeptonsJets : 172.666 Variable VSumJetLeptonsPt : 107.325 Variable addEt : 176.104 Variable dPhiLepSumMet : 2.28406 Variable dPhiLeptons : 0.0254087 Variable dRLeptons : 0.325152 Variable lep1_E : 46.0978 Variable lep2_E : 40.383 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2165 Ht = 267.874 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 45.2922 LepAPt = 45.292 LepBEt = 35.604 LepBPt = 35.604 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 95.2083 MetDelPhi = 2.19471 MetSig = 6.53886 MetSigLeptonsJets = 7.24556 MetSpec = 95.2083 Mjj = 0 MostCentralJetEta = -1.47546 MtllMet = 179.575 Njets = 1 SB = 0 SumEt = 212.005 SumEtJets = 0 SumEtLeptonsJets = 172.666 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 107.325 addEt = 176.104 dPhiLepSumMet = 2.28406 dPhiLeptons = 0.0254087 dRLeptons = 0.325152 diltype = 52 dimass = 13.1154 event = 77 jet1_Et = 91.7697 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.0978 lep2_E = 40.383 rand = 0.999742 run = 237144 weight = 3.96224e-06 ===Show End Prepared event 10000 for Signal with 56797 events Prepared event 20000 for Signal with 56797 events Prepared event 30000 for Signal with 56797 events Prepared event 40000 for Signal with 56797 events Prepared event 50000 for Signal with 56797 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 144698 for Background Prepared event 0 for Background with 144698 events ====Entry 0 Variable Ht : 79.7868 Variable LepAPt : 30.5457 Variable LepBPt : 11.4206 Variable MetSigLeptonsJets : 5.83799 Variable MetSpec : 37.8193 Variable SumEtLeptonsJets : 41.9663 Variable VSumJetLeptonsPt : 41.2152 Variable addEt : 79.7868 Variable dPhiLepSumMet : 2.89654 Variable dPhiLeptons : 0.426439 Variable dRLeptons : 0.500605 Variable lep1_E : 30.5607 Variable lep2_E : 11.7282 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 79.7868 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.546 LepAPt = 30.5457 LepBEt = 11.4214 LepBPt = 11.4206 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 37.8193 MetDelPhi = 2.58497 MetSig = 2.81024 MetSigLeptonsJets = 5.83799 MetSpec = 37.8193 Mjj = 0 MostCentralJetEta = 0 MtllMet = 80.0898 Njets = 0 SB = 0 SumEt = 181.11 SumEtJets = 0 SumEtLeptonsJets = 41.9663 Target = 0 TrainWeight = 4.7777 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.2152 addEt = 79.7868 dPhiLepSumMet = 2.89654 dPhiLeptons = 0.426439 dRLeptons = 0.500605 diltype = 41 dimass = 9.31149 event = 6639571 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 30.5607 lep2_E = 11.7282 rand = 0.999742 run = 271566 weight = 0.0404189 ===Show End Prepared event 10000 for Background with 144698 events Prepared event 20000 for Background with 144698 events Prepared event 30000 for Background with 144698 events Prepared event 40000 for Background with 144698 events Prepared event 50000 for Background with 144698 events Prepared event 60000 for Background with 144698 events Prepared event 70000 for Background with 144698 events Prepared event 80000 for Background with 144698 events Prepared event 90000 for Background with 144698 events Prepared event 100000 for Background with 144698 events Prepared event 110000 for Background with 144698 events Prepared event 120000 for Background with 144698 events Prepared event 130000 for Background with 144698 events Prepared event 140000 for Background with 144698 events Warning: found 4551 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 201495 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4551 negative weights. Signal fraction: 63.238327 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 62.3834381 64.8501053 66.7788239 68.0725098 68.9946289 70.2064362 70.9477692 71.7896271 72.8328552 73.6695557 74.3200684 75.0381851 75.6112976 76.2667694 76.9866409 77.4193115 78.0524292 78.7534637 79.3609619 79.8871307 80.6765289 81.3408051 82.2084198 82.9592133 83.8189468 84.7609024 85.8146667 87.0139389 88.4012375 89.8404388 91.5367737 92.9332275 94.7646332 96.3565369 98.0497131 99.7291718 101.31794 102.821228 104.456352 106.073944 107.806885 109.444923 111.381012 113.372574 114.926224 116.897324 118.899208 120.749527 122.723236 124.46991 126.14505 127.927666 129.470215 131.269379 132.976349 134.72612 136.436584 137.920959 139.423767 141.107849 142.675247 144.296295 145.779175 147.177795 148.632111 150.109802 151.554062 152.981155 154.357681 155.723328 157.075851 158.559662 160.000641 161.489883 163.12532 164.892975 166.812256 168.810562 170.874176 173.213135 175.748993 178.434601 180.920044 183.686005 186.92746 190.058868 193.40567 196.925018 200.810516 204.988892 209.824646 215.007294 221.180054 228.010071 235.970825 245.903564 258.62796 279.719482 312.284302 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0001068 20.3519669 20.6516571 20.9798622 21.2427788 21.4994431 21.7502556 21.9890957 22.207756 22.4599915 22.7075958 22.9217091 23.1512108 23.3540859 23.5949345 23.783741 24.0053291 24.2600098 24.5073433 24.7184029 24.9286213 25.1465912 25.3696213 25.6046467 25.8237095 26.0464096 26.2738838 26.5022068 26.7569752 26.9851837 27.207058 27.4390068 27.7040901 27.9268837 28.1427269 28.4072971 28.6701469 28.9062157 29.1641998 29.4508514 29.745121 30.0121727 30.3172417 30.6187534 30.9197159 31.2118721 31.4978065 31.7604485 32.0858078 32.3903503 32.6928139 32.9890747 33.3259659 33.6183777 33.9116669 34.2425194 34.5695648 34.9086304 35.2226143 35.5469284 35.8730431 36.1911545 36.4944992 36.8015137 37.1178665 37.477726 37.7799568 38.0938873 38.4206123 38.7544632 39.0890312 39.4213943 39.7741585 40.0936356 40.4869423 40.8507347 41.2354813 41.6363869 41.9648438 42.3596077 42.7996101 43.2539711 43.7057114 44.1987534 44.6778793 45.2431564 45.7663345 46.3304596 46.9340668 47.6455536 48.3017769 49.1351089 50.0855255 51.1666298 52.4190674 54.0156937 55.9056664 58.5976105 62.2296677 68.08461 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0002251 10.1276064 10.2727604 10.3784256 10.4727879 10.6037331 10.7444258 10.8542347 10.9835005 11.1050558 11.244813 11.3805599 11.5154228 11.6492443 11.78409 11.9397449 12.0813904 12.2608395 12.4104271 12.611104 12.7650852 12.9125147 13.1234398 13.353425 13.5220184 13.6907187 13.8724041 14.0902805 14.2934713 14.4857483 14.7111807 14.9232244 15.1375313 15.3559399 15.5219517 15.7803841 15.9985199 16.2785206 16.5307388 16.8065605 17.0474129 17.3377419 17.614315 17.9037132 18.2066727 18.4830856 18.7978592 19.1086502 19.3923817 19.7327881 20.0650387 20.3570232 20.6437054 20.9363098 21.2336388 21.5180397 21.8342838 22.1756229 22.4907379 22.866436 23.2151299 23.5731888 23.9286118 24.2958031 24.6583366 25.015522 25.3730278 25.7301598 26.0804691 26.4292889 26.812603 27.1819649 27.5465641 27.9108086 28.2691536 28.6413612 29.0129166 29.4067802 29.7972908 30.1797409 30.5500565 30.9455395 31.3426933 31.7353745 32.1764832 32.6190262 33.0153656 33.4448624 33.8828888 34.4096031 34.9430733 35.5135918 36.1061478 36.8003807 37.6144485 38.5409546 39.6722794 41.2048111 43.7534599 48.2312775 74.3131104 ------------------------------ Transdef: Tab for variable 5 1.14728987 2.65663338 3.04755259 3.32986164 3.62473893 3.82785225 4.02586937 4.16777563 4.30710983 4.43454742 4.54690933 4.6431942 4.75131989 4.82763767 4.932652 5.0119462 5.09045935 5.1535964 5.21598101 5.29094982 5.35640526 5.41471672 5.4666853 5.52445793 5.57703304 5.6284523 5.67380524 5.72861576 5.78100634 5.82611752 5.86858034 5.91395569 5.96379948 6.01188755 6.05380058 6.10147047 6.15071392 6.20260715 6.24202061 6.28062439 6.32357359 6.36511993 6.41159248 6.45252228 6.50532246 6.55472612 6.609972 6.65266418 6.70563602 6.75248337 6.79770994 6.83807278 6.88602352 6.94259262 6.99661064 7.04591846 7.1087904 7.16059256 7.21084023 7.26351309 7.31720257 7.37632132 7.42996502 7.49365139 7.55416489 7.61812878 7.68044376 7.73669052 7.79765034 7.86010742 7.92071915 7.97643042 8.04215336 8.09934711 8.16146183 8.21719265 8.27894211 8.34228706 8.40658379 8.47579193 8.54421043 8.6137867 8.67887306 8.74607468 8.80983734 8.88299942 8.95701218 9.03646851 9.12015533 9.20944214 9.30840874 9.41042614 9.53642273 9.67007256 9.82005405 10.0042648 10.2233915 10.5202637 10.9274397 11.6943245 19.6634274 ------------------------------ Transdef: Tab for variable 6 15.0039139 20.3539543 25.0802956 26.1817131 27.0058708 27.874321 28.8347549 29.5768394 30.4660931 31.1328735 31.8485928 32.4223557 32.9864655 33.4929352 34.0430756 34.4574203 34.7509499 35.1720085 35.6295586 36.0134659 36.3525543 36.7093887 37.064621 37.4499664 37.830513 38.1517487 38.5410042 38.9035187 39.2778091 39.6083069 40.0123062 40.401001 40.8257751 41.2120094 41.7399902 42.1918869 42.6905632 43.1104088 43.6067886 44.0908508 44.6979523 45.3487206 45.9898491 46.7124863 47.4577522 48.1208878 48.7972069 49.446373 50.229229 50.9660645 51.7485466 52.5301666 53.3601074 54.2733536 55.09095 55.854538 56.6643906 57.4767761 58.3438492 59.1906662 60.0800285 60.9829865 61.9112015 62.7398148 63.549057 64.399765 65.2582855 66.0718384 66.9208069 67.758728 68.5476456 69.3544159 70.199646 70.983078 71.8053894 72.6065674 73.4124146 74.1995926 74.9467316 75.7671204 76.5809555 77.4678345 78.2322235 79.1088257 79.9898529 80.9351578 81.8710022 82.8717651 83.962265 85.2655334 86.7012024 88.4638214 90.4864502 92.6449585 95.0192413 97.940239 101.716583 106.5215 113.921638 125.668655 289.142151 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.6468658 33.5877342 34.1755981 34.7933121 35.368576 35.8360405 36.2310944 36.6728134 37.0602341 37.4569168 37.7674713 38.0584755 38.3583412 38.6578102 38.9619255 39.2794037 39.5391006 39.8401947 40.1578522 40.5161743 40.9267807 41.3257446 41.7092667 42.0562668 42.5700111 43.1741219 43.8078804 44.5934448 45.1539116 45.937706 46.944191 47.8549347 48.8141098 49.7981644 50.8629379 51.9636688 52.9653358 53.9922943 55.0956306 56.0763168 57.1242104 58.1453094 58.9256783 59.8923035 60.9053497 61.8465385 62.7593765 63.7307243 64.6440277 65.6630707 66.5549622 67.4969635 68.4440765 69.2290192 70.1662521 71.0558777 71.9128265 72.7414093 73.5615387 74.3665924 75.2393341 76.1855316 76.9216614 77.7346039 78.6495667 79.5332794 80.5161133 81.6322021 82.7912827 83.9823761 85.3934326 86.8696594 88.4212036 89.8613434 91.5254364 93.1101227 94.6785583 96.4172974 98.3407669 100.1082 101.996872 104.048653 106.096291 108.240791 110.664436 113.250443 115.759621 118.835052 122.359131 126.050842 129.93576 134.453918 139.661469 145.272598 152.541748 161.413361 172.939041 189.443115 216.470062 471.948059 ------------------------------ Transdef: Tab for variable 8 0.172416463 24.9159069 29.0709343 31.0700188 32.0403976 32.7737465 33.3353806 33.8551331 34.2910271 34.7498589 35.1069031 35.4375839 35.8423347 36.1507416 36.4811096 36.7787018 37.0372086 37.3304596 37.5855255 37.8501053 38.1238327 38.386261 38.6433182 38.8922729 39.2342758 39.5070457 39.7528915 40.0560532 40.4290619 40.7713318 41.1238899 41.461647 41.822258 42.218895 42.6841965 43.1787872 43.712822 44.3627892 44.8798218 45.4692993 46.1013374 46.7541962 47.3947678 48.1943474 48.8493004 49.4230118 50.1548996 50.8720551 51.5522537 52.3538399 53.0671425 53.8076859 54.5971184 55.4192886 56.1518326 56.9536209 57.7229729 58.4455299 59.1852188 59.8844223 60.6475716 61.354557 62.1741028 62.9695244 63.7306366 64.4985809 65.2615204 65.9940033 66.6793671 67.4041748 68.1090012 68.8148651 69.5285187 70.2197952 70.9642792 71.7097702 72.4814453 73.1918488 73.9012222 74.6027069 75.3723297 76.1344147 76.8887024 77.7019043 78.5786133 79.3382416 80.2979126 81.4168243 82.5348206 83.8442078 85.3180389 86.9383545 88.9635239 91.2853622 93.8780212 97.2465668 101.066162 106.109512 113.602402 126.587791 326.868286 ------------------------------ Transdef: Tab for variable 9 47.1748543 61.9416275 64.1902771 66.0591125 67.468399 68.4589996 69.3657608 70.2598572 70.9460907 71.6948166 72.6371613 73.4120636 74.0054474 74.5889435 75.2960052 75.7139969 76.3216858 76.9518204 77.315506 77.8580399 78.4164581 78.9892044 79.5013962 79.9564056 80.593689 81.1778717 81.8525696 82.5791397 83.3162079 84.0456696 84.7821808 85.6981354 86.731575 87.74823 88.7810822 89.9929504 91.1861267 92.5026321 93.6793976 95.355278 96.7560272 98.1864624 99.6345825 101.053864 102.25882 103.730804 105.24762 106.592499 108.144516 109.547958 111.032135 112.574585 113.992142 115.335228 116.720322 118.183167 119.64753 120.986931 122.462265 123.812683 125.121002 126.524307 127.877136 129.194733 130.534088 131.803329 133.061615 134.312332 135.583984 136.920578 138.144928 139.377884 140.590668 141.896667 143.184845 144.472351 145.619659 146.78212 147.998505 149.160767 150.304352 151.450607 152.610016 153.655273 154.760345 155.844376 156.947021 158.085739 159.259094 160.422241 161.757904 163.231842 164.766296 166.473328 168.567154 170.783447 173.853394 177.998718 184.660858 198.185822 387.21228 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.15770113 1.44905257 1.65061522 1.7996521 1.9238348 2.01931238 2.10420179 2.17925882 2.23808575 2.29184055 2.33170033 2.37811375 2.41901231 2.4550252 2.48776436 2.51999712 2.54843569 2.57722545 2.60342836 2.62360096 2.64738035 2.66859555 2.68973041 2.71076345 2.72892523 2.74594474 2.76412058 2.779181 2.79498148 2.80783629 2.82065582 2.83086681 2.84239984 2.85326648 2.8626883 2.87211418 2.88137484 2.89050722 2.89955568 2.90847015 2.91662931 2.92437243 2.93215513 2.93976593 2.94726562 2.95308995 2.95968819 2.96577072 2.9725585 2.97781372 2.98345399 2.9883976 2.99299383 2.99830484 3.00310659 3.00741053 3.01203704 3.0162344 3.02083731 3.02515578 3.02883458 3.03306246 3.03692675 3.0407691 3.04401827 3.04796982 3.05146027 3.05507278 3.05858326 3.0620842 3.0653882 3.06822872 3.07116747 3.0741334 3.07674599 3.07980347 3.08269882 3.08592176 3.08864617 3.09163213 3.09439993 3.09678316 3.09930754 3.10177803 3.10420394 3.1069479 3.10958529 3.11235714 3.11475134 3.11726904 3.11982751 3.12235069 3.12489796 3.1273613 3.12965488 3.13203812 3.13454914 3.13685036 3.13914776 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00531351566 0.0111131668 0.0180791616 0.0245342255 0.0307583809 0.0386439264 0.045270443 0.0520843416 0.059088707 0.0658669472 0.0731929541 0.080040887 0.0868641138 0.0935380459 0.0987891555 0.106387034 0.112481594 0.118489608 0.124747396 0.131190062 0.137825608 0.144503355 0.15110682 0.157364517 0.163514629 0.168866038 0.174975395 0.180227041 0.186198652 0.191340089 0.196286082 0.200878382 0.204991817 0.20947063 0.213477254 0.217976928 0.222424626 0.2271263 0.232244253 0.236525416 0.241813004 0.246413946 0.251225621 0.255609393 0.260035396 0.26466167 0.269220948 0.274312496 0.278907895 0.283424258 0.287895441 0.293095052 0.298635632 0.3030321 0.308250725 0.31383729 0.319128036 0.324558496 0.330325127 0.335732818 0.341394186 0.34732163 0.352929056 0.359141886 0.364812464 0.370752573 0.376867086 0.383587599 0.389969051 0.396688342 0.403692961 0.410072207 0.416758418 0.423746586 0.430457473 0.438367367 0.446271479 0.453587562 0.461579561 0.470800012 0.479187012 0.488960743 0.498745084 0.508125305 0.517780185 0.527325988 0.538776755 0.550660312 0.563622117 0.578222632 0.594014883 0.609555244 0.628677726 0.645246148 0.665674925 0.696600735 0.721823096 0.768060088 0.821347833 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.207212061 0.213671923 0.219300002 0.226128429 0.232180968 0.237390906 0.242426559 0.247525603 0.253347397 0.258627027 0.263784468 0.26877147 0.27406913 0.279074132 0.284235299 0.289470255 0.294881314 0.299870133 0.305021822 0.309500456 0.314537644 0.319524884 0.324625164 0.329728425 0.334922403 0.339677155 0.344856322 0.349471331 0.354278147 0.359205961 0.364360809 0.369105339 0.374001652 0.378790736 0.384145677 0.389388353 0.394280434 0.399213374 0.403698623 0.407826841 0.411533803 0.415434718 0.419163048 0.423195839 0.427235842 0.430868268 0.434791863 0.438500464 0.4428249 0.447157025 0.451424122 0.456077218 0.460407853 0.464979976 0.469661295 0.473453492 0.477941692 0.482077807 0.486656874 0.490835011 0.495541751 0.500602126 0.505525112 0.510342896 0.516074657 0.521140337 0.52577579 0.531830668 0.537796259 0.543457687 0.549241006 0.555889726 0.561877608 0.568215251 0.575844467 0.582979321 0.59018743 0.597338796 0.605211675 0.613768876 0.621390343 0.629918277 0.638389826 0.647599876 0.65824306 0.665787458 0.675216913 0.684698045 0.697744668 0.708541989 0.720458627 0.73420167 0.748868048 0.761598825 0.776613176 0.797886729 0.826637983 0.86005801 0.904917002 1.14129901 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.664135 22.4664154 23.1798668 23.7322273 24.2903824 24.8335381 25.3356705 25.7575417 26.1764755 26.6636009 27.1055107 27.5043373 27.9618568 28.3638783 28.7751675 29.1783733 29.5049248 29.9597492 30.2539749 30.5828495 30.9127674 31.2429924 31.6221542 31.9385166 32.2978363 32.5574112 32.958786 33.3427429 33.7195892 34.1003494 34.4443512 34.7673569 35.1158104 35.47435 35.8079147 36.1725464 36.4325714 36.8207855 37.2131996 37.5883255 37.955513 38.3042068 38.6541824 39.0304832 39.4317245 39.7405548 40.1221771 40.4980774 40.8599167 41.245018 41.61409 42.0156784 42.4200096 42.8016396 43.1697426 43.5365486 43.9610672 44.3602295 44.7874794 45.2044907 45.6064987 46.0452538 46.4696121 46.8717728 47.2864685 47.7119598 48.152317 48.6021042 49.0832748 49.553196 50.0678482 50.5966225 51.0785599 51.6945114 52.3530273 52.9333992 53.640625 54.2501793 54.9641113 55.7108078 56.4309464 57.3432655 58.2470474 59.1112976 60.1410751 61.0927658 62.0800858 63.1567688 64.6015549 66.1800919 67.7529297 69.5426636 71.6765289 74.3562698 77.323349 80.5553589 85.0679626 91.216568 101.063423 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0116768 10.6833286 11.0962648 11.4341888 11.7289228 12.0736275 12.4156561 12.7664032 13.1194248 13.4804058 13.759551 14.0196743 14.3433094 14.6968184 14.9983711 15.2765417 15.5634995 15.8794518 16.2004623 16.5077782 16.8236294 17.1602287 17.4897575 17.7747116 18.1311874 18.4458103 18.7808838 19.080883 19.3473034 19.6825886 20.0134697 20.3569603 20.6663971 21.0616264 21.3875084 21.6863441 21.9996872 22.3568859 22.7473831 23.0826492 23.4495964 23.7678089 24.1352348 24.4800587 24.8256874 25.1735325 25.5317955 25.8591022 26.194603 26.5029182 26.8768959 27.2165833 27.5293579 27.8594341 28.1795692 28.5466156 28.9001007 29.2237473 29.5721169 29.9156971 30.2636452 30.6057281 30.9837818 31.3058167 31.5744076 31.8968391 32.2503624 32.6118736 32.9590149 33.3180885 33.6965675 34.0803032 34.4758759 34.8414307 35.2225418 35.6580963 36.0562859 36.4565735 36.8594055 37.3514328 37.8162956 38.2916946 38.7900848 39.3328896 39.97258 40.5169678 41.181427 41.851738 42.6073647 43.3431091 44.2171555 45.0502853 46.089798 47.4276047 48.7373352 50.6101685 52.78508 55.4398041 59.0963287 65.1968842 120.256287 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.9 54.3 58.1 35.5 53.7 65.8 59.2 67.8 -24.5 -18.5 -35.7 19.6 35.8 2 68.9 100.0 68.1 65.4 39.1 71.1 94.6 76.9 92.0 -43.0 -24.0 -45.5 34.2 43.6 3 54.3 68.1 100.0 54.0 12.4 36.7 71.6 55.6 72.8 -16.4 -25.7 -50.2 63.6 35.5 4 58.1 65.4 54.0 100.0 23.3 43.3 65.2 58.0 72.3 -10.4 -29.3 -57.4 26.6 76.2 5 35.5 39.1 12.4 23.3 100.0 85.2 12.2 60.2 59.6 23.2 -8.4 -13.3 -2.2 13.1 6 53.7 71.1 36.7 43.3 85.2 100.0 50.5 80.6 81.2 -6.7 -15.6 -28.0 12.5 27.4 7 65.8 94.6 71.6 65.2 12.2 50.5 100.0 68.2 80.9 -51.6 -23.2 -45.3 39.1 44.7 8 59.2 76.9 55.6 58.0 60.2 80.6 68.2 100.0 84.5 -9.6 -23.5 -40.2 26.9 39.6 9 67.8 92.0 72.8 72.3 59.6 81.2 80.9 84.5 100.0 -18.8 -26.6 -50.9 37.9 49.7 10 -24.5 -43.0 -16.4 -10.4 23.2 -6.7 -51.6 -9.6 -18.8 100.0 3.3 6.9 -6.4 -4.8 11 -18.5 -24.0 -25.7 -29.3 -8.4 -15.6 -23.2 -23.5 -26.6 3.3 100.0 54.5 -7.4 -18.1 12 -35.7 -45.5 -50.2 -57.4 -13.3 -28.0 -45.3 -40.2 -50.9 6.9 54.5 100.0 -20.8 -35.3 13 19.6 34.2 63.6 26.6 -2.2 12.5 39.1 26.9 37.9 -6.4 -7.4 -20.8 100.0 51.8 14 35.8 43.6 35.5 76.2 13.1 27.4 44.7 39.6 49.7 -4.8 -18.1 -35.3 51.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 177.568587 TOTAL CORRELATION OF ALL VARIABLES 75.5470633 ROUND 1: MAX CORR ( 75.5469958) AFTER KILLING INPUT VARIABLE 8 CONTR 0.100961611 ROUND 2: MAX CORR ( 75.5441922) AFTER KILLING INPUT VARIABLE 11 CONTR 0.650852526 ROUND 3: MAX CORR ( 75.5411153) AFTER KILLING INPUT VARIABLE 14 CONTR 0.681818378 ROUND 4: MAX CORR ( 75.5364462) AFTER KILLING INPUT VARIABLE 6 CONTR 0.839880043 ROUND 5: MAX CORR ( 75.5212572) AFTER KILLING INPUT VARIABLE 2 CONTR 1.51473154 ROUND 6: MAX CORR ( 75.3992685) AFTER KILLING INPUT VARIABLE 12 CONTR 4.29075702 ROUND 7: MAX CORR ( 75.1985175) AFTER KILLING INPUT VARIABLE 10 CONTR 5.49842266 ROUND 8: MAX CORR ( 74.5145643) AFTER KILLING INPUT VARIABLE 13 CONTR 10.1191279 ROUND 9: MAX CORR ( 73.2196597) AFTER KILLING INPUT VARIABLE 9 CONTR 13.8311866 ROUND 10: MAX CORR ( 72.8915029) AFTER KILLING INPUT VARIABLE 3 CONTR 6.92440358 ROUND 11: MAX CORR ( 71.3957609) AFTER KILLING INPUT VARIABLE 4 CONTR 14.6906954 ROUND 12: MAX CORR ( 65.8094336) AFTER KILLING INPUT VARIABLE 5 CONTR 27.685251 LAST REMAINING VARIABLE: 7 total correlation to target: 75.5470633 % total significance: 160.717143 sigma correlations of single variables to target: variable 2: 68.8962488 % , in sigma: 146.568348 variable 3: 54.2796842 % , in sigma: 115.473393 variable 4: 58.1076303 % , in sigma: 123.616881 variable 5: 35.5044729 % , in sigma: 75.5314262 variable 6: 53.7394655 % , in sigma: 114.324144 variable 7: 65.8094336 % , in sigma: 140.001526 variable 8: 59.2036481 % , in sigma: 125.948525 variable 9: 67.7968709 % , in sigma: 144.229556 variable 10: -24.4639416 % , in sigma: 52.0440454 variable 11: -18.4694769 % , in sigma: 39.2915545 variable 12: -35.6811009 % , in sigma: 75.9071806 variable 13: 19.6422291 % , in sigma: 41.7864415 variable 14: 35.800811 % , in sigma: 76.1618493 variables sorted by significance: 1 most relevant variable 7 corr 65.809433 , in sigma: 140.001524 2 most relevant variable 5 corr 27.6852512 , in sigma: 58.8969879 3 most relevant variable 4 corr 14.6906958 , in sigma: 31.2526595 4 most relevant variable 3 corr 6.92440367 , in sigma: 14.7308224 5 most relevant variable 9 corr 13.8311863 , in sigma: 29.4241582 6 most relevant variable 13 corr 10.1191282 , in sigma: 21.5272084 7 most relevant variable 10 corr 5.49842262 , in sigma: 11.697222 8 most relevant variable 12 corr 4.29075718 , in sigma: 9.12806142 9 most relevant variable 2 corr 1.51473153 , in sigma: 3.22240617 10 most relevant variable 6 corr 0.839880049 , in sigma: 1.78674214 11 most relevant variable 14 corr 0.681818366 , in sigma: 1.45048523 12 most relevant variable 11 corr 0.650852501 , in sigma: 1.38460914 13 most relevant variable 8 corr 0.100961611 , in sigma: 0.214783486 global correlations between input variables: variable 2: 99.1960819 % variable 3: 92.3369737 % variable 4: 92.9766887 % variable 5: 95.3810266 % variable 6: 95.4561393 % variable 7: 98.8307931 % variable 8: 90.2196084 % variable 9: 98.6751656 % variable 10: 72.1556711 % variable 11: 55.3446531 % variable 12: 72.7343928 % variable 13: 84.94937 % variable 14: 89.5002843 % significance loss when removing single variables: variable 2: corr = 1.54606429 % , sigma = 3.2890628 variable 3: corr = 16.2158512 % , sigma = 34.4972414 variable 4: corr = 12.4752101 % , sigma = 26.5394845 variable 5: corr = 16.8995868 % , sigma = 35.9518051 variable 6: corr = 0.825772489 % , sigma = 1.75673003 variable 7: corr = 8.56621322 % , sigma = 18.2235715 variable 8: corr = 0.100961611 % , sigma = 0.214783486 variable 9: corr = 11.2616089 % , sigma = 23.9576963 variable 10: corr = 5.05776572 % , sigma = 10.7597783 variable 11: corr = 0.656359024 % , sigma = 1.39632359 variable 12: corr = 3.4982502 % , sigma = 7.44209969 variable 13: corr = 7.77926057 % , sigma = 16.549426 variable 14: corr = 0.718649688 % , sigma = 1.52883937 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 24.5123577 sigma out 15 active outputs RANK 2 NODE 5 --> 23.3034325 sigma out 15 active outputs RANK 3 NODE 6 --> 22.067564 sigma out 15 active outputs RANK 4 NODE 1 --> 19.656786 sigma out 15 active outputs RANK 5 NODE 2 --> 19.643816 sigma out 15 active outputs RANK 6 NODE 3 --> 19.2300034 sigma out 15 active outputs RANK 7 NODE 4 --> 17.910965 sigma out 15 active outputs RANK 8 NODE 8 --> 16.1919136 sigma out 15 active outputs RANK 9 NODE 7 --> 15.0305557 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 30.3810406 sigma in 9act. ( 31.6456909 sig out 1act.) RANK 2 NODE 1 --> 25.1233253 sigma in 9act. ( 31.1606407 sig out 1act.) RANK 3 NODE 7 --> 22.4081898 sigma in 9act. ( 23.4269161 sig out 1act.) RANK 4 NODE 9 --> 19.7303028 sigma in 9act. ( 23.8388634 sig out 1act.) RANK 5 NODE 13 --> 19.4928284 sigma in 9act. ( 18.828392 sig out 1act.) RANK 6 NODE 14 --> 15.5007563 sigma in 9act. ( 20.4586792 sig out 1act.) RANK 7 NODE 6 --> 11.2219181 sigma in 9act. ( 10.5132961 sig out 1act.) RANK 8 NODE 3 --> 10.4011717 sigma in 9act. ( 10.7690296 sig out 1act.) RANK 9 NODE 8 --> 10.0541 sigma in 9act. ( 9.29243374 sig out 1act.) RANK 10 NODE 4 --> 9.37746429 sigma in 9act. ( 12.081686 sig out 1act.) RANK 11 NODE 10 --> 7.26133013 sigma in 9act. ( 6.46333075 sig out 1act.) RANK 12 NODE 2 --> 4.35933733 sigma in 9act. ( 2.39707327 sig out 1act.) RANK 13 NODE 11 --> 3.96231055 sigma in 9act. ( 7.75829411 sig out 1act.) RANK 14 NODE 5 --> 1.85596693 sigma in 9act. ( 2.75983977 sig out 1act.) RANK 15 NODE 12 --> 1.40915275 sigma in 9act. ( 1.30715132 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 31.6456909 sigma out 1act.( 30.3810406 sig in 9act.) RANK 2 NODE 1 --> 31.1606407 sigma out 1act.( 25.1233253 sig in 9act.) RANK 3 NODE 9 --> 23.8388634 sigma out 1act.( 19.7303028 sig in 9act.) RANK 4 NODE 7 --> 23.4269161 sigma out 1act.( 22.4081898 sig in 9act.) RANK 5 NODE 14 --> 20.4586792 sigma out 1act.( 15.5007563 sig in 9act.) RANK 6 NODE 13 --> 18.828392 sigma out 1act.( 19.4928284 sig in 9act.) RANK 7 NODE 4 --> 12.081686 sigma out 1act.( 9.37746429 sig in 9act.) RANK 8 NODE 3 --> 10.7690296 sigma out 1act.( 10.4011717 sig in 9act.) RANK 9 NODE 6 --> 10.5132961 sigma out 1act.( 11.2219181 sig in 9act.) RANK 10 NODE 8 --> 9.29243374 sigma out 1act.( 10.0541 sig in 9act.) RANK 11 NODE 11 --> 7.75829411 sigma out 1act.( 3.96231055 sig in 9act.) RANK 12 NODE 10 --> 6.46333075 sigma out 1act.( 7.26133013 sig in 9act.) RANK 13 NODE 5 --> 2.75983977 sigma out 1act.( 1.85596693 sig in 9act.) RANK 14 NODE 2 --> 2.39707327 sigma out 1act.( 4.35933733 sig in 9act.) RANK 15 NODE 12 --> 1.30715132 sigma out 1act.( 1.40915275 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.6218338 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 26.0666885 sigma out 15 active outputs RANK 2 NODE 9 --> 24.6431236 sigma out 15 active outputs RANK 3 NODE 5 --> 23.3160648 sigma out 15 active outputs RANK 4 NODE 1 --> 23.0641613 sigma out 15 active outputs RANK 5 NODE 6 --> 21.4690895 sigma out 15 active outputs RANK 6 NODE 3 --> 20.4254436 sigma out 15 active outputs RANK 7 NODE 4 --> 19.42556 sigma out 15 active outputs RANK 8 NODE 8 --> 17.0926018 sigma out 15 active outputs RANK 9 NODE 7 --> 15.3120861 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 28.1209126 sigma in 9act. ( 28.8842602 sig out 1act.) RANK 2 NODE 7 --> 25.8677959 sigma in 9act. ( 23.6767673 sig out 1act.) RANK 3 NODE 1 --> 25.7824364 sigma in 9act. ( 28.1164513 sig out 1act.) RANK 4 NODE 9 --> 23.6122665 sigma in 9act. ( 22.342308 sig out 1act.) RANK 5 NODE 14 --> 18.5605907 sigma in 9act. ( 18.434906 sig out 1act.) RANK 6 NODE 13 --> 16.4264526 sigma in 9act. ( 15.7973585 sig out 1act.) RANK 7 NODE 11 --> 11.9606228 sigma in 9act. ( 8.09046078 sig out 1act.) RANK 8 NODE 4 --> 11.8017454 sigma in 9act. ( 11.6521406 sig out 1act.) RANK 9 NODE 8 --> 11.1333942 sigma in 9act. ( 8.1805191 sig out 1act.) RANK 10 NODE 3 --> 10.7633305 sigma in 9act. ( 9.73093414 sig out 1act.) RANK 11 NODE 5 --> 10.5772991 sigma in 9act. ( 6.45230103 sig out 1act.) RANK 12 NODE 6 --> 8.93175983 sigma in 9act. ( 8.33399773 sig out 1act.) RANK 13 NODE 10 --> 7.57680511 sigma in 9act. ( 5.52216768 sig out 1act.) RANK 14 NODE 12 --> 6.92908859 sigma in 9act. ( 2.17645621 sig out 1act.) RANK 15 NODE 2 --> 5.35718822 sigma in 9act. ( 1.87277126 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 28.8842602 sigma out 1act.( 28.1209126 sig in 9act.) RANK 2 NODE 1 --> 28.1164513 sigma out 1act.( 25.7824364 sig in 9act.) RANK 3 NODE 7 --> 23.6767673 sigma out 1act.( 25.8677959 sig in 9act.) RANK 4 NODE 9 --> 22.342308 sigma out 1act.( 23.6122665 sig in 9act.) RANK 5 NODE 14 --> 18.434906 sigma out 1act.( 18.5605907 sig in 9act.) RANK 6 NODE 13 --> 15.7973585 sigma out 1act.( 16.4264526 sig in 9act.) RANK 7 NODE 4 --> 11.6521406 sigma out 1act.( 11.8017454 sig in 9act.) RANK 8 NODE 3 --> 9.73093414 sigma out 1act.( 10.7633305 sig in 9act.) RANK 9 NODE 6 --> 8.33399773 sigma out 1act.( 8.93175983 sig in 9act.) RANK 10 NODE 8 --> 8.1805191 sigma out 1act.( 11.1333942 sig in 9act.) RANK 11 NODE 11 --> 8.09046078 sigma out 1act.( 11.9606228 sig in 9act.) RANK 12 NODE 5 --> 6.45230103 sigma out 1act.( 10.5772991 sig in 9act.) RANK 13 NODE 10 --> 5.52216768 sigma out 1act.( 7.57680511 sig in 9act.) RANK 14 NODE 12 --> 2.17645621 sigma out 1act.( 6.92908859 sig in 9act.) RANK 15 NODE 2 --> 1.87277126 sigma out 1act.( 5.35718822 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.5359421 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.430377394 *** contribution from regularisation: 0.00342225307 *** contribution from error: -0.433799654 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.485867828 *** contribution from regularisation: 0.00214213901 *** contribution from error: -0.488009959 *********************************************** -----------------> Test sample ENTER BFGS code START -48959.8006 0.222192943 0.0969376564 EXIT FROM BFGS code FG_START 0. 0.222192943 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.512006402 *** contribution from regularisation: 0.00213800231 *** contribution from error: -0.514144421 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -51583.1107 0.222192943 22.1296539 EXIT FROM BFGS code FG_LNSRCH 0. 0.225310653 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.555068195 *** contribution from regularisation: 0.00266954629 *** contribution from error: -0.557737768 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55921.4578 0.225310653 9.8486414 EXIT FROM BFGS code NEW_X -55921.4578 0.225310653 9.8486414 ENTER BFGS code NEW_X -55921.4578 0.225310653 9.8486414 EXIT FROM BFGS code FG_LNSRCH 0. 0.22723639 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.558709085 *** contribution from regularisation: 0.00274265232 *** contribution from error: -0.561451733 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56288.2619 0.22723639 2.74708843 EXIT FROM BFGS code NEW_X -56288.2619 0.22723639 2.74708843 ENTER BFGS code NEW_X -56288.2619 0.22723639 2.74708843 EXIT FROM BFGS code FG_LNSRCH 0. 0.228111148 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.560289741 *** contribution from regularisation: 0.00262562488 *** contribution from error: -0.562915385 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56447.509 0.228111148 -6.6965661 EXIT FROM BFGS code NEW_X -56447.509 0.228111148 -6.6965661 ENTER BFGS code NEW_X -56447.509 0.228111148 -6.6965661 EXIT FROM BFGS code FG_LNSRCH 0. 0.22502017 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.560629785 *** contribution from regularisation: 0.00250707543 *** contribution from error: -0.563136876 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56481.7703 0.22502017 -3.28088188 EXIT FROM BFGS code NEW_X -56481.7703 0.22502017 -3.28088188 ENTER BFGS code NEW_X -56481.7703 0.22502017 -3.28088188 EXIT FROM BFGS code FG_LNSRCH 0. 0.224460334 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.560825229 *** contribution from regularisation: 0.0024832848 *** contribution from error: -0.563308537 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56501.461 0.224460334 -4.74875593 EXIT FROM BFGS code NEW_X -56501.461 0.224460334 -4.74875593 ENTER BFGS code NEW_X -56501.461 0.224460334 -4.74875593 EXIT FROM BFGS code FG_LNSRCH 0. 0.221674189 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.561028838 *** contribution from regularisation: 0.00246456312 *** contribution from error: -0.563493431 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56521.9702 0.221674189 -5.94129848 EXIT FROM BFGS code NEW_X -56521.9702 0.221674189 -5.94129848 ENTER BFGS code NEW_X -56521.9702 0.221674189 -5.94129848 EXIT FROM BFGS code FG_LNSRCH 0. 0.208759934 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 43.7137794 sigma out 15 active outputs RANK 2 NODE 1 --> 29.130125 sigma out 15 active outputs RANK 3 NODE 8 --> 23.3604183 sigma out 15 active outputs RANK 4 NODE 9 --> 21.0106239 sigma out 15 active outputs RANK 5 NODE 4 --> 19.3936939 sigma out 15 active outputs RANK 6 NODE 3 --> 17.7108955 sigma out 15 active outputs RANK 7 NODE 5 --> 16.5397472 sigma out 15 active outputs RANK 8 NODE 7 --> 15.9616222 sigma out 15 active outputs RANK 9 NODE 6 --> 13.1009722 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 32.196804 sigma in 9act. ( 31.0910645 sig out 1act.) RANK 2 NODE 5 --> 29.6431522 sigma in 9act. ( 21.6970005 sig out 1act.) RANK 3 NODE 11 --> 27.232935 sigma in 9act. ( 23.1982651 sig out 1act.) RANK 4 NODE 9 --> 24.2786732 sigma in 9act. ( 19.303257 sig out 1act.) RANK 5 NODE 14 --> 20.1423855 sigma in 9act. ( 17.7356491 sig out 1act.) RANK 6 NODE 1 --> 20.0032253 sigma in 9act. ( 17.7808723 sig out 1act.) RANK 7 NODE 12 --> 18.9925938 sigma in 9act. ( 13.0864964 sig out 1act.) RANK 8 NODE 4 --> 13.5083752 sigma in 9act. ( 11.2548304 sig out 1act.) RANK 9 NODE 15 --> 13.0853224 sigma in 9act. ( 13.9983206 sig out 1act.) RANK 10 NODE 8 --> 11.745719 sigma in 9act. ( 9.49585247 sig out 1act.) RANK 11 NODE 3 --> 8.33668232 sigma in 9act. ( 8.56114292 sig out 1act.) RANK 12 NODE 13 --> 8.23880005 sigma in 9act. ( 6.95229912 sig out 1act.) RANK 13 NODE 10 --> 6.58419371 sigma in 9act. ( 5.02818298 sig out 1act.) RANK 14 NODE 6 --> 6.04697323 sigma in 9act. ( 4.75811672 sig out 1act.) RANK 15 NODE 2 --> 3.79703307 sigma in 9act. ( 1.86711276 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 31.0910645 sigma out 1act.( 32.196804 sig in 9act.) RANK 2 NODE 11 --> 23.1982651 sigma out 1act.( 27.232935 sig in 9act.) RANK 3 NODE 5 --> 21.6970005 sigma out 1act.( 29.6431522 sig in 9act.) RANK 4 NODE 9 --> 19.303257 sigma out 1act.( 24.2786732 sig in 9act.) RANK 5 NODE 1 --> 17.7808723 sigma out 1act.( 20.0032253 sig in 9act.) RANK 6 NODE 14 --> 17.7356491 sigma out 1act.( 20.1423855 sig in 9act.) RANK 7 NODE 15 --> 13.9983206 sigma out 1act.( 13.0853224 sig in 9act.) RANK 8 NODE 12 --> 13.0864964 sigma out 1act.( 18.9925938 sig in 9act.) RANK 9 NODE 4 --> 11.2548304 sigma out 1act.( 13.5083752 sig in 9act.) RANK 10 NODE 8 --> 9.49585247 sigma out 1act.( 11.745719 sig in 9act.) RANK 11 NODE 3 --> 8.56114292 sigma out 1act.( 8.33668232 sig in 9act.) RANK 12 NODE 13 --> 6.95229912 sigma out 1act.( 8.23880005 sig in 9act.) RANK 13 NODE 10 --> 5.02818298 sigma out 1act.( 6.58419371 sig in 9act.) RANK 14 NODE 6 --> 4.75811672 sigma out 1act.( 6.04697323 sig in 9act.) RANK 15 NODE 2 --> 1.86711276 sigma out 1act.( 3.79703307 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.1227417 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.561677754 *** contribution from regularisation: 0.00241375179 *** contribution from error: -0.564091504 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56587.349 0.208759934 -11.5174265 EXIT FROM BFGS code NEW_X -56587.349 0.208759934 -11.5174265 ENTER BFGS code NEW_X -56587.349 0.208759934 -11.5174265 EXIT FROM BFGS code FG_LNSRCH 0. 0.179048613 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.562613308 *** contribution from regularisation: 0.0025113523 *** contribution from error: -0.565124691 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56681.6005 0.179048613 -19.2418079 EXIT FROM BFGS code NEW_X -56681.6005 0.179048613 -19.2418079 ENTER BFGS code NEW_X -56681.6005 0.179048613 -19.2418079 EXIT FROM BFGS code FG_LNSRCH 0. 0.131143525 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.56292206 *** contribution from regularisation: 0.00289623835 *** contribution from error: -0.56581831 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56712.7109 0.131143525 49.0747108 EXIT FROM BFGS code FG_LNSRCH 0. 0.153994262 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.563677847 *** contribution from regularisation: 0.00225883792 *** contribution from error: -0.565936685 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56788.8536 0.153994262 7.75117254 EXIT FROM BFGS code NEW_X -56788.8536 0.153994262 7.75117254 ENTER BFGS code NEW_X -56788.8536 0.153994262 7.75117254 EXIT FROM BFGS code FG_LNSRCH 0. 0.150615841 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.563603044 *** contribution from regularisation: 0.00259497738 *** contribution from error: -0.566197991 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56781.317 0.150615841 5.6550355 EXIT FROM BFGS code FG_LNSRCH 0. 0.153334424 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.563546956 *** contribution from regularisation: 0.00245801103 *** contribution from error: -0.566004992 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56775.6669 0.153334424 7.42930746 EXIT FROM BFGS code FG_LNSRCH 0. 0.153959364 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.563439369 *** contribution from regularisation: 0.00250084302 *** contribution from error: -0.565940201 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56764.8283 0.153959364 7.81660938 EXIT FROM BFGS code FG_LNSRCH 0. 0.153994188 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.563425899 *** contribution from regularisation: 0.00251079747 *** contribution from error: -0.565936685 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56763.4694 0.153994188 7.86599684 EXIT FROM BFGS code FG_LNSRCH 0. 0.153994262 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.563427746 *** contribution from regularisation: 0.00250894227 *** contribution from error: -0.565936685 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56763.6563 0.153994262 7.89646435 EXIT FROM BFGS code FG_LNSRCH 0. 0.153994262 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.563438594 *** contribution from regularisation: 0.00249810237 *** contribution from error: -0.565936685 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56764.7484 0.153994262 7.86783981 EXIT FROM BFGS code FG_LNSRCH 0. 0.153994262 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 47.2184296 sigma out 15 active outputs RANK 2 NODE 1 --> 27.850811 sigma out 15 active outputs RANK 3 NODE 4 --> 26.6352081 sigma out 15 active outputs RANK 4 NODE 8 --> 25.1844482 sigma out 15 active outputs RANK 5 NODE 7 --> 24.0280972 sigma out 15 active outputs RANK 6 NODE 5 --> 23.5413303 sigma out 15 active outputs RANK 7 NODE 9 --> 21.5402699 sigma out 15 active outputs RANK 8 NODE 3 --> 17.1485176 sigma out 15 active outputs RANK 9 NODE 6 --> 12.8138227 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 46.1193542 sigma in 9act. ( 47.8022728 sig out 1act.) RANK 2 NODE 11 --> 32.7479172 sigma in 9act. ( 32.1953163 sig out 1act.) RANK 3 NODE 5 --> 31.0013504 sigma in 9act. ( 27.6230965 sig out 1act.) RANK 4 NODE 1 --> 25.5290108 sigma in 9act. ( 23.2536964 sig out 1act.) RANK 5 NODE 9 --> 21.1000557 sigma in 9act. ( 23.7752647 sig out 1act.) RANK 6 NODE 14 --> 19.3615685 sigma in 9act. ( 17.1716022 sig out 1act.) RANK 7 NODE 12 --> 18.1222801 sigma in 9act. ( 12.7628355 sig out 1act.) RANK 8 NODE 4 --> 11.3348637 sigma in 9act. ( 9.17254162 sig out 1act.) RANK 9 NODE 8 --> 9.76163292 sigma in 9act. ( 8.62931252 sig out 1act.) RANK 10 NODE 15 --> 8.96846581 sigma in 9act. ( 8.19760895 sig out 1act.) RANK 11 NODE 3 --> 6.5200243 sigma in 9act. ( 5.19348955 sig out 1act.) RANK 12 NODE 13 --> 5.77445316 sigma in 9act. ( 4.2835288 sig out 1act.) RANK 13 NODE 10 --> 4.86790752 sigma in 9act. ( 3.73191881 sig out 1act.) RANK 14 NODE 6 --> 4.41700315 sigma in 9act. ( 3.35281491 sig out 1act.) RANK 15 NODE 2 --> 4.32813501 sigma in 9act. ( 3.74366045 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 47.8022728 sigma out 1act.( 46.1193542 sig in 9act.) RANK 2 NODE 11 --> 32.1953163 sigma out 1act.( 32.7479172 sig in 9act.) RANK 3 NODE 5 --> 27.6230965 sigma out 1act.( 31.0013504 sig in 9act.) RANK 4 NODE 9 --> 23.7752647 sigma out 1act.( 21.1000557 sig in 9act.) RANK 5 NODE 1 --> 23.2536964 sigma out 1act.( 25.5290108 sig in 9act.) RANK 6 NODE 14 --> 17.1716022 sigma out 1act.( 19.3615685 sig in 9act.) RANK 7 NODE 12 --> 12.7628355 sigma out 1act.( 18.1222801 sig in 9act.) RANK 8 NODE 4 --> 9.17254162 sigma out 1act.( 11.3348637 sig in 9act.) RANK 9 NODE 8 --> 8.62931252 sigma out 1act.( 9.76163292 sig in 9act.) RANK 10 NODE 15 --> 8.19760895 sigma out 1act.( 8.96846581 sig in 9act.) RANK 11 NODE 3 --> 5.19348955 sigma out 1act.( 6.5200243 sig in 9act.) RANK 12 NODE 13 --> 4.2835288 sigma out 1act.( 5.77445316 sig in 9act.) RANK 13 NODE 2 --> 3.74366045 sigma out 1act.( 4.32813501 sig in 9act.) RANK 14 NODE 10 --> 3.73191881 sigma out 1act.( 4.86790752 sig in 9act.) RANK 15 NODE 6 --> 3.35281491 sigma out 1act.( 4.41700315 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 77.192543 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.563421249 *** contribution from regularisation: 0.00251542195 *** contribution from error: -0.565936685 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56763.0035 0.153994262 7.91188431 EXIT FROM BFGS code NEW_X -56763.0035 0.153994262 7.91188431 ENTER BFGS code NEW_X -56763.0035 0.153994262 7.91188431 EXIT FROM BFGS code CONVERGENC -56763.0035 0.153994262 7.91188431 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 69.0141068 sigma out 15 active outputs RANK 2 NODE 1 --> 41.1663971 sigma out 15 active outputs RANK 3 NODE 4 --> 40.1164169 sigma out 15 active outputs RANK 4 NODE 8 --> 37.0407028 sigma out 15 active outputs RANK 5 NODE 7 --> 35.658535 sigma out 15 active outputs RANK 6 NODE 5 --> 34.7870674 sigma out 15 active outputs RANK 7 NODE 9 --> 32.345871 sigma out 15 active outputs RANK 8 NODE 3 --> 26.0664577 sigma out 15 active outputs RANK 9 NODE 6 --> 18.1052742 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 69.2132034 sigma in 9act. ( 71.2761917 sig out 1act.) RANK 2 NODE 11 --> 47.8755035 sigma in 9act. ( 48.7282295 sig out 1act.) RANK 3 NODE 5 --> 45.8310547 sigma in 9act. ( 40.9614868 sig out 1act.) RANK 4 NODE 1 --> 38.1522331 sigma in 9act. ( 34.4513016 sig out 1act.) RANK 5 NODE 9 --> 31.1361923 sigma in 9act. ( 35.7086105 sig out 1act.) RANK 6 NODE 14 --> 28.3869038 sigma in 9act. ( 25.8666668 sig out 1act.) RANK 7 NODE 12 --> 26.5036335 sigma in 9act. ( 19.1164436 sig out 1act.) RANK 8 NODE 4 --> 16.4736748 sigma in 9act. ( 13.7614174 sig out 1act.) RANK 9 NODE 8 --> 13.7809315 sigma in 9act. ( 12.9921236 sig out 1act.) RANK 10 NODE 15 --> 12.2079849 sigma in 9act. ( 12.3100672 sig out 1act.) RANK 11 NODE 3 --> 8.5767746 sigma in 9act. ( 7.80602503 sig out 1act.) RANK 12 NODE 13 --> 8.08275318 sigma in 9act. ( 6.36085033 sig out 1act.) RANK 13 NODE 10 --> 6.321064 sigma in 9act. ( 5.56303453 sig out 1act.) RANK 14 NODE 6 --> 5.90800047 sigma in 9act. ( 4.87832308 sig out 1act.) RANK 15 NODE 2 --> 5.80799103 sigma in 9act. ( 5.50594091 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 71.2761917 sigma out 1act.( 69.2132034 sig in 9act.) RANK 2 NODE 11 --> 48.7282295 sigma out 1act.( 47.8755035 sig in 9act.) RANK 3 NODE 5 --> 40.9614868 sigma out 1act.( 45.8310547 sig in 9act.) RANK 4 NODE 9 --> 35.7086105 sigma out 1act.( 31.1361923 sig in 9act.) RANK 5 NODE 1 --> 34.4513016 sigma out 1act.( 38.1522331 sig in 9act.) RANK 6 NODE 14 --> 25.8666668 sigma out 1act.( 28.3869038 sig in 9act.) RANK 7 NODE 12 --> 19.1164436 sigma out 1act.( 26.5036335 sig in 9act.) RANK 8 NODE 4 --> 13.7614174 sigma out 1act.( 16.4736748 sig in 9act.) RANK 9 NODE 8 --> 12.9921236 sigma out 1act.( 13.7809315 sig in 9act.) RANK 10 NODE 15 --> 12.3100672 sigma out 1act.( 12.2079849 sig in 9act.) RANK 11 NODE 3 --> 7.80602503 sigma out 1act.( 8.5767746 sig in 9act.) RANK 12 NODE 13 --> 6.36085033 sigma out 1act.( 8.08275318 sig in 9act.) RANK 13 NODE 10 --> 5.56303453 sigma out 1act.( 6.321064 sig in 9act.) RANK 14 NODE 2 --> 5.50594091 sigma out 1act.( 5.80799103 sig in 9act.) RANK 15 NODE 6 --> 4.87832308 sigma out 1act.( 5.90800047 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 115.435104 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.563436985 *** contribution from regularisation: 0.00249970634 *** contribution from error: -0.565936685 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done