NNInput NNInputs_190.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 72021 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 13331 nbkg = 58690 Bkg Entries: 58690 Sig Entries: 13331 Chosen entries: 13331 Signal fraction: 1 Background fraction: 0.227143 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 58690 Actual Signal Entries: 13331 Entries to split: 13331 Test with : 6665 Train with : 6665 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 13331 for Signal Prepared event 0 for Signal with 13331 events ====Entry 0 Variable Ht : 195.721 Variable LepAPt : 24.9994 Variable LepBPt : 11.8764 Variable MetSigLeptonsJets : 7.91886 Variable MetSpec : 83.7822 Variable SumEtLeptonsJets : 111.938 Variable VSumJetLeptonsPt : 77.0354 Variable addEt : 120.658 Variable dPhiLepSumMet : 2.23519 Variable dPhiLeptons : 0.560132 Variable dRLeptons : 0.584458 Variable lep1_E : 30.9083 Variable lep2_E : 13.4408 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2190 Ht = 195.72 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 24.9996 LepAPt = 24.9994 LepBEt = 11.8764 LepBPt = 11.8764 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 83.7822 MetDelPhi = 1.85313 MetSig = 5.64184 MetSigLeptonsJets = 7.91886 MetSpec = 83.7822 Mjj = 0 MostCentralJetEta = 1.62985 MtllMet = 125.773 Njets = 1 SB = 0 SumEt = 220.527 SumEtJets = 0 SumEtLeptonsJets = 111.938 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 77.0354 addEt = 120.658 dPhiLepSumMet = 2.23519 dPhiLeptons = 0.560132 dRLeptons = 0.584458 diltype = 49 dimass = 9.9527 event = 263 jet1_Et = 75.0623 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 30.9083 lep2_E = 13.4408 rand = 0.999742 run = 228406 weight = 2.09015e-06 ===Show End Prepared event 10000 for Signal with 13331 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 58690 for Background Prepared event 0 for Background with 58690 events ====Entry 0 Variable Ht : 65.1543 Variable LepAPt : 20.8407 Variable LepBPt : 10.82 Variable MetSigLeptonsJets : 5.95247 Variable MetSpec : 33.4933 Variable SumEtLeptonsJets : 31.6607 Variable VSumJetLeptonsPt : 31.4507 Variable addEt : 65.1543 Variable dPhiLepSumMet : 3.01433 Variable dPhiLeptons : 0.243032 Variable dRLeptons : 0.763155 Variable lep1_E : 24.0883 Variable lep2_E : 10.9808 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 65.1543 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 20.8411 LepAPt = 20.8407 LepBEt = 10.82 LepBPt = 10.82 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 33.4933 MetDelPhi = 2.93145 MetSig = 3.89076 MetSigLeptonsJets = 5.95247 MetSpec = 33.4933 Mjj = 0 MostCentralJetEta = 0 MtllMet = 67.7985 Njets = 0 SB = 0 SumEt = 74.1048 SumEtJets = 0 SumEtLeptonsJets = 31.6607 Target = 0 TrainWeight = 0.666355 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 31.4507 addEt = 65.1543 dPhiLepSumMet = 3.01433 dPhiLeptons = 0.243032 dRLeptons = 0.763155 diltype = 110 dimass = 11.6846 event = 12144548 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 24.0883 lep2_E = 10.9808 rand = 0.999742 run = 272126 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 58690 events Prepared event 20000 for Background with 58690 events Prepared event 30000 for Background with 58690 events Prepared event 40000 for Background with 58690 events Prepared event 50000 for Background with 58690 events Warning: found 2012 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 72021 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 2012 negative weights. Signal fraction: 63.0967979 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 48.6484184 60.6519775 64.6011658 66.3567657 67.8186264 68.7744827 69.6394043 70.6618958 71.4212494 72.2884903 73.3370056 74.0184021 74.7044373 75.3529358 75.8777771 76.6196899 77.2742157 77.8177948 78.4597321 78.9744568 79.6861572 80.5752563 81.1571274 81.9607391 82.5679016 83.4697723 84.4109344 85.515358 86.4074097 87.8974304 89.2082214 91.1402206 92.6531906 94.8012085 96.775528 98.6458588 100.458725 102.389061 104.175438 106.04332 107.624474 109.215775 110.807854 112.504486 114.606911 116.495071 118.334091 119.955719 121.664703 123.478897 125.503265 127.359619 129.020172 130.555252 132.423187 134.018341 135.715515 137.523224 138.936829 140.533325 142.029327 143.708893 145.348221 146.936188 148.5289 150.163269 152.042465 153.7771 155.509262 157.333694 159.114563 161.047821 162.880005 164.835159 166.83371 169.084625 170.836029 172.978271 175.271652 177.523361 179.89032 182.241394 184.90683 187.663513 190.599655 193.818054 197.08519 200.588684 204.789825 208.936127 212.837082 218.009094 222.913361 229.925385 237.559814 246.366241 257.981506 273.707092 295.2453 336.247772 635.413757 ------------------------------ Transdef: Tab for variable 3 20.0001564 20.2635918 20.531889 20.8320274 21.1000366 21.3072662 21.5178585 21.7450256 21.9420128 22.1070023 22.322979 22.5414104 22.7641907 23.0265236 23.206953 23.3812752 23.5635376 23.7648659 24.0023384 24.2310257 24.4958038 24.7066479 24.97089 25.1920815 25.376585 25.6179333 25.8576546 26.0352955 26.2755013 26.5315247 26.8090363 27.054472 27.324913 27.6111565 27.8729553 28.0803528 28.3406544 28.6454887 28.9522438 29.2137184 29.4938202 29.7683868 30.1985226 30.4678192 30.7994328 31.2362556 31.6357727 31.9535561 32.2668343 32.6869278 33.0037651 33.4327545 33.8260269 34.202774 34.6064568 35.0014343 35.4035873 35.8654633 36.2774963 36.7895203 37.2541313 37.7318687 38.1811371 38.6131134 39.0704193 39.5534439 39.9843063 40.515686 41.0548859 41.6155701 42.3091202 42.8729591 43.406311 43.9837227 44.5783691 45.1867371 45.7421188 46.4217606 47.0060806 47.668232 48.3977509 49.0508957 49.8326416 50.7061462 51.4826241 52.4150696 53.3126907 54.450161 55.4545593 56.6479492 57.8150787 59.0318909 60.2974968 61.7946663 63.6565094 65.7711716 68.3926926 71.4318237 75.0788803 81.932724 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0006914 10.124176 10.2538013 10.3703899 10.5054865 10.6477299 10.7707109 10.9147797 11.0484648 11.1875267 11.3166561 11.4615316 11.6176624 11.785635 11.9260159 12.0594025 12.1945972 12.3635082 12.5162058 12.6717854 12.8428555 13.0105114 13.2181654 13.4278345 13.6753674 13.9132042 14.0813246 14.2114201 14.390667 14.6004162 14.7778454 14.9676857 15.1799812 15.4168777 15.594512 15.8388691 16.0812302 16.3114929 16.5200634 16.7582359 16.9829712 17.2492905 17.4703369 17.6888504 17.8854809 18.1038761 18.3575439 18.578413 18.8072548 19.0228844 19.2021675 19.4093037 19.6086655 19.8591442 20.1129341 20.3252163 20.5397644 20.7483788 20.9698219 21.2045383 21.4385872 21.625885 21.872963 22.0865192 22.2851028 22.5312958 22.7531471 22.9512596 23.1698074 23.4020233 23.6271763 23.8805389 24.1696053 24.4433556 24.7181816 25.0345726 25.3088989 25.6814003 25.9360313 26.2064896 26.5197315 26.8014717 27.1603966 27.5036983 27.8249664 28.1868782 28.5401535 28.975666 29.4705658 30.0095062 30.4656219 31.0857201 31.7476387 32.3005409 32.9733505 33.8519592 34.9654732 36.5584984 38.4271469 42.3299866 74.3859253 ------------------------------ Transdef: Tab for variable 5 0.951345682 2.33350039 2.72735834 3.03985 3.3094511 3.56729937 3.79172969 3.98726988 4.1332798 4.30385208 4.45372391 4.58302975 4.7052083 4.81054258 4.91184711 5.00855255 5.08965206 5.15992546 5.23758936 5.30558968 5.37441063 5.43558693 5.48445511 5.52500248 5.58389568 5.63256836 5.68008518 5.71816444 5.77306175 5.80863667 5.85174513 5.89359522 5.92850971 5.97853661 6.02055931 6.06160164 6.09470558 6.13404751 6.17826986 6.216434 6.25992489 6.29629707 6.35020638 6.39311647 6.43695068 6.48710442 6.52801037 6.57705784 6.62456083 6.67284775 6.71611643 6.76103687 6.81040192 6.86261559 6.90645885 6.95481777 7.00938416 7.06631851 7.12801123 7.18641281 7.2460947 7.29932261 7.35807943 7.41909647 7.48726845 7.55114651 7.61935234 7.68668032 7.74726486 7.80594635 7.87321472 7.93452072 8.01508904 8.08711624 8.14298248 8.20424652 8.27272606 8.34466171 8.40490341 8.47393703 8.55181026 8.61906242 8.68950272 8.76444626 8.85248947 8.92810059 9.00329399 9.09142303 9.18757439 9.28582287 9.39922714 9.52143669 9.65400887 9.77109718 9.92198944 10.1293488 10.3427048 10.6769085 11.1466541 11.9988384 18.3742065 ------------------------------ Transdef: Tab for variable 6 15.0471287 17.9536934 20.137867 22.2221394 23.9798126 25.6630669 27.0518055 28.3526649 29.5665932 30.5803051 31.2944984 32.1082001 32.6330643 33.1393051 33.6994476 34.2143974 34.5698547 34.9935455 35.2980423 35.7180176 36.1116486 36.445488 36.8282127 37.1892052 37.5515594 37.8830109 38.2246399 38.5748634 38.9508133 39.2453537 39.6513824 40.0471802 40.2706146 40.6149712 40.9759407 41.3439522 41.7651138 42.2430801 42.7358437 43.1714935 43.664711 44.1387863 44.8130493 45.4420166 46.1473732 47.0426521 47.9086151 48.7141228 49.4567413 50.0746918 50.8660278 51.7722321 52.6533203 53.5887909 54.3284988 55.1632156 55.9520874 56.6304169 57.5415459 58.6686783 59.5227966 60.3242722 61.2809067 62.1060104 62.8953705 63.8125458 64.6046295 65.5626678 66.3328476 67.3227692 68.2167358 69.0443649 69.9380341 70.7278214 71.5494385 72.4481354 73.3618164 74.1893768 75.1575317 76.093338 77.0472031 78.1109848 79.3945694 80.3621674 81.546936 82.8218765 83.9130707 85.1857147 86.7655792 88.4146805 89.7980347 91.6298981 93.5881653 95.9033508 98.8323059 102.452377 105.709595 111.244995 119.309563 134.451416 290.769653 ------------------------------ Transdef: Tab for variable 7 30.1484737 32.54673 33.4377251 33.9745331 34.684166 35.1006927 35.63694 36.0616837 36.4572144 36.8548431 37.2742386 37.6426392 37.8961868 38.2140732 38.4852982 38.8057289 39.1225128 39.3945541 39.637085 39.9824142 40.3184433 40.7201614 41.2089119 41.5675316 42.1150093 42.6521034 43.3120575 43.8062515 44.4990768 45.2619476 46.2324066 47.0117874 47.8535576 48.7824097 50.0231743 51.3164864 52.799324 53.7552071 54.8252144 55.8731766 56.8314896 57.6912994 58.7806664 59.7424049 60.6370621 61.5803757 62.5564842 63.5660095 64.5609131 65.5442123 66.3398819 67.2931824 68.2630005 69.0894775 69.986351 70.8335724 71.8896484 72.999939 73.9933014 74.7965851 75.9638901 77.0045929 78.083313 79.1760559 80.2908936 81.4309769 82.7717896 84.007576 85.4568787 86.826416 88.2265778 89.4941559 91.0848846 92.6837006 94.1784821 95.7246017 97.5339279 99.3835602 101.049667 102.869476 104.778809 106.749603 108.91613 111.225143 113.852905 116.158005 118.774529 122.156998 125.229378 128.230179 131.783203 136.401016 141.092896 145.585083 152.455505 159.991333 170.330902 182.810455 200.941406 230.01947 364.010101 ------------------------------ Transdef: Tab for variable 8 1.31380045 22.525732 27.0076542 30.1361198 31.4961929 32.3738899 32.9492645 33.3633232 33.7618561 34.3061981 34.7366409 35.0190964 35.3575821 35.6706543 36.0325241 36.4751205 36.7837219 37.1527939 37.391037 37.6807022 37.9501266 38.3239861 38.5223694 38.7746353 39.0352554 39.3025894 39.6489487 40.0211983 40.3529587 40.6336441 41.0808105 41.4479294 41.8736076 42.2311478 42.6841965 43.1623917 43.7450218 44.2858505 44.8589401 45.5181046 46.1982956 46.8048325 47.3962708 48.0129852 48.7797012 49.4429703 50.2301712 51.0802841 51.9827957 52.8121719 53.504158 54.1991272 55.053154 55.7394485 56.4413757 57.2924614 58.0124474 58.787941 59.5178185 60.1877518 60.8754311 61.6232986 62.282486 63.1439247 63.8427773 64.5978241 65.2908478 65.9420013 66.771759 67.4671936 68.2037735 68.853653 69.6866455 70.4888992 71.1988373 72.1431274 72.8924942 73.8202209 74.6166992 75.4392242 76.2987518 77.1981277 78.2455444 79.1725235 80.2208862 81.3002777 82.5591736 83.9405746 85.3833923 86.9311981 88.5131226 90.4421616 92.3758774 94.7074738 97.3761597 100.901505 105.143303 111.634476 119.539139 134.567184 288.973846 ------------------------------ Transdef: Tab for variable 9 48.6484184 59.5679169 63.1569138 65.6990356 66.7941284 67.8355255 68.8022385 69.5390778 70.4243546 71.2596741 72.0187378 72.8895416 73.7361832 74.3158264 74.9720764 75.4651337 76.0385742 76.6560898 77.2328186 77.7525482 78.2687378 78.7345734 79.3061218 80.0219269 80.6452789 81.1571274 81.7563477 82.3592606 82.8705292 83.5430756 84.474472 85.2035675 86.084938 87.0666199 88.0297852 89.1105957 90.631546 92.0567703 93.1666412 94.7578125 96.3436432 97.9187012 99.6007996 100.976524 102.738098 104.269135 105.676346 107.23996 108.780457 110.261963 111.736923 113.402855 114.9048 116.359558 117.700073 118.957443 120.165108 121.521912 123.008911 124.441444 125.841797 127.447418 128.605408 129.622314 130.737976 132.269379 133.568634 135.023254 136.356476 137.912964 139.006226 140.176666 141.506012 142.664627 144.00592 145.106812 146.41394 147.542572 148.982269 150.184921 151.669586 152.940491 154.512268 155.998596 157.445831 158.651123 160.228027 162.038605 163.758331 165.913849 167.845779 170.02478 172.654938 175.054962 178.132721 181.233826 185.11937 190.251343 198.073944 211.857529 342.429901 ------------------------------ Transdef: Tab for variable 10 0.0598361529 0.955374718 1.3179971 1.51789093 1.68129253 1.80894446 1.93611956 2.01668119 2.10352492 2.16574407 2.22766924 2.28295374 2.32717705 2.36492395 2.41095638 2.4492116 2.48484087 2.51887131 2.54918408 2.57426858 2.6033566 2.62707329 2.64892483 2.6707983 2.68987536 2.70732331 2.7232213 2.74302983 2.76047134 2.77807283 2.79326153 2.80824995 2.81873274 2.83139348 2.84168839 2.85477591 2.86419964 2.87388992 2.88388515 2.89489484 2.90409517 2.91184378 2.92036915 2.92845321 2.93618226 2.94357705 2.95194697 2.95851707 2.9662509 2.971663 2.97741938 2.98366642 2.98950124 2.99470997 2.99873877 3.00393605 3.00799561 3.0121181 3.01544333 3.01919007 3.02307463 3.02686024 3.03053355 3.03456187 3.03937769 3.04250574 3.04629326 3.05008125 3.05396581 3.05687523 3.06018114 3.06316042 3.06621265 3.06921816 3.07274723 3.07616544 3.07894969 3.08207989 3.08468294 3.0878849 3.09058619 3.09338093 3.09608579 3.09922767 3.10174036 3.10474253 3.10704517 3.10983706 3.11241627 3.11478209 3.11703539 3.11922956 3.12167597 3.12413406 3.12702465 3.12951875 3.13160586 3.13423014 3.13638949 3.13889265 3.14158177 ------------------------------ Transdef: Tab for variable 11 1.33514404E-05 0.00464296341 0.00969564728 0.0142831802 0.0203206241 0.0253571272 0.0310584307 0.0365107059 0.0453102626 0.0509279966 0.0582828522 0.0650469959 0.0720380545 0.0802696347 0.0879558921 0.0932282209 0.0988634825 0.105150193 0.111690275 0.118238926 0.123962402 0.129555106 0.135650754 0.139798284 0.145008326 0.151346207 0.157296538 0.163363904 0.169013858 0.174499929 0.180744588 0.185703233 0.18996644 0.194261551 0.198750973 0.202522844 0.205998629 0.211626589 0.216180086 0.220834732 0.225219548 0.228782117 0.23335588 0.237050816 0.241899639 0.246549249 0.250736475 0.254647255 0.258020043 0.263195693 0.268015504 0.272254348 0.276296616 0.28060776 0.285359681 0.289739966 0.294594973 0.299338222 0.304382682 0.309084654 0.313967943 0.319342792 0.324082851 0.329711676 0.335294694 0.339845598 0.345963478 0.352417231 0.356595337 0.362853527 0.369736642 0.376921415 0.383485556 0.389767647 0.396214485 0.401477575 0.410866499 0.417901218 0.425244093 0.432405949 0.440373361 0.446494401 0.457157433 0.466968298 0.476202726 0.488010168 0.500665903 0.511766493 0.523183048 0.533812165 0.547209978 0.563118994 0.580139577 0.599393785 0.621334076 0.643097341 0.671734691 0.703747034 0.753988028 0.819757879 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.206725374 0.212900743 0.218731195 0.224361509 0.229905814 0.235001177 0.240588993 0.245406806 0.250762463 0.256092191 0.260981292 0.265951037 0.269233882 0.274072886 0.278333783 0.28336376 0.286863118 0.290463865 0.294790447 0.298766792 0.303606927 0.307913542 0.312034369 0.31583935 0.320698023 0.325099587 0.329483598 0.334729731 0.33921361 0.343910992 0.348224342 0.352464676 0.357086658 0.362294555 0.367256105 0.370934874 0.375290602 0.379874974 0.384869456 0.388728023 0.392596543 0.396782607 0.40077275 0.404908448 0.408151865 0.412454367 0.416582227 0.420553565 0.424648166 0.42857179 0.432288468 0.435382038 0.439430416 0.443472862 0.44710961 0.451820016 0.456688106 0.461254001 0.465485722 0.47058624 0.474917233 0.479953587 0.484748751 0.489451766 0.495078743 0.499717206 0.505391121 0.511123419 0.517234325 0.523208201 0.528940916 0.534612536 0.541862547 0.548346162 0.555062592 0.561236978 0.566928506 0.574023068 0.582249403 0.588334441 0.596925735 0.605038881 0.615489125 0.624229312 0.632148445 0.643092811 0.652959585 0.66229856 0.674998999 0.690174758 0.702221453 0.71527195 0.735149741 0.753474116 0.768148363 0.792963386 0.816951275 0.848781586 0.895904064 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.2695656 22.0102367 22.5066833 23.1247444 23.5876465 24.0849152 24.5740814 25.0494385 25.5510864 25.8384666 26.0866413 26.5555153 26.9590225 27.3454552 27.6952248 28.017334 28.3286018 28.647438 28.9358978 29.2868729 29.5990753 29.9832153 30.2995396 30.6247063 30.8844185 31.2950325 31.5446091 31.8804531 32.2013779 32.5124016 32.9465332 33.3106728 33.7171707 34.1583862 34.4472656 34.805336 35.1835556 35.5705872 35.9620895 36.3445206 36.7042427 37.1278076 37.5943985 38.0202484 38.3485641 38.72258 39.1841354 39.5878525 40.0375137 40.5068893 41.0051956 41.4792519 41.9211578 42.4700546 42.8810539 43.4527855 43.9000282 44.3429108 44.8264999 45.2760735 45.7402802 46.3068008 46.8512726 47.4822998 48.0567207 48.6938286 49.279686 49.9247932 50.5377884 51.1721725 51.7969437 52.5246506 53.1917725 53.8640747 54.6556778 55.2389755 56.0395279 56.764679 57.5013428 58.4636993 59.2738419 60.2900009 61.3177147 62.1720352 63.1463699 64.2018433 65.5387802 66.9409943 68.3597107 69.6770325 71.3838196 73.1410675 75.3630219 77.6323395 80.5631561 83.9623032 87.9776306 93.1684875 103.318451 196.200546 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.729393 11.0988617 11.4024696 11.7848034 12.0888691 12.4029417 12.659585 12.9030075 13.1320181 13.3623695 13.6881733 13.983345 14.2044868 14.443635 14.6563435 14.865387 15.0863743 15.2787848 15.532114 15.8073072 16.0339699 16.2896366 16.5752449 16.84412 17.0909424 17.4108315 17.6769485 17.9058876 18.177042 18.5043449 18.7492561 19.0083466 19.2084599 19.5014534 19.7374611 20.0167618 20.3261642 20.6108932 20.8406906 21.0703125 21.335228 21.5566673 21.8446083 22.0858974 22.3896561 22.6436195 22.863718 23.0845833 23.3186398 23.5038567 23.7694702 23.9938469 24.2291336 24.4771214 24.7646351 25.0018234 25.3177757 25.5794029 25.8514862 26.1333218 26.3997231 26.6436348 26.9103737 27.1603642 27.4066238 27.6527023 27.9084549 28.148571 28.4319782 28.7009659 29.0152855 29.3194771 29.6572037 29.9823036 30.3248901 30.678051 31.0673904 31.3932953 31.7870903 32.1863403 32.5848389 33.0232697 33.4090347 33.9268379 34.3798981 34.8790817 35.4001312 35.9801064 36.5837173 37.3541031 38.1744461 39.3445663 40.2354355 41.3034859 42.6172409 44.219986 46.4390869 49.9764481 56.7055054 111.950317 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.6 55.9 52.4 30.3 47.6 65.9 56.0 64.9 -27.6 -8.3 -27.7 40.1 36.4 2 67.6 100.0 71.0 58.5 39.9 68.1 94.8 76.5 91.9 -42.8 -17.9 -39.2 55.3 42.8 3 55.9 71.0 100.0 46.0 20.5 41.5 72.4 60.1 77.8 -14.0 -20.0 -46.1 82.3 32.1 4 52.4 58.5 46.0 100.0 14.3 33.0 60.5 47.8 61.0 -14.0 -19.9 -46.4 35.8 81.8 5 30.3 39.9 20.5 14.3 100.0 85.7 13.0 64.2 61.1 24.3 -4.4 -10.6 12.5 7.2 6 47.6 68.1 41.5 33.0 85.7 100.0 47.5 81.7 79.5 -3.4 -9.7 -22.8 30.2 21.8 7 65.9 94.8 72.4 60.5 13.0 47.5 100.0 66.3 80.6 -52.3 -17.4 -39.0 57.5 45.4 8 56.0 76.5 60.1 47.8 64.2 81.7 66.3 100.0 85.5 -8.3 -16.6 -34.3 46.4 34.4 9 64.9 91.9 77.8 61.0 61.1 79.5 80.6 85.5 100.0 -17.6 -19.5 -44.0 61.4 44.5 10 -27.6 -42.8 -14.0 -14.0 24.3 -3.4 -52.3 -8.3 -17.6 100.0 2.5 5.2 -9.4 -9.2 11 -8.3 -17.9 -20.0 -19.9 -4.4 -9.7 -17.4 -16.6 -19.5 2.5 100.0 49.7 -16.1 -17.7 12 -27.7 -39.2 -46.1 -46.4 -10.6 -22.8 -39.0 -34.3 -44.0 5.2 49.7 100.0 -32.7 -29.0 13 40.1 55.3 82.3 35.8 12.5 30.2 57.5 46.4 61.4 -9.4 -16.1 -32.7 100.0 44.5 14 36.4 42.8 32.1 81.8 7.2 21.8 45.4 34.4 44.5 -9.2 -17.7 -29.0 44.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 172.694843 TOTAL CORRELATION OF ALL VARIABLES 73.3152696 ROUND 1: MAX CORR ( 73.3028117) AFTER KILLING INPUT VARIABLE 8 CONTR 1.35150314 ROUND 2: MAX CORR ( 73.292133) AFTER KILLING INPUT VARIABLE 6 CONTR 1.25117388 ROUND 3: MAX CORR ( 73.2793298) AFTER KILLING INPUT VARIABLE 2 CONTR 1.36988792 ROUND 4: MAX CORR ( 73.2455058) AFTER KILLING INPUT VARIABLE 14 CONTR 2.22621739 ROUND 5: MAX CORR ( 73.170259) AFTER KILLING INPUT VARIABLE 12 CONTR 3.31923465 ROUND 6: MAX CORR ( 72.9639833) AFTER KILLING INPUT VARIABLE 13 CONTR 5.49035079 ROUND 7: MAX CORR ( 72.757636) AFTER KILLING INPUT VARIABLE 11 CONTR 5.48354452 ROUND 8: MAX CORR ( 72.4494957) AFTER KILLING INPUT VARIABLE 10 CONTR 6.68910757 ROUND 9: MAX CORR ( 71.2704116) AFTER KILLING INPUT VARIABLE 9 CONTR 13.0175981 ROUND 10: MAX CORR ( 70.8191883) AFTER KILLING INPUT VARIABLE 3 CONTR 8.00713049 ROUND 11: MAX CORR ( 69.4349821) AFTER KILLING INPUT VARIABLE 4 CONTR 13.9334383 ROUND 12: MAX CORR ( 65.8848827) AFTER KILLING INPUT VARIABLE 5 CONTR 21.9180056 LAST REMAINING VARIABLE: 7 total correlation to target: 73.3152696 % total significance: 75.2664793 sigma correlations of single variables to target: variable 2: 67.5504339 % , in sigma: 69.3482185 variable 3: 55.8602239 % , in sigma: 57.3468857 variable 4: 52.3544865 % , in sigma: 53.7478467 variable 5: 30.3057745 % , in sigma: 31.1123312 variable 6: 47.576424 % , in sigma: 48.8426211 variable 7: 65.8848827 % , in sigma: 67.6383403 variable 8: 55.9879585 % , in sigma: 57.4780198 variable 9: 64.9261939 % , in sigma: 66.6541371 variable 10: -27.556623 % , in sigma: 28.2900139 variable 11: -8.26648032 % , in sigma: 8.4864841 variable 12: -27.671733 % , in sigma: 28.4081874 variable 13: 40.114454 % , in sigma: 41.1820585 variable 14: 36.3821188 % , in sigma: 37.3503911 variables sorted by significance: 1 most relevant variable 7 corr 65.8848801 , in sigma: 67.6383377 2 most relevant variable 5 corr 21.918005 , in sigma: 22.5013299 3 most relevant variable 4 corr 13.9334383 , in sigma: 14.3042623 4 most relevant variable 3 corr 8.00713062 , in sigma: 8.22023208 5 most relevant variable 9 corr 13.0175982 , in sigma: 13.364048 6 most relevant variable 10 corr 6.68910742 , in sigma: 6.86713106 7 most relevant variable 11 corr 5.48354435 , in sigma: 5.62948318 8 most relevant variable 13 corr 5.49035072 , in sigma: 5.6364707 9 most relevant variable 12 corr 3.31923461 , in sigma: 3.40757259 10 most relevant variable 14 corr 2.22621727 , in sigma: 2.28546573 11 most relevant variable 2 corr 1.36988795 , in sigma: 1.40634609 12 most relevant variable 6 corr 1.25117385 , in sigma: 1.28447255 13 most relevant variable 8 corr 1.35150313 , in sigma: 1.38747198 global correlations between input variables: variable 2: 99.2823268 % variable 3: 94.5644746 % variable 4: 92.1140295 % variable 5: 95.5464453 % variable 6: 94.3863578 % variable 7: 98.9619365 % variable 8: 90.9918864 % variable 9: 98.8117153 % variable 10: 72.7873142 % variable 11: 51.4098707 % variable 12: 68.2609025 % variable 13: 89.4659102 % variable 14: 89.464924 % significance loss when removing single variables: variable 2: corr = 1.85081826 % , sigma = 1.90007586 variable 3: corr = 14.1329215 % , sigma = 14.5090545 variable 4: corr = 13.6358506 % , sigma = 13.9987546 variable 5: corr = 15.1089845 % , sigma = 15.5110944 variable 6: corr = 1.66251967 % , sigma = 1.7067659 variable 7: corr = 7.29665572 % , sigma = 7.49084862 variable 8: corr = 1.35150314 % , sigma = 1.38747199 variable 9: corr = 10.3631803 % , sigma = 10.6389856 variable 10: corr = 6.24315189 % , sigma = 6.40930688 variable 11: corr = 3.2460196 % , sigma = 3.33240904 variable 12: corr = 3.66634868 % , sigma = 3.76392473 variable 13: corr = 3.22872843 % , sigma = 3.31465768 variable 14: corr = 2.27278043 % , sigma = 2.33326812 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 14.8015347 sigma out 15 active outputs RANK 2 NODE 8 --> 14.0752783 sigma out 15 active outputs RANK 3 NODE 1 --> 13.7304029 sigma out 15 active outputs RANK 4 NODE 3 --> 11.8903379 sigma out 15 active outputs RANK 5 NODE 2 --> 10.3818893 sigma out 15 active outputs RANK 6 NODE 9 --> 9.92488098 sigma out 15 active outputs RANK 7 NODE 7 --> 9.00149822 sigma out 15 active outputs RANK 8 NODE 4 --> 7.8022089 sigma out 15 active outputs RANK 9 NODE 6 --> 6.21612453 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 18.6646519 sigma in 9act. ( 18.7527256 sig out 1act.) RANK 2 NODE 14 --> 14.9772367 sigma in 9act. ( 15.1666231 sig out 1act.) RANK 3 NODE 10 --> 14.3114786 sigma in 9act. ( 15.2484503 sig out 1act.) RANK 4 NODE 15 --> 11.0697985 sigma in 9act. ( 11.2263155 sig out 1act.) RANK 5 NODE 11 --> 7.41118956 sigma in 9act. ( 7.63009834 sig out 1act.) RANK 6 NODE 1 --> 6.74827623 sigma in 9act. ( 6.5128336 sig out 1act.) RANK 7 NODE 13 --> 5.71848965 sigma in 9act. ( 5.81020689 sig out 1act.) RANK 8 NODE 3 --> 5.42146969 sigma in 9act. ( 6.59767485 sig out 1act.) RANK 9 NODE 9 --> 4.0832696 sigma in 9act. ( 3.93186712 sig out 1act.) RANK 10 NODE 6 --> 3.97531676 sigma in 9act. ( 3.66692472 sig out 1act.) RANK 11 NODE 2 --> 3.58788824 sigma in 9act. ( 3.54932475 sig out 1act.) RANK 12 NODE 12 --> 3.35033441 sigma in 9act. ( 3.09284568 sig out 1act.) RANK 13 NODE 4 --> 2.98992515 sigma in 9act. ( 2.44585657 sig out 1act.) RANK 14 NODE 8 --> 1.97994637 sigma in 9act. ( 2.39854383 sig out 1act.) RANK 15 NODE 5 --> 1.37610793 sigma in 9act. ( 1.19044065 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 18.7527256 sigma out 1act.( 18.6646519 sig in 9act.) RANK 2 NODE 10 --> 15.2484503 sigma out 1act.( 14.3114786 sig in 9act.) RANK 3 NODE 14 --> 15.1666231 sigma out 1act.( 14.9772367 sig in 9act.) RANK 4 NODE 15 --> 11.2263155 sigma out 1act.( 11.0697985 sig in 9act.) RANK 5 NODE 11 --> 7.63009834 sigma out 1act.( 7.41118956 sig in 9act.) RANK 6 NODE 3 --> 6.59767485 sigma out 1act.( 5.42146969 sig in 9act.) RANK 7 NODE 1 --> 6.5128336 sigma out 1act.( 6.74827623 sig in 9act.) RANK 8 NODE 13 --> 5.81020689 sigma out 1act.( 5.71848965 sig in 9act.) RANK 9 NODE 9 --> 3.93186712 sigma out 1act.( 4.0832696 sig in 9act.) RANK 10 NODE 6 --> 3.66692472 sigma out 1act.( 3.97531676 sig in 9act.) RANK 11 NODE 2 --> 3.54932475 sigma out 1act.( 3.58788824 sig in 9act.) RANK 12 NODE 12 --> 3.09284568 sigma out 1act.( 3.35033441 sig in 9act.) RANK 13 NODE 4 --> 2.44585657 sigma out 1act.( 2.98992515 sig in 9act.) RANK 14 NODE 8 --> 2.39854383 sigma out 1act.( 1.97994637 sig in 9act.) RANK 15 NODE 5 --> 1.19044065 sigma out 1act.( 1.37610793 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 34.3857727 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 18.7351665 sigma out 15 active outputs RANK 2 NODE 8 --> 15.3648214 sigma out 15 active outputs RANK 3 NODE 1 --> 14.1113081 sigma out 15 active outputs RANK 4 NODE 3 --> 12.4885006 sigma out 15 active outputs RANK 5 NODE 9 --> 10.8812561 sigma out 15 active outputs RANK 6 NODE 7 --> 10.8472767 sigma out 15 active outputs RANK 7 NODE 2 --> 10.3390236 sigma out 15 active outputs RANK 8 NODE 4 --> 9.69477749 sigma out 15 active outputs RANK 9 NODE 6 --> 8.88630962 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 16.4730148 sigma in 9act. ( 16.1254406 sig out 1act.) RANK 2 NODE 10 --> 14.6446638 sigma in 9act. ( 14.2093391 sig out 1act.) RANK 3 NODE 14 --> 13.2712231 sigma in 9act. ( 13.064724 sig out 1act.) RANK 4 NODE 15 --> 10.7479773 sigma in 9act. ( 10.8394823 sig out 1act.) RANK 5 NODE 5 --> 10.5622511 sigma in 9act. ( 5.67195177 sig out 1act.) RANK 6 NODE 3 --> 10.4913626 sigma in 9act. ( 8.08255959 sig out 1act.) RANK 7 NODE 8 --> 9.54182529 sigma in 9act. ( 4.78657293 sig out 1act.) RANK 8 NODE 1 --> 8.66409969 sigma in 9act. ( 5.71483421 sig out 1act.) RANK 9 NODE 11 --> 7.68450403 sigma in 9act. ( 7.00572014 sig out 1act.) RANK 10 NODE 9 --> 7.55478954 sigma in 9act. ( 3.87069654 sig out 1act.) RANK 11 NODE 4 --> 7.17194986 sigma in 9act. ( 2.44022322 sig out 1act.) RANK 12 NODE 13 --> 6.49822521 sigma in 9act. ( 5.06918478 sig out 1act.) RANK 13 NODE 2 --> 6.05923176 sigma in 9act. ( 3.23073936 sig out 1act.) RANK 14 NODE 12 --> 5.21056175 sigma in 9act. ( 2.83292317 sig out 1act.) RANK 15 NODE 6 --> 4.3844614 sigma in 9act. ( 2.57459354 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 16.1254406 sigma out 1act.( 16.4730148 sig in 9act.) RANK 2 NODE 10 --> 14.2093391 sigma out 1act.( 14.6446638 sig in 9act.) RANK 3 NODE 14 --> 13.064724 sigma out 1act.( 13.2712231 sig in 9act.) RANK 4 NODE 15 --> 10.8394823 sigma out 1act.( 10.7479773 sig in 9act.) RANK 5 NODE 3 --> 8.08255959 sigma out 1act.( 10.4913626 sig in 9act.) RANK 6 NODE 11 --> 7.00572014 sigma out 1act.( 7.68450403 sig in 9act.) RANK 7 NODE 1 --> 5.71483421 sigma out 1act.( 8.66409969 sig in 9act.) RANK 8 NODE 5 --> 5.67195177 sigma out 1act.( 10.5622511 sig in 9act.) RANK 9 NODE 13 --> 5.06918478 sigma out 1act.( 6.49822521 sig in 9act.) RANK 10 NODE 8 --> 4.78657293 sigma out 1act.( 9.54182529 sig in 9act.) RANK 11 NODE 9 --> 3.87069654 sigma out 1act.( 7.55478954 sig in 9act.) RANK 12 NODE 2 --> 3.23073936 sigma out 1act.( 6.05923176 sig in 9act.) RANK 13 NODE 12 --> 2.83292317 sigma out 1act.( 5.21056175 sig in 9act.) RANK 14 NODE 6 --> 2.57459354 sigma out 1act.( 4.3844614 sig in 9act.) RANK 15 NODE 4 --> 2.44022322 sigma out 1act.( 7.17194986 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 31.9998646 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.460339665 *** contribution from regularisation: 0.0091148233 *** contribution from error: -0.469454497 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.5231179 *** contribution from regularisation: 0.00428384356 *** contribution from error: -0.527401745 *********************************************** -----------------> Test sample ENTER BFGS code START -18841.0767 0.174444556 0.0477450676 EXIT FROM BFGS code FG_START 0. 0.174444556 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.55089432 *** contribution from regularisation: 0.00333782448 *** contribution from error: -0.554232121 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -19837.7052 0.174444556 16.8183498 EXIT FROM BFGS code FG_LNSRCH 0. 0.184738994 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.588831484 *** contribution from regularisation: 0.00483730575 *** contribution from error: -0.593668818 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21203.8226 0.184738994 22.3992462 EXIT FROM BFGS code NEW_X -21203.8226 0.184738994 22.3992462 ENTER BFGS code NEW_X -21203.8226 0.184738994 22.3992462 EXIT FROM BFGS code FG_LNSRCH 0. 0.202642113 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.592291236 *** contribution from regularisation: 0.00514395814 *** contribution from error: -0.597435176 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21328.4065 0.202642113 12.3139133 EXIT FROM BFGS code NEW_X -21328.4065 0.202642113 12.3139133 ENTER BFGS code NEW_X -21328.4065 0.202642113 12.3139133 EXIT FROM BFGS code FG_LNSRCH 0. 0.22583425 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.595396757 *** contribution from regularisation: 0.00497519597 *** contribution from error: -0.600371957 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21440.2368 0.22583425 -0.974213421 EXIT FROM BFGS code NEW_X -21440.2368 0.22583425 -0.974213421 ENTER BFGS code NEW_X -21440.2368 0.22583425 -0.974213421 EXIT FROM BFGS code FG_LNSRCH 0. 0.22588858 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.596161723 *** contribution from regularisation: 0.00463177776 *** contribution from error: -0.600793481 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21467.7839 0.22588858 -3.83130693 EXIT FROM BFGS code NEW_X -21467.7839 0.22588858 -3.83130693 ENTER BFGS code NEW_X -21467.7839 0.22588858 -3.83130693 EXIT FROM BFGS code FG_LNSRCH 0. 0.221602201 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.59634155 *** contribution from regularisation: 0.00451634219 *** contribution from error: -0.600857913 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21474.259 0.221602201 -4.88100529 EXIT FROM BFGS code NEW_X -21474.259 0.221602201 -4.88100529 ENTER BFGS code NEW_X -21474.259 0.221602201 -4.88100529 EXIT FROM BFGS code FG_LNSRCH 0. 0.170176268 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.596579671 *** contribution from regularisation: 0.00273715099 *** contribution from error: -0.599316835 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21482.8342 0.170176268 -15.0085268 EXIT FROM BFGS code NEW_X -21482.8342 0.170176268 -15.0085268 ENTER BFGS code NEW_X -21482.8342 0.170176268 -15.0085268 EXIT FROM BFGS code FG_LNSRCH 0. -0.0314136259 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 75.1470566 sigma out 15 active outputs RANK 2 NODE 8 --> 56.2588425 sigma out 15 active outputs RANK 3 NODE 4 --> 55.6330643 sigma out 15 active outputs RANK 4 NODE 7 --> 53.747982 sigma out 15 active outputs RANK 5 NODE 6 --> 40.5305672 sigma out 15 active outputs RANK 6 NODE 1 --> 37.3213043 sigma out 15 active outputs RANK 7 NODE 3 --> 36.7639275 sigma out 15 active outputs RANK 8 NODE 2 --> 27.3873863 sigma out 15 active outputs RANK 9 NODE 9 --> 21.2278576 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 82.9725189 sigma in 9act. ( 87.8505249 sig out 1act.) RANK 2 NODE 3 --> 73.7880554 sigma in 9act. ( 76.8140335 sig out 1act.) RANK 3 NODE 8 --> 56.2396469 sigma in 9act. ( 60.6451378 sig out 1act.) RANK 4 NODE 9 --> 35.1836395 sigma in 9act. ( 34.911644 sig out 1act.) RANK 5 NODE 4 --> 28.5827503 sigma in 9act. ( 27.2274132 sig out 1act.) RANK 6 NODE 15 --> 27.9654312 sigma in 9act. ( 26.5783806 sig out 1act.) RANK 7 NODE 2 --> 19.3199635 sigma in 9act. ( 18.3309116 sig out 1act.) RANK 8 NODE 11 --> 18.6647949 sigma in 9act. ( 17.1552258 sig out 1act.) RANK 9 NODE 7 --> 17.3500061 sigma in 9act. ( 13.4220934 sig out 1act.) RANK 10 NODE 14 --> 16.5121937 sigma in 9act. ( 13.037137 sig out 1act.) RANK 11 NODE 12 --> 14.6961794 sigma in 9act. ( 13.4256973 sig out 1act.) RANK 12 NODE 1 --> 14.6569386 sigma in 9act. ( 9.9368515 sig out 1act.) RANK 13 NODE 10 --> 12.5111952 sigma in 9act. ( 1.09780443 sig out 1act.) RANK 14 NODE 6 --> 10.0537443 sigma in 9act. ( 8.24057007 sig out 1act.) RANK 15 NODE 13 --> 8.44041157 sigma in 9act. ( 3.87291241 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 87.8505249 sigma out 1act.( 82.9725189 sig in 9act.) RANK 2 NODE 3 --> 76.8140335 sigma out 1act.( 73.7880554 sig in 9act.) RANK 3 NODE 8 --> 60.6451378 sigma out 1act.( 56.2396469 sig in 9act.) RANK 4 NODE 9 --> 34.911644 sigma out 1act.( 35.1836395 sig in 9act.) RANK 5 NODE 4 --> 27.2274132 sigma out 1act.( 28.5827503 sig in 9act.) RANK 6 NODE 15 --> 26.5783806 sigma out 1act.( 27.9654312 sig in 9act.) RANK 7 NODE 2 --> 18.3309116 sigma out 1act.( 19.3199635 sig in 9act.) RANK 8 NODE 11 --> 17.1552258 sigma out 1act.( 18.6647949 sig in 9act.) RANK 9 NODE 12 --> 13.4256973 sigma out 1act.( 14.6961794 sig in 9act.) RANK 10 NODE 7 --> 13.4220934 sigma out 1act.( 17.3500061 sig in 9act.) RANK 11 NODE 14 --> 13.037137 sigma out 1act.( 16.5121937 sig in 9act.) RANK 12 NODE 1 --> 9.9368515 sigma out 1act.( 14.6569386 sig in 9act.) RANK 13 NODE 6 --> 8.24057007 sigma out 1act.( 10.0537443 sig in 9act.) RANK 14 NODE 13 --> 3.87291241 sigma out 1act.( 8.44041157 sig in 9act.) RANK 15 NODE 10 --> 1.09780443 sigma out 1act.( 12.5111952 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 145.965942 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.13718468 *** contribution from regularisation: 0.0202124957 *** contribution from error: -0.157397181 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -4940.02028 -0.0314136259 173.350983 EXIT FROM BFGS code FG_LNSRCH 0. 0.168766856 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.597751558 *** contribution from regularisation: 0.00150462554 *** contribution from error: -0.599256158 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21525.0328 0.168766856 -16.1177177 EXIT FROM BFGS code FG_LNSRCH 0. 0.167274594 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.593811452 *** contribution from regularisation: 0.00537687773 *** contribution from error: -0.599188328 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21383.1495 0.167274594 -13.2136869 EXIT FROM BFGS code FG_LNSRCH 0. 0.168762311 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.595615745 *** contribution from regularisation: 0.00364023098 *** contribution from error: -0.599255979 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21448.1227 0.168762311 -14.2076769 EXIT FROM BFGS code FG_LNSRCH 0. 0.168766856 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.594929338 *** contribution from regularisation: 0.00432683481 *** contribution from error: -0.599256158 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -21423.4051 0.168766856 -13.7341337 EXIT FROM BFGS code NEW_X -21423.4051 0.168766856 -13.7341337 ENTER BFGS code NEW_X -21423.4051 0.168766856 -13.7341337 EXIT FROM BFGS code CONVERGENC -21423.4051 0.168766856 -13.7341337 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 35.7178001 sigma out 15 active outputs RANK 2 NODE 1 --> 20.9059486 sigma out 15 active outputs RANK 3 NODE 6 --> 16.1010551 sigma out 15 active outputs RANK 4 NODE 3 --> 13.7392235 sigma out 15 active outputs RANK 5 NODE 8 --> 12.4492836 sigma out 15 active outputs RANK 6 NODE 2 --> 10.8132877 sigma out 15 active outputs RANK 7 NODE 4 --> 8.07613277 sigma out 15 active outputs RANK 8 NODE 7 --> 7.38262033 sigma out 15 active outputs RANK 9 NODE 9 --> 6.38565493 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 32.0633163 sigma in 9act. ( 26.6886635 sig out 1act.) RANK 2 NODE 8 --> 25.0774117 sigma in 9act. ( 20.8128185 sig out 1act.) RANK 3 NODE 3 --> 23.6083946 sigma in 9act. ( 18.1711903 sig out 1act.) RANK 4 NODE 15 --> 10.6548872 sigma in 9act. ( 8.29875278 sig out 1act.) RANK 5 NODE 11 --> 7.12521696 sigma in 9act. ( 4.67037773 sig out 1act.) RANK 6 NODE 4 --> 6.97347212 sigma in 9act. ( 5.76258707 sig out 1act.) RANK 7 NODE 9 --> 5.73472404 sigma in 9act. ( 4.74465752 sig out 1act.) RANK 8 NODE 12 --> 5.21478844 sigma in 9act. ( 3.61987329 sig out 1act.) RANK 9 NODE 10 --> 5.17791796 sigma in 9act. ( 3.94811416 sig out 1act.) RANK 10 NODE 2 --> 4.89600086 sigma in 9act. ( 3.72386694 sig out 1act.) RANK 11 NODE 14 --> 4.86138105 sigma in 9act. ( 3.47843671 sig out 1act.) RANK 12 NODE 1 --> 3.29454064 sigma in 9act. ( 1.88531208 sig out 1act.) RANK 13 NODE 13 --> 3.07549953 sigma in 9act. ( 1.79791343 sig out 1act.) RANK 14 NODE 7 --> 2.53996539 sigma in 9act. ( 1.16814244 sig out 1act.) RANK 15 NODE 6 --> 2.18448091 sigma in 9act. ( 1.48140192 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 26.6886635 sigma out 1act.( 32.0633163 sig in 9act.) RANK 2 NODE 8 --> 20.8128185 sigma out 1act.( 25.0774117 sig in 9act.) RANK 3 NODE 3 --> 18.1711903 sigma out 1act.( 23.6083946 sig in 9act.) RANK 4 NODE 15 --> 8.29875278 sigma out 1act.( 10.6548872 sig in 9act.) RANK 5 NODE 4 --> 5.76258707 sigma out 1act.( 6.97347212 sig in 9act.) RANK 6 NODE 9 --> 4.74465752 sigma out 1act.( 5.73472404 sig in 9act.) RANK 7 NODE 11 --> 4.67037773 sigma out 1act.( 7.12521696 sig in 9act.) RANK 8 NODE 10 --> 3.94811416 sigma out 1act.( 5.17791796 sig in 9act.) RANK 9 NODE 2 --> 3.72386694 sigma out 1act.( 4.89600086 sig in 9act.) RANK 10 NODE 12 --> 3.61987329 sigma out 1act.( 5.21478844 sig in 9act.) RANK 11 NODE 14 --> 3.47843671 sigma out 1act.( 4.86138105 sig in 9act.) RANK 12 NODE 1 --> 1.88531208 sigma out 1act.( 3.29454064 sig in 9act.) RANK 13 NODE 13 --> 1.79791343 sigma out 1act.( 3.07549953 sig in 9act.) RANK 14 NODE 6 --> 1.48140192 sigma out 1act.( 2.18448091 sig in 9act.) RANK 15 NODE 7 --> 1.16814244 sigma out 1act.( 2.53996539 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 41.0737762 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.595230699 *** contribution from regularisation: 0.00402547279 *** contribution from error: -0.599256158 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25010 Closing output file done