NNInput NNInputs_185.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 173203 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 33403 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 33403 Chosen entries: 33403 Signal fraction: 1 Background fraction: 0.238934 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 33403 Entries to split: 33403 Test with : 16701 Train with : 16701 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 33403 for Signal Prepared event 0 for Signal with 33403 events ====Entry 0 Variable Ht : 147.006 Variable LepAPt : 30.5393 Variable LepBPt : 15.4876 Variable MetSigLeptonsJets : 2.11691 Variable MetSpec : 17.0117 Variable SumEtLeptonsJets : 123.482 Variable VSumJetLeptonsPt : 38.8269 Variable addEt : 69.5511 Variable dPhiLepSumMet : 0.952509 Variable dPhiLeptons : 0.431247 Variable dRLeptons : 0.583611 Variable lep1_E : 46.6216 Variable lep2_E : 18.2884 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2185 Ht = 147.006 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.5393 LepAPt = 30.5393 LepBEt = 15.4881 LepBPt = 15.4876 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 23.5237 MetDelPhi = 0.808389 MetSig = 1.71418 MetSigLeptonsJets = 2.11691 MetSpec = 17.0117 Mjj = 0 MostCentralJetEta = -1.43393 MtllMet = 76.1567 Njets = 1 SB = 0 SumEt = 188.32 SumEtJets = 0 SumEtLeptonsJets = 123.482 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 38.8269 addEt = 69.5511 dPhiLepSumMet = 0.952509 dPhiLeptons = 0.431247 dRLeptons = 0.583611 diltype = 52 dimass = 12.6791 event = 96 jet1_Et = 77.4552 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.6216 lep2_E = 18.2884 rand = 0.999742 run = 231298 weight = 2.74614e-06 ===Show End Prepared event 10000 for Signal with 33403 events Prepared event 20000 for Signal with 33403 events Prepared event 30000 for Signal with 33403 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.19504 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4368 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 173203 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4368 negative weights. Signal fraction: 61.942215 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1181221 65.0462189 66.5550613 67.9446106 68.8397827 69.8618011 70.7151871 71.5140076 72.4478226 73.3098297 74.0050812 74.5989075 75.4413757 76.0672531 76.8388824 77.3690948 78.0134506 78.6919861 79.2655487 79.8246536 80.682724 81.4056549 82.2061996 82.7941589 83.5934372 84.5494156 85.5345154 86.571022 87.9809875 89.1744843 90.5619354 92.1797028 93.6677017 95.2516937 96.6732407 98.4011765 100.053841 101.632919 103.380699 104.80896 106.385818 107.998688 109.635948 111.617996 113.36824 115.028671 116.969879 118.796494 120.368118 122.124496 123.848953 125.668243 127.500336 129.398621 130.956482 132.553406 134.207642 135.843933 137.353622 139.077454 140.743835 142.2547 143.98085 145.540314 147.096725 148.500275 150.325165 152.044861 153.77652 155.595276 157.373352 159.242691 161.104004 163.00618 164.882599 166.877899 168.80159 170.793396 173.21048 175.585739 178.058807 180.147339 183.026184 185.80278 188.66655 191.528366 195.08046 199.139664 203.464417 207.844574 212.604599 218.289612 224.251617 232.224426 240.962814 252.461884 267.61264 293.130096 341.815643 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0002613 20.3265743 20.650135 20.9512825 21.2420273 21.5046654 21.7599316 21.9674969 22.1826172 22.4128494 22.645607 22.881361 23.125412 23.3100433 23.5516777 23.7458115 23.9642639 24.2170639 24.45327 24.687973 24.8940773 25.1048355 25.298769 25.4795876 25.6473198 25.8393173 26.0539589 26.2744045 26.5227966 26.7857933 27.0178223 27.2308445 27.5227852 27.7452049 27.9950256 28.2623634 28.5132751 28.793335 29.0509853 29.2175808 29.4743385 29.7452507 30.018177 30.3310471 30.6451416 30.9973164 31.333271 31.6181812 31.868206 32.2101517 32.5522537 32.877533 33.2354126 33.588707 33.920929 34.3455582 34.7409325 35.1200981 35.4700623 35.9070129 36.2573891 36.6394768 37.020134 37.4544182 37.8514137 38.3698502 38.8256302 39.2346268 39.7008514 40.1582184 40.6865387 41.0199966 41.5825577 42.0693741 42.6231003 43.2068253 43.7992706 44.4332924 45.0492134 45.6770401 46.3188477 47.03582 47.8327332 48.6583862 49.4016571 50.2050476 51.0372009 51.9208679 52.8739395 53.8137512 54.8492012 56.1060791 57.394455 58.784729 60.2703171 61.9491043 64.0113373 66.652771 70.3511505 77.6711426 212.48645 ------------------------------ Transdef: Tab for variable 4 10.0003643 10.1400833 10.2520132 10.365633 10.4892378 10.6170292 10.7549324 10.8881874 10.9956093 11.1346531 11.2672224 11.4072104 11.5440998 11.6855259 11.8373947 11.9978294 12.1500454 12.3080845 12.4751644 12.6280136 12.7939587 12.9220505 13.0998459 13.2921438 13.4686165 13.650444 13.8403358 14.0448761 14.2225018 14.3725109 14.6027098 14.8209476 15.0189667 15.2060757 15.3831196 15.5605412 15.751771 15.8860598 16.1050034 16.3580437 16.5889969 16.841568 17.0821342 17.3460197 17.5975342 17.8060417 18.0019226 18.2493858 18.4777489 18.7511292 18.9681511 19.2146912 19.4724426 19.7484894 20.0311852 20.22019 20.4102859 20.6546173 20.9138069 21.1523552 21.3645477 21.5844193 21.8089619 22.0102768 22.2228775 22.45224 22.7045021 22.9321098 23.1864929 23.4432144 23.6860638 23.9488564 24.2176018 24.5022964 24.7765713 25.0357437 25.3236694 25.610405 25.9111366 26.2012558 26.5107422 26.8456078 27.1827507 27.5259418 27.8768463 28.2661514 28.7110138 29.1156998 29.5976028 30.0792084 30.5898132 31.2041969 31.7222328 32.3925018 33.0906601 33.89431 34.9282608 36.4054489 38.4489975 41.9243584 72.7606735 ------------------------------ Transdef: Tab for variable 5 1.0227313 2.72551465 3.15908861 3.49508429 3.7671442 3.98741341 4.1479454 4.27013683 4.4017334 4.50230789 4.61483002 4.71256304 4.80672932 4.90768528 4.9896841 5.06309175 5.12680244 5.19240475 5.26378441 5.32320881 5.3804636 5.43519783 5.49301529 5.5288353 5.58149719 5.63212252 5.67915058 5.72909784 5.78346109 5.83568859 5.88250351 5.93326187 5.98136711 6.02647495 6.07205582 6.11524677 6.15799618 6.20022202 6.24190044 6.27834225 6.31851768 6.35882711 6.40302706 6.45056343 6.49725628 6.55063343 6.60150528 6.65230656 6.70200062 6.74558067 6.78963089 6.83473969 6.87378883 6.92338467 6.98064804 7.03981543 7.09208727 7.14708042 7.19815731 7.24799824 7.29994583 7.36205673 7.41876125 7.48085117 7.52772808 7.59123516 7.64943027 7.70767021 7.77751732 7.83885956 7.8974762 7.96499443 8.03013706 8.08799648 8.15038109 8.21125126 8.27787018 8.34273148 8.40506554 8.47309303 8.54255104 8.61166 8.68972301 8.76692009 8.8424139 8.92254829 9.00692558 9.08967018 9.18845081 9.28876686 9.39116096 9.502285 9.63289165 9.78021812 9.96270943 10.1573181 10.4020224 10.759943 11.2293682 12.3179073 21.1559963 ------------------------------ Transdef: Tab for variable 6 15.0042896 21.0889931 25.4420776 26.5358715 27.4073105 28.326231 29.1803627 29.9284592 30.6990128 31.2705841 31.8718414 32.3745651 32.8891754 33.3633652 33.9051208 34.3947144 34.8045769 35.242527 35.7239227 36.1215172 36.4734573 36.850502 37.164856 37.5015106 37.8676376 38.2116241 38.624733 39.0701065 39.4595833 39.8648834 40.268013 40.564064 41.0070839 41.4831619 41.9070129 42.2939987 42.6769485 43.1154213 43.5477448 43.9578552 44.4900055 45.0042686 45.6576118 46.3787537 47.1412201 47.7359848 48.4258118 49.135994 49.7719154 50.4257584 51.162384 52.0055847 52.9283867 53.7668839 54.5147552 55.3356628 56.1293945 56.9668007 57.7507782 58.5347137 59.2861099 60.1693726 61.1199455 62.0039444 62.8195877 63.7410583 64.5577011 65.3904266 66.1218872 66.9756393 67.7960968 68.6907501 69.5571899 70.448494 71.233429 72.0688171 72.9848251 73.846138 74.705864 75.7134094 76.6673813 77.3356094 78.4227295 79.4076538 80.4138336 81.6728058 82.8066559 84.1307068 85.4746094 86.9093628 88.3952789 90.2235107 92.1323853 94.4209824 96.8090363 99.6674652 103.413834 108.565681 116.484192 128.447937 280.715759 ------------------------------ Transdef: Tab for variable 7 30.1484737 32.6468658 33.6397858 34.3122597 35.0746231 35.5652237 35.9481583 36.3094406 36.6726952 37.1027298 37.4569321 37.8013382 38.1015854 38.4097672 38.7722321 39.0051575 39.2723694 39.5380936 39.8451996 40.1739922 40.5826569 40.9533043 41.3239746 41.6401215 42.0300751 42.4470596 42.8640862 43.3899078 44.0683136 44.7264633 45.3892441 45.9968338 47.0648804 47.8953476 48.7589874 49.7034988 50.7791557 51.8071671 52.8852386 53.8325882 55.0774498 56.0061607 57.0261841 58.1020546 59.2164688 60.2257004 61.0351372 61.7090225 62.5792084 63.4903946 64.4173431 65.2498322 66.1473389 67.0378723 67.9944839 68.9406281 69.9230652 70.7789307 71.774353 72.6968384 73.7001419 74.6987915 75.7146606 76.7222672 77.6766205 78.6162567 79.7482224 80.9191971 82.0990372 83.346283 84.4758301 85.8908539 87.1069489 88.4545975 90.066391 91.4968262 93.2494354 95.0840225 96.7093964 98.4133911 100.298874 102.087784 104.232407 106.400406 108.770226 111.148819 113.530457 116.617905 119.502258 122.865082 126.641556 130.764084 135.933533 141.033707 147.259659 155.211029 164.635864 177.690918 196.984558 235.137299 517.957397 ------------------------------ Transdef: Tab for variable 8 3.10723281 24.6779861 29.1559868 31.0870628 31.9979095 32.7794075 33.3424835 33.856842 34.3511581 34.7516098 35.1093521 35.4375839 35.8451614 36.1055756 36.4568367 36.7615509 37.1289444 37.3732071 37.6609573 37.866333 38.1263275 38.4489594 38.6901474 38.9381943 39.2173004 39.5085754 39.8175507 40.1192551 40.4267349 40.787384 41.1104126 41.4482613 41.8108711 42.1535072 42.6327095 43.0527725 43.5768661 44.0358963 44.6564713 45.1737251 45.6939201 46.3521042 47.0199432 47.7565689 48.2605591 48.841732 49.478817 50.2217255 50.9502296 51.7034187 52.4298706 53.213192 53.9178772 54.7493286 55.4542007 56.2281952 57.0326653 57.8622055 58.6822891 59.4727554 60.2407684 60.9293594 61.5368118 62.325943 63.0053978 63.7486496 64.4446259 65.1948776 65.8781204 66.5799866 67.3111115 68.1961365 69.0225983 69.8452911 70.5696411 71.3578491 72.0783386 72.8999939 73.7020721 74.6473312 75.5398865 76.5186005 77.4707947 78.4897003 79.4350891 80.6479721 81.830246 83.0682144 84.4324341 85.8698807 87.3812943 89.1447372 90.8931885 93.1910858 96.0487595 99.5066986 103.806458 109.277626 118.074173 136.892761 326.868286 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7763062 64.4791107 66.1341858 67.3832092 68.4228821 69.2359924 70.1229706 70.8302612 71.5425873 72.3826523 73.1727753 73.8126755 74.3518829 75.104538 75.6881561 76.2647095 76.9083862 77.4443054 78.0146332 78.5822754 79.1025314 79.5795898 80.2368088 80.9621887 81.5722351 82.2084198 82.6884613 83.377655 84.0437775 84.7609024 85.7340393 86.571022 87.1856384 88.3865814 89.285141 90.2790451 91.4221115 92.8230972 93.9283905 95.2105103 96.3695984 97.8824005 99.2592163 100.832382 102.111237 103.698738 105.174973 106.670197 108.005768 109.639641 111.296783 112.77578 114.227875 115.723495 117.235481 118.720963 119.803215 121.186234 122.554924 123.990494 125.377289 126.756393 128.071838 129.581772 130.72049 132.017365 133.230286 134.544525 135.696335 136.857758 138.144104 139.540695 140.848755 141.998016 143.244232 144.426849 145.626358 146.880066 148.10022 149.374374 150.821777 152.167358 153.591812 154.993042 156.535492 158.026306 159.805145 161.534546 163.360168 165.119141 167.117722 169.47879 171.753723 174.52771 177.77713 181.500168 186.632843 194.636063 213.862854 385.879456 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.00403738 1.3624773 1.60850167 1.76091444 1.88598132 1.98266673 2.06716347 2.14560938 2.21423364 2.27349234 2.32545662 2.37541723 2.4150095 2.45538163 2.48745728 2.52021122 2.5481441 2.57495213 2.60017943 2.6272192 2.64993858 2.67357874 2.69575262 2.71494675 2.73291779 2.75005436 2.76685023 2.78018713 2.79517221 2.80930066 2.82272434 2.83473635 2.84482527 2.85598278 2.86460376 2.87438607 2.88404131 2.89331555 2.90229344 2.91044521 2.9168129 2.92382193 2.93075275 2.93846607 2.94599485 2.95248699 2.95911574 2.96570706 2.97233677 2.97813606 2.98313141 2.9872489 2.99196982 2.99591208 3.00143266 3.00618601 3.01118326 3.01567888 3.01997924 3.0240097 3.02831602 3.03178215 3.03562212 3.03944969 3.04299593 3.04718161 3.05135155 3.05483603 3.05806351 3.06148624 3.065207 3.06864119 3.07231474 3.07514858 3.07794833 3.08097792 3.08384705 3.08732629 3.08976269 3.09253597 3.09508753 3.09769893 3.10047245 3.10315752 3.10521054 3.10804415 3.11001635 3.11308193 3.11535931 3.11768007 3.12016201 3.1228621 3.12555075 3.12789679 3.12983274 3.13169789 3.13408971 3.13679075 3.13926601 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00610196125 0.0103573184 0.0160398427 0.0226572715 0.0295959115 0.0372582078 0.0451794863 0.0530723929 0.0591435507 0.0668494701 0.0743620098 0.0821708143 0.0897557139 0.0964592695 0.104841828 0.110563278 0.117392063 0.124856263 0.132942796 0.14013195 0.147527933 0.154162958 0.160833359 0.16746974 0.174202323 0.180282354 0.186461776 0.192370951 0.198286057 0.203823447 0.208877206 0.213736475 0.21917592 0.22480908 0.229949236 0.234231025 0.238702893 0.243938267 0.249062896 0.254534006 0.259243488 0.263733745 0.267691195 0.272994161 0.278019667 0.283159167 0.288603783 0.293507338 0.299155235 0.303545117 0.308868885 0.314005733 0.320009947 0.325183034 0.331585526 0.33661139 0.342585444 0.348215163 0.353244931 0.358323336 0.363717556 0.369331121 0.375398338 0.381399155 0.387266755 0.393069983 0.3990767 0.405031919 0.410977304 0.417863637 0.425238132 0.430871248 0.437714815 0.444420934 0.450657189 0.458985656 0.466513395 0.473927021 0.481425285 0.490643501 0.499960661 0.509553254 0.517721176 0.526513815 0.536849082 0.545176744 0.556959271 0.570443392 0.582689047 0.595371127 0.609218836 0.625282466 0.64090848 0.657477379 0.680479884 0.704011142 0.735078573 0.776964307 0.840616584 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.213359833 0.222887933 0.232009694 0.24073498 0.248693347 0.25508219 0.262258947 0.26914984 0.276271135 0.282679677 0.288993806 0.295975029 0.301953256 0.307415366 0.313335001 0.318683684 0.323988289 0.330104887 0.336004615 0.341405392 0.346444845 0.350448251 0.355627298 0.360259593 0.365389436 0.370281696 0.375737607 0.380669117 0.38606748 0.390703112 0.395394772 0.399522066 0.40349704 0.407489777 0.411585093 0.414976895 0.419003129 0.422667354 0.426148057 0.429824769 0.433656812 0.437300742 0.441036522 0.445088089 0.448991001 0.453472584 0.457181752 0.461044669 0.464761853 0.469222546 0.472982734 0.476502419 0.479542524 0.483520269 0.487176955 0.491313875 0.49549365 0.500213504 0.505444467 0.510463178 0.515725017 0.520963311 0.525623083 0.530697823 0.536048055 0.54178679 0.546872973 0.550628066 0.55617559 0.561970949 0.568154693 0.575235724 0.581789255 0.588230491 0.594875097 0.601138353 0.608062923 0.614837945 0.62209785 0.628697157 0.635877848 0.643321276 0.652247429 0.661671221 0.668740273 0.67787385 0.687158227 0.698549747 0.708356559 0.718732715 0.73009479 0.743064165 0.756452739 0.771204829 0.791916609 0.810695887 0.833204031 0.86388886 0.909335852 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.6021423 22.3976383 23.1333389 23.8287296 24.435421 24.8853951 25.3542957 25.8226318 26.2234306 26.7116966 27.216259 27.6621666 28.0762444 28.5046272 28.8530464 29.2106667 29.5439911 29.9016361 30.2884369 30.6236076 30.9848042 31.3469563 31.6861916 32.0301132 32.4091873 32.8193779 33.1863098 33.5893784 34.0007973 34.3449059 34.7417374 35.0994263 35.52351 35.9224243 36.1977463 36.6247139 36.971962 37.3155861 37.7236557 38.1816177 38.6110153 39.0786362 39.5255699 40.0221748 40.4637985 40.948288 41.4318848 41.9090919 42.4703827 42.9880981 43.3692322 43.8240776 44.2917175 44.7938614 45.2803116 45.7374268 46.3366241 46.7922707 47.371582 47.8685989 48.3939209 48.9716873 49.5241089 50.181221 50.791626 51.3739014 51.9998283 52.5966187 53.3073044 54.0258865 54.6557846 55.3092537 56.0099754 56.7038956 57.4731903 58.2548141 58.9075584 59.6827087 60.4857635 61.3972397 62.3742523 63.3425941 64.4280853 65.6277771 66.8566589 67.8813629 68.8704529 70.1096191 71.6960144 73.3366699 75.0465698 76.9204025 78.9018402 81.5921097 84.2197571 87.6026688 91.2664642 97.0563431 106.812729 316.641113 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.6386251 11.0988617 11.4674616 11.8803358 12.2725601 12.6313839 13.0148106 13.3748569 13.69417 14.0383167 14.3844414 14.6486511 14.9473724 15.2263813 15.5410328 15.8412905 16.1218739 16.4526634 16.7097225 16.9814949 17.2754402 17.5634727 17.8068581 18.0895329 18.3601837 18.6389866 18.9477482 19.1645775 19.437521 19.7689514 20.023344 20.3276596 20.6207123 20.8906174 21.1968956 21.4851284 21.7177086 21.9586029 22.216095 22.5102634 22.7755814 23.0592957 23.3181477 23.5400696 23.8108597 24.0610428 24.2930698 24.5836449 24.8712692 25.0860386 25.3336983 25.5607338 25.8005142 26.0524216 26.3165474 26.5775261 26.8889847 27.1351032 27.4253769 27.6927185 27.9557152 28.1655979 28.4245586 28.7063599 28.9822578 29.262043 29.5626125 29.8508072 30.2098846 30.5353775 30.8924294 31.2285004 31.5419579 31.8857994 32.2912788 32.7109756 33.0965042 33.4473801 33.8222847 34.2677307 34.7085953 35.1852989 35.687397 36.2982101 36.8595276 37.4462242 38.0610275 38.7502594 39.4964943 40.1755371 41.0539131 42.0607643 43.2513275 44.2887611 45.8107605 47.9314957 51.1008835 54.735527 60.4739761 115.518631 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.5 53.1 53.6 32.4 51.8 63.4 55.5 63.9 -25.6 -19.3 -41.4 18.1 21.6 2 65.5 100.0 69.8 59.5 42.6 72.0 94.7 78.0 92.7 -44.2 -25.6 -51.8 37.3 30.7 3 53.1 69.8 100.0 46.1 21.7 44.1 71.4 60.6 76.7 -13.6 -27.8 -58.7 66.7 22.5 4 53.6 59.5 46.1 100.0 17.7 37.8 61.1 50.9 63.0 -13.4 -30.5 -61.8 21.1 68.9 5 32.4 42.6 21.7 17.7 100.0 84.7 16.5 61.8 62.2 18.7 -10.0 -17.4 5.8 3.7 6 51.8 72.0 44.1 37.8 84.7 100.0 52.4 80.6 81.6 -8.9 -18.5 -34.4 19.0 15.6 7 63.4 94.7 71.4 61.1 16.5 52.4 100.0 70.3 82.0 -52.3 -24.6 -51.9 40.3 33.7 8 55.5 78.0 60.6 50.9 61.8 80.6 70.3 100.0 85.3 -13.2 -25.7 -47.1 32.8 26.8 9 63.9 92.7 76.7 63.0 62.2 81.6 82.0 85.3 100.0 -21.4 -28.4 -57.6 43.3 33.6 10 -25.6 -44.2 -13.6 -13.4 18.7 -8.9 -52.3 -13.2 -21.4 100.0 1.5 7.8 -4.4 -5.2 11 -19.3 -25.6 -27.8 -30.5 -10.0 -18.5 -24.6 -25.7 -28.4 1.5 100.0 54.7 -12.1 -17.9 12 -41.4 -51.8 -58.7 -61.8 -17.4 -34.4 -51.9 -47.1 -57.6 7.8 54.7 100.0 -31.2 -34.5 13 18.1 37.3 66.7 21.1 5.8 19.0 40.3 32.8 43.3 -4.4 -12.1 -31.2 100.0 46.0 14 21.6 30.7 22.5 68.9 3.7 15.6 33.7 26.8 33.6 -5.2 -17.9 -34.5 46.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 168.618252 TOTAL CORRELATION OF ALL VARIABLES 72.7690911 ROUND 1: MAX CORR ( 72.7630961) AFTER KILLING INPUT VARIABLE 11 CONTR 0.934063199 ROUND 2: MAX CORR ( 72.7432934) AFTER KILLING INPUT VARIABLE 8 CONTR 1.6974746 ROUND 3: MAX CORR ( 72.6824714) AFTER KILLING INPUT VARIABLE 2 CONTR 2.97406916 ROUND 4: MAX CORR ( 72.6125976) AFTER KILLING INPUT VARIABLE 12 CONTR 3.18626865 ROUND 5: MAX CORR ( 72.5179745) AFTER KILLING INPUT VARIABLE 14 CONTR 3.70576715 ROUND 6: MAX CORR ( 72.3456427) AFTER KILLING INPUT VARIABLE 6 CONTR 4.99645945 ROUND 7: MAX CORR ( 72.1195213) AFTER KILLING INPUT VARIABLE 10 CONTR 5.71547582 ROUND 8: MAX CORR ( 71.148526) AFTER KILLING INPUT VARIABLE 9 CONTR 11.7946007 ROUND 9: MAX CORR ( 69.6234779) AFTER KILLING INPUT VARIABLE 13 CONTR 14.6521013 ROUND 10: MAX CORR ( 69.2119752) AFTER KILLING INPUT VARIABLE 3 CONTR 7.55851592 ROUND 11: MAX CORR ( 67.1833155) AFTER KILLING INPUT VARIABLE 4 CONTR 16.6342909 ROUND 12: MAX CORR ( 63.3763905) AFTER KILLING INPUT VARIABLE 5 CONTR 22.2941921 LAST REMAINING VARIABLE: 7 total correlation to target: 72.7690911 % total significance: 119.809668 sigma correlations of single variables to target: variable 2: 65.504929 % , in sigma: 107.849688 variable 3: 53.1140642 % , in sigma: 87.4489196 variable 4: 53.5640679 % , in sigma: 88.1898219 variable 5: 32.4170394 % , in sigma: 53.3725881 variable 6: 51.7503854 % , in sigma: 85.2037092 variable 7: 63.3763905 % , in sigma: 104.345185 variable 8: 55.5019792 % , in sigma: 91.3804693 variable 9: 63.94095 % , in sigma: 105.274696 variable 10: -25.6131801 % , in sigma: 42.1704676 variable 11: -19.3112558 % , in sigma: 31.7947512 variable 12: -41.4104863 % , in sigma: 68.1797248 variable 13: 18.0751884 % , in sigma: 29.759645 variable 14: 21.5883577 % , in sigma: 35.5438542 variables sorted by significance: 1 most relevant variable 7 corr 63.3763924 , in sigma: 104.345188 2 most relevant variable 5 corr 22.2941914 , in sigma: 36.7059643 3 most relevant variable 4 corr 16.6342907 , in sigma: 27.3872988 4 most relevant variable 3 corr 7.55851603 , in sigma: 12.4446146 5 most relevant variable 13 corr 14.6521015 , in sigma: 24.1237507 6 most relevant variable 9 corr 11.7946005 , in sigma: 19.4190575 7 most relevant variable 10 corr 5.71547604 , in sigma: 9.4101668 8 most relevant variable 6 corr 4.99645948 , in sigma: 8.2263519 9 most relevant variable 14 corr 3.70576715 , in sigma: 6.10130929 10 most relevant variable 12 corr 3.18626857 , in sigma: 5.245988 11 most relevant variable 2 corr 2.97406912 , in sigma: 4.89661514 12 most relevant variable 8 corr 1.6974746 , in sigma: 2.79478368 13 most relevant variable 11 corr 0.934063196 , in sigma: 1.53787549 global correlations between input variables: variable 2: 99.2299365 % variable 3: 93.7269617 % variable 4: 91.2140445 % variable 5: 95.4233904 % variable 6: 94.4206657 % variable 7: 98.8361232 % variable 8: 90.9731022 % variable 9: 98.8934773 % variable 10: 71.5700561 % variable 11: 55.9010812 % variable 12: 78.1357063 % variable 13: 86.1589143 % variable 14: 86.8929151 % significance loss when removing single variables: variable 2: corr = 2.01368143 % , sigma = 3.31539806 variable 3: corr = 16.1966204 % , sigma = 26.6667025 variable 4: corr = 16.3511057 % , sigma = 26.9210528 variable 5: corr = 11.7869886 % , sigma = 19.4065251 variable 6: corr = 4.86028576 % , sigma = 8.00215055 variable 7: corr = 7.04790114 % , sigma = 11.6039198 variable 8: corr = 1.63195885 % , sigma = 2.68691618 variable 9: corr = 10.9223777 % , sigma = 17.9829984 variable 10: corr = 4.30480427 % , sigma = 7.0875857 variable 11: corr = 0.934063199 % , sigma = 1.53787549 variable 12: corr = 2.34544923 % , sigma = 3.86163259 variable 13: corr = 6.85076888 % , sigma = 11.2793541 variable 14: corr = 3.72366341 % , sigma = 6.13077434 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 12.0251369 sigma out 15 active outputs RANK 2 NODE 1 --> 11.9348497 sigma out 15 active outputs RANK 3 NODE 3 --> 11.6624966 sigma out 15 active outputs RANK 4 NODE 10 --> 10.5766096 sigma out 15 active outputs RANK 5 NODE 4 --> 10.4586439 sigma out 15 active outputs RANK 6 NODE 11 --> 10.3476915 sigma out 15 active outputs RANK 7 NODE 8 --> 10.3384514 sigma out 15 active outputs RANK 8 NODE 6 --> 10.036644 sigma out 15 active outputs RANK 9 NODE 9 --> 9.7807703 sigma out 15 active outputs RANK 10 NODE 7 --> 9.46606255 sigma out 15 active outputs RANK 11 NODE 5 --> 8.30164337 sigma out 15 active outputs RANK 12 NODE 2 --> 7.45530128 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 16.7545567 sigma in 12act. ( 18.472086 sig out 1act.) RANK 2 NODE 2 --> 12.5251331 sigma in 12act. ( 12.627099 sig out 1act.) RANK 3 NODE 8 --> 10.4120426 sigma in 12act. ( 8.64954567 sig out 1act.) RANK 4 NODE 5 --> 10.1500731 sigma in 12act. ( 11.3966522 sig out 1act.) RANK 5 NODE 4 --> 9.28238964 sigma in 12act. ( 9.37793732 sig out 1act.) RANK 6 NODE 10 --> 8.85750008 sigma in 12act. ( 8.21570683 sig out 1act.) RANK 7 NODE 1 --> 8.74715614 sigma in 12act. ( 10.3910589 sig out 1act.) RANK 8 NODE 13 --> 8.64848423 sigma in 12act. ( 7.85087585 sig out 1act.) RANK 9 NODE 7 --> 8.51767635 sigma in 12act. ( 9.40182304 sig out 1act.) RANK 10 NODE 12 --> 7.69217777 sigma in 12act. ( 8.18847942 sig out 1act.) RANK 11 NODE 3 --> 6.98582983 sigma in 12act. ( 8.84213448 sig out 1act.) RANK 12 NODE 11 --> 6.23952103 sigma in 12act. ( 6.35302305 sig out 1act.) RANK 13 NODE 6 --> 6.22547817 sigma in 12act. ( 7.25022745 sig out 1act.) RANK 14 NODE 15 --> 4.84240723 sigma in 12act. ( 3.94977498 sig out 1act.) RANK 15 NODE 14 --> 4.70661831 sigma in 12act. ( 5.34639978 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 18.472086 sigma out 1act.( 16.7545567 sig in 12act.) RANK 2 NODE 2 --> 12.627099 sigma out 1act.( 12.5251331 sig in 12act.) RANK 3 NODE 5 --> 11.3966522 sigma out 1act.( 10.1500731 sig in 12act.) RANK 4 NODE 1 --> 10.3910589 sigma out 1act.( 8.74715614 sig in 12act.) RANK 5 NODE 7 --> 9.40182304 sigma out 1act.( 8.51767635 sig in 12act.) RANK 6 NODE 4 --> 9.37793732 sigma out 1act.( 9.28238964 sig in 12act.) RANK 7 NODE 3 --> 8.84213448 sigma out 1act.( 6.98582983 sig in 12act.) RANK 8 NODE 8 --> 8.64954567 sigma out 1act.( 10.4120426 sig in 12act.) RANK 9 NODE 10 --> 8.21570683 sigma out 1act.( 8.85750008 sig in 12act.) RANK 10 NODE 12 --> 8.18847942 sigma out 1act.( 7.69217777 sig in 12act.) RANK 11 NODE 13 --> 7.85087585 sigma out 1act.( 8.64848423 sig in 12act.) RANK 12 NODE 6 --> 7.25022745 sigma out 1act.( 6.22547817 sig in 12act.) RANK 13 NODE 11 --> 6.35302305 sigma out 1act.( 6.23952103 sig in 12act.) RANK 14 NODE 14 --> 5.34639978 sigma out 1act.( 4.70661831 sig in 12act.) RANK 15 NODE 15 --> 3.94977498 sigma out 1act.( 4.84240723 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 37.4319916 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 23.708889 sigma out 15 active outputs RANK 2 NODE 1 --> 14.1611919 sigma out 15 active outputs RANK 3 NODE 3 --> 14.0212831 sigma out 15 active outputs RANK 4 NODE 4 --> 12.7223196 sigma out 15 active outputs RANK 5 NODE 11 --> 12.536993 sigma out 15 active outputs RANK 6 NODE 7 --> 12.2524128 sigma out 15 active outputs RANK 7 NODE 10 --> 12.2367191 sigma out 15 active outputs RANK 8 NODE 6 --> 11.9677715 sigma out 15 active outputs RANK 9 NODE 9 --> 11.6764107 sigma out 15 active outputs RANK 10 NODE 8 --> 11.6658039 sigma out 15 active outputs RANK 11 NODE 5 --> 10.1657228 sigma out 15 active outputs RANK 12 NODE 2 --> 8.93225861 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 19.6404209 sigma in 12act. ( 18.9253922 sig out 1act.) RANK 2 NODE 5 --> 14.4828911 sigma in 12act. ( 12.2476177 sig out 1act.) RANK 3 NODE 1 --> 13.949049 sigma in 12act. ( 11.8234568 sig out 1act.) RANK 4 NODE 2 --> 12.9976492 sigma in 12act. ( 11.9982157 sig out 1act.) RANK 5 NODE 3 --> 12.7730885 sigma in 12act. ( 10.3211155 sig out 1act.) RANK 6 NODE 7 --> 11.7147131 sigma in 12act. ( 9.6163044 sig out 1act.) RANK 7 NODE 6 --> 11.7076998 sigma in 12act. ( 8.34850979 sig out 1act.) RANK 8 NODE 13 --> 11.6287918 sigma in 12act. ( 7.09589005 sig out 1act.) RANK 9 NODE 10 --> 11.3584385 sigma in 12act. ( 7.9166193 sig out 1act.) RANK 10 NODE 14 --> 11.2901535 sigma in 12act. ( 6.1533637 sig out 1act.) RANK 11 NODE 12 --> 10.4412746 sigma in 12act. ( 8.56054592 sig out 1act.) RANK 12 NODE 4 --> 10.0533915 sigma in 12act. ( 9.26848316 sig out 1act.) RANK 13 NODE 8 --> 9.63751793 sigma in 12act. ( 7.16782045 sig out 1act.) RANK 14 NODE 11 --> 8.58117199 sigma in 12act. ( 6.27438831 sig out 1act.) RANK 15 NODE 15 --> 3.48319411 sigma in 12act. ( 1.96374559 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 18.9253922 sigma out 1act.( 19.6404209 sig in 12act.) RANK 2 NODE 5 --> 12.2476177 sigma out 1act.( 14.4828911 sig in 12act.) RANK 3 NODE 2 --> 11.9982157 sigma out 1act.( 12.9976492 sig in 12act.) RANK 4 NODE 1 --> 11.8234568 sigma out 1act.( 13.949049 sig in 12act.) RANK 5 NODE 3 --> 10.3211155 sigma out 1act.( 12.7730885 sig in 12act.) RANK 6 NODE 7 --> 9.6163044 sigma out 1act.( 11.7147131 sig in 12act.) RANK 7 NODE 4 --> 9.26848316 sigma out 1act.( 10.0533915 sig in 12act.) RANK 8 NODE 12 --> 8.56054592 sigma out 1act.( 10.4412746 sig in 12act.) RANK 9 NODE 6 --> 8.34850979 sigma out 1act.( 11.7076998 sig in 12act.) RANK 10 NODE 10 --> 7.9166193 sigma out 1act.( 11.3584385 sig in 12act.) RANK 11 NODE 8 --> 7.16782045 sigma out 1act.( 9.63751793 sig in 12act.) RANK 12 NODE 13 --> 7.09589005 sigma out 1act.( 11.6287918 sig in 12act.) RANK 13 NODE 11 --> 6.27438831 sigma out 1act.( 8.58117199 sig in 12act.) RANK 14 NODE 14 --> 6.1533637 sigma out 1act.( 11.2901535 sig in 12act.) RANK 15 NODE 15 --> 1.96374559 sigma out 1act.( 3.48319411 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.2792397 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.500513971 *** contribution from regularisation: 0.00504246075 *** contribution from error: -0.505556405 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.549678862 *** contribution from regularisation: 0.00281310244 *** contribution from error: -0.552491963 *********************************************** -----------------> Test sample ENTER BFGS code START -47611.4016 0.682741404 0.0111947916 EXIT FROM BFGS code FG_START 0. 0.682741404 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.571741521 *** contribution from regularisation: 0.00246643578 *** contribution from error: -0.574207962 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49513.3889 0.682741404 56.5708427 EXIT FROM BFGS code FG_LNSRCH 0. 0.71379894 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.584259629 *** contribution from regularisation: 0.00340077444 *** contribution from error: -0.587660432 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50597.4663 0.71379894 36.5400124 EXIT FROM BFGS code NEW_X -50597.4663 0.71379894 36.5400124 ENTER BFGS code NEW_X -50597.4663 0.71379894 36.5400124 EXIT FROM BFGS code FG_LNSRCH 0. 0.728032351 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.586755157 *** contribution from regularisation: 0.0032212222 *** contribution from error: -0.58997637 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50813.5829 0.728032351 -2.61641312 EXIT FROM BFGS code NEW_X -50813.5829 0.728032351 -2.61641312 ENTER BFGS code NEW_X -50813.5829 0.728032351 -2.61641312 EXIT FROM BFGS code FG_LNSRCH 0. 0.728652418 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.587799013 *** contribution from regularisation: 0.003047643 *** contribution from error: -0.590846658 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50903.9808 0.728652418 -13.5438461 EXIT FROM BFGS code NEW_X -50903.9808 0.728652418 -13.5438461 ENTER BFGS code NEW_X -50903.9808 0.728652418 -13.5438461 EXIT FROM BFGS code FG_LNSRCH 0. 0.7213462 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.588435948 *** contribution from regularisation: 0.00300857006 *** contribution from error: -0.591444492 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50959.1408 0.7213462 -21.6850815 EXIT FROM BFGS code NEW_X -50959.1408 0.7213462 -21.6850815 ENTER BFGS code NEW_X -50959.1408 0.7213462 -21.6850815 EXIT FROM BFGS code FG_LNSRCH 0. 0.698321104 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.589343786 *** contribution from regularisation: 0.00287019042 *** contribution from error: -0.592213988 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51037.7603 0.698321104 -21.3550282 EXIT FROM BFGS code NEW_X -51037.7603 0.698321104 -21.3550282 ENTER BFGS code NEW_X -51037.7603 0.698321104 -21.3550282 EXIT FROM BFGS code FG_LNSRCH 0. 0.602779567 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.590533674 *** contribution from regularisation: 0.00299621955 *** contribution from error: -0.59352988 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51140.8048 0.602779567 -26.2786598 EXIT FROM BFGS code NEW_X -51140.8048 0.602779567 -26.2786598 ENTER BFGS code NEW_X -51140.8048 0.602779567 -26.2786598 EXIT FROM BFGS code FG_LNSRCH 0. 0.499318928 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 32.4753494 sigma out 15 active outputs RANK 2 NODE 4 --> 16.8277416 sigma out 15 active outputs RANK 3 NODE 9 --> 15.5862942 sigma out 15 active outputs RANK 4 NODE 2 --> 15.1299992 sigma out 15 active outputs RANK 5 NODE 8 --> 14.1426859 sigma out 15 active outputs RANK 6 NODE 1 --> 12.4494562 sigma out 15 active outputs RANK 7 NODE 10 --> 9.71975327 sigma out 15 active outputs RANK 8 NODE 11 --> 9.02619362 sigma out 15 active outputs RANK 9 NODE 6 --> 7.93168354 sigma out 15 active outputs RANK 10 NODE 7 --> 7.91901684 sigma out 15 active outputs RANK 11 NODE 3 --> 7.84218693 sigma out 15 active outputs RANK 12 NODE 5 --> 6.89964771 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 22.2030926 sigma in 12act. ( 17.2164516 sig out 1act.) RANK 2 NODE 9 --> 20.1632252 sigma in 12act. ( 19.7307568 sig out 1act.) RANK 3 NODE 1 --> 20.0996475 sigma in 12act. ( 14.5283804 sig out 1act.) RANK 4 NODE 14 --> 16.4267216 sigma in 12act. ( 12.927206 sig out 1act.) RANK 5 NODE 6 --> 15.6733294 sigma in 12act. ( 9.92426872 sig out 1act.) RANK 6 NODE 7 --> 14.8261805 sigma in 12act. ( 13.753952 sig out 1act.) RANK 7 NODE 12 --> 12.7820997 sigma in 12act. ( 9.26072025 sig out 1act.) RANK 8 NODE 11 --> 11.1936588 sigma in 12act. ( 10.6096649 sig out 1act.) RANK 9 NODE 5 --> 9.90795231 sigma in 12act. ( 7.92719555 sig out 1act.) RANK 10 NODE 4 --> 6.22336435 sigma in 12act. ( 3.5971787 sig out 1act.) RANK 11 NODE 13 --> 5.66093349 sigma in 12act. ( 2.59128571 sig out 1act.) RANK 12 NODE 2 --> 5.59747076 sigma in 12act. ( 4.19224358 sig out 1act.) RANK 13 NODE 10 --> 5.09875202 sigma in 12act. ( 3.11934948 sig out 1act.) RANK 14 NODE 8 --> 4.50135708 sigma in 12act. ( 3.33544898 sig out 1act.) RANK 15 NODE 15 --> 1.13949811 sigma in 12act. ( 0.560876429 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 19.7307568 sigma out 1act.( 20.1632252 sig in 12act.) RANK 2 NODE 3 --> 17.2164516 sigma out 1act.( 22.2030926 sig in 12act.) RANK 3 NODE 1 --> 14.5283804 sigma out 1act.( 20.0996475 sig in 12act.) RANK 4 NODE 7 --> 13.753952 sigma out 1act.( 14.8261805 sig in 12act.) RANK 5 NODE 14 --> 12.927206 sigma out 1act.( 16.4267216 sig in 12act.) RANK 6 NODE 11 --> 10.6096649 sigma out 1act.( 11.1936588 sig in 12act.) RANK 7 NODE 6 --> 9.92426872 sigma out 1act.( 15.6733294 sig in 12act.) RANK 8 NODE 12 --> 9.26072025 sigma out 1act.( 12.7820997 sig in 12act.) RANK 9 NODE 5 --> 7.92719555 sigma out 1act.( 9.90795231 sig in 12act.) RANK 10 NODE 2 --> 4.19224358 sigma out 1act.( 5.59747076 sig in 12act.) RANK 11 NODE 4 --> 3.5971787 sigma out 1act.( 6.22336435 sig in 12act.) RANK 12 NODE 8 --> 3.33544898 sigma out 1act.( 4.50135708 sig in 12act.) RANK 13 NODE 10 --> 3.11934948 sigma out 1act.( 5.09875202 sig in 12act.) RANK 14 NODE 13 --> 2.59128571 sigma out 1act.( 5.66093349 sig in 12act.) RANK 15 NODE 15 --> 0.560876429 sigma out 1act.( 1.13949811 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 40.8793793 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.587671876 *** contribution from regularisation: 0.00314106164 *** contribution from error: -0.590812922 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50892.974 0.499318928 54.6968842 EXIT FROM BFGS code FG_LNSRCH 0. 0.588000178 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.590629995 *** contribution from regularisation: 0.00319357915 *** contribution from error: -0.593823552 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51149.1497 0.588000178 -11.2558804 EXIT FROM BFGS code NEW_X -51149.1497 0.588000178 -11.2558804 ENTER BFGS code NEW_X -51149.1497 0.588000178 -11.2558804 EXIT FROM BFGS code FG_LNSRCH 0. 0.577776313 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.591163337 *** contribution from regularisation: 0.00298548955 *** contribution from error: -0.594148815 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51195.3359 0.577776313 -11.9512892 EXIT FROM BFGS code NEW_X -51195.3359 0.577776313 -11.9512892 ENTER BFGS code NEW_X -51195.3359 0.577776313 -11.9512892 EXIT FROM BFGS code FG_LNSRCH 0. 0.550167382 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.591287076 *** contribution from regularisation: 0.00294917473 *** contribution from error: -0.594236255 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51206.0515 0.550167382 -5.30476713 EXIT FROM BFGS code NEW_X -51206.0515 0.550167382 -5.30476713 ENTER BFGS code NEW_X -51206.0515 0.550167382 -5.30476713 EXIT FROM BFGS code FG_LNSRCH 0. 0.495911658 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.591371477 *** contribution from regularisation: 0.00278081628 *** contribution from error: -0.594152272 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51213.3622 0.495911658 -8.13135338 EXIT FROM BFGS code NEW_X -51213.3622 0.495911658 -8.13135338 ENTER BFGS code NEW_X -51213.3622 0.495911658 -8.13135338 EXIT FROM BFGS code FG_LNSRCH 0. 0.401311785 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.591117442 *** contribution from regularisation: 0.00261164922 *** contribution from error: -0.593729079 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51191.3616 0.401311785 4.17195606 EXIT FROM BFGS code FG_LNSRCH 0. 0.474941105 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.590470433 *** contribution from regularisation: 0.00370735582 *** contribution from error: -0.594177783 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51135.3307 0.474941105 -3.5817616 EXIT FROM BFGS code FG_LNSRCH 0. 0.495337188 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.591145039 *** contribution from regularisation: 0.00300846179 *** contribution from error: -0.594153523 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51193.7533 0.495337188 -7.53540659 EXIT FROM BFGS code FG_LNSRCH 0. 0.49590975 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.591085196 *** contribution from regularisation: 0.00306713767 *** contribution from error: -0.594152331 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51188.5677 0.49590975 -7.35956478 EXIT FROM BFGS code FG_LNSRCH 0. 0.495911658 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.591091692 *** contribution from regularisation: 0.00306061376 *** contribution from error: -0.594152331 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51189.1315 0.495911658 -7.46102381 EXIT FROM BFGS code FG_LNSRCH 0. 0.495911658 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 29.8188324 sigma out 15 active outputs RANK 2 NODE 1 --> 13.6522875 sigma out 15 active outputs RANK 3 NODE 4 --> 13.2976246 sigma out 15 active outputs RANK 4 NODE 8 --> 13.1556978 sigma out 15 active outputs RANK 5 NODE 2 --> 13.1521044 sigma out 15 active outputs RANK 6 NODE 9 --> 12.2718296 sigma out 15 active outputs RANK 7 NODE 10 --> 9.98579979 sigma out 15 active outputs RANK 8 NODE 11 --> 8.63442993 sigma out 15 active outputs RANK 9 NODE 6 --> 8.17123032 sigma out 15 active outputs RANK 10 NODE 3 --> 8.13817215 sigma out 15 active outputs RANK 11 NODE 7 --> 7.97566032 sigma out 15 active outputs RANK 12 NODE 5 --> 7.12385082 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 3 --> 19.1154022 sigma in 12act. ( 15.2357979 sig out 1act.) RANK 2 NODE 9 --> 19.0751801 sigma in 12act. ( 17.9853077 sig out 1act.) RANK 3 NODE 1 --> 17.1455727 sigma in 12act. ( 12.8455353 sig out 1act.) RANK 4 NODE 14 --> 16.7743111 sigma in 12act. ( 13.0386934 sig out 1act.) RANK 5 NODE 6 --> 13.7199068 sigma in 12act. ( 9.30875206 sig out 1act.) RANK 6 NODE 7 --> 12.8506613 sigma in 12act. ( 11.9143343 sig out 1act.) RANK 7 NODE 12 --> 11.3415003 sigma in 12act. ( 8.55733967 sig out 1act.) RANK 8 NODE 11 --> 10.5300636 sigma in 12act. ( 9.97955799 sig out 1act.) RANK 9 NODE 5 --> 9.50548458 sigma in 12act. ( 7.48826027 sig out 1act.) RANK 10 NODE 2 --> 6.63032007 sigma in 12act. ( 5.25735426 sig out 1act.) RANK 11 NODE 10 --> 6.37592506 sigma in 12act. ( 4.56934023 sig out 1act.) RANK 12 NODE 4 --> 5.70814991 sigma in 12act. ( 3.65642715 sig out 1act.) RANK 13 NODE 8 --> 5.6781497 sigma in 12act. ( 4.64623737 sig out 1act.) RANK 14 NODE 13 --> 5.61141157 sigma in 12act. ( 2.55463576 sig out 1act.) RANK 15 NODE 15 --> 1.36927056 sigma in 12act. ( 0.810402334 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 17.9853077 sigma out 1act.( 19.0751801 sig in 12act.) RANK 2 NODE 3 --> 15.2357979 sigma out 1act.( 19.1154022 sig in 12act.) RANK 3 NODE 14 --> 13.0386934 sigma out 1act.( 16.7743111 sig in 12act.) RANK 4 NODE 1 --> 12.8455353 sigma out 1act.( 17.1455727 sig in 12act.) RANK 5 NODE 7 --> 11.9143343 sigma out 1act.( 12.8506613 sig in 12act.) RANK 6 NODE 11 --> 9.97955799 sigma out 1act.( 10.5300636 sig in 12act.) RANK 7 NODE 6 --> 9.30875206 sigma out 1act.( 13.7199068 sig in 12act.) RANK 8 NODE 12 --> 8.55733967 sigma out 1act.( 11.3415003 sig in 12act.) RANK 9 NODE 5 --> 7.48826027 sigma out 1act.( 9.50548458 sig in 12act.) RANK 10 NODE 2 --> 5.25735426 sigma out 1act.( 6.63032007 sig in 12act.) RANK 11 NODE 8 --> 4.64623737 sigma out 1act.( 5.6781497 sig in 12act.) RANK 12 NODE 10 --> 4.56934023 sigma out 1act.( 6.37592506 sig in 12act.) RANK 13 NODE 4 --> 3.65642715 sigma out 1act.( 5.70814991 sig in 12act.) RANK 14 NODE 13 --> 2.55463576 sigma out 1act.( 5.61141157 sig in 12act.) RANK 15 NODE 15 --> 0.810402334 sigma out 1act.( 1.36927056 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 37.9311523 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.591099977 *** contribution from regularisation: 0.0030523499 *** contribution from error: -0.594152331 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51189.8472 0.495911658 -7.58037949 EXIT FROM BFGS code FG_LNSRCH 0. 0.495911658 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.591070414 *** contribution from regularisation: 0.00308189099 *** contribution from error: -0.594152331 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51187.2889 0.495911658 -7.22755432 EXIT FROM BFGS code NEW_X -51187.2889 0.495911658 -7.22755432 ENTER BFGS code NEW_X -51187.2889 0.495911658 -7.22755432 EXIT FROM BFGS code CONVERGENC -51187.2889 0.495911658 -7.22755432 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 47.8011284 sigma out 15 active outputs RANK 2 NODE 2 --> 21.8096085 sigma out 15 active outputs RANK 3 NODE 1 --> 21.6665955 sigma out 15 active outputs RANK 4 NODE 8 --> 20.4694424 sigma out 15 active outputs RANK 5 NODE 9 --> 19.4789619 sigma out 15 active outputs RANK 6 NODE 4 --> 19.1385326 sigma out 15 active outputs RANK 7 NODE 10 --> 16.0452671 sigma out 15 active outputs RANK 8 NODE 11 --> 13.5399609 sigma out 15 active outputs RANK 9 NODE 6 --> 13.3856535 sigma out 15 active outputs RANK 10 NODE 7 --> 13.1346483 sigma out 15 active outputs RANK 11 NODE 3 --> 13.0060701 sigma out 15 active outputs RANK 12 NODE 5 --> 11.4704533 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 31.2758636 sigma in 12act. ( 30.0365658 sig out 1act.) RANK 2 NODE 3 --> 30.8776226 sigma in 12act. ( 25.2332191 sig out 1act.) RANK 3 NODE 1 --> 28.0342541 sigma in 12act. ( 20.4981518 sig out 1act.) RANK 4 NODE 14 --> 26.8410568 sigma in 12act. ( 21.2103176 sig out 1act.) RANK 5 NODE 6 --> 21.8141708 sigma in 12act. ( 14.5147524 sig out 1act.) RANK 6 NODE 7 --> 20.7917156 sigma in 12act. ( 19.1187515 sig out 1act.) RANK 7 NODE 12 --> 17.4706993 sigma in 12act. ( 13.7972164 sig out 1act.) RANK 8 NODE 11 --> 16.6200027 sigma in 12act. ( 15.7335424 sig out 1act.) RANK 9 NODE 5 --> 14.2449608 sigma in 12act. ( 12.5684729 sig out 1act.) RANK 10 NODE 2 --> 9.91171837 sigma in 12act. ( 8.574296 sig out 1act.) RANK 11 NODE 10 --> 9.00051498 sigma in 12act. ( 7.35262775 sig out 1act.) RANK 12 NODE 8 --> 8.33916473 sigma in 12act. ( 7.27513838 sig out 1act.) RANK 13 NODE 4 --> 7.99612045 sigma in 12act. ( 5.22483349 sig out 1act.) RANK 14 NODE 13 --> 6.51461792 sigma in 12act. ( 4.00119448 sig out 1act.) RANK 15 NODE 15 --> 1.51732695 sigma in 12act. ( 0.974930882 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 30.0365658 sigma out 1act.( 31.2758636 sig in 12act.) RANK 2 NODE 3 --> 25.2332191 sigma out 1act.( 30.8776226 sig in 12act.) RANK 3 NODE 14 --> 21.2103176 sigma out 1act.( 26.8410568 sig in 12act.) RANK 4 NODE 1 --> 20.4981518 sigma out 1act.( 28.0342541 sig in 12act.) RANK 5 NODE 7 --> 19.1187515 sigma out 1act.( 20.7917156 sig in 12act.) RANK 6 NODE 11 --> 15.7335424 sigma out 1act.( 16.6200027 sig in 12act.) RANK 7 NODE 6 --> 14.5147524 sigma out 1act.( 21.8141708 sig in 12act.) RANK 8 NODE 12 --> 13.7972164 sigma out 1act.( 17.4706993 sig in 12act.) RANK 9 NODE 5 --> 12.5684729 sigma out 1act.( 14.2449608 sig in 12act.) RANK 10 NODE 2 --> 8.574296 sigma out 1act.( 9.91171837 sig in 12act.) RANK 11 NODE 10 --> 7.35262775 sigma out 1act.( 9.00051498 sig in 12act.) RANK 12 NODE 8 --> 7.27513838 sigma out 1act.( 8.33916473 sig in 12act.) RANK 13 NODE 4 --> 5.22483349 sigma out 1act.( 7.99612045 sig in 12act.) RANK 14 NODE 13 --> 4.00119448 sigma out 1act.( 6.51461792 sig in 12act.) RANK 15 NODE 15 --> 0.974930882 sigma out 1act.( 1.51732695 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.691227 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.591134548 *** contribution from regularisation: 0.00301772798 *** contribution from error: -0.594152272 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done