NNInput NNInputs_185.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 172387 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 34955 nbkg = 137432 Bkg Entries: 137432 Sig Entries: 34955 Chosen entries: 34955 Signal fraction: 1 Background fraction: 0.254344 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 137432 Actual Signal Entries: 34955 Entries to split: 34955 Test with : 17477 Train with : 17477 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 34955 for Signal Prepared event 0 for Signal with 34955 events ====Entry 0 Variable Ht : 147.006 Variable LepAPt : 30.5393 Variable LepBPt : 15.4876 Variable MetSigLeptonsJets : 2.11691 Variable MetSpec : 17.0117 Variable SumEtLeptonsJets : 123.482 Variable VSumJetLeptonsPt : 38.8269 Variable addEt : 69.5511 Variable dPhiLepSumMet : 0.952509 Variable dPhiLeptons : 0.431247 Variable dRLeptons : 0.583611 Variable lep1_E : 46.6216 Variable lep2_E : 18.2884 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2185 Ht = 147.006 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.5393 LepAPt = 30.5393 LepBEt = 15.4881 LepBPt = 15.4876 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 23.5237 MetDelPhi = 0.808389 MetSig = 1.71418 MetSigLeptonsJets = 2.11691 MetSpec = 17.0117 Mjj = 0 MostCentralJetEta = -1.43393 MtllMet = 76.1567 Njets = 1 SB = 0 SumEt = 188.32 SumEtJets = 0 SumEtLeptonsJets = 123.482 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 38.8269 addEt = 69.5511 dPhiLepSumMet = 0.952509 dPhiLeptons = 0.431247 dRLeptons = 0.583611 diltype = 52 dimass = 12.6791 event = 96 jet1_Et = 77.4552 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.6216 lep2_E = 18.2884 rand = 0.999742 run = 231298 weight = 2.74614e-06 ===Show End Prepared event 10000 for Signal with 34955 events Prepared event 20000 for Signal with 34955 events Prepared event 30000 for Signal with 34955 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 137432 for Background Prepared event 0 for Background with 137432 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.250591 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 137432 events Prepared event 20000 for Background with 137432 events Prepared event 30000 for Background with 137432 events Prepared event 40000 for Background with 137432 events Prepared event 50000 for Background with 137432 events Prepared event 60000 for Background with 137432 events Prepared event 70000 for Background with 137432 events Prepared event 80000 for Background with 137432 events Prepared event 90000 for Background with 137432 events Prepared event 100000 for Background with 137432 events Prepared event 110000 for Background with 137432 events Prepared event 120000 for Background with 137432 events Prepared event 130000 for Background with 137432 events Warning: found 4431 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 172387 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4431 negative weights. Signal fraction: 62.7773628 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0091019 63.0204353 65.5200043 67.0294037 68.3112793 69.3942642 70.5228577 71.3599472 72.2422028 73.2279663 74.0440979 74.862114 75.4324341 76.121582 76.8577423 77.3185425 78.0703278 78.8646698 79.6387329 80.4260101 81.0075302 81.7458191 82.6543274 83.4747543 84.5707932 85.5778198 86.8030243 88.0958633 89.3358765 90.5894928 92.0504456 93.7231445 95.439827 97.1177673 98.6809235 100.170715 101.776108 103.380699 104.582329 105.998428 107.60405 109.484711 111.489761 113.356026 115.212532 117.000282 118.760132 120.152252 121.891983 123.730339 125.347824 127.075531 128.690903 130.436462 132.244873 133.696259 135.331131 136.968384 138.587753 140.108231 141.645111 143.170792 144.830093 146.356873 147.889542 149.533691 151.177017 152.948792 154.717377 156.605972 158.478088 160.337158 162.212784 164.039963 165.877411 167.713776 169.723816 172.01268 174.279572 176.571457 178.800201 181.337814 184.026443 186.996201 189.923279 192.883575 196.440918 200.317291 204.422363 208.900452 213.232727 218.352982 223.873199 230.914963 238.368958 247.504028 259.394928 276.14679 302.590912 361.623108 936.282959 ------------------------------ Transdef: Tab for variable 3 20.0009289 20.3970528 20.7210197 21.0331345 21.3072853 21.5365982 21.8192806 22.0803909 22.3180714 22.5507259 22.7569008 22.9628296 23.1999588 23.3732071 23.6024227 23.8453617 24.1126575 24.3685074 24.5861435 24.8173103 25.0443535 25.2646236 25.4928608 25.6880112 25.8988419 26.1467457 26.3940582 26.6490288 26.9109802 27.1336823 27.359211 27.6627922 27.8786964 28.1134644 28.3571186 28.6198959 28.8877831 29.1874657 29.4709282 29.7713013 30.1223869 30.4602737 30.7385597 31.0301132 31.3327522 31.6521301 31.8864937 32.1950607 32.5223503 32.8804855 33.2668648 33.6268539 34.0077362 34.4104004 34.7728157 35.1597748 35.5570183 35.9407501 36.3625679 36.74646 37.1004524 37.5191498 37.9203262 38.3829842 38.8781166 39.2340164 39.6764526 40.1221161 40.6415405 40.9593735 41.5084763 41.9976006 42.5340805 43.0674286 43.6231766 44.2205009 44.8541412 45.4694023 46.0858841 46.7870255 47.5131073 48.20681 48.9629669 49.7020111 50.4803772 51.3109093 52.2215538 53.1690521 54.1838074 55.3054352 56.5191345 57.823555 59.132019 60.6199951 62.1514053 64.0998535 66.4458694 69.2756348 74.2124023 82.5993652 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1269073 10.2829809 10.394146 10.5020027 10.6141243 10.7553005 10.8854122 11.0139389 11.1529865 11.3045807 11.4390039 11.5749102 11.7312746 11.8591385 12.0333271 12.2037277 12.3614874 12.5181856 12.6927414 12.8643208 13.0646362 13.2837448 13.4805145 13.667551 13.8365574 14.0014362 14.2012024 14.4252682 14.6355066 14.8293056 15.0492573 15.2450809 15.4635801 15.6968918 15.887929 16.1219082 16.3869553 16.599268 16.8188286 17.0471458 17.3041286 17.5678463 17.800539 17.9862728 18.2201157 18.475502 18.7447948 18.999752 19.2780914 19.5455475 19.7775803 20.0607758 20.2416859 20.4120922 20.6664734 20.9181042 21.1617088 21.3637905 21.5991364 21.8363686 22.0105553 22.2292023 22.4557953 22.7081146 22.9272919 23.1737022 23.4391785 23.6702118 23.9345322 24.2022705 24.4891548 24.7593746 25.0081692 25.2771721 25.5523338 25.8382835 26.1274948 26.4369221 26.7288437 27.0645161 27.4144211 27.7888203 28.1655064 28.5468292 28.9586716 29.3892517 29.8639336 30.3415031 30.8254051 31.3515377 31.9511871 32.5859909 33.2774429 34.0555801 34.9977417 36.1656876 37.7858124 40.1164322 44.4002228 95.9728546 ------------------------------ Transdef: Tab for variable 5 1.04557288 2.62195969 3.09126616 3.42656016 3.71727824 3.93040657 4.10975122 4.23729801 4.37021303 4.48799229 4.59861851 4.68654537 4.78776979 4.88364601 4.95714951 5.03437233 5.11401844 5.17398977 5.25321007 5.3126688 5.37088728 5.43622494 5.49089909 5.5266943 5.56851673 5.62449455 5.68114328 5.73200607 5.78189373 5.83096123 5.88942242 5.94014788 5.98831463 6.03355598 6.08265781 6.12145472 6.16525841 6.21160889 6.25684214 6.30096817 6.3499918 6.40055847 6.44780684 6.49231052 6.53911781 6.59114075 6.64071846 6.69101048 6.74916553 6.79680014 6.84488773 6.89432144 6.95300293 7.00017738 7.05601025 7.10426188 7.16177416 7.21285725 7.26563644 7.32360744 7.37757683 7.43035221 7.48364782 7.53295851 7.58702517 7.65065575 7.7119422 7.78533077 7.84099531 7.90063763 7.9551959 8.01546192 8.078475 8.13309097 8.19161987 8.24158669 8.30871964 8.37783146 8.43996048 8.50618935 8.57459927 8.65044403 8.72839451 8.80082321 8.88083839 8.96574974 9.05250549 9.13440609 9.22958946 9.32295418 9.43352222 9.5506649 9.69066906 9.8372364 10.0042858 10.1844654 10.4557552 10.7998829 11.3318796 12.4512043 21.1559963 ------------------------------ Transdef: Tab for variable 6 15.0050735 21.7045364 25.4917927 26.5358715 27.5714073 28.5413857 29.4155483 30.1944237 30.9382935 31.5567856 32.1340027 32.7026825 33.1871109 33.6764755 34.2212448 34.6991997 35.0467072 35.541687 35.957962 36.3767662 36.6929359 37.1038284 37.5343704 37.8676376 38.2828751 38.692894 39.1088448 39.5339203 39.9062004 40.2650375 40.6712494 41.130249 41.5759811 42.0527115 42.4377327 42.9062119 43.2928238 43.777813 44.3887482 45.0194778 45.6317787 46.1693726 46.90728 47.5215607 48.2428284 49.0381355 49.7833977 50.4059677 51.0661774 51.860714 52.7103271 53.4073715 54.175415 54.8548203 55.5747261 56.4203529 57.0885468 57.9040108 58.534893 59.276062 60.135704 60.9858131 61.7962646 62.7373276 63.5664444 64.3519058 65.2313614 65.9930115 66.8070602 67.6580048 68.4411392 69.314476 70.1960068 70.9894867 71.7917404 72.6366501 73.5642776 74.4282074 75.3152542 76.258812 76.8104553 77.8441696 78.8930054 79.9187775 81.0049896 82.1624451 83.3338318 84.5426102 85.8865051 87.3274078 89.0073395 90.6141815 92.5279236 94.9124527 97.5161133 100.610146 104.185638 109.439247 116.874863 129.121124 280.715759 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.5937691 33.6425018 34.4123535 34.9552765 35.5087738 36.0248299 36.4593124 36.9259262 37.3091736 37.6657906 38.0303726 38.388916 38.7370758 39.0288391 39.3045769 39.6190414 39.9704056 40.2970886 40.600914 41.0344696 41.449955 41.9143829 42.4425011 42.8822556 43.5108185 44.1619225 44.9055405 45.4652176 46.0243225 47.0079193 47.9473343 48.7721329 49.7953682 50.7975464 51.8258057 52.8860168 53.8751945 54.9715576 55.9652138 56.9908218 57.9607811 58.9915237 60.047142 60.968811 61.3548203 62.2906723 63.1602821 64.0740509 64.9462891 65.8040314 66.6953506 67.5646286 68.5149155 69.5111237 70.3962173 71.4253235 72.2195435 73.0845184 74.0110626 75.041153 76.1207275 76.9343719 78.0181122 79.1181183 80.4334488 81.6209106 82.5961761 83.8291016 85.0636749 86.5085831 87.8523102 89.2834778 90.7484436 92.2043304 93.8742142 95.6055756 97.3735962 99.1739502 101.068573 103.165192 105.193802 107.410995 109.969101 112.460083 114.873009 117.587418 120.91507 124.173576 127.900467 131.580231 136.024048 141.151535 147.363678 154.379181 162.176514 173.3069 187.196854 207.907227 253.494904 642.334534 ------------------------------ Transdef: Tab for variable 8 2.89562607 24.9270935 29.1252823 30.8971119 32.0498505 32.8180771 33.4353065 33.9019394 34.3697586 34.7764893 35.2198753 35.555603 35.9363289 36.2619934 36.6107254 36.9357605 37.2213707 37.545639 37.8740845 38.1847763 38.478447 38.7419319 38.990448 39.2804184 39.56633 39.8469315 40.1795959 40.5520096 40.9133759 41.3215866 41.784935 42.2195206 42.6513138 43.1188126 43.5795326 44.0246696 44.5425262 45.0229492 45.7255936 46.361351 47.0065918 47.6558685 48.2138176 48.7794724 49.4135704 50.1037407 50.8952713 51.6271439 52.3594055 53.0618286 53.8094025 54.5360947 55.3535919 56.1761703 56.9481049 57.6646309 58.3824921 59.162014 59.8845291 60.6433105 61.100502 61.8724899 62.577446 63.3134346 64.0028229 64.7093277 65.3802185 66.065834 66.761673 67.5166779 68.320488 69.135582 69.9386978 70.649498 71.3865433 72.0693359 72.8106079 73.661171 74.5614014 75.4383545 76.3587952 77.3982239 78.2732239 79.1703873 80.335495 81.4108429 82.64888 83.8265686 85.0822449 86.4976044 88.0753326 89.9288635 91.8587799 94.2770538 97.1005402 100.731209 105.035446 111.188385 119.714653 139.653625 326.868286 ------------------------------ Transdef: Tab for variable 9 49.4992676 62.8013802 64.816391 66.4997253 67.5832062 68.6827087 69.8079529 70.7077332 71.405899 72.2118835 73.0718765 73.8519058 74.577507 75.177681 75.6955109 76.3215256 76.9729462 77.3805847 78.0136108 78.6407013 79.3007431 79.8870697 80.6145477 81.1373291 81.7490311 82.5345001 83.2708282 84.0880737 84.7607346 85.7754822 86.6900024 87.4165039 88.5222244 89.3595581 90.4717712 91.6533203 92.9590302 94.509819 95.7473526 96.9063263 98.463089 99.8534088 101.365143 102.660583 104.19249 105.602692 106.804062 108.228729 109.861008 111.294266 112.707275 114.11409 115.451935 116.913055 118.312424 119.658638 120.677559 122.054619 123.635704 124.958824 126.470001 127.609383 128.923035 130.243439 131.518509 132.709045 133.908722 135.154083 136.290192 137.477631 138.778595 139.992554 141.25293 142.502411 143.694 145.022278 146.181885 147.439758 148.574173 149.950745 151.266541 152.647797 154.009674 155.567627 156.962418 158.53804 160.266418 162.056458 163.891266 165.691559 167.59697 169.7966 171.863953 174.432312 177.190002 180.616211 184.892014 190.703476 201.242477 229.276138 582.80835 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.886424899 1.29269004 1.5321703 1.71159184 1.84327984 1.94739807 2.02545595 2.10646915 2.17953396 2.24296808 2.30435061 2.3543539 2.39553142 2.43556452 2.46628666 2.49708319 2.52932954 2.55442643 2.58201718 2.60817528 2.63176489 2.65417051 2.67525005 2.69857502 2.71627474 2.73384547 2.75055695 2.76535583 2.78199148 2.79606628 2.80992413 2.82387018 2.83733273 2.84721494 2.85899901 2.86918402 2.87815595 2.88891411 2.89842319 2.9084425 2.9159596 2.92477202 2.93152571 2.93882966 2.94631386 2.95332384 2.95877934 2.96534967 2.97110891 2.97707391 2.98314762 2.98875356 2.99339294 2.99723482 3.00227928 3.00684214 3.01213765 3.0169692 3.02153683 3.02611971 3.02998137 3.03418851 3.03773618 3.04141974 3.04464149 3.04858685 3.05248737 3.05579281 3.05927682 3.06281042 3.06623363 3.06920195 3.07207823 3.07493186 3.07826972 3.08108282 3.08379054 3.08678055 3.08964109 3.09277558 3.09554434 3.09859252 3.10135698 3.10393214 3.10657716 3.10902977 3.1114831 3.11375332 3.11611509 3.11861229 3.12102389 3.12333298 3.12600708 3.12847447 3.13070488 3.13240385 3.13446259 3.13678598 3.13918805 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00559164584 0.00978124142 0.0162274279 0.0226304531 0.0290029049 0.0367134213 0.0443847179 0.0514605194 0.0591552258 0.0655173659 0.0724625587 0.0789013505 0.0855767727 0.0924632549 0.0992585421 0.10651052 0.110887334 0.117707476 0.1244663 0.131364226 0.138114214 0.144203305 0.15061605 0.156532586 0.162291408 0.168160319 0.174257517 0.180197716 0.185898423 0.191397935 0.196954489 0.202766061 0.20856069 0.213966995 0.219636559 0.22595346 0.231245875 0.235773891 0.241076946 0.246709764 0.252276242 0.257538915 0.262786984 0.267712772 0.273013204 0.278699338 0.283673882 0.288598597 0.294004142 0.29986915 0.305028915 0.310155839 0.316282868 0.322561264 0.328058124 0.333643556 0.339725792 0.345097482 0.350903422 0.357000411 0.362558246 0.367716789 0.374034435 0.379415035 0.385383725 0.391018629 0.396072984 0.402831197 0.409153223 0.415075898 0.422138691 0.429094076 0.435970783 0.441610873 0.448838413 0.456223488 0.464411974 0.471908092 0.47932446 0.487259895 0.496289194 0.50475651 0.514842272 0.524215221 0.534412503 0.542433321 0.553294301 0.566007316 0.57875669 0.59294796 0.60592258 0.622956634 0.642948985 0.657721221 0.679426908 0.705581784 0.738865912 0.778120399 0.83990562 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.100253433 0.165438235 0.187621325 0.201151639 0.214204818 0.224275067 0.233671278 0.242392436 0.251052856 0.258067071 0.265662313 0.273038089 0.280071288 0.286266804 0.292761385 0.299583673 0.305314362 0.311054707 0.316887975 0.323148638 0.328764945 0.334851444 0.340798318 0.346190959 0.350963831 0.355819166 0.36024946 0.365839779 0.371429324 0.376202047 0.380574465 0.385634542 0.391198128 0.396298826 0.40093559 0.404731989 0.408764541 0.412266374 0.41584006 0.41960597 0.423451751 0.427446365 0.431393415 0.435412765 0.43858254 0.442129254 0.445939422 0.45003581 0.45473963 0.458907396 0.463109583 0.467483491 0.471277297 0.474822074 0.477942735 0.48247534 0.486257255 0.490589589 0.495022923 0.499521971 0.504662395 0.50946337 0.514230251 0.519731045 0.525348067 0.530299067 0.536022544 0.540522575 0.546487212 0.550367773 0.555462539 0.560669661 0.566470504 0.572735906 0.579305649 0.585263014 0.59220165 0.59940356 0.606874228 0.615047336 0.621736526 0.629567087 0.637066841 0.646469951 0.654579282 0.663167238 0.671878755 0.679712534 0.690166891 0.70230931 0.71540153 0.726388335 0.739087343 0.753837228 0.771127939 0.788741589 0.807307839 0.831391811 0.86495024 0.907841206 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.7597466 22.5376244 23.2572765 23.7991905 24.4271774 24.9215508 25.3988724 25.9127579 26.4175835 26.9628525 27.3608284 27.7666569 28.1419144 28.5629845 28.9398003 29.3389931 29.7206154 30.0901031 30.4688091 30.8523445 31.1755943 31.5411491 31.9313488 32.3088837 32.6072311 33.0080299 33.4215012 33.8606415 34.2654724 34.5156937 34.9161835 35.3689117 35.7564583 36.1211243 36.4954224 36.944603 37.3120422 37.7159615 38.1367874 38.5811768 39.0093727 39.4774017 39.8381996 40.323822 40.8328514 41.2956009 41.7857475 42.324379 42.7612305 43.2336617 43.6556244 44.1554718 44.6531219 45.1805954 45.6495018 46.2043877 46.6921158 47.271553 47.8073425 48.3338242 48.9268646 49.5187073 50.1486282 50.6766891 51.2006073 51.7977371 52.3976135 53.0430984 53.7123108 54.4031258 55.0326004 55.6405296 56.3556442 57.1202469 57.9055862 58.6521187 59.4065094 60.2752495 61.0922852 62.0366135 62.9499817 64.0718384 64.9685669 66.0847931 67.1747437 68.1420746 69.1576385 70.4548721 71.8817062 73.4800797 75.3069763 77.4493332 79.5851593 81.9288788 85.3630829 87.877121 92.2407837 98.314743 109.554688 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.7723637 11.205513 11.6028519 11.9156265 12.2778559 12.564682 12.9053831 13.2633915 13.6156921 13.9362946 14.318737 14.631012 14.8974571 15.2343721 15.5422573 15.8573399 16.1171837 16.424633 16.6778336 16.9449291 17.2634506 17.6334419 17.9010696 18.1645813 18.378437 18.6536865 18.9370003 19.2010231 19.493454 19.8005486 20.0914268 20.389595 20.6331367 20.9436569 21.2784309 21.571701 21.8582687 22.0847282 22.345314 22.6034927 22.8964844 23.1372299 23.3750839 23.5798645 23.8330803 24.1013851 24.3720589 24.6635189 24.9223137 25.1557007 25.4357224 25.6853561 25.9555969 26.2078152 26.4917336 26.7872181 27.0818424 27.3506527 27.6575584 27.9453735 28.1260757 28.3689919 28.651741 28.9460449 29.2481995 29.5275459 29.8729897 30.2206535 30.5212231 30.8713722 31.2194405 31.5524025 31.8861809 32.2683258 32.6725922 33.0712509 33.4473915 33.7639618 34.1762238 34.6171875 35.0653954 35.5478745 36.1016388 36.6143417 37.181221 37.8048248 38.4648323 39.1999512 39.8668823 40.7192383 41.6026726 42.5366287 43.6540222 44.9903603 46.6277695 48.7734642 51.711132 55.8475952 62.7891579 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 63.8 51.9 53.1 29.0 48.9 61.8 53.5 62.3 -25.3 -21.3 -42.1 21.0 25.0 2 63.8 100.0 70.7 60.8 38.8 69.5 94.9 77.2 92.5 -44.3 -28.3 -54.4 41.6 34.8 3 51.9 70.7 100.0 48.3 19.1 42.9 72.2 60.8 77.7 -13.8 -31.0 -61.2 69.3 26.1 4 53.1 60.8 48.3 100.0 14.5 36.4 62.5 50.5 64.2 -14.7 -34.7 -65.6 26.1 72.0 5 29.0 38.8 19.1 14.5 100.0 84.0 13.1 60.9 59.2 21.1 -8.4 -14.0 6.5 2.8 6 48.9 69.5 42.9 36.4 84.0 100.0 50.0 79.9 80.1 -6.7 -18.7 -33.4 21.3 16.9 7 61.8 94.9 72.2 62.5 13.1 50.0 100.0 69.2 82.0 -52.7 -27.9 -54.9 43.8 37.5 8 53.5 77.2 60.8 50.5 60.9 79.9 69.2 100.0 85.1 -12.6 -26.7 -47.4 36.3 29.0 9 62.3 92.5 77.7 64.2 59.2 80.1 82.0 85.1 100.0 -20.8 -31.2 -60.1 47.9 37.5 10 -25.3 -44.3 -13.8 -14.7 21.1 -6.7 -52.7 -12.6 -20.8 100.0 2.6 9.6 -5.0 -7.6 11 -21.3 -28.3 -31.0 -34.7 -8.4 -18.7 -27.9 -26.7 -31.2 2.6 100.0 57.1 -17.5 -23.5 12 -42.1 -54.4 -61.2 -65.6 -14.0 -33.4 -54.9 -47.4 -60.1 9.6 57.1 100.0 -36.6 -40.4 13 21.0 41.6 69.3 26.1 6.5 21.3 43.8 36.3 47.9 -5.0 -17.5 -36.6 100.0 47.9 14 25.0 34.8 26.1 72.0 2.8 16.9 37.5 29.0 37.5 -7.6 -23.5 -40.4 47.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 165.215702 TOTAL CORRELATION OF ALL VARIABLES 70.5419441 ROUND 1: MAX CORR ( 70.5403111) AFTER KILLING INPUT VARIABLE 11 CONTR 0.479992459 ROUND 2: MAX CORR ( 70.518579) AFTER KILLING INPUT VARIABLE 8 CONTR 1.75085867 ROUND 3: MAX CORR ( 70.4612035) AFTER KILLING INPUT VARIABLE 12 CONTR 2.84407749 ROUND 4: MAX CORR ( 70.4071193) AFTER KILLING INPUT VARIABLE 14 CONTR 2.76020938 ROUND 5: MAX CORR ( 70.3475825) AFTER KILLING INPUT VARIABLE 2 CONTR 2.89483611 ROUND 6: MAX CORR ( 70.1525034) AFTER KILLING INPUT VARIABLE 6 CONTR 5.23532595 ROUND 7: MAX CORR ( 69.9180389) AFTER KILLING INPUT VARIABLE 10 CONTR 5.73075641 ROUND 8: MAX CORR ( 69.1458877) AFTER KILLING INPUT VARIABLE 9 CONTR 10.3623541 ROUND 9: MAX CORR ( 67.7769011) AFTER KILLING INPUT VARIABLE 13 CONTR 13.6910722 ROUND 10: MAX CORR ( 67.4361008) AFTER KILLING INPUT VARIABLE 3 CONTR 6.78827207 ROUND 11: MAX CORR ( 65.2912891) AFTER KILLING INPUT VARIABLE 4 CONTR 16.872322 ROUND 12: MAX CORR ( 61.8070314) AFTER KILLING INPUT VARIABLE 5 CONTR 21.0438426 LAST REMAINING VARIABLE: 7 total correlation to target: 70.5419441 % total significance: 118.020237 sigma correlations of single variables to target: variable 2: 63.7695034 % , in sigma: 106.689602 variable 3: 51.856101 % , in sigma: 86.7578776 variable 4: 53.0711672 % , in sigma: 88.7907447 variable 5: 28.9638219 % , in sigma: 48.4579378 variable 6: 48.8898273 % , in sigma: 81.7951517 variable 7: 61.8070314 % , in sigma: 103.406287 variable 8: 53.4829684 % , in sigma: 89.4797089 variable 9: 62.290832 % , in sigma: 104.21571 variable 10: -25.3169052 % , in sigma: 42.3564617 variable 11: -21.3206561 % , in sigma: 35.6705351 variable 12: -42.1222492 % , in sigma: 70.4726515 variable 13: 20.9674598 % , in sigma: 35.0796198 variable 14: 24.9967453 % , in sigma: 41.8208182 variables sorted by significance: 1 most relevant variable 7 corr 61.8070297 , in sigma: 103.406284 2 most relevant variable 5 corr 21.0438423 , in sigma: 35.2074117 3 most relevant variable 4 corr 16.8723221 , in sigma: 28.2282475 4 most relevant variable 3 corr 6.7882719 , in sigma: 11.3571219 5 most relevant variable 13 corr 13.6910725 , in sigma: 22.9058561 6 most relevant variable 9 corr 10.3623543 , in sigma: 17.3367424 7 most relevant variable 10 corr 5.73075628 , in sigma: 9.58784487 8 most relevant variable 6 corr 5.23532581 , in sigma: 8.75896465 9 most relevant variable 2 corr 2.89483619 , in sigma: 4.84320723 10 most relevant variable 14 corr 2.76020932 , in sigma: 4.61796968 11 most relevant variable 12 corr 2.84407759 , in sigma: 4.75828553 12 most relevant variable 8 corr 1.75085866 , in sigma: 2.92927503 13 most relevant variable 11 corr 0.479992449 , in sigma: 0.803051624 global correlations between input variables: variable 2: 99.2776146 % variable 3: 94.2917334 % variable 4: 92.0847338 % variable 5: 95.2205137 % variable 6: 93.9222202 % variable 7: 98.8983619 % variable 8: 90.7948648 % variable 9: 98.9742698 % variable 10: 71.980492 % variable 11: 57.9699412 % variable 12: 80.5261851 % variable 13: 86.9525817 % variable 14: 88.0446862 % significance loss when removing single variables: variable 2: corr = 1.85500399 % , sigma = 3.10351542 variable 3: corr = 15.0121288 % , sigma = 25.1160501 variable 4: corr = 15.3270567 % , sigma = 25.6429404 variable 5: corr = 10.891694 % , sigma = 18.2223545 variable 6: corr = 5.1876357 % , sigma = 8.67917669 variable 7: corr = 6.32652882 % , sigma = 10.5846024 variable 8: corr = 1.72419224 % , sigma = 2.88466075 variable 9: corr = 9.60329707 % , sigma = 16.0668013 variable 10: corr = 4.5057723 % , sigma = 7.53838475 variable 11: corr = 0.479992459 % , sigma = 0.803051641 variable 12: corr = 2.22400606 % , sigma = 3.72087452 variable 13: corr = 6.67947173 % , sigma = 11.1750938 variable 14: corr = 2.83500252 % , sigma = 4.74310249 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 26.6154213 sigma out 15 active outputs RANK 2 NODE 1 --> 25.0825825 sigma out 15 active outputs RANK 3 NODE 11 --> 19.8936977 sigma out 15 active outputs RANK 4 NODE 6 --> 17.655777 sigma out 15 active outputs RANK 5 NODE 7 --> 17.6218224 sigma out 15 active outputs RANK 6 NODE 8 --> 16.5986843 sigma out 15 active outputs RANK 7 NODE 2 --> 16.4012756 sigma out 15 active outputs RANK 8 NODE 5 --> 16.2054329 sigma out 15 active outputs RANK 9 NODE 4 --> 14.9677019 sigma out 15 active outputs RANK 10 NODE 9 --> 13.8117943 sigma out 15 active outputs RANK 11 NODE 3 --> 13.5396557 sigma out 15 active outputs RANK 12 NODE 12 --> 12.7660933 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 35.9558258 sigma in 12act. ( 35.5858879 sig out 1act.) RANK 2 NODE 1 --> 32.0782318 sigma in 12act. ( 31.6932964 sig out 1act.) RANK 3 NODE 9 --> 20.2561913 sigma in 12act. ( 18.8159657 sig out 1act.) RANK 4 NODE 11 --> 19.4683762 sigma in 12act. ( 18.0978394 sig out 1act.) RANK 5 NODE 13 --> 14.5114641 sigma in 12act. ( 11.636797 sig out 1act.) RANK 6 NODE 15 --> 13.1934795 sigma in 12act. ( 13.2048521 sig out 1act.) RANK 7 NODE 5 --> 12.407445 sigma in 12act. ( 11.9870653 sig out 1act.) RANK 8 NODE 14 --> 9.79035759 sigma in 12act. ( 9.68255329 sig out 1act.) RANK 9 NODE 8 --> 9.24808788 sigma in 12act. ( 8.40653992 sig out 1act.) RANK 10 NODE 3 --> 5.38197899 sigma in 12act. ( 5.16666508 sig out 1act.) RANK 11 NODE 7 --> 4.70408916 sigma in 12act. ( 4.37618828 sig out 1act.) RANK 12 NODE 10 --> 4.58054161 sigma in 12act. ( 6.12643337 sig out 1act.) RANK 13 NODE 12 --> 3.55199051 sigma in 12act. ( 1.24833655 sig out 1act.) RANK 14 NODE 2 --> 2.44115043 sigma in 12act. ( 2.09775281 sig out 1act.) RANK 15 NODE 6 --> 1.40288913 sigma in 12act. ( 0.690448284 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 35.5858879 sigma out 1act.( 35.9558258 sig in 12act.) RANK 2 NODE 1 --> 31.6932964 sigma out 1act.( 32.0782318 sig in 12act.) RANK 3 NODE 9 --> 18.8159657 sigma out 1act.( 20.2561913 sig in 12act.) RANK 4 NODE 11 --> 18.0978394 sigma out 1act.( 19.4683762 sig in 12act.) RANK 5 NODE 15 --> 13.2048521 sigma out 1act.( 13.1934795 sig in 12act.) RANK 6 NODE 5 --> 11.9870653 sigma out 1act.( 12.407445 sig in 12act.) RANK 7 NODE 13 --> 11.636797 sigma out 1act.( 14.5114641 sig in 12act.) RANK 8 NODE 14 --> 9.68255329 sigma out 1act.( 9.79035759 sig in 12act.) RANK 9 NODE 8 --> 8.40653992 sigma out 1act.( 9.24808788 sig in 12act.) RANK 10 NODE 10 --> 6.12643337 sigma out 1act.( 4.58054161 sig in 12act.) RANK 11 NODE 3 --> 5.16666508 sigma out 1act.( 5.38197899 sig in 12act.) RANK 12 NODE 7 --> 4.37618828 sigma out 1act.( 4.70408916 sig in 12act.) RANK 13 NODE 2 --> 2.09775281 sigma out 1act.( 2.44115043 sig in 12act.) RANK 14 NODE 12 --> 1.24833655 sigma out 1act.( 3.55199051 sig in 12act.) RANK 15 NODE 6 --> 0.690448284 sigma out 1act.( 1.40288913 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.4987755 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 29.2853527 sigma out 15 active outputs RANK 2 NODE 1 --> 23.7750378 sigma out 15 active outputs RANK 3 NODE 11 --> 19.8519783 sigma out 15 active outputs RANK 4 NODE 7 --> 17.0737591 sigma out 15 active outputs RANK 5 NODE 6 --> 16.8680248 sigma out 15 active outputs RANK 6 NODE 2 --> 15.7934313 sigma out 15 active outputs RANK 7 NODE 8 --> 15.7848816 sigma out 15 active outputs RANK 8 NODE 9 --> 15.1347694 sigma out 15 active outputs RANK 9 NODE 5 --> 14.2695303 sigma out 15 active outputs RANK 10 NODE 4 --> 13.3820791 sigma out 15 active outputs RANK 11 NODE 3 --> 13.0089874 sigma out 15 active outputs RANK 12 NODE 12 --> 11.9254303 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 37.0645027 sigma in 12act. ( 35.4496155 sig out 1act.) RANK 2 NODE 1 --> 27.1749249 sigma in 12act. ( 27.8520317 sig out 1act.) RANK 3 NODE 9 --> 16.450325 sigma in 12act. ( 15.1492424 sig out 1act.) RANK 4 NODE 11 --> 15.7571592 sigma in 12act. ( 15.2613668 sig out 1act.) RANK 5 NODE 15 --> 13.6021509 sigma in 12act. ( 12.312686 sig out 1act.) RANK 6 NODE 6 --> 13.0541611 sigma in 12act. ( 4.41434956 sig out 1act.) RANK 7 NODE 10 --> 12.7252836 sigma in 12act. ( 7.8144989 sig out 1act.) RANK 8 NODE 13 --> 12.5481739 sigma in 12act. ( 9.3637228 sig out 1act.) RANK 9 NODE 5 --> 10.7905216 sigma in 12act. ( 10.9660616 sig out 1act.) RANK 10 NODE 14 --> 10.6007929 sigma in 12act. ( 8.3438406 sig out 1act.) RANK 11 NODE 8 --> 9.94040585 sigma in 12act. ( 7.11318588 sig out 1act.) RANK 12 NODE 7 --> 7.23346281 sigma in 12act. ( 4.90768576 sig out 1act.) RANK 13 NODE 2 --> 7.0675211 sigma in 12act. ( 2.91336942 sig out 1act.) RANK 14 NODE 3 --> 6.58858681 sigma in 12act. ( 4.93874788 sig out 1act.) RANK 15 NODE 12 --> 5.96269846 sigma in 12act. ( 0.43783927 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 35.4496155 sigma out 1act.( 37.0645027 sig in 12act.) RANK 2 NODE 1 --> 27.8520317 sigma out 1act.( 27.1749249 sig in 12act.) RANK 3 NODE 11 --> 15.2613668 sigma out 1act.( 15.7571592 sig in 12act.) RANK 4 NODE 9 --> 15.1492424 sigma out 1act.( 16.450325 sig in 12act.) RANK 5 NODE 15 --> 12.312686 sigma out 1act.( 13.6021509 sig in 12act.) RANK 6 NODE 5 --> 10.9660616 sigma out 1act.( 10.7905216 sig in 12act.) RANK 7 NODE 13 --> 9.3637228 sigma out 1act.( 12.5481739 sig in 12act.) RANK 8 NODE 14 --> 8.3438406 sigma out 1act.( 10.6007929 sig in 12act.) RANK 9 NODE 10 --> 7.8144989 sigma out 1act.( 12.7252836 sig in 12act.) RANK 10 NODE 8 --> 7.11318588 sigma out 1act.( 9.94040585 sig in 12act.) RANK 11 NODE 3 --> 4.93874788 sigma out 1act.( 6.58858681 sig in 12act.) RANK 12 NODE 7 --> 4.90768576 sigma out 1act.( 7.23346281 sig in 12act.) RANK 13 NODE 6 --> 4.41434956 sigma out 1act.( 13.0541611 sig in 12act.) RANK 14 NODE 2 --> 2.91336942 sigma out 1act.( 7.0675211 sig in 12act.) RANK 15 NODE 12 --> 0.43783927 sigma out 1act.( 5.96269846 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.7878304 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.449609548 *** contribution from regularisation: 0.00518477429 *** contribution from error: -0.454794317 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.5125283 *** contribution from regularisation: 0.00266343635 *** contribution from error: -0.515191734 *********************************************** -----------------> Test sample ENTER BFGS code START -44184.9736 0.322727859 -0.125630021 EXIT FROM BFGS code FG_START 0. 0.322727859 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.552270949 *** contribution from regularisation: 0.00246337219 *** contribution from error: -0.554734349 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47601.8891 0.322727859 34.9022484 EXIT FROM BFGS code FG_LNSRCH 0. 0.33366856 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.574581146 *** contribution from regularisation: 0.00318322657 *** contribution from error: -0.577764392 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49524.874 0.33366856 29.4194717 EXIT FROM BFGS code NEW_X -49524.874 0.33366856 29.4194717 ENTER BFGS code NEW_X -49524.874 0.33366856 29.4194717 EXIT FROM BFGS code FG_LNSRCH 0. 0.342224747 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.576720536 *** contribution from regularisation: 0.00319574727 *** contribution from error: -0.579916298 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49709.2748 0.342224747 -0.537570894 EXIT FROM BFGS code NEW_X -49709.2748 0.342224747 -0.537570894 ENTER BFGS code NEW_X -49709.2748 0.342224747 -0.537570894 EXIT FROM BFGS code FG_LNSRCH 0. 0.33916378 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.57825762 *** contribution from regularisation: 0.00315505266 *** contribution from error: -0.581412673 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49841.7586 0.33916378 -11.943779 EXIT FROM BFGS code NEW_X -49841.7586 0.33916378 -11.943779 ENTER BFGS code NEW_X -49841.7586 0.33916378 -11.943779 EXIT FROM BFGS code FG_LNSRCH 0. 0.331969351 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.578944325 *** contribution from regularisation: 0.00309574208 *** contribution from error: -0.582040071 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49900.9477 0.331969351 -15.5826645 EXIT FROM BFGS code NEW_X -49900.9477 0.331969351 -15.5826645 ENTER BFGS code NEW_X -49900.9477 0.331969351 -15.5826645 EXIT FROM BFGS code FG_LNSRCH 0. 0.311836481 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.579957366 *** contribution from regularisation: 0.00314098992 *** contribution from error: -0.583098352 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49988.2676 0.311836481 -11.0247879 EXIT FROM BFGS code NEW_X -49988.2676 0.311836481 -11.0247879 ENTER BFGS code NEW_X -49988.2676 0.311836481 -11.0247879 EXIT FROM BFGS code FG_LNSRCH 0. 0.281488866 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.580976725 *** contribution from regularisation: 0.00306349667 *** contribution from error: -0.584040225 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50076.1283 0.281488866 -12.6904163 EXIT FROM BFGS code NEW_X -50076.1283 0.281488866 -12.6904163 ENTER BFGS code NEW_X -50076.1283 0.281488866 -12.6904163 EXIT FROM BFGS code FG_LNSRCH 0. 0.258565366 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 33.3532867 sigma out 15 active outputs RANK 2 NODE 9 --> 19.2318306 sigma out 15 active outputs RANK 3 NODE 1 --> 18.7888832 sigma out 15 active outputs RANK 4 NODE 2 --> 17.8727989 sigma out 15 active outputs RANK 5 NODE 8 --> 15.9752827 sigma out 15 active outputs RANK 6 NODE 6 --> 12.0685997 sigma out 15 active outputs RANK 7 NODE 11 --> 11.5337629 sigma out 15 active outputs RANK 8 NODE 12 --> 10.0232735 sigma out 15 active outputs RANK 9 NODE 7 --> 9.37408829 sigma out 15 active outputs RANK 10 NODE 5 --> 7.00719881 sigma out 15 active outputs RANK 11 NODE 3 --> 6.35663748 sigma out 15 active outputs RANK 12 NODE 4 --> 5.63384724 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 37.2288933 sigma in 12act. ( 27.8261948 sig out 1act.) RANK 2 NODE 10 --> 19.6565266 sigma in 12act. ( 17.545908 sig out 1act.) RANK 3 NODE 6 --> 19.644186 sigma in 12act. ( 15.2750311 sig out 1act.) RANK 4 NODE 14 --> 11.1224718 sigma in 12act. ( 11.1727676 sig out 1act.) RANK 5 NODE 1 --> 10.7329235 sigma in 12act. ( 8.92569637 sig out 1act.) RANK 6 NODE 2 --> 10.1331253 sigma in 12act. ( 9.65976715 sig out 1act.) RANK 7 NODE 3 --> 9.83622456 sigma in 12act. ( 6.64401388 sig out 1act.) RANK 8 NODE 15 --> 9.60518551 sigma in 12act. ( 8.83020401 sig out 1act.) RANK 9 NODE 5 --> 9.5592556 sigma in 12act. ( 8.68702507 sig out 1act.) RANK 10 NODE 8 --> 7.70194817 sigma in 12act. ( 6.62823105 sig out 1act.) RANK 11 NODE 9 --> 7.39180326 sigma in 12act. ( 7.01242685 sig out 1act.) RANK 12 NODE 7 --> 6.81786346 sigma in 12act. ( 4.97716045 sig out 1act.) RANK 13 NODE 11 --> 5.28391266 sigma in 12act. ( 2.72469521 sig out 1act.) RANK 14 NODE 13 --> 4.35213041 sigma in 12act. ( 1.30060697 sig out 1act.) RANK 15 NODE 12 --> 3.27076817 sigma in 12act. ( 1.47464192 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 27.8261948 sigma out 1act.( 37.2288933 sig in 12act.) RANK 2 NODE 10 --> 17.545908 sigma out 1act.( 19.6565266 sig in 12act.) RANK 3 NODE 6 --> 15.2750311 sigma out 1act.( 19.644186 sig in 12act.) RANK 4 NODE 14 --> 11.1727676 sigma out 1act.( 11.1224718 sig in 12act.) RANK 5 NODE 2 --> 9.65976715 sigma out 1act.( 10.1331253 sig in 12act.) RANK 6 NODE 1 --> 8.92569637 sigma out 1act.( 10.7329235 sig in 12act.) RANK 7 NODE 15 --> 8.83020401 sigma out 1act.( 9.60518551 sig in 12act.) RANK 8 NODE 5 --> 8.68702507 sigma out 1act.( 9.5592556 sig in 12act.) RANK 9 NODE 9 --> 7.01242685 sigma out 1act.( 7.39180326 sig in 12act.) RANK 10 NODE 3 --> 6.64401388 sigma out 1act.( 9.83622456 sig in 12act.) RANK 11 NODE 8 --> 6.62823105 sigma out 1act.( 7.70194817 sig in 12act.) RANK 12 NODE 7 --> 4.97716045 sigma out 1act.( 6.81786346 sig in 12act.) RANK 13 NODE 11 --> 2.72469521 sigma out 1act.( 5.28391266 sig in 12act.) RANK 14 NODE 12 --> 1.47464192 sigma out 1act.( 3.27076817 sig in 12act.) RANK 15 NODE 13 --> 1.30060697 sigma out 1act.( 4.35213041 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 44.0459061 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.581416607 *** contribution from regularisation: 0.00314585376 *** contribution from error: -0.58456248 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50114.0435 0.258565366 7.14653301 EXIT FROM BFGS code NEW_X -50114.0435 0.258565366 7.14653301 ENTER BFGS code NEW_X -50114.0435 0.258565366 7.14653301 EXIT FROM BFGS code FG_LNSRCH 0. 0.267473191 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.581650853 *** contribution from regularisation: 0.00304707605 *** contribution from error: -0.584697902 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50134.2335 0.267473191 -3.01468349 EXIT FROM BFGS code NEW_X -50134.2335 0.267473191 -3.01468349 ENTER BFGS code NEW_X -50134.2335 0.267473191 -3.01468349 EXIT FROM BFGS code FG_LNSRCH 0. 0.266400963 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.581839323 *** contribution from regularisation: 0.00291132345 *** contribution from error: -0.584750652 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50150.4778 0.266400963 -10.5227156 EXIT FROM BFGS code NEW_X -50150.4778 0.266400963 -10.5227156 ENTER BFGS code NEW_X -50150.4778 0.266400963 -10.5227156 EXIT FROM BFGS code FG_LNSRCH 0. 0.249273077 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.581901968 *** contribution from regularisation: 0.00259547634 *** contribution from error: -0.584497452 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50155.8786 0.249273077 -17.2499962 EXIT FROM BFGS code NEW_X -50155.8786 0.249273077 -17.2499962 ENTER BFGS code NEW_X -50155.8786 0.249273077 -17.2499962 EXIT FROM BFGS code FG_LNSRCH 0. 0.226832077 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.581807017 *** contribution from regularisation: 0.00276019238 *** contribution from error: -0.584567189 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50147.691 0.226832077 -40.8957329 EXIT FROM BFGS code FG_LNSRCH 0. 0.243929803 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.581175327 *** contribution from regularisation: 0.00339380931 *** contribution from error: -0.584569156 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50093.2433 0.243929803 -20.7563362 EXIT FROM BFGS code FG_LNSRCH 0. 0.249097064 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.581444979 *** contribution from regularisation: 0.00305489823 *** contribution from error: -0.584499896 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50116.4867 0.249097064 -16.7289276 EXIT FROM BFGS code FG_LNSRCH 0. 0.249272719 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.581506193 *** contribution from regularisation: 0.00299125514 *** contribution from error: -0.584497452 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50121.7653 0.249272719 -16.4856205 EXIT FROM BFGS code FG_LNSRCH 0. 0.249273077 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.581525743 *** contribution from regularisation: 0.00297170575 *** contribution from error: -0.584497452 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50123.4503 0.249273077 -16.6458206 EXIT FROM BFGS code FG_LNSRCH 0. 0.249273077 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.581445754 *** contribution from regularisation: 0.00305172242 *** contribution from error: -0.584497452 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50116.5534 0.249273077 -16.5500317 EXIT FROM BFGS code FG_LNSRCH 0. 0.249273077 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 33.0234108 sigma out 15 active outputs RANK 2 NODE 2 --> 18.0490341 sigma out 15 active outputs RANK 3 NODE 1 --> 16.6138115 sigma out 15 active outputs RANK 4 NODE 8 --> 15.6311474 sigma out 15 active outputs RANK 5 NODE 9 --> 14.2192812 sigma out 15 active outputs RANK 6 NODE 7 --> 11.6921749 sigma out 15 active outputs RANK 7 NODE 6 --> 10.3972292 sigma out 15 active outputs RANK 8 NODE 11 --> 9.86529064 sigma out 15 active outputs RANK 9 NODE 12 --> 9.70790386 sigma out 15 active outputs RANK 10 NODE 5 --> 8.43243599 sigma out 15 active outputs RANK 11 NODE 3 --> 6.27362871 sigma out 15 active outputs RANK 12 NODE 4 --> 5.13435602 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 33.4212608 sigma in 12act. ( 24.0612946 sig out 1act.) RANK 2 NODE 6 --> 20.6054401 sigma in 12act. ( 14.9994497 sig out 1act.) RANK 3 NODE 10 --> 19.2154484 sigma in 12act. ( 16.9796104 sig out 1act.) RANK 4 NODE 14 --> 11.1695299 sigma in 12act. ( 10.1468229 sig out 1act.) RANK 5 NODE 5 --> 10.20965 sigma in 12act. ( 8.74847507 sig out 1act.) RANK 6 NODE 1 --> 9.93762779 sigma in 12act. ( 7.35586405 sig out 1act.) RANK 7 NODE 2 --> 9.93179607 sigma in 12act. ( 8.77537346 sig out 1act.) RANK 8 NODE 3 --> 9.31191444 sigma in 12act. ( 5.54938221 sig out 1act.) RANK 9 NODE 8 --> 9.1758852 sigma in 12act. ( 7.43751431 sig out 1act.) RANK 10 NODE 15 --> 8.48390579 sigma in 12act. ( 6.99983168 sig out 1act.) RANK 11 NODE 9 --> 7.31659842 sigma in 12act. ( 6.27871418 sig out 1act.) RANK 12 NODE 7 --> 5.51164818 sigma in 12act. ( 3.32426572 sig out 1act.) RANK 13 NODE 11 --> 4.99000883 sigma in 12act. ( 2.19778991 sig out 1act.) RANK 14 NODE 13 --> 3.88994861 sigma in 12act. ( 0.421935111 sig out 1act.) RANK 15 NODE 12 --> 2.83494496 sigma in 12act. ( 0.604612887 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 24.0612946 sigma out 1act.( 33.4212608 sig in 12act.) RANK 2 NODE 10 --> 16.9796104 sigma out 1act.( 19.2154484 sig in 12act.) RANK 3 NODE 6 --> 14.9994497 sigma out 1act.( 20.6054401 sig in 12act.) RANK 4 NODE 14 --> 10.1468229 sigma out 1act.( 11.1695299 sig in 12act.) RANK 5 NODE 2 --> 8.77537346 sigma out 1act.( 9.93179607 sig in 12act.) RANK 6 NODE 5 --> 8.74847507 sigma out 1act.( 10.20965 sig in 12act.) RANK 7 NODE 8 --> 7.43751431 sigma out 1act.( 9.1758852 sig in 12act.) RANK 8 NODE 1 --> 7.35586405 sigma out 1act.( 9.93762779 sig in 12act.) RANK 9 NODE 15 --> 6.99983168 sigma out 1act.( 8.48390579 sig in 12act.) RANK 10 NODE 9 --> 6.27871418 sigma out 1act.( 7.31659842 sig in 12act.) RANK 11 NODE 3 --> 5.54938221 sigma out 1act.( 9.31191444 sig in 12act.) RANK 12 NODE 7 --> 3.32426572 sigma out 1act.( 5.51164818 sig in 12act.) RANK 13 NODE 11 --> 2.19778991 sigma out 1act.( 4.99000883 sig in 12act.) RANK 14 NODE 12 --> 0.604612887 sigma out 1act.( 2.83494496 sig in 12act.) RANK 15 NODE 13 --> 0.421935111 sigma out 1act.( 3.88994861 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 39.9224663 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.581463575 *** contribution from regularisation: 0.00303392299 *** contribution from error: -0.584497511 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50118.0876 0.249273077 -16.620945 EXIT FROM BFGS code NEW_X -50118.0876 0.249273077 -16.620945 ENTER BFGS code NEW_X -50118.0876 0.249273077 -16.620945 EXIT FROM BFGS code CONVERGENC -50118.0876 0.249273077 -16.620945 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 53.837368 sigma out 15 active outputs RANK 2 NODE 2 --> 30.8056641 sigma out 15 active outputs RANK 3 NODE 9 --> 27.458395 sigma out 15 active outputs RANK 4 NODE 1 --> 27.1772137 sigma out 15 active outputs RANK 5 NODE 8 --> 25.4328918 sigma out 15 active outputs RANK 6 NODE 7 --> 19.2806931 sigma out 15 active outputs RANK 7 NODE 6 --> 17.7212639 sigma out 15 active outputs RANK 8 NODE 11 --> 16.4591427 sigma out 15 active outputs RANK 9 NODE 12 --> 15.9694624 sigma out 15 active outputs RANK 10 NODE 5 --> 13.1835299 sigma out 15 active outputs RANK 11 NODE 3 --> 9.93078995 sigma out 15 active outputs RANK 12 NODE 4 --> 8.12029743 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 55.5187187 sigma in 12act. ( 45.1401482 sig out 1act.) RANK 2 NODE 10 --> 34.4374046 sigma in 12act. ( 29.4508018 sig out 1act.) RANK 3 NODE 6 --> 32.8638992 sigma in 12act. ( 28.6324177 sig out 1act.) RANK 4 NODE 14 --> 20.5525608 sigma in 12act. ( 17.8427658 sig out 1act.) RANK 5 NODE 5 --> 18.5688477 sigma in 12act. ( 16.9365311 sig out 1act.) RANK 6 NODE 2 --> 17.9872837 sigma in 12act. ( 16.4442387 sig out 1act.) RANK 7 NODE 1 --> 15.3457508 sigma in 12act. ( 14.9151001 sig out 1act.) RANK 8 NODE 8 --> 14.3921547 sigma in 12act. ( 14.1992922 sig out 1act.) RANK 9 NODE 15 --> 14.0306787 sigma in 12act. ( 13.2788696 sig out 1act.) RANK 10 NODE 3 --> 13.694972 sigma in 12act. ( 11.614481 sig out 1act.) RANK 11 NODE 9 --> 12.2395258 sigma in 12act. ( 11.425045 sig out 1act.) RANK 12 NODE 7 --> 7.74876022 sigma in 12act. ( 6.27058029 sig out 1act.) RANK 13 NODE 11 --> 6.06842279 sigma in 12act. ( 4.70221233 sig out 1act.) RANK 14 NODE 13 --> 3.92177558 sigma in 12act. ( 0.87497282 sig out 1act.) RANK 15 NODE 12 --> 2.96368742 sigma in 12act. ( 1.32816911 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 45.1401482 sigma out 1act.( 55.5187187 sig in 12act.) RANK 2 NODE 10 --> 29.4508018 sigma out 1act.( 34.4374046 sig in 12act.) RANK 3 NODE 6 --> 28.6324177 sigma out 1act.( 32.8638992 sig in 12act.) RANK 4 NODE 14 --> 17.8427658 sigma out 1act.( 20.5525608 sig in 12act.) RANK 5 NODE 5 --> 16.9365311 sigma out 1act.( 18.5688477 sig in 12act.) RANK 6 NODE 2 --> 16.4442387 sigma out 1act.( 17.9872837 sig in 12act.) RANK 7 NODE 1 --> 14.9151001 sigma out 1act.( 15.3457508 sig in 12act.) RANK 8 NODE 8 --> 14.1992922 sigma out 1act.( 14.3921547 sig in 12act.) RANK 9 NODE 15 --> 13.2788696 sigma out 1act.( 14.0306787 sig in 12act.) RANK 10 NODE 3 --> 11.614481 sigma out 1act.( 13.694972 sig in 12act.) RANK 11 NODE 9 --> 11.425045 sigma out 1act.( 12.2395258 sig in 12act.) RANK 12 NODE 7 --> 6.27058029 sigma out 1act.( 7.74876022 sig in 12act.) RANK 13 NODE 11 --> 4.70221233 sigma out 1act.( 6.06842279 sig in 12act.) RANK 14 NODE 12 --> 1.32816911 sigma out 1act.( 2.96368742 sig in 12act.) RANK 15 NODE 13 --> 0.87497282 sigma out 1act.( 3.92177558 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 74.3654404 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.581485808 *** contribution from regularisation: 0.00301167695 *** contribution from error: -0.584497511 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done