NNInput NNInputs_195.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 14816 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 1985 nbkg = 12831 Bkg Entries: 12831 Sig Entries: 1985 Chosen entries: 1985 Warning: entries low (below 6000) Signal fraction: 1 Background fraction: 0.154703 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 12831 Actual Signal Entries: 1985 Entries to split: 1985 Test with : 992 Train with : 992 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 1985 for Signal Prepared event 0 for Signal with 1985 events ====Entry 0 Variable Ht : 235.185 Variable LepAPt : 61.3941 Variable LepBPt : 19.6569 Variable MetSigLeptonsJets : 9.27285 Variable MetSpec : 105.57 Variable SumEtLeptonsJets : 129.614 Variable VSumJetLeptonsPt : 96.9973 Variable addEt : 186.621 Variable dPhiLepSumMet : 2.61896 Variable dPhiLeptons : 0.0385032 Variable dRLeptons : 0.438198 Variable lep1_E : 62.5515 Variable lep2_E : 20.2388 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2195 Ht = 235.185 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 61.3941 LepAPt = 61.3941 LepBEt = 19.6573 LepBPt = 19.6569 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 105.57 MetDelPhi = 2.15513 MetSig = 8.07992 MetSigLeptonsJets = 9.27285 MetSpec = 105.57 Mjj = 0 MostCentralJetEta = -2.00364 MtllMet = 188.224 Njets = 1 SB = 0 SumEt = 170.713 SumEtJets = 0 SumEtLeptonsJets = 129.614 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 96.9973 addEt = 186.621 dPhiLepSumMet = 2.61896 dPhiLeptons = 0.0385032 dRLeptons = 0.438198 diltype = 58 dimass = 15.3455 event = 46 jet1_Et = 48.5634 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 62.5515 lep2_E = 20.2388 rand = 0.999742 run = 228581 weight = 2.19139e-06 ===Show End Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 12831 for Background Prepared event 0 for Background with 12831 events ====Entry 0 Variable Ht : 61.1273 Variable LepAPt : 22.7899 Variable LepBPt : 11.7315 Variable MetSigLeptonsJets : 4.52817 Variable MetSpec : 26.6052 Variable SumEtLeptonsJets : 34.5213 Variable VSumJetLeptonsPt : 31.9684 Variable addEt : 61.1273 Variable dPhiLepSumMet : 2.92616 Variable dPhiLeptons : 0.819534 Variable dRLeptons : 0.934366 Variable lep1_E : 23.1166 Variable lep2_E : 12.194 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 61.1273 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 22.7899 LepAPt = 22.7899 LepBEt = 11.7322 LepBPt = 11.7315 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 26.6052 MetDelPhi = 2.37814 MetSig = 2.46258 MetSigLeptonsJets = 4.52817 MetSpec = 26.6052 Mjj = 0 MostCentralJetEta = 0 MtllMet = 61.9133 Njets = 0 SB = 0 SumEt = 116.722 SumEtJets = 0 SumEtLeptonsJets = 34.5213 Target = 0 TrainWeight = 1.09235 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 31.9684 addEt = 61.1273 dPhiLepSumMet = 2.92616 dPhiLeptons = 0.819534 dRLeptons = 0.934366 diltype = 54 dimass = 14.9851 event = 1421455 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 23.1166 lep2_E = 12.194 rand = 0.999742 run = 271216 weight = 0.0400324 ===Show End Prepared event 10000 for Background with 12831 events Warning: found 420 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 14816 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 420 negative weights. Signal fraction: 75.2698517 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 55.8076553 62.8013802 67.3899689 69.8692322 71.0066681 72.0430756 74.3200836 75.2408905 75.934967 77.0368805 77.1521072 78.5751648 79.6004486 80.9575043 81.0013199 81.2171783 82.6408386 83.411972 84.6834259 85.8120804 86.7841034 87.5503998 88.6497345 89.770752 91.651619 92.839035 93.9305573 95.2037201 97.3902893 98.0100555 98.8409653 99.3769989 101.151802 101.886444 103.0597 104.404938 105.51017 106.166916 106.858002 107.959496 109.050407 111.222275 112.558632 113.392128 113.919983 114.888184 116.54184 117.503128 118.67897 120.636314 122.025703 123.43837 124.482018 125.875565 126.966187 128.392105 129.033417 129.863373 131.166382 132.478531 133.371902 133.792114 135.652313 136.810242 139.21933 141.512421 142.608047 143.600494 144.568008 146.120544 148.188141 149.590485 151.321533 153.867752 155.575806 157.973602 160.229355 162.696579 164.346222 166.566132 167.892929 169.254059 171.725449 173.442505 175.83371 180.773865 183.396057 188.588837 192.330017 197.284576 199.64267 205.887421 211.122284 215.529602 225.262604 238.999298 251.544342 272.234375 281.13205 304.565826 850.621887 ------------------------------ Transdef: Tab for variable 3 20.0002613 20.5753632 21.0313568 21.1860161 21.4980583 21.5781479 21.8515091 22.02001 22.3668098 22.5667915 22.7140617 22.8134937 23.061121 23.3042622 23.4650078 23.6053123 23.6948013 23.9889908 24.3704185 24.8356781 25.004097 25.2076759 25.2569771 25.3228703 25.5870914 25.7947235 26.1040268 26.263504 26.5089302 26.8137398 27.0202999 27.1342621 27.3640118 27.6600266 27.813324 27.8784542 28.1059036 28.3347282 28.5412865 28.6305618 28.9369869 29.0935249 29.3112049 29.6585846 29.7778111 30.0199852 30.3826447 30.7050495 30.9791031 31.3423653 31.6649818 31.7490349 32.025238 32.2487793 32.403389 32.7163391 32.7872047 33.1070175 33.3061523 33.7213058 33.8398209 34.0771332 34.3263245 34.7263603 35.099617 35.2593231 35.4439316 35.6918411 35.9408989 36.4017105 36.658886 36.8724289 37.1309891 37.5554962 38.2277451 38.6179962 39.0753059 39.6838989 40.2647018 40.7837715 41.6608505 42.0432892 42.7279587 43.2896194 44.0160027 44.5858192 45.2862549 46.4417572 47.0834694 47.6346855 48.7990837 49.7436562 50.8508148 52.2874222 54.5913315 55.7750664 57.5926971 59.686264 65.3904724 74.7188568 109.76886 ------------------------------ Transdef: Tab for variable 4 10.0039043 10.1119308 10.1579132 10.3395958 10.4504099 10.5402489 10.6142349 10.7003975 10.8617115 11.0736103 11.2313957 11.3549118 11.5760136 11.7314577 11.8549175 12.0539169 12.1901646 12.3612375 12.4869289 12.6162834 12.8290234 13.0284491 13.3483057 13.592845 13.6837921 13.8362007 13.9872847 14.1587086 14.3204575 14.5747614 14.7348986 14.7986679 14.9961739 15.2476521 15.485837 15.6152716 15.8054037 15.939312 16.0009346 16.2509537 16.3554382 16.5959797 16.7352772 16.8385677 16.9542084 17.0717468 17.423336 17.7362213 17.9605045 18.1611023 18.397438 18.6423855 18.8059082 18.9938278 19.1153488 19.4200745 19.5790634 19.8853474 20.0953274 20.2634087 20.4978943 20.6657524 20.7619514 20.9008789 20.9973278 21.1691513 21.2655468 21.446331 21.5899086 21.7475128 21.8930855 21.994648 22.1673203 22.3699493 22.6410389 22.7268028 22.9327469 23.0835342 23.2664986 23.4689159 23.7530708 23.856102 24.0717812 24.2277184 24.4337578 24.5710754 24.8541298 25.2621498 25.5083122 25.7574997 26.1897469 26.525589 27.0105896 27.4659519 27.8753815 28.0960236 28.5294151 29.0642281 30.5076561 32.4176102 38.2633057 ------------------------------ Transdef: Tab for variable 5 2.25071955 3.4225781 3.77949858 4.04323769 4.23595285 4.31109667 4.43224907 4.52733278 4.64675236 4.78361273 4.876544 4.95562315 5.12400103 5.16729832 5.29018307 5.33179522 5.36693335 5.41930771 5.49458027 5.52445793 5.53796911 5.60942268 5.73886776 5.79206371 5.86990833 5.90981007 5.96052694 6.01596642 6.07062912 6.14557314 6.21755695 6.27397108 6.31576824 6.39204502 6.45021105 6.50895119 6.55168056 6.62844801 6.64825487 6.70541191 6.75865841 6.77702522 6.81045151 6.84825468 6.87793875 6.92141151 6.95894051 7.0059371 7.05574131 7.09811306 7.17886877 7.21599102 7.26405525 7.30372715 7.36868715 7.40686131 7.45966625 7.52548504 7.58100033 7.60944366 7.65939617 7.73267555 7.80403662 7.83034372 7.87467575 7.9342165 7.99166536 8.03844643 8.06002808 8.10835075 8.14812565 8.19870186 8.23884487 8.28540993 8.36252975 8.41238976 8.4412365 8.53261757 8.57330894 8.63190556 8.72785664 8.81276703 8.88573837 8.92487812 9.00479507 9.09348965 9.17874622 9.29486847 9.38586617 9.50066757 9.57968426 9.71397972 9.81905365 9.99009514 10.1837902 10.3314943 10.6646509 10.979763 11.5948095 12.2464638 19.0882549 ------------------------------ Transdef: Tab for variable 6 25.0010986 26.6051693 27.7120972 30.0012589 30.7434959 31.2493591 31.6391411 32.147747 32.8090973 34.06147 34.6510925 34.7509499 35.0429306 36.1711578 36.8836327 37.5394821 38.2285919 38.5093269 38.8406677 39.3846741 40.0907707 40.3561554 40.8721085 41.4895554 42.1197624 42.4220772 42.6190987 42.9797173 43.5163231 43.8307343 44.0274773 44.8190918 45.3654633 45.7777786 46.4797363 47.1068459 47.4519348 48.1241837 48.5818634 49.048111 49.3633347 49.7618752 50.0436935 50.608429 51.273468 51.5166931 51.999321 52.6079559 53.1689491 53.9817886 54.7063904 55.3717194 55.9618912 56.5364838 57.0325089 57.434906 58.0410728 58.3897858 58.6642113 59.145134 59.9442215 60.5483704 61.1617737 62.1728287 62.8614578 63.5383987 64.1244202 65.1513672 65.6418304 66.5510101 67.0090332 67.7188721 68.3457184 69.2636108 69.8722687 70.5820999 71.477066 72.0703583 73.0411835 74.372879 75.560318 76.2788849 77.1651993 78.567337 79.3852692 80.6640472 82.707489 84.7117462 87.4163971 89.9205399 91.8461685 94.1019592 96.1895447 98.0378342 101.560585 105.782906 109.260399 113.526688 126.581573 136.805359 175.932022 ------------------------------ Transdef: Tab for variable 7 30.3086014 31.6623116 34.5213127 34.753376 35.2873497 36.3411255 36.8998337 38.2426338 38.5663567 38.825325 38.928215 39.3912201 39.5689049 40.1618652 40.4402161 41.298912 41.7132149 42.1660233 42.322197 42.6304741 43.0370483 43.9921646 44.6006241 44.9342194 45.7994537 46.7977905 47.1075974 48.1900787 48.5726318 49.0493736 49.4444504 49.8033333 50.5989227 50.994442 51.6002312 52.2675629 53.2324905 53.8741112 54.6066437 55.6907463 56.4701385 57.0207558 57.54496 58.4955711 58.627861 59.645874 60.5165863 61.3966064 61.8692551 62.7277107 63.0283127 63.7045822 64.3556976 65.1552124 65.9388733 66.5940247 67.2404785 67.8578415 68.6608887 69.131546 70.3357849 71.3291779 72.9103699 73.4943085 74.2167816 75.7584686 76.7588654 77.4858475 78.623703 79.5900726 81.3451385 82.5478592 83.6839447 85.2939301 86.8044586 88.0838852 89.6955032 91.0299759 92.4265823 93.7856674 94.9657593 96.759201 97.9844589 99.9792633 101.386429 103.026321 105.69857 107.865845 110.331902 112.063019 116.208443 119.761154 122.845032 128.148712 135.70871 139.7621 146.437683 154.932114 169.496979 188.757004 507.284485 ------------------------------ Transdef: Tab for variable 8 6.80322456 27.8836212 30.04813 31.4719486 32.1448212 33.8179245 34.0968857 34.2646866 34.9704857 35.5490799 36.2482452 37.4238586 37.7555237 37.8404922 38.0505981 38.640831 38.850029 38.9089241 39.2669449 39.5026016 39.6275291 40.0829201 40.5500832 40.7714119 40.9190598 41.2176361 41.5439148 42.0820923 42.9119568 43.0793915 43.354187 43.8235245 44.2890205 44.8382492 45.3615036 46.3059692 46.6293716 46.7991829 47.3245773 47.8672104 48.3288574 48.716713 48.7952385 49.0332565 49.5088882 49.7201767 50.052578 50.6270065 51.0933914 51.7227554 52.5929413 52.9929008 53.745842 54.4769897 54.9109116 55.5765152 56.072998 56.4417648 57.0096512 57.4664345 58.1744385 59.0263596 59.7547226 60.231472 60.7499619 61.2607651 61.7820511 62.5151215 62.9718094 63.6846771 64.2874603 65.0310516 65.6158371 66.2086105 66.6387177 67.684082 68.4227753 69.2657623 70.4336472 71.83284 72.9819946 73.8441315 75.4415894 76.3688354 77.4992218 78.4996338 79.4110641 81.0368423 82.4557953 85.724823 86.8826065 90.3054962 93.4158325 96.6719666 99.5328522 107.458916 113.993805 119.264977 123.53981 137.749039 344.837463 ------------------------------ Transdef: Tab for variable 9 55.8076553 62.8013802 66.7069016 68.4799347 70.5295639 71.0066681 71.84935 73.0712433 74.3200836 75.5134888 76.6254501 77.0368805 77.1519318 77.9387817 79.3440399 80.4251251 80.9676208 81.2101898 81.5533905 83.1595917 83.411972 84.7588501 85.5781021 86.5702972 86.8729248 87.7260895 88.6497345 89.7498779 90.5669327 91.6105042 92.3680115 93.2076797 93.8693237 95.0475006 95.918457 96.8626709 97.9949722 98.396637 98.8507767 99.9697418 100.673164 101.633537 102.647285 103.367638 104.242859 104.810898 105.4925 105.817879 106.704559 107.653748 108.034546 108.592606 109.984512 111.331116 112.413048 113.392151 114.291725 114.821045 115.298416 116.785515 117.668442 118.628403 120.066124 120.819801 121.834435 123.060707 124.02562 125.165565 125.810364 126.907982 127.895821 128.942108 129.46756 130.289642 131.313599 132.236542 132.929657 134.056183 135.703217 136.902435 138.987381 140.190628 141.912567 143.052917 144.4039 145.61351 147.063156 148.429825 149.703735 151.68782 154.306732 155.950638 159.684998 163.252625 166.219437 169.375305 176.113586 179.710297 188.495544 205.093384 422.705414 ------------------------------ Transdef: Tab for variable 10 0.237594441 1.03350031 1.397753 1.59112859 1.71942663 1.84909582 1.95413291 2.06982136 2.14832306 2.1810956 2.24017262 2.28504467 2.32169795 2.37368917 2.4011519 2.41904593 2.45527411 2.49204969 2.53134322 2.54091883 2.55983901 2.59822893 2.61973548 2.65742397 2.67458868 2.70494127 2.71613574 2.73282361 2.75153494 2.7686491 2.78687763 2.80369091 2.81686258 2.82811546 2.84191227 2.85155964 2.85332108 2.85826302 2.86927414 2.87886381 2.88181472 2.88805175 2.89581299 2.90023327 2.91316843 2.92007494 2.92616296 2.92920876 2.93571043 2.94639158 2.94803476 2.95055676 2.95849347 2.96485496 2.9711709 2.9770546 2.98105288 2.98901987 2.99381065 3.00065804 3.0052135 3.01246071 3.01957607 3.025141 3.03045559 3.03535652 3.03779173 3.04304361 3.04574537 3.05113745 3.05400252 3.06128788 3.06415629 3.06605053 3.06710005 3.06936836 3.0716083 3.07617068 3.07828808 3.07997108 3.08471704 3.0892992 3.0918355 3.09639883 3.10048747 3.10372353 3.10565901 3.10750389 3.11206698 3.11372519 3.11700821 3.12000227 3.12160444 3.12419796 3.12705398 3.12934017 3.13169551 3.13274956 3.13537884 3.13867092 3.14156055 ------------------------------ Transdef: Tab for variable 11 7.65302248E-05 0.00877701957 0.013170247 0.0228942633 0.0263876915 0.0378322639 0.0480598174 0.0570597649 0.0660199523 0.074787654 0.0847667605 0.093240127 0.103617638 0.10810405 0.11549288 0.128720939 0.138135433 0.148432881 0.157206535 0.16253221 0.167588711 0.178970814 0.189822316 0.19987762 0.212627828 0.226710439 0.230720758 0.233969688 0.24262476 0.253526688 0.263443351 0.27340436 0.279271483 0.291328192 0.299564958 0.304547131 0.31152606 0.3188003 0.32636264 0.333804309 0.340783596 0.345989645 0.351443529 0.355929255 0.364103168 0.365865588 0.371689022 0.375783443 0.378684998 0.384738594 0.38820526 0.390641332 0.395001292 0.39848572 0.402403235 0.407975316 0.411444008 0.417001724 0.423119903 0.425547481 0.430521965 0.434135199 0.437999368 0.439293712 0.440659285 0.445868909 0.447294116 0.452374488 0.456668556 0.459911436 0.4661448 0.467626333 0.475256443 0.478722155 0.487836361 0.495804727 0.508139491 0.512907505 0.519931912 0.526301146 0.533235312 0.542186737 0.548867106 0.562164962 0.573675632 0.577880383 0.583038151 0.5939641 0.602122486 0.607035041 0.613301754 0.629371583 0.639765263 0.650254369 0.658943415 0.667413354 0.697197199 0.72921145 0.778923154 0.823282719 1.11007142 ------------------------------ Transdef: Tab for variable 12 0.241848439 0.375963867 0.402914643 0.408398122 0.412157357 0.413626611 0.417199612 0.42078042 0.423740089 0.42473191 0.427163303 0.429718494 0.432021648 0.434688091 0.438141525 0.439965904 0.442418814 0.445222914 0.448005319 0.449507117 0.451807857 0.454725564 0.457642138 0.460050374 0.460700274 0.463308215 0.465632439 0.469077408 0.471695006 0.473732948 0.475729465 0.477942735 0.479272455 0.481834441 0.484862566 0.488144994 0.49055168 0.493223101 0.495118558 0.496957749 0.500254869 0.502527952 0.503806233 0.507437825 0.511525989 0.514259219 0.517356932 0.521345854 0.522645473 0.526868165 0.528599739 0.530725718 0.533866704 0.537671983 0.539848447 0.545198262 0.547798038 0.54969883 0.553987205 0.557477713 0.561669827 0.566934228 0.569413245 0.573220611 0.576193333 0.581390858 0.586107135 0.592115998 0.598354816 0.601793408 0.608400345 0.612896085 0.617979407 0.621402204 0.625756621 0.63047564 0.636972725 0.643571258 0.651733994 0.658442974 0.664956152 0.666085243 0.668076515 0.672326922 0.6782372 0.683038354 0.697381318 0.703089654 0.713105559 0.722990751 0.729610443 0.742360175 0.753837228 0.766366899 0.780251026 0.79388845 0.818633139 0.849844694 0.877107263 0.933968663 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0123215 22.3974857 23.1165848 23.394928 23.7683716 24.2649422 24.6941872 25.211092 25.7471924 26.069313 26.8885384 27.1436157 27.5325127 28.0263214 28.6017723 28.992897 29.4304256 29.5802879 29.9550629 30.1289978 30.3815804 30.8056374 30.983242 31.3926544 31.6613407 31.8020535 32.1896515 32.5125885 32.8627472 33.4559326 33.9807663 34.4171715 34.5628204 34.8396606 35.3013725 35.533596 36.0054932 36.1900826 36.2963028 36.8111267 37.2718658 37.7705688 38.402401 38.6882286 39.1286125 39.4775658 39.8040009 40.3835907 40.734726 41.0208054 41.531086 42.3155403 42.6517868 43.0271683 43.2969284 43.7749863 44.3047409 44.8012886 45.0695953 45.8768005 46.3671913 46.6253128 47.0914879 47.4938164 47.8852539 48.3475609 48.8726654 49.770752 50.6432037 51.5850563 52.0297318 52.6312675 53.3840866 54.2376938 55.0236778 56.3688126 57.6848259 58.4642487 59.2560616 59.764328 60.387085 61.4598312 62.173378 63.6191788 64.4385376 65.6826172 66.8370361 68.2505264 70.5131378 71.4682159 73.2058029 75.8993835 78.9385223 82.9671021 85.3608856 88.438179 89.9060516 95.3131104 104.938896 119.424736 194.379669 ------------------------------ Transdef: Tab for variable 14 10.0093269 10.9721165 11.3884211 11.9825802 12.1187115 12.3425274 12.6981726 12.9504032 13.3847313 14.0708141 14.4496498 14.7570448 15.0552731 15.3545036 15.7323132 15.9551783 16.2688446 16.4099026 16.5261688 16.7800789 16.794426 17.1188602 17.4935341 17.7185822 17.9586754 18.1560669 18.3838806 18.7345428 19.0145702 19.2039757 19.4316292 19.6509476 19.8746758 20.0626526 20.4096565 20.640934 20.8416309 21.0436611 21.3333168 21.5309925 21.6637955 21.7457008 22.0124722 22.1139717 22.3629684 22.5845566 22.9271622 23.1142654 23.2203445 23.4835682 23.6012554 23.8264809 24.1026859 24.2520256 24.4625816 24.5867424 24.976532 25.2693005 25.622406 25.8937607 26.0531273 26.4031181 26.5428658 26.6376266 27.0712605 27.248497 27.37677 27.5533752 27.9481964 28.0972672 28.1761436 28.7068825 29.0158806 29.3552513 29.5282612 29.8904476 30.1751938 30.4670353 30.881958 31.1522408 31.6825314 31.9725838 32.4883957 32.9412689 33.5432472 34.1165848 34.4762344 34.9959831 35.594429 36.7306061 37.8740616 38.9338226 40.087738 41.2050247 43.441082 45.6218224 47.669342 49.8927116 52.2194748 60.899147 89.625824 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 0.9 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 51.4 21.8 36.0 23.2 40.1 49.5 43.0 47.4 -19.6 -19.3 -19.2 11.2 26.4 2 51.4 100.0 53.0 41.1 48.8 78.7 94.4 81.9 91.0 -38.7 -27.6 -36.7 29.6 26.1 3 21.8 53.0 100.0 17.9 23.7 39.7 52.4 52.1 66.1 4.5 -24.4 -45.2 66.9 8.6 4 36.0 41.1 17.9 100.0 15.8 31.2 41.9 41.3 45.7 1.6 -26.1 -48.8 6.3 75.8 5 23.2 48.8 23.7 15.8 100.0 84.7 20.2 59.1 71.2 21.0 -14.4 -14.4 13.7 12.2 6 40.1 78.7 39.7 31.2 84.7 100.0 58.7 80.6 88.0 -6.4 -21.6 -26.0 22.6 21.6 7 49.5 94.4 52.4 41.9 20.2 58.7 100.0 74.4 77.6 -49.2 -26.4 -36.2 30.6 26.5 8 43.0 81.9 52.1 41.3 59.1 80.6 74.4 100.0 86.5 -10.8 -29.1 -35.1 34.6 30.4 9 47.4 91.0 66.1 45.7 71.2 88.0 77.6 86.5 100.0 -11.2 -29.7 -43.7 40.1 31.1 10 -19.6 -38.7 4.5 1.6 21.0 -6.4 -49.2 -10.8 -11.2 100.0 -1.3 -3.1 9.5 5.9 11 -19.3 -27.6 -24.4 -26.1 -14.4 -21.6 -26.4 -29.1 -29.7 -1.3 100.0 52.0 -24.6 -26.9 12 -19.2 -36.7 -45.2 -48.8 -14.4 -26.0 -36.2 -35.1 -43.7 -3.1 52.0 100.0 -28.4 -38.4 13 11.2 29.6 66.9 6.3 13.7 22.6 30.6 34.6 40.1 9.5 -24.6 -28.4 100.0 29.9 14 26.4 26.1 8.6 75.8 12.2 21.6 26.5 30.4 31.1 5.9 -26.9 -38.4 29.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 122.661742 TOTAL CORRELATION OF ALL VARIABLES 55.3837172 ROUND 1: MAX CORR ( 55.3837172) AFTER KILLING INPUT VARIABLE 7 CONTR 0.00199643237 ROUND 2: MAX CORR ( 55.3778902) AFTER KILLING INPUT VARIABLE 10 CONTR 0.80337266 ROUND 3: MAX CORR ( 55.351842) AFTER KILLING INPUT VARIABLE 13 CONTR 1.69832456 ROUND 4: MAX CORR ( 55.335923) AFTER KILLING INPUT VARIABLE 14 CONTR 1.32741693 ROUND 5: MAX CORR ( 55.3065001) AFTER KILLING INPUT VARIABLE 6 CONTR 1.80427885 ROUND 6: MAX CORR ( 55.2785099) AFTER KILLING INPUT VARIABLE 8 CONTR 1.75934715 ROUND 7: MAX CORR ( 55.1600911) AFTER KILLING INPUT VARIABLE 2 CONTR 3.61635219 ROUND 8: MAX CORR ( 54.7577914) AFTER KILLING INPUT VARIABLE 11 CONTR 6.64980649 ROUND 9: MAX CORR ( 54.5041293) AFTER KILLING INPUT VARIABLE 12 CONTR 5.26456173 ROUND 10: MAX CORR ( 54.2579342) AFTER KILLING INPUT VARIABLE 4 CONTR 5.17461928 ROUND 11: MAX CORR ( 49.7291393) AFTER KILLING INPUT VARIABLE 3 CONTR 21.7010628 ROUND 12: MAX CORR ( 47.4009443) AFTER KILLING INPUT VARIABLE 5 CONTR 15.0378783 LAST REMAINING VARIABLE: 9 total correlation to target: 55.3837172 % total significance: 20.2575214 sigma correlations of single variables to target: variable 2: 51.4008716 % , in sigma: 18.8007289 variable 3: 21.762501 % , in sigma: 7.95999892 variable 4: 35.9891667 % , in sigma: 13.16364 variable 5: 23.1905529 % , in sigma: 8.4823328 variable 6: 40.0978575 % , in sigma: 14.6664624 variable 7: 49.454402 % , in sigma: 18.0887751 variable 8: 43.0350727 % , in sigma: 15.740798 variable 9: 47.4009443 % , in sigma: 17.3376886 variable 10: -19.591143 % , in sigma: 7.1657884 variable 11: -19.2604712 % , in sigma: 7.04483963 variable 12: -19.1520621 % , in sigma: 7.0051872 variable 13: 11.2055494 % , in sigma: 4.09861722 variable 14: 26.4128303 % , in sigma: 9.66093466 variables sorted by significance: 1 most relevant variable 9 corr 47.4009438 , in sigma: 17.3376884 2 most relevant variable 5 corr 15.037878 , in sigma: 5.50035554 3 most relevant variable 3 corr 21.7010632 , in sigma: 7.937527 4 most relevant variable 4 corr 5.1746192 , in sigma: 1.89270356 5 most relevant variable 12 corr 5.26456165 , in sigma: 1.92560152 6 most relevant variable 11 corr 6.6498065 , in sigma: 2.43227801 7 most relevant variable 2 corr 3.61635208 , in sigma: 1.32274129 8 most relevant variable 8 corr 1.7593472 , in sigma: 0.64351068 9 most relevant variable 6 corr 1.80427885 , in sigma: 0.659945183 10 most relevant variable 14 corr 1.3274169 , in sigma: 0.485524943 11 most relevant variable 13 corr 1.69832456 , in sigma: 0.621190628 12 most relevant variable 10 corr 0.803372681 , in sigma: 0.293847002 13 most relevant variable 7 corr 0.00199643243 , in sigma: 0.00073022857 global correlations between input variables: variable 2: 99.4940106 % variable 3: 93.5729184 % variable 4: 89.470406 % variable 5: 97.7703031 % variable 6: 95.4483468 % variable 7: 99.2742773 % variable 8: 91.1593608 % variable 9: 99.3023165 % variable 10: 72.5421659 % variable 11: 55.6198063 % variable 12: 70.8698265 % variable 13: 80.847981 % variable 14: 85.3286868 % significance loss when removing single variables: variable 2: corr = 1.25885345 % , sigma = 0.460446716 variable 3: corr = 6.15428287 % , sigma = 2.25103195 variable 4: corr = 4.34893154 % , sigma = 1.59069449 variable 5: corr = 5.68618982 % , sigma = 2.07981908 variable 6: corr = 1.73290745 % , sigma = 0.6338399 variable 7: corr = 0.00199643236 % , sigma = 0.000730228544 variable 8: corr = 1.80315949 % , sigma = 0.659535759 variable 9: corr = 7.44857352 % , sigma = 2.72444041 variable 10: corr = 0.800057843 % , sigma = 0.292634544 variable 11: corr = 6.59393005 % , sigma = 2.41184026 variable 12: corr = 7.61836364 % , sigma = 2.78654399 variable 13: corr = 1.65368402 % , sigma = 0.604862605 variable 14: corr = 2.05512457 % , sigma = 0.751696202 Keep only 3 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 4 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 6.6302619 sigma out 15 active outputs RANK 2 NODE 4 --> 5.91133165 sigma out 15 active outputs RANK 3 NODE 1 --> 4.87481833 sigma out 15 active outputs RANK 4 NODE 3 --> 4.42783022 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 6.84363365 sigma in 4act. ( 7.71406126 sig out 1act.) RANK 2 NODE 2 --> 4.64978409 sigma in 4act. ( 6.69210863 sig out 1act.) RANK 3 NODE 8 --> 3.79534698 sigma in 4act. ( 4.24946213 sig out 1act.) RANK 4 NODE 4 --> 3.12966752 sigma in 4act. ( 3.33233094 sig out 1act.) RANK 5 NODE 12 --> 2.47799587 sigma in 4act. ( 2.99867797 sig out 1act.) RANK 6 NODE 3 --> 2.31042933 sigma in 4act. ( 2.28726625 sig out 1act.) RANK 7 NODE 14 --> 2.21172404 sigma in 4act. ( 2.33566356 sig out 1act.) RANK 8 NODE 15 --> 2.13358045 sigma in 4act. ( 2.29849243 sig out 1act.) RANK 9 NODE 6 --> 1.84491181 sigma in 4act. ( 1.67944109 sig out 1act.) RANK 10 NODE 13 --> 1.193367 sigma in 4act. ( 0.742854476 sig out 1act.) RANK 11 NODE 11 --> 1.12814641 sigma in 4act. ( 1.05026495 sig out 1act.) RANK 12 NODE 7 --> 1.05891812 sigma in 4act. ( 1.00064945 sig out 1act.) RANK 13 NODE 10 --> 0.887351274 sigma in 4act. ( 0.84181416 sig out 1act.) RANK 14 NODE 5 --> 0.712474823 sigma in 4act. ( 0.265726656 sig out 1act.) RANK 15 NODE 1 --> 0.423269808 sigma in 4act. ( 0.23266457 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 7.71406126 sigma out 1act.( 6.84363365 sig in 4act.) RANK 2 NODE 2 --> 6.69210863 sigma out 1act.( 4.64978409 sig in 4act.) RANK 3 NODE 8 --> 4.24946213 sigma out 1act.( 3.79534698 sig in 4act.) RANK 4 NODE 4 --> 3.33233094 sigma out 1act.( 3.12966752 sig in 4act.) RANK 5 NODE 12 --> 2.99867797 sigma out 1act.( 2.47799587 sig in 4act.) RANK 6 NODE 14 --> 2.33566356 sigma out 1act.( 2.21172404 sig in 4act.) RANK 7 NODE 15 --> 2.29849243 sigma out 1act.( 2.13358045 sig in 4act.) RANK 8 NODE 3 --> 2.28726625 sigma out 1act.( 2.31042933 sig in 4act.) RANK 9 NODE 6 --> 1.67944109 sigma out 1act.( 1.84491181 sig in 4act.) RANK 10 NODE 11 --> 1.05026495 sigma out 1act.( 1.12814641 sig in 4act.) RANK 11 NODE 7 --> 1.00064945 sigma out 1act.( 1.05891812 sig in 4act.) RANK 12 NODE 10 --> 0.84181416 sigma out 1act.( 0.887351274 sig in 4act.) RANK 13 NODE 13 --> 0.742854476 sigma out 1act.( 1.193367 sig in 4act.) RANK 14 NODE 5 --> 0.265726656 sigma out 1act.( 0.712474823 sig in 4act.) RANK 15 NODE 1 --> 0.23266457 sigma out 1act.( 0.423269808 sig in 4act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 12.8345461 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 9.60805416 sigma out 15 active outputs RANK 2 NODE 1 --> 9.07828903 sigma out 15 active outputs RANK 3 NODE 3 --> 8.80897903 sigma out 15 active outputs RANK 4 NODE 4 --> 6.12138557 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 6.4236846 sigma in 4act. ( 7.34416723 sig out 1act.) RANK 2 NODE 8 --> 5.98624849 sigma in 4act. ( 4.96080256 sig out 1act.) RANK 3 NODE 10 --> 5.978899 sigma in 4act. ( 3.34394455 sig out 1act.) RANK 4 NODE 2 --> 5.18365479 sigma in 4act. ( 6.33723593 sig out 1act.) RANK 5 NODE 3 --> 5.06372738 sigma in 4act. ( 3.33091235 sig out 1act.) RANK 6 NODE 11 --> 4.71738434 sigma in 4act. ( 2.81622458 sig out 1act.) RANK 7 NODE 1 --> 4.69273281 sigma in 4act. ( 1.98108554 sig out 1act.) RANK 8 NODE 7 --> 4.06854439 sigma in 4act. ( 1.47660387 sig out 1act.) RANK 9 NODE 14 --> 3.90625763 sigma in 4act. ( 2.25929236 sig out 1act.) RANK 10 NODE 4 --> 3.5961287 sigma in 4act. ( 2.46202135 sig out 1act.) RANK 11 NODE 6 --> 3.17897201 sigma in 4act. ( 1.26766706 sig out 1act.) RANK 12 NODE 5 --> 3.17597651 sigma in 4act. ( 1.06916988 sig out 1act.) RANK 13 NODE 12 --> 2.59731936 sigma in 4act. ( 2.29664826 sig out 1act.) RANK 14 NODE 13 --> 2.19604325 sigma in 4act. ( 0.54188627 sig out 1act.) RANK 15 NODE 15 --> 1.91334772 sigma in 4act. ( 1.38763309 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 7.34416723 sigma out 1act.( 6.4236846 sig in 4act.) RANK 2 NODE 2 --> 6.33723593 sigma out 1act.( 5.18365479 sig in 4act.) RANK 3 NODE 8 --> 4.96080256 sigma out 1act.( 5.98624849 sig in 4act.) RANK 4 NODE 10 --> 3.34394455 sigma out 1act.( 5.978899 sig in 4act.) RANK 5 NODE 3 --> 3.33091235 sigma out 1act.( 5.06372738 sig in 4act.) RANK 6 NODE 11 --> 2.81622458 sigma out 1act.( 4.71738434 sig in 4act.) RANK 7 NODE 4 --> 2.46202135 sigma out 1act.( 3.5961287 sig in 4act.) RANK 8 NODE 12 --> 2.29664826 sigma out 1act.( 2.59731936 sig in 4act.) RANK 9 NODE 14 --> 2.25929236 sigma out 1act.( 3.90625763 sig in 4act.) RANK 10 NODE 1 --> 1.98108554 sigma out 1act.( 4.69273281 sig in 4act.) RANK 11 NODE 7 --> 1.47660387 sigma out 1act.( 4.06854439 sig in 4act.) RANK 12 NODE 15 --> 1.38763309 sigma out 1act.( 1.91334772 sig in 4act.) RANK 13 NODE 6 --> 1.26766706 sigma out 1act.( 3.17897201 sig in 4act.) RANK 14 NODE 5 --> 1.06916988 sigma out 1act.( 3.17597651 sig in 4act.) RANK 15 NODE 13 --> 0.54188627 sigma out 1act.( 2.19604325 sig in 4act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 13.2826891 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.557759523 *** contribution from regularisation: 0.0177017879 *** contribution from error: -0.575461328 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.607194424 *** contribution from regularisation: 0.00633114856 *** contribution from error: -0.613525569 *********************************************** -----------------> Test sample ENTER BFGS code START -4498.83702 0.353706807 -0.000940854894 EXIT FROM BFGS code FG_START 0. 0.353706807 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.614257336 *** contribution from regularisation: 0.00294882176 *** contribution from error: -0.617206156 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -4550.41827 0.353706807 4.97383451 EXIT FROM BFGS code FG_LNSRCH 0. 0.458409607 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.617468178 *** contribution from regularisation: 0.00577690359 *** contribution from error: -0.62324506 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4574.20445 0.458409607 0.691612959 EXIT FROM BFGS code NEW_X -4574.20445 0.458409607 0.691612959 ENTER BFGS code NEW_X -4574.20445 0.458409607 0.691612959 EXIT FROM BFGS code FG_LNSRCH 0. 0.449115008 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.618743956 *** contribution from regularisation: 0.00563103659 *** contribution from error: -0.624374986 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4583.65511 0.449115008 0.589547813 EXIT FROM BFGS code NEW_X -4583.65511 0.449115008 0.589547813 ENTER BFGS code NEW_X -4583.65511 0.449115008 0.589547813 EXIT FROM BFGS code FG_LNSRCH 0. 0.458614081 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.61876601 *** contribution from regularisation: 0.00513122836 *** contribution from error: -0.623897254 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4583.81879 0.458614081 0.577652812 EXIT FROM BFGS code NEW_X -4583.81879 0.458614081 0.577652812 ENTER BFGS code NEW_X -4583.81879 0.458614081 0.577652812 EXIT FROM BFGS code FG_LNSRCH 0. 0.518845081 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.615545988 *** contribution from regularisation: 0.00389376935 *** contribution from error: -0.619439781 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4559.9645 0.518845081 0.496737659 EXIT FROM BFGS code FG_LNSRCH 0. 0.463152468 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.617431343 *** contribution from regularisation: 0.00630525034 *** contribution from error: -0.62373662 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4573.93147 0.463152468 0.686418414 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.619044244 *** contribution from regularisation: 0.00484970165 *** contribution from error: -0.623893917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4585.87976 0.458685458 0.573508501 EXIT FROM BFGS code FG_LNSRCH 0. 0.458755136 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 5.60582399 sigma out 15 active outputs RANK 2 NODE 1 --> 5.32656145 sigma out 15 active outputs RANK 3 NODE 3 --> 5.29499674 sigma out 15 active outputs RANK 4 NODE 4 --> 2.75274396 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 3.86399555 sigma in 4act. ( 2.23190379 sig out 1act.) RANK 2 NODE 8 --> 3.37868857 sigma in 4act. ( 2.39511919 sig out 1act.) RANK 3 NODE 3 --> 3.18725514 sigma in 4act. ( 2.21310306 sig out 1act.) RANK 4 NODE 1 --> 3.09349036 sigma in 4act. ( 1.71048319 sig out 1act.) RANK 5 NODE 11 --> 2.97820663 sigma in 4act. ( 1.64295435 sig out 1act.) RANK 6 NODE 7 --> 2.59794331 sigma in 4act. ( 1.46852958 sig out 1act.) RANK 7 NODE 2 --> 2.50813317 sigma in 4act. ( 2.10134268 sig out 1act.) RANK 8 NODE 14 --> 2.39997244 sigma in 4act. ( 1.33256841 sig out 1act.) RANK 9 NODE 9 --> 2.25982285 sigma in 4act. ( 2.14830208 sig out 1act.) RANK 10 NODE 5 --> 2.03170371 sigma in 4act. ( 0.982780397 sig out 1act.) RANK 11 NODE 6 --> 1.95195997 sigma in 4act. ( 0.78349942 sig out 1act.) RANK 12 NODE 4 --> 1.92484272 sigma in 4act. ( 0.535005152 sig out 1act.) RANK 13 NODE 12 --> 1.41927516 sigma in 4act. ( 0.746198177 sig out 1act.) RANK 14 NODE 13 --> 1.36850262 sigma in 4act. ( 0.903943419 sig out 1act.) RANK 15 NODE 15 --> 1.01552105 sigma in 4act. ( 0.387227178 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 2.39511919 sigma out 1act.( 3.37868857 sig in 4act.) RANK 2 NODE 10 --> 2.23190379 sigma out 1act.( 3.86399555 sig in 4act.) RANK 3 NODE 3 --> 2.21310306 sigma out 1act.( 3.18725514 sig in 4act.) RANK 4 NODE 9 --> 2.14830208 sigma out 1act.( 2.25982285 sig in 4act.) RANK 5 NODE 2 --> 2.10134268 sigma out 1act.( 2.50813317 sig in 4act.) RANK 6 NODE 1 --> 1.71048319 sigma out 1act.( 3.09349036 sig in 4act.) RANK 7 NODE 11 --> 1.64295435 sigma out 1act.( 2.97820663 sig in 4act.) RANK 8 NODE 7 --> 1.46852958 sigma out 1act.( 2.59794331 sig in 4act.) RANK 9 NODE 14 --> 1.33256841 sigma out 1act.( 2.39997244 sig in 4act.) RANK 10 NODE 5 --> 0.982780397 sigma out 1act.( 2.03170371 sig in 4act.) RANK 11 NODE 13 --> 0.903943419 sigma out 1act.( 1.36850262 sig in 4act.) RANK 12 NODE 6 --> 0.78349942 sigma out 1act.( 1.95195997 sig in 4act.) RANK 13 NODE 12 --> 0.746198177 sigma out 1act.( 1.41927516 sig in 4act.) RANK 14 NODE 4 --> 0.535005152 sigma out 1act.( 1.92484272 sig in 4act.) RANK 15 NODE 15 --> 0.387227178 sigma out 1act.( 1.01552105 sig in 4act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 6.13138247 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.617141366 *** contribution from regularisation: 0.00675051101 *** contribution from error: -0.62389189 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -4571.78328 0.458755136 1.02872038 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.620118916 *** contribution from regularisation: 0.00377502339 *** contribution from error: -0.623893917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4593.84098 0.458685458 0.412242323 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.616229892 *** contribution from regularisation: 0.0076640537 *** contribution from error: -0.623893917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4565.03104 0.458685458 0.861189961 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.619493246 *** contribution from regularisation: 0.00440068357 *** contribution from error: -0.623893917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4589.20609 0.458685458 0.71602422 EXIT FROM BFGS code NEW_X -4589.20609 0.458685458 0.71602422 ENTER BFGS code NEW_X -4589.20609 0.458685458 0.71602422 EXIT FROM BFGS code FG_LNSRCH 0. 0.528335631 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.614651382 *** contribution from regularisation: 0.00381076802 *** contribution from error: -0.618462145 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4553.33734 0.528335631 0.275915504 EXIT FROM BFGS code FG_LNSRCH 0. 0.463291347 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.615987062 *** contribution from regularisation: 0.00775243808 *** contribution from error: -0.623739481 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4563.23213 0.463291347 0.558452964 EXIT FROM BFGS code FG_LNSRCH 0. 0.458718091 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.618453562 *** contribution from regularisation: 0.00543935597 *** contribution from error: -0.623892903 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4581.50395 0.458718091 0.717739582 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.618130386 *** contribution from regularisation: 0.00576357823 *** contribution from error: -0.623893976 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4579.10976 0.458685458 0.663211584 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.61788255 *** contribution from regularisation: 0.00601139804 *** contribution from error: -0.623893976 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4577.27392 0.458685458 0.69933182 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.617986202 *** contribution from regularisation: 0.00590774324 *** contribution from error: -0.623893917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -4578.04179 0.458685458 0.785891175 EXIT FROM BFGS code FG_LNSRCH 0. 0.458685458 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 5.39391899 sigma out 15 active outputs RANK 2 NODE 2 --> 5.22324133 sigma out 15 active outputs RANK 3 NODE 3 --> 4.8604517 sigma out 15 active outputs RANK 4 NODE 4 --> 2.6426816 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 3.72131181 sigma in 4act. ( 2.35921669 sig out 1act.) RANK 2 NODE 8 --> 3.30732131 sigma in 4act. ( 2.71045566 sig out 1act.) RANK 3 NODE 3 --> 3.14926124 sigma in 4act. ( 2.43762684 sig out 1act.) RANK 4 NODE 1 --> 2.91398263 sigma in 4act. ( 1.7400676 sig out 1act.) RANK 5 NODE 11 --> 2.78332853 sigma in 4act. ( 1.69578779 sig out 1act.) RANK 6 NODE 2 --> 2.47512436 sigma in 4act. ( 2.25278068 sig out 1act.) RANK 7 NODE 7 --> 2.46945477 sigma in 4act. ( 1.53967726 sig out 1act.) RANK 8 NODE 9 --> 2.29152751 sigma in 4act. ( 2.13956141 sig out 1act.) RANK 9 NODE 14 --> 2.2139709 sigma in 4act. ( 1.35070968 sig out 1act.) RANK 10 NODE 5 --> 1.84862387 sigma in 4act. ( 0.975748718 sig out 1act.) RANK 11 NODE 6 --> 1.75828564 sigma in 4act. ( 0.79772079 sig out 1act.) RANK 12 NODE 4 --> 1.71622765 sigma in 4act. ( 0.546049118 sig out 1act.) RANK 13 NODE 12 --> 1.29660249 sigma in 4act. ( 0.779402196 sig out 1act.) RANK 14 NODE 13 --> 1.29518998 sigma in 4act. ( 0.915071368 sig out 1act.) RANK 15 NODE 15 --> 0.92274189 sigma in 4act. ( 0.389920294 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 2.71045566 sigma out 1act.( 3.30732131 sig in 4act.) RANK 2 NODE 3 --> 2.43762684 sigma out 1act.( 3.14926124 sig in 4act.) RANK 3 NODE 10 --> 2.35921669 sigma out 1act.( 3.72131181 sig in 4act.) RANK 4 NODE 2 --> 2.25278068 sigma out 1act.( 2.47512436 sig in 4act.) RANK 5 NODE 9 --> 2.13956141 sigma out 1act.( 2.29152751 sig in 4act.) RANK 6 NODE 1 --> 1.7400676 sigma out 1act.( 2.91398263 sig in 4act.) RANK 7 NODE 11 --> 1.69578779 sigma out 1act.( 2.78332853 sig in 4act.) RANK 8 NODE 7 --> 1.53967726 sigma out 1act.( 2.46945477 sig in 4act.) RANK 9 NODE 14 --> 1.35070968 sigma out 1act.( 2.2139709 sig in 4act.) RANK 10 NODE 5 --> 0.975748718 sigma out 1act.( 1.84862387 sig in 4act.) RANK 11 NODE 13 --> 0.915071368 sigma out 1act.( 1.29518998 sig in 4act.) RANK 12 NODE 6 --> 0.79772079 sigma out 1act.( 1.75828564 sig in 4act.) RANK 13 NODE 12 --> 0.779402196 sigma out 1act.( 1.29660249 sig in 4act.) RANK 14 NODE 4 --> 0.546049118 sigma out 1act.( 1.71622765 sig in 4act.) RANK 15 NODE 15 --> 0.389920294 sigma out 1act.( 0.92274189 sig in 4act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 6.48762465 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.618174851 *** contribution from regularisation: 0.00571910618 *** contribution from error: -0.623893976 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -4579.43921 0.458685458 0.750600338 EXIT FROM BFGS code NEW_X -4579.43921 0.458685458 0.750600338 ENTER BFGS code NEW_X -4579.43921 0.458685458 0.750600338 EXIT FROM BFGS code CONVERGENC -4579.43921 0.458685458 0.750600338 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 9.58861351 sigma out 15 active outputs RANK 2 NODE 2 --> 7.55311346 sigma out 15 active outputs RANK 3 NODE 3 --> 6.91366291 sigma out 15 active outputs RANK 4 NODE 4 --> 3.82004857 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 6.20956326 sigma in 4act. ( 3.94998932 sig out 1act.) RANK 2 NODE 8 --> 5.81903744 sigma in 4act. ( 4.74528837 sig out 1act.) RANK 3 NODE 3 --> 5.66772795 sigma in 4act. ( 3.86317182 sig out 1act.) RANK 4 NODE 1 --> 4.28047323 sigma in 4act. ( 2.89399505 sig out 1act.) RANK 5 NODE 2 --> 4.15391827 sigma in 4act. ( 3.41896486 sig out 1act.) RANK 6 NODE 11 --> 3.97995782 sigma in 4act. ( 2.82643628 sig out 1act.) RANK 7 NODE 9 --> 3.90923667 sigma in 4act. ( 3.75585055 sig out 1act.) RANK 8 NODE 7 --> 3.72278643 sigma in 4act. ( 2.33205748 sig out 1act.) RANK 9 NODE 14 --> 2.89513946 sigma in 4act. ( 2.25754499 sig out 1act.) RANK 10 NODE 5 --> 2.22376609 sigma in 4act. ( 1.51150656 sig out 1act.) RANK 11 NODE 6 --> 1.94863522 sigma in 4act. ( 1.32271612 sig out 1act.) RANK 12 NODE 4 --> 1.73719692 sigma in 4act. ( 0.917131484 sig out 1act.) RANK 13 NODE 13 --> 1.72997177 sigma in 4act. ( 1.13367653 sig out 1act.) RANK 14 NODE 12 --> 1.49638593 sigma in 4act. ( 1.15428901 sig out 1act.) RANK 15 NODE 15 --> 0.952221274 sigma in 4act. ( 0.554774046 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 4.74528837 sigma out 1act.( 5.81903744 sig in 4act.) RANK 2 NODE 10 --> 3.94998932 sigma out 1act.( 6.20956326 sig in 4act.) RANK 3 NODE 3 --> 3.86317182 sigma out 1act.( 5.66772795 sig in 4act.) RANK 4 NODE 9 --> 3.75585055 sigma out 1act.( 3.90923667 sig in 4act.) RANK 5 NODE 2 --> 3.41896486 sigma out 1act.( 4.15391827 sig in 4act.) RANK 6 NODE 1 --> 2.89399505 sigma out 1act.( 4.28047323 sig in 4act.) RANK 7 NODE 11 --> 2.82643628 sigma out 1act.( 3.97995782 sig in 4act.) RANK 8 NODE 7 --> 2.33205748 sigma out 1act.( 3.72278643 sig in 4act.) RANK 9 NODE 14 --> 2.25754499 sigma out 1act.( 2.89513946 sig in 4act.) RANK 10 NODE 5 --> 1.51150656 sigma out 1act.( 2.22376609 sig in 4act.) RANK 11 NODE 6 --> 1.32271612 sigma out 1act.( 1.94863522 sig in 4act.) RANK 12 NODE 12 --> 1.15428901 sigma out 1act.( 1.49638593 sig in 4act.) RANK 13 NODE 13 --> 1.13367653 sigma out 1act.( 1.72997177 sig in 4act.) RANK 14 NODE 4 --> 0.917131484 sigma out 1act.( 1.73719692 sig in 4act.) RANK 15 NODE 15 --> 0.554774046 sigma out 1act.( 0.952221274 sig in 4act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 10.6555014 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.618641317 *** contribution from regularisation: 0.00525264163 *** contribution from error: -0.623893976 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 23367 Closing output file done