NNInput NNInputs_155.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 191095 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 51295 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 51295 Chosen entries: 51295 Signal fraction: 1 Background fraction: 0.366917 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 51295 Entries to split: 51295 Test with : 25647 Train with : 25647 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 51295 for Signal Prepared event 0 for Signal with 51295 events ====Entry 0 Variable Ht : 266.323 Variable LepAPt : 64.2176 Variable LepBPt : 58.0643 Variable MetSigLeptonsJets : 2.54404 Variable MetSpec : 36.171 Variable SumEtLeptonsJets : 227.916 Variable VSumJetLeptonsPt : 47.3654 Variable addEt : 160.689 Variable dPhiLepSumMet : 2.30851 Variable dPhiLeptons : 0.188909 Variable dRLeptons : 0.230155 Variable lep1_E : 71.5884 Variable lep2_E : 61.5172 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2155 Ht = 266.323 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 64.2176 LepAPt = 64.2176 LepBEt = 58.0643 LepBPt = 58.0643 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 38.4071 MetDelPhi = 1.22788 MetSig = 2.2508 MetSigLeptonsJets = 2.54404 MetSpec = 36.171 Mjj = 0 MostCentralJetEta = 0.570342 MtllMet = 163.453 Njets = 1 SB = 0 SumEt = 291.171 SumEtJets = 0 SumEtLeptonsJets = 227.916 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 47.3654 addEt = 160.689 dPhiLepSumMet = 2.30851 dPhiLeptons = 0.188909 dRLeptons = 0.230155 diltype = 45 dimass = 14.0433 event = 519 jet1_Et = 105.634 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.5884 lep2_E = 61.5172 rand = 0.999742 run = 236753 weight = 3.57235e-06 ===Show End Prepared event 10000 for Signal with 51295 events Prepared event 20000 for Signal with 51295 events Prepared event 30000 for Signal with 51295 events Prepared event 40000 for Signal with 51295 events Prepared event 50000 for Signal with 51295 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.297476 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4436 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 191095 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4436 negative weights. Signal fraction: 62.5670967 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0054131 63.0259247 64.9274826 66.5548325 67.8823242 68.9111404 70.0706177 70.7922211 71.5748749 72.4568787 73.3578796 73.9774628 74.6601791 75.31633 75.8913193 76.6968536 77.2702942 77.9978867 78.6130905 79.3008041 79.8360443 80.6521149 81.3579712 82.1891708 82.714325 83.5616455 84.6227722 85.483139 86.6407318 87.8421783 88.8325195 90.0421448 91.5833359 92.9334412 94.3484192 95.6667023 97.2617035 98.7557907 100.258133 101.880409 103.380699 104.898575 106.30558 107.788284 109.228531 110.815979 112.032333 113.489494 115.10968 116.501427 118.034668 119.633118 121.198273 122.656494 124.13681 125.567917 127.114456 128.486115 129.970642 131.538864 133.008362 134.262573 135.706482 137.079559 138.425522 139.74826 141.148926 142.379852 143.828033 145.162567 146.590881 147.986542 149.37883 150.897949 152.435669 154.133392 155.915222 157.880219 160.06456 162.139374 164.368469 166.821838 169.461365 172.090836 174.675842 177.339783 180.247925 183.661438 186.992981 190.635315 194.86026 199.38942 204.595032 210.176697 216.573273 224.705078 234.804108 247.997925 268.259583 301.416107 888.225952 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3468552 20.6865501 20.9737282 21.2697868 21.4940662 21.7633171 21.998764 22.2151451 22.4249344 22.6523933 22.8523903 23.0922318 23.3221188 23.512867 23.7234364 23.9028206 24.1142921 24.3632736 24.5690155 24.7865601 24.9758339 25.1833229 25.3773899 25.5860329 25.7592773 25.9663239 26.1701851 26.37677 26.5908241 26.8019466 27.0380707 27.2783604 27.5130768 27.7793694 28.0124435 28.2284279 28.4521885 28.6701469 28.8739929 29.1076279 29.3378677 29.5798645 29.7618828 29.9959221 30.2704353 30.5490074 30.7675819 31.0629768 31.3136597 31.5458736 31.7870674 32.0095367 32.2486267 32.5699921 32.8289146 33.1091194 33.3615112 33.6875076 33.9419098 34.2156372 34.5385971 34.8254471 35.1369781 35.4347687 35.7531128 36.0656509 36.3448105 36.6667252 36.9807739 37.3324051 37.6971588 38.0850449 38.4270096 38.7885284 39.1238556 39.4756088 39.8644104 40.2538681 40.6477356 41.0870705 41.529274 41.9889374 42.4901428 43.0346909 43.5568695 44.120575 44.7340775 45.4338646 46.1536751 47.0253067 47.857029 48.904747 50.0934296 51.4210739 53.0828285 55.1768799 57.7308197 61.6440468 69.2511292 163.247238 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1177654 10.2503023 10.372736 10.4730091 10.615324 10.7511387 10.8935909 10.9940815 11.1111803 11.2671146 11.3895559 11.5174456 11.6682816 11.789547 11.9439678 12.1076298 12.2564621 12.3962383 12.5520134 12.7062988 12.8471498 13.0067577 13.1794462 13.3757324 13.5602512 13.7411366 13.9082661 14.0786409 14.2523079 14.4381342 14.6558342 14.8625698 15.0880508 15.2994041 15.4765167 15.6899872 15.8767586 16.0914822 16.326664 16.5677681 16.8308182 17.0943718 17.3423557 17.6333046 17.8576431 18.1168423 18.3757133 18.6178875 18.890913 19.1320801 19.3702774 19.6465645 19.9445591 20.192173 20.4254494 20.6754684 20.943821 21.1930504 21.4753685 21.7476215 22.0064201 22.2792282 22.5590305 22.8619843 23.1419773 23.4423866 23.7531071 24.080595 24.375473 24.6927147 24.9968224 25.3338737 25.6504784 25.9872246 26.3349075 26.6930256 27.0500031 27.3660164 27.7446613 28.0894241 28.4025192 28.8132076 29.2095184 29.6216049 30.0468636 30.4676876 30.9404926 31.4371281 31.9121552 32.4373398 33.0530014 33.6466141 34.3426666 35.1409721 36.0503235 37.2042923 38.6900787 41.1419067 45.975563 74.5743942 ------------------------------ Transdef: Tab for variable 5 1.34787333 2.68098116 3.09794164 3.39652324 3.65361142 3.87582111 4.06776142 4.19768047 4.32783604 4.43464661 4.54825592 4.63168907 4.72409058 4.81126022 4.89762592 4.97779369 5.05585003 5.1244359 5.17659712 5.24497938 5.29827023 5.36163425 5.41337395 5.45628738 5.50247908 5.54422331 5.5922308 5.63319111 5.67837954 5.72553158 5.77898598 5.82917786 5.87418222 5.91910076 5.96176577 6.00430346 6.049613 6.08605766 6.13205671 6.17775536 6.2160635 6.26024246 6.3006134 6.33960104 6.38563538 6.43341494 6.47514105 6.51385021 6.55802536 6.60872269 6.65246582 6.69939518 6.75264072 6.7920351 6.8366456 6.87245846 6.91901493 6.97297192 7.03089046 7.07528019 7.12885094 7.1801672 7.237113 7.28800488 7.33580494 7.39134789 7.43318701 7.49197769 7.54224968 7.60466337 7.65788221 7.71843338 7.7764349 7.83882904 7.89871931 7.954669 8.00981236 8.07636356 8.13790131 8.19938087 8.26028919 8.32518578 8.38704872 8.45022392 8.52484894 8.60116768 8.67134285 8.75414848 8.83535767 8.92873001 9.02437973 9.12984276 9.25107861 9.37465191 9.52295685 9.6936903 9.9231205 10.2152424 10.6684179 11.4379339 23.5595493 ------------------------------ Transdef: Tab for variable 6 15.0119848 21.0665131 25.4459209 26.5617599 27.4052773 28.3009357 29.1194038 29.8129253 30.5052853 31.1199512 31.6390495 32.1621208 32.6692123 33.1598816 33.5789146 34.0634995 34.5520897 34.9059753 35.3266029 35.7374649 36.1215134 36.4773712 36.8516655 37.2157631 37.5312347 37.9216537 38.3108597 38.769043 39.1532669 39.4959183 39.8405914 40.2505302 40.5641708 40.9902039 41.4026489 41.7866974 42.1998062 42.6158218 43.0664368 43.5000839 43.8904839 44.3135529 44.8259201 45.4669266 46.0656662 46.6815262 47.2925453 47.921524 48.563385 49.2806015 49.8633308 50.4589844 51.1484909 51.8508759 52.566185 53.3498077 54.0617371 54.6208687 55.3520813 56.0764351 56.78125 57.553978 58.2130585 58.851223 59.6278381 60.3466377 61.0027542 61.7431641 62.4747086 63.2572937 64.0327377 64.7193069 65.4577332 66.232933 66.9014587 67.6169052 68.3494949 69.1372833 69.8375473 70.5889816 71.3890228 72.1734314 72.9576416 73.7805023 74.6815796 75.6004181 76.5572586 77.5325012 78.6521759 79.8605499 81.2457809 82.9368057 84.8440933 86.9582291 89.5274429 92.3228302 96.0007324 100.569809 107.880249 120.815704 218.598831 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.8080139 33.7757301 34.400116 35.0583878 35.5195007 35.9281616 36.315712 36.7239799 37.0760498 37.4567261 37.7676811 38.121254 38.3948174 38.7419891 39.0714951 39.3352699 39.6236649 39.9856949 40.291893 40.616188 40.9784012 41.383522 41.6899338 42.0433998 42.4702148 42.8933067 43.4351044 44.006073 44.6244621 45.2063599 45.9414215 46.80299 47.4994583 48.4302368 49.2551651 50.171196 51.1852531 52.1851425 53.0273476 54.0208817 54.937149 55.7907181 56.4894028 57.3596649 58.22155 59.0469894 59.8561249 60.6849289 61.416256 62.211544 62.9677582 63.7050056 64.4626999 65.2157135 66.0787811 66.8458252 67.701416 68.5467224 69.3925247 70.234436 71.0697632 71.9904633 72.844986 73.6567688 74.5986481 75.5825882 76.6135864 77.607132 78.7215424 79.9740143 81.324852 82.6631546 84.1446381 85.6996155 87.2388763 88.719574 90.4451752 92.1683044 93.8743591 95.5097198 97.5319977 99.419342 101.554535 103.753189 106.105957 108.62114 111.171768 113.954712 116.974487 120.707977 124.650642 128.711502 133.754822 139.151978 145.675201 154.035339 165.81665 181.690323 208.860168 532.093323 ------------------------------ Transdef: Tab for variable 8 3.10723281 24.4575138 28.7745514 30.7051086 31.8503456 32.6170502 33.1738396 33.731369 34.1583443 34.5930557 34.9701042 35.2777596 35.5837059 35.9354935 36.2811203 36.5581131 36.914772 37.2263374 37.5070763 37.7900276 38.0601654 38.3487091 38.6426086 38.8997116 39.1932526 39.4191818 39.6762123 39.9515991 40.2671814 40.5010529 40.8755951 41.2282524 41.5654755 41.9298248 42.3104858 42.7047043 43.1459503 43.5977325 44.048912 44.5162125 45.0937767 45.5495758 46.1223526 46.752449 47.3437805 47.9693146 48.5488815 49.0711212 49.7409668 50.4082794 51.0319138 51.6964798 52.3824921 53.0191841 53.667572 54.2678299 54.9641685 55.5644073 56.2127457 56.8701668 57.5004921 58.1192474 58.7831154 59.4239388 60.0729065 60.6701889 61.2718277 61.9092789 62.5771332 63.174736 63.8093414 64.4676514 65.1039276 65.7396851 66.392807 67.1191559 67.8070145 68.5226669 69.1978149 69.9162827 70.6679306 71.4160156 72.2187195 73.0099792 73.7944031 74.6718216 75.6343384 76.6508636 77.6980209 78.7780304 80.2598572 81.9044571 83.8096466 85.9953079 88.6830978 91.8914871 95.7878418 100.577095 108.02121 122.723206 348.466034 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7099228 64.4709625 66.1317978 67.369751 68.3333664 69.3790588 70.2084198 70.7940903 71.4850922 72.1963196 73.0594482 73.6916809 74.2619171 74.8865967 75.4589844 76.0135269 76.6956482 77.223587 77.8495026 78.4350128 78.9946823 79.5011444 80.0702667 80.7134705 81.3761444 82.0135193 82.5353851 83.1269684 83.8218079 84.6851578 85.3370209 86.191391 87.0713501 88.0115662 88.772049 89.6631927 90.78405 92.0194092 92.9788818 94.1183243 95.1795349 96.3260498 97.6037064 98.9133606 100.259094 101.632919 102.787865 104.113144 105.478287 106.660965 107.950638 109.130737 110.40773 111.645309 112.866394 114.208817 115.299637 116.339775 117.460892 118.660973 119.72818 120.828606 121.976608 123.043152 124.152351 125.273224 126.394897 127.485184 128.576767 129.709473 130.794312 131.924057 133.007416 134.139877 135.263702 136.324951 137.372208 138.411377 139.465393 140.506866 141.604584 142.736191 143.860565 144.973083 146.106567 147.310272 148.329987 149.489487 150.7948 152.149933 153.56134 155.176285 156.888214 158.91478 161.491669 164.54686 169.130066 176.948242 192.92627 450.732758 ------------------------------ Transdef: Tab for variable 10 0.00305827498 1.10850668 1.42304635 1.63411438 1.79077113 1.89882755 1.99823141 2.08135533 2.14442396 2.21015644 2.26215601 2.31604481 2.36189127 2.40345621 2.44208908 2.47526836 2.50588942 2.53850102 2.56615448 2.59114289 2.61663342 2.63667393 2.65985537 2.68150806 2.70146275 2.71947455 2.7367537 2.75362253 2.77294302 2.78590536 2.80072403 2.81515837 2.82636952 2.83918428 2.85157824 2.86164784 2.87318993 2.88335752 2.89239883 2.90147996 2.91063404 2.91752052 2.92425299 2.93074822 2.93822265 2.94623065 2.95228195 2.95850134 2.96502995 2.97109985 2.97749138 2.98365068 2.98748446 2.99211597 2.99696779 3.00244808 3.00731635 3.01179957 3.01631355 3.02078056 3.02510214 3.02883196 3.03245831 3.03673625 3.04084563 3.04506636 3.04915047 3.05296087 3.0563488 3.05924535 3.06220627 3.06560183 3.06835175 3.07185555 3.07491446 3.07750463 3.08058405 3.08357286 3.08676434 3.08933735 3.09226322 3.09495616 3.09718251 3.10012245 3.1027565 3.10497999 3.10805321 3.11095142 3.11341381 3.11611509 3.11832619 3.12066364 3.12332678 3.12597108 3.12832832 3.13052845 3.13281107 3.13461637 3.13698006 3.13915777 3.1415925 ------------------------------ Transdef: Tab for variable 11 5.7220459E-06 0.00571107771 0.0116139203 0.0187492371 0.0248030424 0.03153494 0.0386790335 0.0462587476 0.0530589819 0.0597343072 0.0671598911 0.0758395195 0.0828283206 0.0905971229 0.0981471539 0.105612114 0.113430865 0.120863885 0.127853751 0.135102987 0.142212212 0.149149179 0.155291706 0.16177626 0.168870926 0.175004482 0.180929527 0.187309861 0.192899704 0.198503464 0.204871655 0.210172668 0.215147674 0.22056967 0.225832477 0.231362581 0.236663908 0.242345572 0.247650743 0.253742516 0.258752704 0.263520956 0.267843902 0.273567915 0.278810978 0.283582926 0.288679063 0.294362545 0.299589634 0.304026604 0.30979681 0.315021515 0.320789039 0.326075792 0.332471997 0.337282896 0.342717707 0.348197699 0.353718996 0.359079331 0.364998102 0.370785475 0.376893878 0.382891834 0.388645768 0.394285202 0.39951086 0.405528039 0.412166595 0.418227255 0.424987078 0.430772424 0.436571598 0.442871898 0.449549377 0.456149101 0.46363163 0.470219433 0.477104247 0.484819949 0.495336622 0.505099416 0.513527811 0.522522926 0.531280279 0.541191578 0.551466823 0.564227819 0.575475574 0.588855982 0.601411343 0.616373897 0.631929398 0.64747566 0.664036512 0.685639024 0.712736487 0.738422632 0.782554328 0.84224081 1.12674999 ------------------------------ Transdef: Tab for variable 12 0.20003137 0.213173211 0.22427544 0.234414577 0.243714571 0.251591027 0.259065241 0.266962349 0.274574906 0.281583726 0.288593054 0.295030177 0.301600635 0.307363302 0.313320696 0.318959534 0.32508105 0.330981642 0.336870372 0.342827052 0.348459005 0.353690863 0.359511018 0.364688605 0.369782567 0.375083327 0.379827023 0.385849059 0.390851945 0.3958202 0.400624752 0.404392749 0.408522934 0.412143886 0.415768206 0.419490099 0.423196405 0.426808298 0.430549085 0.434215546 0.437695116 0.441172123 0.445029795 0.448586971 0.452586949 0.45667845 0.460466206 0.464493573 0.468225598 0.471955687 0.475880265 0.479671478 0.483378053 0.487277299 0.491582036 0.495813996 0.500421166 0.505573511 0.509761453 0.514678121 0.518476605 0.523259163 0.527695596 0.532690883 0.537971854 0.543131292 0.548345268 0.553370774 0.558881521 0.563676715 0.569185019 0.574911714 0.579950571 0.586203456 0.591844797 0.5978477 0.604378343 0.6117872 0.618037343 0.625131249 0.632209122 0.640317082 0.648060083 0.657227099 0.665216804 0.673366189 0.681768119 0.693260133 0.702896476 0.713216186 0.723569751 0.735463738 0.747735262 0.759533882 0.776679158 0.795570612 0.813461661 0.834673226 0.863893986 0.915697694 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0044594 21.5334415 22.3977337 23.0279617 23.5495892 24.1879196 24.7340927 25.1787109 25.6225815 26.0423126 26.5157738 26.989809 27.3262138 27.6992855 28.1218987 28.4972954 28.8529854 29.2152214 29.5111275 29.7953377 30.129837 30.4501038 30.7546234 31.0213852 31.3954296 31.7163544 32.0548058 32.3729019 32.6998978 33.0683365 33.3827705 33.723217 34.0444221 34.4119949 34.6744576 34.989624 35.331707 35.6173897 35.9511185 36.1960449 36.5262566 36.8977165 37.2742615 37.6282654 37.9529457 38.2841873 38.6334915 38.986866 39.3501816 39.7248535 40.1005783 40.4612656 40.8178444 41.1873016 41.5765991 41.9822769 42.3706894 42.7808647 43.0844345 43.488369 43.8780518 44.3069038 44.7495193 45.2034912 45.6856956 46.1772079 46.606041 47.0899582 47.5690804 48.0291367 48.5320282 49.0725632 49.5800247 50.2037582 50.8387299 51.5644836 52.2492104 52.9588127 53.7507744 54.486927 55.3389282 56.1228027 56.93013 57.8497391 58.9581299 60.088501 61.1082764 62.3514442 63.9109688 65.6051407 67.0054932 68.979248 70.6480713 73.2177429 75.7634277 78.4614944 82.5276794 87.113266 93.3145065 103.445114 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.74541 11.1474323 11.4903851 11.8391361 12.2653303 12.4931297 12.835186 13.1476154 13.4634647 13.770998 14.0799904 14.3909931 14.6801529 15.0005798 15.3233318 15.6171627 15.9084244 16.2399044 16.5094833 16.7812729 17.0746841 17.4127865 17.6947765 17.9554443 18.2379265 18.5644093 18.8618164 19.1040173 19.3748512 19.6948318 19.99617 20.3154659 20.6053066 20.9075871 21.177002 21.4668884 21.7486534 22.0084019 22.3537006 22.6337242 22.9304428 23.2047386 23.467495 23.7825089 24.1292858 24.4294357 24.7286263 25.0276642 25.334074 25.6371956 25.936676 26.2372093 26.5291748 26.8435421 27.1533852 27.4248695 27.7095528 27.9844894 28.2935505 28.6106739 28.9362049 29.2396755 29.5787811 29.8884277 30.2122917 30.5287628 30.8972397 31.2296295 31.5425682 31.8865242 32.2650299 32.677063 33.0632057 33.4598618 33.8955917 34.304985 34.7476425 35.1357498 35.6264458 36.1526718 36.6976852 37.204483 37.74757 38.2954025 38.9131927 39.5348358 40.2135315 40.9856758 41.7608261 42.7547302 43.757019 44.6257401 45.9322319 47.4621353 49.3582916 51.5685768 54.300293 58.3061447 64.7895508 139.444885 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.9 48.0 54.3 29.9 49.8 63.0 54.9 64.1 -26.8 -18.1 -38.5 10.3 26.3 2 65.9 100.0 65.5 62.1 34.9 69.1 94.4 74.5 91.6 -44.6 -25.9 -50.7 28.4 35.6 3 48.0 65.5 100.0 46.8 8.6 34.1 69.0 52.9 71.0 -15.7 -27.3 -55.4 60.6 25.9 4 54.3 62.1 46.8 100.0 18.4 39.9 62.2 54.1 69.0 -12.4 -31.2 -63.3 18.5 71.6 5 29.9 34.9 8.6 18.4 100.0 84.0 7.4 57.3 56.8 24.6 -8.4 -13.4 -6.2 6.8 6 49.8 69.1 34.1 39.9 84.0 100.0 48.2 79.2 80.2 -6.5 -16.7 -31.6 7.9 20.6 7 63.0 94.4 69.0 62.2 7.4 48.2 100.0 65.9 80.2 -53.3 -24.9 -50.5 33.2 36.9 8 54.9 74.5 52.9 54.1 57.3 79.2 65.9 100.0 83.0 -10.0 -25.0 -44.9 21.9 32.1 9 64.1 91.6 71.0 69.0 56.8 80.2 80.2 83.0 100.0 -20.1 -29.0 -57.4 32.5 41.6 10 -26.8 -44.6 -15.7 -12.4 24.6 -6.5 -53.3 -10.0 -20.1 100.0 3.8 8.6 -4.1 -4.4 11 -18.1 -25.9 -27.3 -31.2 -8.4 -16.7 -24.9 -25.0 -29.0 3.8 100.0 54.2 -10.8 -20.4 12 -38.5 -50.7 -55.4 -63.3 -13.4 -31.6 -50.5 -44.9 -57.4 8.6 54.2 100.0 -25.4 -38.6 13 10.3 28.4 60.6 18.5 -6.2 7.9 33.2 21.9 32.5 -4.1 -10.8 -25.4 100.0 48.0 14 26.3 35.6 25.9 71.6 6.8 20.6 36.9 32.1 41.6 -4.4 -20.4 -38.6 48.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 165.5229 TOTAL CORRELATION OF ALL VARIABLES 72.432161 ROUND 1: MAX CORR ( 72.425012) AFTER KILLING INPUT VARIABLE 6 CONTR 1.01764163 ROUND 2: MAX CORR ( 72.4154461) AFTER KILLING INPUT VARIABLE 8 CONTR 1.17708013 ROUND 3: MAX CORR ( 72.4043843) AFTER KILLING INPUT VARIABLE 14 CONTR 1.26569143 ROUND 4: MAX CORR ( 72.3856865) AFTER KILLING INPUT VARIABLE 11 CONTR 1.64537529 ROUND 5: MAX CORR ( 72.3195207) AFTER KILLING INPUT VARIABLE 2 CONTR 3.09427316 ROUND 6: MAX CORR ( 72.2147661) AFTER KILLING INPUT VARIABLE 12 CONTR 3.89109722 ROUND 7: MAX CORR ( 71.9327276) AFTER KILLING INPUT VARIABLE 10 CONTR 6.37613846 ROUND 8: MAX CORR ( 70.9767048) AFTER KILLING INPUT VARIABLE 9 CONTR 11.6886558 ROUND 9: MAX CORR ( 70.1225195) AFTER KILLING INPUT VARIABLE 3 CONTR 10.9783824 ROUND 10: MAX CORR ( 69.569872) AFTER KILLING INPUT VARIABLE 13 CONTR 8.78639051 ROUND 11: MAX CORR ( 67.9164632) AFTER KILLING INPUT VARIABLE 4 CONTR 15.0771721 ROUND 12: MAX CORR ( 63.0293738) AFTER KILLING INPUT VARIABLE 5 CONTR 25.2971145 LAST REMAINING VARIABLE: 7 total correlation to target: 72.432161 % total significance: 147.027945 sigma correlations of single variables to target: variable 2: 65.9341122 % , in sigma: 133.837744 variable 3: 48.0488007 % , in sigma: 97.5328684 variable 4: 54.3070207 % , in sigma: 110.236248 variable 5: 29.913578 % , in sigma: 60.7207052 variable 6: 49.782739 % , in sigma: 101.05254 variable 7: 63.0293738 % , in sigma: 127.9415 variable 8: 54.8944562 % , in sigma: 111.428666 variable 9: 64.1212769 % , in sigma: 130.157922 variable 10: -26.7847198 % , in sigma: 54.3695268 variable 11: -18.1452617 % , in sigma: 36.8325411 variable 12: -38.4740649 % , in sigma: 78.0973896 variable 13: 10.2764967 % , in sigma: 20.8599629 variable 14: 26.2538941 % , in sigma: 53.292019 variables sorted by significance: 1 most relevant variable 7 corr 63.0293732 , in sigma: 127.941499 2 most relevant variable 5 corr 25.2971153 , in sigma: 51.3498815 3 most relevant variable 4 corr 15.0771723 , in sigma: 30.6047152 4 most relevant variable 13 corr 8.7863903 , in sigma: 17.8352391 5 most relevant variable 3 corr 10.9783821 , in sigma: 22.2846998 6 most relevant variable 9 corr 11.6886559 , in sigma: 23.7264639 7 most relevant variable 10 corr 6.37613869 , in sigma: 12.9427392 8 most relevant variable 12 corr 3.89109731 , in sigma: 7.89842569 9 most relevant variable 2 corr 3.09427309 , in sigma: 6.2809753 10 most relevant variable 11 corr 1.64537525 , in sigma: 3.33989955 11 most relevant variable 14 corr 1.2656914 , in sigma: 2.5691903 12 most relevant variable 8 corr 1.17708015 , in sigma: 2.3893209 13 most relevant variable 6 corr 1.01764166 , in sigma: 2.06568133 global correlations between input variables: variable 2: 99.1723665 % variable 3: 92.3917514 % variable 4: 92.5275253 % variable 5: 95.5289701 % variable 6: 95.1113352 % variable 7: 98.7818626 % variable 8: 89.3317454 % variable 9: 98.7903884 % variable 10: 72.003132 % variable 11: 55.2416428 % variable 12: 77.2656424 % variable 13: 84.4783886 % variable 14: 88.1384181 % significance loss when removing single variables: variable 2: corr = 3.49976386 % , sigma = 7.10406926 variable 3: corr = 15.056226 % , sigma = 30.562197 variable 4: corr = 14.7797032 % , sigma = 30.0008914 variable 5: corr = 14.8981305 % , sigma = 30.2412835 variable 6: corr = 1.01764163 % , sigma = 2.06568127 variable 7: corr = 6.7195932 % , sigma = 13.6399076 variable 8: corr = 1.47073132 % , sigma = 2.9853949 variable 9: corr = 11.1166862 % , sigma = 22.5654392 variable 10: corr = 5.8737768 % , sigma = 11.9230094 variable 11: corr = 1.66670135 % , sigma = 3.38318878 variable 12: corr = 2.89618301 % , sigma = 5.87887799 variable 13: corr = 7.7747041 % , sigma = 15.7816466 variable 14: corr = 1.28272394 % , sigma = 2.60376416 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 17.5191727 sigma out 15 active outputs RANK 2 NODE 1 --> 14.4984884 sigma out 15 active outputs RANK 3 NODE 8 --> 13.6109934 sigma out 15 active outputs RANK 4 NODE 2 --> 13.3125124 sigma out 15 active outputs RANK 5 NODE 4 --> 11.1741037 sigma out 15 active outputs RANK 6 NODE 6 --> 10.3015509 sigma out 15 active outputs RANK 7 NODE 5 --> 8.42290783 sigma out 15 active outputs RANK 8 NODE 9 --> 8.30387783 sigma out 15 active outputs RANK 9 NODE 3 --> 6.43200397 sigma out 15 active outputs RANK 10 NODE 7 --> 6.14042091 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 16.7264977 sigma in 10act. ( 20.2297802 sig out 1act.) RANK 2 NODE 14 --> 14.9557352 sigma in 10act. ( 19.7413673 sig out 1act.) RANK 3 NODE 1 --> 14.6306238 sigma in 10act. ( 13.1691961 sig out 1act.) RANK 4 NODE 7 --> 13.3621006 sigma in 10act. ( 12.1786442 sig out 1act.) RANK 5 NODE 12 --> 12.5462828 sigma in 10act. ( 14.0032511 sig out 1act.) RANK 6 NODE 13 --> 10.266573 sigma in 10act. ( 16.2255325 sig out 1act.) RANK 7 NODE 3 --> 6.61768103 sigma in 10act. ( 6.56940985 sig out 1act.) RANK 8 NODE 6 --> 6.55356121 sigma in 10act. ( 8.79137325 sig out 1act.) RANK 9 NODE 15 --> 4.93497801 sigma in 10act. ( 4.19634151 sig out 1act.) RANK 10 NODE 5 --> 4.88513517 sigma in 10act. ( 2.82574081 sig out 1act.) RANK 11 NODE 2 --> 3.86929297 sigma in 10act. ( 5.46050167 sig out 1act.) RANK 12 NODE 8 --> 3.37462044 sigma in 10act. ( 5.21273613 sig out 1act.) RANK 13 NODE 10 --> 2.31097579 sigma in 10act. ( 3.49866223 sig out 1act.) RANK 14 NODE 9 --> 1.66971993 sigma in 10act. ( 2.92503476 sig out 1act.) RANK 15 NODE 4 --> 1.12049532 sigma in 10act. ( 1.24479949 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 20.2297802 sigma out 1act.( 16.7264977 sig in 10act.) RANK 2 NODE 14 --> 19.7413673 sigma out 1act.( 14.9557352 sig in 10act.) RANK 3 NODE 13 --> 16.2255325 sigma out 1act.( 10.266573 sig in 10act.) RANK 4 NODE 12 --> 14.0032511 sigma out 1act.( 12.5462828 sig in 10act.) RANK 5 NODE 1 --> 13.1691961 sigma out 1act.( 14.6306238 sig in 10act.) RANK 6 NODE 7 --> 12.1786442 sigma out 1act.( 13.3621006 sig in 10act.) RANK 7 NODE 6 --> 8.79137325 sigma out 1act.( 6.55356121 sig in 10act.) RANK 8 NODE 3 --> 6.56940985 sigma out 1act.( 6.61768103 sig in 10act.) RANK 9 NODE 2 --> 5.46050167 sigma out 1act.( 3.86929297 sig in 10act.) RANK 10 NODE 8 --> 5.21273613 sigma out 1act.( 3.37462044 sig in 10act.) RANK 11 NODE 15 --> 4.19634151 sigma out 1act.( 4.93497801 sig in 10act.) RANK 12 NODE 10 --> 3.49866223 sigma out 1act.( 2.31097579 sig in 10act.) RANK 13 NODE 9 --> 2.92503476 sigma out 1act.( 1.66971993 sig in 10act.) RANK 14 NODE 5 --> 2.82574081 sigma out 1act.( 4.88513517 sig in 10act.) RANK 15 NODE 4 --> 1.24479949 sigma out 1act.( 1.12049532 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.4905472 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 30.6894627 sigma out 15 active outputs RANK 2 NODE 8 --> 16.1967812 sigma out 15 active outputs RANK 3 NODE 1 --> 15.7851973 sigma out 15 active outputs RANK 4 NODE 2 --> 14.8074188 sigma out 15 active outputs RANK 5 NODE 4 --> 14.0423183 sigma out 15 active outputs RANK 6 NODE 5 --> 12.9189596 sigma out 15 active outputs RANK 7 NODE 6 --> 12.352706 sigma out 15 active outputs RANK 8 NODE 7 --> 11.1662626 sigma out 15 active outputs RANK 9 NODE 9 --> 9.35725212 sigma out 15 active outputs RANK 10 NODE 3 --> 7.72373152 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 20.7989521 sigma in 10act. ( 19.2804947 sig out 1act.) RANK 2 NODE 13 --> 19.2321262 sigma in 10act. ( 17.0200768 sig out 1act.) RANK 3 NODE 11 --> 19.0365906 sigma in 10act. ( 19.7099361 sig out 1act.) RANK 4 NODE 1 --> 14.5052948 sigma in 10act. ( 11.7821636 sig out 1act.) RANK 5 NODE 12 --> 13.630415 sigma in 10act. ( 13.1315641 sig out 1act.) RANK 6 NODE 7 --> 11.4938154 sigma in 10act. ( 10.7519169 sig out 1act.) RANK 7 NODE 9 --> 11.0242796 sigma in 10act. ( 5.85945368 sig out 1act.) RANK 8 NODE 8 --> 10.8855429 sigma in 10act. ( 6.79594612 sig out 1act.) RANK 9 NODE 6 --> 10.4632835 sigma in 10act. ( 9.15777683 sig out 1act.) RANK 10 NODE 2 --> 10.3890238 sigma in 10act. ( 5.64461851 sig out 1act.) RANK 11 NODE 10 --> 9.21243191 sigma in 10act. ( 4.23104477 sig out 1act.) RANK 12 NODE 5 --> 9.0297327 sigma in 10act. ( 2.68771219 sig out 1act.) RANK 13 NODE 4 --> 7.6146431 sigma in 10act. ( 3.33982277 sig out 1act.) RANK 14 NODE 3 --> 7.29301596 sigma in 10act. ( 6.23090887 sig out 1act.) RANK 15 NODE 15 --> 5.74508524 sigma in 10act. ( 3.92153835 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 19.7099361 sigma out 1act.( 19.0365906 sig in 10act.) RANK 2 NODE 14 --> 19.2804947 sigma out 1act.( 20.7989521 sig in 10act.) RANK 3 NODE 13 --> 17.0200768 sigma out 1act.( 19.2321262 sig in 10act.) RANK 4 NODE 12 --> 13.1315641 sigma out 1act.( 13.630415 sig in 10act.) RANK 5 NODE 1 --> 11.7821636 sigma out 1act.( 14.5052948 sig in 10act.) RANK 6 NODE 7 --> 10.7519169 sigma out 1act.( 11.4938154 sig in 10act.) RANK 7 NODE 6 --> 9.15777683 sigma out 1act.( 10.4632835 sig in 10act.) RANK 8 NODE 8 --> 6.79594612 sigma out 1act.( 10.8855429 sig in 10act.) RANK 9 NODE 3 --> 6.23090887 sigma out 1act.( 7.29301596 sig in 10act.) RANK 10 NODE 9 --> 5.85945368 sigma out 1act.( 11.0242796 sig in 10act.) RANK 11 NODE 2 --> 5.64461851 sigma out 1act.( 10.3890238 sig in 10act.) RANK 12 NODE 10 --> 4.23104477 sigma out 1act.( 9.21243191 sig in 10act.) RANK 13 NODE 15 --> 3.92153835 sigma out 1act.( 5.74508524 sig in 10act.) RANK 14 NODE 4 --> 3.33982277 sigma out 1act.( 7.6146431 sig in 10act.) RANK 15 NODE 5 --> 2.68771219 sigma out 1act.( 9.0297327 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 41.9939308 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.442124933 *** contribution from regularisation: 0.00441196701 *** contribution from error: -0.446536899 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.496352136 *** contribution from regularisation: 0.00210391544 *** contribution from error: -0.498456061 *********************************************** -----------------> Test sample ENTER BFGS code START -47434.5114 0.174677581 0.311562359 EXIT FROM BFGS code FG_START 0. 0.174677581 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.511482596 *** contribution from regularisation: 0.00215891027 *** contribution from error: -0.513641536 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48870.6252 0.174677581 97.6025009 EXIT FROM BFGS code FG_LNSRCH 0. 0.189725593 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.544183612 *** contribution from regularisation: 0.00305111893 *** contribution from error: -0.547234714 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51995.1108 0.189725593 126.907509 EXIT FROM BFGS code NEW_X -51995.1108 0.189725593 126.907509 ENTER BFGS code NEW_X -51995.1108 0.189725593 126.907509 EXIT FROM BFGS code FG_LNSRCH 0. 0.206909999 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.54634887 *** contribution from regularisation: 0.00297027919 *** contribution from error: -0.549319148 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52201.994 0.206909999 56.6684952 EXIT FROM BFGS code NEW_X -52201.994 0.206909999 56.6684952 ENTER BFGS code NEW_X -52201.994 0.206909999 56.6684952 EXIT FROM BFGS code FG_LNSRCH 0. 0.225528136 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.548026085 *** contribution from regularisation: 0.00286614662 *** contribution from error: -0.550892234 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52362.2468 0.225528136 9.92821503 EXIT FROM BFGS code NEW_X -52362.2468 0.225528136 9.92821503 ENTER BFGS code NEW_X -52362.2468 0.225528136 9.92821503 EXIT FROM BFGS code FG_LNSRCH 0. 0.238233387 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.548582375 *** contribution from regularisation: 0.00284321955 *** contribution from error: -0.551425576 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52415.4024 0.238233387 -2.20577431 EXIT FROM BFGS code NEW_X -52415.4024 0.238233387 -2.20577431 ENTER BFGS code NEW_X -52415.4024 0.238233387 -2.20577431 EXIT FROM BFGS code FG_LNSRCH 0. 0.245771974 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.548822999 *** contribution from regularisation: 0.00284149172 *** contribution from error: -0.551664472 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52438.3884 0.245771974 -5.07821274 EXIT FROM BFGS code NEW_X -52438.3884 0.245771974 -5.07821274 ENTER BFGS code NEW_X -52438.3884 0.245771974 -5.07821274 EXIT FROM BFGS code FG_LNSRCH 0. 0.259883285 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.549182117 *** contribution from regularisation: 0.00281977258 *** contribution from error: -0.552001894 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52472.7033 0.259883285 10.3954897 EXIT FROM BFGS code NEW_X -52472.7033 0.259883285 10.3954897 ENTER BFGS code NEW_X -52472.7033 0.259883285 10.3954897 EXIT FROM BFGS code FG_LNSRCH 0. 0.300704479 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 40.6535568 sigma out 15 active outputs RANK 2 NODE 1 --> 23.0495052 sigma out 15 active outputs RANK 3 NODE 5 --> 16.4452381 sigma out 15 active outputs RANK 4 NODE 8 --> 15.9914265 sigma out 15 active outputs RANK 5 NODE 2 --> 14.9884119 sigma out 15 active outputs RANK 6 NODE 6 --> 14.5902729 sigma out 15 active outputs RANK 7 NODE 7 --> 11.5884314 sigma out 15 active outputs RANK 8 NODE 4 --> 10.7536716 sigma out 15 active outputs RANK 9 NODE 3 --> 9.9570446 sigma out 15 active outputs RANK 10 NODE 9 --> 9.1208086 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 26.688345 sigma in 10act. ( 25.0993919 sig out 1act.) RANK 2 NODE 14 --> 22.9045391 sigma in 10act. ( 19.6258183 sig out 1act.) RANK 3 NODE 9 --> 21.1760578 sigma in 10act. ( 20.134016 sig out 1act.) RANK 4 NODE 11 --> 19.3193874 sigma in 10act. ( 19.1355419 sig out 1act.) RANK 5 NODE 2 --> 16.6686764 sigma in 10act. ( 12.2101631 sig out 1act.) RANK 6 NODE 8 --> 15.9873219 sigma in 10act. ( 13.3749924 sig out 1act.) RANK 7 NODE 5 --> 15.123065 sigma in 10act. ( 15.6566763 sig out 1act.) RANK 8 NODE 4 --> 12.9718952 sigma in 10act. ( 11.8354731 sig out 1act.) RANK 9 NODE 10 --> 12.5083513 sigma in 10act. ( 8.86912632 sig out 1act.) RANK 10 NODE 12 --> 11.9006844 sigma in 10act. ( 10.5569992 sig out 1act.) RANK 11 NODE 3 --> 9.16646576 sigma in 10act. ( 8.13404083 sig out 1act.) RANK 12 NODE 1 --> 8.26636028 sigma in 10act. ( 6.27479744 sig out 1act.) RANK 13 NODE 6 --> 8.19170952 sigma in 10act. ( 7.04166031 sig out 1act.) RANK 14 NODE 7 --> 6.09766865 sigma in 10act. ( 5.55658054 sig out 1act.) RANK 15 NODE 15 --> 6.02186394 sigma in 10act. ( 5.35942698 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 25.0993919 sigma out 1act.( 26.688345 sig in 10act.) RANK 2 NODE 9 --> 20.134016 sigma out 1act.( 21.1760578 sig in 10act.) RANK 3 NODE 14 --> 19.6258183 sigma out 1act.( 22.9045391 sig in 10act.) RANK 4 NODE 11 --> 19.1355419 sigma out 1act.( 19.3193874 sig in 10act.) RANK 5 NODE 5 --> 15.6566763 sigma out 1act.( 15.123065 sig in 10act.) RANK 6 NODE 8 --> 13.3749924 sigma out 1act.( 15.9873219 sig in 10act.) RANK 7 NODE 2 --> 12.2101631 sigma out 1act.( 16.6686764 sig in 10act.) RANK 8 NODE 4 --> 11.8354731 sigma out 1act.( 12.9718952 sig in 10act.) RANK 9 NODE 12 --> 10.5569992 sigma out 1act.( 11.9006844 sig in 10act.) RANK 10 NODE 10 --> 8.86912632 sigma out 1act.( 12.5083513 sig in 10act.) RANK 11 NODE 3 --> 8.13404083 sigma out 1act.( 9.16646576 sig in 10act.) RANK 12 NODE 6 --> 7.04166031 sigma out 1act.( 8.19170952 sig in 10act.) RANK 13 NODE 1 --> 6.27479744 sigma out 1act.( 8.26636028 sig in 10act.) RANK 14 NODE 7 --> 5.55658054 sigma out 1act.( 6.09766865 sig in 10act.) RANK 15 NODE 15 --> 5.35942698 sigma out 1act.( 6.02186394 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.8954506 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.549799562 *** contribution from regularisation: 0.00281794905 *** contribution from error: -0.55261749 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52531.7001 0.300704479 -0.0447943024 EXIT FROM BFGS code NEW_X -52531.7001 0.300704479 -0.0447943024 ENTER BFGS code NEW_X -52531.7001 0.300704479 -0.0447943024 EXIT FROM BFGS code FG_LNSRCH 0. 0.392905563 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.550512791 *** contribution from regularisation: 0.0031672453 *** contribution from error: -0.553680062 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52599.844 0.392905563 119.522049 EXIT FROM BFGS code NEW_X -52599.844 0.392905563 119.522049 ENTER BFGS code NEW_X -52599.844 0.392905563 119.522049 EXIT FROM BFGS code FG_LNSRCH 0. 0.431434125 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.551679134 *** contribution from regularisation: 0.00278786523 *** contribution from error: -0.554467022 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52711.2837 0.431434125 -47.374115 EXIT FROM BFGS code NEW_X -52711.2837 0.431434125 -47.374115 ENTER BFGS code NEW_X -52711.2837 0.431434125 -47.374115 EXIT FROM BFGS code FG_LNSRCH 0. 0.393278748 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.551859975 *** contribution from regularisation: 0.00260153599 *** contribution from error: -0.554461539 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52728.5645 0.393278748 -2.79176426 EXIT FROM BFGS code NEW_X -52728.5645 0.393278748 -2.79176426 ENTER BFGS code NEW_X -52728.5645 0.393278748 -2.79176426 EXIT FROM BFGS code FG_LNSRCH 0. 0.399094403 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.551840484 *** contribution from regularisation: 0.00275330804 *** contribution from error: -0.554593801 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52726.7023 0.399094403 7.93510389 EXIT FROM BFGS code FG_LNSRCH 0. 0.39462781 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.551788211 *** contribution from regularisation: 0.00271488074 *** contribution from error: -0.554503083 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52721.7085 0.39462781 -0.140775099 EXIT FROM BFGS code FG_LNSRCH 0. 0.393359572 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.551734269 *** contribution from regularisation: 0.00273011671 *** contribution from error: -0.5544644 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52716.5514 0.393359572 -2.36909127 EXIT FROM BFGS code FG_LNSRCH 0. 0.393278986 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.551734924 *** contribution from regularisation: 0.00272655743 *** contribution from error: -0.554461479 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52716.6196 0.393278986 -2.46618009 EXIT FROM BFGS code FG_LNSRCH 0. 0.393278748 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.551732719 *** contribution from regularisation: 0.0027287663 *** contribution from error: -0.554461479 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52716.408 0.393278748 -2.41985083 EXIT FROM BFGS code FG_LNSRCH 0. 0.393278748 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.551733911 *** contribution from regularisation: 0.00272760284 *** contribution from error: -0.554461539 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52716.5192 0.393278748 -2.36144614 EXIT FROM BFGS code FG_LNSRCH 0. 0.393278748 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 42.3206177 sigma out 15 active outputs RANK 2 NODE 1 --> 27.6209717 sigma out 15 active outputs RANK 3 NODE 8 --> 21.8835201 sigma out 15 active outputs RANK 4 NODE 2 --> 20.213171 sigma out 15 active outputs RANK 5 NODE 5 --> 18.7827816 sigma out 15 active outputs RANK 6 NODE 3 --> 15.0705185 sigma out 15 active outputs RANK 7 NODE 6 --> 15.0667543 sigma out 15 active outputs RANK 8 NODE 7 --> 12.6828175 sigma out 15 active outputs RANK 9 NODE 4 --> 10.3121996 sigma out 15 active outputs RANK 10 NODE 9 --> 8.57883835 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 35.4186363 sigma in 10act. ( 34.2093391 sig out 1act.) RANK 2 NODE 14 --> 25.8359451 sigma in 10act. ( 22.7593822 sig out 1act.) RANK 3 NODE 9 --> 25.5527401 sigma in 10act. ( 25.6209011 sig out 1act.) RANK 4 NODE 11 --> 21.1061535 sigma in 10act. ( 21.5653896 sig out 1act.) RANK 5 NODE 5 --> 20.2049961 sigma in 10act. ( 21.7071228 sig out 1act.) RANK 6 NODE 8 --> 16.24613 sigma in 10act. ( 14.1792545 sig out 1act.) RANK 7 NODE 12 --> 14.5643024 sigma in 10act. ( 14.2003536 sig out 1act.) RANK 8 NODE 2 --> 13.5840082 sigma in 10act. ( 10.3949118 sig out 1act.) RANK 9 NODE 4 --> 11.7447357 sigma in 10act. ( 10.0985336 sig out 1act.) RANK 10 NODE 10 --> 11.2653093 sigma in 10act. ( 9.49472809 sig out 1act.) RANK 11 NODE 3 --> 10.7417202 sigma in 10act. ( 11.2386227 sig out 1act.) RANK 12 NODE 15 --> 7.82507038 sigma in 10act. ( 8.36985493 sig out 1act.) RANK 13 NODE 6 --> 5.04058075 sigma in 10act. ( 3.14503479 sig out 1act.) RANK 14 NODE 1 --> 4.65137911 sigma in 10act. ( 1.77292097 sig out 1act.) RANK 15 NODE 7 --> 3.37780762 sigma in 10act. ( 1.23221254 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 34.2093391 sigma out 1act.( 35.4186363 sig in 10act.) RANK 2 NODE 9 --> 25.6209011 sigma out 1act.( 25.5527401 sig in 10act.) RANK 3 NODE 14 --> 22.7593822 sigma out 1act.( 25.8359451 sig in 10act.) RANK 4 NODE 5 --> 21.7071228 sigma out 1act.( 20.2049961 sig in 10act.) RANK 5 NODE 11 --> 21.5653896 sigma out 1act.( 21.1061535 sig in 10act.) RANK 6 NODE 12 --> 14.2003536 sigma out 1act.( 14.5643024 sig in 10act.) RANK 7 NODE 8 --> 14.1792545 sigma out 1act.( 16.24613 sig in 10act.) RANK 8 NODE 3 --> 11.2386227 sigma out 1act.( 10.7417202 sig in 10act.) RANK 9 NODE 2 --> 10.3949118 sigma out 1act.( 13.5840082 sig in 10act.) RANK 10 NODE 4 --> 10.0985336 sigma out 1act.( 11.7447357 sig in 10act.) RANK 11 NODE 10 --> 9.49472809 sigma out 1act.( 11.2653093 sig in 10act.) RANK 12 NODE 15 --> 8.36985493 sigma out 1act.( 7.82507038 sig in 10act.) RANK 13 NODE 6 --> 3.14503479 sigma out 1act.( 5.04058075 sig in 10act.) RANK 14 NODE 1 --> 1.77292097 sigma out 1act.( 4.65137911 sig in 10act.) RANK 15 NODE 7 --> 1.23221254 sigma out 1act.( 3.37780762 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.7669983 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.55173099 *** contribution from regularisation: 0.00273054116 *** contribution from error: -0.554461539 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52716.2384 0.393278748 -2.30327106 EXIT FROM BFGS code NEW_X -52716.2384 0.393278748 -2.30327106 ENTER BFGS code NEW_X -52716.2384 0.393278748 -2.30327106 EXIT FROM BFGS code CONVERGENC -52716.2384 0.393278748 -2.30327106 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 63.3819275 sigma out 15 active outputs RANK 2 NODE 1 --> 41.7254791 sigma out 15 active outputs RANK 3 NODE 8 --> 33.0515099 sigma out 15 active outputs RANK 4 NODE 2 --> 30.1603775 sigma out 15 active outputs RANK 5 NODE 5 --> 28.5988579 sigma out 15 active outputs RANK 6 NODE 3 --> 23.2135887 sigma out 15 active outputs RANK 7 NODE 6 --> 22.6365089 sigma out 15 active outputs RANK 8 NODE 7 --> 18.7848129 sigma out 15 active outputs RANK 9 NODE 4 --> 15.5629702 sigma out 15 active outputs RANK 10 NODE 9 --> 12.7961941 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 53.5243683 sigma in 10act. ( 53.6073456 sig out 1act.) RANK 2 NODE 14 --> 38.937851 sigma in 10act. ( 35.5545349 sig out 1act.) RANK 3 NODE 9 --> 38.4979744 sigma in 10act. ( 40.0577812 sig out 1act.) RANK 4 NODE 11 --> 31.9046745 sigma in 10act. ( 33.1684608 sig out 1act.) RANK 5 NODE 5 --> 30.6274109 sigma in 10act. ( 33.9312172 sig out 1act.) RANK 6 NODE 8 --> 24.6112309 sigma in 10act. ( 21.8556137 sig out 1act.) RANK 7 NODE 12 --> 22.1164303 sigma in 10act. ( 21.4417877 sig out 1act.) RANK 8 NODE 2 --> 20.4763069 sigma in 10act. ( 16.2460003 sig out 1act.) RANK 9 NODE 4 --> 16.9848576 sigma in 10act. ( 16.0798759 sig out 1act.) RANK 10 NODE 10 --> 16.9623032 sigma in 10act. ( 14.4326124 sig out 1act.) RANK 11 NODE 3 --> 16.1947632 sigma in 10act. ( 17.5625687 sig out 1act.) RANK 12 NODE 15 --> 11.7332182 sigma in 10act. ( 12.9187489 sig out 1act.) RANK 13 NODE 6 --> 6.32396698 sigma in 10act. ( 4.83491373 sig out 1act.) RANK 14 NODE 1 --> 5.10254002 sigma in 10act. ( 2.81707978 sig out 1act.) RANK 15 NODE 7 --> 3.60193563 sigma in 10act. ( 1.87269211 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 53.6073456 sigma out 1act.( 53.5243683 sig in 10act.) RANK 2 NODE 9 --> 40.0577812 sigma out 1act.( 38.4979744 sig in 10act.) RANK 3 NODE 14 --> 35.5545349 sigma out 1act.( 38.937851 sig in 10act.) RANK 4 NODE 5 --> 33.9312172 sigma out 1act.( 30.6274109 sig in 10act.) RANK 5 NODE 11 --> 33.1684608 sigma out 1act.( 31.9046745 sig in 10act.) RANK 6 NODE 8 --> 21.8556137 sigma out 1act.( 24.6112309 sig in 10act.) RANK 7 NODE 12 --> 21.4417877 sigma out 1act.( 22.1164303 sig in 10act.) RANK 8 NODE 3 --> 17.5625687 sigma out 1act.( 16.1947632 sig in 10act.) RANK 9 NODE 2 --> 16.2460003 sigma out 1act.( 20.4763069 sig in 10act.) RANK 10 NODE 4 --> 16.0798759 sigma out 1act.( 16.9848576 sig in 10act.) RANK 11 NODE 10 --> 14.4326124 sigma out 1act.( 16.9623032 sig in 10act.) RANK 12 NODE 15 --> 12.9187489 sigma out 1act.( 11.7332182 sig in 10act.) RANK 13 NODE 6 --> 4.83491373 sigma out 1act.( 6.32396698 sig in 10act.) RANK 14 NODE 1 --> 2.81707978 sigma out 1act.( 5.10254002 sig in 10act.) RANK 15 NODE 7 --> 1.87269211 sigma out 1act.( 3.60193563 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 100.858032 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.551746368 *** contribution from regularisation: 0.0027151606 *** contribution from error: -0.554461539 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26967 Closing output file done