NNInput NNInputs_165.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 196472 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 59040 nbkg = 137432 Bkg Entries: 137432 Sig Entries: 59040 Chosen entries: 59040 Signal fraction: 1 Background fraction: 0.429594 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 137432 Actual Signal Entries: 59040 Entries to split: 59040 Test with : 29520 Train with : 29520 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 59040 for Signal Prepared event 0 for Signal with 59040 events ====Entry 0 Variable Ht : 267.874 Variable LepAPt : 45.292 Variable LepBPt : 35.604 Variable MetSigLeptonsJets : 7.24556 Variable MetSpec : 95.2083 Variable SumEtLeptonsJets : 172.666 Variable VSumJetLeptonsPt : 107.325 Variable addEt : 176.104 Variable dPhiLepSumMet : 2.28406 Variable dPhiLeptons : 0.0254087 Variable dRLeptons : 0.325152 Variable lep1_E : 46.0978 Variable lep2_E : 40.383 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2165 Ht = 267.874 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 45.2922 LepAPt = 45.292 LepBEt = 35.604 LepBPt = 35.604 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 95.2083 MetDelPhi = 2.19471 MetSig = 6.53886 MetSigLeptonsJets = 7.24556 MetSpec = 95.2083 Mjj = 0 MostCentralJetEta = -1.47546 MtllMet = 179.575 Njets = 1 SB = 0 SumEt = 212.005 SumEtJets = 0 SumEtLeptonsJets = 172.666 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 107.325 addEt = 176.104 dPhiLepSumMet = 2.28406 dPhiLeptons = 0.0254087 dRLeptons = 0.325152 diltype = 52 dimass = 13.1154 event = 77 jet1_Et = 91.7697 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.0978 lep2_E = 40.383 rand = 0.999742 run = 237144 weight = 4.01724e-06 ===Show End Prepared event 10000 for Signal with 59040 events Prepared event 20000 for Signal with 59040 events Prepared event 30000 for Signal with 59040 events Prepared event 40000 for Signal with 59040 events Prepared event 50000 for Signal with 59040 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 137432 for Background Prepared event 0 for Background with 137432 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.419128 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 137432 events Prepared event 20000 for Background with 137432 events Prepared event 30000 for Background with 137432 events Prepared event 40000 for Background with 137432 events Prepared event 50000 for Background with 137432 events Prepared event 60000 for Background with 137432 events Prepared event 70000 for Background with 137432 events Prepared event 80000 for Background with 137432 events Prepared event 90000 for Background with 137432 events Prepared event 100000 for Background with 137432 events Prepared event 110000 for Background with 137432 events Prepared event 120000 for Background with 137432 events Prepared event 130000 for Background with 137432 events Warning: found 4374 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 196472 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4374 negative weights. Signal fraction: 62.7400208 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0048981 63.4921188 65.9472961 67.3630829 68.6679611 69.839325 70.73909 71.6664429 72.7127075 73.5905075 74.3842773 75.190567 75.894577 76.6467209 77.1886444 78.0369873 78.7107239 79.4259644 80.0934296 80.8291473 81.470871 82.3018265 83.0718613 83.9602661 85.1877441 86.2191772 87.4656982 88.6511307 89.4719238 91.1163483 92.8231812 94.0772247 95.6053543 97.3270874 99.0517273 100.777374 102.612358 104.181122 105.956497 107.573929 109.201187 110.851135 112.759964 114.674469 116.62339 118.444366 119.868362 121.804749 123.463554 125.20256 127.101303 128.809235 130.570831 132.380829 134.035156 135.821533 137.447113 139.100906 140.63559 142.288971 143.795197 145.38681 146.783295 148.147217 149.497742 150.913147 152.404984 153.661285 155.045166 156.427063 157.912811 159.308441 160.804184 162.405365 164.00415 165.782623 167.787231 169.613342 171.710632 174.154053 176.661926 179.176743 181.863342 184.857407 187.921417 191.037292 194.165649 197.732666 201.440735 205.392639 209.786774 215.185699 220.76709 227.018768 235.031387 244.003815 254.794159 269.999084 290.697021 331.962067 928.238586 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.4477806 20.8293419 21.1705322 21.4531174 21.7161789 21.9925346 22.2178841 22.4520054 22.7167892 22.8937035 23.1158295 23.3607178 23.6057949 23.8729858 24.1192055 24.3777542 24.6010971 24.8549004 25.1094189 25.2570877 25.4937782 25.7361717 25.9576912 26.1969128 26.4713974 26.7060547 26.9805984 27.2044525 27.4700432 27.7424812 27.9832859 28.2136745 28.4536934 28.7015686 28.9574184 29.1831474 29.4693985 29.7475853 30.040535 30.3601704 30.6214294 30.9309158 31.2518177 31.5482216 31.8415451 32.1183662 32.3937607 32.6922302 33.0415497 33.3697357 33.7473907 34.0310059 34.3147736 34.640564 34.9971886 35.3208847 35.6290512 35.9681168 36.3116989 36.6550255 36.9809761 37.345459 37.6740265 38.0465164 38.3762703 38.7215805 39.0617104 39.3113327 39.6672058 39.9899368 40.3762741 40.7188911 41.0948372 41.4918137 41.8376389 42.2190933 42.6399994 43.0587006 43.487606 43.9451523 44.4183388 44.9132843 45.4420319 45.9418678 46.4874573 47.0395508 47.6938629 48.3180504 49.0856895 49.9071388 50.7655334 51.7970047 53.0592957 54.469265 56.2967682 58.6707153 61.5022545 65.9456635 74.5698395 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0002251 10.1259241 10.2992592 10.4027863 10.5032682 10.6324902 10.7757425 10.8967152 11.027565 11.1808338 11.3206148 11.4773769 11.6074562 11.7507248 11.9110355 12.0943089 12.2779217 12.4509373 12.6474628 12.8421669 13.0060978 13.2231274 13.4330368 13.6091938 13.7841377 13.9588699 14.1814289 14.3937168 14.6105404 14.8379936 15.0740767 15.2915459 15.5047503 15.741951 15.9621458 16.2411861 16.5077591 16.7660904 17.0522842 17.3772335 17.666151 17.9433327 18.2625237 18.5587502 18.8866501 19.2046509 19.5458603 19.8715057 20.1827126 20.4569969 20.7722244 21.0912971 21.4149456 21.7394867 22.0103855 22.3245392 22.676548 22.9856262 23.3620872 23.7280273 24.0800228 24.4207993 24.7337952 25.0805588 25.4328194 25.8108006 26.1460018 26.531786 26.9151878 27.2845383 27.6873684 28.0452366 28.3713341 28.7716408 29.1689453 29.551075 29.9136772 30.3017349 30.6947441 31.1165428 31.4975491 31.8706741 32.2912941 32.703022 33.1230469 33.5495758 33.9893608 34.4437027 34.9582863 35.4944153 36.050827 36.6821709 37.3756485 38.162838 39.0662193 40.1312714 41.5190163 43.7249413 46.9171219 52.3231354 101.509193 ------------------------------ Transdef: Tab for variable 5 1.04386115 2.71359396 3.13854933 3.48133516 3.73763251 3.96119571 4.13283825 4.25928688 4.39223385 4.52590656 4.62728691 4.72109795 4.81349564 4.90756273 4.99970102 5.07666302 5.15501451 5.22786999 5.29545641 5.35839653 5.41402006 5.47207642 5.52598715 5.57475567 5.63212252 5.68138409 5.73662853 5.78487396 5.83727741 5.89045334 5.93944168 5.98962975 6.03237104 6.08428669 6.12788868 6.18048763 6.22107506 6.26787663 6.30523205 6.35621738 6.40728378 6.45359135 6.49335575 6.54598141 6.5925951 6.63578892 6.6768713 6.7296114 6.77477932 6.82241726 6.87869167 6.92430496 6.9736948 7.02433109 7.07899857 7.13908768 7.19441891 7.23749065 7.28871632 7.34524727 7.39785767 7.44782448 7.48917675 7.53995609 7.60119915 7.66040707 7.72269058 7.78571033 7.84710693 7.90634441 7.96399021 8.02451611 8.08074474 8.13494873 8.1932106 8.24737835 8.30393124 8.36994553 8.4291153 8.49407196 8.56013203 8.62573624 8.6942482 8.76620483 8.83228874 8.90646935 8.97578621 9.05447197 9.13398457 9.22416878 9.32616425 9.43078327 9.5617218 9.68797016 9.84074688 10.0261526 10.2611599 10.5816841 11.0169573 11.8490019 19.1815319 ------------------------------ Transdef: Tab for variable 6 15.0039139 21.3733292 25.4972267 26.7171516 27.7151241 28.785038 29.5216408 30.4282246 31.2152061 31.9042854 32.4679184 32.9638519 33.4558105 33.9613991 34.5118942 34.9171371 35.3851776 35.8185349 36.2612991 36.6905289 37.0755081 37.51931 37.9494247 38.2999496 38.6452217 39.041954 39.4370575 39.8375626 40.2641449 40.6255341 41.1223221 41.6002197 42.1049767 42.5751801 43.059845 43.5752411 43.9084396 44.4142113 44.9835014 45.5877876 46.2490845 46.9417267 47.5656204 48.2142029 48.8828049 49.5271454 50.1029282 50.7453918 51.6315842 52.5030937 53.3776627 54.1710854 54.8738785 55.747612 56.561985 57.2848892 58.0436783 58.6026459 59.4268532 60.193306 61.0755844 61.9150581 62.7133675 63.506134 64.3566742 65.1271973 65.8790283 66.6860428 67.4541016 68.2360687 68.9798126 69.7054443 70.5183258 71.2647781 72.0098267 72.7768097 73.5392609 74.319397 75.074791 75.8905334 76.7294769 77.5489197 78.3853989 79.2876434 80.2390442 81.1927872 82.179512 83.127121 84.348587 85.6680679 87.2209778 88.9668427 90.8692932 93.2598877 95.6000671 98.8450851 102.92849 108.188553 115.916588 129.983429 280.646332 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.653801 33.7413559 34.4912872 35.0125351 35.5245056 36.0669708 36.6442223 37.044838 37.4574966 37.8183289 38.1373978 38.4656754 38.7929115 39.1362457 39.4700966 39.8388939 40.1538696 40.4544868 40.8635483 41.2461472 41.6324081 42.0860634 42.5775146 43.019146 43.6030731 44.3338585 44.8804321 45.4872704 46.2489738 47.1841545 48.1872292 49.0204353 49.8080826 50.9394379 52.1002274 53.1545792 54.2215233 55.2857933 56.2658348 57.2311211 58.2241364 59.1920891 60.1875534 61.1232834 61.807106 62.8283691 63.7892838 64.78862 65.7097855 66.724205 67.6580887 68.6290436 69.5455093 70.4401703 71.3447876 72.1378632 72.9851608 73.7885513 74.6611404 75.5458069 76.4807434 77.2808762 78.1448135 78.9520111 79.823143 80.9229202 81.9687042 83.0830841 84.1989441 85.5663147 87.0868225 88.607338 90.1178589 91.7880859 93.5441284 95.3912506 97.3346634 99.0982971 100.93589 102.775368 104.769218 106.938499 109.163864 111.581894 114.050476 116.828178 119.889847 123.382263 127.005455 130.788055 135.035324 139.735413 145.282562 151.478119 159.616089 168.956635 181.004028 199.955597 230.725433 582.217407 ------------------------------ Transdef: Tab for variable 8 1.40223694 26.1529064 29.701046 31.3686161 32.3159485 33.0012245 33.720047 34.0724945 34.4937744 34.9275513 35.3088455 35.7599335 36.1352692 36.5116806 36.8779449 37.1941299 37.4846191 37.795723 38.0355988 38.3409462 38.6437988 38.8855553 39.204895 39.5220604 39.7717285 40.1090012 40.4667053 40.8467407 41.2899933 41.6636124 42.096489 42.5540466 42.9854355 43.4132996 43.9037476 44.4101028 44.9895401 45.5721092 46.2285156 46.8715134 47.5307922 48.2518387 48.7950363 49.4014702 50.1683159 50.9145241 51.6547813 52.378952 53.1298752 53.8931503 54.589817 55.3584099 56.1194611 56.8374557 57.5862465 58.2903175 59.0452194 59.7780075 60.5380707 61.0989532 61.8199425 62.5751266 63.3392982 64.0890961 64.772171 65.4962769 66.2404404 66.947876 67.6660919 68.3521118 69.1044998 69.8072205 70.5120239 71.26017 71.9409027 72.6690521 73.387558 74.1084976 74.8193665 75.6030273 76.330658 77.0543442 77.8532104 78.6165619 79.429245 80.3746338 81.3821259 82.3424225 83.4664764 84.7716751 86.3480988 88.027832 90.1616364 92.4673386 95.4853439 98.9508057 103.400589 108.694916 116.566383 132.864685 347.479309 ------------------------------ Transdef: Tab for variable 9 49.4992676 63.0463333 65.2409668 66.9569626 68.1876144 69.1864319 70.2084961 71.0001144 71.7942657 72.7533112 73.5465393 74.2445221 75.0089874 75.59375 76.2289734 76.9385605 77.4321976 78.109726 78.6943207 79.3005142 79.8198166 80.496254 81.0373459 81.6473541 82.4283981 83.1043549 83.8747101 84.7688675 85.756424 86.6672058 87.6826172 88.6511002 89.3584137 90.5458679 91.6808395 92.9780426 94.0801392 95.4403534 96.8900757 98.4006805 99.754776 101.339355 102.806 104.226395 105.624275 106.966393 108.499542 110.02681 111.460396 112.965637 114.460983 115.935013 117.34491 118.74765 119.803711 121.163864 122.681923 123.934967 125.31398 126.674683 128.071808 129.535782 130.8573 132.241913 133.507294 134.800079 136.152802 137.427521 138.778961 139.941345 141.2332 142.419922 143.561493 144.645447 145.736877 146.933151 148.104614 149.126862 150.225067 151.340607 152.411102 153.33844 154.441605 155.478119 156.619125 157.76416 158.982666 160.112701 161.275772 162.641022 163.879608 165.574005 167.244781 169.185059 171.268768 173.958801 177.541336 182.928329 192.279449 212.679993 582.80835 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.14082408 1.44544244 1.66124201 1.81843698 1.93195128 2.02837706 2.10926008 2.18225241 2.24301291 2.29468107 2.33960104 2.38368082 2.42463923 2.45788026 2.49285078 2.52674389 2.55633545 2.58720589 2.61302614 2.63656425 2.65939093 2.68029165 2.70145726 2.72116947 2.73829436 2.7561636 2.770895 2.7856555 2.80046439 2.81370544 2.8270824 2.83908844 2.84904623 2.85761857 2.86761165 2.87819624 2.88663578 2.89653683 2.90522528 2.91496372 2.92172766 2.928545 2.93656206 2.94406152 2.95010018 2.95765829 2.96353889 2.96868634 2.974648 2.97950649 2.98461103 2.98947001 2.99427199 2.99958467 3.00407839 3.0086 3.01339102 3.01757598 3.02262735 3.02713442 3.03019381 3.03429794 3.03789854 3.0415771 3.04465413 3.04879856 3.05244064 3.05567169 3.05844164 3.06229448 3.06573176 3.06858397 3.07186508 3.07459593 3.07797718 3.0809679 3.08408427 3.0872035 3.09003353 3.09281778 3.09547544 3.09798455 3.10077667 3.10365009 3.10608578 3.10861254 3.11107445 3.11352348 3.11583281 3.11840916 3.12092018 3.12313557 3.12565947 3.12815285 3.13061571 3.13230801 3.13454151 3.13660288 3.13908339 3.14158249 ------------------------------ Transdef: Tab for variable 11 1.91926956E-05 0.00483492017 0.0108473506 0.0177414417 0.0237624645 0.0299888849 0.0372311585 0.0444109216 0.0519573577 0.0585300401 0.0649557114 0.0718618631 0.07888484 0.0856823325 0.0921332836 0.0980920792 0.104985952 0.109602869 0.115389898 0.121809378 0.128488541 0.134581566 0.140987039 0.146920443 0.152769208 0.158641085 0.164318323 0.169757873 0.174859405 0.180083811 0.18558228 0.191206932 0.196245909 0.201469898 0.207103729 0.211744249 0.217013597 0.222382188 0.227944851 0.232893974 0.237610996 0.242894411 0.247523546 0.252376318 0.257509351 0.262261003 0.267047942 0.272317529 0.277751386 0.283082783 0.288139582 0.29376623 0.299837708 0.305214882 0.311040282 0.316550195 0.322357416 0.327754736 0.333534002 0.339549422 0.345073164 0.350875258 0.356653452 0.361442327 0.366969109 0.373211384 0.379072428 0.384770185 0.390129536 0.396730602 0.402642339 0.40918684 0.415831685 0.422758698 0.429231614 0.436423421 0.442251712 0.44954285 0.457551837 0.465882301 0.473929703 0.481158137 0.491385818 0.502699852 0.51273191 0.523430288 0.534011006 0.546865582 0.55778718 0.571589708 0.585358202 0.601501346 0.617501259 0.637888789 0.655582905 0.678192854 0.703340709 0.731499314 0.775503397 0.836971641 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.101212122 0.161199361 0.179484427 0.193037331 0.203296944 0.213643223 0.222656652 0.231131181 0.238936633 0.245854974 0.253387183 0.259974062 0.266620517 0.273153663 0.279622674 0.285202026 0.29118073 0.297119617 0.302747071 0.308508992 0.313961148 0.319771528 0.325126112 0.330729395 0.33645609 0.341667771 0.346721143 0.350723535 0.356124163 0.361146152 0.366725862 0.37163645 0.376743436 0.382062435 0.387173682 0.391846478 0.396676004 0.401004374 0.404540241 0.408643901 0.412258744 0.415914297 0.420086801 0.423839509 0.427897394 0.431582808 0.435565621 0.439148039 0.443280697 0.446984947 0.451362133 0.45545572 0.459616065 0.463214755 0.467539251 0.471729398 0.476036638 0.479521215 0.484113455 0.488794327 0.492865562 0.497478992 0.502524376 0.507878661 0.512869775 0.518358231 0.523668528 0.529458404 0.535905838 0.542495728 0.548551798 0.554707527 0.560305178 0.566838682 0.573572516 0.58029151 0.587538242 0.593941331 0.601734638 0.608205497 0.616412282 0.625295281 0.633617997 0.641022444 0.650266409 0.659300506 0.668355584 0.678182364 0.687661052 0.699052215 0.707904458 0.721580207 0.734359145 0.748631299 0.765216649 0.781387091 0.801104188 0.829315901 0.860045075 0.905197203 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.8130531 22.657814 23.4548378 24.0639038 24.7649097 25.211092 25.7269897 26.1882133 26.6977501 27.1441116 27.5944786 28.0535641 28.5042305 28.8649254 29.2393703 29.574192 29.94491 30.3077316 30.6973896 31.0505753 31.4708633 31.8847504 32.2890472 32.5872879 33.0093613 33.3890533 33.7917328 34.2201042 34.5660019 34.9287796 35.2561493 35.5463867 35.9463577 36.2087936 36.5496597 36.912735 37.2742767 37.6554871 38.0016479 38.4004974 38.7564201 39.1323662 39.5069809 39.8599777 40.2202301 40.6020584 40.9783554 41.3987312 41.8078651 42.2255783 42.6251144 43.0098267 43.3302765 43.6639977 44.0827141 44.5262833 44.9423065 45.3386459 45.7641945 46.2023087 46.5476456 46.9612236 47.336586 47.8014221 48.249485 48.6998253 49.1678314 49.66362 50.1905289 50.716877 51.2111206 51.7418365 52.3404922 52.9373703 53.5709763 54.1806564 54.8252182 55.4284058 56.1586227 56.9403839 57.7903519 58.6180725 59.5094376 60.4406586 61.4302902 62.5995102 63.7750397 64.9741287 66.4722595 68.0840149 69.8015747 71.6565247 73.8838043 76.7497406 79.763504 83.7464447 87.6018677 92.9658813 104.497955 381.504089 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.8277016 11.3135014 11.63766 12.0007515 12.3364401 12.6905994 13.0405874 13.4290752 13.7380257 14.0570116 14.4326992 14.6755219 15.0213699 15.3458385 15.6791553 16.0070305 16.3661995 16.6833229 16.9857025 17.3718376 17.7206039 18.0463161 18.3431435 18.6689072 18.988163 19.3163338 19.7138596 20.0682659 20.4441795 20.7478714 21.1328259 21.4609489 21.8232498 22.151886 22.5503044 22.9122467 23.2967491 23.6395683 24.0040131 24.3932877 24.7000847 25.0189037 25.3742237 25.6349659 25.9930153 26.3257866 26.6527023 27.0274239 27.3503151 27.6640129 28.0076485 28.3155136 28.6594734 29.0207691 29.391222 29.7261868 30.0675564 30.3881168 30.7498264 31.0885582 31.450264 31.7547646 32.1291389 32.4746094 32.8650665 33.2276955 33.4610214 33.8721695 34.2081337 34.5654297 34.9276352 35.3129959 35.7345276 36.1517029 36.5730629 37.004837 37.4455566 37.8893127 38.3654861 38.8502884 39.330719 39.9178619 40.4505196 41.0665359 41.7059479 42.4234161 43.0927734 43.8719864 44.5568466 45.5491867 46.493248 47.6797142 49.1120605 50.935833 52.8831711 55.0761261 58.0078926 62.4183655 70.0102997 138.757965 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.4 52.1 58.3 31.3 51.3 65.1 58.1 66.1 -25.0 -25.1 -45.9 18.0 35.5 2 67.4 100.0 69.5 67.3 35.4 69.3 94.8 76.8 92.5 -42.7 -32.3 -57.9 35.3 45.3 3 52.1 69.5 100.0 56.7 10.3 36.3 72.8 56.9 74.5 -15.9 -34.4 -63.1 64.0 38.0 4 58.3 67.3 56.7 100.0 19.1 41.8 67.8 58.5 73.6 -13.1 -37.7 -70.5 29.3 76.6 5 31.3 35.4 10.3 19.1 100.0 84.1 9.4 58.3 55.3 25.2 -10.4 -15.0 -4.1 9.3 6 51.3 69.3 36.3 41.8 84.1 100.0 49.5 80.1 79.0 -6.1 -20.8 -35.0 12.0 25.9 7 65.1 94.8 72.8 67.8 9.4 49.5 100.0 68.8 82.1 -51.1 -31.5 -58.2 39.8 46.6 8 58.1 76.8 56.9 58.5 58.3 80.1 68.8 100.0 84.4 -9.7 -30.7 -51.2 28.1 39.8 9 66.1 92.5 74.5 73.6 55.3 79.0 82.1 84.4 100.0 -19.4 -35.4 -64.0 39.3 51.0 10 -25.0 -42.7 -15.9 -13.1 25.2 -6.1 -51.1 -9.7 -19.4 100.0 3.4 9.8 -5.5 -6.5 11 -25.1 -32.3 -34.4 -37.7 -10.4 -20.8 -31.5 -30.7 -35.4 3.4 100.0 57.9 -17.4 -28.1 12 -45.9 -57.9 -63.1 -70.5 -15.0 -35.0 -58.2 -51.2 -64.0 9.8 57.9 100.0 -33.9 -49.1 13 18.0 35.3 64.0 29.3 -4.1 12.0 39.8 28.1 39.3 -5.5 -17.4 -33.9 100.0 53.6 14 35.5 45.3 38.0 76.6 9.3 25.9 46.6 39.8 51.0 -6.5 -28.1 -49.1 53.6 100.0 TOTAL CORRELATION TO TARGET (diagonal) 176.567774 TOTAL CORRELATION OF ALL VARIABLES 73.6382725 ROUND 1: MAX CORR ( 73.6382674) AFTER KILLING INPUT VARIABLE 14 CONTR 0.0272757725 ROUND 2: MAX CORR ( 73.6379337) AFTER KILLING INPUT VARIABLE 8 CONTR 0.221685004 ROUND 3: MAX CORR ( 73.6376675) AFTER KILLING INPUT VARIABLE 6 CONTR 0.198005066 ROUND 4: MAX CORR ( 73.6371487) AFTER KILLING INPUT VARIABLE 11 CONTR 0.276436991 ROUND 5: MAX CORR ( 73.6344448) AFTER KILLING INPUT VARIABLE 2 CONTR 0.631038249 ROUND 6: MAX CORR ( 73.6035621) AFTER KILLING INPUT VARIABLE 12 CONTR 2.13239306 ROUND 7: MAX CORR ( 73.4124421) AFTER KILLING INPUT VARIABLE 10 CONTR 5.30072655 ROUND 8: MAX CORR ( 72.6593436) AFTER KILLING INPUT VARIABLE 13 CONTR 10.4883953 ROUND 9: MAX CORR ( 71.8327038) AFTER KILLING INPUT VARIABLE 3 CONTR 10.9289926 ROUND 10: MAX CORR ( 71.4453673) AFTER KILLING INPUT VARIABLE 9 CONTR 7.44961889 ROUND 11: MAX CORR ( 69.8399621) AFTER KILLING INPUT VARIABLE 4 CONTR 15.0605515 ROUND 12: MAX CORR ( 65.0827359) AFTER KILLING INPUT VARIABLE 5 CONTR 25.3349124 LAST REMAINING VARIABLE: 7 total correlation to target: 73.6382725 % total significance: 160.309005 sigma correlations of single variables to target: variable 2: 67.3659762 % , in sigma: 146.654345 variable 3: 52.1030846 % , in sigma: 113.427344 variable 4: 58.2791698 % , in sigma: 126.872554 variable 5: 31.3221031 % , in sigma: 68.1875744 variable 6: 51.2753131 % , in sigma: 111.625302 variable 7: 65.0827359 % , in sigma: 141.683778 variable 8: 58.0813821 % , in sigma: 126.441975 variable 9: 66.0501966 % , in sigma: 143.78992 variable 10: -24.9665867 % , in sigma: 54.351746 variable 11: -25.0650648 % , in sigma: 54.5661307 variable 12: -45.893279 % , in sigma: 99.9087249 variable 13: 17.9909725 % , in sigma: 39.1659773 variable 14: 35.542723 % , in sigma: 77.3757772 variables sorted by significance: 1 most relevant variable 7 corr 65.0827332 , in sigma: 141.683772 2 most relevant variable 5 corr 25.3349133 , in sigma: 55.1535853 3 most relevant variable 4 corr 15.0605516 , in sigma: 32.7865113 4 most relevant variable 9 corr 7.44961882 , in sigma: 16.217667 5 most relevant variable 3 corr 10.9289923 , in sigma: 23.7921915 6 most relevant variable 13 corr 10.4883957 , in sigma: 22.8330218 7 most relevant variable 10 corr 5.30072641 , in sigma: 11.5395724 8 most relevant variable 12 corr 2.13239312 , in sigma: 4.64217599 9 most relevant variable 2 corr 0.631038249 , in sigma: 1.37375729 10 most relevant variable 11 corr 0.276436985 , in sigma: 0.601797632 11 most relevant variable 6 corr 0.198005065 , in sigma: 0.431052956 12 most relevant variable 8 corr 0.221685007 , in sigma: 0.482603703 13 most relevant variable 14 corr 0.0272757728 , in sigma: 0.0593787965 global correlations between input variables: variable 2: 99.1985212 % variable 3: 92.808365 % variable 4: 93.5689275 % variable 5: 95.1888612 % variable 6: 95.0847061 % variable 7: 98.8372271 % variable 8: 90.513454 % variable 9: 98.7469431 % variable 10: 72.1799168 % variable 11: 58.7948905 % variable 12: 81.631556 % variable 13: 84.8231233 % variable 14: 89.5428523 % significance loss when removing single variables: variable 2: corr = 0.689750328 % , sigma = 1.50157228 variable 3: corr = 13.1191809 % , sigma = 28.5601871 variable 4: corr = 12.5009266 % , sigma = 27.2142602 variable 5: corr = 15.3035956 % , sigma = 33.315613 variable 6: corr = 0.264441002 % , sigma = 0.575682624 variable 7: corr = 9.19059335 % , sigma = 20.0077328 variable 8: corr = 0.221825913 % , sigma = 0.482910452 variable 9: corr = 9.82318429 % , sigma = 21.3848702 variable 10: corr = 5.01532681 % , sigma = 10.9182634 variable 11: corr = 0.287375979 % , sigma = 0.625611598 variable 12: corr = 1.78975075 % , sigma = 3.8962506 variable 13: corr = 7.25512327 % , sigma = 15.7942542 variable 14: corr = 0.0272757725 % , sigma = 0.0593787959 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 32.4256248 sigma out 15 active outputs RANK 2 NODE 1 --> 21.237093 sigma out 15 active outputs RANK 3 NODE 6 --> 20.3680897 sigma out 15 active outputs RANK 4 NODE 5 --> 20.180912 sigma out 15 active outputs RANK 5 NODE 9 --> 16.6785507 sigma out 15 active outputs RANK 6 NODE 4 --> 16.2072525 sigma out 15 active outputs RANK 7 NODE 8 --> 12.4582939 sigma out 15 active outputs RANK 8 NODE 3 --> 10.3246622 sigma out 15 active outputs RANK 9 NODE 7 --> 9.41337395 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 41.6728706 sigma in 9act. ( 44.3926582 sig out 1act.) RANK 2 NODE 11 --> 25.7436981 sigma in 9act. ( 28.0062256 sig out 1act.) RANK 3 NODE 3 --> 16.7928638 sigma in 9act. ( 18.9519615 sig out 1act.) RANK 4 NODE 1 --> 12.8898087 sigma in 9act. ( 18.1257896 sig out 1act.) RANK 5 NODE 12 --> 11.9143515 sigma in 9act. ( 14.0695162 sig out 1act.) RANK 6 NODE 14 --> 6.11000633 sigma in 9act. ( 1.29912066 sig out 1act.) RANK 7 NODE 7 --> 5.96851778 sigma in 9act. ( 5.74351645 sig out 1act.) RANK 8 NODE 13 --> 5.88543415 sigma in 9act. ( 4.12063217 sig out 1act.) RANK 9 NODE 10 --> 5.64245749 sigma in 9act. ( 7.47029829 sig out 1act.) RANK 10 NODE 9 --> 5.37603712 sigma in 9act. ( 0.81930089 sig out 1act.) RANK 11 NODE 15 --> 5.31811619 sigma in 9act. ( 6.44884443 sig out 1act.) RANK 12 NODE 6 --> 4.33456945 sigma in 9act. ( 6.48350096 sig out 1act.) RANK 13 NODE 2 --> 2.38666081 sigma in 9act. ( 1.31023061 sig out 1act.) RANK 14 NODE 5 --> 1.78074098 sigma in 9act. ( 3.17438102 sig out 1act.) RANK 15 NODE 4 --> 1.44771028 sigma in 9act. ( 1.98719299 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 44.3926582 sigma out 1act.( 41.6728706 sig in 9act.) RANK 2 NODE 11 --> 28.0062256 sigma out 1act.( 25.7436981 sig in 9act.) RANK 3 NODE 3 --> 18.9519615 sigma out 1act.( 16.7928638 sig in 9act.) RANK 4 NODE 1 --> 18.1257896 sigma out 1act.( 12.8898087 sig in 9act.) RANK 5 NODE 12 --> 14.0695162 sigma out 1act.( 11.9143515 sig in 9act.) RANK 6 NODE 10 --> 7.47029829 sigma out 1act.( 5.64245749 sig in 9act.) RANK 7 NODE 6 --> 6.48350096 sigma out 1act.( 4.33456945 sig in 9act.) RANK 8 NODE 15 --> 6.44884443 sigma out 1act.( 5.31811619 sig in 9act.) RANK 9 NODE 7 --> 5.74351645 sigma out 1act.( 5.96851778 sig in 9act.) RANK 10 NODE 13 --> 4.12063217 sigma out 1act.( 5.88543415 sig in 9act.) RANK 11 NODE 5 --> 3.17438102 sigma out 1act.( 1.78074098 sig in 9act.) RANK 12 NODE 4 --> 1.98719299 sigma out 1act.( 1.44771028 sig in 9act.) RANK 13 NODE 2 --> 1.31023061 sigma out 1act.( 2.38666081 sig in 9act.) RANK 14 NODE 14 --> 1.29912066 sigma out 1act.( 6.11000633 sig in 9act.) RANK 15 NODE 9 --> 0.81930089 sigma out 1act.( 5.37603712 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 62.0340767 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 37.6367035 sigma out 15 active outputs RANK 2 NODE 1 --> 21.9919415 sigma out 15 active outputs RANK 3 NODE 5 --> 21.3955574 sigma out 15 active outputs RANK 4 NODE 6 --> 20.7270985 sigma out 15 active outputs RANK 5 NODE 4 --> 18.1810474 sigma out 15 active outputs RANK 6 NODE 9 --> 18.1189232 sigma out 15 active outputs RANK 7 NODE 8 --> 16.6627808 sigma out 15 active outputs RANK 8 NODE 3 --> 12.335722 sigma out 15 active outputs RANK 9 NODE 7 --> 10.7981892 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 40.8625793 sigma in 9act. ( 42.7796974 sig out 1act.) RANK 2 NODE 11 --> 25.2230854 sigma in 9act. ( 25.4999485 sig out 1act.) RANK 3 NODE 1 --> 19.7378178 sigma in 9act. ( 17.0722771 sig out 1act.) RANK 4 NODE 3 --> 18.6325226 sigma in 9act. ( 17.6510487 sig out 1act.) RANK 5 NODE 12 --> 15.2547865 sigma in 9act. ( 14.0471621 sig out 1act.) RANK 6 NODE 6 --> 11.2498722 sigma in 9act. ( 6.98392916 sig out 1act.) RANK 7 NODE 5 --> 11.0721693 sigma in 9act. ( 5.37486362 sig out 1act.) RANK 8 NODE 10 --> 10.4189968 sigma in 9act. ( 8.56390953 sig out 1act.) RANK 9 NODE 4 --> 9.25604916 sigma in 9act. ( 2.84281421 sig out 1act.) RANK 10 NODE 15 --> 8.91180229 sigma in 9act. ( 6.5357132 sig out 1act.) RANK 11 NODE 7 --> 7.30189276 sigma in 9act. ( 5.4002986 sig out 1act.) RANK 12 NODE 13 --> 6.73127699 sigma in 9act. ( 3.47223163 sig out 1act.) RANK 13 NODE 14 --> 6.57371426 sigma in 9act. ( 0.498293072 sig out 1act.) RANK 14 NODE 9 --> 5.60834789 sigma in 9act. ( 0.0931719169 sig out 1act.) RANK 15 NODE 2 --> 4.61540031 sigma in 9act. ( 1.23582435 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 42.7796974 sigma out 1act.( 40.8625793 sig in 9act.) RANK 2 NODE 11 --> 25.4999485 sigma out 1act.( 25.2230854 sig in 9act.) RANK 3 NODE 3 --> 17.6510487 sigma out 1act.( 18.6325226 sig in 9act.) RANK 4 NODE 1 --> 17.0722771 sigma out 1act.( 19.7378178 sig in 9act.) RANK 5 NODE 12 --> 14.0471621 sigma out 1act.( 15.2547865 sig in 9act.) RANK 6 NODE 10 --> 8.56390953 sigma out 1act.( 10.4189968 sig in 9act.) RANK 7 NODE 6 --> 6.98392916 sigma out 1act.( 11.2498722 sig in 9act.) RANK 8 NODE 15 --> 6.5357132 sigma out 1act.( 8.91180229 sig in 9act.) RANK 9 NODE 7 --> 5.4002986 sigma out 1act.( 7.30189276 sig in 9act.) RANK 10 NODE 5 --> 5.37486362 sigma out 1act.( 11.0721693 sig in 9act.) RANK 11 NODE 13 --> 3.47223163 sigma out 1act.( 6.73127699 sig in 9act.) RANK 12 NODE 4 --> 2.84281421 sigma out 1act.( 9.25604916 sig in 9act.) RANK 13 NODE 2 --> 1.23582435 sigma out 1act.( 4.61540031 sig in 9act.) RANK 14 NODE 14 --> 0.498293072 sigma out 1act.( 6.57371426 sig in 9act.) RANK 15 NODE 9 --> 0.0931719169 sigma out 1act.( 5.60834789 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 59.3759308 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.438183129 *** contribution from regularisation: 0.00376257673 *** contribution from error: -0.441945702 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.488406539 *** contribution from regularisation: 0.00172780605 *** contribution from error: -0.490134358 *********************************************** -----------------> Test sample ENTER BFGS code START -47988.927 0.529638469 0.0558113009 EXIT FROM BFGS code FG_START 0. 0.529638469 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.505131662 *** contribution from regularisation: 0.00184511777 *** contribution from error: -0.506976783 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49622.1165 0.529638469 33.6053581 EXIT FROM BFGS code FG_LNSRCH 0. 0.534274697 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.533929408 *** contribution from regularisation: 0.00240525324 *** contribution from error: -0.536334634 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52451.0921 0.534274697 82.5348816 EXIT FROM BFGS code NEW_X -52451.0921 0.534274697 82.5348816 ENTER BFGS code NEW_X -52451.0921 0.534274697 82.5348816 EXIT FROM BFGS code FG_LNSRCH 0. 0.543315113 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.536926329 *** contribution from regularisation: 0.00242640846 *** contribution from error: -0.539352715 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52745.4975 0.543315113 31.5581169 EXIT FROM BFGS code NEW_X -52745.4975 0.543315113 31.5581169 ENTER BFGS code NEW_X -52745.4975 0.543315113 31.5581169 EXIT FROM BFGS code FG_LNSRCH 0. 0.55051136 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.538193703 *** contribution from regularisation: 0.00245109643 *** contribution from error: -0.540644825 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52869.9985 0.55051136 -6.90373898 EXIT FROM BFGS code NEW_X -52869.9985 0.55051136 -6.90373898 ENTER BFGS code NEW_X -52869.9985 0.55051136 -6.90373898 EXIT FROM BFGS code FG_LNSRCH 0. 0.551468909 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.538689971 *** contribution from regularisation: 0.00244507007 *** contribution from error: -0.541135013 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52918.7474 0.551468909 -22.5375862 EXIT FROM BFGS code NEW_X -52918.7474 0.551468909 -22.5375862 ENTER BFGS code NEW_X -52918.7474 0.551468909 -22.5375862 EXIT FROM BFGS code FG_LNSRCH 0. 0.546649873 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.539013326 *** contribution from regularisation: 0.00241681514 *** contribution from error: -0.541430116 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52950.5114 0.546649873 -18.9189491 EXIT FROM BFGS code NEW_X -52950.5114 0.546649873 -18.9189491 ENTER BFGS code NEW_X -52950.5114 0.546649873 -18.9189491 EXIT FROM BFGS code FG_LNSRCH 0. 0.532850623 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.539455295 *** contribution from regularisation: 0.0023981682 *** contribution from error: -0.541853487 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52993.9323 0.532850623 -0.81335938 EXIT FROM BFGS code NEW_X -52993.9323 0.532850623 -0.81335938 ENTER BFGS code NEW_X -52993.9323 0.532850623 -0.81335938 EXIT FROM BFGS code FG_LNSRCH 0. 0.495063543 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 50.0289192 sigma out 15 active outputs RANK 2 NODE 1 --> 28.3821507 sigma out 15 active outputs RANK 3 NODE 8 --> 25.4750366 sigma out 15 active outputs RANK 4 NODE 4 --> 19.7972679 sigma out 15 active outputs RANK 5 NODE 7 --> 18.2854748 sigma out 15 active outputs RANK 6 NODE 9 --> 16.7740097 sigma out 15 active outputs RANK 7 NODE 5 --> 14.0505667 sigma out 15 active outputs RANK 8 NODE 3 --> 13.9167557 sigma out 15 active outputs RANK 9 NODE 6 --> 13.910368 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 42.684391 sigma in 9act. ( 48.3352356 sig out 1act.) RANK 2 NODE 1 --> 26.36236 sigma in 9act. ( 19.2483997 sig out 1act.) RANK 3 NODE 5 --> 24.0289326 sigma in 9act. ( 20.0471497 sig out 1act.) RANK 4 NODE 10 --> 20.9955196 sigma in 9act. ( 15.4752836 sig out 1act.) RANK 5 NODE 6 --> 20.4460583 sigma in 9act. ( 18.9833355 sig out 1act.) RANK 6 NODE 11 --> 20.2649918 sigma in 9act. ( 18.8879051 sig out 1act.) RANK 7 NODE 4 --> 18.9976025 sigma in 9act. ( 14.8944092 sig out 1act.) RANK 8 NODE 12 --> 18.6496773 sigma in 9act. ( 13.5376444 sig out 1act.) RANK 9 NODE 3 --> 12.4051638 sigma in 9act. ( 11.0604038 sig out 1act.) RANK 10 NODE 15 --> 10.7765827 sigma in 9act. ( 10.1072931 sig out 1act.) RANK 11 NODE 2 --> 9.18601894 sigma in 9act. ( 8.25991344 sig out 1act.) RANK 12 NODE 7 --> 7.5589447 sigma in 9act. ( 5.61854744 sig out 1act.) RANK 13 NODE 14 --> 5.76807547 sigma in 9act. ( 4.32511902 sig out 1act.) RANK 14 NODE 9 --> 4.21480179 sigma in 9act. ( 2.36659026 sig out 1act.) RANK 15 NODE 13 --> 3.81123805 sigma in 9act. ( 1.02151489 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 48.3352356 sigma out 1act.( 42.684391 sig in 9act.) RANK 2 NODE 5 --> 20.0471497 sigma out 1act.( 24.0289326 sig in 9act.) RANK 3 NODE 1 --> 19.2483997 sigma out 1act.( 26.36236 sig in 9act.) RANK 4 NODE 6 --> 18.9833355 sigma out 1act.( 20.4460583 sig in 9act.) RANK 5 NODE 11 --> 18.8879051 sigma out 1act.( 20.2649918 sig in 9act.) RANK 6 NODE 10 --> 15.4752836 sigma out 1act.( 20.9955196 sig in 9act.) RANK 7 NODE 4 --> 14.8944092 sigma out 1act.( 18.9976025 sig in 9act.) RANK 8 NODE 12 --> 13.5376444 sigma out 1act.( 18.6496773 sig in 9act.) RANK 9 NODE 3 --> 11.0604038 sigma out 1act.( 12.4051638 sig in 9act.) RANK 10 NODE 15 --> 10.1072931 sigma out 1act.( 10.7765827 sig in 9act.) RANK 11 NODE 2 --> 8.25991344 sigma out 1act.( 9.18601894 sig in 9act.) RANK 12 NODE 7 --> 5.61854744 sigma out 1act.( 7.5589447 sig in 9act.) RANK 13 NODE 14 --> 4.32511902 sigma out 1act.( 5.76807547 sig in 9act.) RANK 14 NODE 9 --> 2.36659026 sigma out 1act.( 4.21480179 sig in 9act.) RANK 15 NODE 13 --> 1.02151489 sigma out 1act.( 3.81123805 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 69.4264679 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.54052943 *** contribution from regularisation: 0.00243995804 *** contribution from error: -0.542969406 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53099.4505 0.495063543 25.4537907 EXIT FROM BFGS code NEW_X -53099.4505 0.495063543 25.4537907 ENTER BFGS code NEW_X -53099.4505 0.495063543 25.4537907 EXIT FROM BFGS code FG_LNSRCH 0. 0.41586414 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.54084909 *** contribution from regularisation: 0.00299600535 *** contribution from error: -0.543845117 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53130.8504 0.41586414 151.01329 EXIT FROM BFGS code FG_LNSRCH 0. 0.462434143 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.541912735 *** contribution from regularisation: 0.00217284844 *** contribution from error: -0.544085562 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53235.3377 0.462434143 62.1381493 EXIT FROM BFGS code NEW_X -53235.3377 0.462434143 62.1381493 ENTER BFGS code NEW_X -53235.3377 0.462434143 62.1381493 EXIT FROM BFGS code FG_LNSRCH 0. 0.436407536 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.541286588 *** contribution from regularisation: 0.00321923732 *** contribution from error: -0.544505835 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53173.8309 0.436407536 -87.2316971 EXIT FROM BFGS code FG_LNSRCH 0. 0.452453166 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.54290241 *** contribution from regularisation: 0.00205458119 *** contribution from error: -0.544956982 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53332.5588 0.452453166 18.6020679 EXIT FROM BFGS code NEW_X -53332.5588 0.452453166 18.6020679 ENTER BFGS code NEW_X -53332.5588 0.452453166 18.6020679 EXIT FROM BFGS code FG_LNSRCH 0. 0.449234515 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.542804718 *** contribution from regularisation: 0.00266148732 *** contribution from error: -0.545466185 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53322.9634 0.449234515 18.4320507 EXIT FROM BFGS code FG_LNSRCH 0. 0.451582819 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.542744279 *** contribution from regularisation: 0.00242939638 *** contribution from error: -0.545173705 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53317.0283 0.451582819 18.8279266 EXIT FROM BFGS code FG_LNSRCH 0. 0.452355385 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.542487144 *** contribution from regularisation: 0.0024969927 *** contribution from error: -0.544984162 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53291.7673 0.452355385 18.8549232 EXIT FROM BFGS code FG_LNSRCH 0. 0.452452272 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.542451322 *** contribution from regularisation: 0.00250596809 *** contribution from error: -0.54495728 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53288.2457 0.452452272 18.9037342 EXIT FROM BFGS code FG_LNSRCH 0. 0.452453166 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.542458594 *** contribution from regularisation: 0.00249836384 *** contribution from error: -0.544956982 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53288.9633 0.452453166 18.8570557 EXIT FROM BFGS code FG_LNSRCH 0. 0.452453166 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 56.2757034 sigma out 15 active outputs RANK 2 NODE 1 --> 34.8074837 sigma out 15 active outputs RANK 3 NODE 4 --> 30.3101673 sigma out 15 active outputs RANK 4 NODE 7 --> 29.9913616 sigma out 15 active outputs RANK 5 NODE 8 --> 28.4409523 sigma out 15 active outputs RANK 6 NODE 3 --> 22.1384602 sigma out 15 active outputs RANK 7 NODE 9 --> 20.9214096 sigma out 15 active outputs RANK 8 NODE 5 --> 15.3101978 sigma out 15 active outputs RANK 9 NODE 6 --> 12.734437 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 65.6402512 sigma in 9act. ( 67.5544662 sig out 1act.) RANK 2 NODE 5 --> 27.2457886 sigma in 9act. ( 24.6498299 sig out 1act.) RANK 3 NODE 1 --> 25.4920826 sigma in 9act. ( 19.6181164 sig out 1act.) RANK 4 NODE 6 --> 24.6748943 sigma in 9act. ( 24.7355614 sig out 1act.) RANK 5 NODE 10 --> 21.517971 sigma in 9act. ( 20.0175228 sig out 1act.) RANK 6 NODE 4 --> 19.7482643 sigma in 9act. ( 16.5680275 sig out 1act.) RANK 7 NODE 11 --> 18.1530209 sigma in 9act. ( 16.0351086 sig out 1act.) RANK 8 NODE 12 --> 17.5055771 sigma in 9act. ( 12.5429029 sig out 1act.) RANK 9 NODE 15 --> 12.9524355 sigma in 9act. ( 11.7672586 sig out 1act.) RANK 10 NODE 2 --> 12.868165 sigma in 9act. ( 12.8221388 sig out 1act.) RANK 11 NODE 3 --> 10.6346493 sigma in 9act. ( 10.8026123 sig out 1act.) RANK 12 NODE 14 --> 6.40217924 sigma in 9act. ( 5.62036657 sig out 1act.) RANK 13 NODE 7 --> 4.36045742 sigma in 9act. ( 2.80576539 sig out 1act.) RANK 14 NODE 13 --> 3.71849823 sigma in 9act. ( 2.49325371 sig out 1act.) RANK 15 NODE 9 --> 3.32122278 sigma in 9act. ( 1.62447345 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 67.5544662 sigma out 1act.( 65.6402512 sig in 9act.) RANK 2 NODE 6 --> 24.7355614 sigma out 1act.( 24.6748943 sig in 9act.) RANK 3 NODE 5 --> 24.6498299 sigma out 1act.( 27.2457886 sig in 9act.) RANK 4 NODE 10 --> 20.0175228 sigma out 1act.( 21.517971 sig in 9act.) RANK 5 NODE 1 --> 19.6181164 sigma out 1act.( 25.4920826 sig in 9act.) RANK 6 NODE 4 --> 16.5680275 sigma out 1act.( 19.7482643 sig in 9act.) RANK 7 NODE 11 --> 16.0351086 sigma out 1act.( 18.1530209 sig in 9act.) RANK 8 NODE 2 --> 12.8221388 sigma out 1act.( 12.868165 sig in 9act.) RANK 9 NODE 12 --> 12.5429029 sigma out 1act.( 17.5055771 sig in 9act.) RANK 10 NODE 15 --> 11.7672586 sigma out 1act.( 12.9524355 sig in 9act.) RANK 11 NODE 3 --> 10.8026123 sigma out 1act.( 10.6346493 sig in 9act.) RANK 12 NODE 14 --> 5.62036657 sigma out 1act.( 6.40217924 sig in 9act.) RANK 13 NODE 7 --> 2.80576539 sigma out 1act.( 4.36045742 sig in 9act.) RANK 14 NODE 13 --> 2.49325371 sigma out 1act.( 3.71849823 sig in 9act.) RANK 15 NODE 9 --> 1.62447345 sigma out 1act.( 3.32122278 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 87.8946838 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.542444944 *** contribution from regularisation: 0.002512031 *** contribution from error: -0.544956982 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53287.6207 0.452453166 18.8646774 EXIT FROM BFGS code FG_LNSRCH 0. 0.452453166 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.542436898 *** contribution from regularisation: 0.00252009509 *** contribution from error: -0.544956982 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53286.8285 0.452453166 18.9142036 EXIT FROM BFGS code FG_LNSRCH 0. 0.452453166 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.542455852 *** contribution from regularisation: 0.00250111008 *** contribution from error: -0.544956982 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53288.6935 0.452453166 18.9000874 EXIT FROM BFGS code NEW_X -53288.6935 0.452453166 18.9000874 ENTER BFGS code NEW_X -53288.6935 0.452453166 18.9000874 EXIT FROM BFGS code CONVERGENC -53288.6935 0.452453166 18.9000874 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 78.6379318 sigma out 15 active outputs RANK 2 NODE 1 --> 49.4208374 sigma out 15 active outputs RANK 3 NODE 4 --> 43.600174 sigma out 15 active outputs RANK 4 NODE 7 --> 42.9411507 sigma out 15 active outputs RANK 5 NODE 8 --> 40.2421227 sigma out 15 active outputs RANK 6 NODE 3 --> 32.0757828 sigma out 15 active outputs RANK 7 NODE 9 --> 29.1270313 sigma out 15 active outputs RANK 8 NODE 5 --> 20.9175396 sigma out 15 active outputs RANK 9 NODE 6 --> 17.7042809 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 93.2591858 sigma in 9act. ( 96.423027 sig out 1act.) RANK 2 NODE 5 --> 38.7639542 sigma in 9act. ( 34.7150955 sig out 1act.) RANK 3 NODE 1 --> 35.8600006 sigma in 9act. ( 28.1252289 sig out 1act.) RANK 4 NODE 6 --> 34.6531219 sigma in 9act. ( 35.2624283 sig out 1act.) RANK 5 NODE 10 --> 30.5701809 sigma in 9act. ( 28.366396 sig out 1act.) RANK 6 NODE 4 --> 27.6006699 sigma in 9act. ( 23.6214638 sig out 1act.) RANK 7 NODE 11 --> 25.4124985 sigma in 9act. ( 22.9465542 sig out 1act.) RANK 8 NODE 12 --> 24.5439339 sigma in 9act. ( 17.9990902 sig out 1act.) RANK 9 NODE 2 --> 18.0130119 sigma in 9act. ( 18.3612881 sig out 1act.) RANK 10 NODE 15 --> 17.9008369 sigma in 9act. ( 16.8773365 sig out 1act.) RANK 11 NODE 3 --> 14.4776506 sigma in 9act. ( 15.6076899 sig out 1act.) RANK 12 NODE 14 --> 8.3987627 sigma in 9act. ( 8.04579449 sig out 1act.) RANK 13 NODE 7 --> 5.47616911 sigma in 9act. ( 3.89182043 sig out 1act.) RANK 14 NODE 13 --> 4.34387016 sigma in 9act. ( 3.5542655 sig out 1act.) RANK 15 NODE 9 --> 3.71199131 sigma in 9act. ( 2.27610731 sig out 1act.) sorted by output significance RANK 1 NODE 8 --> 96.423027 sigma out 1act.( 93.2591858 sig in 9act.) RANK 2 NODE 6 --> 35.2624283 sigma out 1act.( 34.6531219 sig in 9act.) RANK 3 NODE 5 --> 34.7150955 sigma out 1act.( 38.7639542 sig in 9act.) RANK 4 NODE 10 --> 28.366396 sigma out 1act.( 30.5701809 sig in 9act.) RANK 5 NODE 1 --> 28.1252289 sigma out 1act.( 35.8600006 sig in 9act.) RANK 6 NODE 4 --> 23.6214638 sigma out 1act.( 27.6006699 sig in 9act.) RANK 7 NODE 11 --> 22.9465542 sigma out 1act.( 25.4124985 sig in 9act.) RANK 8 NODE 2 --> 18.3612881 sigma out 1act.( 18.0130119 sig in 9act.) RANK 9 NODE 12 --> 17.9990902 sigma out 1act.( 24.5439339 sig in 9act.) RANK 10 NODE 15 --> 16.8773365 sigma out 1act.( 17.9008369 sig in 9act.) RANK 11 NODE 3 --> 15.6076899 sigma out 1act.( 14.4776506 sig in 9act.) RANK 12 NODE 14 --> 8.04579449 sigma out 1act.( 8.3987627 sig in 9act.) RANK 13 NODE 7 --> 3.89182043 sigma out 1act.( 5.47616911 sig in 9act.) RANK 14 NODE 13 --> 3.5542655 sigma out 1act.( 4.34387016 sig in 9act.) RANK 15 NODE 9 --> 2.27610731 sigma out 1act.( 3.71199131 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 125.353172 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.542444587 *** contribution from regularisation: 0.00251237885 *** contribution from error: -0.544956982 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done