NNInput NNInputs_195.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 165339 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 25539 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 25539 Chosen entries: 25539 Signal fraction: 1 Background fraction: 0.182682 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 25539 Entries to split: 25539 Test with : 12769 Train with : 12769 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 25539 for Signal Prepared event 0 for Signal with 25539 events ====Entry 0 Variable Ht : 225.901 Variable LepAPt : 63.638 Variable LepBPt : 23.389 Variable MetSigLeptonsJets : 9.51092 Variable MetSpec : 104.705 Variable SumEtLeptonsJets : 121.196 Variable VSumJetLeptonsPt : 96.1224 Variable addEt : 191.732 Variable dPhiLepSumMet : 2.687 Variable dPhiLeptons : 0.342211 Variable dRLeptons : 0.346978 Variable lep1_E : 71.8454 Variable lep2_E : 25.7459 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2195 Ht = 225.901 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 63.6382 LepAPt = 63.638 LepBEt = 23.389 LepBPt = 23.389 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 104.705 MetDelPhi = 2.13998 MetSig = 7.54777 MetSigLeptonsJets = 9.51092 MetSpec = 104.705 Mjj = 0 MostCentralJetEta = 2.45448 MtllMet = 197.429 Njets = 1 SB = 0 SumEt = 192.44 SumEtJets = 0 SumEtLeptonsJets = 121.196 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 96.1224 addEt = 191.732 dPhiLepSumMet = 2.687 dPhiLeptons = 0.342211 dRLeptons = 0.346978 diltype = 47 dimass = 13.3241 event = 561 jet1_Et = 34.1693 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.8454 lep2_E = 25.7459 rand = 0.999742 run = 228576 weight = 1.92787e-06 ===Show End Prepared event 10000 for Signal with 25539 events Prepared event 20000 for Signal with 25539 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.148163 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4489 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 165339 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4489 negative weights. Signal fraction: 62.4451981 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1206551 65.3334579 67.2905121 68.6109924 69.6569519 70.506012 71.3599472 72.1761627 73.037384 73.7802887 74.3833771 75.0713501 75.7218323 76.5085754 77.0969238 77.8004456 78.549942 79.1452103 79.7500687 80.494812 81.2591858 81.9672394 82.6923752 83.5634155 84.4666824 85.4668884 86.6759338 87.6697235 88.7729263 89.9947968 91.6540146 93.2385864 94.977829 96.3220901 98.0019379 99.7055359 101.373787 102.954796 104.293388 105.95105 107.62384 109.231308 111.117043 112.785248 114.147705 116.10614 117.722168 119.503677 120.850159 122.638 124.196243 126.086357 127.956879 129.350464 130.960007 132.631027 134.290939 135.791992 137.355865 138.947174 140.764999 142.401993 143.957474 145.469559 147.205811 148.847549 150.587708 152.48877 154.388031 156.321594 158.406189 160.21759 162.061676 164.015228 166.010254 168.119583 170.28804 172.531876 175.061295 177.811829 180.484253 182.925568 185.749176 188.765198 191.628159 194.820984 198.36496 202.279922 206.472824 211.346313 216.800629 222.756058 229.25824 235.857574 244.846161 259.088409 274.002808 299.941589 346.729401 850.621887 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3627625 20.6866894 21.0330811 21.3268623 21.5853081 21.8291702 22.0285759 22.3000107 22.5510712 22.7714005 22.9883747 23.1650715 23.3262005 23.5661335 23.7368698 23.9625626 24.1925869 24.4394035 24.6238327 24.8767757 25.1351318 25.3528366 25.5489006 25.6941833 25.9116974 26.1649532 26.3736248 26.6028976 26.8717842 27.1264076 27.340641 27.6033707 27.8593483 28.0973434 28.3069267 28.5642776 28.8264618 29.0996246 29.346035 29.6659946 29.9344177 30.164196 30.4786892 30.7600174 31.0543137 31.4424934 31.7081184 31.9773293 32.3620148 32.7181892 33.032692 33.398262 33.7224197 34.1381531 34.4965897 34.9122467 35.3159218 35.7591476 36.1932564 36.6583519 37.0818901 37.5596046 38.0194664 38.453804 38.9701881 39.3307953 39.8809509 40.3899536 40.8137054 41.2640686 41.8577881 42.4217987 43.0403938 43.5872269 44.2220154 44.7749062 45.4116821 46.1793442 46.8737793 47.5708122 48.3359222 49.2219467 50.0977173 51.066494 52.0244293 52.9901237 54.0388451 55.1994972 56.5031281 57.7192078 58.9529915 60.3324547 62.217186 64.0478134 65.7935944 68.311821 71.7892685 75.6707916 82.3719559 169.089767 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.124279 10.2741442 10.3938808 10.4789534 10.5900126 10.7085571 10.8522072 10.9907284 11.1206827 11.2650967 11.4014654 11.5268993 11.7108765 11.8479004 11.9971848 12.1613712 12.3158112 12.4829826 12.6345901 12.8066654 12.9772549 13.1518087 13.3533983 13.5239925 13.7044334 13.8644266 14.035326 14.2000484 14.3784904 14.5969772 14.8096657 15.0061035 15.2042131 15.3813725 15.554019 15.7542572 15.9591751 16.1676559 16.3851357 16.5918274 16.779892 16.9681053 17.1751537 17.3884506 17.6366634 17.8321095 17.9917946 18.2584763 18.4499226 18.6520958 18.8689842 19.0727386 19.3002853 19.5307484 19.7346039 19.9821663 20.1743813 20.3041801 20.5197506 20.7335129 20.9404793 21.1327629 21.3332272 21.5385456 21.7417068 21.9500351 22.1227837 22.3547287 22.6009388 22.8373451 23.0726662 23.2830963 23.5295181 23.7666245 24.0241489 24.2883568 24.5550919 24.839222 25.1293221 25.431778 25.7295799 26.0372791 26.4019623 26.7206726 27.0856247 27.499218 27.8576431 28.2722092 28.7439194 29.2049751 29.7009773 30.252285 30.8901329 31.6337509 32.5130081 33.5244598 34.837677 36.8736 40.5020523 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.1656847 2.71174788 3.08431411 3.44438696 3.70418024 3.93569398 4.1040926 4.21725988 4.33285904 4.44409466 4.54737616 4.64982319 4.76083279 4.85499096 4.95106649 5.02196598 5.10852528 5.16534901 5.24418402 5.30260372 5.36589241 5.42040539 5.46995449 5.52012348 5.57070255 5.62203026 5.67087269 5.72461557 5.77898598 5.81954098 5.86590099 5.91408253 5.96395254 6.01415634 6.05976582 6.09971762 6.14707565 6.18968105 6.23478746 6.27974749 6.32315779 6.36480951 6.40966702 6.45170975 6.50562954 6.55156708 6.60264397 6.64019299 6.68051243 6.72956371 6.77005291 6.82165241 6.86963749 6.92163801 6.96871185 7.01913929 7.07558346 7.13583469 7.19079733 7.25964069 7.31467056 7.37363911 7.43544817 7.48664284 7.54170704 7.60021877 7.6584444 7.71721172 7.79080248 7.85146046 7.90870476 7.96563339 8.02655888 8.08746815 8.14962387 8.21123505 8.2700758 8.33731461 8.40336227 8.47149754 8.54352188 8.61390495 8.69364834 8.77289295 8.84543228 8.9262085 9.0160284 9.11148262 9.22411633 9.3326416 9.42744827 9.53790092 9.67860985 9.81719017 9.99098396 10.213131 10.4696732 10.7926235 11.2520447 12.212471 19.0882549 ------------------------------ Transdef: Tab for variable 6 15.024827 22.0835609 25.6089973 26.6051693 27.5524464 28.5761032 29.4006577 30.1470757 30.8277893 31.4597511 32.0516968 32.5761795 33.0285149 33.5227051 34.0321274 34.509819 34.8994942 35.3195801 35.7801971 36.2467651 36.5972176 37.0049515 37.3745728 37.7443848 38.1725807 38.5202789 38.9132614 39.2765694 39.6297951 39.9411316 40.2962799 40.5398369 41.0381393 41.522438 41.9943848 42.3975716 42.886116 43.1850128 43.744545 44.2180634 44.7372665 45.3132133 45.969696 46.5805397 47.2101364 47.8964615 48.5307846 49.1372681 49.9574165 50.4656601 51.2142029 52.0726624 52.8707008 53.5866051 54.5341492 55.3599129 56.0991821 56.8960762 57.616787 58.3891945 59.0174751 59.881897 60.7250824 61.5579071 62.42799 63.2949409 64.1513977 64.9453964 65.7906036 66.6407166 67.5252228 68.473175 69.3647003 70.2047272 71.0843201 71.9942322 72.9334488 73.9314499 74.9797668 75.9605408 76.7117691 77.5865936 78.7797928 79.9035797 81.1843185 82.4271088 83.740921 85.053421 86.4720306 88.1060486 89.8994598 91.6951599 93.6796951 96.0195236 98.5664902 101.373184 105.676201 111.159889 118.991463 131.777313 252.419907 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.9589767 33.9266434 34.6640549 35.3207932 35.7444 36.1538239 36.5095367 36.939827 37.3165512 37.6551437 38.0305748 38.3677292 38.677948 38.9983292 39.2771416 39.5430984 39.898468 40.2612 40.5982552 40.9248085 41.2968369 41.5927734 41.9676056 42.3892365 42.8227158 43.3772354 44.0376587 44.6522598 45.1501236 45.8203773 46.7602234 47.7455673 48.6145592 49.5868835 50.5743523 51.7466507 52.8628922 53.8940811 55.1209259 56.0848389 57.1157227 57.9899521 58.9333229 59.8782005 60.8939056 61.4855042 62.3170967 63.1313477 64.0540161 64.9920807 65.9257355 66.8514709 67.7600555 68.6655121 69.5875092 70.5282135 71.4261322 72.2773132 73.2357635 74.2090912 75.3274841 76.4624405 77.3694 78.5622101 79.72995 80.8370056 81.9681015 83.2440186 84.4583282 85.6903229 86.9033508 88.2868958 89.6646423 91.1328201 92.6522751 94.2817535 95.9846878 97.702774 99.7152557 101.50676 103.530548 105.534843 107.784645 110.176453 112.5867 115.464584 118.46357 121.84082 125.213203 129.3927 133.957642 138.946808 144.40976 150.581482 157.321487 167.140259 181.783844 201.805618 238.380096 533.67572 ------------------------------ Transdef: Tab for variable 8 3.10723281 25.6228828 29.6363716 31.2651405 32.1562119 32.9504547 33.4744606 33.9455109 34.4679031 34.9406662 35.223381 35.5516739 35.9530411 36.2514038 36.6019211 36.933075 37.2323418 37.5112076 37.7802734 38.0801392 38.3863831 38.6424637 38.8922729 39.152626 39.3772736 39.7216034 40.0372581 40.3369598 40.6607361 41.0174866 41.3574829 41.7408524 42.0945587 42.5337868 42.983139 43.3859024 43.7984123 44.3276978 44.8802185 45.4883728 46.1218109 46.7489319 47.4445801 48.0771332 48.7206879 49.3473015 49.988903 50.7483902 51.4151688 52.2254868 53.0186844 53.6977539 54.5424843 55.2687798 56.0081711 56.7342873 57.503212 58.2025299 58.9183884 59.741127 60.4830666 61.0986443 61.8214149 62.4966469 63.2271881 63.9786224 64.7572632 65.4857864 66.193367 66.8616333 67.5895767 68.4169617 69.228775 69.9766159 70.7142639 71.600975 72.3470612 73.2674255 74.1781464 75.0772858 76.0003662 77.0424194 77.9982758 79.0461044 80.0821762 81.4275665 82.7604599 84.1173706 85.5539093 87.0813141 88.6694489 90.6235657 93.0201721 95.4672394 97.9187927 101.491936 106.299423 111.67292 120.827942 138.113281 344.837463 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7685928 64.7364807 66.4559937 67.8437347 68.993576 69.852684 70.5485382 71.3595963 72.0102386 72.8514709 73.4633179 74.0330811 74.7236786 75.3735809 75.9698639 76.6296921 77.1119919 77.6946945 78.3042145 78.8671417 79.4092484 79.9942322 80.6340256 81.300827 81.8215027 82.4841309 83.2928543 83.9396973 84.6562347 85.4668884 86.5277023 87.0975189 87.9605408 88.868042 89.8279114 91.0368042 92.2842331 93.3893127 94.9400482 96.0901871 97.3614273 98.8460617 100.152397 101.541519 102.844238 104.35585 105.763428 107.159286 108.548645 110.03833 111.560249 112.889114 114.315254 115.769714 116.990776 118.379837 119.717735 120.907059 122.279373 123.688461 124.99556 126.398712 127.632164 128.888123 130.128235 131.448273 132.671143 134.061981 135.20578 136.491882 137.73761 138.972488 140.138733 141.443314 142.707397 144.066589 145.431641 146.807892 148.326782 149.774323 151.178116 152.673233 154.261154 155.932404 157.560883 159.158981 161.038147 163.042892 165.132629 167.174744 169.463242 171.992218 174.672821 177.983902 181.505341 185.998566 191.790558 199.197906 216.307922 422.705414 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.924676538 1.2844342 1.53282177 1.71889067 1.85535741 1.96839929 2.06458378 2.14644766 2.20883822 2.2626853 2.31267023 2.35353827 2.39158154 2.43256712 2.46423435 2.4978292 2.52814674 2.55772114 2.58265734 2.60804152 2.63147306 2.65538406 2.68144941 2.70245552 2.72102404 2.73849154 2.75576687 2.77078772 2.78531337 2.80112672 2.81424999 2.82693815 2.8392415 2.85015917 2.85976744 2.86934376 2.87827635 2.88827658 2.89784002 2.90545583 2.91386676 2.92184782 2.92889357 2.93569183 2.94364166 2.95003366 2.95649314 2.96301126 2.96868229 2.9749608 2.98081064 2.98608446 2.99023533 2.99381757 2.99935389 3.00453663 3.00911474 3.01383972 3.01795244 3.02212715 3.02609038 3.0293684 3.03359985 3.03690624 3.04113388 3.04554462 3.04968071 3.05325532 3.05733395 3.06050658 3.06403828 3.06710172 3.07059526 3.07354259 3.07617426 3.0796237 3.08295655 3.08611965 3.08878136 3.09189749 3.09469056 3.09712124 3.1000185 3.1025219 3.10524702 3.10810494 3.11094546 3.11337328 3.11576796 3.1181426 3.12029576 3.12252998 3.12504101 3.12730694 3.12943363 3.13158321 3.13384676 3.13622189 3.13875246 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.62124634E-05 0.00542670488 0.00951993465 0.0159542151 0.0236058235 0.0299191475 0.0374715328 0.0458334684 0.0525644198 0.0596432686 0.0665921718 0.0741053522 0.0820695907 0.0899592936 0.0974750519 0.105400741 0.111063242 0.118201971 0.124614 0.132439733 0.139870644 0.146701753 0.153890759 0.159563303 0.165822029 0.173526615 0.179651767 0.185153127 0.190032363 0.196460649 0.201856613 0.206743717 0.211380363 0.217140317 0.222823322 0.227875426 0.233407855 0.23926124 0.244346142 0.249611616 0.255065262 0.260167301 0.26515308 0.2698282 0.275081277 0.280415058 0.285156429 0.29109323 0.296199441 0.301041722 0.306918114 0.311765194 0.31750679 0.322886705 0.328713775 0.33415705 0.340013742 0.345460117 0.350518167 0.355688572 0.361046553 0.366685927 0.3722983 0.37812531 0.384696245 0.390129536 0.396097302 0.400915027 0.407145143 0.413377553 0.419749975 0.426539123 0.433166504 0.439381391 0.44624728 0.452643514 0.45982188 0.466275215 0.474129379 0.481401145 0.490445435 0.499517083 0.508048296 0.517421722 0.526409686 0.536738038 0.544336796 0.55342871 0.566257477 0.57970798 0.592537522 0.607968271 0.625963211 0.644654632 0.659721971 0.68134892 0.708092272 0.735530496 0.781512618 0.845724344 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.212773308 0.223588943 0.233057767 0.242182761 0.250819683 0.258944988 0.265911818 0.272236168 0.278483301 0.285393715 0.291188627 0.297945082 0.30363217 0.31003648 0.315687418 0.320977241 0.326298714 0.331387043 0.337250292 0.343285441 0.348159134 0.352773875 0.357149631 0.362369329 0.367985249 0.373496294 0.378041208 0.384406507 0.389330059 0.394255131 0.398599237 0.403302968 0.407648265 0.411075234 0.414404988 0.418117583 0.42180258 0.425411254 0.428696036 0.432374895 0.436190546 0.43938452 0.443163276 0.446470171 0.450404733 0.454732418 0.458407283 0.46251905 0.46603179 0.470368683 0.47374171 0.476881683 0.480928719 0.484838545 0.489238471 0.493274331 0.497326374 0.501284361 0.5061602 0.51069212 0.515673757 0.520382166 0.524334908 0.530038655 0.534957409 0.53992486 0.544957876 0.54868573 0.553714156 0.558833122 0.564154506 0.570026875 0.576479435 0.581908345 0.588424683 0.596067071 0.602277875 0.610822201 0.618254483 0.625850677 0.633368969 0.640448213 0.649629116 0.659024239 0.667145371 0.675910234 0.685262859 0.697316885 0.706630945 0.720501006 0.734746456 0.746979475 0.759122729 0.775003731 0.795050919 0.812543869 0.834278107 0.864432096 0.915789902 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0123215 21.7606163 22.4968834 23.2401466 23.7663765 24.374115 24.9116783 25.4024734 25.8730583 26.3644886 26.8767586 27.3283825 27.7019157 28.1235313 28.5728493 28.9221535 29.3487778 29.6873055 30.0791988 30.4278336 30.8174381 31.0865517 31.5426769 31.8924656 32.2915459 32.6368713 33.051899 33.4295578 33.7921829 34.1772118 34.5147133 34.9108505 35.2822838 35.7071838 36.1142044 36.3833694 36.8675461 37.3219452 37.7732582 38.2117882 38.6785202 39.1352348 39.6306458 40.1352615 40.5587502 41.0194588 41.4320145 41.929985 42.4304886 42.8820953 43.3966484 43.8464584 44.3627014 44.8579712 45.3407669 45.8781281 46.4137802 46.9579544 47.5133629 48.0427475 48.525238 49.096489 49.680809 50.3239517 50.9315338 51.6695213 52.3367081 53.0054321 53.7572517 54.5781021 55.270298 56.0007019 56.7727585 57.5502701 58.2989273 59.0619812 59.9278259 60.701828 61.5687943 62.3703079 63.2748642 64.3461227 65.3509674 66.4044952 67.3200073 68.1687775 69.3795166 70.5168991 72.0541077 73.5593033 74.905014 76.7200775 78.5185623 80.8500519 83.0996857 86.7917023 89.3036194 93.2074738 99.1016541 109.554871 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.6244402 11.0887814 11.4971428 11.8662729 12.2728376 12.595583 12.9594164 13.3089476 13.6207418 13.8924513 14.22295 14.5519867 14.8341579 15.1803036 15.4834003 15.7919083 16.0543213 16.3761292 16.671505 16.9255333 17.1869793 17.4198704 17.7188396 17.9277077 18.2051048 18.474926 18.7090263 18.9850483 19.1696033 19.4397011 19.7289906 19.9834099 20.236948 20.5109253 20.7433434 20.9695549 21.2091389 21.4459534 21.6587048 21.8921986 22.1367989 22.3682098 22.6271057 22.9021759 23.1369019 23.3915215 23.6359024 23.8790665 24.1438293 24.3803406 24.5991306 24.8771687 25.0901489 25.3287926 25.540966 25.8055649 26.0480404 26.3004303 26.5426712 26.7956085 27.0810394 27.3773575 27.6447315 27.8846855 28.0542755 28.3122768 28.5827065 28.8827515 29.1911926 29.4895344 29.7870445 30.0916729 30.4383812 30.8443909 31.188488 31.4960442 31.8941784 32.2820816 32.6914368 33.0844727 33.4475403 33.8439331 34.2986679 34.8286819 35.3876724 35.8694115 36.6313133 37.2809258 37.9644241 38.7908783 39.7874985 40.7121277 41.8715973 43.2448196 44.9947891 47.2729454 50.0367737 53.6000443 60.2444763 112.712608 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.4 52.3 51.1 31.5 51.1 63.0 55.3 63.7 -24.7 -18.6 -40.6 18.5 16.9 2 65.4 100.0 69.2 54.9 42.7 72.0 94.7 78.1 92.6 -43.5 -24.5 -51.2 38.3 23.9 3 52.3 69.2 100.0 40.8 22.2 44.7 70.4 60.6 76.9 -12.6 -27.6 -58.6 68.2 15.0 4 51.1 54.9 40.8 100.0 13.1 32.9 57.3 45.6 57.5 -12.8 -28.8 -59.4 18.4 67.3 5 31.5 42.7 22.2 13.1 100.0 85.2 16.5 62.6 62.5 20.3 -7.0 -15.3 7.4 -1.7 6 51.1 72.0 44.7 32.9 85.2 100.0 52.2 81.0 82.1 -6.5 -16.2 -33.3 20.6 9.0 7 63.0 94.7 70.4 57.3 16.5 52.2 100.0 70.0 81.8 -52.5 -24.3 -51.7 40.4 27.7 8 55.3 78.1 60.6 45.6 62.6 81.0 70.0 100.0 85.6 -12.3 -24.2 -46.2 33.6 19.0 9 63.7 92.6 76.9 57.5 62.5 82.1 81.8 85.6 100.0 -20.0 -26.7 -56.7 45.2 25.8 10 -24.7 -43.5 -12.6 -12.8 20.3 -6.5 -52.5 -12.3 -20.0 100.0 2.8 8.2 -3.7 -4.2 11 -18.6 -24.5 -27.6 -28.8 -7.0 -16.2 -24.3 -24.2 -26.7 2.8 100.0 53.6 -14.4 -16.7 12 -40.6 -51.2 -58.6 -59.4 -15.3 -33.3 -51.7 -46.2 -56.7 8.2 53.6 100.0 -33.7 -31.2 13 18.5 38.3 68.2 18.4 7.4 20.6 40.4 33.6 45.2 -3.7 -14.4 -33.7 100.0 41.4 14 16.9 23.9 15.0 67.3 -1.7 9.0 27.7 19.0 25.8 -4.2 -16.7 -31.2 41.4 100.0 TOTAL CORRELATION TO TARGET (diagonal) 165.968192 TOTAL CORRELATION OF ALL VARIABLES 72.1547564 ROUND 1: MAX CORR ( 72.1523515) AFTER KILLING INPUT VARIABLE 8 CONTR 0.589106043 ROUND 2: MAX CORR ( 72.1480876) AFTER KILLING INPUT VARIABLE 11 CONTR 0.784397502 ROUND 3: MAX CORR ( 72.0703218) AFTER KILLING INPUT VARIABLE 12 CONTR 3.34891985 ROUND 4: MAX CORR ( 71.9883546) AFTER KILLING INPUT VARIABLE 10 CONTR 3.43629071 ROUND 5: MAX CORR ( 71.8785096) AFTER KILLING INPUT VARIABLE 14 CONTR 3.97530464 ROUND 6: MAX CORR ( 71.7224014) AFTER KILLING INPUT VARIABLE 6 CONTR 4.73468929 ROUND 7: MAX CORR ( 71.4927211) AFTER KILLING INPUT VARIABLE 7 CONTR 5.73530201 ROUND 8: MAX CORR ( 70.4972916) AFTER KILLING INPUT VARIABLE 9 CONTR 11.8886944 ROUND 9: MAX CORR ( 70.1868223) AFTER KILLING INPUT VARIABLE 5 CONTR 6.60894073 ROUND 10: MAX CORR ( 68.4444803) AFTER KILLING INPUT VARIABLE 13 CONTR 15.5416581 ROUND 11: MAX CORR ( 67.8501716) AFTER KILLING INPUT VARIABLE 3 CONTR 9.00006072 ROUND 12: MAX CORR ( 65.3821433) AFTER KILLING INPUT VARIABLE 4 CONTR 18.1334258 LAST REMAINING VARIABLE: 2 total correlation to target: 72.1547564 % total significance: 103.320921 sigma correlations of single variables to target: variable 2: 65.3821433 % , in sigma: 93.6229791 variable 3: 52.3459266 % , in sigma: 74.9559642 variable 4: 51.0646175 % , in sigma: 73.1212128 variable 5: 31.478691 % , in sigma: 45.0754392 variable 6: 51.1206121 % , in sigma: 73.2013934 variable 7: 63.0322521 % , in sigma: 90.2580876 variable 8: 55.2644204 % , in sigma: 79.1350576 variable 9: 63.68509 % , in sigma: 91.1929091 variable 10: -24.6854969 % , in sigma: 35.3480269 variable 11: -18.6194149 % , in sigma: 26.6617918 variable 12: -40.6302355 % , in sigma: 58.1798561 variable 13: 18.5192768 % , in sigma: 26.5184005 variable 14: 16.9071631 % , in sigma: 24.2099585 variables sorted by significance: 1 most relevant variable 2 corr 65.3821411 , in sigma: 93.6229759 2 most relevant variable 4 corr 18.1334267 , in sigma: 25.9658882 3 most relevant variable 3 corr 9.00006104 , in sigma: 12.8875024 4 most relevant variable 13 corr 15.5416584 , in sigma: 22.2546446 5 most relevant variable 5 corr 6.6089406 , in sigma: 9.46357333 6 most relevant variable 9 corr 11.8886948 , in sigma: 17.0238381 7 most relevant variable 7 corr 5.73530197 , in sigma: 8.2125796 8 most relevant variable 6 corr 4.73468924 , in sigma: 6.77976721 9 most relevant variable 14 corr 3.9753046 , in sigma: 5.69237778 10 most relevant variable 10 corr 3.43629074 , in sigma: 4.92054497 11 most relevant variable 12 corr 3.34891987 , in sigma: 4.79543556 12 most relevant variable 11 corr 0.784397483 , in sigma: 1.12320621 13 most relevant variable 8 corr 0.589106023 , in sigma: 0.843561531 global correlations between input variables: variable 2: 99.2569881 % variable 3: 94.1664947 % variable 4: 90.5776349 % variable 5: 95.6488066 % variable 6: 94.7138409 % variable 7: 98.852791 % variable 8: 91.1879043 % variable 9: 98.9708889 % variable 10: 71.9678004 % variable 11: 54.7058805 % variable 12: 77.5592121 % variable 13: 86.7944373 % variable 14: 86.6586813 % significance loss when removing single variables: variable 2: corr = 3.86287361 % , sigma = 5.53138391 variable 3: corr = 15.6216664 % , sigma = 22.3692109 variable 4: corr = 16.6208525 % , sigma = 23.7999803 variable 5: corr = 9.65416787 % , sigma = 13.8241408 variable 6: corr = 4.60609837 % , sigma = 6.59563346 variable 7: corr = 4.82448442 % , sigma = 6.90834808 variable 8: corr = 0.589106043 % , sigma = 0.843561559 variable 9: corr = 10.2425459 % , sigma = 14.66666 variable 10: corr = 3.25476754 % , sigma = 4.66061554 variable 11: corr = 0.736876272 % , sigma = 1.05515892 variable 12: corr = 2.62899305 % , sigma = 3.76454715 variable 13: corr = 6.57729356 % , sigma = 9.41825682 variable 14: corr = 4.07248351 % , sigma = 5.83153166 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 15.4033384 sigma out 15 active outputs RANK 2 NODE 11 --> 13.8811817 sigma out 15 active outputs RANK 3 NODE 8 --> 13.2805834 sigma out 15 active outputs RANK 4 NODE 3 --> 13.0906925 sigma out 15 active outputs RANK 5 NODE 6 --> 12.8237247 sigma out 15 active outputs RANK 6 NODE 5 --> 11.7685881 sigma out 15 active outputs RANK 7 NODE 12 --> 10.7393932 sigma out 15 active outputs RANK 8 NODE 2 --> 9.73398685 sigma out 15 active outputs RANK 9 NODE 4 --> 9.49845505 sigma out 15 active outputs RANK 10 NODE 7 --> 9.03114128 sigma out 15 active outputs RANK 11 NODE 9 --> 6.38139582 sigma out 15 active outputs RANK 12 NODE 10 --> 5.90348864 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 21.767231 sigma in 12act. ( 22.0566006 sig out 1act.) RANK 2 NODE 9 --> 15.9450045 sigma in 12act. ( 17.1060085 sig out 1act.) RANK 3 NODE 4 --> 14.9889097 sigma in 12act. ( 15.6154451 sig out 1act.) RANK 4 NODE 10 --> 14.04776 sigma in 12act. ( 13.92904 sig out 1act.) RANK 5 NODE 13 --> 9.22653866 sigma in 12act. ( 9.37343884 sig out 1act.) RANK 6 NODE 14 --> 7.52558517 sigma in 12act. ( 6.00013399 sig out 1act.) RANK 7 NODE 11 --> 7.39884901 sigma in 12act. ( 9.65033913 sig out 1act.) RANK 8 NODE 7 --> 6.15524006 sigma in 12act. ( 6.39214563 sig out 1act.) RANK 9 NODE 15 --> 6.0932169 sigma in 12act. ( 6.54114437 sig out 1act.) RANK 10 NODE 5 --> 5.88335609 sigma in 12act. ( 5.52251482 sig out 1act.) RANK 11 NODE 8 --> 4.94524193 sigma in 12act. ( 4.15003633 sig out 1act.) RANK 12 NODE 6 --> 4.8150816 sigma in 12act. ( 4.68259335 sig out 1act.) RANK 13 NODE 1 --> 4.29933167 sigma in 12act. ( 3.84680557 sig out 1act.) RANK 14 NODE 2 --> 2.89145851 sigma in 12act. ( 2.61337447 sig out 1act.) RANK 15 NODE 3 --> 2.71956658 sigma in 12act. ( 2.16411972 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 22.0566006 sigma out 1act.( 21.767231 sig in 12act.) RANK 2 NODE 9 --> 17.1060085 sigma out 1act.( 15.9450045 sig in 12act.) RANK 3 NODE 4 --> 15.6154451 sigma out 1act.( 14.9889097 sig in 12act.) RANK 4 NODE 10 --> 13.92904 sigma out 1act.( 14.04776 sig in 12act.) RANK 5 NODE 11 --> 9.65033913 sigma out 1act.( 7.39884901 sig in 12act.) RANK 6 NODE 13 --> 9.37343884 sigma out 1act.( 9.22653866 sig in 12act.) RANK 7 NODE 15 --> 6.54114437 sigma out 1act.( 6.0932169 sig in 12act.) RANK 8 NODE 7 --> 6.39214563 sigma out 1act.( 6.15524006 sig in 12act.) RANK 9 NODE 14 --> 6.00013399 sigma out 1act.( 7.52558517 sig in 12act.) RANK 10 NODE 5 --> 5.52251482 sigma out 1act.( 5.88335609 sig in 12act.) RANK 11 NODE 6 --> 4.68259335 sigma out 1act.( 4.8150816 sig in 12act.) RANK 12 NODE 8 --> 4.15003633 sigma out 1act.( 4.94524193 sig in 12act.) RANK 13 NODE 1 --> 3.84680557 sigma out 1act.( 4.29933167 sig in 12act.) RANK 14 NODE 2 --> 2.61337447 sigma out 1act.( 2.89145851 sig in 12act.) RANK 15 NODE 3 --> 2.16411972 sigma out 1act.( 2.71956658 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 40.16922 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 17.6921768 sigma out 15 active outputs RANK 2 NODE 8 --> 16.8379688 sigma out 15 active outputs RANK 3 NODE 1 --> 16.3281078 sigma out 15 active outputs RANK 4 NODE 11 --> 15.4887486 sigma out 15 active outputs RANK 5 NODE 3 --> 14.0858908 sigma out 15 active outputs RANK 6 NODE 6 --> 13.6982203 sigma out 15 active outputs RANK 7 NODE 5 --> 13.3651409 sigma out 15 active outputs RANK 8 NODE 12 --> 12.0763149 sigma out 15 active outputs RANK 9 NODE 4 --> 10.7267332 sigma out 15 active outputs RANK 10 NODE 7 --> 10.0253563 sigma out 15 active outputs RANK 11 NODE 9 --> 8.62090397 sigma out 15 active outputs RANK 12 NODE 10 --> 6.32203627 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 22.5853996 sigma in 12act. ( 21.2001762 sig out 1act.) RANK 2 NODE 9 --> 16.651247 sigma in 12act. ( 16.1310635 sig out 1act.) RANK 3 NODE 4 --> 15.9734612 sigma in 12act. ( 14.14849 sig out 1act.) RANK 4 NODE 10 --> 13.924161 sigma in 12act. ( 12.7832241 sig out 1act.) RANK 5 NODE 11 --> 13.7332554 sigma in 12act. ( 10.9555597 sig out 1act.) RANK 6 NODE 13 --> 11.6981888 sigma in 12act. ( 9.06947422 sig out 1act.) RANK 7 NODE 15 --> 10.13445 sigma in 12act. ( 7.08802271 sig out 1act.) RANK 8 NODE 5 --> 10.0473404 sigma in 12act. ( 5.39461946 sig out 1act.) RANK 9 NODE 7 --> 9.04435444 sigma in 12act. ( 7.8836832 sig out 1act.) RANK 10 NODE 8 --> 7.97276354 sigma in 12act. ( 3.61002898 sig out 1act.) RANK 11 NODE 2 --> 7.30435276 sigma in 12act. ( 3.73132801 sig out 1act.) RANK 12 NODE 14 --> 7.18840599 sigma in 12act. ( 4.39288616 sig out 1act.) RANK 13 NODE 1 --> 7.06166315 sigma in 12act. ( 4.19378376 sig out 1act.) RANK 14 NODE 6 --> 6.31761169 sigma in 12act. ( 4.20663261 sig out 1act.) RANK 15 NODE 3 --> 6.14328194 sigma in 12act. ( 2.48923731 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 21.2001762 sigma out 1act.( 22.5853996 sig in 12act.) RANK 2 NODE 9 --> 16.1310635 sigma out 1act.( 16.651247 sig in 12act.) RANK 3 NODE 4 --> 14.14849 sigma out 1act.( 15.9734612 sig in 12act.) RANK 4 NODE 10 --> 12.7832241 sigma out 1act.( 13.924161 sig in 12act.) RANK 5 NODE 11 --> 10.9555597 sigma out 1act.( 13.7332554 sig in 12act.) RANK 6 NODE 13 --> 9.06947422 sigma out 1act.( 11.6981888 sig in 12act.) RANK 7 NODE 7 --> 7.8836832 sigma out 1act.( 9.04435444 sig in 12act.) RANK 8 NODE 15 --> 7.08802271 sigma out 1act.( 10.13445 sig in 12act.) RANK 9 NODE 5 --> 5.39461946 sigma out 1act.( 10.0473404 sig in 12act.) RANK 10 NODE 14 --> 4.39288616 sigma out 1act.( 7.18840599 sig in 12act.) RANK 11 NODE 6 --> 4.20663261 sigma out 1act.( 6.31761169 sig in 12act.) RANK 12 NODE 1 --> 4.19378376 sigma out 1act.( 7.06166315 sig in 12act.) RANK 13 NODE 2 --> 3.73132801 sigma out 1act.( 7.30435276 sig in 12act.) RANK 14 NODE 8 --> 3.61002898 sigma out 1act.( 7.97276354 sig in 12act.) RANK 15 NODE 3 --> 2.48923731 sigma out 1act.( 6.14328194 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.7911835 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.529045165 *** contribution from regularisation: 0.004863346 *** contribution from error: -0.533908486 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.569733262 *** contribution from regularisation: 0.00253555761 *** contribution from error: -0.572268844 *********************************************** -----------------> Test sample ENTER BFGS code START -47107.5439 0.380189866 0.23826021 EXIT FROM BFGS code FG_START 0. 0.380189866 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.594126642 *** contribution from regularisation: 0.00220303307 *** contribution from error: -0.596329689 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49115.8545 0.380189866 18.5121021 EXIT FROM BFGS code FG_LNSRCH 0. 0.395482779 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.606976271 *** contribution from regularisation: 0.00305055198 *** contribution from error: -0.610026836 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50178.121 0.395482779 22.5858021 EXIT FROM BFGS code NEW_X -50178.121 0.395482779 22.5858021 ENTER BFGS code NEW_X -50178.121 0.395482779 22.5858021 EXIT FROM BFGS code FG_LNSRCH 0. 0.411145329 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.608219087 *** contribution from regularisation: 0.0030664322 *** contribution from error: -0.611285508 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50280.8657 0.411145329 3.12225747 EXIT FROM BFGS code NEW_X -50280.8657 0.411145329 3.12225747 ENTER BFGS code NEW_X -50280.8657 0.411145329 3.12225747 EXIT FROM BFGS code FG_LNSRCH 0. 0.419344157 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.608897388 *** contribution from regularisation: 0.00294780405 *** contribution from error: -0.611845195 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50336.9382 0.419344157 -3.93913436 EXIT FROM BFGS code NEW_X -50336.9382 0.419344157 -3.93913436 ENTER BFGS code NEW_X -50336.9382 0.419344157 -3.93913436 EXIT FROM BFGS code FG_LNSRCH 0. 0.42800498 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.6092875 *** contribution from regularisation: 0.00293980376 *** contribution from error: -0.612227321 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50369.188 0.42800498 -13.5340023 EXIT FROM BFGS code NEW_X -50369.188 0.42800498 -13.5340023 ENTER BFGS code NEW_X -50369.188 0.42800498 -13.5340023 EXIT FROM BFGS code FG_LNSRCH 0. 0.424378484 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.610076249 *** contribution from regularisation: 0.00275317719 *** contribution from error: -0.612829447 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50434.3924 0.424378484 -11.2685442 EXIT FROM BFGS code NEW_X -50434.3924 0.424378484 -11.2685442 ENTER BFGS code NEW_X -50434.3924 0.424378484 -11.2685442 EXIT FROM BFGS code FG_LNSRCH 0. 0.419005781 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.611159444 *** contribution from regularisation: 0.00267351349 *** contribution from error: -0.613832951 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50523.9414 0.419005781 -57.5200005 EXIT FROM BFGS code NEW_X -50523.9414 0.419005781 -57.5200005 ENTER BFGS code NEW_X -50523.9414 0.419005781 -57.5200005 EXIT FROM BFGS code FG_LNSRCH 0. 0.266077846 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.9671345 sigma out 15 active outputs RANK 2 NODE 9 --> 15.9329338 sigma out 15 active outputs RANK 3 NODE 8 --> 15.7732668 sigma out 15 active outputs RANK 4 NODE 11 --> 12.8703461 sigma out 15 active outputs RANK 5 NODE 1 --> 9.80998325 sigma out 15 active outputs RANK 6 NODE 12 --> 7.90135908 sigma out 15 active outputs RANK 7 NODE 5 --> 7.57080078 sigma out 15 active outputs RANK 8 NODE 3 --> 6.16282225 sigma out 15 active outputs RANK 9 NODE 7 --> 6.11684942 sigma out 15 active outputs RANK 10 NODE 6 --> 5.2371397 sigma out 15 active outputs RANK 11 NODE 10 --> 4.73418236 sigma out 15 active outputs RANK 12 NODE 4 --> 4.68398523 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 20.6869011 sigma in 12act. ( 15.3917379 sig out 1act.) RANK 2 NODE 11 --> 16.1131115 sigma in 12act. ( 16.9384995 sig out 1act.) RANK 3 NODE 7 --> 15.3185616 sigma in 12act. ( 10.6513643 sig out 1act.) RANK 4 NODE 13 --> 12.2961645 sigma in 12act. ( 12.1073074 sig out 1act.) RANK 5 NODE 15 --> 11.2795591 sigma in 12act. ( 11.1821985 sig out 1act.) RANK 6 NODE 12 --> 9.79590702 sigma in 12act. ( 6.66676712 sig out 1act.) RANK 7 NODE 3 --> 8.34337044 sigma in 12act. ( 5.5933814 sig out 1act.) RANK 8 NODE 10 --> 7.25201035 sigma in 12act. ( 5.0195775 sig out 1act.) RANK 9 NODE 9 --> 7.09594679 sigma in 12act. ( 3.83136773 sig out 1act.) RANK 10 NODE 4 --> 6.91442919 sigma in 12act. ( 4.50867176 sig out 1act.) RANK 11 NODE 1 --> 5.48059893 sigma in 12act. ( 4.2214613 sig out 1act.) RANK 12 NODE 8 --> 4.6269207 sigma in 12act. ( 3.61249828 sig out 1act.) RANK 13 NODE 6 --> 4.46447325 sigma in 12act. ( 3.62542129 sig out 1act.) RANK 14 NODE 5 --> 4.06848335 sigma in 12act. ( 2.80376434 sig out 1act.) RANK 15 NODE 14 --> 0.983238637 sigma in 12act. ( 0.293395996 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 16.9384995 sigma out 1act.( 16.1131115 sig in 12act.) RANK 2 NODE 2 --> 15.3917379 sigma out 1act.( 20.6869011 sig in 12act.) RANK 3 NODE 13 --> 12.1073074 sigma out 1act.( 12.2961645 sig in 12act.) RANK 4 NODE 15 --> 11.1821985 sigma out 1act.( 11.2795591 sig in 12act.) RANK 5 NODE 7 --> 10.6513643 sigma out 1act.( 15.3185616 sig in 12act.) RANK 6 NODE 12 --> 6.66676712 sigma out 1act.( 9.79590702 sig in 12act.) RANK 7 NODE 3 --> 5.5933814 sigma out 1act.( 8.34337044 sig in 12act.) RANK 8 NODE 10 --> 5.0195775 sigma out 1act.( 7.25201035 sig in 12act.) RANK 9 NODE 4 --> 4.50867176 sigma out 1act.( 6.91442919 sig in 12act.) RANK 10 NODE 1 --> 4.2214613 sigma out 1act.( 5.48059893 sig in 12act.) RANK 11 NODE 9 --> 3.83136773 sigma out 1act.( 7.09594679 sig in 12act.) RANK 12 NODE 6 --> 3.62542129 sigma out 1act.( 4.46447325 sig in 12act.) RANK 13 NODE 8 --> 3.61249828 sigma out 1act.( 4.6269207 sig in 12act.) RANK 14 NODE 5 --> 2.80376434 sigma out 1act.( 4.06848335 sig in 12act.) RANK 15 NODE 14 --> 0.293395996 sigma out 1act.( 0.983238637 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 33.1179047 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.608085752 *** contribution from regularisation: 0.00277478853 *** contribution from error: -0.610860527 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50269.8397 0.266077846 153.901138 EXIT FROM BFGS code FG_LNSRCH 0. 0.40327844 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.610645294 *** contribution from regularisation: 0.00337836775 *** contribution from error: -0.614023685 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50481.4357 0.40327844 -34.8310165 EXIT FROM BFGS code FG_LNSRCH 0. 0.418324441 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.611019969 *** contribution from regularisation: 0.00282305712 *** contribution from error: -0.613843024 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50512.4108 0.418324441 -56.335537 EXIT FROM BFGS code FG_LNSRCH 0. 0.419000238 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.610900342 *** contribution from regularisation: 0.00293266913 *** contribution from error: -0.61383301 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50502.5221 0.419000238 -56.2300491 EXIT FROM BFGS code FG_LNSRCH 0. 0.419005781 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.610911012 *** contribution from regularisation: 0.00292198267 *** contribution from error: -0.61383301 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50503.4007 0.419005781 -56.697628 EXIT FROM BFGS code FG_LNSRCH 0. 0.419005781 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.61088562 *** contribution from regularisation: 0.0029473633 *** contribution from error: -0.61383301 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50501.3025 0.419005781 -56.5455627 EXIT FROM BFGS code FG_LNSRCH 0. 0.419005781 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.610893607 *** contribution from regularisation: 0.00293936254 *** contribution from error: -0.613832951 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50501.9639 0.419005781 -56.4879684 EXIT FROM BFGS code FG_LNSRCH 0. 0.419005781 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.610911608 *** contribution from regularisation: 0.00292134914 *** contribution from error: -0.613832951 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50503.453 0.419005781 -56.499485 EXIT FROM BFGS code NEW_X -50503.453 0.419005781 -56.499485 ENTER BFGS code NEW_X -50503.453 0.419005781 -56.499485 EXIT FROM BFGS code CONVERGENC -50503.453 0.419005781 -56.499485 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 42.5045586 sigma out 15 active outputs RANK 2 NODE 8 --> 27.6010857 sigma out 15 active outputs RANK 3 NODE 9 --> 26.5572853 sigma out 15 active outputs RANK 4 NODE 1 --> 24.6991501 sigma out 15 active outputs RANK 5 NODE 11 --> 20.3491917 sigma out 15 active outputs RANK 6 NODE 12 --> 14.7636509 sigma out 15 active outputs RANK 7 NODE 3 --> 13.4006796 sigma out 15 active outputs RANK 8 NODE 10 --> 12.9183531 sigma out 15 active outputs RANK 9 NODE 5 --> 11.9362497 sigma out 15 active outputs RANK 10 NODE 6 --> 9.85734272 sigma out 15 active outputs RANK 11 NODE 7 --> 9.43712711 sigma out 15 active outputs RANK 12 NODE 4 --> 7.79656458 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 38.3407097 sigma in 12act. ( 29.4552536 sig out 1act.) RANK 2 NODE 11 --> 29.1900539 sigma in 12act. ( 30.5277443 sig out 1act.) RANK 3 NODE 7 --> 28.8619938 sigma in 12act. ( 21.7678947 sig out 1act.) RANK 4 NODE 13 --> 21.3729038 sigma in 12act. ( 22.0009155 sig out 1act.) RANK 5 NODE 15 --> 21.0064888 sigma in 12act. ( 20.3965912 sig out 1act.) RANK 6 NODE 12 --> 17.6295662 sigma in 12act. ( 13.6162682 sig out 1act.) RANK 7 NODE 3 --> 14.7590675 sigma in 12act. ( 11.604105 sig out 1act.) RANK 8 NODE 10 --> 12.4806004 sigma in 12act. ( 10.3746195 sig out 1act.) RANK 9 NODE 4 --> 12.0731182 sigma in 12act. ( 10.1676998 sig out 1act.) RANK 10 NODE 9 --> 11.975421 sigma in 12act. ( 9.03666496 sig out 1act.) RANK 11 NODE 1 --> 8.56817436 sigma in 12act. ( 7.52606106 sig out 1act.) RANK 12 NODE 8 --> 7.33609247 sigma in 12act. ( 6.88560104 sig out 1act.) RANK 13 NODE 6 --> 7.1977272 sigma in 12act. ( 7.0550456 sig out 1act.) RANK 14 NODE 5 --> 6.55047321 sigma in 12act. ( 5.42587376 sig out 1act.) RANK 15 NODE 14 --> 1.76798749 sigma in 12act. ( 0.70616436 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 30.5277443 sigma out 1act.( 29.1900539 sig in 12act.) RANK 2 NODE 2 --> 29.4552536 sigma out 1act.( 38.3407097 sig in 12act.) RANK 3 NODE 13 --> 22.0009155 sigma out 1act.( 21.3729038 sig in 12act.) RANK 4 NODE 7 --> 21.7678947 sigma out 1act.( 28.8619938 sig in 12act.) RANK 5 NODE 15 --> 20.3965912 sigma out 1act.( 21.0064888 sig in 12act.) RANK 6 NODE 12 --> 13.6162682 sigma out 1act.( 17.6295662 sig in 12act.) RANK 7 NODE 3 --> 11.604105 sigma out 1act.( 14.7590675 sig in 12act.) RANK 8 NODE 10 --> 10.3746195 sigma out 1act.( 12.4806004 sig in 12act.) RANK 9 NODE 4 --> 10.1676998 sigma out 1act.( 12.0731182 sig in 12act.) RANK 10 NODE 9 --> 9.03666496 sigma out 1act.( 11.975421 sig in 12act.) RANK 11 NODE 1 --> 7.52606106 sigma out 1act.( 8.56817436 sig in 12act.) RANK 12 NODE 6 --> 7.0550456 sigma out 1act.( 7.1977272 sig in 12act.) RANK 13 NODE 8 --> 6.88560104 sigma out 1act.( 7.33609247 sig in 12act.) RANK 14 NODE 5 --> 5.42587376 sigma out 1act.( 6.55047321 sig in 12act.) RANK 15 NODE 14 --> 0.70616436 sigma out 1act.( 1.76798749 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.0075951 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.610880315 *** contribution from regularisation: 0.00295268255 *** contribution from error: -0.61383301 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done