NNInput NNInputs_165.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 195575 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 55775 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 55775 Chosen entries: 55775 Signal fraction: 1 Background fraction: 0.398963 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 55775 Entries to split: 55775 Test with : 27887 Train with : 27887 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 55775 for Signal Prepared event 0 for Signal with 55775 events ====Entry 0 Variable Ht : 267.874 Variable LepAPt : 45.292 Variable LepBPt : 35.604 Variable MetSigLeptonsJets : 7.24556 Variable MetSpec : 95.2083 Variable SumEtLeptonsJets : 172.666 Variable VSumJetLeptonsPt : 107.325 Variable addEt : 176.104 Variable dPhiLepSumMet : 2.28406 Variable dPhiLeptons : 0.0254087 Variable dRLeptons : 0.325152 Variable lep1_E : 46.0978 Variable lep2_E : 40.383 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2165 Ht = 267.874 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 45.2922 LepAPt = 45.292 LepBEt = 35.604 LepBPt = 35.604 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 95.2083 MetDelPhi = 2.19471 MetSig = 6.53886 MetSigLeptonsJets = 7.24556 MetSpec = 95.2083 Mjj = 0 MostCentralJetEta = -1.47546 MtllMet = 179.575 Njets = 1 SB = 0 SumEt = 212.005 SumEtJets = 0 SumEtLeptonsJets = 172.666 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 107.325 addEt = 176.104 dPhiLepSumMet = 2.28406 dPhiLeptons = 0.0254087 dRLeptons = 0.325152 diltype = 52 dimass = 13.1154 event = 77 jet1_Et = 91.7697 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.0978 lep2_E = 40.383 rand = 0.999742 run = 237144 weight = 4.01724e-06 ===Show End Prepared event 10000 for Signal with 55775 events Prepared event 20000 for Signal with 55775 events Prepared event 30000 for Signal with 55775 events Prepared event 40000 for Signal with 55775 events Prepared event 50000 for Signal with 55775 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.322645 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4387 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 195575 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4387 negative weights. Signal fraction: 62.5904083 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1892281 65.5503845 67.0571747 68.3926315 69.4302063 70.4019089 71.2818069 72.0129852 73.036087 73.8126755 74.4789505 75.2406158 75.7592392 76.5348358 77.2384338 77.887413 78.5505676 79.2711487 79.93573 80.7681274 81.5033722 82.2058563 83.0121765 83.9315414 84.9575653 86.0250473 87.1292496 88.5410843 89.7952423 91.5316467 92.9333038 94.359024 95.8455963 97.5743256 99.1518478 100.961166 102.518517 104.119644 105.573143 107.097488 108.683609 110.588333 112.392426 114.106644 115.970589 117.698196 119.676765 121.099854 122.930923 124.73745 126.60791 128.450165 130.13092 131.794174 133.53714 135.273163 136.783264 138.359955 139.83963 141.475861 142.94046 144.543274 145.926224 147.296906 148.73053 150.25209 151.741608 153.039703 154.518433 155.894257 157.357941 158.854797 160.477325 162.061218 163.639664 165.426147 167.413818 169.431732 171.391327 173.834625 176.218719 178.980637 181.666687 184.72522 187.783417 190.707108 194.349243 197.73703 201.701157 206.211365 210.583374 216.045929 222.245071 229.074371 237.662109 248.594528 263.644501 284.424774 332.509094 928.238586 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3513832 20.733078 21.0851936 21.4154587 21.6068802 21.8830147 22.1271725 22.3777504 22.620018 22.8647614 23.1149521 23.2957497 23.5246067 23.7193832 23.9108047 24.1622581 24.4356079 24.6459579 24.8907623 25.1482048 25.3452187 25.5666237 25.7204895 25.9555702 26.1947346 26.4295654 26.6971798 26.9387474 27.196743 27.4694881 27.7212753 27.9305744 28.142704 28.3488655 28.6201458 28.861496 29.141243 29.3936081 29.6661301 29.9601765 30.2557411 30.5660706 30.8195724 31.1053123 31.3968849 31.6725006 31.9216671 32.2036018 32.4957085 32.8095398 33.1135674 33.4111481 33.7593994 34.0649643 34.3749237 34.7162704 35.0307693 35.3305855 35.6541138 35.9766693 36.310051 36.6509476 36.9539337 37.2992287 37.6323624 37.9582596 38.3013916 38.6553345 38.9769897 39.240593 39.5885544 39.9413528 40.2768135 40.6348228 40.8838501 41.2693024 41.6608505 42.0278664 42.4087296 42.8463669 43.2962952 43.7275085 44.1795044 44.6512756 45.1917152 45.742897 46.3144608 46.9574814 47.6524277 48.4312592 49.2284927 50.1630783 51.247963 52.5571518 53.9993057 55.9689255 58.6354408 62.2659225 69.1251526 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1176167 10.2646332 10.3997545 10.5464735 10.682744 10.8091927 10.9383011 11.0721207 11.2324486 11.3848896 11.543417 11.6988487 11.8282089 11.9978294 12.1550808 12.3063831 12.4368801 12.6260548 12.79422 12.9472361 13.1716518 13.3941021 13.5669384 13.7137909 13.9099331 14.0862713 14.2797298 14.4792461 14.7151184 14.9517202 15.1803093 15.4028378 15.6241379 15.8278236 16.0615768 16.3271637 16.5824928 16.8256474 17.0904827 17.3770485 17.6948357 17.9605293 18.1614094 18.4903526 18.7719727 19.068737 19.367115 19.6998501 20.0532532 20.2983208 20.5498619 20.865221 21.1818027 21.4827728 21.8108406 22.0636635 22.3883018 22.7190895 23.0616684 23.3973808 23.7335167 24.0817528 24.4515762 24.7771854 25.127346 25.4887466 25.8707542 26.1962471 26.5847702 26.9750481 27.3393364 27.7095985 28.0979958 28.4393158 28.7911968 29.1709061 29.5394058 29.9373398 30.3100147 30.7066479 31.107151 31.4894447 31.8911285 32.3201447 32.7412338 33.1567993 33.5994339 34.0425453 34.5250549 35.0639267 35.6342659 36.2415237 36.9110336 37.671051 38.5884781 39.7210197 41.3399963 43.7154961 48.065361 74.918541 ------------------------------ Transdef: Tab for variable 5 1.22125256 2.77635574 3.18539095 3.54737997 3.80308199 4.02841663 4.19218588 4.32964039 4.44954538 4.57818031 4.6566267 4.76028919 4.84595346 4.93997669 5.01571703 5.09495735 5.15501451 5.22534275 5.29097748 5.35893059 5.41694164 5.46243572 5.52015781 5.55963516 5.61616373 5.66364622 5.72481108 5.7770505 5.82529593 5.87637901 5.92509747 5.97356987 6.01279688 6.05561733 6.10400963 6.15552807 6.19927406 6.2457962 6.28506374 6.32474709 6.38127613 6.42790127 6.47210121 6.52431774 6.5740118 6.62219238 6.67032957 6.7217145 6.76791573 6.81485367 6.85805845 6.89873695 6.95602417 6.99435139 7.04608536 7.09696865 7.14859962 7.20750809 7.264781 7.31786728 7.3796196 7.43318033 7.48365021 7.53457165 7.59482384 7.65635681 7.72164059 7.78774261 7.85085583 7.90917206 7.96658659 8.02703571 8.08606911 8.14389992 8.20709229 8.26317215 8.32317734 8.38883781 8.45240974 8.51655388 8.58284569 8.65137005 8.72282791 8.78982925 8.85802746 8.93766022 9.00767612 9.08283615 9.16875744 9.2658968 9.36380672 9.46949387 9.59677505 9.73725128 9.90839195 10.1046581 10.349596 10.6910057 11.2342339 12.1942062 19.6634274 ------------------------------ Transdef: Tab for variable 6 15.0262194 21.3178749 25.5667801 26.7713528 27.7171288 28.7301292 29.617384 30.473732 31.1567535 31.7301846 32.2792435 32.8214951 33.3232727 33.8387604 34.3466339 34.7006912 35.0873795 35.5624771 35.9845505 36.3034668 36.6768608 37.0929871 37.4817047 37.8854675 38.2700272 38.6771202 39.0949974 39.472023 39.8514557 40.2882004 40.630661 41.0729866 41.522438 41.9945831 42.5084763 42.9574738 43.3335876 43.8359299 44.3483124 44.8673515 45.596344 46.1653137 46.8275909 47.4931602 48.1830444 49.0230865 49.6626511 50.3404732 51.0677414 51.911972 52.6791458 53.4873276 54.3158264 55.1016922 55.9524689 56.7604027 57.5173645 58.2837219 58.9208145 59.7185974 60.5908051 61.4765244 62.327446 63.1367264 63.9897995 64.8039398 65.6028748 66.421402 67.2369995 68.0634003 68.8532104 69.6898193 70.5055084 71.2664719 72.0516663 72.8483887 73.5883789 74.3686829 75.101532 75.9679718 76.7131958 77.470047 78.3256302 79.2116699 80.1370316 81.1046066 82.0852203 83.0587769 84.1474686 85.3976593 86.9426117 88.6490631 90.5174713 92.6500854 95.042511 98.3101807 102.142159 107.396004 114.988693 127.565407 246.541672 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7847061 33.7422028 34.5131187 35.171463 35.6549072 36.1163559 36.4647751 36.8849487 37.2579613 37.606041 37.9773941 38.3188553 38.6365852 38.8870621 39.2543488 39.5293083 39.8578987 40.2706108 40.6385422 40.9744225 41.3952637 41.7184067 42.1334915 42.6381302 43.1731644 43.7760201 44.4972153 44.9903564 45.6810532 46.5250816 47.2917709 48.205925 49.0205612 49.9731941 51.1612587 52.2404556 53.1391335 54.1553726 55.1684265 56.1834488 57.15979 58.1742935 59.2130127 60.186985 61.0036545 61.6921844 62.6793251 63.666214 64.5452576 65.4682922 66.4699554 67.3257675 68.3330994 69.1744537 70.0767975 70.9087296 71.762146 72.7104111 73.5066376 74.2836685 75.1572876 76.0685806 77.0002213 77.8523254 78.6526642 79.6210022 80.6099854 81.714447 82.8251495 83.9350128 85.3049469 86.682373 88.1819153 89.7305298 91.3638 93.1168671 94.8582764 96.6544647 98.4824066 100.480286 102.222153 104.264603 106.360725 108.469048 110.878403 113.336044 115.791756 118.782181 122.345604 126.241791 130.320587 134.99292 140.220337 145.694153 152.814026 162.214279 174.552368 192.510727 229.24292 582.217407 ------------------------------ Transdef: Tab for variable 8 0.172416463 25.2664185 29.7791519 31.4717999 32.2699966 32.9905777 33.5281944 34.0421028 34.6055679 35.0532913 35.3977623 35.7722244 36.0881119 36.4104424 36.6875305 36.9818268 37.2857666 37.5993423 37.9593353 38.2495728 38.5580406 38.8502007 39.1190872 39.3983994 39.7115173 40.0565033 40.3622742 40.7190399 41.0571785 41.4006157 41.8178406 42.2278366 42.6950264 43.1812248 43.7006989 44.1394234 44.5963669 45.1963539 45.7272034 46.3523636 46.9162941 47.6241951 48.1943703 48.7493286 49.4368286 50.1779518 50.9369049 51.6496353 52.3843689 53.1145973 53.8323555 54.5677834 55.2944107 56.0008087 56.7797546 57.5430984 58.3072205 59.0595779 59.811554 60.557888 61.1233978 61.9493484 62.7587929 63.4353027 64.1881409 64.9129639 65.6535645 66.3640976 67.0522766 67.7792358 68.5212708 69.2447815 69.9429321 70.6895676 71.4078903 72.1455917 72.8280106 73.5541992 74.2217026 74.9442291 75.7355194 76.4997101 77.2473755 78.0025177 78.8621368 79.7565002 80.844986 81.8762589 83.0933075 84.4467468 85.9301376 87.7968903 89.8864288 92.4342728 95.0712128 98.6699982 103.109978 108.69912 117.219292 137.838837 347.479309 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.8018761 64.9963074 66.4671478 67.7846985 68.7878265 69.8527527 70.6548996 71.3913574 72.0863495 73.036087 73.7366791 74.3362885 75.0470886 75.5649719 76.1859283 76.8771439 77.4538422 78.0113068 78.588829 79.2234802 79.7740021 80.4487915 81.1156769 81.7628021 82.4285889 83.1139221 83.8203735 84.730957 85.5101547 86.3637543 87.1102219 88.1278534 89.0754089 90.3479004 91.6532974 92.8222961 93.8015518 95.1463089 96.462944 97.9588165 99.2476349 100.798775 102.125351 103.585159 104.987778 106.321037 107.937088 109.416946 110.817703 112.409531 113.87693 115.328201 116.694122 118.181915 119.558243 120.582169 121.935196 123.388992 124.757233 126.176636 127.530281 128.868195 130.206924 131.530396 132.851166 134.114624 135.391815 136.685699 137.954468 139.223755 140.505783 141.80928 142.957764 144.202942 145.320511 146.437531 147.595154 148.724243 149.861664 150.925247 152.078949 153.107712 154.237457 155.254181 156.351562 157.493729 158.702179 159.896286 161.18335 162.610031 163.981522 165.667206 167.453674 169.50589 171.847382 175.286606 179.977417 188.946503 210.210037 459.46109 ------------------------------ Transdef: Tab for variable 10 0.0777236596 1.07391882 1.42899156 1.6519444 1.8150388 1.9387269 2.04019713 2.12568426 2.19655991 2.25656414 2.3096621 2.35002041 2.39446688 2.43637061 2.47582006 2.50740647 2.53916311 2.56739283 2.5913434 2.61665535 2.63898683 2.66289139 2.68492508 2.70486712 2.72285271 2.74098873 2.75869799 2.77593088 2.79080582 2.80317354 2.81689382 2.82899475 2.84057379 2.85170555 2.86118007 2.87039804 2.8798666 2.8891592 2.89837217 2.90709066 2.91572905 2.92216563 2.92855072 2.93655467 2.9440515 2.94972205 2.9573288 2.96398282 2.97050285 2.97670937 2.98258257 2.98649311 2.99040389 2.99459505 2.9997735 3.00405002 3.00819635 3.01342249 3.01842451 3.02293444 3.02757454 3.03158712 3.03513241 3.0390563 3.04271793 3.04671431 3.05054235 3.05404019 3.05747867 3.06108522 3.06435871 3.06710196 3.07041311 3.07338905 3.07627416 3.07917523 3.08248925 3.08565068 3.08839893 3.09111023 3.09373021 3.09642696 3.09918308 3.10207987 3.10453606 3.10734892 3.10973692 3.11252594 3.11518025 3.11720228 3.11919689 3.12133265 3.12403345 3.12650132 3.12883711 3.1309073 3.13251662 3.13454914 3.13697815 3.13908577 3.1415844 ------------------------------ Transdef: Tab for variable 11 4.53725397E-06 0.00595271122 0.0101910811 0.016653657 0.0229640901 0.0292013884 0.0365676582 0.0443323851 0.0508158207 0.0583508015 0.0649738908 0.0722891241 0.0785213709 0.0862982571 0.0935463309 0.0998926014 0.107156396 0.112580158 0.119005799 0.126416206 0.133574128 0.14066124 0.147504807 0.154232025 0.160409927 0.166194558 0.172504902 0.178659633 0.184392333 0.190636218 0.1960513 0.201213598 0.206068516 0.211075783 0.215984881 0.221351087 0.226868108 0.231781363 0.235583544 0.240800798 0.246038109 0.250964284 0.255331516 0.259836942 0.264871478 0.270046949 0.275350332 0.280296624 0.284647644 0.289409876 0.294356287 0.299425125 0.303923011 0.309169114 0.314252377 0.319843888 0.324845552 0.33067894 0.336402714 0.342249393 0.347863972 0.353312612 0.358353019 0.363827944 0.368757546 0.374728501 0.38106364 0.387001872 0.392914236 0.399432659 0.405671597 0.411885738 0.41852814 0.426171005 0.433167934 0.440005541 0.447667301 0.455893993 0.463774592 0.472460806 0.480074167 0.489353478 0.498257756 0.507069588 0.516077042 0.525516033 0.535542846 0.544254959 0.555990458 0.56928283 0.580966592 0.596106052 0.61149466 0.630194068 0.647050798 0.666618824 0.694848418 0.722529411 0.764858246 0.82885313 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.209706888 0.218901634 0.227527112 0.234745175 0.242568865 0.249439925 0.255800784 0.262621999 0.269348681 0.275403261 0.280918002 0.286480069 0.292332709 0.29784894 0.303133488 0.308377296 0.313758314 0.318760186 0.323879868 0.32879746 0.334006965 0.339352012 0.344323337 0.348685563 0.35397017 0.358212948 0.362934589 0.367677748 0.372622371 0.377717078 0.383219123 0.388884902 0.393784434 0.398670495 0.402899891 0.406694114 0.410588861 0.413655639 0.417560279 0.421432585 0.42530033 0.42885685 0.432235897 0.435530365 0.439197093 0.443085194 0.446714818 0.450910121 0.455404818 0.459674835 0.464301795 0.468845248 0.472855389 0.476502419 0.480227232 0.484293729 0.488571703 0.492450058 0.49731493 0.501854539 0.507209301 0.512185693 0.517159462 0.521903753 0.52696681 0.532445312 0.53841269 0.544999242 0.54917115 0.554265082 0.559847236 0.566647828 0.57170862 0.578142166 0.584174454 0.590154409 0.596312642 0.603340924 0.611605406 0.618194401 0.624849677 0.631736517 0.640052557 0.650175929 0.660447717 0.666951239 0.676271558 0.686363339 0.697742701 0.709055424 0.720973432 0.734315038 0.748703241 0.762065053 0.780499876 0.806343555 0.82983768 0.857679486 0.904055059 1.13453126 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.7858467 22.6433411 23.3545341 24.0177612 24.6527557 25.1614933 25.62257 26.0681267 26.6145172 27.109478 27.5636292 28.0631142 28.4761066 28.8650131 29.2598915 29.6022015 30.0311127 30.3462067 30.677639 31.0104961 31.3954296 31.7210541 32.0548325 32.4070702 32.7812576 33.1680145 33.5485687 33.9283333 34.3347931 34.5522423 34.9345856 35.3070793 35.6409988 35.9948311 36.3199921 36.7043457 37.0807343 37.4070969 37.7774963 38.1606827 38.532692 38.8438873 39.2136765 39.6103745 39.9819527 40.3353233 40.6947899 41.0852737 41.4845428 41.877079 42.2905617 42.6496582 42.992897 43.3213806 43.6562805 44.0679703 44.4561005 44.8448334 45.2338562 45.6507492 46.0851822 46.5515137 46.9538422 47.3830681 47.8632393 48.3109245 48.8150864 49.2493591 49.75737 50.2760925 50.8577423 51.3711891 51.9542236 52.5470467 53.2117119 53.920826 54.5634422 55.2394562 55.9040146 56.6513214 57.4811592 58.358757 59.1829758 60.1466293 61.1088333 62.2392807 63.4374008 64.7206497 66.2704086 67.8058014 69.0739594 70.9779816 73.4662857 76.1767731 78.7151871 82.7167206 87.5966949 91.8902435 101.931328 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.8580551 11.3193073 11.7236576 12.1840239 12.4262466 12.7578535 13.1325111 13.5171661 13.8538952 14.207859 14.573164 14.9146338 15.2848759 15.6390266 15.9498186 16.2856541 16.5866299 16.9322548 17.2444496 17.5673027 17.8164635 18.1553383 18.4845657 18.7581291 19.1313286 19.4701767 19.8352547 20.2045975 20.5784645 20.9370422 21.2699051 21.6302376 21.9598312 22.3471565 22.6938782 23.028677 23.3432617 23.6623249 23.999155 24.3462067 24.6999969 25.0256596 25.3601799 25.6963997 26.0056763 26.2978249 26.6210823 26.9580364 27.3006516 27.6155033 27.8994598 28.1400928 28.4960098 28.8560143 29.1810341 29.5235939 29.8496552 30.1895161 30.5537872 30.8996925 31.2346153 31.5450478 31.8359013 32.2062302 32.5526276 32.8807068 33.2420692 33.5030975 33.8863983 34.2552185 34.6184616 34.969944 35.3691559 35.7539902 36.1750641 36.592659 37.0517273 37.4712448 37.9607239 38.4382248 38.9570007 39.4147568 39.8669968 40.4146805 41.0570831 41.6360855 42.4263153 43.1294022 43.9864578 44.6680374 45.6548615 46.8225174 47.896286 49.2274628 51.2080688 53.1443672 55.9002228 59.7370491 65.6940689 117.131721 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 66.4 53.2 57.8 33.8 52.9 63.8 57.2 65.5 -22.9 -20.2 -44.4 15.0 31.6 2 66.4 100.0 67.8 64.8 41.4 71.7 94.8 78.4 92.6 -43.3 -25.3 -53.5 31.4 40.5 3 53.2 67.8 100.0 54.5 13.6 37.3 71.2 56.8 72.9 -16.1 -28.6 -59.7 61.0 33.7 4 57.8 64.8 54.5 100.0 23.0 43.6 64.9 57.9 71.8 -9.8 -31.2 -67.7 24.3 73.8 5 33.8 41.4 13.6 23.0 100.0 84.7 15.4 60.8 60.5 19.7 -9.3 -17.7 -2.2 11.5 6 52.9 71.7 37.3 43.6 84.7 100.0 52.0 80.3 80.9 -8.1 -17.7 -35.4 10.8 25.5 7 63.8 94.8 71.2 64.9 15.4 52.0 100.0 70.4 82.2 -51.8 -24.5 -53.6 36.0 41.6 8 57.2 78.4 56.8 57.9 60.8 80.3 70.4 100.0 85.6 -12.8 -25.2 -49.1 26.1 37.6 9 65.5 92.6 72.9 71.8 60.5 80.9 82.2 85.6 100.0 -20.8 -28.4 -60.1 35.4 46.7 10 -22.9 -43.3 -16.1 -9.8 19.7 -8.1 -51.8 -12.8 -20.8 100.0 1.5 7.1 -6.5 -3.8 11 -20.2 -25.3 -28.6 -31.2 -9.3 -17.7 -24.5 -25.2 -28.4 1.5 100.0 53.2 -11.7 -21.3 12 -44.4 -53.5 -59.7 -67.7 -17.7 -35.4 -53.6 -49.1 -60.1 7.1 53.2 100.0 -28.5 -44.4 13 15.0 31.4 61.0 24.3 -2.2 10.8 36.0 26.1 35.4 -6.5 -11.7 -28.5 100.0 51.3 14 31.6 40.5 33.7 73.8 11.5 25.5 41.6 37.6 46.7 -3.8 -21.3 -44.4 51.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.009912 TOTAL CORRELATION OF ALL VARIABLES 73.8500736 ROUND 1: MAX CORR ( 73.8482546) AFTER KILLING INPUT VARIABLE 14 CONTR 0.518323123 ROUND 2: MAX CORR ( 73.8430026) AFTER KILLING INPUT VARIABLE 11 CONTR 0.88072308 ROUND 3: MAX CORR ( 73.8342372) AFTER KILLING INPUT VARIABLE 8 CONTR 1.1377363 ROUND 4: MAX CORR ( 73.7972791) AFTER KILLING INPUT VARIABLE 12 CONTR 2.33584891 ROUND 5: MAX CORR ( 73.7151755) AFTER KILLING INPUT VARIABLE 2 CONTR 3.48012983 ROUND 6: MAX CORR ( 73.5986031) AFTER KILLING INPUT VARIABLE 10 CONTR 4.14399692 ROUND 7: MAX CORR ( 73.4215509) AFTER KILLING INPUT VARIABLE 6 CONTR 5.10198527 ROUND 8: MAX CORR ( 72.3296152) AFTER KILLING INPUT VARIABLE 13 CONTR 12.6155021 ROUND 9: MAX CORR ( 70.8931351) AFTER KILLING INPUT VARIABLE 9 CONTR 14.3435224 ROUND 10: MAX CORR ( 70.4830574) AFTER KILLING INPUT VARIABLE 3 CONTR 7.61414648 ROUND 11: MAX CORR ( 68.2510449) AFTER KILLING INPUT VARIABLE 4 CONTR 17.5970521 ROUND 12: MAX CORR ( 63.7896001) AFTER KILLING INPUT VARIABLE 5 CONTR 24.2712185 LAST REMAINING VARIABLE: 7 total correlation to target: 73.8500736 % total significance: 156.501941 sigma correlations of single variables to target: variable 2: 66.4305244 % , in sigma: 140.778547 variable 3: 53.2164046 % , in sigma: 112.775387 variable 4: 57.7785063 % , in sigma: 122.443323 variable 5: 33.7755776 % , in sigma: 71.5766853 variable 6: 52.8681324 % , in sigma: 112.037334 variable 7: 63.7896001 % , in sigma: 135.181941 variable 8: 57.2435053 % , in sigma: 121.309557 variable 9: 65.474121 % , in sigma: 138.751751 variable 10: -22.9353325 % , in sigma: 48.6042042 variable 11: -20.1794986 % , in sigma: 42.7640833 variable 12: -44.3847568 % , in sigma: 94.0594948 variable 13: 14.958572 % , in sigma: 31.6999759 variable 14: 31.6301224 % , in sigma: 67.0300696 variables sorted by significance: 1 most relevant variable 7 corr 63.7896004 , in sigma: 135.181941 2 most relevant variable 5 corr 24.2712193 , in sigma: 51.435195 3 most relevant variable 4 corr 17.5970516 , in sigma: 37.2914015 4 most relevant variable 3 corr 7.61414671 , in sigma: 16.1357827 5 most relevant variable 9 corr 14.3435221 , in sigma: 30.3965716 6 most relevant variable 13 corr 12.6155024 , in sigma: 26.7345788 7 most relevant variable 6 corr 5.10198545 , in sigma: 10.8120492 8 most relevant variable 10 corr 4.14399672 , in sigma: 8.78189418 9 most relevant variable 2 corr 3.48012972 , in sigma: 7.37503744 10 most relevant variable 12 corr 2.33584881 , in sigma: 4.95009491 11 most relevant variable 8 corr 1.13773632 , in sigma: 2.41107333 12 most relevant variable 11 corr 0.880723059 , in sigma: 1.86641478 13 most relevant variable 14 corr 0.518323123 , in sigma: 1.0984224 global correlations between input variables: variable 2: 99.2018412 % variable 3: 92.1939706 % variable 4: 92.9049832 % variable 5: 95.2214189 % variable 6: 94.6356779 % variable 7: 98.822038 % variable 8: 90.7683692 % variable 9: 98.7754865 % variable 10: 71.1270843 % variable 11: 54.2645189 % variable 12: 79.1708299 % variable 13: 83.9134603 % variable 14: 88.4699201 % significance loss when removing single variables: variable 2: corr = 2.77068868 % , sigma = 5.87160089 variable 3: corr = 17.7050315 % , sigma = 37.5202307 variable 4: corr = 14.9414093 % , sigma = 31.663605 variable 5: corr = 13.4818831 % , sigma = 28.5705994 variable 6: corr = 4.32992373 % , sigma = 9.17590786 variable 7: corr = 7.04828635 % , sigma = 14.9366201 variable 8: corr = 1.07813232 % , sigma = 2.28476144 variable 9: corr = 13.020408 % , sigma = 27.5926487 variable 10: corr = 3.3657329 % , sigma = 7.13260947 variable 11: corr = 0.846929303 % , sigma = 1.79479957 variable 12: corr = 1.70020388 % , sigma = 3.60304594 variable 13: corr = 8.31097733 % , sigma = 17.6124955 variable 14: corr = 0.518323123 % , sigma = 1.0984224 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 19.5958519 sigma out 15 active outputs RANK 2 NODE 3 --> 18.3246803 sigma out 15 active outputs RANK 3 NODE 11 --> 17.1409187 sigma out 15 active outputs RANK 4 NODE 10 --> 15.5982552 sigma out 15 active outputs RANK 5 NODE 4 --> 15.4637985 sigma out 15 active outputs RANK 6 NODE 5 --> 15.0986776 sigma out 15 active outputs RANK 7 NODE 7 --> 13.4469919 sigma out 15 active outputs RANK 8 NODE 9 --> 13.0896654 sigma out 15 active outputs RANK 9 NODE 6 --> 12.472352 sigma out 15 active outputs RANK 10 NODE 1 --> 11.3190613 sigma out 15 active outputs RANK 11 NODE 8 --> 9.01412106 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 20.9812241 sigma in 11act. ( 19.5005283 sig out 1act.) RANK 2 NODE 3 --> 18.8522243 sigma in 11act. ( 15.1466188 sig out 1act.) RANK 3 NODE 11 --> 18.1501884 sigma in 11act. ( 14.0560303 sig out 1act.) RANK 4 NODE 2 --> 16.4762611 sigma in 11act. ( 12.5199375 sig out 1act.) RANK 5 NODE 10 --> 13.4616365 sigma in 11act. ( 21.3449364 sig out 1act.) RANK 6 NODE 7 --> 13.2306099 sigma in 11act. ( 10.1358624 sig out 1act.) RANK 7 NODE 14 --> 12.6695185 sigma in 11act. ( 9.30530262 sig out 1act.) RANK 8 NODE 13 --> 12.0091658 sigma in 11act. ( 8.34404469 sig out 1act.) RANK 9 NODE 8 --> 10.186059 sigma in 11act. ( 10.8039608 sig out 1act.) RANK 10 NODE 5 --> 9.81970978 sigma in 11act. ( 9.49523926 sig out 1act.) RANK 11 NODE 15 --> 8.21599388 sigma in 11act. ( 7.18599224 sig out 1act.) RANK 12 NODE 4 --> 7.61958313 sigma in 11act. ( 10.8784409 sig out 1act.) RANK 13 NODE 1 --> 6.72196531 sigma in 11act. ( 5.82023764 sig out 1act.) RANK 14 NODE 9 --> 3.18104196 sigma in 11act. ( 5.57810307 sig out 1act.) RANK 15 NODE 12 --> 1.59376419 sigma in 11act. ( 2.01764631 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 21.3449364 sigma out 1act.( 13.4616365 sig in 11act.) RANK 2 NODE 6 --> 19.5005283 sigma out 1act.( 20.9812241 sig in 11act.) RANK 3 NODE 3 --> 15.1466188 sigma out 1act.( 18.8522243 sig in 11act.) RANK 4 NODE 11 --> 14.0560303 sigma out 1act.( 18.1501884 sig in 11act.) RANK 5 NODE 2 --> 12.5199375 sigma out 1act.( 16.4762611 sig in 11act.) RANK 6 NODE 4 --> 10.8784409 sigma out 1act.( 7.61958313 sig in 11act.) RANK 7 NODE 8 --> 10.8039608 sigma out 1act.( 10.186059 sig in 11act.) RANK 8 NODE 7 --> 10.1358624 sigma out 1act.( 13.2306099 sig in 11act.) RANK 9 NODE 5 --> 9.49523926 sigma out 1act.( 9.81970978 sig in 11act.) RANK 10 NODE 14 --> 9.30530262 sigma out 1act.( 12.6695185 sig in 11act.) RANK 11 NODE 13 --> 8.34404469 sigma out 1act.( 12.0091658 sig in 11act.) RANK 12 NODE 15 --> 7.18599224 sigma out 1act.( 8.21599388 sig in 11act.) RANK 13 NODE 1 --> 5.82023764 sigma out 1act.( 6.72196531 sig in 11act.) RANK 14 NODE 9 --> 5.57810307 sigma out 1act.( 3.18104196 sig in 11act.) RANK 15 NODE 12 --> 2.01764631 sigma out 1act.( 1.59376419 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.0921974 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 22.5923939 sigma out 15 active outputs RANK 2 NODE 3 --> 16.7668648 sigma out 15 active outputs RANK 3 NODE 2 --> 15.9860945 sigma out 15 active outputs RANK 4 NODE 6 --> 15.5084438 sigma out 15 active outputs RANK 5 NODE 4 --> 15.4440575 sigma out 15 active outputs RANK 6 NODE 5 --> 14.3241463 sigma out 15 active outputs RANK 7 NODE 11 --> 13.9460678 sigma out 15 active outputs RANK 8 NODE 1 --> 13.1849995 sigma out 15 active outputs RANK 9 NODE 9 --> 12.7820072 sigma out 15 active outputs RANK 10 NODE 7 --> 12.0822639 sigma out 15 active outputs RANK 11 NODE 8 --> 8.18558502 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 23.2329807 sigma in 11act. ( 21.0920715 sig out 1act.) RANK 2 NODE 6 --> 16.3339329 sigma in 11act. ( 16.9433746 sig out 1act.) RANK 3 NODE 4 --> 15.5212851 sigma in 11act. ( 11.1872282 sig out 1act.) RANK 4 NODE 3 --> 14.6475201 sigma in 11act. ( 13.2413225 sig out 1act.) RANK 5 NODE 11 --> 13.000803 sigma in 11act. ( 12.2907772 sig out 1act.) RANK 6 NODE 8 --> 12.6846752 sigma in 11act. ( 10.5767517 sig out 1act.) RANK 7 NODE 9 --> 12.444314 sigma in 11act. ( 7.31486702 sig out 1act.) RANK 8 NODE 2 --> 12.0687952 sigma in 11act. ( 10.7356701 sig out 1act.) RANK 9 NODE 7 --> 10.5538692 sigma in 11act. ( 8.49476814 sig out 1act.) RANK 10 NODE 14 --> 10.1018877 sigma in 11act. ( 8.0526495 sig out 1act.) RANK 11 NODE 5 --> 9.80145741 sigma in 11act. ( 8.71830654 sig out 1act.) RANK 12 NODE 12 --> 9.2150507 sigma in 11act. ( 4.42404366 sig out 1act.) RANK 13 NODE 15 --> 8.93679333 sigma in 11act. ( 6.66244078 sig out 1act.) RANK 14 NODE 13 --> 8.30181122 sigma in 11act. ( 6.69966459 sig out 1act.) RANK 15 NODE 1 --> 6.35143566 sigma in 11act. ( 5.32900286 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 21.0920715 sigma out 1act.( 23.2329807 sig in 11act.) RANK 2 NODE 6 --> 16.9433746 sigma out 1act.( 16.3339329 sig in 11act.) RANK 3 NODE 3 --> 13.2413225 sigma out 1act.( 14.6475201 sig in 11act.) RANK 4 NODE 11 --> 12.2907772 sigma out 1act.( 13.000803 sig in 11act.) RANK 5 NODE 4 --> 11.1872282 sigma out 1act.( 15.5212851 sig in 11act.) RANK 6 NODE 2 --> 10.7356701 sigma out 1act.( 12.0687952 sig in 11act.) RANK 7 NODE 8 --> 10.5767517 sigma out 1act.( 12.6846752 sig in 11act.) RANK 8 NODE 5 --> 8.71830654 sigma out 1act.( 9.80145741 sig in 11act.) RANK 9 NODE 7 --> 8.49476814 sigma out 1act.( 10.5538692 sig in 11act.) RANK 10 NODE 14 --> 8.0526495 sigma out 1act.( 10.1018877 sig in 11act.) RANK 11 NODE 9 --> 7.31486702 sigma out 1act.( 12.444314 sig in 11act.) RANK 12 NODE 13 --> 6.69966459 sigma out 1act.( 8.30181122 sig in 11act.) RANK 13 NODE 15 --> 6.66244078 sigma out 1act.( 8.93679333 sig in 11act.) RANK 14 NODE 1 --> 5.32900286 sigma out 1act.( 6.35143566 sig in 11act.) RANK 15 NODE 12 --> 4.42404366 sigma out 1act.( 9.2150507 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.5956802 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.356760085 *** contribution from regularisation: 0.00416657655 *** contribution from error: -0.360926658 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.423907727 *** contribution from regularisation: 0.00249757455 *** contribution from error: -0.426405311 *********************************************** -----------------> Test sample ENTER BFGS code START -41462.4431 0.301175237 0.475090981 EXIT FROM BFGS code FG_START 0. 0.301175237 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.461583823 *** contribution from regularisation: 0.00230126362 *** contribution from error: -0.463885099 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -45136.8967 0.301175237 255.578491 EXIT FROM BFGS code FG_LNSRCH 0. 0.323191077 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.530844331 *** contribution from regularisation: 0.00342120044 *** contribution from error: -0.534265518 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51909.6765 0.323191077 162.928726 EXIT FROM BFGS code NEW_X -51909.6765 0.323191077 162.928726 ENTER BFGS code NEW_X -51909.6765 0.323191077 162.928726 EXIT FROM BFGS code FG_LNSRCH 0. 0.344960392 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.54047972 *** contribution from regularisation: 0.0037379351 *** contribution from error: -0.544217646 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52851.8922 0.344960392 102.646675 EXIT FROM BFGS code NEW_X -52851.8922 0.344960392 102.646675 ENTER BFGS code NEW_X -52851.8922 0.344960392 102.646675 EXIT FROM BFGS code FG_LNSRCH 0. 0.373439521 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.545614421 *** contribution from regularisation: 0.00340239378 *** contribution from error: -0.549016833 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53353.9951 0.373439521 23.7754631 EXIT FROM BFGS code NEW_X -53353.9951 0.373439521 23.7754631 ENTER BFGS code NEW_X -53353.9951 0.373439521 23.7754631 EXIT FROM BFGS code FG_LNSRCH 0. 0.393696398 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.548530817 *** contribution from regularisation: 0.00317926146 *** contribution from error: -0.551710069 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53639.1852 0.393696398 -35.706337 EXIT FROM BFGS code NEW_X -53639.1852 0.393696398 -35.706337 ENTER BFGS code NEW_X -53639.1852 0.393696398 -35.706337 EXIT FROM BFGS code FG_LNSRCH 0. 0.387122571 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.54989934 *** contribution from regularisation: 0.00294667319 *** contribution from error: -0.552846014 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53773.0052 0.387122571 -31.1592827 EXIT FROM BFGS code NEW_X -53773.0052 0.387122571 -31.1592827 ENTER BFGS code NEW_X -53773.0052 0.387122571 -31.1592827 EXIT FROM BFGS code FG_LNSRCH 0. 0.362625152 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.551422298 *** contribution from regularisation: 0.0030597439 *** contribution from error: -0.554482043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53921.9308 0.362625152 37.2773285 EXIT FROM BFGS code NEW_X -53921.9308 0.362625152 37.2773285 ENTER BFGS code NEW_X -53921.9308 0.362625152 37.2773285 EXIT FROM BFGS code FG_LNSRCH 0. 0.368200898 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 50.2714958 sigma out 15 active outputs RANK 2 NODE 1 --> 26.9898891 sigma out 15 active outputs RANK 3 NODE 9 --> 25.1142273 sigma out 15 active outputs RANK 4 NODE 8 --> 23.5431843 sigma out 15 active outputs RANK 5 NODE 2 --> 19.4978924 sigma out 15 active outputs RANK 6 NODE 7 --> 16.7963276 sigma out 15 active outputs RANK 7 NODE 3 --> 15.5464993 sigma out 15 active outputs RANK 8 NODE 11 --> 14.9295444 sigma out 15 active outputs RANK 9 NODE 6 --> 14.080986 sigma out 15 active outputs RANK 10 NODE 4 --> 13.661171 sigma out 15 active outputs RANK 11 NODE 5 --> 13.3858366 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 42.1387062 sigma in 11act. ( 33.3841972 sig out 1act.) RANK 2 NODE 12 --> 36.5757103 sigma in 11act. ( 32.2792969 sig out 1act.) RANK 3 NODE 9 --> 32.1198692 sigma in 11act. ( 36.7900887 sig out 1act.) RANK 4 NODE 4 --> 22.1023865 sigma in 11act. ( 17.7795048 sig out 1act.) RANK 5 NODE 15 --> 18.1344986 sigma in 11act. ( 17.7642555 sig out 1act.) RANK 6 NODE 8 --> 17.7970467 sigma in 11act. ( 15.1137438 sig out 1act.) RANK 7 NODE 2 --> 15.2662029 sigma in 11act. ( 14.7273703 sig out 1act.) RANK 8 NODE 3 --> 12.2402906 sigma in 11act. ( 10.8560963 sig out 1act.) RANK 9 NODE 7 --> 10.9432316 sigma in 11act. ( 8.82458401 sig out 1act.) RANK 10 NODE 6 --> 9.94516373 sigma in 11act. ( 10.123909 sig out 1act.) RANK 11 NODE 14 --> 8.2524395 sigma in 11act. ( 7.08832312 sig out 1act.) RANK 12 NODE 5 --> 7.76128769 sigma in 11act. ( 6.70543098 sig out 1act.) RANK 13 NODE 1 --> 7.5615015 sigma in 11act. ( 6.43069649 sig out 1act.) RANK 14 NODE 13 --> 6.48052835 sigma in 11act. ( 5.94503784 sig out 1act.) RANK 15 NODE 11 --> 4.83010149 sigma in 11act. ( 3.17375112 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 36.7900887 sigma out 1act.( 32.1198692 sig in 11act.) RANK 2 NODE 10 --> 33.3841972 sigma out 1act.( 42.1387062 sig in 11act.) RANK 3 NODE 12 --> 32.2792969 sigma out 1act.( 36.5757103 sig in 11act.) RANK 4 NODE 4 --> 17.7795048 sigma out 1act.( 22.1023865 sig in 11act.) RANK 5 NODE 15 --> 17.7642555 sigma out 1act.( 18.1344986 sig in 11act.) RANK 6 NODE 8 --> 15.1137438 sigma out 1act.( 17.7970467 sig in 11act.) RANK 7 NODE 2 --> 14.7273703 sigma out 1act.( 15.2662029 sig in 11act.) RANK 8 NODE 3 --> 10.8560963 sigma out 1act.( 12.2402906 sig in 11act.) RANK 9 NODE 6 --> 10.123909 sigma out 1act.( 9.94516373 sig in 11act.) RANK 10 NODE 7 --> 8.82458401 sigma out 1act.( 10.9432316 sig in 11act.) RANK 11 NODE 14 --> 7.08832312 sigma out 1act.( 8.2524395 sig in 11act.) RANK 12 NODE 5 --> 6.70543098 sigma out 1act.( 7.76128769 sig in 11act.) RANK 13 NODE 1 --> 6.43069649 sigma out 1act.( 7.5615015 sig in 11act.) RANK 14 NODE 13 --> 5.94503784 sigma out 1act.( 6.48052835 sig in 11act.) RANK 15 NODE 11 --> 3.17375112 sigma out 1act.( 4.83010149 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 71.1840363 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.552141368 *** contribution from regularisation: 0.00303979893 *** contribution from error: -0.555181146 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53992.2504 0.368200898 -68.7080917 EXIT FROM BFGS code NEW_X -53992.2504 0.368200898 -68.7080917 ENTER BFGS code NEW_X -53992.2504 0.368200898 -68.7080917 EXIT FROM BFGS code FG_LNSRCH 0. 0.357624173 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.552570164 *** contribution from regularisation: 0.00308151171 *** contribution from error: -0.555651665 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54034.1774 0.357624173 -7.43656445 EXIT FROM BFGS code NEW_X -54034.1774 0.357624173 -7.43656445 ENTER BFGS code NEW_X -54034.1774 0.357624173 -7.43656445 EXIT FROM BFGS code FG_LNSRCH 0. 0.350222141 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.552926421 *** contribution from regularisation: 0.00309961569 *** contribution from error: -0.556026042 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54069.0165 0.350222141 17.3116989 EXIT FROM BFGS code NEW_X -54069.0165 0.350222141 17.3116989 ENTER BFGS code NEW_X -54069.0165 0.350222141 17.3116989 EXIT FROM BFGS code FG_LNSRCH 0. 0.334792316 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.553694308 *** contribution from regularisation: 0.00316009833 *** contribution from error: -0.556854427 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54144.107 0.334792316 48.4389915 EXIT FROM BFGS code NEW_X -54144.107 0.334792316 48.4389915 ENTER BFGS code NEW_X -54144.107 0.334792316 48.4389915 EXIT FROM BFGS code FG_LNSRCH 0. 0.308843821 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.554810464 *** contribution from regularisation: 0.00339945802 *** contribution from error: -0.558209896 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54253.2505 0.308843821 82.5991211 EXIT FROM BFGS code NEW_X -54253.2505 0.308843821 82.5991211 ENTER BFGS code NEW_X -54253.2505 0.308843821 82.5991211 EXIT FROM BFGS code FG_LNSRCH 0. 0.329875082 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.554346621 *** contribution from regularisation: 0.00352279097 *** contribution from error: -0.557869434 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54207.8906 0.329875082 -202.63414 EXIT FROM BFGS code FG_LNSRCH 0. 0.318073183 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.555915833 *** contribution from regularisation: 0.0029913024 *** contribution from error: -0.558907151 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54361.3413 0.318073183 -35.4616013 EXIT FROM BFGS code NEW_X -54361.3413 0.318073183 -35.4616013 ENTER BFGS code NEW_X -54361.3413 0.318073183 -35.4616013 EXIT FROM BFGS code FG_LNSRCH 0. 0.312783569 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.556183934 *** contribution from regularisation: 0.00321818353 *** contribution from error: -0.559402108 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54387.5565 0.312783569 -41.0320892 EXIT FROM BFGS code NEW_X -54387.5565 0.312783569 -41.0320892 ENTER BFGS code NEW_X -54387.5565 0.312783569 -41.0320892 EXIT FROM BFGS code FG_LNSRCH 0. 0.309949368 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.556433499 *** contribution from regularisation: 0.00308519369 *** contribution from error: -0.559518695 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54411.9638 0.309949368 -24.2622318 EXIT FROM BFGS code NEW_X -54411.9638 0.309949368 -24.2622318 ENTER BFGS code NEW_X -54411.9638 0.309949368 -24.2622318 EXIT FROM BFGS code FG_LNSRCH 0. 0.300354898 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.556608915 *** contribution from regularisation: 0.00313241337 *** contribution from error: -0.559741318 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54429.1142 0.300354898 -28.6968746 EXIT FROM BFGS code NEW_X -54429.1142 0.300354898 -28.6968746 ENTER BFGS code NEW_X -54429.1142 0.300354898 -28.6968746 EXIT FROM BFGS code FG_LNSRCH 0. 0.275106579 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 63.26017 sigma out 15 active outputs RANK 2 NODE 7 --> 36.0928993 sigma out 15 active outputs RANK 3 NODE 1 --> 31.7464199 sigma out 15 active outputs RANK 4 NODE 9 --> 31.0847855 sigma out 15 active outputs RANK 5 NODE 2 --> 27.8062992 sigma out 15 active outputs RANK 6 NODE 8 --> 25.6768894 sigma out 15 active outputs RANK 7 NODE 4 --> 21.7945709 sigma out 15 active outputs RANK 8 NODE 3 --> 21.4361038 sigma out 15 active outputs RANK 9 NODE 11 --> 20.0971928 sigma out 15 active outputs RANK 10 NODE 5 --> 14.8146296 sigma out 15 active outputs RANK 11 NODE 6 --> 14.63657 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 58.5086975 sigma in 11act. ( 58.3790474 sig out 1act.) RANK 2 NODE 9 --> 50.4444656 sigma in 11act. ( 54.3925285 sig out 1act.) RANK 3 NODE 10 --> 40.6584969 sigma in 11act. ( 37.3831825 sig out 1act.) RANK 4 NODE 15 --> 27.1579857 sigma in 11act. ( 29.9778957 sig out 1act.) RANK 5 NODE 8 --> 25.6622601 sigma in 11act. ( 23.8569641 sig out 1act.) RANK 6 NODE 3 --> 21.2609959 sigma in 11act. ( 21.4480438 sig out 1act.) RANK 7 NODE 2 --> 16.4508953 sigma in 11act. ( 16.7901192 sig out 1act.) RANK 8 NODE 4 --> 14.931139 sigma in 11act. ( 11.8902369 sig out 1act.) RANK 9 NODE 7 --> 12.1914883 sigma in 11act. ( 11.7432585 sig out 1act.) RANK 10 NODE 14 --> 10.7472792 sigma in 11act. ( 10.7734585 sig out 1act.) RANK 11 NODE 13 --> 9.03033352 sigma in 11act. ( 8.60546875 sig out 1act.) RANK 12 NODE 5 --> 7.67478991 sigma in 11act. ( 6.65631866 sig out 1act.) RANK 13 NODE 6 --> 7.12696028 sigma in 11act. ( 6.1481204 sig out 1act.) RANK 14 NODE 11 --> 6.57867861 sigma in 11act. ( 6.38434601 sig out 1act.) RANK 15 NODE 1 --> 4.67504311 sigma in 11act. ( 3.33625674 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 58.3790474 sigma out 1act.( 58.5086975 sig in 11act.) RANK 2 NODE 9 --> 54.3925285 sigma out 1act.( 50.4444656 sig in 11act.) RANK 3 NODE 10 --> 37.3831825 sigma out 1act.( 40.6584969 sig in 11act.) RANK 4 NODE 15 --> 29.9778957 sigma out 1act.( 27.1579857 sig in 11act.) RANK 5 NODE 8 --> 23.8569641 sigma out 1act.( 25.6622601 sig in 11act.) RANK 6 NODE 3 --> 21.4480438 sigma out 1act.( 21.2609959 sig in 11act.) RANK 7 NODE 2 --> 16.7901192 sigma out 1act.( 16.4508953 sig in 11act.) RANK 8 NODE 4 --> 11.8902369 sigma out 1act.( 14.931139 sig in 11act.) RANK 9 NODE 7 --> 11.7432585 sigma out 1act.( 12.1914883 sig in 11act.) RANK 10 NODE 14 --> 10.7734585 sigma out 1act.( 10.7472792 sig in 11act.) RANK 11 NODE 13 --> 8.60546875 sigma out 1act.( 9.03033352 sig in 11act.) RANK 12 NODE 5 --> 6.65631866 sigma out 1act.( 7.67478991 sig in 11act.) RANK 13 NODE 11 --> 6.38434601 sigma out 1act.( 6.57867861 sig in 11act.) RANK 14 NODE 6 --> 6.1481204 sigma out 1act.( 7.12696028 sig in 11act.) RANK 15 NODE 1 --> 3.33625674 sigma out 1act.( 4.67504311 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 102.846085 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.556903362 *** contribution from regularisation: 0.00308934506 *** contribution from error: -0.559992731 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54457.9107 0.275106579 9.4571352 EXIT FROM BFGS code NEW_X -54457.9107 0.275106579 9.4571352 ENTER BFGS code NEW_X -54457.9107 0.275106579 9.4571352 EXIT FROM BFGS code FG_LNSRCH 0. 0.260052323 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.557076693 *** contribution from regularisation: 0.00315643451 *** contribution from error: -0.560233116 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54474.86 0.260052323 -36.2848701 EXIT FROM BFGS code NEW_X -54474.86 0.260052323 -36.2848701 ENTER BFGS code NEW_X -54474.86 0.260052323 -36.2848701 EXIT FROM BFGS code FG_LNSRCH 0. 0.244807407 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.557265162 *** contribution from regularisation: 0.00317252078 *** contribution from error: -0.560437679 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54493.2903 0.244807407 -13.0219917 EXIT FROM BFGS code NEW_X -54493.2903 0.244807407 -13.0219917 ENTER BFGS code NEW_X -54493.2903 0.244807407 -13.0219917 EXIT FROM BFGS code FG_LNSRCH 0. 0.232937649 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.557388186 *** contribution from regularisation: 0.0031661531 *** contribution from error: -0.560554326 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54505.318 0.232937649 -13.801404 EXIT FROM BFGS code NEW_X -54505.318 0.232937649 -13.801404 ENTER BFGS code NEW_X -54505.318 0.232937649 -13.801404 EXIT FROM BFGS code FG_LNSRCH 0. 0.176387846 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.557781339 *** contribution from regularisation: 0.0031104323 *** contribution from error: -0.560891747 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54543.7663 0.176387846 -2.90798759 EXIT FROM BFGS code NEW_X -54543.7663 0.176387846 -2.90798759 ENTER BFGS code NEW_X -54543.7663 0.176387846 -2.90798759 EXIT FROM BFGS code FG_LNSRCH 0. 0.136762947 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.557854474 *** contribution from regularisation: 0.00319636147 *** contribution from error: -0.561050832 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54550.9152 0.136762947 19.0872555 EXIT FROM BFGS code NEW_X -54550.9152 0.136762947 19.0872555 ENTER BFGS code NEW_X -54550.9152 0.136762947 19.0872555 EXIT FROM BFGS code FG_LNSRCH 0. 0.133840904 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.558045626 *** contribution from regularisation: 0.00324163167 *** contribution from error: -0.561287284 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54569.6078 0.133840904 -4.0878005 EXIT FROM BFGS code NEW_X -54569.6078 0.133840904 -4.0878005 ENTER BFGS code NEW_X -54569.6078 0.133840904 -4.0878005 EXIT FROM BFGS code FG_LNSRCH 0. 0.120203018 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.558129728 *** contribution from regularisation: 0.00321895769 *** contribution from error: -0.561348677 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54577.8298 0.120203018 -13.2129822 EXIT FROM BFGS code NEW_X -54577.8298 0.120203018 -13.2129822 ENTER BFGS code NEW_X -54577.8298 0.120203018 -13.2129822 EXIT FROM BFGS code FG_LNSRCH 0. 0.0978419036 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.558207631 *** contribution from regularisation: 0.0032336025 *** contribution from error: -0.561441243 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54585.4485 0.0978419036 -7.10486603 EXIT FROM BFGS code NEW_X -54585.4485 0.0978419036 -7.10486603 ENTER BFGS code NEW_X -54585.4485 0.0978419036 -7.10486603 EXIT FROM BFGS code FG_LNSRCH 0. 0.0387582816 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.55839318 *** contribution from regularisation: 0.0032210059 *** contribution from error: -0.561614215 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54603.5947 0.0387582816 -52.4387054 EXIT FROM BFGS code NEW_X -54603.5947 0.0387582816 -52.4387054 ENTER BFGS code NEW_X -54603.5947 0.0387582816 -52.4387054 EXIT FROM BFGS code FG_LNSRCH 0. 0.00199700729 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 90.0715866 sigma out 15 active outputs RANK 2 NODE 2 --> 51.2093086 sigma out 15 active outputs RANK 3 NODE 1 --> 47.3040199 sigma out 15 active outputs RANK 4 NODE 7 --> 39.6215668 sigma out 15 active outputs RANK 5 NODE 4 --> 36.5369072 sigma out 15 active outputs RANK 6 NODE 9 --> 33.4224815 sigma out 15 active outputs RANK 7 NODE 8 --> 28.6625996 sigma out 15 active outputs RANK 8 NODE 11 --> 24.5916309 sigma out 15 active outputs RANK 9 NODE 3 --> 19.3746395 sigma out 15 active outputs RANK 10 NODE 5 --> 17.5671902 sigma out 15 active outputs RANK 11 NODE 6 --> 16.1056538 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 94.1597595 sigma in 11act. ( 84.9768753 sig out 1act.) RANK 2 NODE 9 --> 65.0979996 sigma in 11act. ( 72.3062668 sig out 1act.) RANK 3 NODE 15 --> 42.1937637 sigma in 11act. ( 55.1311417 sig out 1act.) RANK 4 NODE 10 --> 33.1581993 sigma in 11act. ( 35.6830902 sig out 1act.) RANK 5 NODE 8 --> 29.3968277 sigma in 11act. ( 29.9893894 sig out 1act.) RANK 6 NODE 3 --> 28.0644894 sigma in 11act. ( 30.7486401 sig out 1act.) RANK 7 NODE 2 --> 20.2707596 sigma in 11act. ( 20.6391106 sig out 1act.) RANK 8 NODE 7 --> 19.5657654 sigma in 11act. ( 20.7047844 sig out 1act.) RANK 9 NODE 6 --> 14.1437073 sigma in 11act. ( 14.1112289 sig out 1act.) RANK 10 NODE 14 --> 13.9530993 sigma in 11act. ( 15.1631918 sig out 1act.) RANK 11 NODE 13 --> 13.179224 sigma in 11act. ( 12.3210764 sig out 1act.) RANK 12 NODE 11 --> 12.865509 sigma in 11act. ( 14.279501 sig out 1act.) RANK 13 NODE 4 --> 11.5729685 sigma in 11act. ( 9.8023777 sig out 1act.) RANK 14 NODE 5 --> 7.30683756 sigma in 11act. ( 6.90422869 sig out 1act.) RANK 15 NODE 1 --> 3.75849342 sigma in 11act. ( 2.88319635 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 84.9768753 sigma out 1act.( 94.1597595 sig in 11act.) RANK 2 NODE 9 --> 72.3062668 sigma out 1act.( 65.0979996 sig in 11act.) RANK 3 NODE 15 --> 55.1311417 sigma out 1act.( 42.1937637 sig in 11act.) RANK 4 NODE 10 --> 35.6830902 sigma out 1act.( 33.1581993 sig in 11act.) RANK 5 NODE 3 --> 30.7486401 sigma out 1act.( 28.0644894 sig in 11act.) RANK 6 NODE 8 --> 29.9893894 sigma out 1act.( 29.3968277 sig in 11act.) RANK 7 NODE 7 --> 20.7047844 sigma out 1act.( 19.5657654 sig in 11act.) RANK 8 NODE 2 --> 20.6391106 sigma out 1act.( 20.2707596 sig in 11act.) RANK 9 NODE 14 --> 15.1631918 sigma out 1act.( 13.9530993 sig in 11act.) RANK 10 NODE 11 --> 14.279501 sigma out 1act.( 12.865509 sig in 11act.) RANK 11 NODE 6 --> 14.1112289 sigma out 1act.( 14.1437073 sig in 11act.) RANK 12 NODE 13 --> 12.3210764 sigma out 1act.( 13.179224 sig in 11act.) RANK 13 NODE 4 --> 9.8023777 sigma out 1act.( 11.5729685 sig in 11act.) RANK 14 NODE 5 --> 6.90422869 sigma out 1act.( 7.30683756 sig in 11act.) RANK 15 NODE 1 --> 2.88319635 sigma out 1act.( 3.75849342 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 142.822708 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.558495045 *** contribution from regularisation: 0.00328009157 *** contribution from error: -0.561775148 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54613.557 0.00199700729 75.5202942 EXIT FROM BFGS code NEW_X -54613.557 0.00199700729 75.5202942 ENTER BFGS code NEW_X -54613.557 0.00199700729 75.5202942 EXIT FROM BFGS code FG_LNSRCH 0. 0.0173506979 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.558666945 *** contribution from regularisation: 0.00330230198 *** contribution from error: -0.561969221 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54630.3628 0.0173506979 40.9731102 EXIT FROM BFGS code NEW_X -54630.3628 0.0173506979 40.9731102 ENTER BFGS code NEW_X -54630.3628 0.0173506979 40.9731102 EXIT FROM BFGS code FG_LNSRCH 0. 0.0241606496 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.558929384 *** contribution from regularisation: 0.00323751406 *** contribution from error: -0.56216687 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54656.0281 0.0241606496 -3.26514459 EXIT FROM BFGS code NEW_X -54656.0281 0.0241606496 -3.26514459 ENTER BFGS code NEW_X -54656.0281 0.0241606496 -3.26514459 EXIT FROM BFGS code FG_LNSRCH 0. 0.024331389 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.558934391 *** contribution from regularisation: 0.00327078183 *** contribution from error: -0.562205195 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54656.5186 0.024331389 -15.2464867 EXIT FROM BFGS code NEW_X -54656.5186 0.024331389 -15.2464867 ENTER BFGS code NEW_X -54656.5186 0.024331389 -15.2464867 EXIT FROM BFGS code FG_LNSRCH 0. 0.0180413071 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.558924139 *** contribution from regularisation: 0.00329087139 *** contribution from error: -0.56221503 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54655.5156 0.0180413071 24.9574738 EXIT FROM BFGS code FG_LNSRCH 0. 0.0221210383 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.558839083 *** contribution from regularisation: 0.00340109412 *** contribution from error: -0.562240183 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54647.2003 0.0221210383 -1.60163283 EXIT FROM BFGS code FG_LNSRCH 0. 0.0241570454 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.55884552 *** contribution from regularisation: 0.00336346403 *** contribution from error: -0.56220901 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54647.8254 0.0241570454 -14.1661386 EXIT FROM BFGS code FG_LNSRCH 0. 0.0243297592 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.558864295 *** contribution from regularisation: 0.00334097631 *** contribution from error: -0.562205255 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54649.6613 0.0243297592 -15.1963835 EXIT FROM BFGS code FG_LNSRCH 0. 0.024331389 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.558858573 *** contribution from regularisation: 0.00334659521 *** contribution from error: -0.562205195 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54649.105 0.024331389 -15.1929436 EXIT FROM BFGS code FG_LNSRCH 0. 0.024331389 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.558868289 *** contribution from regularisation: 0.00333692296 *** contribution from error: -0.562205195 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54650.0508 0.024331389 -15.184166 EXIT FROM BFGS code FG_LNSRCH 0. 0.024331389 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 85.0756073 sigma out 15 active outputs RANK 2 NODE 1 --> 47.9106865 sigma out 15 active outputs RANK 3 NODE 2 --> 44.0055733 sigma out 15 active outputs RANK 4 NODE 7 --> 43.561615 sigma out 15 active outputs RANK 5 NODE 4 --> 36.3807411 sigma out 15 active outputs RANK 6 NODE 9 --> 33.1371651 sigma out 15 active outputs RANK 7 NODE 8 --> 26.2722511 sigma out 15 active outputs RANK 8 NODE 11 --> 24.3678131 sigma out 15 active outputs RANK 9 NODE 3 --> 20.6240921 sigma out 15 active outputs RANK 10 NODE 5 --> 17.5141125 sigma out 15 active outputs RANK 11 NODE 6 --> 16.0735722 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 87.461174 sigma in 11act. ( 83.441452 sig out 1act.) RANK 2 NODE 9 --> 62.4957771 sigma in 11act. ( 73.4349594 sig out 1act.) RANK 3 NODE 15 --> 43.8605919 sigma in 11act. ( 54.6568527 sig out 1act.) RANK 4 NODE 10 --> 33.2497673 sigma in 11act. ( 35.2049026 sig out 1act.) RANK 5 NODE 8 --> 28.5908947 sigma in 11act. ( 27.9351902 sig out 1act.) RANK 6 NODE 3 --> 28.4788132 sigma in 11act. ( 30.9291782 sig out 1act.) RANK 7 NODE 2 --> 20.8143921 sigma in 11act. ( 21.1647377 sig out 1act.) RANK 8 NODE 7 --> 19.9535789 sigma in 11act. ( 20.533102 sig out 1act.) RANK 9 NODE 6 --> 15.9621172 sigma in 11act. ( 16.1757774 sig out 1act.) RANK 10 NODE 14 --> 14.2176552 sigma in 11act. ( 15.0094423 sig out 1act.) RANK 11 NODE 11 --> 14.1403046 sigma in 11act. ( 15.6924524 sig out 1act.) RANK 12 NODE 13 --> 12.6531181 sigma in 11act. ( 12.2131462 sig out 1act.) RANK 13 NODE 4 --> 11.3682575 sigma in 11act. ( 9.16857529 sig out 1act.) RANK 14 NODE 5 --> 7.53634405 sigma in 11act. ( 7.03885555 sig out 1act.) RANK 15 NODE 1 --> 4.01847219 sigma in 11act. ( 3.22673893 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 83.441452 sigma out 1act.( 87.461174 sig in 11act.) RANK 2 NODE 9 --> 73.4349594 sigma out 1act.( 62.4957771 sig in 11act.) RANK 3 NODE 15 --> 54.6568527 sigma out 1act.( 43.8605919 sig in 11act.) RANK 4 NODE 10 --> 35.2049026 sigma out 1act.( 33.2497673 sig in 11act.) RANK 5 NODE 3 --> 30.9291782 sigma out 1act.( 28.4788132 sig in 11act.) RANK 6 NODE 8 --> 27.9351902 sigma out 1act.( 28.5908947 sig in 11act.) RANK 7 NODE 2 --> 21.1647377 sigma out 1act.( 20.8143921 sig in 11act.) RANK 8 NODE 7 --> 20.533102 sigma out 1act.( 19.9535789 sig in 11act.) RANK 9 NODE 6 --> 16.1757774 sigma out 1act.( 15.9621172 sig in 11act.) RANK 10 NODE 11 --> 15.6924524 sigma out 1act.( 14.1403046 sig in 11act.) RANK 11 NODE 14 --> 15.0094423 sigma out 1act.( 14.2176552 sig in 11act.) RANK 12 NODE 13 --> 12.2131462 sigma out 1act.( 12.6531181 sig in 11act.) RANK 13 NODE 4 --> 9.16857529 sigma out 1act.( 11.3682575 sig in 11act.) RANK 14 NODE 5 --> 7.03885555 sigma out 1act.( 7.53634405 sig in 11act.) RANK 15 NODE 1 --> 3.22673893 sigma out 1act.( 4.01847219 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 142.178894 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.558860838 *** contribution from regularisation: 0.00334437145 *** contribution from error: -0.562205195 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54649.3225 0.024331389 -15.1768761 EXIT FROM BFGS code FG_LNSRCH 0. 0.024331389 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.558857381 *** contribution from regularisation: 0.00334778125 *** contribution from error: -0.562205136 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54648.989 0.024331389 -15.1685705 EXIT FROM BFGS code NEW_X -54648.989 0.024331389 -15.1685705 ENTER BFGS code NEW_X -54648.989 0.024331389 -15.1685705 EXIT FROM BFGS code CONVERGENC -54648.989 0.024331389 -15.1685705 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 124.08786 sigma out 15 active outputs RANK 2 NODE 1 --> 71.2486572 sigma out 15 active outputs RANK 3 NODE 7 --> 65.2831802 sigma out 15 active outputs RANK 4 NODE 2 --> 65.1139755 sigma out 15 active outputs RANK 5 NODE 4 --> 54.3774643 sigma out 15 active outputs RANK 6 NODE 9 --> 47.3798637 sigma out 15 active outputs RANK 7 NODE 8 --> 38.6239128 sigma out 15 active outputs RANK 8 NODE 11 --> 35.9784126 sigma out 15 active outputs RANK 9 NODE 3 --> 30.468029 sigma out 15 active outputs RANK 10 NODE 5 --> 25.2468758 sigma out 15 active outputs RANK 11 NODE 6 --> 23.5032921 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 129.854523 sigma in 11act. ( 121.827194 sig out 1act.) RANK 2 NODE 9 --> 91.1626892 sigma in 11act. ( 107.074585 sig out 1act.) RANK 3 NODE 15 --> 64.8477097 sigma in 11act. ( 80.6626205 sig out 1act.) RANK 4 NODE 10 --> 48.1016998 sigma in 11act. ( 52.2313118 sig out 1act.) RANK 5 NODE 3 --> 42.2623062 sigma in 11act. ( 44.5078278 sig out 1act.) RANK 6 NODE 8 --> 41.9276772 sigma in 11act. ( 41.2876587 sig out 1act.) RANK 7 NODE 2 --> 30.416914 sigma in 11act. ( 30.8994522 sig out 1act.) RANK 8 NODE 7 --> 28.9519806 sigma in 11act. ( 31.1352596 sig out 1act.) RANK 9 NODE 6 --> 22.8960991 sigma in 11act. ( 24.1898556 sig out 1act.) RANK 10 NODE 11 --> 20.484457 sigma in 11act. ( 23.3418293 sig out 1act.) RANK 11 NODE 14 --> 20.3986664 sigma in 11act. ( 22.121006 sig out 1act.) RANK 12 NODE 13 --> 18.1175556 sigma in 11act. ( 17.9972534 sig out 1act.) RANK 13 NODE 4 --> 16.0449677 sigma in 11act. ( 13.2367945 sig out 1act.) RANK 14 NODE 5 --> 10.511981 sigma in 11act. ( 10.2061205 sig out 1act.) RANK 15 NODE 1 --> 5.15818262 sigma in 11act. ( 4.78012848 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 121.827194 sigma out 1act.( 129.854523 sig in 11act.) RANK 2 NODE 9 --> 107.074585 sigma out 1act.( 91.1626892 sig in 11act.) RANK 3 NODE 15 --> 80.6626205 sigma out 1act.( 64.8477097 sig in 11act.) RANK 4 NODE 10 --> 52.2313118 sigma out 1act.( 48.1016998 sig in 11act.) RANK 5 NODE 3 --> 44.5078278 sigma out 1act.( 42.2623062 sig in 11act.) RANK 6 NODE 8 --> 41.2876587 sigma out 1act.( 41.9276772 sig in 11act.) RANK 7 NODE 7 --> 31.1352596 sigma out 1act.( 28.9519806 sig in 11act.) RANK 8 NODE 2 --> 30.8994522 sigma out 1act.( 30.416914 sig in 11act.) RANK 9 NODE 6 --> 24.1898556 sigma out 1act.( 22.8960991 sig in 11act.) RANK 10 NODE 11 --> 23.3418293 sigma out 1act.( 20.484457 sig in 11act.) RANK 11 NODE 14 --> 22.121006 sigma out 1act.( 20.3986664 sig in 11act.) RANK 12 NODE 13 --> 17.9972534 sigma out 1act.( 18.1175556 sig in 11act.) RANK 13 NODE 4 --> 13.2367945 sigma out 1act.( 16.0449677 sig in 11act.) RANK 14 NODE 5 --> 10.2061205 sigma out 1act.( 10.511981 sig in 11act.) RANK 15 NODE 1 --> 4.78012848 sigma out 1act.( 5.15818262 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 208.318649 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.558859289 *** contribution from regularisation: 0.00334588531 *** contribution from error: -0.562205195 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30761 Closing output file done