NNInput NNInputs_120.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 80561 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 21871 nbkg = 58690 Bkg Entries: 58690 Sig Entries: 21871 Chosen entries: 21871 Signal fraction: 1 Background fraction: 0.372653 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 58690 Actual Signal Entries: 21871 Entries to split: 21871 Test with : 10935 Train with : 10935 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 21871 for Signal Prepared event 0 for Signal with 21871 events ====Entry 0 Variable Ht : 133.536 Variable LepAPt : 46.0413 Variable LepBPt : 26.8314 Variable MetSigLeptonsJets : 4.74809 Variable MetSpec : 36.4934 Variable SumEtLeptonsJets : 88.7944 Variable VSumJetLeptonsPt : 62.7074 Variable addEt : 117.615 Variable dPhiLepSumMet : 3.02894 Variable dPhiLeptons : 0.30213 Variable dRLeptons : 0.319689 Variable lep1_E : 46.8686 Variable lep2_E : 27.998 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2120 Ht = 133.536 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 46.0413 LepAPt = 46.0413 LepBEt = 26.8317 LepBPt = 26.8314 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.7416 MetDelPhi = 0.953851 MetSig = 2.83595 MetSigLeptonsJets = 4.74808 MetSpec = 36.4934 Mjj = 0 MostCentralJetEta = -0.917012 MtllMet = 118.428 Njets = 1 SB = 0 SumEt = 248.901 SumEtJets = 0 SumEtLeptonsJets = 88.7944 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 62.7074 addEt = 117.615 dPhiLepSumMet = 3.02894 dPhiLeptons = 0.30213 dRLeptons = 0.319689 diltype = 47 dimass = 11.201 event = 314 jet1_Et = 15.9217 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 46.8686 lep2_E = 27.998 rand = 0.999742 run = 232436 weight = 1.11491e-06 ===Show End Prepared event 10000 for Signal with 21871 events Prepared event 20000 for Signal with 21871 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 58690 for Background Prepared event 0 for Background with 58690 events ====Entry 0 Variable Ht : 65.1543 Variable LepAPt : 20.8407 Variable LepBPt : 10.82 Variable MetSigLeptonsJets : 5.95247 Variable MetSpec : 33.4933 Variable SumEtLeptonsJets : 31.6607 Variable VSumJetLeptonsPt : 31.4507 Variable addEt : 65.1543 Variable dPhiLepSumMet : 3.01433 Variable dPhiLeptons : 0.243032 Variable dRLeptons : 0.763155 Variable lep1_E : 24.0883 Variable lep2_E : 10.9808 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 65.1543 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 20.8411 LepAPt = 20.8407 LepBEt = 10.82 LepBPt = 10.82 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 33.4933 MetDelPhi = 2.93145 MetSig = 3.89076 MetSigLeptonsJets = 5.95247 MetSpec = 33.4933 Mjj = 0 MostCentralJetEta = 0 MtllMet = 67.7985 Njets = 0 SB = 0 SumEt = 74.1048 SumEtJets = 0 SumEtLeptonsJets = 31.6607 Target = 0 TrainWeight = 1.08535 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 31.4507 addEt = 65.1543 dPhiLepSumMet = 3.01433 dPhiLeptons = 0.243032 dRLeptons = 0.763155 diltype = 110 dimass = 11.6846 event = 12144548 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 24.0883 lep2_E = 10.9808 rand = 0.999742 run = 272126 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 58690 events Prepared event 20000 for Background with 58690 events Prepared event 30000 for Background with 58690 events Prepared event 40000 for Background with 58690 events Prepared event 50000 for Background with 58690 events Warning: found 1950 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 80561 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 1950 negative weights. Signal fraction: 63.4542923 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 60.3244629 63.4237633 65.3153992 66.7539978 67.9347 68.7411346 69.5694427 70.580368 71.3913269 72.1997375 73.1461182 73.8321686 74.3488159 75.0713348 75.5509949 76.1716461 76.9355621 77.4184113 78.033905 78.579895 79.2387161 79.7809143 80.4056549 81.1117859 81.6476135 82.3096313 82.8065643 83.5631104 84.3522034 85.2010956 85.9826965 86.7231598 87.7941284 88.7778702 89.9337769 90.9049759 91.9532776 92.9101715 94.1042328 95.201004 96.222702 97.1999817 98.1304321 99.0636902 100.039993 100.983757 102.000732 102.999481 103.914291 104.853996 105.742645 106.695526 107.535675 108.347794 109.079315 110.135994 111.007965 111.89624 112.798721 113.645157 114.592728 115.529312 116.853279 117.961197 119.044388 120.251747 121.572441 122.940269 124.515244 126.240387 128.015259 129.47171 131.212128 132.707031 134.462616 136.503998 138.3479 140.037872 141.888885 143.724045 145.667542 147.932404 150.351517 152.584778 155.204987 158.278229 161.6763 165.213821 169.042053 173.497681 178.00592 183.159424 189.200119 196.646271 204.772522 215.312805 230.37262 250.439651 290.118469 721.042175 ------------------------------ Transdef: Tab for variable 3 20.0001068 20.2262287 20.4478645 20.6682243 20.8993206 21.0837841 21.2717743 21.423111 21.6392479 21.882 22.0171165 22.2087479 22.4317589 22.5967064 22.791069 23.0317917 23.2037849 23.3575935 23.5626469 23.7337017 23.9283276 24.101141 24.2842484 24.4925232 24.6825256 24.886879 25.094696 25.2845726 25.4546337 25.669384 25.848732 25.9916496 26.2095757 26.385952 26.5936508 26.8147678 27.0253372 27.2281361 27.4700603 27.6969337 27.8957653 28.1410065 28.3502693 28.5854721 28.7947731 28.9930134 29.1949234 29.404705 29.7010994 29.989481 30.2194424 30.4678192 30.7046032 30.9977684 31.2732544 31.5424614 31.7991524 32.0690842 32.3171806 32.5510788 32.8037415 33.0782089 33.33992 33.6644897 33.9350662 34.2066345 34.5195847 34.848629 35.1583252 35.5099106 35.8546524 36.2499619 36.5839157 36.908783 37.3186646 37.691658 38.0989876 38.5679321 39.0263901 39.4485092 39.8474541 40.3877945 40.8884964 41.4079475 41.9808693 42.5861359 43.2759438 44.0010071 44.7913322 45.674881 46.6168518 47.6464424 48.9083862 50.3931618 51.7592316 54.1521149 56.7232819 60.516201 65.0761871 73.3859787 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.0749588 10.1798725 10.2905197 10.4202385 10.5275116 10.633234 10.7250137 10.8311405 10.9241676 11.0238419 11.0911369 11.2045746 11.2958603 11.3936644 11.4955072 11.5911617 11.7124424 11.8468227 11.9740915 12.080864 12.1853056 12.294775 12.4006891 12.5357208 12.6364269 12.7465496 12.8588619 12.9618111 13.083004 13.2234316 13.3432951 13.4588623 13.5859547 13.7336826 13.9082012 14.0417671 14.124403 14.2389984 14.3735275 14.5017681 14.6435165 14.7707233 14.8976765 15.0581722 15.2337856 15.3862534 15.5333376 15.671463 15.8212967 15.9479656 16.091917 16.2574482 16.4083786 16.5619793 16.7419128 16.9024601 17.0934849 17.2587242 17.426897 17.5941372 17.7435188 17.9679127 18.193779 18.3799934 18.5628395 18.7608223 18.9254284 19.1236267 19.3439083 19.5838051 19.7900925 20.0222263 20.2514858 20.459938 20.6954403 20.8758202 21.1264648 21.3473282 21.5982437 21.8579979 22.1752014 22.4312458 22.742609 23.0603695 23.3666115 23.7446747 24.1382866 24.55299 25.0229187 25.4270401 25.9383698 26.5292549 27.0939293 27.8334084 28.7881927 29.9116859 31.2328491 33.4736023 37.4050903 67.9286346 ------------------------------ Transdef: Tab for variable 5 1.06199944 1.96124554 2.32470655 2.56316233 2.77163839 2.93737555 3.0880177 3.25345659 3.40491056 3.54334664 3.66841936 3.78883266 3.90512276 4.01326561 4.11715317 4.21446466 4.32151604 4.42246914 4.51874304 4.60046482 4.69681883 4.76800823 4.83098888 4.91916084 4.98784304 5.04868793 5.11637592 5.17917156 5.23747158 5.29326248 5.33059502 5.39628029 5.45236683 5.50262213 5.54598045 5.59108257 5.63718271 5.67503071 5.71502495 5.76281166 5.81020784 5.85016966 5.89022732 5.92907667 5.96740961 6.00230694 6.03319645 6.06729889 6.10056496 6.13476467 6.16760302 6.20436382 6.24190569 6.28243065 6.31796741 6.35315037 6.39155483 6.42608166 6.46635723 6.50949049 6.54397011 6.58730316 6.61702728 6.65043449 6.68122959 6.71712112 6.75244713 6.78704262 6.82919598 6.87288618 6.91929626 6.97150612 7.01117039 7.06059551 7.10397339 7.14648342 7.19185257 7.24172306 7.28579426 7.335917 7.39202595 7.4427824 7.49467564 7.55603981 7.62131882 7.68953419 7.76127815 7.83532047 7.90610504 7.99462461 8.09191132 8.18375397 8.29526901 8.40673637 8.54792786 8.68575287 8.87711811 9.1319046 9.44283867 10.0031948 18.5645885 ------------------------------ Transdef: Tab for variable 6 15.0119476 16.3832035 18.0307541 19.5289421 20.8209114 22.6077423 23.7721405 24.9797688 25.8797703 26.9490051 27.6845188 28.4242287 29.268959 29.8892479 30.5676708 31.0223694 31.6917877 32.1236115 32.5748596 33.0015984 33.467308 33.8579559 34.2248688 34.6729736 35.0063477 35.3171539 35.6625099 35.937973 36.3030701 36.5899963 36.903923 37.2706909 37.5545883 37.8360062 38.2265816 38.5035934 38.8210678 39.1443138 39.4316864 39.6788979 39.9618263 40.2749252 40.530899 40.8431396 41.2385826 41.553978 41.8807373 42.2331924 42.6546516 43.0094109 43.3902893 43.7161636 44.0857277 44.4674339 44.919529 45.2924995 45.7287216 46.1508942 46.5906143 47.0545311 47.6032791 48.0354042 48.4751053 48.9177818 49.4120369 49.7825584 50.2040596 50.6631927 51.0926552 51.5217514 51.9361572 52.4716225 52.9985924 53.5452957 54.0382309 54.6407814 55.2154694 55.7009506 56.2329025 56.8288994 57.4457016 58.0093002 58.651413 59.3429337 60.051796 60.8385696 61.7239151 62.6237869 63.7519455 64.8293915 66.2366333 67.5841827 69.0151672 70.9590607 72.8740082 74.9824677 77.8319092 81.337471 87.5486908 95.5414581 214.544067 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.1338882 33.0578613 33.744091 34.3833771 34.9347992 35.3828545 35.8036995 36.1272888 36.4553108 36.8350945 37.2982483 37.5146866 37.8101273 38.0580215 38.4021072 38.7624893 39.0757446 39.2571259 39.5059814 39.7482185 40.1059418 40.3870697 40.6802292 40.9763565 41.2894135 41.6175537 42.1163788 42.5204811 42.9649506 43.4795532 43.9353104 44.4719009 44.9938889 45.4666138 46.1255875 46.6857109 47.2537003 47.8189011 48.4258499 49.0134277 49.6040344 50.2506485 50.8323746 51.4426956 52.0725288 52.7755051 53.3776245 54.0033798 54.5592957 55.1798477 55.7660217 56.310379 56.8902855 57.5395432 58.2214012 58.9372787 59.6826973 60.5264893 61.2968445 62.2274551 63.3122025 64.4361572 65.6575089 66.7758255 67.892128 69.1591415 70.6117172 71.8262024 73.0550232 74.2820511 75.4998703 76.9949036 78.367218 79.778717 81.2743607 82.8448334 84.6965027 86.4905243 88.4046783 90.5110931 92.500351 94.4315262 96.9049683 98.9780045 101.415298 104.15313 107.270065 110.349091 113.264099 116.703445 120.98848 125.207489 131.178375 138.030792 146.412872 156.449753 167.367828 184.149261 212.243149 499.137787 ------------------------------ Transdef: Tab for variable 8 1.96929502 17.0978394 21.6920776 24.703228 27.328907 29.2326393 30.4190559 31.3487396 31.9280701 32.4475708 32.9496536 33.3633232 33.7852173 34.2171478 34.6411247 34.9836807 35.2055206 35.4787674 35.7575531 36.0388565 36.3115768 36.5827484 36.893898 37.1786308 37.3625526 37.5852699 37.8817139 38.1549454 38.4418259 38.6428146 38.8508911 39.0581589 39.2740021 39.5152512 39.7420998 40.067421 40.2749214 40.454586 40.7613335 40.9778595 41.2934952 41.5780792 41.8615761 42.2206345 42.6272659 42.9641342 43.3064117 43.704483 44.032959 44.448204 44.8327637 45.1853333 45.5896378 45.9953308 46.4441528 46.8066559 47.2514038 47.6945076 48.1210175 48.5377502 48.9740295 49.4361267 49.7933311 50.2364159 50.6876869 51.0440063 51.5161858 51.9520721 52.4544907 52.8739624 53.3474426 53.7798691 54.252861 54.7579803 55.2083397 55.6606216 56.1429138 56.6788139 57.2191544 57.8351288 58.3985214 59.0759544 59.7524643 60.5301743 61.2587128 62.1201286 63.1130295 64.0602875 65.1543274 66.4246521 67.664978 69.2445679 70.8256073 72.8319244 75.1092072 77.6830826 81.7587891 86.1333771 91.8396149 104.459183 230.44165 ------------------------------ Transdef: Tab for variable 9 47.1748543 58.3412552 61.8595467 63.7142792 65.2534866 66.3851318 67.3697128 68.2305603 68.9945679 69.730545 70.4612885 71.2879333 71.9922104 72.7998352 73.4996109 74.0244751 74.4695587 75.0447693 75.5031128 76.0084229 76.4552155 77.0197754 77.4537964 78.0119629 78.4673004 78.8762207 79.4754791 79.9598007 80.4248962 81.0009613 81.4953308 81.9651489 82.456543 82.8890991 83.4230423 84.0054626 84.6593704 85.2029953 85.9137726 86.4172821 87.1275177 87.8729935 88.6146088 89.3280334 90.1128311 90.8933105 91.6130066 92.2735291 92.8836517 93.6396942 94.3735657 95.1660156 96.000061 96.7476196 97.4209595 98.0839539 98.7210083 99.5157089 100.166801 100.913513 101.67337 102.459999 103.175667 103.913643 104.624283 105.280991 105.948418 106.647644 107.410614 108.068474 108.713608 109.416229 110.065605 110.664993 111.359222 112.046799 112.724854 113.425423 114.150864 114.898819 115.726212 116.626823 117.463333 118.367294 119.225021 120.261635 121.360153 122.539001 123.67514 125.17955 127.030846 129.031998 130.899414 133.229553 136.588501 140.189697 145.278046 151.327759 161.592621 178.96936 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.873288393 1.11377144 1.30246627 1.44880235 1.58053756 1.69070256 1.78429973 1.85783184 1.93629074 2.00951385 2.07376766 2.13677502 2.19562578 2.24419403 2.28975296 2.33061647 2.36432528 2.40505171 2.4393611 2.47420073 2.50154114 2.52644467 2.55358672 2.57683206 2.60366464 2.62719011 2.65240836 2.67709112 2.69987202 2.71852636 2.7386992 2.75819588 2.77635717 2.79307079 2.80895925 2.82271004 2.83567214 2.84980679 2.86062765 2.87112141 2.88103557 2.89288807 2.90141368 2.91196537 2.92176604 2.92851639 2.93712354 2.9459579 2.95396519 2.95962596 2.96669388 2.97285175 2.97878551 2.98482966 2.99048805 2.99530077 2.99975777 3.00465345 3.00930858 3.01440001 3.01832914 3.02296948 3.02718282 3.03073025 3.03455901 3.03937769 3.04327106 3.04701376 3.05022097 3.054317 3.05708313 3.06051826 3.06432939 3.06810975 3.07188654 3.07557058 3.07855225 3.08157754 3.08432865 3.08747888 3.09011102 3.09336472 3.09647226 3.09942055 3.10210323 3.1048398 3.10719538 3.10995126 3.11279726 3.11521578 3.11867785 3.12091541 3.12361622 3.12602425 3.12890363 3.13135052 3.13379335 3.13643742 3.13858891 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.85966492E-05 0.00581550598 0.0105459392 0.0164829511 0.0220384896 0.0282054543 0.0348463058 0.0423862934 0.0505108759 0.0571780726 0.0647398233 0.0733160377 0.0803308487 0.0876309872 0.0944440216 0.100502729 0.106503025 0.114474118 0.121561229 0.129221559 0.136050701 0.142679304 0.149684072 0.155810893 0.162941575 0.169801652 0.175756291 0.17952916 0.186175913 0.191302896 0.196604729 0.202101588 0.206967354 0.21193409 0.217311502 0.222343445 0.227962613 0.23263216 0.23708725 0.242122144 0.247320086 0.253278136 0.258144379 0.263475209 0.269976377 0.273634434 0.278491467 0.284103334 0.288877249 0.294169664 0.299354464 0.305243373 0.311493754 0.316436172 0.32229054 0.328481197 0.334762335 0.340265363 0.346910357 0.352279663 0.357939005 0.365041733 0.37148276 0.378531098 0.384760857 0.390435845 0.395890564 0.402965724 0.410579443 0.416620374 0.42276001 0.429615617 0.436608344 0.442260563 0.448308229 0.455884159 0.464239836 0.470719397 0.478723288 0.487158775 0.495398045 0.504886985 0.513497829 0.523186862 0.531491399 0.54037714 0.549772024 0.56316483 0.574726582 0.586431682 0.59911859 0.611306548 0.62757504 0.645829916 0.66338551 0.679305613 0.70138979 0.732871115 0.773825943 0.826398432 1.11372733 ------------------------------ Transdef: Tab for variable 12 0.20009917 0.209498346 0.218212217 0.225908577 0.232879147 0.23990792 0.248133779 0.25521785 0.26172179 0.268226027 0.273788393 0.280116171 0.286486119 0.293957978 0.299681664 0.306334138 0.312769294 0.318358243 0.323362648 0.330001622 0.335479558 0.340449989 0.346670389 0.353588343 0.360332042 0.365605175 0.371813595 0.377273083 0.383777797 0.388984829 0.393735111 0.398542166 0.403523088 0.408246338 0.413095504 0.418204606 0.422764242 0.42698288 0.432123661 0.436498284 0.440601051 0.445404053 0.450241625 0.454362214 0.45838666 0.462771386 0.467227757 0.470318556 0.475177944 0.479640365 0.483608395 0.489136815 0.49444142 0.498509109 0.502589464 0.507377148 0.511379361 0.515474319 0.51985687 0.525294304 0.530241489 0.53603977 0.540468454 0.546149254 0.551579714 0.556187391 0.561756194 0.566392004 0.571218491 0.577036381 0.583192885 0.587990463 0.593312979 0.598609269 0.604771972 0.611201167 0.617066145 0.621781945 0.628131747 0.634217858 0.640425324 0.648035169 0.656783283 0.664726615 0.673254073 0.680195093 0.689493299 0.698354006 0.705494225 0.714720547 0.728950977 0.738990963 0.752354622 0.76326704 0.776988745 0.793952763 0.815178037 0.83901453 0.869953215 0.904897928 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.1632423 21.6881065 22.2522354 22.6256676 23.1929398 23.488987 23.8179665 24.2313004 24.6483154 25.0064392 25.4024429 25.6838932 25.9808693 26.2950535 26.6268654 26.9499321 27.2433739 27.5503044 27.8119392 28.1139297 28.3401985 28.6040077 28.8281898 29.1014595 29.3695335 29.6977501 30.019331 30.3117943 30.5558434 30.8170948 31.0973816 31.3777657 31.6632099 31.915617 32.1582947 32.4160614 32.7269974 32.9892387 33.2914505 33.55513 33.8620071 34.1434937 34.4611435 34.7219543 35.0780029 35.3866119 35.7245789 36.0180359 36.3041191 36.6502609 36.9466896 37.3079071 37.6268616 37.9519463 38.2171898 38.5765877 38.9597778 39.2942429 39.6554909 39.988884 40.3972702 40.808609 41.2464523 41.6922989 42.158989 42.6205215 42.9737015 43.3635788 43.9147148 44.4568939 44.9844894 45.4643593 45.9991989 46.599617 47.1969147 47.8079758 48.5057678 49.1115341 49.8389053 50.578064 51.4119263 52.195549 52.9656868 54.0688934 55.1595802 56.1548729 57.290062 58.5221939 60.1990623 61.846386 63.5486984 65.9526367 68.110939 70.7183075 74.3689728 77.6575546 82.6375427 89.9825821 101.399017 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0114679 10.4894333 10.8446379 11.0861273 11.3379459 11.5848503 11.8306465 12.0662336 12.2972775 12.4754133 12.6479263 12.840538 13.0083017 13.1699677 13.3222313 13.5009193 13.6752148 13.8618517 14.0047283 14.1777601 14.3592434 14.5432434 14.6908493 14.8626757 15.0235567 15.1999092 15.3579865 15.5387239 15.731452 15.9405708 16.0786171 16.2558327 16.4084015 16.5965195 16.7801056 16.958725 17.1445084 17.3646564 17.5002441 17.7025433 17.8880005 18.0657558 18.2435837 18.4586411 18.6355705 18.8178139 19.0040569 19.1664124 19.3349991 19.5577106 19.7830849 19.9755592 20.1575508 20.3654881 20.6120472 20.8417969 21.0446053 21.3111305 21.5227127 21.7482662 21.9789658 22.2159615 22.434185 22.6823616 22.931488 23.1718445 23.4085464 23.7155838 23.9680214 24.2376328 24.4618263 24.7591171 25.0812416 25.4012165 25.741539 26.0349388 26.3582687 26.7205811 27.0718994 27.4280014 27.7629299 28.1420708 28.5427399 29.0032387 29.4730072 29.9948311 30.6277885 31.1984825 31.7815685 32.5426483 33.338768 34.0558014 35.0145073 36.0123024 37.3102112 39.110672 40.9056549 43.3333435 46.2745972 54.2447968 115.645821 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 54.5 42.6 27.9 2.6 24.9 54.2 34.3 47.6 -32.9 0.1 -10.4 24.7 10.5 2 54.5 100.0 66.2 48.2 9.7 49.0 94.0 56.0 87.4 -51.8 -13.3 -30.2 46.9 29.9 3 42.6 66.2 100.0 26.5 -9.6 18.9 69.5 41.8 69.5 -22.9 -15.2 -34.4 76.6 14.1 4 27.9 48.2 26.5 100.0 -1.8 17.8 49.3 32.4 52.5 -14.4 -16.1 -36.3 18.8 77.6 5 2.6 9.7 -9.6 -1.8 100.0 81.6 -18.8 48.0 42.5 36.1 2.7 5.1 -12.1 -4.5 6 24.9 49.0 18.9 17.8 81.6 100.0 24.7 72.1 70.4 4.3 -1.8 -7.4 9.2 8.3 7 54.2 94.0 69.5 49.3 -18.8 24.7 100.0 45.9 73.2 -59.8 -12.9 -30.8 51.1 31.7 8 34.3 56.0 41.8 32.4 48.0 72.1 45.9 100.0 73.3 -2.7 -9.8 -20.2 28.4 19.7 9 47.6 87.4 69.5 52.5 42.5 70.4 73.2 73.3 100.0 -21.4 -14.7 -33.4 49.5 33.8 10 -32.9 -51.8 -22.9 -14.4 36.1 4.3 -59.8 -2.7 -21.4 100.0 3.4 8.2 -15.9 -7.5 11 0.1 -13.3 -15.2 -16.1 2.7 -1.8 -12.9 -9.8 -14.7 3.4 100.0 53.1 -11.6 -14.9 12 -10.4 -30.2 -34.4 -36.3 5.1 -7.4 -30.8 -20.2 -33.4 8.2 53.1 100.0 -19.7 -18.7 13 24.7 46.9 76.6 18.8 -12.1 9.2 51.1 28.4 49.5 -15.9 -11.6 -19.7 100.0 34.2 14 10.5 29.9 14.1 77.6 -4.5 8.3 31.7 19.7 33.8 -7.5 -14.9 -18.7 34.2 100.0 TOTAL CORRELATION TO TARGET (diagonal) 120.321713 TOTAL CORRELATION OF ALL VARIABLES 59.2326105 ROUND 1: MAX CORR ( 59.2209122) AFTER KILLING INPUT VARIABLE 6 CONTR 1.17715992 ROUND 2: MAX CORR ( 59.1543879) AFTER KILLING INPUT VARIABLE 11 CONTR 2.80621292 ROUND 3: MAX CORR ( 59.0427006) AFTER KILLING INPUT VARIABLE 13 CONTR 3.63333378 ROUND 4: MAX CORR ( 58.933944) AFTER KILLING INPUT VARIABLE 7 CONTR 3.58200178 ROUND 5: MAX CORR ( 58.4993681) AFTER KILLING INPUT VARIABLE 5 CONTR 7.1437863 ROUND 6: MAX CORR ( 58.3475721) AFTER KILLING INPUT VARIABLE 9 CONTR 4.21152063 ROUND 7: MAX CORR ( 57.9766873) AFTER KILLING INPUT VARIABLE 8 CONTR 6.56832535 ROUND 8: MAX CORR ( 57.4704238) AFTER KILLING INPUT VARIABLE 10 CONTR 7.64504101 ROUND 9: MAX CORR ( 56.433847) AFTER KILLING INPUT VARIABLE 3 CONTR 10.8660264 ROUND 10: MAX CORR ( 55.741536) AFTER KILLING INPUT VARIABLE 12 CONTR 8.81250514 ROUND 11: MAX CORR ( 54.8576533) AFTER KILLING INPUT VARIABLE 4 CONTR 9.88719964 ROUND 12: MAX CORR ( 54.5194744) AFTER KILLING INPUT VARIABLE 14 CONTR 6.08186124 LAST REMAINING VARIABLE: 2 total correlation to target: 59.2326105 % total significance: 77.7534897 sigma correlations of single variables to target: variable 2: 54.5194744 % , in sigma: 71.5666481 variable 3: 42.5754428 % , in sigma: 55.8879513 variable 4: 27.9375975 % , in sigma: 36.673138 variable 5: 2.56279476 % , in sigma: 3.36413057 variable 6: 24.8830495 % , in sigma: 32.6634925 variable 7: 54.1556569 % , in sigma: 71.0890719 variable 8: 34.3039872 % , in sigma: 45.0301733 variable 9: 47.5729763 % , in sigma: 62.4481159 variable 10: -32.9433092 % , in sigma: 43.2440379 variable 11: 0.134443339 % , in sigma: 0.176481142 variable 12: -10.4347586 % , in sigma: 13.6975036 variable 13: 24.6818022 % , in sigma: 32.3993191 variable 14: 10.4827408 % , in sigma: 13.7604889 variables sorted by significance: 1 most relevant variable 2 corr 54.519474 , in sigma: 71.5666476 2 most relevant variable 14 corr 6.08186102 , in sigma: 7.98354005 3 most relevant variable 4 corr 9.8871994 , in sigma: 12.9787333 4 most relevant variable 12 corr 8.81250477 , in sigma: 11.5680027 5 most relevant variable 3 corr 10.8660269 , in sigma: 14.263621 6 most relevant variable 10 corr 7.64504099 , in sigma: 10.0354958 7 most relevant variable 8 corr 6.56832552 , in sigma: 8.62211249 8 most relevant variable 9 corr 4.21152067 , in sigma: 5.52838084 9 most relevant variable 5 corr 7.14378643 , in sigma: 9.37750878 10 most relevant variable 7 corr 3.58200169 , in sigma: 4.70202358 11 most relevant variable 13 corr 3.63333368 , in sigma: 4.76940609 12 most relevant variable 11 corr 2.8062129 , in sigma: 3.68366081 13 most relevant variable 6 corr 1.17715991 , in sigma: 1.54523479 global correlations between input variables: variable 2: 99.0534182 % variable 3: 94.1048206 % variable 4: 90.8052219 % variable 5: 94.7404455 % variable 6: 93.3499637 % variable 7: 98.6590084 % variable 8: 84.6709769 % variable 9: 98.590519 % variable 10: 73.6955266 % variable 11: 55.0213062 % variable 12: 65.5340513 % variable 13: 86.1024864 % variable 14: 87.153242 % significance loss when removing single variables: variable 2: corr = 4.36959701 % , sigma = 5.73588457 variable 3: corr = 11.4100451 % , sigma = 14.9777431 variable 4: corr = 10.8561691 % , sigma = 14.250681 variable 5: corr = 7.37407044 % , sigma = 9.67979809 variable 6: corr = 1.17715992 % , sigma = 1.54523482 variable 7: corr = 3.4059335 % , sigma = 4.47090231 variable 8: corr = 5.55907845 % , sigma = 7.29729359 variable 9: corr = 6.35880775 % , sigma = 8.34708261 variable 10: corr = 7.92195391 % , sigma = 10.398994 variable 11: corr = 2.85748863 % , sigma = 3.75096945 variable 12: corr = 7.26612899 % , sigma = 9.53810547 variable 13: corr = 3.68528572 % , sigma = 4.83760251 variable 14: corr = 7.12251184 % , sigma = 9.34958203 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 14.4251204 sigma out 15 active outputs RANK 2 NODE 7 --> 14.4246321 sigma out 15 active outputs RANK 3 NODE 6 --> 13.2691422 sigma out 15 active outputs RANK 4 NODE 10 --> 12.1849413 sigma out 15 active outputs RANK 5 NODE 4 --> 12.1788111 sigma out 15 active outputs RANK 6 NODE 3 --> 11.458065 sigma out 15 active outputs RANK 7 NODE 2 --> 11.1565857 sigma out 15 active outputs RANK 8 NODE 11 --> 10.7941017 sigma out 15 active outputs RANK 9 NODE 1 --> 8.72214794 sigma out 15 active outputs RANK 10 NODE 5 --> 8.1069622 sigma out 15 active outputs RANK 11 NODE 12 --> 6.75350618 sigma out 15 active outputs RANK 12 NODE 9 --> 5.148314 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 20.4785309 sigma in 12act. ( 21.1362286 sig out 1act.) RANK 2 NODE 14 --> 19.4254322 sigma in 12act. ( 19.8445644 sig out 1act.) RANK 3 NODE 12 --> 17.0298805 sigma in 12act. ( 18.2669449 sig out 1act.) RANK 4 NODE 10 --> 12.6526136 sigma in 12act. ( 13.0412674 sig out 1act.) RANK 5 NODE 2 --> 7.65987873 sigma in 12act. ( 8.03912544 sig out 1act.) RANK 6 NODE 9 --> 7.23718834 sigma in 12act. ( 7.79410744 sig out 1act.) RANK 7 NODE 3 --> 5.28983688 sigma in 12act. ( 5.84697723 sig out 1act.) RANK 8 NODE 15 --> 5.10896587 sigma in 12act. ( 5.42324781 sig out 1act.) RANK 9 NODE 8 --> 4.22409296 sigma in 12act. ( 4.96495104 sig out 1act.) RANK 10 NODE 5 --> 4.09133768 sigma in 12act. ( 3.58276248 sig out 1act.) RANK 11 NODE 4 --> 3.56557727 sigma in 12act. ( 3.16868043 sig out 1act.) RANK 12 NODE 6 --> 2.50658703 sigma in 12act. ( 2.43830585 sig out 1act.) RANK 13 NODE 1 --> 2.41050005 sigma in 12act. ( 2.52135038 sig out 1act.) RANK 14 NODE 13 --> 1.69722283 sigma in 12act. ( 0.467895001 sig out 1act.) RANK 15 NODE 11 --> 0.988117933 sigma in 12act. ( 0.0820258856 sig out 1 act.) sorted by output significance RANK 1 NODE 7 --> 21.1362286 sigma out 1act.( 20.4785309 sig in 12act.) RANK 2 NODE 14 --> 19.8445644 sigma out 1act.( 19.4254322 sig in 12act.) RANK 3 NODE 12 --> 18.2669449 sigma out 1act.( 17.0298805 sig in 12act.) RANK 4 NODE 10 --> 13.0412674 sigma out 1act.( 12.6526136 sig in 12act.) RANK 5 NODE 2 --> 8.03912544 sigma out 1act.( 7.65987873 sig in 12act.) RANK 6 NODE 9 --> 7.79410744 sigma out 1act.( 7.23718834 sig in 12act.) RANK 7 NODE 3 --> 5.84697723 sigma out 1act.( 5.28983688 sig in 12act.) RANK 8 NODE 15 --> 5.42324781 sigma out 1act.( 5.10896587 sig in 12act.) RANK 9 NODE 8 --> 4.96495104 sigma out 1act.( 4.22409296 sig in 12act.) RANK 10 NODE 5 --> 3.58276248 sigma out 1act.( 4.09133768 sig in 12act.) RANK 11 NODE 4 --> 3.16868043 sigma out 1act.( 3.56557727 sig in 12act.) RANK 12 NODE 1 --> 2.52135038 sigma out 1act.( 2.41050005 sig in 12act.) RANK 13 NODE 6 --> 2.43830585 sigma out 1act.( 2.50658703 sig in 12act.) RANK 14 NODE 13 --> 0.467895001 sigma out 1act.( 1.69722283 sig in 12act.) RANK 15 NODE 11 --> 0.0820258856 sigma out 1act.( 0.988117933 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 39.9165726 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 15.7479687 sigma out 15 active outputs RANK 2 NODE 8 --> 15.2743521 sigma out 15 active outputs RANK 3 NODE 7 --> 14.8841972 sigma out 15 active outputs RANK 4 NODE 10 --> 14.1934385 sigma out 15 active outputs RANK 5 NODE 6 --> 14.1882219 sigma out 15 active outputs RANK 6 NODE 4 --> 13.1245117 sigma out 15 active outputs RANK 7 NODE 3 --> 12.977273 sigma out 15 active outputs RANK 8 NODE 2 --> 12.0839195 sigma out 15 active outputs RANK 9 NODE 1 --> 10.9017191 sigma out 15 active outputs RANK 10 NODE 5 --> 10.8717365 sigma out 15 active outputs RANK 11 NODE 9 --> 7.86599827 sigma out 15 active outputs RANK 12 NODE 12 --> 7.12439919 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 7 --> 20.1707821 sigma in 12act. ( 20.090456 sig out 1act.) RANK 2 NODE 14 --> 19.8170776 sigma in 12act. ( 19.6088428 sig out 1act.) RANK 3 NODE 12 --> 18.1430187 sigma in 12act. ( 18.1913261 sig out 1act.) RANK 4 NODE 10 --> 14.058836 sigma in 12act. ( 12.5508308 sig out 1act.) RANK 5 NODE 2 --> 11.0718203 sigma in 12act. ( 7.92153025 sig out 1act.) RANK 6 NODE 9 --> 9.5978899 sigma in 12act. ( 7.89425325 sig out 1act.) RANK 7 NODE 1 --> 8.62167645 sigma in 12act. ( 2.94568896 sig out 1act.) RANK 8 NODE 3 --> 8.55367947 sigma in 12act. ( 6.21096277 sig out 1act.) RANK 9 NODE 6 --> 7.39468431 sigma in 12act. ( 2.6817379 sig out 1act.) RANK 10 NODE 5 --> 7.15461731 sigma in 12act. ( 3.15435171 sig out 1act.) RANK 11 NODE 8 --> 6.72486305 sigma in 12act. ( 5.34414101 sig out 1act.) RANK 12 NODE 15 --> 6.64056444 sigma in 12act. ( 5.4895277 sig out 1act.) RANK 13 NODE 13 --> 5.32982874 sigma in 12act. ( 0.393906832 sig out 1act.) RANK 14 NODE 4 --> 4.3234396 sigma in 12act. ( 2.28832793 sig out 1act.) RANK 15 NODE 11 --> 3.32705235 sigma in 12act. ( 0.023116339 sig out 1act.) sorted by output significance RANK 1 NODE 7 --> 20.090456 sigma out 1act.( 20.1707821 sig in 12act.) RANK 2 NODE 14 --> 19.6088428 sigma out 1act.( 19.8170776 sig in 12act.) RANK 3 NODE 12 --> 18.1913261 sigma out 1act.( 18.1430187 sig in 12act.) RANK 4 NODE 10 --> 12.5508308 sigma out 1act.( 14.058836 sig in 12act.) RANK 5 NODE 2 --> 7.92153025 sigma out 1act.( 11.0718203 sig in 12act.) RANK 6 NODE 9 --> 7.89425325 sigma out 1act.( 9.5978899 sig in 12act.) RANK 7 NODE 3 --> 6.21096277 sigma out 1act.( 8.55367947 sig in 12act.) RANK 8 NODE 15 --> 5.4895277 sigma out 1act.( 6.64056444 sig in 12act.) RANK 9 NODE 8 --> 5.34414101 sigma out 1act.( 6.72486305 sig in 12act.) RANK 10 NODE 5 --> 3.15435171 sigma out 1act.( 7.15461731 sig in 12act.) RANK 11 NODE 1 --> 2.94568896 sigma out 1act.( 8.62167645 sig in 12act.) RANK 12 NODE 6 --> 2.6817379 sigma out 1act.( 7.39468431 sig in 12act.) RANK 13 NODE 4 --> 2.28832793 sigma out 1act.( 4.3234396 sig in 12act.) RANK 14 NODE 13 --> 0.393906832 sigma out 1act.( 5.32982874 sig in 12act.) RANK 15 NODE 11 --> 0.023116339 sigma out 1act.( 3.32705235 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 39.1169052 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.419971019 *** contribution from regularisation: 0.00788184535 *** contribution from error: -0.427852869 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.449770212 *** contribution from regularisation: 0.00480601052 *** contribution from error: -0.454576224 *********************************************** -----------------> Test sample ENTER BFGS code START -18120.7719 0.397227854 0.0408140607 EXIT FROM BFGS code FG_START 0. 0.397227854 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.462909162 *** contribution from regularisation: 0.00417071674 *** contribution from error: -0.467079878 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -18645.9806 0.397227854 62.3220215 EXIT FROM BFGS code FG_LNSRCH 0. 0.428411782 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.493507951 *** contribution from regularisation: 0.00563477445 *** contribution from error: -0.499142736 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -19878.5001 0.428411782 42.7901573 EXIT FROM BFGS code NEW_X -19878.5001 0.428411782 42.7901573 ENTER BFGS code NEW_X -19878.5001 0.428411782 42.7901573 EXIT FROM BFGS code FG_LNSRCH 0. 0.453148723 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.495989084 *** contribution from regularisation: 0.00598766329 *** contribution from error: -0.501976728 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -19978.4404 0.453148723 -15.7388144 EXIT FROM BFGS code NEW_X -19978.4404 0.453148723 -15.7388144 ENTER BFGS code NEW_X -19978.4404 0.453148723 -15.7388144 EXIT FROM BFGS code FG_LNSRCH 0. 0.445260584 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.496410757 *** contribution from regularisation: 0.00594325084 *** contribution from error: -0.502354026 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -19995.4252 0.445260584 -23.0303192 EXIT FROM BFGS code NEW_X -19995.4252 0.445260584 -23.0303192 ENTER BFGS code NEW_X -19995.4252 0.445260584 -23.0303192 EXIT FROM BFGS code FG_LNSRCH 0. 0.403960735 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.497103602 *** contribution from regularisation: 0.00561003713 *** contribution from error: -0.502713621 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20023.3329 0.403960735 -31.7434959 EXIT FROM BFGS code NEW_X -20023.3329 0.403960735 -31.7434959 ENTER BFGS code NEW_X -20023.3329 0.403960735 -31.7434959 EXIT FROM BFGS code FG_LNSRCH 0. 0.352308869 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.497910202 *** contribution from regularisation: 0.00543410191 *** contribution from error: -0.503344297 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20055.8226 0.352308869 -30.5362453 EXIT FROM BFGS code NEW_X -20055.8226 0.352308869 -30.5362453 ENTER BFGS code NEW_X -20055.8226 0.352308869 -30.5362453 EXIT FROM BFGS code FG_LNSRCH 0. -0.0835636631 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.498337179 *** contribution from regularisation: 0.00671591656 *** contribution from error: -0.505053103 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20073.0211 -0.0835636631 20.5074005 EXIT FROM BFGS code FG_LNSRCH 0. 0.163753107 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 24.2911339 sigma out 15 active outputs RANK 2 NODE 10 --> 15.8456764 sigma out 15 active outputs RANK 3 NODE 1 --> 14.7509212 sigma out 15 active outputs RANK 4 NODE 5 --> 10.5250006 sigma out 15 active outputs RANK 5 NODE 9 --> 9.57806301 sigma out 15 active outputs RANK 6 NODE 3 --> 8.81440353 sigma out 15 active outputs RANK 7 NODE 4 --> 7.60414171 sigma out 15 active outputs RANK 8 NODE 2 --> 7.58701611 sigma out 15 active outputs RANK 9 NODE 8 --> 6.03428555 sigma out 15 active outputs RANK 10 NODE 12 --> 5.92277622 sigma out 15 active outputs RANK 11 NODE 6 --> 5.90335464 sigma out 15 active outputs RANK 12 NODE 7 --> 3.55525446 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 19.0162582 sigma in 12act. ( 20.8650742 sig out 1act.) RANK 2 NODE 14 --> 18.1738091 sigma in 12act. ( 18.0726967 sig out 1act.) RANK 3 NODE 7 --> 14.7727633 sigma in 12act. ( 12.9567661 sig out 1act.) RANK 4 NODE 1 --> 11.3513155 sigma in 12act. ( 8.62518978 sig out 1act.) RANK 5 NODE 8 --> 10.5754309 sigma in 12act. ( 9.68381023 sig out 1act.) RANK 6 NODE 12 --> 10.3484821 sigma in 12act. ( 8.37527275 sig out 1act.) RANK 7 NODE 6 --> 9.58094025 sigma in 12act. ( 8.26189613 sig out 1act.) RANK 8 NODE 3 --> 8.79443932 sigma in 12act. ( 7.90476561 sig out 1act.) RANK 9 NODE 2 --> 7.68353987 sigma in 12act. ( 6.01574373 sig out 1act.) RANK 10 NODE 10 --> 6.65090656 sigma in 12act. ( 4.87723112 sig out 1act.) RANK 11 NODE 15 --> 4.77308035 sigma in 12act. ( 3.29480767 sig out 1act.) RANK 12 NODE 5 --> 2.98882103 sigma in 12act. ( 0.691446364 sig out 1act.) RANK 13 NODE 13 --> 2.4087739 sigma in 12act. ( 0.57412982 sig out 1act.) RANK 14 NODE 4 --> 1.76525223 sigma in 12act. ( 0.79486233 sig out 1act.) RANK 15 NODE 11 --> 1.53143489 sigma in 12act. ( 0.316171885 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 20.8650742 sigma out 1act.( 19.0162582 sig in 12act.) RANK 2 NODE 14 --> 18.0726967 sigma out 1act.( 18.1738091 sig in 12act.) RANK 3 NODE 7 --> 12.9567661 sigma out 1act.( 14.7727633 sig in 12act.) RANK 4 NODE 8 --> 9.68381023 sigma out 1act.( 10.5754309 sig in 12act.) RANK 5 NODE 1 --> 8.62518978 sigma out 1act.( 11.3513155 sig in 12act.) RANK 6 NODE 12 --> 8.37527275 sigma out 1act.( 10.3484821 sig in 12act.) RANK 7 NODE 6 --> 8.26189613 sigma out 1act.( 9.58094025 sig in 12act.) RANK 8 NODE 3 --> 7.90476561 sigma out 1act.( 8.79443932 sig in 12act.) RANK 9 NODE 2 --> 6.01574373 sigma out 1act.( 7.68353987 sig in 12act.) RANK 10 NODE 10 --> 4.87723112 sigma out 1act.( 6.65090656 sig in 12act.) RANK 11 NODE 15 --> 3.29480767 sigma out 1act.( 4.77308035 sig in 12act.) RANK 12 NODE 4 --> 0.79486233 sigma out 1act.( 1.76525223 sig in 12act.) RANK 13 NODE 5 --> 0.691446364 sigma out 1act.( 2.98882103 sig in 12act.) RANK 14 NODE 13 --> 0.57412982 sigma out 1act.( 2.4087739 sig in 12act.) RANK 15 NODE 11 --> 0.316171885 sigma out 1act.( 1.53143489 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 37.0308342 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.501731396 *** contribution from regularisation: 0.00426025689 *** contribution from error: -0.505991638 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -20209.7406 0.163753107 -19.9367123 EXIT FROM BFGS code NEW_X -20209.7406 0.163753107 -19.9367123 ENTER BFGS code NEW_X -20209.7406 0.163753107 -19.9367123 EXIT FROM BFGS code FG_LNSRCH 0. -0.183349118 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.490567625 *** contribution from regularisation: 0.00940189883 *** contribution from error: -0.499969512 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -19760.0644 -0.183349118 109.417847 EXIT FROM BFGS code FG_LNSRCH 0. 0.106266774 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.503422022 *** contribution from regularisation: 0.00368197728 *** contribution from error: -0.50710398 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20277.8382 0.106266774 -6.37677336 EXIT FROM BFGS code NEW_X -20277.8382 0.106266774 -6.37677336 ENTER BFGS code NEW_X -20277.8382 0.106266774 -6.37677336 EXIT FROM BFGS code FG_LNSRCH 0. 0.00427746307 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.50188452 *** contribution from regularisation: 0.00693938415 *** contribution from error: -0.508823931 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20215.9075 0.00427746307 14.9000549 EXIT FROM BFGS code FG_LNSRCH 0. 0.0945233181 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.502364278 *** contribution from regularisation: 0.00500408793 *** contribution from error: -0.507368386 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20235.2332 0.0945233181 -4.38623095 EXIT FROM BFGS code FG_LNSRCH 0. 0.105964392 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.50131613 *** contribution from regularisation: 0.00579505879 *** contribution from error: -0.507111192 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20193.0149 0.105964392 -6.24601793 EXIT FROM BFGS code FG_LNSRCH 0. 0.106266662 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.501491487 *** contribution from regularisation: 0.00561251538 *** contribution from error: -0.50710398 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20200.0762 0.106266662 -6.26234627 EXIT FROM BFGS code FG_LNSRCH 0. 0.106266774 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.50141108 *** contribution from regularisation: 0.00569288759 *** contribution from error: -0.50710398 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20196.8388 0.106266774 -6.21549463 EXIT FROM BFGS code FG_LNSRCH 0. 0.106266774 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.501450062 *** contribution from regularisation: 0.00565393735 *** contribution from error: -0.50710398 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20198.4077 0.106266774 -6.18364763 EXIT FROM BFGS code FG_LNSRCH 0. 0.106266774 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.50148195 *** contribution from regularisation: 0.00562204933 *** contribution from error: -0.50710398 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20199.6921 0.106266774 -6.13494587 EXIT FROM BFGS code NEW_X -20199.6921 0.106266774 -6.13494587 ENTER BFGS code NEW_X -20199.6921 0.106266774 -6.13494587 EXIT FROM BFGS code CONVERGENC -20199.6921 0.106266774 -6.13494587 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 37.0303459 sigma out 15 active outputs RANK 2 NODE 10 --> 24.093668 sigma out 15 active outputs RANK 3 NODE 1 --> 22.1101475 sigma out 15 active outputs RANK 4 NODE 5 --> 15.6920595 sigma out 15 active outputs RANK 5 NODE 9 --> 14.6094713 sigma out 15 active outputs RANK 6 NODE 3 --> 11.9829102 sigma out 15 active outputs RANK 7 NODE 4 --> 11.7830105 sigma out 15 active outputs RANK 8 NODE 2 --> 10.0815401 sigma out 15 active outputs RANK 9 NODE 12 --> 9.67157745 sigma out 15 active outputs RANK 10 NODE 8 --> 8.62287807 sigma out 15 active outputs RANK 11 NODE 6 --> 7.12656164 sigma out 15 active outputs RANK 12 NODE 7 --> 3.69988322 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 30.074295 sigma in 12act. ( 34.5427208 sig out 1act.) RANK 2 NODE 14 --> 28.5682106 sigma in 12act. ( 29.605608 sig out 1act.) RANK 3 NODE 7 --> 21.5446682 sigma in 12act. ( 18.9601498 sig out 1act.) RANK 4 NODE 8 --> 17.0297661 sigma in 12act. ( 16.9399185 sig out 1act.) RANK 5 NODE 1 --> 15.872076 sigma in 12act. ( 13.2236271 sig out 1act.) RANK 6 NODE 6 --> 14.6303606 sigma in 12act. ( 13.3390455 sig out 1act.) RANK 7 NODE 12 --> 13.7399559 sigma in 12act. ( 11.4924164 sig out 1act.) RANK 8 NODE 3 --> 12.2138615 sigma in 12act. ( 11.3323298 sig out 1act.) RANK 9 NODE 2 --> 10.3938494 sigma in 12act. ( 8.65283108 sig out 1act.) RANK 10 NODE 10 --> 8.74156952 sigma in 12act. ( 6.60379267 sig out 1act.) RANK 11 NODE 15 --> 5.79184151 sigma in 12act. ( 4.02126884 sig out 1act.) RANK 12 NODE 5 --> 2.80405998 sigma in 12act. ( 0.387337685 sig out 1act.) RANK 13 NODE 13 --> 2.5038476 sigma in 12act. ( 1.18585503 sig out 1act.) RANK 14 NODE 4 --> 1.91645026 sigma in 12act. ( 1.19517517 sig out 1act.) RANK 15 NODE 11 --> 1.48346984 sigma in 12act. ( 0.37291041 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 34.5427208 sigma out 1act.( 30.074295 sig in 12act.) RANK 2 NODE 14 --> 29.605608 sigma out 1act.( 28.5682106 sig in 12act.) RANK 3 NODE 7 --> 18.9601498 sigma out 1act.( 21.5446682 sig in 12act.) RANK 4 NODE 8 --> 16.9399185 sigma out 1act.( 17.0297661 sig in 12act.) RANK 5 NODE 6 --> 13.3390455 sigma out 1act.( 14.6303606 sig in 12act.) RANK 6 NODE 1 --> 13.2236271 sigma out 1act.( 15.872076 sig in 12act.) RANK 7 NODE 12 --> 11.4924164 sigma out 1act.( 13.7399559 sig in 12act.) RANK 8 NODE 3 --> 11.3323298 sigma out 1act.( 12.2138615 sig in 12act.) RANK 9 NODE 2 --> 8.65283108 sigma out 1act.( 10.3938494 sig in 12act.) RANK 10 NODE 10 --> 6.60379267 sigma out 1act.( 8.74156952 sig in 12act.) RANK 11 NODE 15 --> 4.02126884 sigma out 1act.( 5.79184151 sig in 12act.) RANK 12 NODE 4 --> 1.19517517 sigma out 1act.( 1.91645026 sig in 12act.) RANK 13 NODE 13 --> 1.18585503 sigma out 1act.( 2.5038476 sig in 12act.) RANK 14 NODE 5 --> 0.387337685 sigma out 1act.( 2.80405998 sig in 12act.) RANK 15 NODE 11 --> 0.37291041 sigma out 1act.( 1.48346984 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 58.8829994 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.501526952 *** contribution from regularisation: 0.00557701662 *** contribution from error: -0.50710398 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26450 Closing output file done