NNInput NNInputs_180.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 191429 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 43087 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 43087 Chosen entries: 43087 Signal fraction: 1 Background fraction: 0.290457 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 43087 Entries to split: 43087 Test with : 21543 Train with : 21543 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 43087 for Signal Prepared event 0 for Signal with 43087 events ====Entry 0 Variable Ht : 238.939 Variable LepAPt : 61.5371 Variable LepBPt : 55.1916 Variable MetSigLeptonsJets : 2.02446 Variable MetSpec : 29.3112 Variable SumEtLeptonsJets : 209.628 Variable VSumJetLeptonsPt : 45.1399 Variable addEt : 146.04 Variable dPhiLepSumMet : 1.77561 Variable dPhiLeptons : 0.187258 Variable dRLeptons : 0.187258 Variable lep1_E : 62.4858 Variable lep2_E : 56.0434 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2180 Ht = 238.939 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 61.5373 LepAPt = 61.5371 LepBEt = 55.1918 LepBPt = 55.1916 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 29.3112 MetDelPhi = 1.67688 MetSig = 1.87318 MetSigLeptonsJets = 2.02446 MetSpec = 29.3112 Mjj = 0 MostCentralJetEta = -1.401 MtllMet = 146.401 Njets = 1 SB = 0 SumEt = 244.856 SumEtJets = 0 SumEtLeptonsJets = 209.628 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 45.1399 addEt = 146.04 dPhiLepSumMet = 1.77561 dPhiLeptons = 0.187258 dRLeptons = 0.187258 diltype = 17 dimass = 10.9007 event = 67 jet1_Et = 92.8988 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 62.4858 lep2_E = 56.0434 rand = 0.999742 run = 167138 weight = 2.79813e-06 ===Show End Prepared event 10000 for Signal with 43087 events Prepared event 20000 for Signal with 43087 events Prepared event 30000 for Signal with 43087 events Prepared event 40000 for Signal with 43087 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.258892 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4739 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 191429 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4739 negative weights. Signal fraction: 62.7486839 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0054131 63.468399 65.7295837 67.3902969 68.5430603 69.743042 70.7898636 71.6665878 72.5755157 73.3865356 74.147583 74.8947449 75.5595932 76.3443451 77.0399933 77.6599579 78.3968964 79.0895691 79.7059937 80.4260101 81.0830765 81.7638168 82.5329208 83.1997375 84.0024567 84.9540787 86.067627 87.4165649 88.7687454 89.9773636 91.5928955 92.9780731 94.4983826 96.2357941 98.002182 99.6549072 101.443962 103.057144 104.448219 105.997559 107.827621 109.562218 111.42823 113.390686 115.216064 117.023949 119.068932 120.972343 122.730438 124.602951 126.459366 128.296082 130.013824 131.814423 133.415314 135.027588 136.607178 138.196777 139.671875 141.109818 142.716248 144.219208 145.788956 147.519043 148.91568 150.344208 152.002533 153.612961 155.278687 156.758209 158.43631 160.06604 161.724091 163.634384 165.50528 167.41214 169.488403 171.585358 173.70015 175.807632 178.201736 180.554199 183.383133 186.416443 189.350677 192.495178 195.727295 199.607269 203.403717 207.489059 212.342422 217.861145 223.916626 230.718628 238.697418 248.508972 260.804871 279.421082 302.075165 355.34845 819.677795 ------------------------------ Transdef: Tab for variable 3 20.0023994 20.3670273 20.6901207 20.9590683 21.252161 21.5545883 21.8652878 22.0788651 22.3227158 22.5646935 22.7724304 22.9792061 23.201416 23.3987465 23.6236591 23.9019394 24.1346436 24.3719025 24.6249886 24.8378849 25.0824203 25.2780685 25.4890461 25.7171059 25.9560204 26.1960182 26.4526119 26.6899948 26.9362221 27.1521339 27.4123917 27.6505566 27.9267864 28.1464005 28.3857269 28.6368465 28.8807335 29.1380405 29.4032745 29.6819153 29.9640713 30.2870255 30.5686932 30.8983612 31.2608624 31.5708733 31.8297615 32.1389694 32.479393 32.8134384 33.1713867 33.5396194 33.8554764 34.2265549 34.5765228 34.97369 35.3675003 35.7181396 36.1141434 36.5195465 36.8810043 37.3020973 37.7543793 38.1774559 38.6147652 39.0124435 39.4573441 39.9225464 40.3436012 40.8135338 41.1367264 41.6171036 42.1156502 42.6521645 43.1646652 43.7186432 44.2304878 44.8351669 45.4085693 46.0338211 46.6748619 47.3382492 48.0014496 48.7254944 49.5542984 50.3246002 51.0687828 51.94384 52.846199 53.797905 54.7984467 55.9571609 57.243187 58.6280289 60.1829033 61.9300385 64.1468124 66.9200439 71.5105591 81.7109756 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0006914 10.1204624 10.2616291 10.3905392 10.4964199 10.6187248 10.7577744 10.8739185 11.0123835 11.1582279 11.3226624 11.4814959 11.6319504 11.7660904 11.9264183 12.094655 12.2341518 12.3806057 12.5388994 12.7223434 12.8716888 13.0681 13.2626133 13.4589176 13.6070557 13.784503 13.9480734 14.1529617 14.3509121 14.5671186 14.7994785 15.0267849 15.2409096 15.4382143 15.6786013 15.8901615 16.1388359 16.4056473 16.6365891 16.8400955 17.0844345 17.3624516 17.632473 17.911026 18.1102066 18.3770866 18.6760426 18.9369965 19.1811829 19.4815769 19.7708054 20.0480003 20.2560844 20.4451122 20.7022419 20.9625282 21.1974735 21.4478951 21.6811447 21.9161797 22.1891479 22.4764595 22.7451744 23.036253 23.322403 23.5884399 23.8485374 24.1281223 24.412281 24.7067928 24.9891853 25.2826691 25.5682354 25.8464432 26.1477394 26.4329185 26.7188988 27.0463943 27.3519211 27.657856 27.9473076 28.2735844 28.6404266 29.026413 29.4092369 29.8256874 30.2295399 30.6571102 31.1205215 31.6714439 32.1928024 32.7870407 33.4128494 34.0713272 34.9147491 35.8382263 36.9849777 38.7468567 41.1050224 45.9718208 116.983894 ------------------------------ Transdef: Tab for variable 5 1.08851385 2.71571636 3.16789031 3.49748325 3.7911799 4.02802801 4.17553616 4.30351257 4.43305588 4.53806877 4.64472723 4.73132133 4.82550621 4.91950846 5.01095581 5.08757114 5.15343904 5.23042679 5.28948116 5.3524189 5.4106741 5.47325373 5.52006912 5.56707525 5.62502813 5.67994308 5.72957325 5.77971363 5.83706856 5.88056183 5.9262886 5.97330189 6.01537704 6.06037664 6.10565567 6.15173435 6.1990366 6.24185514 6.27832508 6.32054901 6.37153149 6.41943407 6.47441196 6.51674175 6.55153751 6.59784794 6.64990807 6.70563602 6.75764847 6.80470896 6.85712147 6.89628172 6.94890451 6.98797512 7.03791523 7.08601189 7.14090586 7.1920433 7.24624729 7.29876614 7.35737467 7.41188908 7.47425127 7.52986479 7.58806419 7.65394878 7.70934582 7.77116442 7.8321991 7.88964748 7.95387268 8.01488495 8.077631 8.13713169 8.19689846 8.26360226 8.32999611 8.39029312 8.45834351 8.52092361 8.59015751 8.6633873 8.73447704 8.80778313 8.89231873 8.97149277 9.06605244 9.15735626 9.25346088 9.35866356 9.46716785 9.57887173 9.69789028 9.82557869 10.0078526 10.2218781 10.4867859 10.8501606 11.4083281 12.3204422 21.7385216 ------------------------------ Transdef: Tab for variable 6 15.0113287 22.0924683 25.6410599 26.687233 27.7942772 28.7971878 29.7132721 30.6312275 31.2276173 31.8490143 32.4559631 33.0447311 33.5720062 34.1364822 34.5841675 34.9803543 35.4558334 35.9276352 36.3062286 36.6540451 37.0150032 37.4065781 37.8191147 38.1914787 38.5859756 38.9408798 39.3132935 39.7195816 40.1141663 40.4643097 40.7949219 41.1955376 41.6410065 42.1332321 42.5752792 43.0174103 43.3708611 43.8418922 44.3478127 44.8197937 45.4231033 46.0476608 46.7730141 47.434639 48.112957 48.7291412 49.4005203 50.1585159 50.8036118 51.5858078 52.4202499 53.3168793 54.1653519 55.0168304 55.8079987 56.6372375 57.4680557 58.3870926 59.2187805 60.0045547 60.8120651 61.5449295 62.3697891 63.2151642 64.0583954 64.8905792 65.7198029 66.4410248 67.38517 68.2211456 69.0158691 69.7923126 70.6024933 71.4750061 72.2703857 73.1125107 73.9448395 74.7799683 75.5796661 76.4975433 77.1493988 77.9549103 78.9247665 79.9344254 80.9291382 82.1092758 83.2471619 84.4569702 85.7328644 87.1098404 88.6904297 90.6826324 92.5575562 95.027359 97.9192657 101.131065 105.191559 110.569511 118.269302 133.232101 311.985382 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7440948 33.7208977 34.5207977 35.0461884 35.4921036 36.013298 36.4688339 36.9041443 37.2765045 37.6519394 38.0285225 38.2963295 38.6490173 38.9060745 39.223629 39.5627365 39.8735504 40.2068481 40.5325012 40.9611282 41.3787994 41.7824173 42.2009048 42.6739197 43.0966797 43.6518402 44.4297676 45.0002518 45.614212 46.4794846 47.3902473 48.4164696 49.3207741 50.3929214 51.4263 52.5794334 53.6941605 54.9018097 55.9650803 56.9508171 58.00634 59.026062 60.0169487 60.9932251 61.7738533 62.67939 63.5904465 64.4598083 65.4217529 66.4589233 67.3730774 68.3129883 69.1491699 70.1637878 70.9731598 71.8145752 72.7374878 73.5894623 74.5358887 75.5395355 76.5093307 77.3678284 78.3516769 79.2662964 80.3041153 81.5464783 82.705246 83.8873596 85.1669922 86.3907318 87.9283295 89.5716095 91.1150513 92.695282 94.1413116 95.8137436 97.5671463 99.2585907 101.092667 102.932892 104.990425 107.162582 109.549118 112.132011 114.565857 117.269638 120.399841 123.509895 127.007553 130.926239 135.322815 139.908142 145.914886 152.380829 161.173981 171.399246 184.209412 205.463623 248.188477 523.715759 ------------------------------ Transdef: Tab for variable 8 1.09349227 26.153862 29.8760529 31.5962524 32.4255524 33.2280655 33.7550468 34.1850433 34.6722488 35.0884705 35.4598808 35.9031601 36.2250786 36.5794563 36.9067688 37.2181091 37.5174866 37.795166 38.0329437 38.3087196 38.5939369 38.8532257 39.1753845 39.4499588 39.735775 40.0823441 40.4235268 40.7810516 41.1393967 41.4883118 41.8869476 42.2872391 42.6478958 43.0740509 43.5078392 43.9635162 44.4375458 45.0979309 45.6987839 46.3150711 47.0186157 47.8078384 48.2606506 48.8151741 49.4663391 50.2911911 51.036232 51.7377853 52.5300446 53.2592621 54.0026627 54.8292923 55.5577316 56.3623657 57.1538734 57.8871765 58.642437 59.3959961 60.1626511 60.9315796 61.6405716 62.3635406 63.1206665 63.8590698 64.5889282 65.2911682 66.0697479 66.8159866 67.556572 68.3492126 69.0100021 69.7053375 70.4218292 71.1675797 71.90802 72.6361542 73.3651428 74.1721802 74.9864426 75.7274628 76.5743713 77.4815903 78.3521271 79.1808243 80.187027 81.3604736 82.5096588 83.7475586 85.0284576 86.4729691 88.1051178 89.8415909 91.9727631 94.2503052 97.4756775 101.129181 106.162415 112.304001 121.955116 141.461868 363.290375 ------------------------------ Transdef: Tab for variable 9 49.2546883 63.0204353 65.1717529 66.8196716 68.0980988 69.0340424 70.1067657 71.0074005 71.8825378 72.6688538 73.4147339 74.095932 74.7834015 75.3560181 75.9662628 76.6305466 77.1515198 77.7891693 78.4177704 78.9704208 79.5001678 80.074585 80.7801743 81.3008423 81.9399567 82.5562439 83.1958923 83.7868652 84.6178741 85.4558487 86.4086304 87.2793121 88.2792664 89.3151245 90.3438416 91.4976578 92.7660141 93.8613129 95.2105103 96.4988251 98.0031433 99.3779831 100.872726 102.201614 103.883286 105.432587 106.97374 108.423279 109.942451 111.430328 112.928558 114.536407 115.829407 117.332085 118.858505 120.263 121.767075 123.151031 124.55162 125.9767 127.314651 128.578079 129.89566 131.218994 132.467804 133.732666 134.995926 136.290329 137.599609 138.808472 140.059784 141.184311 142.496124 143.558563 144.70578 145.972534 147.209991 148.363281 149.564545 150.802216 152.115631 153.319534 154.568527 155.913376 157.179352 158.46402 159.944672 161.201385 162.886261 164.615829 166.306702 168.264618 170.451477 172.645554 175.332031 178.742859 182.904053 188.765442 199.697327 232.005524 582.80835 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.962215424 1.33958149 1.58227062 1.74472785 1.88507318 1.98211408 2.06809425 2.14459991 2.21062183 2.26455975 2.31453848 2.36014199 2.4026351 2.43952489 2.47597742 2.50854778 2.53803396 2.56446409 2.58865595 2.61556506 2.6392746 2.66252279 2.6840148 2.70664239 2.72531867 2.74426532 2.75984526 2.77528858 2.78999329 2.80293274 2.81741047 2.83138514 2.84306812 2.85403347 2.86473703 2.87470341 2.88314462 2.89268732 2.90087438 2.91096544 2.91929388 2.92525291 2.93271446 2.93948984 2.94673347 2.95384121 2.9608655 2.96645212 2.97214985 2.97733974 2.98257494 2.98849821 2.99381757 2.99827981 3.00286818 3.00666952 3.01181579 3.01594114 3.01998925 3.02421474 3.02861238 3.03226972 3.03562069 3.03960133 3.04317141 3.04693222 3.05069637 3.05460024 3.05816364 3.06194973 3.06543326 3.06830788 3.07122254 3.07447195 3.0773139 3.08047867 3.08350182 3.08608389 3.08921862 3.09211731 3.09498239 3.09810162 3.10064912 3.10324144 3.10550737 3.10820436 3.11041451 3.11300039 3.11525893 3.11782169 3.1203618 3.12258315 3.12481689 3.12708759 3.12910175 3.13170338 3.13420296 3.13636589 3.13905907 3.1415906 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.0051869154 0.00926558115 0.0153216096 0.0215167999 0.0270724371 0.0331210941 0.0398188829 0.046311155 0.0515093803 0.0582461357 0.0630553588 0.0689597726 0.0752153397 0.0810973942 0.0872410685 0.0928742886 0.0982992575 0.104082532 0.109511912 0.114585645 0.120236754 0.125450492 0.130495906 0.135713339 0.140796959 0.145730734 0.150940537 0.155652523 0.161055386 0.165903509 0.17102325 0.176451683 0.18166399 0.186537266 0.191434741 0.196493983 0.201752663 0.206589878 0.211651087 0.216895938 0.222252488 0.227532864 0.23226136 0.237550288 0.243463948 0.248463333 0.253582031 0.2588377 0.264548242 0.2698645 0.27546072 0.280094415 0.285186768 0.290960789 0.296770334 0.302395284 0.308483064 0.313822269 0.320192426 0.325911403 0.331694454 0.337676764 0.343721509 0.350072086 0.356346965 0.361529112 0.367586136 0.37468937 0.381180406 0.386822045 0.392758489 0.399819762 0.406556726 0.413297266 0.420013428 0.42816782 0.435704112 0.441880226 0.450580239 0.458243787 0.467271447 0.475280523 0.483324051 0.494177938 0.505050898 0.51718998 0.529166102 0.539795578 0.550607204 0.564616323 0.57896173 0.596679091 0.616795063 0.637888789 0.657225609 0.681884706 0.711329818 0.752912521 0.819534302 1.1246134 ------------------------------ Transdef: Tab for variable 12 0.100013629 0.119110353 0.135210678 0.148002535 0.160644025 0.169773147 0.179000765 0.188344076 0.196943909 0.204639167 0.213053599 0.221435606 0.228717208 0.235242248 0.242309302 0.249531329 0.256707937 0.262818813 0.268917233 0.275545061 0.281384766 0.287878543 0.293631136 0.29897964 0.304888606 0.310419559 0.315469503 0.320837975 0.326452017 0.33208555 0.33789593 0.343842477 0.348987192 0.353942156 0.35841167 0.364167869 0.370050192 0.375326693 0.380587161 0.386128753 0.390841275 0.395898879 0.400997639 0.405420512 0.409690857 0.413640797 0.417470187 0.42168802 0.425620258 0.430044472 0.43440038 0.438461423 0.442287862 0.446237564 0.450736284 0.455215931 0.459789693 0.463680029 0.468464434 0.47287485 0.477618605 0.482506037 0.48800981 0.492683172 0.497574687 0.502802193 0.508130789 0.513296187 0.519307256 0.524775743 0.530691743 0.537265301 0.543255925 0.548014104 0.554655552 0.561070919 0.568064094 0.575468779 0.581978321 0.589182377 0.597073317 0.604740024 0.614286065 0.62252152 0.631297827 0.64254415 0.652966142 0.662133574 0.673280418 0.683238447 0.694942653 0.706404686 0.719828725 0.734922647 0.751637518 0.771327734 0.791361928 0.811590314 0.843960166 0.88525933 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0075798 21.5126419 22.4310532 23.126091 23.7437344 24.307579 24.8739281 25.3130856 25.7651958 26.2318115 26.6895332 27.0996151 27.4952736 27.8618851 28.2865047 28.6940632 29.0846024 29.4777412 29.8307056 30.2287025 30.6007099 30.934845 31.2644615 31.6452999 31.9658356 32.3587799 32.6883659 33.064537 33.4249573 33.7799454 34.22155 34.4718857 34.8572693 35.2156143 35.5471268 35.9607925 36.3007393 36.7363281 37.1515236 37.5413857 37.9729156 38.429287 38.8135223 39.1752243 39.5914154 39.9791794 40.4554291 40.8846664 41.3323593 41.7605591 42.204258 42.6635056 43.0645065 43.5106964 43.9683609 44.4231033 44.9332771 45.3892746 45.9268494 46.3948059 46.9221268 47.4596252 47.9332504 48.4724884 49.0560036 49.6088638 50.1456566 50.8010521 51.3539658 51.964653 52.6008072 53.2430229 53.893158 54.5432472 55.264534 55.9961166 56.7066193 57.5472298 58.3317337 59.0807381 59.9029884 60.7681313 61.7244339 62.7664413 63.7602234 64.7763062 66.0283279 67.0950775 68.1421967 69.4536133 70.7846375 72.5697632 74.4658966 76.8613663 79.3675232 82.1287231 85.9629517 90.4234314 96.2315598 109.223389 381.504089 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.7588921 11.1961298 11.558979 11.9074936 12.257143 12.5121155 12.8418198 13.1969872 13.4993343 13.8150406 14.0791149 14.3682308 14.6472607 14.949461 15.2220964 15.5066891 15.8331413 16.1163788 16.4366684 16.7536888 16.9733849 17.3184166 17.647625 17.9365101 18.1854458 18.4893265 18.7799587 19.0953712 19.4228878 19.7230225 20.024065 20.3097229 20.5890083 20.9029675 21.1947727 21.4579258 21.7236862 21.9804115 22.2512436 22.5528946 22.8619518 23.165657 23.4704132 23.7398872 24.0299454 24.3134117 24.6043148 24.8941002 25.1655807 25.4356346 25.6609459 25.9414978 26.2160492 26.5196953 26.7943802 27.0907249 27.3787804 27.6259556 27.9021301 28.1232109 28.376236 28.6850815 28.99897 29.3057384 29.6275864 29.9674854 30.2568207 30.5696068 30.8893776 31.2328281 31.5337868 31.8942413 32.2797546 32.6411018 33.0261345 33.470211 33.8815575 34.3037109 34.7447815 35.2030373 35.7121162 36.2336655 36.7840462 37.2960052 37.8785629 38.5314407 39.1937065 39.8668823 40.594635 41.4417038 42.3354683 43.4646835 44.4252396 45.854496 47.595192 49.5816536 52.5167427 56.3665504 63.1955795 157.525284 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 65.2 53.1 55.3 30.1 50.3 63.1 55.0 64.0 -24.5 -15.4 -27.8 25.3 30.9 2 65.2 100.0 69.6 61.7 39.4 70.4 94.8 78.1 92.8 -43.3 -22.3 -38.2 43.3 39.3 3 53.1 69.6 100.0 50.2 17.0 41.2 71.8 60.0 76.5 -14.3 -25.2 -44.1 71.3 31.6 4 55.3 61.7 50.2 100.0 16.8 38.7 63.0 52.8 66.2 -13.0 -29.2 -49.7 30.1 75.0 5 30.1 39.4 17.0 16.8 100.0 84.0 13.4 59.9 58.8 21.2 -6.7 -11.0 4.8 6.3 6 50.3 70.4 41.2 38.7 84.0 100.0 50.9 79.8 80.2 -7.0 -15.4 -24.9 20.9 21.5 7 63.1 94.8 71.8 63.0 13.4 50.9 100.0 70.5 82.3 -51.8 -21.2 -37.7 46.7 41.8 8 55.0 78.1 60.0 52.8 59.9 79.8 70.5 100.0 85.2 -12.5 -22.5 -35.4 37.4 33.9 9 64.0 92.8 76.5 66.2 58.8 80.2 82.3 85.2 100.0 -20.6 -25.5 -43.8 49.0 43.0 10 -24.5 -43.3 -14.3 -13.0 21.2 -7.0 -51.8 -12.5 -20.6 100.0 1.1 3.6 -7.1 -7.2 11 -15.4 -22.3 -25.2 -29.2 -6.7 -15.4 -21.2 -22.5 -25.5 1.1 100.0 59.9 -11.8 -18.7 12 -27.8 -38.2 -44.1 -49.7 -11.0 -24.9 -37.7 -35.4 -43.8 3.6 59.9 100.0 -21.8 -27.3 13 25.3 43.3 71.3 30.1 4.8 20.9 46.7 37.4 49.0 -7.1 -11.8 -21.8 100.0 51.3 14 30.9 39.3 31.6 75.0 6.3 21.5 41.8 33.9 43.0 -7.2 -18.7 -27.3 51.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 166.962378 TOTAL CORRELATION OF ALL VARIABLES 72.225396 ROUND 1: MAX CORR ( 72.2247964) AFTER KILLING INPUT VARIABLE 11 CONTR 0.294314931 ROUND 2: MAX CORR ( 72.1964492) AFTER KILLING INPUT VARIABLE 8 CONTR 2.02334899 ROUND 3: MAX CORR ( 72.1340397) AFTER KILLING INPUT VARIABLE 14 CONTR 3.00126497 ROUND 4: MAX CORR ( 72.0246838) AFTER KILLING INPUT VARIABLE 10 CONTR 3.97046665 ROUND 5: MAX CORR ( 71.8884373) AFTER KILLING INPUT VARIABLE 6 CONTR 4.42805321 ROUND 6: MAX CORR ( 71.6556681) AFTER KILLING INPUT VARIABLE 2 CONTR 5.78036797 ROUND 7: MAX CORR ( 71.3813079) AFTER KILLING INPUT VARIABLE 12 CONTR 6.26447512 ROUND 8: MAX CORR ( 70.5094539) AFTER KILLING INPUT VARIABLE 13 CONTR 11.122411 ROUND 9: MAX CORR ( 69.4959502) AFTER KILLING INPUT VARIABLE 9 CONTR 11.9120103 ROUND 10: MAX CORR ( 69.0886676) AFTER KILLING INPUT VARIABLE 3 CONTR 7.51286268 ROUND 11: MAX CORR ( 66.7516062) AFTER KILLING INPUT VARIABLE 4 CONTR 17.8176055 ROUND 12: MAX CORR ( 63.0915992) AFTER KILLING INPUT VARIABLE 5 CONTR 21.7997027 LAST REMAINING VARIABLE: 7 total correlation to target: 72.225396 % total significance: 134.198272 sigma correlations of single variables to target: variable 2: 65.2280877 % , in sigma: 121.196935 variable 3: 53.0909525 % , in sigma: 98.645552 variable 4: 55.3233248 % , in sigma: 102.793407 variable 5: 30.0660013 % , in sigma: 55.8640814 variable 6: 50.2917333 % , in sigma: 93.4444676 variable 7: 63.0915992 % , in sigma: 117.227236 variable 8: 55.004757 % , in sigma: 102.201493 variable 9: 63.9993934 % , in sigma: 118.913962 variable 10: -24.4754103 % , in sigma: 45.4764936 variable 11: -15.4365513 % , in sigma: 28.6818574 variable 12: -27.790871 % , in sigma: 51.6367795 variable 13: 25.2945492 % , in sigma: 46.9984931 variable 14: 30.9469648 % , in sigma: 57.5009542 variables sorted by significance: 1 most relevant variable 7 corr 63.0915985 , in sigma: 117.227235 2 most relevant variable 5 corr 21.7997036 , in sigma: 40.5049014 3 most relevant variable 4 corr 17.817606 , in sigma: 33.1059718 4 most relevant variable 3 corr 7.51286268 , in sigma: 13.9592614 5 most relevant variable 9 corr 11.9120102 , in sigma: 22.1330898 6 most relevant variable 13 corr 11.1224108 , in sigma: 20.665976 7 most relevant variable 12 corr 6.26447535 , in sigma: 11.6396975 8 most relevant variable 2 corr 5.78036785 , in sigma: 10.7402024 9 most relevant variable 6 corr 4.42805338 , in sigma: 8.22753688 10 most relevant variable 10 corr 3.97046661 , in sigma: 7.37731859 11 most relevant variable 14 corr 3.00126505 , in sigma: 5.57649531 12 most relevant variable 8 corr 2.02334905 , in sigma: 3.75948018 13 most relevant variable 11 corr 0.294314921 , in sigma: 0.546851327 global correlations between input variables: variable 2: 99.2476731 % variable 3: 93.8499921 % variable 4: 92.3050782 % variable 5: 95.1770062 % variable 6: 94.1445399 % variable 7: 98.862857 % variable 8: 90.9494242 % variable 9: 98.9226006 % variable 10: 71.2272544 % variable 11: 60.6836585 % variable 12: 71.914684 % variable 13: 87.8320863 % variable 14: 89.3038119 % significance loss when removing single variables: variable 2: corr = 3.2001311 % , sigma = 5.94599803 variable 3: corr = 15.8898865 % , sigma = 29.5241759 variable 4: corr = 16.6397233 % , sigma = 30.917409 variable 5: corr = 11.3866051 % , sigma = 21.1568619 variable 6: corr = 4.62013542 % , sigma = 8.58443458 variable 7: corr = 5.83378556 % , sigma = 10.8394551 variable 8: corr = 1.99960431 % , sigma = 3.7153613 variable 9: corr = 10.7793671 % , sigma = 20.0285842 variable 10: corr = 3.62543992 % , sigma = 6.73624233 variable 11: corr = 0.294314931 % , sigma = 0.546851345 variable 12: corr = 5.34830403 % , sigma = 9.937407 variable 13: corr = 5.77233249 % , sigma = 10.7252724 variable 14: corr = 2.93356352 % , sigma = 5.4507026 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 23.0700436 sigma out 15 active outputs RANK 2 NODE 1 --> 22.4258728 sigma out 15 active outputs RANK 3 NODE 11 --> 20.3843689 sigma out 15 active outputs RANK 4 NODE 12 --> 17.9923553 sigma out 15 active outputs RANK 5 NODE 8 --> 14.7696257 sigma out 15 active outputs RANK 6 NODE 6 --> 14.0700254 sigma out 15 active outputs RANK 7 NODE 9 --> 13.6430016 sigma out 15 active outputs RANK 8 NODE 7 --> 11.7826853 sigma out 15 active outputs RANK 9 NODE 10 --> 11.6839619 sigma out 15 active outputs RANK 10 NODE 5 --> 11.0705872 sigma out 15 active outputs RANK 11 NODE 2 --> 9.64674854 sigma out 15 active outputs RANK 12 NODE 3 --> 8.35985661 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 37.5336533 sigma in 12act. ( 38.1773567 sig out 1act.) RANK 2 NODE 4 --> 23.9574738 sigma in 12act. ( 24.837759 sig out 1act.) RANK 3 NODE 15 --> 13.7863359 sigma in 12act. ( 19.3087425 sig out 1act.) RANK 4 NODE 7 --> 13.0312204 sigma in 12act. ( 12.0912457 sig out 1act.) RANK 5 NODE 6 --> 12.1944609 sigma in 12act. ( 12.5421362 sig out 1act.) RANK 6 NODE 13 --> 11.8658819 sigma in 12act. ( 11.2395868 sig out 1act.) RANK 7 NODE 12 --> 9.73497295 sigma in 12act. ( 10.3782244 sig out 1act.) RANK 8 NODE 8 --> 8.17461205 sigma in 12act. ( 8.60592175 sig out 1act.) RANK 9 NODE 9 --> 7.38311911 sigma in 12act. ( 6.77189636 sig out 1act.) RANK 10 NODE 10 --> 5.57684708 sigma in 12act. ( 9.22935867 sig out 1act.) RANK 11 NODE 3 --> 4.26617479 sigma in 12act. ( 5.7279644 sig out 1act.) RANK 12 NODE 1 --> 3.65851951 sigma in 12act. ( 5.10798502 sig out 1act.) RANK 13 NODE 5 --> 3.63361955 sigma in 12act. ( 2.00573421 sig out 1act.) RANK 14 NODE 11 --> 3.23603201 sigma in 12act. ( 1.57110322 sig out 1act.) RANK 15 NODE 2 --> 1.70383465 sigma in 12act. ( 2.42356253 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 38.1773567 sigma out 1act.( 37.5336533 sig in 12act.) RANK 2 NODE 4 --> 24.837759 sigma out 1act.( 23.9574738 sig in 12act.) RANK 3 NODE 15 --> 19.3087425 sigma out 1act.( 13.7863359 sig in 12act.) RANK 4 NODE 6 --> 12.5421362 sigma out 1act.( 12.1944609 sig in 12act.) RANK 5 NODE 7 --> 12.0912457 sigma out 1act.( 13.0312204 sig in 12act.) RANK 6 NODE 13 --> 11.2395868 sigma out 1act.( 11.8658819 sig in 12act.) RANK 7 NODE 12 --> 10.3782244 sigma out 1act.( 9.73497295 sig in 12act.) RANK 8 NODE 10 --> 9.22935867 sigma out 1act.( 5.57684708 sig in 12act.) RANK 9 NODE 8 --> 8.60592175 sigma out 1act.( 8.17461205 sig in 12act.) RANK 10 NODE 9 --> 6.77189636 sigma out 1act.( 7.38311911 sig in 12act.) RANK 11 NODE 3 --> 5.7279644 sigma out 1act.( 4.26617479 sig in 12act.) RANK 12 NODE 1 --> 5.10798502 sigma out 1act.( 3.65851951 sig in 12act.) RANK 13 NODE 2 --> 2.42356253 sigma out 1act.( 1.70383465 sig in 12act.) RANK 14 NODE 5 --> 2.00573421 sigma out 1act.( 3.63361955 sig in 12act.) RANK 15 NODE 11 --> 1.57110322 sigma out 1act.( 3.23603201 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 57.1065598 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 29.804512 sigma out 15 active outputs RANK 2 NODE 1 --> 22.6742096 sigma out 15 active outputs RANK 3 NODE 4 --> 21.9092751 sigma out 15 active outputs RANK 4 NODE 10 --> 20.0426884 sigma out 15 active outputs RANK 5 NODE 11 --> 19.5319157 sigma out 15 active outputs RANK 6 NODE 12 --> 18.1703949 sigma out 15 active outputs RANK 7 NODE 8 --> 16.797266 sigma out 15 active outputs RANK 8 NODE 6 --> 16.1734409 sigma out 15 active outputs RANK 9 NODE 7 --> 12.8213501 sigma out 15 active outputs RANK 10 NODE 5 --> 11.1236191 sigma out 15 active outputs RANK 11 NODE 2 --> 10.998971 sigma out 15 active outputs RANK 12 NODE 3 --> 8.85905266 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 36.0449753 sigma in 12act. ( 34.9379616 sig out 1act.) RANK 2 NODE 15 --> 23.255106 sigma in 12act. ( 19.0476265 sig out 1act.) RANK 3 NODE 4 --> 20.349535 sigma in 12act. ( 22.3219624 sig out 1act.) RANK 4 NODE 10 --> 15.818078 sigma in 12act. ( 10.762291 sig out 1act.) RANK 5 NODE 12 --> 15.3789091 sigma in 12act. ( 13.8241072 sig out 1act.) RANK 6 NODE 2 --> 14.103159 sigma in 12act. ( 8.23707771 sig out 1act.) RANK 7 NODE 1 --> 14.0819702 sigma in 12act. ( 9.00082779 sig out 1act.) RANK 8 NODE 7 --> 14.0071192 sigma in 12act. ( 10.662158 sig out 1act.) RANK 9 NODE 3 --> 12.838357 sigma in 12act. ( 7.15786982 sig out 1act.) RANK 10 NODE 6 --> 12.7645903 sigma in 12act. ( 11.5031004 sig out 1act.) RANK 11 NODE 13 --> 11.2036667 sigma in 12act. ( 9.9989233 sig out 1act.) RANK 12 NODE 8 --> 10.6552067 sigma in 12act. ( 8.57061768 sig out 1act.) RANK 13 NODE 5 --> 7.69306087 sigma in 12act. ( 1.73966706 sig out 1act.) RANK 14 NODE 9 --> 6.47465897 sigma in 12act. ( 6.55583239 sig out 1act.) RANK 15 NODE 11 --> 4.99391747 sigma in 12act. ( 0.983764827 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 34.9379616 sigma out 1act.( 36.0449753 sig in 12act.) RANK 2 NODE 4 --> 22.3219624 sigma out 1act.( 20.349535 sig in 12act.) RANK 3 NODE 15 --> 19.0476265 sigma out 1act.( 23.255106 sig in 12act.) RANK 4 NODE 12 --> 13.8241072 sigma out 1act.( 15.3789091 sig in 12act.) RANK 5 NODE 6 --> 11.5031004 sigma out 1act.( 12.7645903 sig in 12act.) RANK 6 NODE 10 --> 10.762291 sigma out 1act.( 15.818078 sig in 12act.) RANK 7 NODE 7 --> 10.662158 sigma out 1act.( 14.0071192 sig in 12act.) RANK 8 NODE 13 --> 9.9989233 sigma out 1act.( 11.2036667 sig in 12act.) RANK 9 NODE 1 --> 9.00082779 sigma out 1act.( 14.0819702 sig in 12act.) RANK 10 NODE 8 --> 8.57061768 sigma out 1act.( 10.6552067 sig in 12act.) RANK 11 NODE 2 --> 8.23707771 sigma out 1act.( 14.103159 sig in 12act.) RANK 12 NODE 3 --> 7.15786982 sigma out 1act.( 12.838357 sig in 12act.) RANK 13 NODE 9 --> 6.55583239 sigma out 1act.( 6.47465897 sig in 12act.) RANK 14 NODE 5 --> 1.73966706 sigma out 1act.( 7.69306087 sig in 12act.) RANK 15 NODE 11 --> 0.983764827 sigma out 1act.( 4.99391747 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.273735 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.480475754 *** contribution from regularisation: 0.00549972057 *** contribution from error: -0.485975474 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.538627982 *** contribution from regularisation: 0.00259873969 *** contribution from error: -0.541226745 *********************************************** -----------------> Test sample ENTER BFGS code START -51563.8082 0.341766804 -0.155511826 EXIT FROM BFGS code FG_START 0. 0.341766804 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.555191457 *** contribution from regularisation: 0.00241274666 *** contribution from error: -0.557604194 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -53139.595 0.341766804 32.9643517 EXIT FROM BFGS code FG_LNSRCH 0. 0.351562977 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.567858577 *** contribution from regularisation: 0.00308660883 *** contribution from error: -0.570945203 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54352.0155 0.351562977 115.134438 EXIT FROM BFGS code NEW_X -54352.0155 0.351562977 115.134438 ENTER BFGS code NEW_X -54352.0155 0.351562977 115.134438 EXIT FROM BFGS code FG_LNSRCH 0. 0.369939387 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.571934581 *** contribution from regularisation: 0.00300662871 *** contribution from error: -0.574941218 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54742.1458 0.369939387 33.5091057 EXIT FROM BFGS code NEW_X -54742.1458 0.369939387 33.5091057 ENTER BFGS code NEW_X -54742.1458 0.369939387 33.5091057 EXIT FROM BFGS code FG_LNSRCH 0. 0.379761457 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.57302767 *** contribution from regularisation: 0.00297668506 *** contribution from error: -0.576004326 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54846.773 0.379761457 1.54712093 EXIT FROM BFGS code NEW_X -54846.773 0.379761457 1.54712093 ENTER BFGS code NEW_X -54846.773 0.379761457 1.54712093 EXIT FROM BFGS code FG_LNSRCH 0. 0.387362301 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.573729873 *** contribution from regularisation: 0.00290610339 *** contribution from error: -0.576635957 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54913.9831 0.387362301 -19.2631054 EXIT FROM BFGS code NEW_X -54913.9831 0.387362301 -19.2631054 ENTER BFGS code NEW_X -54913.9831 0.387362301 -19.2631054 EXIT FROM BFGS code FG_LNSRCH 0. 0.389382035 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.574298739 *** contribution from regularisation: 0.00295450632 *** contribution from error: -0.577253222 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54968.4301 0.389382035 -16.5675392 EXIT FROM BFGS code NEW_X -54968.4301 0.389382035 -16.5675392 ENTER BFGS code NEW_X -54968.4301 0.389382035 -16.5675392 EXIT FROM BFGS code FG_LNSRCH 0. 0.40094921 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.575527012 *** contribution from regularisation: 0.00294392114 *** contribution from error: -0.578470945 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55085.9906 0.40094921 -19.9979172 EXIT FROM BFGS code NEW_X -55085.9906 0.40094921 -19.9979172 ENTER BFGS code NEW_X -55085.9906 0.40094921 -19.9979172 EXIT FROM BFGS code FG_LNSRCH 0. 0.384593755 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 35.6396675 sigma out 15 active outputs RANK 2 NODE 11 --> 21.2571793 sigma out 15 active outputs RANK 3 NODE 1 --> 18.8951359 sigma out 15 active outputs RANK 4 NODE 10 --> 18.6519699 sigma out 15 active outputs RANK 5 NODE 8 --> 14.3002329 sigma out 15 active outputs RANK 6 NODE 2 --> 13.7654209 sigma out 15 active outputs RANK 7 NODE 4 --> 12.5732784 sigma out 15 active outputs RANK 8 NODE 6 --> 11.7296228 sigma out 15 active outputs RANK 9 NODE 5 --> 9.4492445 sigma out 15 active outputs RANK 10 NODE 7 --> 9.29605865 sigma out 15 active outputs RANK 11 NODE 12 --> 7.99772453 sigma out 15 active outputs RANK 12 NODE 3 --> 7.24312544 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 26.3469162 sigma in 12act. ( 21.449934 sig out 1act.) RANK 2 NODE 12 --> 26.1780434 sigma in 12act. ( 20.1490002 sig out 1act.) RANK 3 NODE 1 --> 20.0771103 sigma in 12act. ( 17.9935379 sig out 1act.) RANK 4 NODE 2 --> 20.0305119 sigma in 12act. ( 18.2872505 sig out 1act.) RANK 5 NODE 3 --> 17.3523464 sigma in 12act. ( 19.1258488 sig out 1act.) RANK 6 NODE 10 --> 14.6136866 sigma in 12act. ( 11.9271564 sig out 1act.) RANK 7 NODE 4 --> 13.5572567 sigma in 12act. ( 12.049571 sig out 1act.) RANK 8 NODE 15 --> 12.2954302 sigma in 12act. ( 10.6165228 sig out 1act.) RANK 9 NODE 8 --> 12.1220846 sigma in 12act. ( 10.3982067 sig out 1act.) RANK 10 NODE 9 --> 8.75895405 sigma in 12act. ( 6.89553356 sig out 1act.) RANK 11 NODE 7 --> 6.68575716 sigma in 12act. ( 5.31793022 sig out 1act.) RANK 12 NODE 6 --> 6.54727507 sigma in 12act. ( 4.17092752 sig out 1act.) RANK 13 NODE 5 --> 5.6872201 sigma in 12act. ( 4.23981476 sig out 1act.) RANK 14 NODE 13 --> 4.11465406 sigma in 12act. ( 1.01577008 sig out 1act.) RANK 15 NODE 11 --> 3.85412335 sigma in 12act. ( 2.88035607 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 21.449934 sigma out 1act.( 26.3469162 sig in 12act.) RANK 2 NODE 12 --> 20.1490002 sigma out 1act.( 26.1780434 sig in 12act.) RANK 3 NODE 3 --> 19.1258488 sigma out 1act.( 17.3523464 sig in 12act.) RANK 4 NODE 2 --> 18.2872505 sigma out 1act.( 20.0305119 sig in 12act.) RANK 5 NODE 1 --> 17.9935379 sigma out 1act.( 20.0771103 sig in 12act.) RANK 6 NODE 4 --> 12.049571 sigma out 1act.( 13.5572567 sig in 12act.) RANK 7 NODE 10 --> 11.9271564 sigma out 1act.( 14.6136866 sig in 12act.) RANK 8 NODE 15 --> 10.6165228 sigma out 1act.( 12.2954302 sig in 12act.) RANK 9 NODE 8 --> 10.3982067 sigma out 1act.( 12.1220846 sig in 12act.) RANK 10 NODE 9 --> 6.89553356 sigma out 1act.( 8.75895405 sig in 12act.) RANK 11 NODE 7 --> 5.31793022 sigma out 1act.( 6.68575716 sig in 12act.) RANK 12 NODE 5 --> 4.23981476 sigma out 1act.( 5.6872201 sig in 12act.) RANK 13 NODE 6 --> 4.17092752 sigma out 1act.( 6.54727507 sig in 12act.) RANK 14 NODE 11 --> 2.88035607 sigma out 1act.( 3.85412335 sig in 12act.) RANK 15 NODE 13 --> 1.01577008 sigma out 1act.( 4.11465406 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 50.1884727 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.574455738 *** contribution from regularisation: 0.00286616548 *** contribution from error: -0.577321887 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54983.4545 0.384593755 134.200104 EXIT FROM BFGS code FG_LNSRCH 0. 0.396957099 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.575623989 *** contribution from regularisation: 0.0031167944 *** contribution from error: -0.578740776 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55095.2724 0.396957099 15.1035261 EXIT FROM BFGS code NEW_X -55095.2724 0.396957099 15.1035261 ENTER BFGS code NEW_X -55095.2724 0.396957099 15.1035261 EXIT FROM BFGS code FG_LNSRCH 0. 0.404805332 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.576179147 *** contribution from regularisation: 0.00286444533 *** contribution from error: -0.579043567 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55148.4085 0.404805332 19.8923798 EXIT FROM BFGS code NEW_X -55148.4085 0.404805332 19.8923798 ENTER BFGS code NEW_X -55148.4085 0.404805332 19.8923798 EXIT FROM BFGS code FG_LNSRCH 0. 0.423027843 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.576373935 *** contribution from regularisation: 0.00286427327 *** contribution from error: -0.579238236 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55167.0546 0.423027843 12.2924404 EXIT FROM BFGS code NEW_X -55167.0546 0.423027843 12.2924404 ENTER BFGS code NEW_X -55167.0546 0.423027843 12.2924404 EXIT FROM BFGS code FG_LNSRCH 0. 0.448726952 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.576715171 *** contribution from regularisation: 0.00281353458 *** contribution from error: -0.579528689 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55199.7139 0.448726952 -11.528162 EXIT FROM BFGS code NEW_X -55199.7139 0.448726952 -11.528162 ENTER BFGS code NEW_X -55199.7139 0.448726952 -11.528162 EXIT FROM BFGS code FG_LNSRCH 0. 0.465921789 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.577153325 *** contribution from regularisation: 0.00283525488 *** contribution from error: -0.579988599 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55241.6518 0.465921789 -18.0513477 EXIT FROM BFGS code NEW_X -55241.6518 0.465921789 -18.0513477 ENTER BFGS code NEW_X -55241.6518 0.465921789 -18.0513477 EXIT FROM BFGS code FG_LNSRCH 0. 0.498186231 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.576737463 *** contribution from regularisation: 0.00274692313 *** contribution from error: -0.579484403 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55201.847 0.498186231 -43.4592819 EXIT FROM BFGS code FG_LNSRCH 0. 0.479828209 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.577122986 *** contribution from regularisation: 0.00336808152 *** contribution from error: -0.580491066 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55238.7514 0.479828209 -21.3298569 EXIT FROM BFGS code FG_LNSRCH 0. 0.469686359 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.577054977 *** contribution from regularisation: 0.00313375588 *** contribution from error: -0.580188751 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55232.2428 0.469686359 -17.6874237 EXIT FROM BFGS code FG_LNSRCH 0. 0.466455013 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.577024043 *** contribution from regularisation: 0.00299470406 *** contribution from error: -0.580018759 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55229.2771 0.466455013 -17.4587746 EXIT FROM BFGS code FG_LNSRCH 0. 0.465940535 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 36.1866112 sigma out 15 active outputs RANK 2 NODE 11 --> 25.3679581 sigma out 15 active outputs RANK 3 NODE 2 --> 20.5765915 sigma out 15 active outputs RANK 4 NODE 10 --> 20.4970932 sigma out 15 active outputs RANK 5 NODE 1 --> 19.9166622 sigma out 15 active outputs RANK 6 NODE 8 --> 14.6216612 sigma out 15 active outputs RANK 7 NODE 6 --> 13.9646149 sigma out 15 active outputs RANK 8 NODE 4 --> 11.7552176 sigma out 15 active outputs RANK 9 NODE 5 --> 11.4792328 sigma out 15 active outputs RANK 10 NODE 12 --> 10.8293133 sigma out 15 active outputs RANK 11 NODE 7 --> 10.5510864 sigma out 15 active outputs RANK 12 NODE 3 --> 9.16972733 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 30.5197735 sigma in 12act. ( 23.1948891 sig out 1act.) RANK 2 NODE 14 --> 27.1445045 sigma in 12act. ( 21.6481915 sig out 1act.) RANK 3 NODE 3 --> 23.3438931 sigma in 12act. ( 26.1963406 sig out 1act.) RANK 4 NODE 2 --> 22.7925129 sigma in 12act. ( 20.9375019 sig out 1act.) RANK 5 NODE 1 --> 22.3876648 sigma in 12act. ( 21.0066357 sig out 1act.) RANK 6 NODE 8 --> 14.4287119 sigma in 12act. ( 13.1620979 sig out 1act.) RANK 7 NODE 4 --> 14.1419678 sigma in 12act. ( 12.1880703 sig out 1act.) RANK 8 NODE 10 --> 13.838829 sigma in 12act. ( 11.4515114 sig out 1act.) RANK 9 NODE 15 --> 11.786397 sigma in 12act. ( 9.8414669 sig out 1act.) RANK 10 NODE 9 --> 10.0983038 sigma in 12act. ( 8.1706419 sig out 1act.) RANK 11 NODE 6 --> 6.18531275 sigma in 12act. ( 3.24516821 sig out 1act.) RANK 12 NODE 5 --> 5.0743618 sigma in 12act. ( 3.922755 sig out 1act.) RANK 13 NODE 7 --> 4.40197659 sigma in 12act. ( 1.18236983 sig out 1act.) RANK 14 NODE 13 --> 3.92918468 sigma in 12act. ( 1.57229996 sig out 1act.) RANK 15 NODE 11 --> 3.36318374 sigma in 12act. ( 2.4496417 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 26.1963406 sigma out 1act.( 23.3438931 sig in 12act.) RANK 2 NODE 12 --> 23.1948891 sigma out 1act.( 30.5197735 sig in 12act.) RANK 3 NODE 14 --> 21.6481915 sigma out 1act.( 27.1445045 sig in 12act.) RANK 4 NODE 1 --> 21.0066357 sigma out 1act.( 22.3876648 sig in 12act.) RANK 5 NODE 2 --> 20.9375019 sigma out 1act.( 22.7925129 sig in 12act.) RANK 6 NODE 8 --> 13.1620979 sigma out 1act.( 14.4287119 sig in 12act.) RANK 7 NODE 4 --> 12.1880703 sigma out 1act.( 14.1419678 sig in 12act.) RANK 8 NODE 10 --> 11.4515114 sigma out 1act.( 13.838829 sig in 12act.) RANK 9 NODE 15 --> 9.8414669 sigma out 1act.( 11.786397 sig in 12act.) RANK 10 NODE 9 --> 8.1706419 sigma out 1act.( 10.0983038 sig in 12act.) RANK 11 NODE 5 --> 3.922755 sigma out 1act.( 5.0743618 sig in 12act.) RANK 12 NODE 6 --> 3.24516821 sigma out 1act.( 6.18531275 sig in 12act.) RANK 13 NODE 11 --> 2.4496417 sigma out 1act.( 3.36318374 sig in 12act.) RANK 14 NODE 13 --> 1.57229996 sigma out 1act.( 3.92918468 sig in 12act.) RANK 15 NODE 7 --> 1.18236983 sigma out 1act.( 4.40197659 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 56.788063 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.577026129 *** contribution from regularisation: 0.00296346331 *** contribution from error: -0.579989612 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -55229.4801 0.465940535 -17.3949375 EXIT FROM BFGS code FG_LNSRCH 0. 0.465921819 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.577042818 *** contribution from regularisation: 0.00294574839 *** contribution from error: -0.579988539 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55231.0763 0.465921819 -17.4130039 EXIT FROM BFGS code FG_LNSRCH 0. 0.465921789 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.57704401 *** contribution from regularisation: 0.00294452626 *** contribution from error: -0.579988539 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55231.193 0.465921789 -17.3653259 EXIT FROM BFGS code FG_LNSRCH 0. 0.465921789 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.577041745 *** contribution from regularisation: 0.00294679916 *** contribution from error: -0.579988539 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55230.9754 0.465921789 -17.3654213 EXIT FROM BFGS code FG_LNSRCH 0. 0.465921789 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.577033758 *** contribution from regularisation: 0.00295478362 *** contribution from error: -0.579988539 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55230.2112 0.465921789 -17.2561054 EXIT FROM BFGS code NEW_X -55230.2112 0.465921789 -17.2561054 ENTER BFGS code NEW_X -55230.2112 0.465921789 -17.2561054 EXIT FROM BFGS code CONVERGENC -55230.2112 0.465921789 -17.2561054 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 60.4257317 sigma out 15 active outputs RANK 2 NODE 11 --> 43.302124 sigma out 15 active outputs RANK 3 NODE 2 --> 34.834137 sigma out 15 active outputs RANK 4 NODE 1 --> 32.553009 sigma out 15 active outputs RANK 5 NODE 10 --> 31.5937405 sigma out 15 active outputs RANK 6 NODE 8 --> 23.8248158 sigma out 15 active outputs RANK 7 NODE 6 --> 22.8700867 sigma out 15 active outputs RANK 8 NODE 4 --> 19.4163799 sigma out 15 active outputs RANK 9 NODE 5 --> 18.7205963 sigma out 15 active outputs RANK 10 NODE 12 --> 17.3416805 sigma out 15 active outputs RANK 11 NODE 7 --> 16.7711563 sigma out 15 active outputs RANK 12 NODE 3 --> 14.7786865 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 51.2385406 sigma in 12act. ( 39.7354507 sig out 1act.) RANK 2 NODE 14 --> 47.0869446 sigma in 12act. ( 35.915947 sig out 1act.) RANK 3 NODE 2 --> 37.6212921 sigma in 12act. ( 35.8707619 sig out 1act.) RANK 4 NODE 3 --> 37.5992355 sigma in 12act. ( 45.5891533 sig out 1act.) RANK 5 NODE 1 --> 36.960186 sigma in 12act. ( 35.9559784 sig out 1act.) RANK 6 NODE 8 --> 23.8089294 sigma in 12act. ( 22.4838448 sig out 1act.) RANK 7 NODE 4 --> 23.6549149 sigma in 12act. ( 20.2088852 sig out 1act.) RANK 8 NODE 10 --> 22.0740318 sigma in 12act. ( 19.5311832 sig out 1act.) RANK 9 NODE 15 --> 18.1413326 sigma in 12act. ( 16.9686146 sig out 1act.) RANK 10 NODE 9 --> 16.0242691 sigma in 12act. ( 13.4800329 sig out 1act.) RANK 11 NODE 6 --> 8.1226778 sigma in 12act. ( 5.51824522 sig out 1act.) RANK 12 NODE 5 --> 7.06413603 sigma in 12act. ( 6.52720881 sig out 1act.) RANK 13 NODE 11 --> 4.6297183 sigma in 12act. ( 4.12892008 sig out 1act.) RANK 14 NODE 7 --> 4.60496902 sigma in 12act. ( 1.98419416 sig out 1act.) RANK 15 NODE 13 --> 4.5145874 sigma in 12act. ( 2.68018889 sig out 1act.) sorted by output significance RANK 1 NODE 3 --> 45.5891533 sigma out 1act.( 37.5992355 sig in 12act.) RANK 2 NODE 12 --> 39.7354507 sigma out 1act.( 51.2385406 sig in 12act.) RANK 3 NODE 1 --> 35.9559784 sigma out 1act.( 36.960186 sig in 12act.) RANK 4 NODE 14 --> 35.915947 sigma out 1act.( 47.0869446 sig in 12act.) RANK 5 NODE 2 --> 35.8707619 sigma out 1act.( 37.6212921 sig in 12act.) RANK 6 NODE 8 --> 22.4838448 sigma out 1act.( 23.8089294 sig in 12act.) RANK 7 NODE 4 --> 20.2088852 sigma out 1act.( 23.6549149 sig in 12act.) RANK 8 NODE 10 --> 19.5311832 sigma out 1act.( 22.0740318 sig in 12act.) RANK 9 NODE 15 --> 16.9686146 sigma out 1act.( 18.1413326 sig in 12act.) RANK 10 NODE 9 --> 13.4800329 sigma out 1act.( 16.0242691 sig in 12act.) RANK 11 NODE 5 --> 6.52720881 sigma out 1act.( 7.06413603 sig in 12act.) RANK 12 NODE 6 --> 5.51824522 sigma out 1act.( 8.1226778 sig in 12act.) RANK 13 NODE 11 --> 4.12892008 sigma out 1act.( 4.6297183 sig in 12act.) RANK 14 NODE 13 --> 2.68018889 sigma out 1act.( 4.5145874 sig in 12act.) RANK 15 NODE 7 --> 1.98419416 sigma out 1act.( 4.60496902 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 96.9176712 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.577043414 *** contribution from regularisation: 0.00294516794 *** contribution from error: -0.579988599 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done