NNInput NNInputs_160.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 195906 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 56106 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 56106 Chosen entries: 56106 Signal fraction: 1 Background fraction: 0.40133 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 56106 Entries to split: 56106 Test with : 28053 Train with : 28053 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 56106 for Signal Prepared event 0 for Signal with 56106 events ====Entry 0 Variable Ht : 120.598 Variable LepAPt : 29.9056 Variable LepBPt : 13.5082 Variable MetSigLeptonsJets : 11.7141 Variable MetSpec : 77.1834 Variable SumEtLeptonsJets : 43.4138 Variable VSumJetLeptonsPt : 43.304 Variable addEt : 120.598 Variable dPhiLepSumMet : 2.82377 Variable dPhiLeptons : 0.153702 Variable dRLeptons : 0.732968 Variable lep1_E : 40.451 Variable lep2_E : 32.7603 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2160 Ht = 120.598 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 29.9058 LepAPt = 29.9056 LepBEt = 13.5084 LepBPt = 13.5082 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 77.1834 MetDelPhi = 2.77599 MetSig = 6.78472 MetSigLeptonsJets = 11.7141 MetSpec = 77.1834 Mjj = 0 MostCentralJetEta = 0 MtllMet = 139.14 Njets = 0 SB = 0 SumEt = 129.415 SumEtJets = 0 SumEtLeptonsJets = 43.4138 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 43.304 addEt = 120.598 dPhiLepSumMet = 2.82377 dPhiLeptons = 0.153702 dRLeptons = 0.732968 diltype = 34 dimass = 15.0375 event = 2600 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.451 lep2_E = 32.7603 rand = 0.999742 run = 233650 weight = 2.30027e-06 ===Show End Prepared event 10000 for Signal with 56106 events Prepared event 20000 for Signal with 56106 events Prepared event 30000 for Signal with 56106 events Prepared event 40000 for Signal with 56106 events Prepared event 50000 for Signal with 56106 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.329008 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4433 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 195906 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4433 negative weights. Signal fraction: 62.867363 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.065033 65.010025 66.6732635 68.2346954 69.2055588 70.2606659 71.0700836 72.0079956 72.9744568 73.8026733 74.4293976 75.3028107 75.9914932 76.7069473 77.264946 77.9578629 78.6280518 79.2654114 79.7886124 80.6573029 81.3227844 82.2065201 82.8274078 83.6274414 84.6487122 85.5165558 86.571022 87.9062958 89.1268921 90.4739532 92.3103638 94.0772247 95.4403534 96.939476 98.8131866 100.269859 101.762978 103.459213 104.809311 106.270851 107.767899 109.415283 111.187958 112.759964 114.435562 116.060875 117.758148 119.38916 120.697968 122.325607 124.084671 125.646973 127.446411 128.974701 130.590988 132.318283 133.837158 135.436279 137.036575 138.541168 140.02536 141.611008 142.968475 144.366913 145.875916 147.310349 148.591888 149.923431 151.297668 152.605484 153.955246 155.266632 156.632507 158.175919 159.722321 161.307861 163.090469 165.081329 167.478149 169.782883 171.929001 174.378113 176.974274 179.7388 182.725876 185.612045 188.890503 192.154297 195.732635 199.644409 203.980042 209.14032 215.03978 221.491852 229.309906 239.385986 252.466125 271.62854 302.038422 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3414783 20.6500397 20.9823608 21.2725487 21.5195122 21.7927952 22.0176048 22.229187 22.4591484 22.7135162 22.9247074 23.150774 23.3346825 23.5992908 23.8047142 24.0526085 24.3013191 24.5087147 24.7576256 25.0091209 25.2225189 25.4495277 25.6739597 25.8840294 26.1207142 26.3321152 26.5452843 26.7926044 27.039999 27.2581024 27.5278625 27.7385445 27.9910927 28.2140884 28.4459305 28.6867599 28.9589043 29.2001801 29.4556637 29.6714134 29.9466629 30.2227936 30.5069733 30.7542458 31.0307121 31.3111267 31.574192 31.8336697 32.0956535 32.3807983 32.6796913 32.9661179 33.2394638 33.5319214 33.7828751 34.0742035 34.3825912 34.6888351 35.0072327 35.3089066 35.5894852 35.877327 36.1972122 36.5046082 36.8280869 37.1210251 37.444149 37.7616882 38.0996552 38.4200287 38.7478561 39.0568237 39.2884521 39.6368942 39.9781342 40.3317413 40.6730042 41.0465469 41.4532585 41.8596115 42.2664948 42.665947 43.1308517 43.5777054 44.0626602 44.5980377 45.2381401 45.8526344 46.6032028 47.3182678 48.1281662 49.0811043 50.1750717 51.4324265 52.9879227 54.7723541 57.2989197 60.8118973 66.6811981 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.1314468 10.2657366 10.4029598 10.4935474 10.6164303 10.7596188 10.8854551 11.0072308 11.1344671 11.2818966 11.4255104 11.5588856 11.7138615 11.8479023 12.0250912 12.1904812 12.3560944 12.518837 12.6922569 12.8445053 13.0177011 13.2254934 13.4437199 13.6091557 13.7756424 13.9190464 14.1272163 14.3102369 14.5096245 14.7418308 14.9794636 15.216567 15.4058571 15.607707 15.8182249 16.0260086 16.2876472 16.5696716 16.8341637 17.1148987 17.4134521 17.7002716 17.9680367 18.2646751 18.5506325 18.8066292 19.0915565 19.3994484 19.7092648 20.0411339 20.2983112 20.5507584 20.8596153 21.1783981 21.4779701 21.7658882 22.0101643 22.3429718 22.6610641 22.9922066 23.3234196 23.6623688 24.01334 24.3478909 24.7168541 25.0872612 25.4753323 25.8107853 26.1702976 26.5096416 26.8848763 27.2782059 27.6559086 27.9946709 28.3378792 28.7474957 29.1290741 29.55406 29.9463081 30.3021202 30.7576466 31.1751633 31.6034431 32.0351715 32.4863205 32.9382591 33.4025574 33.9341049 34.4522476 35.0118484 35.6132431 36.2107124 36.9001846 37.7060471 38.719017 39.8974152 41.5033264 43.9314804 47.8496475 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.02583945 2.77608156 3.15873051 3.50467682 3.76616693 3.99233294 4.14272404 4.28556299 4.4172225 4.53148174 4.63057804 4.74051285 4.83203983 4.92183065 5.00555706 5.07311583 5.14172888 5.21494627 5.2810626 5.33662033 5.39082718 5.44770575 5.50353909 5.53980446 5.59608555 5.64057922 5.68707466 5.73051834 5.78344011 5.83041954 5.87648296 5.92071247 5.97533035 6.01766634 6.06767035 6.10732937 6.14971495 6.19590187 6.24780083 6.29189396 6.33070564 6.3734417 6.42068958 6.47027016 6.51071548 6.56241083 6.61106396 6.65228987 6.69734669 6.75030518 6.79304028 6.84347391 6.87889481 6.92964172 6.9736948 7.02830553 7.08013535 7.13406754 7.18472195 7.23155785 7.28409672 7.33277035 7.38925076 7.44894266 7.49675798 7.54873085 7.60716629 7.66072559 7.72080421 7.78141689 7.83995056 7.89743233 7.94806862 8.0150032 8.07640076 8.13325691 8.19240284 8.25108814 8.31161308 8.37805176 8.44096565 8.51042461 8.57362938 8.63345337 8.70521164 8.77364922 8.84539223 8.92091751 9.0059309 9.09362507 9.18978786 9.29628563 9.41125011 9.55081177 9.70301533 9.8922224 10.1044493 10.4012585 10.8204002 11.5946817 19.1346054 ------------------------------ Transdef: Tab for variable 6 15.0050735 21.6399345 25.6668129 26.7501163 27.6138687 28.6417503 29.5147247 30.2504597 30.9478989 31.6106529 32.2727051 32.776886 33.2674942 33.7340546 34.2804718 34.7063522 35.0612793 35.5047684 35.9553566 36.2608795 36.6357498 36.9882317 37.4132004 37.8074265 38.2199287 38.5603027 38.8921585 39.2782059 39.621006 39.9546623 40.3931389 40.8184395 41.3313904 41.8247986 42.2357254 42.6704102 43.0307884 43.4057922 43.8254242 44.3816833 44.840889 45.4832001 46.0798798 46.8139038 47.3885536 48.0171814 48.7785301 49.402092 50.1008415 50.7292938 51.4894791 52.3329468 53.1889877 53.9506798 54.7059555 55.4358101 56.1516571 56.8938065 57.7016754 58.4106789 59.0328445 59.8616791 60.639267 61.4215126 62.2382965 63.0765076 63.9114761 64.7371063 65.5923843 66.3613663 67.0781784 67.8390808 68.5915527 69.3982544 70.1047974 70.9291382 71.6529846 72.4100189 73.1402969 73.91819 74.6956635 75.4506989 76.2714767 77.1096954 77.8579102 78.7548447 79.7654266 80.7996902 81.8724518 83.1638947 84.5670929 86.1053696 87.8165741 90.0448608 92.778717 95.638504 99.3088989 104.054382 110.755188 123.626221 284.632782 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.6927605 33.718132 34.2795105 34.8790703 35.485939 35.983757 36.3878822 36.8315353 37.148674 37.4980354 37.8510551 38.1886826 38.5371742 38.8527107 39.1263123 39.4011536 39.7376785 40.1010895 40.4504776 40.7961578 41.1478195 41.5359612 41.9046631 42.4455147 42.907196 43.5861206 44.2741852 44.8805923 45.3980103 46.2261353 47.0811462 47.8613968 48.6916656 49.6424484 50.73666 51.7963562 52.6899147 53.5836639 54.7102966 55.7764626 56.766098 57.6977844 58.6317673 59.5116081 60.4564362 61.1640472 61.8574829 62.67939 63.4946518 64.3965607 65.1787949 66.0386124 66.8727646 67.802124 68.6672897 69.6263275 70.4695969 71.3145294 72.204834 72.9811707 73.8657379 74.7219391 75.596077 76.476944 77.4276886 78.3348389 79.2254944 80.2732697 81.3319778 82.5198212 83.8425293 85.1388245 86.5166473 87.9981384 89.6046906 91.2874374 92.9571381 94.5840149 96.3644714 98.0423279 99.8831635 101.820206 103.839737 106.143875 108.365555 111.007599 113.578781 116.606789 119.546303 122.804428 126.700821 131.076477 135.691376 141.314529 148.023346 157.097977 167.305145 181.893127 207.08667 474.677399 ------------------------------ Transdef: Tab for variable 8 2.50452757 25.2866058 29.543808 31.2274361 32.0632629 32.8887825 33.4351883 33.856842 34.3831482 34.8197098 35.1972122 35.5426598 35.9187241 36.2061081 36.5217705 36.8344688 37.1360168 37.4280014 37.7491035 38.0228806 38.2378349 38.5692825 38.8504333 39.1336365 39.4981232 39.8073997 40.1293869 40.4278793 40.7881851 41.1701698 41.4946213 41.8903427 42.3358002 42.7950439 43.271637 43.7262802 44.1299629 44.7161064 45.2188797 45.8085098 46.4640884 47.03965 47.743927 48.2282524 48.8814049 49.4993248 50.1941261 50.9081078 51.5371933 52.2671127 52.9764671 53.5943985 54.3434486 55.0817032 55.7608414 56.5093651 57.2249794 57.8925095 58.5560455 59.2639771 59.946331 60.6281891 61.1428108 61.7779655 62.4757996 63.1491241 63.8915405 64.5214462 65.2059479 65.9673309 66.6226654 67.3131561 68.0262299 68.8068542 69.5100098 70.227005 70.9584045 71.6724854 72.4313812 73.1527405 73.933548 74.6904297 75.4492035 76.2585068 77.0377045 77.9514465 78.7895508 79.7431488 80.9258194 82.1560822 83.5219269 85.0629196 86.9713287 89.0974426 91.5713806 94.6289139 98.4068298 103.349609 109.983368 123.978989 326.868286 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7099228 64.5240784 66.1873016 67.4714432 68.5968857 69.592392 70.4324341 71.2177124 72.0342712 72.9014816 73.6513977 74.2948608 74.9896164 75.651947 76.2668152 76.8845062 77.4118576 78.0404816 78.6150513 79.1897736 79.6625061 80.2451935 80.9619904 81.5841217 82.281601 82.793335 83.5179291 84.3330994 85.0017014 85.8953552 86.690033 87.5509796 88.5438156 89.3599014 90.4257965 91.8643341 93.1206589 94.4342346 95.6047363 96.8657684 98.4326324 99.728653 101.056213 102.320541 103.684799 104.983307 106.270851 107.624908 109.116104 110.51059 111.800446 113.109276 114.407883 115.705215 116.929169 118.326744 119.599182 120.581924 121.84938 123.153275 124.408737 125.727615 127.024757 128.263031 129.485718 130.71756 131.994659 133.149261 134.380402 135.620102 136.831192 138.060257 139.245697 140.380737 141.624634 142.675354 143.804626 144.842209 146.008667 147.156006 148.213013 149.318176 150.360626 151.40271 152.458511 153.516296 154.659698 155.789749 156.914429 158.255875 159.586182 161.004517 162.554825 164.424728 166.999313 170.025909 174.217133 181.247375 195.942398 386.642853 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.18464327 1.50896597 1.70839 1.85374594 1.96835518 2.05898952 2.13735199 2.20332146 2.2613821 2.31267023 2.35403657 2.39647913 2.43464231 2.47118163 2.50388384 2.53151369 2.56167269 2.58818817 2.6158886 2.63760328 2.66120028 2.68041539 2.70068693 2.71989965 2.7392838 2.75515962 2.7709167 2.7848568 2.79868841 2.81279182 2.82422638 2.83637714 2.8468256 2.85729599 2.86775231 2.87739277 2.88778687 2.89794588 2.90609646 2.91470766 2.92262197 2.92923689 2.93685246 2.94476461 2.95145798 2.95898104 2.96589327 2.97263241 2.97841072 2.98373461 2.98794556 2.99166965 2.99540377 3.00071001 3.00571847 3.01019621 3.01463699 3.0193646 3.02411556 3.02849865 3.03188133 3.03575826 3.03983903 3.04374599 3.04743123 3.0513978 3.05507421 3.05885863 3.06173444 3.06488895 3.06781697 3.07132578 3.07450724 3.0770216 3.08054376 3.08323145 3.0859642 3.08877802 3.09164762 3.0943625 3.0969789 3.09980202 3.10246706 3.10497952 3.10735559 3.10948944 3.1122117 3.11453533 3.11647201 3.11882019 3.12112617 3.12376213 3.12623668 3.12886333 3.13089728 3.1323204 3.13439059 3.13644981 3.13897705 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.8014183E-06 0.00571656227 0.00959634688 0.015498966 0.0215345621 0.0279326513 0.0343836546 0.0418387577 0.0490601063 0.0563918948 0.0620623752 0.0695174932 0.0778884888 0.085850358 0.0935442448 0.100814611 0.108079851 0.114659309 0.121025115 0.128376007 0.134881482 0.141316295 0.147244692 0.153850079 0.16007781 0.166841298 0.173556805 0.179767013 0.185810328 0.191707626 0.197051883 0.202502698 0.207600236 0.213019133 0.217923373 0.22341454 0.228306323 0.233481169 0.238556862 0.244147778 0.249762535 0.254778862 0.259420872 0.264257431 0.269452333 0.274370253 0.279262722 0.28389883 0.288443148 0.294012308 0.299037158 0.303830147 0.309381843 0.314553976 0.319882154 0.32488358 0.330621243 0.336417317 0.342353821 0.348365426 0.353291988 0.359273225 0.364734054 0.369835496 0.375283599 0.381511211 0.386887014 0.393494308 0.399309516 0.405255914 0.411531448 0.41829145 0.425114065 0.431845427 0.437936455 0.44524014 0.452003956 0.459194571 0.467612147 0.47532177 0.482673138 0.492995858 0.503131628 0.511948466 0.520638227 0.530201912 0.541464925 0.550920844 0.563611388 0.576639414 0.588932514 0.604859352 0.621550679 0.636347055 0.659351587 0.682356119 0.705319405 0.734857976 0.780627668 0.84892714 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200000316 0.210732386 0.221227616 0.231148034 0.238642618 0.246119589 0.253555477 0.259706646 0.266800344 0.273247242 0.279400229 0.285950363 0.29199183 0.297774673 0.303560674 0.308916301 0.31400311 0.31928286 0.32434094 0.329910636 0.334892631 0.340375304 0.346113145 0.351349741 0.35582599 0.361063421 0.365506291 0.370502681 0.375473857 0.380530596 0.385933727 0.390796065 0.395516634 0.399711728 0.403657228 0.407511324 0.411407351 0.414492071 0.418290377 0.422045469 0.425624013 0.429504603 0.433354795 0.437512279 0.440591753 0.444636256 0.448515266 0.452828228 0.457120538 0.461000204 0.465641022 0.470082879 0.473562717 0.476881027 0.481023043 0.484841049 0.489004374 0.492964149 0.497756898 0.502554178 0.508127689 0.512580752 0.517151356 0.521912336 0.526768684 0.531945586 0.537641764 0.54351306 0.549231291 0.554140449 0.559544861 0.565208673 0.570619941 0.576791525 0.582656741 0.589229405 0.595623493 0.603606224 0.61062175 0.617150068 0.624414444 0.631739974 0.64039278 0.648706555 0.658177972 0.666778803 0.674910486 0.684819102 0.695520401 0.704539895 0.716269732 0.7279917 0.742693663 0.754562736 0.768156767 0.788401365 0.809221864 0.833513975 0.867131591 0.915329099 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.6506596 22.4943829 23.1382389 23.8136673 24.4562645 25.0402832 25.5364761 26.0325317 26.534626 27.0099068 27.3714943 27.7964497 28.2407112 28.6579723 29.0411682 29.4225616 29.7968521 30.1755447 30.5146484 30.8276367 31.1202164 31.4319763 31.7509594 32.0553017 32.3926353 32.7498932 33.1274948 33.4697723 33.8168182 34.191021 34.4645386 34.8312607 35.1596718 35.4924545 35.8146362 36.1210938 36.4535065 36.8025742 37.1513367 37.4726028 37.8233643 38.1662903 38.5038834 38.8195419 39.1873627 39.5707016 39.8854446 40.257164 40.5874405 40.9378624 41.2952194 41.678627 42.0631294 42.4690018 42.8638229 43.1893578 43.5714035 43.963871 44.353447 44.7559662 45.1715622 45.6208115 46.055809 46.4593735 46.9105072 47.3701515 47.8568153 48.3030548 48.8453979 49.3457947 49.8624115 50.4600906 50.9852676 51.5956268 52.2079201 52.8108482 53.5320663 54.1959076 54.9674683 55.7413406 56.5939255 57.4286346 58.3983688 59.2081451 60.1670074 61.202137 62.3166656 63.5516891 65.0584259 66.8559723 68.6372681 70.384758 72.7810211 75.2728729 78.0468216 81.697113 86.2846375 89.943367 99.9009094 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6448269 11.1315784 11.5247574 11.970005 12.3240366 12.6910248 13.0958853 13.445219 13.7299442 14.0757771 14.4518051 14.716814 15.0937757 15.4381256 15.7414474 16.1066589 16.4222832 16.6890297 16.9638863 17.2952347 17.6172218 17.8747978 18.1509209 18.4801311 18.7543907 19.0795517 19.36623 19.7474365 20.1209221 20.4641705 20.8406296 21.1767883 21.4812717 21.7899017 22.1230583 22.4817295 22.8267593 23.1218758 23.3991394 23.7296829 24.0825195 24.3888245 24.7280197 25.0257912 25.3539982 25.6220894 25.9082222 26.270752 26.6075554 26.951973 27.3175163 27.6216507 27.9021301 28.1962814 28.5378399 28.9052277 29.244257 29.6027527 29.9401054 30.3132305 30.6625938 31.0298538 31.3783188 31.732338 32.0629501 32.41008 32.789566 33.2007141 33.5164146 33.8872948 34.2722778 34.6639938 35.0351067 35.5000343 35.9810715 36.4239082 36.8542938 37.2827988 37.7364883 38.2107582 38.7624741 39.2716255 39.8191566 40.2148972 40.9062233 41.5415688 42.3053093 43.0185051 43.8665924 44.709446 45.6760292 46.8780403 48.0118637 49.4658203 51.0687714 52.9322968 55.4172096 59.4354782 65.8491592 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.8 51.8 57.2 32.7 51.6 65.1 57.6 66.4 -26.5 -19.0 -43.2 12.8 31.9 2 67.8 100.0 66.7 64.9 37.6 70.2 94.7 76.6 92.0 -43.5 -26.5 -53.2 28.4 40.4 3 51.8 66.7 100.0 51.9 10.8 35.2 70.1 54.4 72.0 -15.6 -28.3 -57.8 60.2 31.9 4 57.2 64.9 51.9 100.0 21.2 42.1 64.9 57.5 72.0 -11.9 -31.9 -67.0 21.6 74.3 5 32.7 37.6 10.8 21.2 100.0 84.5 10.6 58.9 58.3 23.2 -9.9 -16.2 -4.6 9.9 6 51.6 70.2 35.2 42.1 84.5 100.0 49.7 80.1 80.3 -7.3 -18.1 -33.8 8.5 24.1 7 65.1 94.7 70.1 64.9 10.6 49.7 100.0 67.9 81.0 -52.0 -25.5 -53.3 32.8 41.5 8 57.6 76.6 54.4 57.5 58.9 80.1 67.9 100.0 84.4 -10.5 -26.0 -48.3 22.2 36.4 9 66.4 92.0 72.0 72.0 58.3 80.3 81.0 84.4 100.0 -19.6 -29.9 -60.0 32.6 46.6 10 -26.5 -43.5 -15.6 -11.9 23.2 -7.3 -52.0 -10.5 -19.6 100.0 3.5 8.2 -3.3 -4.7 11 -19.0 -26.5 -28.3 -31.9 -9.9 -18.1 -25.5 -26.0 -29.9 3.5 100.0 53.6 -11.1 -22.6 12 -43.2 -53.2 -57.8 -67.0 -16.2 -33.8 -53.3 -48.3 -60.0 8.2 53.6 100.0 -26.1 -44.4 13 12.8 28.4 60.2 21.6 -4.6 8.5 32.8 22.2 32.6 -3.3 -11.1 -26.1 100.0 49.0 14 31.9 40.4 31.9 74.3 9.9 24.1 41.5 36.4 46.6 -4.7 -22.6 -44.4 49.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.268182 TOTAL CORRELATION OF ALL VARIABLES 74.6380987 ROUND 1: MAX CORR ( 74.6360076) AFTER KILLING INPUT VARIABLE 8 CONTR 0.558695434 ROUND 2: MAX CORR ( 74.6328795) AFTER KILLING INPUT VARIABLE 14 CONTR 0.683324361 ROUND 3: MAX CORR ( 74.6267837) AFTER KILLING INPUT VARIABLE 6 CONTR 0.953868822 ROUND 4: MAX CORR ( 74.6169307) AFTER KILLING INPUT VARIABLE 2 CONTR 1.21263609 ROUND 5: MAX CORR ( 74.6060472) AFTER KILLING INPUT VARIABLE 12 CONTR 1.27439232 ROUND 6: MAX CORR ( 74.5210661) AFTER KILLING INPUT VARIABLE 11 CONTR 3.55991433 ROUND 7: MAX CORR ( 74.2193923) AFTER KILLING INPUT VARIABLE 10 CONTR 6.69858924 ROUND 8: MAX CORR ( 73.2490198) AFTER KILLING INPUT VARIABLE 13 CONTR 11.9624112 ROUND 9: MAX CORR ( 71.9813511) AFTER KILLING INPUT VARIABLE 3 CONTR 13.568493 ROUND 10: MAX CORR ( 71.6743084) AFTER KILLING INPUT VARIABLE 9 CONTR 6.64141737 ROUND 11: MAX CORR ( 70.0723866) AFTER KILLING INPUT VARIABLE 4 CONTR 15.0687465 ROUND 12: MAX CORR ( 65.0985754) AFTER KILLING INPUT VARIABLE 5 CONTR 25.9290347 LAST REMAINING VARIABLE: 7 total correlation to target: 74.6380987 % total significance: 158.333239 sigma correlations of single variables to target: variable 2: 67.8083492 % , in sigma: 143.844976 variable 3: 51.7970137 % , in sigma: 109.879393 variable 4: 57.2460368 % , in sigma: 121.438656 variable 5: 32.7137593 % , in sigma: 69.3972053 variable 6: 51.6479163 % , in sigma: 109.563105 variable 7: 65.0985754 % , in sigma: 138.096608 variable 8: 57.5976541 % , in sigma: 122.184558 variable 9: 66.4366221 % , in sigma: 140.935069 variable 10: -26.4678403 % , in sigma: 56.1474496 variable 11: -18.9891241 % , in sigma: 40.2825042 variable 12: -43.1723926 % , in sigma: 91.5835863 variable 13: 12.7687585 % , in sigma: 27.086956 variable 14: 31.8829292 % , in sigma: 67.6347273 variables sorted by significance: 1 most relevant variable 7 corr 65.0985718 , in sigma: 138.096601 2 most relevant variable 5 corr 25.9290352 , in sigma: 55.0044574 3 most relevant variable 4 corr 15.0687466 , in sigma: 31.9660266 4 most relevant variable 9 corr 6.6414175 , in sigma: 14.0887451 5 most relevant variable 3 corr 13.5684929 , in sigma: 28.7834693 6 most relevant variable 13 corr 11.9624109 , in sigma: 25.3764137 7 most relevant variable 10 corr 6.69858932 , in sigma: 14.2100263 8 most relevant variable 11 corr 3.55991435 , in sigma: 7.55181039 9 most relevant variable 12 corr 1.27439237 , in sigma: 2.70342726 10 most relevant variable 2 corr 1.21263611 , in sigma: 2.57242088 11 most relevant variable 6 corr 0.953868806 , in sigma: 2.02348586 12 most relevant variable 14 corr 0.683324337 , in sigma: 1.44956741 13 most relevant variable 8 corr 0.558695436 , in sigma: 1.18518638 global correlations between input variables: variable 2: 99.2034316 % variable 3: 92.2398191 % variable 4: 92.9541815 % variable 5: 95.5155725 % variable 6: 95.1047643 % variable 7: 98.8584628 % variable 8: 90.0503965 % variable 9: 98.7545288 % variable 10: 71.6681945 % variable 11: 54.626664 % variable 12: 78.6213678 % variable 13: 83.506709 % variable 14: 88.4856868 % significance loss when removing single variables: variable 2: corr = 1.41520986 % , sigma = 3.0021499 variable 3: corr = 16.360689 % , sigma = 34.7066836 variable 4: corr = 13.1113145 % , sigma = 27.8136357 variable 5: corr = 16.8542949 % , sigma = 35.7537926 variable 6: corr = 1.09556073 % , sigma = 2.32406347 variable 7: corr = 8.65706732 % , sigma = 18.3646359 variable 8: corr = 0.558695434 % , sigma = 1.18518638 variable 9: corr = 11.4881637 % , sigma = 24.3703712 variable 10: corr = 6.40733001 % , sigma = 13.5921645 variable 11: corr = 2.75595334 % , sigma = 5.84633084 variable 12: corr = 1.20669692 % , sigma = 2.5598218 variable 13: corr = 8.88642478 % , sigma = 18.8511825 variable 14: corr = 0.683572476 % , sigma = 1.4500938 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 14.7339764 sigma out 15 active outputs RANK 2 NODE 7 --> 14.2038708 sigma out 15 active outputs RANK 3 NODE 4 --> 12.9902544 sigma out 15 active outputs RANK 4 NODE 9 --> 12.8321638 sigma out 15 active outputs RANK 5 NODE 5 --> 12.3199902 sigma out 15 active outputs RANK 6 NODE 2 --> 12.2528 sigma out 15 active outputs RANK 7 NODE 1 --> 11.9799156 sigma out 15 active outputs RANK 8 NODE 8 --> 10.1606121 sigma out 15 active outputs RANK 9 NODE 3 --> 9.65565872 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 22.5633335 sigma in 9act. ( 27.1714039 sig out 1act.) RANK 2 NODE 9 --> 14.8656073 sigma in 9act. ( 11.7600441 sig out 1act.) RANK 3 NODE 8 --> 14.542594 sigma in 9act. ( 7.41601229 sig out 1act.) RANK 4 NODE 7 --> 11.047781 sigma in 9act. ( 9.36666489 sig out 1act.) RANK 5 NODE 11 --> 9.41594696 sigma in 9act. ( 16.7747803 sig out 1act.) RANK 6 NODE 6 --> 7.81798077 sigma in 9act. ( 6.35325432 sig out 1act.) RANK 7 NODE 14 --> 6.72282743 sigma in 9act. ( 5.29591703 sig out 1act.) RANK 8 NODE 1 --> 6.3733058 sigma in 9act. ( 5.80611372 sig out 1act.) RANK 9 NODE 15 --> 5.35888386 sigma in 9act. ( 7.13091135 sig out 1act.) RANK 10 NODE 13 --> 5.35038948 sigma in 9act. ( 7.83043575 sig out 1act.) RANK 11 NODE 2 --> 3.73061347 sigma in 9act. ( 3.49687552 sig out 1act.) RANK 12 NODE 5 --> 3.63659763 sigma in 9act. ( 1.26635802 sig out 1act.) RANK 13 NODE 3 --> 2.16981459 sigma in 9act. ( 3.32851863 sig out 1act.) RANK 14 NODE 10 --> 2.07852578 sigma in 9act. ( 2.62201953 sig out 1act.) RANK 15 NODE 4 --> 1.18763041 sigma in 9act. ( 0.734687269 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 27.1714039 sigma out 1act.( 22.5633335 sig in 9act.) RANK 2 NODE 11 --> 16.7747803 sigma out 1act.( 9.41594696 sig in 9act.) RANK 3 NODE 9 --> 11.7600441 sigma out 1act.( 14.8656073 sig in 9act.) RANK 4 NODE 7 --> 9.36666489 sigma out 1act.( 11.047781 sig in 9act.) RANK 5 NODE 13 --> 7.83043575 sigma out 1act.( 5.35038948 sig in 9act.) RANK 6 NODE 8 --> 7.41601229 sigma out 1act.( 14.542594 sig in 9act.) RANK 7 NODE 15 --> 7.13091135 sigma out 1act.( 5.35888386 sig in 9act.) RANK 8 NODE 6 --> 6.35325432 sigma out 1act.( 7.81798077 sig in 9act.) RANK 9 NODE 1 --> 5.80611372 sigma out 1act.( 6.3733058 sig in 9act.) RANK 10 NODE 14 --> 5.29591703 sigma out 1act.( 6.72282743 sig in 9act.) RANK 11 NODE 2 --> 3.49687552 sigma out 1act.( 3.73061347 sig in 9act.) RANK 12 NODE 3 --> 3.32851863 sigma out 1act.( 2.16981459 sig in 9act.) RANK 13 NODE 10 --> 2.62201953 sigma out 1act.( 2.07852578 sig in 9act.) RANK 14 NODE 5 --> 1.26635802 sigma out 1act.( 3.63659763 sig in 9act.) RANK 15 NODE 4 --> 0.734687269 sigma out 1act.( 1.18763041 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 39.3360062 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.5524902 sigma out 15 active outputs RANK 2 NODE 5 --> 16.0435371 sigma out 15 active outputs RANK 3 NODE 1 --> 15.0270042 sigma out 15 active outputs RANK 4 NODE 7 --> 14.7154579 sigma out 15 active outputs RANK 5 NODE 8 --> 14.4793634 sigma out 15 active outputs RANK 6 NODE 9 --> 14.2145557 sigma out 15 active outputs RANK 7 NODE 6 --> 13.1191769 sigma out 15 active outputs RANK 8 NODE 4 --> 12.6046658 sigma out 15 active outputs RANK 9 NODE 3 --> 9.70303249 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 25.6851807 sigma in 9act. ( 25.7213764 sig out 1act.) RANK 2 NODE 11 --> 19.909399 sigma in 9act. ( 17.262661 sig out 1act.) RANK 3 NODE 9 --> 12.1080074 sigma in 9act. ( 10.2980614 sig out 1act.) RANK 4 NODE 3 --> 11.4274139 sigma in 9act. ( 5.48177767 sig out 1act.) RANK 5 NODE 13 --> 10.9773712 sigma in 9act. ( 8.47515965 sig out 1act.) RANK 6 NODE 10 --> 10.6013641 sigma in 9act. ( 4.47634554 sig out 1act.) RANK 7 NODE 15 --> 9.65597916 sigma in 9act. ( 7.97062588 sig out 1act.) RANK 8 NODE 8 --> 9.36780834 sigma in 9act. ( 5.86727571 sig out 1act.) RANK 9 NODE 2 --> 8.47235775 sigma in 9act. ( 5.01664972 sig out 1act.) RANK 10 NODE 7 --> 8.23069668 sigma in 9act. ( 7.74097586 sig out 1act.) RANK 11 NODE 14 --> 6.93762827 sigma in 9act. ( 4.49921513 sig out 1act.) RANK 12 NODE 6 --> 6.73600674 sigma in 9act. ( 5.41115141 sig out 1act.) RANK 13 NODE 4 --> 6.5170846 sigma in 9act. ( 2.69181323 sig out 1act.) RANK 14 NODE 1 --> 6.3410697 sigma in 9act. ( 5.38731909 sig out 1act.) RANK 15 NODE 5 --> 5.33069515 sigma in 9act. ( 0.931770742 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 25.7213764 sigma out 1act.( 25.6851807 sig in 9act.) RANK 2 NODE 11 --> 17.262661 sigma out 1act.( 19.909399 sig in 9act.) RANK 3 NODE 9 --> 10.2980614 sigma out 1act.( 12.1080074 sig in 9act.) RANK 4 NODE 13 --> 8.47515965 sigma out 1act.( 10.9773712 sig in 9act.) RANK 5 NODE 15 --> 7.97062588 sigma out 1act.( 9.65597916 sig in 9act.) RANK 6 NODE 7 --> 7.74097586 sigma out 1act.( 8.23069668 sig in 9act.) RANK 7 NODE 8 --> 5.86727571 sigma out 1act.( 9.36780834 sig in 9act.) RANK 8 NODE 3 --> 5.48177767 sigma out 1act.( 11.4274139 sig in 9act.) RANK 9 NODE 6 --> 5.41115141 sigma out 1act.( 6.73600674 sig in 9act.) RANK 10 NODE 1 --> 5.38731909 sigma out 1act.( 6.3410697 sig in 9act.) RANK 11 NODE 2 --> 5.01664972 sigma out 1act.( 8.47235775 sig in 9act.) RANK 12 NODE 14 --> 4.49921513 sigma out 1act.( 6.93762827 sig in 9act.) RANK 13 NODE 10 --> 4.47634554 sigma out 1act.( 10.6013641 sig in 9act.) RANK 14 NODE 4 --> 2.69181323 sigma out 1act.( 6.5170846 sig in 9act.) RANK 15 NODE 5 --> 0.931770742 sigma out 1act.( 5.33069515 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.1740837 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.387642235 *** contribution from regularisation: 0.00400860142 *** contribution from error: -0.391650826 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.452397287 *** contribution from regularisation: 0.00166686217 *** contribution from error: -0.454064161 *********************************************** -----------------> Test sample ENTER BFGS code START -44323.4668 0.388620138 -0.293165803 EXIT FROM BFGS code FG_START 0. 0.388620138 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.477803081 *** contribution from regularisation: 0.00185431715 *** contribution from error: -0.479657412 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46802.2457 0.388620138 90.3870544 EXIT FROM BFGS code FG_LNSRCH 0. 0.396481037 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.542324662 *** contribution from regularisation: 0.00309411041 *** contribution from error: -0.545418799 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53122.327 0.396481037 152.758469 EXIT FROM BFGS code NEW_X -53122.327 0.396481037 152.758469 ENTER BFGS code NEW_X -53122.327 0.396481037 152.758469 EXIT FROM BFGS code FG_LNSRCH 0. 0.413300157 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.546379566 *** contribution from regularisation: 0.00307305902 *** contribution from error: -0.549452603 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53519.5192 0.413300157 86.1373062 EXIT FROM BFGS code NEW_X -53519.5192 0.413300157 86.1373062 ENTER BFGS code NEW_X -53519.5192 0.413300157 86.1373062 EXIT FROM BFGS code FG_LNSRCH 0. 0.433944196 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.549808681 *** contribution from regularisation: 0.00264216028 *** contribution from error: -0.552450836 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53855.4095 0.433944196 19.2783585 EXIT FROM BFGS code NEW_X -53855.4095 0.433944196 19.2783585 ENTER BFGS code NEW_X -53855.4095 0.433944196 19.2783585 EXIT FROM BFGS code FG_LNSRCH 0. 0.439915538 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.551254034 *** contribution from regularisation: 0.00228014216 *** contribution from error: -0.55353415 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53996.9876 0.439915538 -13.0472412 EXIT FROM BFGS code NEW_X -53996.9876 0.439915538 -13.0472412 ENTER BFGS code NEW_X -53996.9876 0.439915538 -13.0472412 EXIT FROM BFGS code FG_LNSRCH 0. 0.437870771 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.551528335 *** contribution from regularisation: 0.0022069246 *** contribution from error: -0.553735256 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54023.8538 0.437870771 -11.0857906 EXIT FROM BFGS code NEW_X -54023.8538 0.437870771 -11.0857906 ENTER BFGS code NEW_X -54023.8538 0.437870771 -11.0857906 EXIT FROM BFGS code FG_LNSRCH 0. 0.432575345 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.551754951 *** contribution from regularisation: 0.00218690606 *** contribution from error: -0.553941846 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54046.0528 0.432575345 4.67516041 EXIT FROM BFGS code NEW_X -54046.0528 0.432575345 4.67516041 ENTER BFGS code NEW_X -54046.0528 0.432575345 4.67516041 EXIT FROM BFGS code FG_LNSRCH 0. 0.416474938 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 41.6834526 sigma out 15 active outputs RANK 2 NODE 1 --> 24.489357 sigma out 15 active outputs RANK 3 NODE 8 --> 21.6118202 sigma out 15 active outputs RANK 4 NODE 5 --> 17.8270931 sigma out 15 active outputs RANK 5 NODE 4 --> 15.6144934 sigma out 15 active outputs RANK 6 NODE 7 --> 13.9557247 sigma out 15 active outputs RANK 7 NODE 3 --> 13.2484989 sigma out 15 active outputs RANK 8 NODE 9 --> 13.0851669 sigma out 15 active outputs RANK 9 NODE 6 --> 9.89924145 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 26.7924213 sigma in 9act. ( 22.9251804 sig out 1act.) RANK 2 NODE 10 --> 25.0760479 sigma in 9act. ( 21.4798679 sig out 1act.) RANK 3 NODE 3 --> 23.5190849 sigma in 9act. ( 22.2608376 sig out 1act.) RANK 4 NODE 15 --> 23.1798 sigma in 9act. ( 21.262331 sig out 1act.) RANK 5 NODE 4 --> 22.7262955 sigma in 9act. ( 18.9167957 sig out 1act.) RANK 6 NODE 2 --> 17.691452 sigma in 9act. ( 12.9002638 sig out 1act.) RANK 7 NODE 13 --> 17.6181068 sigma in 9act. ( 16.8086529 sig out 1act.) RANK 8 NODE 12 --> 14.1361933 sigma in 9act. ( 11.3433132 sig out 1act.) RANK 9 NODE 6 --> 9.13622856 sigma in 9act. ( 7.96460438 sig out 1act.) RANK 10 NODE 1 --> 6.15465784 sigma in 9act. ( 5.73991489 sig out 1act.) RANK 11 NODE 7 --> 6.04636765 sigma in 9act. ( 5.83304644 sig out 1act.) RANK 12 NODE 9 --> 5.79538345 sigma in 9act. ( 4.59867811 sig out 1act.) RANK 13 NODE 8 --> 4.07761908 sigma in 9act. ( 0.548770368 sig out 1act.) RANK 14 NODE 14 --> 3.25235295 sigma in 9act. ( 0.264762342 sig out 1act.) RANK 15 NODE 5 --> 3.15188861 sigma in 9act. ( 0.881411672 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 22.9251804 sigma out 1act.( 26.7924213 sig in 9act.) RANK 2 NODE 3 --> 22.2608376 sigma out 1act.( 23.5190849 sig in 9act.) RANK 3 NODE 10 --> 21.4798679 sigma out 1act.( 25.0760479 sig in 9act.) RANK 4 NODE 15 --> 21.262331 sigma out 1act.( 23.1798 sig in 9act.) RANK 5 NODE 4 --> 18.9167957 sigma out 1act.( 22.7262955 sig in 9act.) RANK 6 NODE 13 --> 16.8086529 sigma out 1act.( 17.6181068 sig in 9act.) RANK 7 NODE 2 --> 12.9002638 sigma out 1act.( 17.691452 sig in 9act.) RANK 8 NODE 12 --> 11.3433132 sigma out 1act.( 14.1361933 sig in 9act.) RANK 9 NODE 6 --> 7.96460438 sigma out 1act.( 9.13622856 sig in 9act.) RANK 10 NODE 7 --> 5.83304644 sigma out 1act.( 6.04636765 sig in 9act.) RANK 11 NODE 1 --> 5.73991489 sigma out 1act.( 6.15465784 sig in 9act.) RANK 12 NODE 9 --> 4.59867811 sigma out 1act.( 5.79538345 sig in 9act.) RANK 13 NODE 5 --> 0.881411672 sigma out 1act.( 3.15188861 sig in 9act.) RANK 14 NODE 8 --> 0.548770368 sigma out 1act.( 4.07761908 sig in 9act.) RANK 15 NODE 14 --> 0.264762342 sigma out 1act.( 3.25235295 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.9794998 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.55257374 *** contribution from regularisation: 0.00211443007 *** contribution from error: -0.554688156 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54126.254 0.416474938 30.2082481 EXIT FROM BFGS code NEW_X -54126.254 0.416474938 30.2082481 ENTER BFGS code NEW_X -54126.254 0.416474938 30.2082481 EXIT FROM BFGS code FG_LNSRCH 0. 0.409498155 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.553115845 *** contribution from regularisation: 0.00228215335 *** contribution from error: -0.555397987 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54179.3576 0.409498155 51.1060333 EXIT FROM BFGS code NEW_X -54179.3576 0.409498155 51.1060333 ENTER BFGS code NEW_X -54179.3576 0.409498155 51.1060333 EXIT FROM BFGS code FG_LNSRCH 0. 0.412378609 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.553775489 *** contribution from regularisation: 0.00253921933 *** contribution from error: -0.556314707 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54243.9681 0.412378609 13.0281 EXIT FROM BFGS code NEW_X -54243.9681 0.412378609 13.0281 ENTER BFGS code NEW_X -54243.9681 0.412378609 13.0281 EXIT FROM BFGS code FG_LNSRCH 0. 0.421625793 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.553986907 *** contribution from regularisation: 0.00252654753 *** contribution from error: -0.556513429 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54264.6792 0.421625793 -27.4627857 EXIT FROM BFGS code NEW_X -54264.6792 0.421625793 -27.4627857 ENTER BFGS code NEW_X -54264.6792 0.421625793 -27.4627857 EXIT FROM BFGS code FG_LNSRCH 0. 0.417399436 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.554169118 *** contribution from regularisation: 0.0024930723 *** contribution from error: -0.556662202 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54282.5291 0.417399436 0.552802026 EXIT FROM BFGS code NEW_X -54282.5291 0.417399436 0.552802026 ENTER BFGS code NEW_X -54282.5291 0.417399436 0.552802026 EXIT FROM BFGS code FG_LNSRCH 0. 0.416974932 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.554226339 *** contribution from regularisation: 0.00251604733 *** contribution from error: -0.55674237 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54288.1314 0.416974932 3.93435431 EXIT FROM BFGS code NEW_X -54288.1314 0.416974932 3.93435431 ENTER BFGS code NEW_X -54288.1314 0.416974932 3.93435431 EXIT FROM BFGS code FG_LNSRCH 0. 0.416649222 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.554317713 *** contribution from regularisation: 0.00253585493 *** contribution from error: -0.556853592 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54297.0847 0.416649222 10.1781197 EXIT FROM BFGS code NEW_X -54297.0847 0.416649222 10.1781197 ENTER BFGS code NEW_X -54297.0847 0.416649222 10.1781197 EXIT FROM BFGS code FG_LNSRCH 0. 0.419822276 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.554528415 *** contribution from regularisation: 0.00256369868 *** contribution from error: -0.55709213 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54317.7199 0.419822276 13.202404 EXIT FROM BFGS code NEW_X -54317.7199 0.419822276 13.202404 ENTER BFGS code NEW_X -54317.7199 0.419822276 13.202404 EXIT FROM BFGS code FG_LNSRCH 0. 0.430654109 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.554934561 *** contribution from regularisation: 0.00268525141 *** contribution from error: -0.55761981 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54357.5052 0.430654109 12.2812033 EXIT FROM BFGS code NEW_X -54357.5052 0.430654109 12.2812033 ENTER BFGS code NEW_X -54357.5052 0.430654109 12.2812033 EXIT FROM BFGS code FG_LNSRCH 0. 0.444990695 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.554977238 *** contribution from regularisation: 0.00281958212 *** contribution from error: -0.557796836 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54361.6873 0.444990695 -14.8323431 EXIT FROM BFGS code FG_LNSRCH 0. 0.436968237 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 53.7564125 sigma out 15 active outputs RANK 2 NODE 1 --> 35.439785 sigma out 15 active outputs RANK 3 NODE 8 --> 29.622757 sigma out 15 active outputs RANK 4 NODE 4 --> 28.6842995 sigma out 15 active outputs RANK 5 NODE 7 --> 24.7841702 sigma out 15 active outputs RANK 6 NODE 5 --> 21.9797955 sigma out 15 active outputs RANK 7 NODE 3 --> 20.5397015 sigma out 15 active outputs RANK 8 NODE 6 --> 16.8317909 sigma out 15 active outputs RANK 9 NODE 9 --> 16.3153248 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 45.5754433 sigma in 9act. ( 42.2841263 sig out 1act.) RANK 2 NODE 13 --> 36.6777039 sigma in 9act. ( 35.4080467 sig out 1act.) RANK 3 NODE 10 --> 32.5787201 sigma in 9act. ( 38.0104332 sig out 1act.) RANK 4 NODE 4 --> 31.1240978 sigma in 9act. ( 26.2040253 sig out 1act.) RANK 5 NODE 11 --> 29.6886978 sigma in 9act. ( 31.1907368 sig out 1act.) RANK 6 NODE 3 --> 23.9356174 sigma in 9act. ( 24.6683044 sig out 1act.) RANK 7 NODE 2 --> 17.9259491 sigma in 9act. ( 14.7906971 sig out 1act.) RANK 8 NODE 7 --> 15.9253235 sigma in 9act. ( 17.9802494 sig out 1act.) RANK 9 NODE 6 --> 12.6192122 sigma in 9act. ( 13.212986 sig out 1act.) RANK 10 NODE 1 --> 10.5781317 sigma in 9act. ( 11.5652561 sig out 1act.) RANK 11 NODE 9 --> 9.38116646 sigma in 9act. ( 10.7019939 sig out 1act.) RANK 12 NODE 12 --> 5.24379778 sigma in 9act. ( 4.10858011 sig out 1act.) RANK 13 NODE 5 --> 5.23350334 sigma in 9act. ( 5.19446659 sig out 1act.) RANK 14 NODE 14 --> 3.63219237 sigma in 9act. ( 3.03595662 sig out 1act.) RANK 15 NODE 8 --> 2.40799475 sigma in 9act. ( 0.972734153 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 42.2841263 sigma out 1act.( 45.5754433 sig in 9act.) RANK 2 NODE 10 --> 38.0104332 sigma out 1act.( 32.5787201 sig in 9act.) RANK 3 NODE 13 --> 35.4080467 sigma out 1act.( 36.6777039 sig in 9act.) RANK 4 NODE 11 --> 31.1907368 sigma out 1act.( 29.6886978 sig in 9act.) RANK 5 NODE 4 --> 26.2040253 sigma out 1act.( 31.1240978 sig in 9act.) RANK 6 NODE 3 --> 24.6683044 sigma out 1act.( 23.9356174 sig in 9act.) RANK 7 NODE 7 --> 17.9802494 sigma out 1act.( 15.9253235 sig in 9act.) RANK 8 NODE 2 --> 14.7906971 sigma out 1act.( 17.9259491 sig in 9act.) RANK 9 NODE 6 --> 13.212986 sigma out 1act.( 12.6192122 sig in 9act.) RANK 10 NODE 1 --> 11.5652561 sigma out 1act.( 10.5781317 sig in 9act.) RANK 11 NODE 9 --> 10.7019939 sigma out 1act.( 9.38116646 sig in 9act.) RANK 12 NODE 5 --> 5.19446659 sigma out 1act.( 5.23350334 sig in 9act.) RANK 13 NODE 12 --> 4.10858011 sigma out 1act.( 5.24379778 sig in 9act.) RANK 14 NODE 14 --> 3.03595662 sigma out 1act.( 3.63219237 sig in 9act.) RANK 15 NODE 8 --> 0.972734153 sigma out 1act.( 2.40799475 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 88.1672211 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.555382192 *** contribution from regularisation: 0.00249797339 *** contribution from error: -0.557880163 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54401.3498 0.436968237 0.752064168 EXIT FROM BFGS code NEW_X -54401.3498 0.436968237 0.752064168 ENTER BFGS code NEW_X -54401.3498 0.436968237 0.752064168 EXIT FROM BFGS code FG_LNSRCH 0. 0.439782143 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.555414498 *** contribution from regularisation: 0.00264124153 *** contribution from error: -0.558055758 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54404.5152 0.439782143 -17.6725731 EXIT FROM BFGS code NEW_X -54404.5152 0.439782143 -17.6725731 ENTER BFGS code NEW_X -54404.5152 0.439782143 -17.6725731 EXIT FROM BFGS code FG_LNSRCH 0. 0.436081052 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.555501759 *** contribution from regularisation: 0.00258020801 *** contribution from error: -0.558081985 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54413.0622 0.436081052 -6.25127983 EXIT FROM BFGS code NEW_X -54413.0622 0.436081052 -6.25127983 ENTER BFGS code NEW_X -54413.0622 0.436081052 -6.25127983 EXIT FROM BFGS code FG_LNSRCH 0. 0.430285811 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.555643618 *** contribution from regularisation: 0.00249107927 *** contribution from error: -0.558134675 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54426.9589 0.430285811 -20.4045868 EXIT FROM BFGS code NEW_X -54426.9589 0.430285811 -20.4045868 ENTER BFGS code NEW_X -54426.9589 0.430285811 -20.4045868 EXIT FROM BFGS code FG_LNSRCH 0. 0.390729815 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.555295706 *** contribution from regularisation: 0.00243937061 *** contribution from error: -0.557735085 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54392.8799 0.390729815 113.23497 EXIT FROM BFGS code FG_LNSRCH 0. 0.420201361 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.555411756 *** contribution from regularisation: 0.00277037662 *** contribution from error: -0.55818212 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54404.2449 0.420201361 11.9366207 EXIT FROM BFGS code FG_LNSRCH 0. 0.429507077 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.555487812 *** contribution from regularisation: 0.00265311846 *** contribution from error: -0.558140934 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54411.6982 0.429507077 -17.8773956 EXIT FROM BFGS code FG_LNSRCH 0. 0.430276692 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.555519998 *** contribution from regularisation: 0.0026147787 *** contribution from error: -0.558134794 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54414.8491 0.430276692 -20.2897892 EXIT FROM BFGS code FG_LNSRCH 0. 0.430285811 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.55552417 *** contribution from regularisation: 0.00261053001 *** contribution from error: -0.558134675 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54415.2584 0.430285811 -20.3253078 EXIT FROM BFGS code FG_LNSRCH 0. 0.430285811 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.555518329 *** contribution from regularisation: 0.00261634146 *** contribution from error: -0.558134675 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54414.6891 0.430285811 -20.3175716 EXIT FROM BFGS code FG_LNSRCH 0. 0.430285811 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 53.0844612 sigma out 15 active outputs RANK 2 NODE 1 --> 34.5602379 sigma out 15 active outputs RANK 3 NODE 4 --> 27.7766228 sigma out 15 active outputs RANK 4 NODE 8 --> 27.1894112 sigma out 15 active outputs RANK 5 NODE 7 --> 22.6658516 sigma out 15 active outputs RANK 6 NODE 5 --> 21.5164909 sigma out 15 active outputs RANK 7 NODE 3 --> 19.498867 sigma out 15 active outputs RANK 8 NODE 6 --> 17.2754898 sigma out 15 active outputs RANK 9 NODE 9 --> 14.9482584 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 43.8087273 sigma in 9act. ( 40.6929779 sig out 1act.) RANK 2 NODE 13 --> 37.5072289 sigma in 9act. ( 36.0987701 sig out 1act.) RANK 3 NODE 10 --> 32.7513313 sigma in 9act. ( 37.1481781 sig out 1act.) RANK 4 NODE 4 --> 29.3582134 sigma in 9act. ( 24.5105572 sig out 1act.) RANK 5 NODE 11 --> 25.9685764 sigma in 9act. ( 27.4710026 sig out 1act.) RANK 6 NODE 3 --> 22.0798321 sigma in 9act. ( 22.5138226 sig out 1act.) RANK 7 NODE 2 --> 17.8539925 sigma in 9act. ( 14.8333321 sig out 1act.) RANK 8 NODE 7 --> 15.7311592 sigma in 9act. ( 18.1048145 sig out 1act.) RANK 9 NODE 6 --> 11.8642187 sigma in 9act. ( 12.2447262 sig out 1act.) RANK 10 NODE 1 --> 10.1570511 sigma in 9act. ( 11.1573229 sig out 1act.) RANK 11 NODE 9 --> 9.46666908 sigma in 9act. ( 10.6886091 sig out 1act.) RANK 12 NODE 12 --> 5.54912376 sigma in 9act. ( 4.47372007 sig out 1act.) RANK 13 NODE 5 --> 5.51257658 sigma in 9act. ( 5.47907019 sig out 1act.) RANK 14 NODE 14 --> 3.53713226 sigma in 9act. ( 2.8950367 sig out 1act.) RANK 15 NODE 8 --> 2.46298122 sigma in 9act. ( 0.913028896 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 40.6929779 sigma out 1act.( 43.8087273 sig in 9act.) RANK 2 NODE 10 --> 37.1481781 sigma out 1act.( 32.7513313 sig in 9act.) RANK 3 NODE 13 --> 36.0987701 sigma out 1act.( 37.5072289 sig in 9act.) RANK 4 NODE 11 --> 27.4710026 sigma out 1act.( 25.9685764 sig in 9act.) RANK 5 NODE 4 --> 24.5105572 sigma out 1act.( 29.3582134 sig in 9act.) RANK 6 NODE 3 --> 22.5138226 sigma out 1act.( 22.0798321 sig in 9act.) RANK 7 NODE 7 --> 18.1048145 sigma out 1act.( 15.7311592 sig in 9act.) RANK 8 NODE 2 --> 14.8333321 sigma out 1act.( 17.8539925 sig in 9act.) RANK 9 NODE 6 --> 12.2447262 sigma out 1act.( 11.8642187 sig in 9act.) RANK 10 NODE 1 --> 11.1573229 sigma out 1act.( 10.1570511 sig in 9act.) RANK 11 NODE 9 --> 10.6886091 sigma out 1act.( 9.46666908 sig in 9act.) RANK 12 NODE 5 --> 5.47907019 sigma out 1act.( 5.51257658 sig in 9act.) RANK 13 NODE 12 --> 4.47372007 sigma out 1act.( 5.54912376 sig in 9act.) RANK 14 NODE 14 --> 2.8950367 sigma out 1act.( 3.53713226 sig in 9act.) RANK 15 NODE 8 --> 0.913028896 sigma out 1act.( 2.46298122 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 84.8354263 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.555521011 *** contribution from regularisation: 0.00261368533 *** contribution from error: -0.558134675 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54414.9493 0.430285811 -20.2815838 EXIT FROM BFGS code FG_LNSRCH 0. 0.430285811 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.555525064 *** contribution from regularisation: 0.00260963361 *** contribution from error: -0.558134675 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54415.3462 0.430285811 -20.2948112 EXIT FROM BFGS code NEW_X -54415.3462 0.430285811 -20.2948112 ENTER BFGS code NEW_X -54415.3462 0.430285811 -20.2948112 EXIT FROM BFGS code CONVERGENC -54415.3462 0.430285811 -20.2948112 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 77.0395584 sigma out 15 active outputs RANK 2 NODE 1 --> 51.5747032 sigma out 15 active outputs RANK 3 NODE 8 --> 40.9962158 sigma out 15 active outputs RANK 4 NODE 4 --> 40.3335991 sigma out 15 active outputs RANK 5 NODE 7 --> 33.1208649 sigma out 15 active outputs RANK 6 NODE 5 --> 31.6020794 sigma out 15 active outputs RANK 7 NODE 3 --> 28.8554821 sigma out 15 active outputs RANK 8 NODE 6 --> 25.6264305 sigma out 15 active outputs RANK 9 NODE 9 --> 23.0521297 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 64.5193329 sigma in 9act. ( 61.459877 sig out 1act.) RANK 2 NODE 13 --> 55.4891319 sigma in 9act. ( 54.5724754 sig out 1act.) RANK 3 NODE 10 --> 47.1430321 sigma in 9act. ( 56.6119728 sig out 1act.) RANK 4 NODE 4 --> 43.3370514 sigma in 9act. ( 36.878231 sig out 1act.) RANK 5 NODE 11 --> 38.6411133 sigma in 9act. ( 40.9298897 sig out 1act.) RANK 6 NODE 3 --> 32.7431297 sigma in 9act. ( 33.5121994 sig out 1act.) RANK 7 NODE 2 --> 26.7503357 sigma in 9act. ( 22.5205345 sig out 1act.) RANK 8 NODE 7 --> 23.2255497 sigma in 9act. ( 26.9458485 sig out 1act.) RANK 9 NODE 6 --> 17.3148727 sigma in 9act. ( 19.0242653 sig out 1act.) RANK 10 NODE 1 --> 14.6839542 sigma in 9act. ( 16.5717926 sig out 1act.) RANK 11 NODE 9 --> 13.7647781 sigma in 9act. ( 16.5495453 sig out 1act.) RANK 12 NODE 5 --> 8.04992867 sigma in 9act. ( 8.24034405 sig out 1act.) RANK 13 NODE 12 --> 7.49255705 sigma in 9act. ( 6.77140236 sig out 1act.) RANK 14 NODE 14 --> 4.86726904 sigma in 9act. ( 4.3895359 sig out 1act.) RANK 15 NODE 8 --> 2.61501718 sigma in 9act. ( 1.35254622 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 61.459877 sigma out 1act.( 64.5193329 sig in 9act.) RANK 2 NODE 10 --> 56.6119728 sigma out 1act.( 47.1430321 sig in 9act.) RANK 3 NODE 13 --> 54.5724754 sigma out 1act.( 55.4891319 sig in 9act.) RANK 4 NODE 11 --> 40.9298897 sigma out 1act.( 38.6411133 sig in 9act.) RANK 5 NODE 4 --> 36.878231 sigma out 1act.( 43.3370514 sig in 9act.) RANK 6 NODE 3 --> 33.5121994 sigma out 1act.( 32.7431297 sig in 9act.) RANK 7 NODE 7 --> 26.9458485 sigma out 1act.( 23.2255497 sig in 9act.) RANK 8 NODE 2 --> 22.5205345 sigma out 1act.( 26.7503357 sig in 9act.) RANK 9 NODE 6 --> 19.0242653 sigma out 1act.( 17.3148727 sig in 9act.) RANK 10 NODE 1 --> 16.5717926 sigma out 1act.( 14.6839542 sig in 9act.) RANK 11 NODE 9 --> 16.5495453 sigma out 1act.( 13.7647781 sig in 9act.) RANK 12 NODE 5 --> 8.24034405 sigma out 1act.( 8.04992867 sig in 9act.) RANK 13 NODE 12 --> 6.77140236 sigma out 1act.( 7.49255705 sig in 9act.) RANK 14 NODE 14 --> 4.3895359 sigma out 1act.( 4.86726904 sig in 9act.) RANK 15 NODE 8 --> 1.35254622 sigma out 1act.( 2.61501718 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 128.051758 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.555519164 *** contribution from regularisation: 0.00261554425 *** contribution from error: -0.558134735 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27724 Closing output file done