NNInput NNInputs_145.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 200569 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 52227 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 52227 Chosen entries: 52227 Signal fraction: 1 Background fraction: 0.352072 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 52227 Entries to split: 52227 Test with : 26113 Train with : 26113 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 52227 for Signal Prepared event 0 for Signal with 52227 events ====Entry 0 Variable Ht : 172.917 Variable LepAPt : 28.3138 Variable LepBPt : 20.098 Variable MetSigLeptonsJets : 7.843 Variable MetSpec : 76.8658 Variable SumEtLeptonsJets : 96.051 Variable VSumJetLeptonsPt : 77.1984 Variable addEt : 125.278 Variable dPhiLepSumMet : 2.50109 Variable dPhiLeptons : 0.378813 Variable dRLeptons : 0.471432 Variable lep1_E : 39.4547 Variable lep2_E : 23.5705 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2145 Ht = 172.917 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 28.314 LepAPt = 28.3138 LepBEt = 20.098 LepBPt = 20.098 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 76.8658 MetDelPhi = 2.27916 MetSig = 5.37355 MetSigLeptonsJets = 7.843 MetSpec = 76.8658 Mjj = 0 MostCentralJetEta = 1.79326 MtllMet = 134.112 Njets = 1 SB = 0 SumEt = 204.618 SumEtJets = 0 SumEtLeptonsJets = 96.051 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 77.1984 addEt = 125.278 dPhiLepSumMet = 2.50109 dPhiLeptons = 0.378813 dRLeptons = 0.471432 diltype = 49 dimass = 11.2172 event = 188 jet1_Et = 47.6392 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 39.4547 lep2_E = 23.5705 rand = 0.999742 run = 236503 weight = 3.13807e-06 ===Show End Prepared event 10000 for Signal with 52227 events Prepared event 20000 for Signal with 52227 events Prepared event 30000 for Signal with 52227 events Prepared event 40000 for Signal with 52227 events Prepared event 50000 for Signal with 52227 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.316429 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4758 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 200569 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4758 negative weights. Signal fraction: 62.2190781 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0048981 63.4618073 65.8913116 67.2038574 68.3072052 69.2611923 70.2404938 71.1061401 71.9147568 72.8636322 73.6894913 74.3200836 75.0046844 75.6864624 76.4333878 77.0427704 77.6355438 78.2699585 78.8119278 79.3862228 79.9925003 80.729454 81.3511047 82.1318512 82.8122864 83.5866852 84.5507812 85.4737701 86.5704651 87.6800308 88.7676239 89.6671295 90.949585 92.1798325 93.4994125 94.7453613 95.9685059 97.4490585 98.5994568 99.9801407 101.328163 102.409882 103.820251 104.80896 106.253708 107.496475 108.751053 110.306015 111.762512 113.052277 114.285355 115.719925 117.064545 118.3368 119.577721 120.609177 121.894272 123.303452 124.554138 125.83007 127.060593 128.349716 129.621765 130.912689 132.081573 133.357605 134.539352 135.822144 137.174011 138.479065 139.851761 141.277725 142.80661 144.21405 145.968658 147.78183 149.731934 151.82843 153.988174 156.286346 158.756668 160.826096 163.204147 166.00119 168.851135 171.860992 174.963593 178.025879 181.783493 185.423737 190.271881 194.85022 200.653198 207.578339 215.471527 224.707184 237.289368 253.351746 277.697449 325.671173 820.901062 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3488331 20.6705685 20.9373035 21.1929817 21.4313622 21.6954918 21.9556026 22.1496201 22.3475456 22.5438652 22.7317066 22.8700562 23.0717926 23.2626591 23.4097557 23.6189232 23.8372269 24.0653992 24.2667675 24.4794331 24.6702957 24.8794689 25.098156 25.2705708 25.4733276 25.6642189 25.8505821 26.0602417 26.2406006 26.4633961 26.6580963 26.8619919 27.088501 27.2722321 27.5098457 27.702589 27.9238243 28.1133137 28.3478355 28.5785294 28.8299828 29.0510559 29.2475471 29.5027199 29.7477989 29.9983635 30.2698021 30.5125999 30.7389183 30.9862671 31.2629318 31.488121 31.7029152 31.8953171 32.1731148 32.4272842 32.7183609 33.0373688 33.2918892 33.5786972 33.8493195 34.1553421 34.4219398 34.742382 35.0082703 35.3024216 35.613533 35.9384766 36.2762184 36.6303558 36.9904137 37.3552055 37.7052116 38.090271 38.5063858 38.9238815 39.2562218 39.6604805 40.0734253 40.5595398 40.9103928 41.4267197 41.9951324 42.5869675 43.1915817 43.809433 44.4774208 45.2242661 46.000988 46.889595 47.8266296 48.9291763 50.1833649 51.6606216 53.5920067 56.0225143 59.1035385 64.2958374 73.7657928 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1187344 10.2651863 10.3805943 10.5020981 10.6142349 10.733099 10.822319 10.9440365 11.0687027 11.2113628 11.3443966 11.4676828 11.5940228 11.7327061 11.8519707 11.9955664 12.1382437 12.2723293 12.3902807 12.5355434 12.7015743 12.8564053 13.0277615 13.2163239 13.3835697 13.5341406 13.6879759 13.829669 13.9760962 14.1426525 14.3209057 14.4853468 14.7028313 14.8966885 15.0713835 15.2489891 15.4084358 15.5863333 15.7979584 15.9636545 16.1830196 16.4179611 16.6310806 16.8208008 17.0338516 17.2764969 17.4856377 17.7025013 17.9492321 18.1095123 18.3754845 18.6176605 18.8448696 19.1008511 19.3518677 19.603878 19.8489304 20.1142235 20.2983112 20.5143166 20.7506466 20.9968529 21.2507648 21.4850998 21.7392731 21.9686317 22.1751366 22.4631023 22.7218151 22.9798012 23.2692032 23.5516167 23.8542824 24.1560593 24.4837151 24.7915115 25.1077232 25.4286461 25.7551136 26.1082783 26.4524879 26.8271542 27.1956978 27.593605 27.9786034 28.3551674 28.8211555 29.2949181 29.7688484 30.2797699 30.8957558 31.5056267 32.1438675 32.9447746 33.9261551 35.174427 36.8302231 39.523159 44.3235168 91.0493851 ------------------------------ Transdef: Tab for variable 5 1.04660308 2.53732753 2.98158312 3.30924749 3.57516193 3.79277658 3.99129581 4.12436771 4.24138927 4.36602592 4.46501255 4.57330513 4.66483212 4.75977612 4.83187008 4.91844177 5.00479889 5.06818581 5.13955307 5.19891405 5.26076889 5.31527138 5.36684895 5.42124939 5.47737694 5.52011013 5.5566721 5.60372066 5.6518631 5.70369482 5.75231743 5.80169201 5.84309626 5.89340115 5.93523169 5.97433853 6.01520824 6.05702782 6.10383701 6.14240837 6.18626308 6.22767401 6.26222706 6.29590702 6.33493137 6.3847723 6.42963982 6.47532606 6.51224184 6.54493141 6.58456612 6.62903595 6.66464663 6.71081114 6.75524807 6.80036831 6.84237289 6.88031197 6.92545986 6.96896458 7.00975418 7.05580902 7.10482597 7.1540699 7.20255136 7.24782181 7.2934227 7.3400116 7.38784122 7.43069172 7.48364782 7.52844667 7.57885838 7.63131618 7.69051933 7.74750471 7.80810833 7.86251402 7.92420101 7.98927116 8.05241394 8.10546494 8.1626339 8.22620392 8.28670883 8.35724449 8.42471886 8.49752426 8.58119011 8.67695332 8.75754261 8.86653328 8.98422813 9.12114811 9.26433945 9.44054413 9.68880844 10.0033464 10.4724693 11.4993114 22.6250648 ------------------------------ Transdef: Tab for variable 6 15.003664 20.6273975 25.2183723 26.3535767 27.2933998 28.2478333 29.1990967 29.9450035 30.711441 31.3716202 31.9440937 32.4867249 32.9795837 33.4636841 33.8774261 34.364006 34.7509499 35.1212273 35.5536499 35.9239502 36.2266693 36.5645409 36.9345589 37.2742386 37.6482162 38.0221329 38.3874321 38.6950912 39.0724335 39.4721375 39.8133545 40.1957855 40.5307999 40.8522835 41.1742706 41.5940132 42.0206947 42.456459 42.853447 43.1154213 43.5322266 43.9177742 44.3887024 44.9332161 45.4596786 45.9107819 46.4409027 47.0005341 47.4603195 48.0610962 48.5762215 49.1426086 49.7070007 50.2600403 50.8069839 51.3465805 51.9899559 52.6176414 53.2881851 53.8709412 54.3767929 55.0429001 55.6470718 56.282795 56.8310318 57.4312439 58.0258789 58.5360413 59.0935059 59.8036652 60.4239426 61.0778427 61.7283478 62.360836 63.0050812 63.6779861 64.3222198 65.0390701 65.7922668 66.4984665 67.2052994 67.9396667 68.7209702 69.5813446 70.441452 71.2865753 72.244339 73.2914429 74.3921814 75.6559219 76.7144775 77.9803085 79.7097626 81.5660324 83.9296722 86.7966461 90.4771729 95.2884979 102.132988 115.854507 259.076752 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7471313 33.6419983 34.2776413 34.804657 35.2904053 35.7498322 36.2106857 36.6220932 36.9526863 37.3326302 37.687191 38.0303421 38.3372955 38.6490173 38.8604774 39.1774902 39.4657898 39.7771111 40.0939026 40.4118195 40.8022003 41.1489868 41.4962502 41.8730316 42.2960968 42.7058983 43.1747589 43.6912079 44.2471008 44.7944984 45.3293343 45.8303375 46.6219063 47.3672104 48.2372475 49.0493736 49.7953568 50.6093979 51.4129639 52.2229156 53.0869331 53.8635178 54.7801437 55.602066 56.3238983 57.0702744 57.7967453 58.5553284 59.2648659 60.0128517 60.769722 61.1814804 61.8490715 62.6210861 63.2901573 64.0443268 64.8660278 65.6263275 66.4888 67.2775269 68.0507202 68.8391113 69.7567444 70.6458664 71.584137 72.5596924 73.764679 74.9779282 76.2314758 77.3609161 78.8448792 80.3284149 81.9311218 83.4846039 85.0569 86.6478729 88.3360901 90.1253052 91.9933243 93.8648376 95.9035339 97.9457169 100.253822 102.599823 105.078667 107.961014 110.843521 114.089645 117.496033 120.924759 125.275757 130.070892 136.222687 142.518204 150.240295 160.536041 172.714157 192.542206 234.997086 493.953003 ------------------------------ Transdef: Tab for variable 8 2.90729547 24.0556793 28.4806252 30.5326252 31.8620148 32.5479164 33.1406708 33.6864777 34.0627289 34.4276505 34.8342972 35.1922226 35.5305786 35.8758583 36.1782532 36.516098 36.7980347 37.0726624 37.3344421 37.6192741 37.8489761 38.1253281 38.3745346 38.6149673 38.8654594 39.1427155 39.4045334 39.6586761 39.9685059 40.2917938 40.6280746 40.9217148 41.2759933 41.6203995 42.0305939 42.3729782 42.6902199 43.0745049 43.4405441 43.7898712 44.2252731 44.6567612 45.1412201 45.6334076 46.2001038 46.7630005 47.3550491 47.9060364 48.342514 48.8067474 49.3470154 49.8952866 50.461628 51.0075302 51.5745773 52.1639099 52.7452507 53.2834854 53.8731689 54.4788742 55.0577278 55.5846367 56.1686745 56.748085 57.3135605 57.9063416 58.4369812 59.0179367 59.5861931 60.1500015 60.7290916 61.1846924 61.7641335 62.428627 63.0785904 63.722435 64.3605728 65.002121 65.6574707 66.3335419 67.0130768 67.7224579 68.4577026 69.2002258 69.9830551 70.8971634 71.8203278 72.8553772 74.109436 75.3526535 76.771225 78.4795532 80.4298859 82.8336334 85.6966553 88.9224548 93.3296356 99.2340393 107.996506 127.649269 351.972351 ------------------------------ Transdef: Tab for variable 9 46.2959023 63.002037 65.2659912 66.7123871 67.6847687 68.6740265 69.5786209 70.3435974 71.1627045 71.9147568 72.7678909 73.5138016 74.0848083 74.6656494 75.2522583 75.8991623 76.5368271 77.0641861 77.5902023 78.1451569 78.6222839 79.1203537 79.5903778 80.0463104 80.6913376 81.2670288 81.8739471 82.4845581 83.1213226 83.772171 84.5343323 85.2477493 86.0250931 86.7172241 87.5171509 88.4194946 89.2107544 90.0240784 90.9488373 91.9672241 92.9337463 94.0504379 95.0202637 96.0405655 97.187912 98.2964783 99.2605057 100.469254 101.490456 102.430077 103.564835 104.679062 105.691704 106.687637 107.735199 108.751053 109.760986 110.911995 111.903336 112.88929 113.892761 114.943069 115.94413 116.879974 117.867065 118.846085 119.717735 120.523407 121.514618 122.448784 123.420403 124.353561 125.394569 126.371368 127.326302 128.250702 129.165771 130.044006 130.980438 131.93808 132.916458 133.819183 134.853302 135.855774 137.013092 138.112854 139.263031 140.399765 141.647827 143.045837 144.457428 145.996323 147.671402 149.857635 152.423859 155.699493 159.825363 166.703766 178.061096 207.599487 469.439911 ------------------------------ Transdef: Tab for variable 10 0.00143814425 0.883174658 1.25055361 1.4639616 1.6338172 1.76333511 1.87217176 1.96624327 2.04479742 2.11994481 2.18626785 2.24135113 2.29379082 2.33650708 2.38101053 2.41994715 2.45090294 2.48531294 2.5166707 2.54526114 2.57083941 2.59841943 2.62263703 2.64429331 2.66486502 2.68771696 2.70953035 2.72858191 2.74606991 2.76322007 2.77895093 2.79522848 2.80887866 2.8236382 2.83455276 2.84537816 2.85588312 2.8665626 2.87769556 2.88690758 2.89645004 2.90490437 2.91363311 2.92256236 2.92961311 2.9373188 2.94490528 2.95189333 2.95932508 2.9660697 2.97177553 2.97719479 2.98249078 2.98750234 2.99251509 2.99697208 3.00240397 3.00663757 3.01190615 3.01677823 3.02138853 3.02560091 3.02909589 3.03311777 3.03708887 3.04085851 3.04458952 3.04841638 3.05255032 3.05636311 3.05995798 3.06339598 3.06672978 3.06997108 3.07306862 3.07600784 3.07912207 3.0824163 3.0850563 3.08823347 3.0911026 3.09361434 3.09662104 3.0994091 3.10205221 3.104702 3.10732985 3.11003351 3.1124258 3.11503553 3.11749792 3.11973786 3.12216043 3.12443829 3.12712145 3.12932968 3.13139629 3.13374424 3.13636112 3.13892651 3.1415906 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00622208416 0.0111043509 0.0178445578 0.0240174513 0.0305886269 0.037424311 0.044246316 0.051175952 0.0589522868 0.0649528801 0.0715298057 0.0776243508 0.0844065994 0.0903856754 0.0963531733 0.101834349 0.107928813 0.112485141 0.118067503 0.124156833 0.130059719 0.1355744 0.141227782 0.147273064 0.152940989 0.158770561 0.164236903 0.169385076 0.174854979 0.180006981 0.18592 0.19156599 0.197363675 0.201992124 0.207514226 0.212797999 0.21816209 0.223600984 0.229733139 0.234483466 0.240363598 0.246073723 0.252187848 0.257707894 0.263622254 0.269718766 0.276155531 0.281443566 0.287047088 0.293086618 0.299193859 0.304977775 0.310801983 0.316727042 0.323560596 0.330022454 0.336443245 0.342667103 0.349028558 0.354916304 0.360700041 0.367161393 0.374574602 0.381390095 0.387005091 0.3924582 0.39896214 0.405872285 0.411684811 0.41793561 0.424349606 0.430782974 0.438205481 0.444349408 0.450700998 0.45727706 0.464522362 0.472786605 0.479388535 0.488133609 0.496815443 0.505239487 0.514267206 0.523363471 0.533553958 0.540788531 0.552304029 0.563425183 0.575973928 0.589719296 0.604142904 0.620876312 0.637875915 0.652481019 0.669397771 0.69435364 0.72373867 0.770900846 0.8277179 1.1246134 ------------------------------ Transdef: Tab for variable 12 0.100083143 0.122656032 0.141382605 0.157224506 0.169567347 0.181452453 0.194081277 0.202867717 0.212579459 0.222239435 0.231096774 0.239180043 0.247345269 0.256023318 0.263718158 0.271252275 0.279136479 0.286622524 0.294250995 0.300888449 0.307371914 0.31484428 0.321782231 0.327718914 0.335310102 0.342593491 0.34907043 0.354781985 0.360408187 0.36691016 0.37352109 0.379177958 0.385792136 0.392167985 0.398222715 0.403262466 0.408003777 0.412572831 0.416747689 0.421021044 0.42531547 0.429440886 0.43378073 0.437884241 0.441965491 0.445956051 0.450039059 0.45431155 0.458706796 0.462508619 0.466935933 0.470765054 0.474926949 0.478209525 0.4824211 0.486725479 0.490799695 0.495257914 0.499408066 0.503356874 0.508117914 0.512310326 0.51692307 0.521864772 0.527260065 0.532444596 0.53801167 0.543367863 0.547497869 0.552649617 0.558152795 0.563747525 0.570024729 0.576217115 0.582418203 0.588924348 0.595393419 0.601875782 0.608116925 0.615605593 0.623312831 0.632066965 0.64052695 0.650133967 0.657710254 0.666371703 0.675573826 0.683836401 0.693425894 0.703560829 0.715264142 0.726627707 0.738258779 0.75235486 0.766758084 0.786090493 0.80486387 0.832033634 0.865720451 0.903781533 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0069885 21.4569511 22.2002945 22.7958508 23.307476 23.7635326 24.2821388 24.7621632 25.1290436 25.4750023 25.862318 26.2652645 26.6352463 27.0141392 27.3615875 27.6688766 28.0186462 28.3511124 28.6716461 28.9804916 29.3352013 29.6139793 29.9199562 30.2169743 30.5237846 30.7981682 31.0456314 31.3539886 31.6186867 31.9074421 32.2616959 32.4944077 32.7864838 33.113369 33.4346619 33.7421455 34.0750961 34.3686676 34.6383591 34.9409027 35.3024635 35.5904236 35.9525528 36.214386 36.5420837 36.8912888 37.2494049 37.5957222 37.9083405 38.2580338 38.6163368 38.9275856 39.311264 39.6640015 40.0537872 40.4568253 40.824234 41.236084 41.6578217 42.1046104 42.5722427 42.877739 43.3072929 43.7243042 44.157341 44.6427612 45.1371841 45.6619568 46.181694 46.6850319 47.205822 47.7357178 48.3421364 48.9439278 49.5993385 50.2232437 50.8577423 51.564045 52.2932663 53.0885124 53.924572 54.8704796 55.7679062 56.7584076 57.7782173 58.8600769 59.9799118 61.28022 62.7004013 64.3837814 66.2658844 68.1425476 69.6836243 72.1687775 75.0016479 78.3391266 82.4367142 87.6036835 92.3345261 102.96402 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7305698 11.0921316 11.4037857 11.717577 11.9825687 12.2846155 12.4789438 12.8027668 13.0903969 13.3604088 13.6380796 13.8705997 14.1067123 14.3608742 14.637331 14.8687649 15.1258383 15.366395 15.6103249 15.8461132 16.100029 16.3132095 16.5814629 16.7817535 17.0191441 17.2986259 17.5762825 17.8017197 18.0258904 18.268383 18.5144157 18.7736359 19.054039 19.3422451 19.6326523 19.9006424 20.1737289 20.4343529 20.6528225 20.9549713 21.2511444 21.5256729 21.7630997 22.0120049 22.2575264 22.5476646 22.8117828 23.0639114 23.3332214 23.6299629 23.8834267 24.1494484 24.4433327 24.7146091 25.0086708 25.2813416 25.5844536 25.8817558 26.1651077 26.4709721 26.7729492 27.0985928 27.3870354 27.6823196 27.9612007 28.1817856 28.4977798 28.8735275 29.2429333 29.5837173 29.9447937 30.2789783 30.6304512 31.0355186 31.4243622 31.8209438 32.2816696 32.7147675 33.2420349 33.610321 34.0986404 34.5664215 35.0787926 35.6308517 36.2396011 36.926918 37.5978241 38.3644257 39.2665024 39.9756088 40.9703903 42.0939484 43.2259674 44.5948105 46.3994904 48.8161545 52.0555496 56.1573639 63.6472168 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 60.1 43.4 48.9 18.2 41.6 58.3 47.1 57.4 -27.3 -11.4 -19.7 13.4 25.0 2 60.1 100.0 64.4 57.9 27.6 64.6 94.5 71.3 91.4 -48.2 -19.5 -33.3 35.2 35.5 3 43.4 64.4 100.0 40.5 2.2 29.7 67.8 50.3 70.3 -17.5 -20.7 -37.5 67.3 23.4 4 48.9 57.9 40.5 100.0 8.7 32.6 58.9 47.5 63.8 -13.6 -25.1 -45.1 19.9 74.4 5 18.2 27.6 2.2 8.7 100.0 81.7 0.8 52.8 50.8 24.8 -3.4 -3.6 -6.0 1.5 6 41.6 64.6 29.7 32.6 81.7 100.0 43.7 76.7 77.0 -6.2 -11.8 -18.0 10.5 17.2 7 58.3 94.5 67.8 58.9 0.8 43.7 100.0 63.6 80.2 -55.7 -18.1 -32.8 39.3 37.6 8 47.1 71.3 50.3 47.5 52.8 76.7 63.6 100.0 81.0 -11.9 -18.5 -29.1 26.9 29.5 9 57.4 91.4 70.3 63.8 50.8 77.0 80.2 81.0 100.0 -23.9 -22.4 -39.1 39.8 40.3 10 -27.3 -48.2 -17.5 -13.6 24.8 -6.2 -55.7 -11.9 -23.9 100.0 0.9 4.2 -7.5 -6.3 11 -11.4 -19.5 -20.7 -25.1 -3.4 -11.8 -18.1 -18.5 -22.4 0.9 100.0 59.8 -7.7 -16.0 12 -19.7 -33.3 -37.5 -45.1 -3.6 -18.0 -32.8 -29.1 -39.1 4.2 59.8 100.0 -14.4 -23.7 13 13.4 35.2 67.3 19.9 -6.0 10.5 39.3 26.9 39.8 -7.5 -7.7 -14.4 100.0 45.0 14 25.0 35.5 23.4 74.4 1.5 17.2 37.6 29.5 40.3 -6.3 -16.0 -23.7 45.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 144.650967 TOTAL CORRELATION OF ALL VARIABLES 66.7055109 ROUND 1: MAX CORR ( 66.7036339) AFTER KILLING INPUT VARIABLE 11 CONTR 0.5004147 ROUND 2: MAX CORR ( 66.6773045) AFTER KILLING INPUT VARIABLE 8 CONTR 1.87398764 ROUND 3: MAX CORR ( 66.649972) AFTER KILLING INPUT VARIABLE 14 CONTR 1.90897219 ROUND 4: MAX CORR ( 66.5394947) AFTER KILLING INPUT VARIABLE 7 CONTR 3.8359369 ROUND 5: MAX CORR ( 66.4062902) AFTER KILLING INPUT VARIABLE 10 CONTR 4.20820386 ROUND 6: MAX CORR ( 66.1808124) AFTER KILLING INPUT VARIABLE 6 CONTR 5.46767259 ROUND 7: MAX CORR ( 65.6092604) AFTER KILLING INPUT VARIABLE 12 CONTR 8.67899071 ROUND 8: MAX CORR ( 64.5441854) AFTER KILLING INPUT VARIABLE 9 CONTR 11.7738344 ROUND 9: MAX CORR ( 64.4423639) AFTER KILLING INPUT VARIABLE 5 CONTR 3.6240322 ROUND 10: MAX CORR ( 63.0553367) AFTER KILLING INPUT VARIABLE 3 CONTR 13.2982248 ROUND 11: MAX CORR ( 62.5219858) AFTER KILLING INPUT VARIABLE 13 CONTR 8.18393407 ROUND 12: MAX CORR ( 60.0988958) AFTER KILLING INPUT VARIABLE 4 CONTR 17.2372107 LAST REMAINING VARIABLE: 2 total correlation to target: 66.7055109 % total significance: 137.10781 sigma correlations of single variables to target: variable 2: 60.0988958 % , in sigma: 123.528444 variable 3: 43.4140513 % , in sigma: 89.2340889 variable 4: 48.8700813 % , in sigma: 100.448519 variable 5: 18.2176152 % , in sigma: 37.4448421 variable 6: 41.5595754 % , in sigma: 85.4223628 variable 7: 58.2838588 % , in sigma: 119.797782 variable 8: 47.1455582 % , in sigma: 96.903901 variable 9: 57.3648771 % , in sigma: 117.908889 variable 10: -27.2955758 % , in sigma: 56.1038596 variable 11: -11.3644156 % , in sigma: 23.3586417 variable 12: -19.7365848 % , in sigma: 40.5669618 variable 13: 13.3742735 % , in sigma: 27.489743 variable 14: 25.0367132 % , in sigma: 51.4609492 variables sorted by significance: 1 most relevant variable 2 corr 60.098896 , in sigma: 123.528445 2 most relevant variable 4 corr 17.2372112 , in sigma: 35.4297006 3 most relevant variable 13 corr 8.18393421 , in sigma: 16.8214182 4 most relevant variable 3 corr 13.2982244 , in sigma: 27.3334302 5 most relevant variable 5 corr 3.62403226 , in sigma: 7.44890668 6 most relevant variable 9 corr 11.7738342 , in sigma: 24.2001688 7 most relevant variable 12 corr 8.67899036 , in sigma: 17.8389663 8 most relevant variable 6 corr 5.46767282 , in sigma: 11.2383615 9 most relevant variable 10 corr 4.20820379 , in sigma: 8.64962426 10 most relevant variable 7 corr 3.83593678 , in sigma: 7.88445938 11 most relevant variable 14 corr 1.90897214 , in sigma: 3.92373863 12 most relevant variable 8 corr 1.87398767 , in sigma: 3.85183086 13 most relevant variable 11 corr 0.500414729 , in sigma: 1.02856221 global correlations between input variables: variable 2: 99.1389784 % variable 3: 93.0860401 % variable 4: 92.2172491 % variable 5: 94.9630112 % variable 6: 93.8451875 % variable 7: 98.6807095 % variable 8: 88.5446621 % variable 9: 98.855186 % variable 10: 72.1355722 % variable 11: 60.618257 % variable 12: 70.5917805 % variable 13: 86.1579528 % variable 14: 88.8607845 % significance loss when removing single variables: variable 2: corr = 6.29011511 % , sigma = 12.9288254 variable 3: corr = 15.9421879 % , sigma = 32.7678844 variable 4: corr = 15.8863683 % , sigma = 32.6531516 variable 5: corr = 7.78594746 % , sigma = 16.0033885 variable 6: corr = 4.01453865 % , sigma = 8.25156115 variable 7: corr = 2.48598314 % , sigma = 5.1097383 variable 8: corr = 1.84264699 % , sigma = 3.78741262 variable 9: corr = 10.4821396 % , sigma = 21.5451944 variable 10: corr = 4.13407061 % , sigma = 8.49724948 variable 11: corr = 0.5004147 % , sigma = 1.02856215 variable 12: corr = 7.28087994 % , sigma = 14.9652628 variable 13: corr = 8.79909963 % , sigma = 18.0858412 variable 14: corr = 1.95047331 % , sigma = 4.00904094 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 24.6234646 sigma out 15 active outputs RANK 2 NODE 10 --> 22.593729 sigma out 15 active outputs RANK 3 NODE 2 --> 21.8195915 sigma out 15 active outputs RANK 4 NODE 6 --> 17.5831013 sigma out 15 active outputs RANK 5 NODE 7 --> 16.2999706 sigma out 15 active outputs RANK 6 NODE 8 --> 15.7433758 sigma out 15 active outputs RANK 7 NODE 5 --> 15.5666018 sigma out 15 active outputs RANK 8 NODE 9 --> 15.5343189 sigma out 15 active outputs RANK 9 NODE 4 --> 15.0614223 sigma out 15 active outputs RANK 10 NODE 1 --> 15.0012579 sigma out 15 active outputs RANK 11 NODE 11 --> 14.3641262 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 29.4306469 sigma in 11act. ( 32.7980995 sig out 1act.) RANK 2 NODE 4 --> 26.9194527 sigma in 11act. ( 23.5566845 sig out 1act.) RANK 3 NODE 14 --> 22.0253239 sigma in 11act. ( 22.5488186 sig out 1act.) RANK 4 NODE 10 --> 16.9207573 sigma in 11act. ( 17.0034561 sig out 1act.) RANK 5 NODE 7 --> 16.5368881 sigma in 11act. ( 16.6530495 sig out 1act.) RANK 6 NODE 2 --> 16.3640995 sigma in 11act. ( 21.2194233 sig out 1act.) RANK 7 NODE 1 --> 13.6670122 sigma in 11act. ( 17.5099316 sig out 1act.) RANK 8 NODE 8 --> 13.1462669 sigma in 11act. ( 13.8482599 sig out 1act.) RANK 9 NODE 15 --> 10.0170546 sigma in 11act. ( 9.76761913 sig out 1act.) RANK 10 NODE 3 --> 7.33517838 sigma in 11act. ( 10.1464968 sig out 1act.) RANK 11 NODE 9 --> 7.15310049 sigma in 11act. ( 8.55739689 sig out 1act.) RANK 12 NODE 13 --> 7.122962 sigma in 11act. ( 7.60811853 sig out 1act.) RANK 13 NODE 11 --> 5.57341623 sigma in 11act. ( 1.02166927 sig out 1act.) RANK 14 NODE 12 --> 2.18476605 sigma in 11act. ( 3.38951063 sig out 1act.) RANK 15 NODE 5 --> 1.56341851 sigma in 11act. ( 1.01800847 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 32.7980995 sigma out 1act.( 29.4306469 sig in 11act.) RANK 2 NODE 4 --> 23.5566845 sigma out 1act.( 26.9194527 sig in 11act.) RANK 3 NODE 14 --> 22.5488186 sigma out 1act.( 22.0253239 sig in 11act.) RANK 4 NODE 2 --> 21.2194233 sigma out 1act.( 16.3640995 sig in 11act.) RANK 5 NODE 1 --> 17.5099316 sigma out 1act.( 13.6670122 sig in 11act.) RANK 6 NODE 10 --> 17.0034561 sigma out 1act.( 16.9207573 sig in 11act.) RANK 7 NODE 7 --> 16.6530495 sigma out 1act.( 16.5368881 sig in 11act.) RANK 8 NODE 8 --> 13.8482599 sigma out 1act.( 13.1462669 sig in 11act.) RANK 9 NODE 3 --> 10.1464968 sigma out 1act.( 7.33517838 sig in 11act.) RANK 10 NODE 15 --> 9.76761913 sigma out 1act.( 10.0170546 sig in 11act.) RANK 11 NODE 9 --> 8.55739689 sigma out 1act.( 7.15310049 sig in 11act.) RANK 12 NODE 13 --> 7.60811853 sigma out 1act.( 7.122962 sig in 11act.) RANK 13 NODE 12 --> 3.38951063 sigma out 1act.( 2.18476605 sig in 11act.) RANK 14 NODE 11 --> 1.02166927 sigma out 1act.( 5.57341623 sig in 11act.) RANK 15 NODE 5 --> 1.01800847 sigma out 1act.( 1.56341851 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.2234039 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 27.1739655 sigma out 15 active outputs RANK 2 NODE 10 --> 22.6141911 sigma out 15 active outputs RANK 3 NODE 3 --> 22.4700546 sigma out 15 active outputs RANK 4 NODE 6 --> 17.0163097 sigma out 15 active outputs RANK 5 NODE 7 --> 16.3756142 sigma out 15 active outputs RANK 6 NODE 8 --> 16.0136528 sigma out 15 active outputs RANK 7 NODE 1 --> 15.5433121 sigma out 15 active outputs RANK 8 NODE 5 --> 15.4725008 sigma out 15 active outputs RANK 9 NODE 9 --> 14.7105513 sigma out 15 active outputs RANK 10 NODE 4 --> 14.6290302 sigma out 15 active outputs RANK 11 NODE 11 --> 14.1819353 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 28.059103 sigma in 11act. ( 30.7082596 sig out 1act.) RANK 2 NODE 4 --> 22.1476936 sigma in 11act. ( 20.7077065 sig out 1act.) RANK 3 NODE 2 --> 20.3847656 sigma in 11act. ( 21.0784054 sig out 1act.) RANK 4 NODE 7 --> 17.842207 sigma in 11act. ( 16.8553162 sig out 1act.) RANK 5 NODE 14 --> 17.3820076 sigma in 11act. ( 18.9762363 sig out 1act.) RANK 6 NODE 1 --> 17.1459675 sigma in 11act. ( 17.413456 sig out 1act.) RANK 7 NODE 8 --> 14.6104364 sigma in 11act. ( 13.1231852 sig out 1act.) RANK 8 NODE 10 --> 13.3734226 sigma in 11act. ( 14.2159128 sig out 1act.) RANK 9 NODE 3 --> 12.9746227 sigma in 11act. ( 10.6039934 sig out 1act.) RANK 10 NODE 13 --> 11.5667543 sigma in 11act. ( 7.42782688 sig out 1act.) RANK 11 NODE 12 --> 9.88298607 sigma in 11act. ( 5.1758647 sig out 1act.) RANK 12 NODE 9 --> 9.71728516 sigma in 11act. ( 8.48474503 sig out 1act.) RANK 13 NODE 15 --> 9.21017838 sigma in 11act. ( 9.00746346 sig out 1act.) RANK 14 NODE 11 --> 7.24767017 sigma in 11act. ( 1.94595587 sig out 1act.) RANK 15 NODE 5 --> 7.04818535 sigma in 11act. ( 1.68344522 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 30.7082596 sigma out 1act.( 28.059103 sig in 11act.) RANK 2 NODE 2 --> 21.0784054 sigma out 1act.( 20.3847656 sig in 11act.) RANK 3 NODE 4 --> 20.7077065 sigma out 1act.( 22.1476936 sig in 11act.) RANK 4 NODE 14 --> 18.9762363 sigma out 1act.( 17.3820076 sig in 11act.) RANK 5 NODE 1 --> 17.413456 sigma out 1act.( 17.1459675 sig in 11act.) RANK 6 NODE 7 --> 16.8553162 sigma out 1act.( 17.842207 sig in 11act.) RANK 7 NODE 10 --> 14.2159128 sigma out 1act.( 13.3734226 sig in 11act.) RANK 8 NODE 8 --> 13.1231852 sigma out 1act.( 14.6104364 sig in 11act.) RANK 9 NODE 3 --> 10.6039934 sigma out 1act.( 12.9746227 sig in 11act.) RANK 10 NODE 15 --> 9.00746346 sigma out 1act.( 9.21017838 sig in 11act.) RANK 11 NODE 9 --> 8.48474503 sigma out 1act.( 9.71728516 sig in 11act.) RANK 12 NODE 13 --> 7.42782688 sigma out 1act.( 11.5667543 sig in 11act.) RANK 13 NODE 12 --> 5.1758647 sigma out 1act.( 9.88298607 sig in 11act.) RANK 14 NODE 11 --> 1.94595587 sigma out 1act.( 7.24767017 sig in 11act.) RANK 15 NODE 5 --> 1.68344522 sigma out 1act.( 7.04818535 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 59.0931129 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.420756161 *** contribution from regularisation: 0.00386254699 *** contribution from error: -0.424618721 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.470605701 *** contribution from regularisation: 0.00250755437 *** contribution from error: -0.473113269 *********************************************** -----------------> Test sample ENTER BFGS code START -47204.2519 -0.085385114 0.949347377 EXIT FROM BFGS code FG_START 0. -0.085385114 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.49681437 *** contribution from regularisation: 0.00235763798 *** contribution from error: -0.499172002 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49822.5333 -0.085385114 593.304016 EXIT FROM BFGS code FG_LNSRCH 0. 0.0195600335 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.525441945 *** contribution from regularisation: 0.00297112204 *** contribution from error: -0.528413057 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52693.4181 0.0195600335 129.968216 EXIT FROM BFGS code NEW_X -52693.4181 0.0195600335 129.968216 ENTER BFGS code NEW_X -52693.4181 0.0195600335 129.968216 EXIT FROM BFGS code FG_LNSRCH 0. 0.0418400317 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.527467549 *** contribution from regularisation: 0.00296302931 *** contribution from error: -0.530430555 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52896.5538 0.0418400317 125.265999 EXIT FROM BFGS code NEW_X -52896.5538 0.0418400317 125.265999 ENTER BFGS code NEW_X -52896.5538 0.0418400317 125.265999 EXIT FROM BFGS code FG_LNSRCH 0. 0.0890553594 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.528534532 *** contribution from regularisation: 0.00294484594 *** contribution from error: -0.531479359 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53003.5564 0.0890553594 64.6787262 EXIT FROM BFGS code NEW_X -53003.5564 0.0890553594 64.6787262 ENTER BFGS code NEW_X -53003.5564 0.0890553594 64.6787262 EXIT FROM BFGS code FG_LNSRCH 0. 0.139017031 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.529072523 *** contribution from regularisation: 0.00301740738 *** contribution from error: -0.532089949 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53057.5099 0.139017031 17.5687046 EXIT FROM BFGS code NEW_X -53057.5099 0.139017031 17.5687046 ENTER BFGS code NEW_X -53057.5099 0.139017031 17.5687046 EXIT FROM BFGS code FG_LNSRCH 0. 0.203701645 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.529903948 *** contribution from regularisation: 0.00303227571 *** contribution from error: -0.532936215 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53140.889 0.203701645 -38.2998238 EXIT FROM BFGS code NEW_X -53140.889 0.203701645 -38.2998238 ENTER BFGS code NEW_X -53140.889 0.203701645 -38.2998238 EXIT FROM BFGS code FG_LNSRCH 0. 0.330635011 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.531087816 *** contribution from regularisation: 0.00319284364 *** contribution from error: -0.534280658 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53259.6112 0.330635011 45.6904564 EXIT FROM BFGS code NEW_X -53259.6112 0.330635011 45.6904564 ENTER BFGS code NEW_X -53259.6112 0.330635011 45.6904564 EXIT FROM BFGS code FG_LNSRCH 0. 0.432878077 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 39.7644234 sigma out 15 active outputs RANK 2 NODE 10 --> 22.5868015 sigma out 15 active outputs RANK 3 NODE 1 --> 21.8929939 sigma out 15 active outputs RANK 4 NODE 9 --> 21.2912979 sigma out 15 active outputs RANK 5 NODE 7 --> 18.1219025 sigma out 15 active outputs RANK 6 NODE 4 --> 16.6012764 sigma out 15 active outputs RANK 7 NODE 6 --> 16.3396912 sigma out 15 active outputs RANK 8 NODE 11 --> 14.2913694 sigma out 15 active outputs RANK 9 NODE 5 --> 13.9654226 sigma out 15 active outputs RANK 10 NODE 3 --> 13.8150282 sigma out 15 active outputs RANK 11 NODE 8 --> 13.6318874 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 30.4589024 sigma in 11act. ( 30.9530487 sig out 1act.) RANK 2 NODE 12 --> 28.2100296 sigma in 11act. ( 25.2690849 sig out 1act.) RANK 3 NODE 6 --> 24.2467117 sigma in 11act. ( 27.576416 sig out 1act.) RANK 4 NODE 13 --> 18.6740685 sigma in 11act. ( 19.5548973 sig out 1act.) RANK 5 NODE 3 --> 17.6123333 sigma in 11act. ( 14.3562403 sig out 1act.) RANK 6 NODE 4 --> 16.8215714 sigma in 11act. ( 16.7158508 sig out 1act.) RANK 7 NODE 5 --> 16.2390251 sigma in 11act. ( 12.5257568 sig out 1act.) RANK 8 NODE 8 --> 15.8944407 sigma in 11act. ( 14.9865694 sig out 1act.) RANK 9 NODE 7 --> 14.627491 sigma in 11act. ( 13.6537199 sig out 1act.) RANK 10 NODE 1 --> 13.8522587 sigma in 11act. ( 11.6926203 sig out 1act.) RANK 11 NODE 11 --> 12.5717239 sigma in 11act. ( 11.5913601 sig out 1act.) RANK 12 NODE 9 --> 11.2265806 sigma in 11act. ( 11.1757822 sig out 1act.) RANK 13 NODE 14 --> 8.99234486 sigma in 11act. ( 8.61593533 sig out 1act.) RANK 14 NODE 15 --> 8.36420822 sigma in 11act. ( 7.2412653 sig out 1act.) RANK 15 NODE 10 --> 7.77935839 sigma in 11act. ( 7.48977757 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 30.9530487 sigma out 1act.( 30.4589024 sig in 11act.) RANK 2 NODE 6 --> 27.576416 sigma out 1act.( 24.2467117 sig in 11act.) RANK 3 NODE 12 --> 25.2690849 sigma out 1act.( 28.2100296 sig in 11act.) RANK 4 NODE 13 --> 19.5548973 sigma out 1act.( 18.6740685 sig in 11act.) RANK 5 NODE 4 --> 16.7158508 sigma out 1act.( 16.8215714 sig in 11act.) RANK 6 NODE 8 --> 14.9865694 sigma out 1act.( 15.8944407 sig in 11act.) RANK 7 NODE 3 --> 14.3562403 sigma out 1act.( 17.6123333 sig in 11act.) RANK 8 NODE 7 --> 13.6537199 sigma out 1act.( 14.627491 sig in 11act.) RANK 9 NODE 5 --> 12.5257568 sigma out 1act.( 16.2390251 sig in 11act.) RANK 10 NODE 1 --> 11.6926203 sigma out 1act.( 13.8522587 sig in 11act.) RANK 11 NODE 11 --> 11.5913601 sigma out 1act.( 12.5717239 sig in 11act.) RANK 12 NODE 9 --> 11.1757822 sigma out 1act.( 11.2265806 sig in 11act.) RANK 13 NODE 14 --> 8.61593533 sigma out 1act.( 8.99234486 sig in 11act.) RANK 14 NODE 10 --> 7.48977757 sigma out 1act.( 7.77935839 sig in 11act.) RANK 15 NODE 15 --> 7.2412653 sigma out 1act.( 8.36420822 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.118454 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.532292664 *** contribution from regularisation: 0.00326003623 *** contribution from error: -0.53555268 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53380.4388 0.432878077 -97.1064987 EXIT FROM BFGS code NEW_X -53380.4388 0.432878077 -97.1064987 ENTER BFGS code NEW_X -53380.4388 0.432878077 -97.1064987 EXIT FROM BFGS code FG_LNSRCH 0. 0.421109051 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.532820046 *** contribution from regularisation: 0.00310715521 *** contribution from error: -0.535927176 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53433.3236 0.421109051 -35.2003288 EXIT FROM BFGS code NEW_X -53433.3236 0.421109051 -35.2003288 ENTER BFGS code NEW_X -53433.3236 0.421109051 -35.2003288 EXIT FROM BFGS code FG_LNSRCH 0. 0.40630734 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.533262968 *** contribution from regularisation: 0.00310847256 *** contribution from error: -0.536371469 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53477.7414 0.40630734 38.37397 EXIT FROM BFGS code NEW_X -53477.7414 0.40630734 38.37397 ENTER BFGS code NEW_X -53477.7414 0.40630734 38.37397 EXIT FROM BFGS code FG_LNSRCH 0. 0.397169441 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.533998609 *** contribution from regularisation: 0.00313273398 *** contribution from error: -0.537131369 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53551.5164 0.397169441 93.0230255 EXIT FROM BFGS code NEW_X -53551.5164 0.397169441 93.0230255 ENTER BFGS code NEW_X -53551.5164 0.397169441 93.0230255 EXIT FROM BFGS code FG_LNSRCH 0. 0.384624779 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.535217285 *** contribution from regularisation: 0.00334283663 *** contribution from error: -0.538560092 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53673.732 0.384624779 180.17691 EXIT FROM BFGS code NEW_X -53673.732 0.384624779 180.17691 ENTER BFGS code NEW_X -53673.732 0.384624779 180.17691 EXIT FROM BFGS code FG_LNSRCH 0. 0.412214309 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.535738647 *** contribution from regularisation: 0.00340346852 *** contribution from error: -0.539142132 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53726.0126 0.412214309 -41.3536949 EXIT FROM BFGS code NEW_X -53726.0126 0.412214309 -41.3536949 ENTER BFGS code NEW_X -53726.0126 0.412214309 -41.3536949 EXIT FROM BFGS code FG_LNSRCH 0. 0.410152406 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.537112951 *** contribution from regularisation: 0.00307282503 *** contribution from error: -0.54018575 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53863.8361 0.410152406 -32.2654266 EXIT FROM BFGS code NEW_X -53863.8361 0.410152406 -32.2654266 ENTER BFGS code NEW_X -53863.8361 0.410152406 -32.2654266 EXIT FROM BFGS code FG_LNSRCH 0. 0.407088518 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.537204444 *** contribution from regularisation: 0.00318010477 *** contribution from error: -0.540384531 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53873.012 0.407088518 -33.8802147 EXIT FROM BFGS code NEW_X -53873.012 0.407088518 -33.8802147 ENTER BFGS code NEW_X -53873.012 0.407088518 -33.8802147 EXIT FROM BFGS code FG_LNSRCH 0. 0.395880044 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.537416279 *** contribution from regularisation: 0.00320331077 *** contribution from error: -0.540619612 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53894.2551 0.395880044 -34.4175301 EXIT FROM BFGS code NEW_X -53894.2551 0.395880044 -34.4175301 ENTER BFGS code NEW_X -53894.2551 0.395880044 -34.4175301 EXIT FROM BFGS code FG_LNSRCH 0. 0.362785786 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.537772119 *** contribution from regularisation: 0.00322297867 *** contribution from error: -0.540995121 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -53929.9382 0.362785786 -11.91471 EXIT FROM BFGS code NEW_X -53929.9382 0.362785786 -11.91471 ENTER BFGS code NEW_X -53929.9382 0.362785786 -11.91471 EXIT FROM BFGS code FG_LNSRCH 0. 0.295072764 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 52.9893036 sigma out 15 active outputs RANK 2 NODE 6 --> 39.8127899 sigma out 15 active outputs RANK 3 NODE 10 --> 29.4684486 sigma out 15 active outputs RANK 4 NODE 11 --> 28.0488033 sigma out 15 active outputs RANK 5 NODE 3 --> 27.1829185 sigma out 15 active outputs RANK 6 NODE 4 --> 25.192173 sigma out 15 active outputs RANK 7 NODE 7 --> 23.9499836 sigma out 15 active outputs RANK 8 NODE 1 --> 23.6560364 sigma out 15 active outputs RANK 9 NODE 9 --> 23.3692474 sigma out 15 active outputs RANK 10 NODE 8 --> 21.209486 sigma out 15 active outputs RANK 11 NODE 5 --> 20.0806561 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 48.9549484 sigma in 11act. ( 64.099144 sig out 1act.) RANK 2 NODE 6 --> 44.4023285 sigma in 11act. ( 49.3875389 sig out 1act.) RANK 3 NODE 13 --> 40.3992348 sigma in 11act. ( 44.6398392 sig out 1act.) RANK 4 NODE 8 --> 35.3276138 sigma in 11act. ( 35.3313866 sig out 1act.) RANK 5 NODE 12 --> 28.0998344 sigma in 11act. ( 27.8648853 sig out 1act.) RANK 6 NODE 4 --> 23.7474804 sigma in 11act. ( 23.7356873 sig out 1act.) RANK 7 NODE 3 --> 16.7739906 sigma in 11act. ( 14.1375113 sig out 1act.) RANK 8 NODE 11 --> 16.4303265 sigma in 11act. ( 18.2189388 sig out 1act.) RANK 9 NODE 15 --> 14.0530577 sigma in 11act. ( 14.2060575 sig out 1act.) RANK 10 NODE 14 --> 12.4711828 sigma in 11act. ( 13.0855398 sig out 1act.) RANK 11 NODE 5 --> 10.5107536 sigma in 11act. ( 8.07061672 sig out 1act.) RANK 12 NODE 1 --> 10.4646425 sigma in 11act. ( 10.6511889 sig out 1act.) RANK 13 NODE 10 --> 10.3412256 sigma in 11act. ( 11.447917 sig out 1act.) RANK 14 NODE 7 --> 8.43304634 sigma in 11act. ( 8.24321651 sig out 1act.) RANK 15 NODE 9 --> 7.05651712 sigma in 11act. ( 5.89786625 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 64.099144 sigma out 1act.( 48.9549484 sig in 11act.) RANK 2 NODE 6 --> 49.3875389 sigma out 1act.( 44.4023285 sig in 11act.) RANK 3 NODE 13 --> 44.6398392 sigma out 1act.( 40.3992348 sig in 11act.) RANK 4 NODE 8 --> 35.3313866 sigma out 1act.( 35.3276138 sig in 11act.) RANK 5 NODE 12 --> 27.8648853 sigma out 1act.( 28.0998344 sig in 11act.) RANK 6 NODE 4 --> 23.7356873 sigma out 1act.( 23.7474804 sig in 11act.) RANK 7 NODE 11 --> 18.2189388 sigma out 1act.( 16.4303265 sig in 11act.) RANK 8 NODE 15 --> 14.2060575 sigma out 1act.( 14.0530577 sig in 11act.) RANK 9 NODE 3 --> 14.1375113 sigma out 1act.( 16.7739906 sig in 11act.) RANK 10 NODE 14 --> 13.0855398 sigma out 1act.( 12.4711828 sig in 11act.) RANK 11 NODE 10 --> 11.447917 sigma out 1act.( 10.3412256 sig in 11act.) RANK 12 NODE 1 --> 10.6511889 sigma out 1act.( 10.4646425 sig in 11act.) RANK 13 NODE 7 --> 8.24321651 sigma out 1act.( 8.43304634 sig in 11act.) RANK 14 NODE 5 --> 8.07061672 sigma out 1act.( 10.5107536 sig in 11act.) RANK 15 NODE 9 --> 5.89786625 sigma out 1act.( 7.05651712 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 111.561211 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.538289905 *** contribution from regularisation: 0.00330955419 *** contribution from error: -0.541599452 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -53981.8676 0.295072764 -18.5808067 EXIT FROM BFGS code NEW_X -53981.8676 0.295072764 -18.5808067 ENTER BFGS code NEW_X -53981.8676 0.295072764 -18.5808067 EXIT FROM BFGS code FG_LNSRCH 0. 0.233279288 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.53853184 *** contribution from regularisation: 0.00333667989 *** contribution from error: -0.541868508 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54006.1267 0.233279288 177.945541 EXIT FROM BFGS code NEW_X -54006.1267 0.233279288 177.945541 ENTER BFGS code NEW_X -54006.1267 0.233279288 177.945541 EXIT FROM BFGS code FG_LNSRCH 0. 0.270913273 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.538887858 *** contribution from regularisation: 0.00320070074 *** contribution from error: -0.542088568 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54041.8325 0.270913273 54.0991478 EXIT FROM BFGS code NEW_X -54041.8325 0.270913273 54.0991478 ENTER BFGS code NEW_X -54041.8325 0.270913273 54.0991478 EXIT FROM BFGS code FG_LNSRCH 0. 0.277896017 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.53889966 *** contribution from regularisation: 0.00325561757 *** contribution from error: -0.542155266 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54043.0136 0.277896017 39.8012619 EXIT FROM BFGS code NEW_X -54043.0136 0.277896017 39.8012619 ENTER BFGS code NEW_X -54043.0136 0.277896017 39.8012619 EXIT FROM BFGS code FG_LNSRCH 0. 0.31027329 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.539114535 *** contribution from regularisation: 0.00325939362 *** contribution from error: -0.542373955 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54064.5649 0.31027329 15.9558334 EXIT FROM BFGS code NEW_X -54064.5649 0.31027329 15.9558334 ENTER BFGS code NEW_X -54064.5649 0.31027329 15.9558334 EXIT FROM BFGS code FG_LNSRCH 0. 0.365162581 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.539398193 *** contribution from regularisation: 0.00326667074 *** contribution from error: -0.542664886 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54093.0102 0.365162581 -26.0756798 EXIT FROM BFGS code NEW_X -54093.0102 0.365162581 -26.0756798 ENTER BFGS code NEW_X -54093.0102 0.365162581 -26.0756798 EXIT FROM BFGS code FG_LNSRCH 0. 0.486385971 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.539828002 *** contribution from regularisation: 0.00336867291 *** contribution from error: -0.543196678 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54136.1121 0.486385971 -25.1423664 EXIT FROM BFGS code NEW_X -54136.1121 0.486385971 -25.1423664 ENTER BFGS code NEW_X -54136.1121 0.486385971 -25.1423664 EXIT FROM BFGS code FG_LNSRCH 0. 0.545727074 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.539970756 *** contribution from regularisation: 0.00330512202 *** contribution from error: -0.543275893 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54150.4296 0.545727074 -276.297363 EXIT FROM BFGS code FG_LNSRCH 0. 0.517521501 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.540133357 *** contribution from regularisation: 0.00324958959 *** contribution from error: -0.543382943 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54166.7338 0.517521501 -153.871597 EXIT FROM BFGS code NEW_X -54166.7338 0.517521501 -153.871597 ENTER BFGS code NEW_X -54166.7338 0.517521501 -153.871597 EXIT FROM BFGS code FG_LNSRCH 0. 0.491160423 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.540216923 *** contribution from regularisation: 0.00324007822 *** contribution from error: -0.543456972 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54175.1149 0.491160423 -46.8250084 EXIT FROM BFGS code NEW_X -54175.1149 0.491160423 -46.8250084 ENTER BFGS code NEW_X -54175.1149 0.491160423 -46.8250084 EXIT FROM BFGS code FG_LNSRCH 0. 0.48957929 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 76.0505981 sigma out 15 active outputs RANK 2 NODE 6 --> 47.1501198 sigma out 15 active outputs RANK 3 NODE 3 --> 37.6064301 sigma out 15 active outputs RANK 4 NODE 11 --> 35.9312592 sigma out 15 active outputs RANK 5 NODE 1 --> 35.2671394 sigma out 15 active outputs RANK 6 NODE 10 --> 31.6272774 sigma out 15 active outputs RANK 7 NODE 8 --> 29.774128 sigma out 15 active outputs RANK 8 NODE 7 --> 29.1496944 sigma out 15 active outputs RANK 9 NODE 4 --> 28.1894283 sigma out 15 active outputs RANK 10 NODE 9 --> 26.2219257 sigma out 15 active outputs RANK 11 NODE 5 --> 20.2668552 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 72.1923141 sigma in 11act. ( 84.6665421 sig out 1act.) RANK 2 NODE 6 --> 58.1934891 sigma in 11act. ( 64.6826248 sig out 1act.) RANK 3 NODE 13 --> 49.5894966 sigma in 11act. ( 59.6210365 sig out 1act.) RANK 4 NODE 8 --> 43.9566307 sigma in 11act. ( 47.3302803 sig out 1act.) RANK 5 NODE 4 --> 33.1630707 sigma in 11act. ( 35.1632843 sig out 1act.) RANK 6 NODE 12 --> 26.1195774 sigma in 11act. ( 27.100605 sig out 1act.) RANK 7 NODE 3 --> 20.6614189 sigma in 11act. ( 17.9569645 sig out 1act.) RANK 8 NODE 15 --> 19.617651 sigma in 11act. ( 21.5107727 sig out 1act.) RANK 9 NODE 11 --> 18.3841896 sigma in 11act. ( 19.0833015 sig out 1act.) RANK 10 NODE 14 --> 16.1630306 sigma in 11act. ( 17.6965504 sig out 1act.) RANK 11 NODE 10 --> 11.8303099 sigma in 11act. ( 13.9443531 sig out 1act.) RANK 12 NODE 7 --> 9.58502293 sigma in 11act. ( 10.0303402 sig out 1act.) RANK 13 NODE 1 --> 8.93709946 sigma in 11act. ( 9.30121899 sig out 1act.) RANK 14 NODE 5 --> 8.29557323 sigma in 11act. ( 6.33481026 sig out 1act.) RANK 15 NODE 9 --> 4.7265811 sigma in 11act. ( 3.07443547 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 84.6665421 sigma out 1act.( 72.1923141 sig in 11act.) RANK 2 NODE 6 --> 64.6826248 sigma out 1act.( 58.1934891 sig in 11act.) RANK 3 NODE 13 --> 59.6210365 sigma out 1act.( 49.5894966 sig in 11act.) RANK 4 NODE 8 --> 47.3302803 sigma out 1act.( 43.9566307 sig in 11act.) RANK 5 NODE 4 --> 35.1632843 sigma out 1act.( 33.1630707 sig in 11act.) RANK 6 NODE 12 --> 27.100605 sigma out 1act.( 26.1195774 sig in 11act.) RANK 7 NODE 15 --> 21.5107727 sigma out 1act.( 19.617651 sig in 11act.) RANK 8 NODE 11 --> 19.0833015 sigma out 1act.( 18.3841896 sig in 11act.) RANK 9 NODE 3 --> 17.9569645 sigma out 1act.( 20.6614189 sig in 11act.) RANK 10 NODE 14 --> 17.6965504 sigma out 1act.( 16.1630306 sig in 11act.) RANK 11 NODE 10 --> 13.9443531 sigma out 1act.( 11.8303099 sig in 11act.) RANK 12 NODE 7 --> 10.0303402 sigma out 1act.( 9.58502293 sig in 11act.) RANK 13 NODE 1 --> 9.30121899 sigma out 1act.( 8.93709946 sig in 11act.) RANK 14 NODE 5 --> 6.33481026 sigma out 1act.( 8.29557323 sig in 11act.) RANK 15 NODE 9 --> 3.07443547 sigma out 1act.( 4.7265811 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 144.953918 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.540225625 *** contribution from regularisation: 0.00326493173 *** contribution from error: -0.543490529 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54175.9878 0.48957929 -57.5811386 EXIT FROM BFGS code NEW_X -54175.9878 0.48957929 -57.5811386 ENTER BFGS code NEW_X -54175.9878 0.48957929 -57.5811386 EXIT FROM BFGS code FG_LNSRCH 0. 0.463471025 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.540394962 *** contribution from regularisation: 0.0032114624 *** contribution from error: -0.5436064 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54192.9662 0.463471025 -87.0429306 EXIT FROM BFGS code NEW_X -54192.9662 0.463471025 -87.0429306 ENTER BFGS code NEW_X -54192.9662 0.463471025 -87.0429306 EXIT FROM BFGS code FG_LNSRCH 0. 0.425858051 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.540476978 *** contribution from regularisation: 0.00320837763 *** contribution from error: -0.543685377 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54201.1929 0.425858051 -63.18433 EXIT FROM BFGS code NEW_X -54201.1929 0.425858051 -63.18433 ENTER BFGS code NEW_X -54201.1929 0.425858051 -63.18433 EXIT FROM BFGS code FG_LNSRCH 0. 0.352185875 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.540153325 *** contribution from regularisation: 0.00316067669 *** contribution from error: -0.54331398 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54168.7376 0.352185875 94.7542419 EXIT FROM BFGS code FG_LNSRCH 0. 0.409250498 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.540372252 *** contribution from regularisation: 0.00334436959 *** contribution from error: -0.543716609 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54190.6902 0.409250498 -32.4786377 EXIT FROM BFGS code FG_LNSRCH 0. 0.424407095 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.540406287 *** contribution from regularisation: 0.00328388577 *** contribution from error: -0.543690145 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54194.106 0.424407095 -60.5238152 EXIT FROM BFGS code FG_LNSRCH 0. 0.425835818 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.540421247 *** contribution from regularisation: 0.00326418923 *** contribution from error: -0.543685436 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54195.607 0.425835818 -63.1930046 EXIT FROM BFGS code FG_LNSRCH 0. 0.425858051 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.540418088 *** contribution from regularisation: 0.00326727983 *** contribution from error: -0.543685377 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54195.286 0.425858051 -63.0915565 EXIT FROM BFGS code FG_LNSRCH 0. 0.425858051 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.540420651 *** contribution from regularisation: 0.00326471054 *** contribution from error: -0.543685377 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54195.5436 0.425858051 -63.0990486 EXIT FROM BFGS code FG_LNSRCH 0. 0.425858051 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.540425897 *** contribution from regularisation: 0.00325943157 *** contribution from error: -0.543685317 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54196.073 0.425858051 -63.0257111 EXIT FROM BFGS code FG_LNSRCH 0. 0.425858051 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 78.2020035 sigma out 15 active outputs RANK 2 NODE 6 --> 48.8129692 sigma out 15 active outputs RANK 3 NODE 3 --> 41.9763794 sigma out 15 active outputs RANK 4 NODE 11 --> 38.067421 sigma out 15 active outputs RANK 5 NODE 1 --> 37.3556366 sigma out 15 active outputs RANK 6 NODE 10 --> 33.0354919 sigma out 15 active outputs RANK 7 NODE 7 --> 31.8533573 sigma out 15 active outputs RANK 8 NODE 8 --> 30.8739376 sigma out 15 active outputs RANK 9 NODE 4 --> 30.3169079 sigma out 15 active outputs RANK 10 NODE 9 --> 26.1617584 sigma out 15 active outputs RANK 11 NODE 5 --> 22.4266644 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 71.1221619 sigma in 11act. ( 89.3362274 sig out 1act.) RANK 2 NODE 6 --> 61.6696892 sigma in 11act. ( 66.5051498 sig out 1act.) RANK 3 NODE 13 --> 54.098011 sigma in 11act. ( 61.9828644 sig out 1act.) RANK 4 NODE 8 --> 48.3554382 sigma in 11act. ( 51.4299088 sig out 1act.) RANK 5 NODE 4 --> 37.3545837 sigma in 11act. ( 39.0745316 sig out 1act.) RANK 6 NODE 12 --> 25.7100677 sigma in 11act. ( 27.6519108 sig out 1act.) RANK 7 NODE 15 --> 22.6404133 sigma in 11act. ( 24.9362183 sig out 1act.) RANK 8 NODE 3 --> 21.7537155 sigma in 11act. ( 19.769413 sig out 1act.) RANK 9 NODE 11 --> 19.3011246 sigma in 11act. ( 19.8221302 sig out 1act.) RANK 10 NODE 14 --> 17.6880703 sigma in 11act. ( 19.0954533 sig out 1act.) RANK 11 NODE 10 --> 12.5212488 sigma in 11act. ( 14.1317902 sig out 1act.) RANK 12 NODE 7 --> 10.2316399 sigma in 11act. ( 10.9498825 sig out 1act.) RANK 13 NODE 1 --> 8.86741734 sigma in 11act. ( 9.31397152 sig out 1act.) RANK 14 NODE 5 --> 7.67182875 sigma in 11act. ( 6.17174482 sig out 1act.) RANK 15 NODE 9 --> 4.19961309 sigma in 11act. ( 2.6966579 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 89.3362274 sigma out 1act.( 71.1221619 sig in 11act.) RANK 2 NODE 6 --> 66.5051498 sigma out 1act.( 61.6696892 sig in 11act.) RANK 3 NODE 13 --> 61.9828644 sigma out 1act.( 54.098011 sig in 11act.) RANK 4 NODE 8 --> 51.4299088 sigma out 1act.( 48.3554382 sig in 11act.) RANK 5 NODE 4 --> 39.0745316 sigma out 1act.( 37.3545837 sig in 11act.) RANK 6 NODE 12 --> 27.6519108 sigma out 1act.( 25.7100677 sig in 11act.) RANK 7 NODE 15 --> 24.9362183 sigma out 1act.( 22.6404133 sig in 11act.) RANK 8 NODE 11 --> 19.8221302 sigma out 1act.( 19.3011246 sig in 11act.) RANK 9 NODE 3 --> 19.769413 sigma out 1act.( 21.7537155 sig in 11act.) RANK 10 NODE 14 --> 19.0954533 sigma out 1act.( 17.6880703 sig in 11act.) RANK 11 NODE 10 --> 14.1317902 sigma out 1act.( 12.5212488 sig in 11act.) RANK 12 NODE 7 --> 10.9498825 sigma out 1act.( 10.2316399 sig in 11act.) RANK 13 NODE 1 --> 9.31397152 sigma out 1act.( 8.86741734 sig in 11act.) RANK 14 NODE 5 --> 6.17174482 sigma out 1act.( 7.67182875 sig in 11act.) RANK 15 NODE 9 --> 2.6966579 sigma out 1act.( 4.19961309 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 152.984222 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.540425062 *** contribution from regularisation: 0.00326030748 *** contribution from error: -0.543685377 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54195.9852 0.425858051 -63.0811844 EXIT FROM BFGS code NEW_X -54195.9852 0.425858051 -63.0811844 ENTER BFGS code NEW_X -54195.9852 0.425858051 -63.0811844 EXIT FROM BFGS code CONVERGENC -54195.9852 0.425858051 -63.0811844 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 117.618034 sigma out 15 active outputs RANK 2 NODE 6 --> 70.5829315 sigma out 15 active outputs RANK 3 NODE 3 --> 60.9524536 sigma out 15 active outputs RANK 4 NODE 1 --> 56.9629593 sigma out 15 active outputs RANK 5 NODE 11 --> 56.5776253 sigma out 15 active outputs RANK 6 NODE 10 --> 50.7918472 sigma out 15 active outputs RANK 7 NODE 8 --> 47.7035675 sigma out 15 active outputs RANK 8 NODE 7 --> 47.1353378 sigma out 15 active outputs RANK 9 NODE 4 --> 45.8085556 sigma out 15 active outputs RANK 10 NODE 9 --> 37.9693146 sigma out 15 active outputs RANK 11 NODE 5 --> 33.3785896 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 107.45166 sigma in 11act. ( 137.437851 sig out 1act.) RANK 2 NODE 6 --> 90.7568588 sigma in 11act. ( 104.4524 sig out 1act.) RANK 3 NODE 13 --> 79.1159744 sigma in 11act. ( 95.4119186 sig out 1act.) RANK 4 NODE 8 --> 72.4062195 sigma in 11act. ( 79.4032593 sig out 1act.) RANK 5 NODE 4 --> 56.7532959 sigma in 11act. ( 60.3045959 sig out 1act.) RANK 6 NODE 12 --> 38.9227638 sigma in 11act. ( 41.9133797 sig out 1act.) RANK 7 NODE 15 --> 34.268589 sigma in 11act. ( 37.5890007 sig out 1act.) RANK 8 NODE 3 --> 32.6788979 sigma in 11act. ( 29.9439869 sig out 1act.) RANK 9 NODE 11 --> 29.3350754 sigma in 11act. ( 29.9082298 sig out 1act.) RANK 10 NODE 14 --> 26.446188 sigma in 11act. ( 29.0952644 sig out 1act.) RANK 11 NODE 10 --> 18.3028259 sigma in 11act. ( 21.9766197 sig out 1act.) RANK 12 NODE 7 --> 15.2638988 sigma in 11act. ( 16.7653179 sig out 1act.) RANK 13 NODE 1 --> 13.0744505 sigma in 11act. ( 14.2534418 sig out 1act.) RANK 14 NODE 5 --> 10.9249086 sigma in 11act. ( 9.23567867 sig out 1act.) RANK 15 NODE 9 --> 5.22647095 sigma in 11act. ( 4.03471947 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 137.437851 sigma out 1act.( 107.45166 sig in 11act.) RANK 2 NODE 6 --> 104.4524 sigma out 1act.( 90.7568588 sig in 11act.) RANK 3 NODE 13 --> 95.4119186 sigma out 1act.( 79.1159744 sig in 11act.) RANK 4 NODE 8 --> 79.4032593 sigma out 1act.( 72.4062195 sig in 11act.) RANK 5 NODE 4 --> 60.3045959 sigma out 1act.( 56.7532959 sig in 11act.) RANK 6 NODE 12 --> 41.9133797 sigma out 1act.( 38.9227638 sig in 11act.) RANK 7 NODE 15 --> 37.5890007 sigma out 1act.( 34.268589 sig in 11act.) RANK 8 NODE 3 --> 29.9439869 sigma out 1act.( 32.6788979 sig in 11act.) RANK 9 NODE 11 --> 29.9082298 sigma out 1act.( 29.3350754 sig in 11act.) RANK 10 NODE 14 --> 29.0952644 sigma out 1act.( 26.446188 sig in 11act.) RANK 11 NODE 10 --> 21.9766197 sigma out 1act.( 18.3028259 sig in 11act.) RANK 12 NODE 7 --> 16.7653179 sigma out 1act.( 15.2638988 sig in 11act.) RANK 13 NODE 1 --> 14.2534418 sigma out 1act.( 13.0744505 sig in 11act.) RANK 14 NODE 5 --> 9.23567867 sigma out 1act.( 10.9249086 sig in 11act.) RANK 15 NODE 9 --> 4.03471947 sigma out 1act.( 5.22647095 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 236.052017 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.540414333 *** contribution from regularisation: 0.0032710149 *** contribution from error: -0.543685377 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30761 Closing output file done