NNInput NNInputs_125.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 199165 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 50823 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 50823 Chosen entries: 50823 Signal fraction: 1 Background fraction: 0.342607 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 50823 Entries to split: 50823 Test with : 25411 Train with : 25411 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 50823 for Signal Prepared event 0 for Signal with 50823 events ====Entry 0 Variable Ht : 120.494 Variable LepAPt : 52.8932 Variable LepBPt : 13.787 Variable MetSigLeptonsJets : 6.59008 Variable MetSpec : 53.8132 Variable SumEtLeptonsJets : 66.6802 Variable VSumJetLeptonsPt : 66.139 Variable addEt : 120.494 Variable dPhiLepSumMet : 2.99118 Variable dPhiLeptons : 0.315251 Variable dRLeptons : 0.406645 Variable lep1_E : 70.3851 Variable lep2_E : 15.8115 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2125 Ht = 120.494 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 52.8933 LepAPt = 52.8932 LepBEt = 13.787 LepBPt = 13.787 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 53.8132 MetDelPhi = 2.92651 MetSig = 4.22058 MetSigLeptonsJets = 6.59008 MetSpec = 53.8132 Mjj = 0 MostCentralJetEta = 0 MtllMet = 129.103 Njets = 0 SB = 0 SumEt = 162.568 SumEtJets = 0 SumEtLeptonsJets = 66.6802 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 66.139 addEt = 120.494 dPhiLepSumMet = 2.99118 dPhiLeptons = 0.315251 dRLeptons = 0.406645 diltype = 49 dimass = 10.9671 event = 2092 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 70.3851 lep2_E = 15.8115 rand = 0.999742 run = 235158 weight = 1.4937e-06 ===Show End Prepared event 10000 for Signal with 50823 events Prepared event 20000 for Signal with 50823 events Prepared event 30000 for Signal with 50823 events Prepared event 40000 for Signal with 50823 events Prepared event 50000 for Signal with 50823 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.314789 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4803 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 199165 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4803 negative weights. Signal fraction: 62.066452 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0091019 63.0504227 65.4485855 66.9558716 68.0148621 68.8892975 69.9846191 70.7900467 71.5182877 72.3108521 73.0564575 73.8191681 74.4679642 75.1113586 75.7729492 76.4312668 76.9965057 77.4611969 78.1347122 78.7052002 79.2309723 79.7426834 80.3942032 80.9427948 81.5389023 82.1323242 82.72155 83.3777161 84.0623703 84.9210434 85.7944336 86.6133575 87.5907745 88.5633698 89.35672 90.3872986 91.4014587 92.2331543 93.2873535 94.3083191 95.3678131 96.3585205 97.3525772 98.3804626 99.3916473 100.404236 101.435654 102.296082 103.235886 104.194901 105.25721 106.124069 107.126099 108.153061 109.165634 110.105659 111.088043 112.115623 113.080658 113.986084 115.099556 116.183105 117.269562 118.416756 119.517212 120.459641 121.65184 122.823029 124.173416 125.508591 127.074493 128.605591 130.344101 132.123047 133.742706 135.575378 137.498138 139.590576 141.654053 143.725037 145.89949 148.147217 150.693863 153.50769 156.04071 158.902252 161.616226 165.258423 168.918457 173.167816 177.701706 182.858536 188.629425 195.537537 203.389954 212.633911 224.997498 241.634796 264.210144 303.01712 1151.67786 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.2952881 20.5615349 20.833416 21.0772991 21.3121414 21.500618 21.7227783 21.9526806 22.1147232 22.3006611 22.4826031 22.6624374 22.8328438 23.0379601 23.2301979 23.4175282 23.5912209 23.7853451 23.9652748 24.1579189 24.3614712 24.5540085 24.7316685 24.9227943 25.1159096 25.3208466 25.4948807 25.6805592 25.8624763 26.0594425 26.2249527 26.4156647 26.6041565 26.7971764 26.9896755 27.1747532 27.3934364 27.6327286 27.8206215 27.9942436 28.1994667 28.4151096 28.6007271 28.8198986 28.9980164 29.1849575 29.4156227 29.6476173 29.8083763 30.0346775 30.2414703 30.4590912 30.6605129 30.8939762 31.1447315 31.3984642 31.666048 31.8805561 32.1017532 32.3464508 32.6356201 32.874588 33.1639519 33.4314423 33.7470779 34.0040131 34.2978439 34.6199799 34.9550858 35.2848969 35.5939713 35.9255676 36.3123627 36.6676559 37.0822754 37.5019226 37.9791489 38.4233589 38.871582 39.2336502 39.7312546 40.2268372 40.7343063 41.3393707 41.9746704 42.6256485 43.3720245 44.2365341 45.0263519 46.0518875 47.1952591 48.3606873 49.7738495 51.2965698 53.3516731 55.7326508 59.1171036 64.7286224 75.0077515 215.283478 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1046867 10.2136269 10.3290939 10.4170904 10.5030279 10.6040096 10.7195225 10.8205299 10.9259129 11.016964 11.1340294 11.2489071 11.3586693 11.4640713 11.5693655 11.6753616 11.7780638 11.899292 11.9987783 12.1195793 12.2277222 12.3355293 12.4490938 12.5585613 12.6914101 12.8144264 12.9486761 13.0728884 13.2096081 13.3451633 13.4773674 13.6091938 13.7477694 13.8736839 14.0129538 14.1537075 14.3054085 14.4332609 14.5809488 14.7404251 14.9009094 15.0579681 15.2112122 15.3602514 15.4913216 15.6500015 15.8112345 15.9636898 16.1322136 16.3221111 16.499979 16.6565857 16.8084106 16.9842377 17.1526184 17.3616295 17.5577507 17.7098656 17.9137764 18.1073322 18.317627 18.5301704 18.750885 18.9673424 19.1612797 19.3719368 19.6044312 19.8459816 20.0837479 20.2603989 20.4669552 20.6665535 20.9010601 21.1378899 21.3671055 21.6113548 21.817421 22.0298004 22.2859821 22.5813599 22.8819809 23.2007866 23.502861 23.8512039 24.2217674 24.6091309 25.023035 25.4577103 25.9032078 26.3714256 26.9228592 27.5891533 28.1386833 28.9797707 29.8736782 31.040081 32.5832443 35.10849 39.614399 107.402428 ------------------------------ Transdef: Tab for variable 5 0.808297217 2.40457463 2.80915213 3.11239958 3.37192488 3.57647753 3.77249384 3.93409896 4.0784893 4.18321419 4.2729578 4.37664413 4.46937656 4.55807209 4.64374685 4.70978832 4.78922796 4.85522366 4.9281435 4.99395609 5.05812502 5.1243453 5.17494392 5.22965097 5.2790494 5.3303299 5.37462282 5.42595673 5.4708662 5.51809263 5.5551796 5.60238743 5.64451981 5.68663883 5.73047733 5.77145386 5.81551266 5.84995031 5.89340115 5.93276119 5.97148943 6.00836277 6.04449368 6.08746815 6.12337542 6.16327095 6.20152664 6.23758078 6.27203655 6.30277205 6.33960104 6.37893295 6.42145538 6.46122646 6.49873352 6.53448057 6.57160664 6.61344719 6.6518116 6.69056034 6.72961712 6.76635885 6.80167198 6.83856058 6.87913227 6.92100811 6.96108532 6.99986601 7.04136467 7.08040524 7.12530327 7.16936302 7.20966578 7.25146484 7.30199528 7.35143661 7.39652252 7.43774891 7.48364782 7.52701664 7.57922268 7.63305378 7.69054031 7.74882221 7.81353664 7.87193584 7.94112301 8.01784229 8.09514618 8.17512703 8.25938034 8.36244583 8.47377396 8.58826065 8.72116089 8.87581444 9.07960892 9.35284042 9.72861481 10.3961449 17.7251911 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.1136055 24.5277195 25.9202518 26.9046669 27.7904472 28.6111298 29.3293953 29.9499626 30.6761398 31.2306252 31.7099495 32.1420784 32.665596 33.0766678 33.4729004 33.9002228 34.3474579 34.7106552 35.0230255 35.390419 35.7220535 36.0495682 36.4078636 36.695076 37.0229568 37.3687744 37.7228928 38.0249634 38.323349 38.5891037 38.8695526 39.2269402 39.5394135 39.8455734 40.199707 40.4622612 40.7932739 41.1381226 41.4406166 41.7943306 42.1472244 42.4771652 42.7902908 43.0710602 43.4091415 43.7895126 44.0807495 44.5092163 44.9088287 45.302681 45.7361374 46.1355743 46.6172142 47.0506897 47.5055847 47.9729843 48.3878632 48.8428421 49.2700081 49.7159882 50.2303772 50.6390305 51.0410614 51.4901428 51.9740601 52.4536057 53.0195847 53.5424805 54.0908928 54.5857964 55.07621 55.5731354 56.1048698 56.6305008 57.1052246 57.6321716 58.1845627 58.5730667 59.1580124 59.6829529 60.3115997 60.997448 61.7444725 62.4792023 63.2543373 64.1329193 65.0588226 66.1371002 67.3397522 68.5811005 69.9866028 71.6126633 73.4247513 75.741272 78.7159576 82.2558899 86.4861298 93.0407791 103.874054 280.646332 ------------------------------ Transdef: Tab for variable 7 30.1131554 32.6385727 33.6023026 34.2245712 34.7914925 35.3317108 35.714016 36.1320648 36.5518913 36.9017105 37.2200012 37.5548592 37.8530006 38.1454353 38.3897934 38.6926956 38.9496613 39.2405319 39.5367508 39.8131638 40.0938988 40.3702087 40.6261215 40.9353142 41.3036499 41.6672668 41.9971237 42.3179398 42.6425858 43.0215149 43.4832573 43.9010582 44.4110794 44.8217735 45.238102 45.7918396 46.2731628 46.8146858 47.4127197 48.0427704 48.6189957 49.1812134 49.7683067 50.4253044 51.019722 51.5894699 52.1764984 52.7345276 53.3913116 54.0342102 54.6732864 55.2895508 55.9369011 56.6303978 57.2681961 57.9029083 58.6095276 59.2464638 59.9990005 60.746933 61.3814011 62.1676712 62.9402084 63.8787041 64.8889999 65.9638672 67.2578125 68.4707794 69.8868103 71.0619965 72.4533997 73.5743027 75.0074921 76.4313965 77.8030701 79.3052979 80.882843 82.521347 84.2201233 86.2733002 88.1134491 90.1784821 92.3155289 94.4979095 97.1004791 99.4286041 102.321609 105.432434 108.779297 112.5681 116.255775 120.843376 126.141495 131.879303 138.009338 145.468323 155.621399 167.868042 187.299545 217.798065 731.025879 ------------------------------ Transdef: Tab for variable 8 0.972836435 22.4527912 27.0640068 29.5289555 30.8968334 31.9158287 32.6185837 33.0910645 33.6154327 34.0101624 34.3735809 34.7782173 35.116684 35.4493866 35.7653542 36.0633163 36.3484497 36.6165085 36.8732681 37.1330719 37.3703613 37.6433907 37.871624 38.1015549 38.3167725 38.6007423 38.8392639 39.0574722 39.2622414 39.4834061 39.6850204 39.9745827 40.2254601 40.5087242 40.7755814 41.0880508 41.3616486 41.660862 41.9977264 42.3035698 42.591507 42.9517288 43.2796478 43.5772133 43.8952713 44.2438812 44.5467911 44.9368095 45.335701 45.7128372 46.1396255 46.5594177 47.0137253 47.4065628 47.8810425 48.2607727 48.6610031 49.034584 49.4084435 49.8452225 50.3064957 50.749054 51.1947174 51.6278839 52.0839691 52.5348053 53.0280533 53.4910507 53.9903717 54.4633484 54.9651031 55.4253044 55.9442749 56.4524307 56.9848595 57.4633408 58.0013695 58.5711365 59.1545105 59.7447281 60.3630371 61.0626907 61.5985947 62.3315201 63.1312637 63.9866867 64.9673157 66.0487823 67.161438 68.5724792 69.9868317 71.6719818 73.4850159 75.4977875 78.1261292 80.9311676 84.7981873 89.8967896 96.8960571 112.463493 428.068787 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7101555 64.5298767 66.2247925 67.2538223 68.2530518 69.0442657 70.0111694 70.7463684 71.3764114 72.1150055 72.7846985 73.4305954 74.0568695 74.6637955 75.177681 75.7139969 76.2813416 76.7730255 77.1959534 77.7102661 78.2941284 78.7363968 79.2081909 79.6494446 80.1361389 80.6521149 81.0975189 81.6658173 82.180191 82.6737518 83.2065659 83.7200623 84.388092 85.0761795 85.7527313 86.4167633 87.0857239 87.8176575 88.5674133 89.2138901 89.7815704 90.515892 91.2227478 91.9674072 92.6994781 93.4190521 94.176651 95.0731812 95.8960114 96.5187683 97.3113708 98.1397171 98.8985596 99.7251587 100.522186 101.298294 102.02758 102.679855 103.488861 104.200806 104.93531 105.688019 106.414238 107.176567 107.921562 108.648041 109.396255 110.152153 110.894455 111.636528 112.333252 113.063904 113.832603 114.595718 115.320496 116.046944 116.857773 117.640953 118.448715 119.253204 119.967453 120.915878 121.804077 122.75898 123.823975 124.871918 125.971573 127.293892 128.762848 130.440598 132.487076 134.863892 137.510468 140.904068 144.791306 149.680252 156.568329 168.434509 190.095825 582.80835 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.908318281 1.18007231 1.3806181 1.52969956 1.66208136 1.76813912 1.86319828 1.94621682 2.02839994 2.09550762 2.15741348 2.21580625 2.26474428 2.30779243 2.35145235 2.39197731 2.42760134 2.46097898 2.49397135 2.52745962 2.55707431 2.58421516 2.6110816 2.63532305 2.66007662 2.68120241 2.7028923 2.72168016 2.74185014 2.76131701 2.77584076 2.79361176 2.80800438 2.82388115 2.83835125 2.84840727 2.85966921 2.87211466 2.8819015 2.8918016 2.90087295 2.91107941 2.91929579 2.9258914 2.93347359 2.94159627 2.94904947 2.95591807 2.96231127 2.96833873 2.97436285 2.97926021 2.98422146 2.98913717 2.99436665 2.99952221 3.00455332 3.00954175 3.01460576 3.01918864 3.02360964 3.02769017 3.0315516 3.03562284 3.0395937 3.04339051 3.04720759 3.05098891 3.05456972 3.05774021 3.06087732 3.06480646 3.06814313 3.07145333 3.07448912 3.07746267 3.08062649 3.08384514 3.0869298 3.0901556 3.09341049 3.09627962 3.09901237 3.10197759 3.10452437 3.10744166 3.10993481 3.11262465 3.11524248 3.11741543 3.11994004 3.12244129 3.12505913 3.12762165 3.12989879 3.13187599 3.13411808 3.13634014 3.1390152 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.09672546E-05 0.00519469008 0.0109256506 0.0176647902 0.0236293077 0.0296443384 0.0370159149 0.0440967083 0.0509643555 0.0586076975 0.0653715134 0.072245717 0.079090029 0.0859111845 0.0928145349 0.0984688401 0.105093867 0.109746844 0.115210772 0.121691704 0.128376484 0.134389162 0.14034009 0.146365166 0.152503371 0.158540726 0.164308608 0.170333862 0.175873935 0.182102382 0.187281191 0.19316408 0.198672652 0.205101043 0.210985333 0.216955423 0.223153949 0.229525477 0.234483331 0.240380287 0.246671081 0.253272057 0.259970665 0.265877008 0.271334529 0.277653933 0.284316897 0.290485919 0.296679497 0.302992463 0.309672236 0.315670192 0.32215035 0.328797698 0.335676908 0.342817307 0.349450052 0.356102169 0.36185956 0.368406296 0.375214636 0.381753325 0.387702405 0.39382863 0.400065124 0.407386303 0.413987517 0.420324087 0.426368684 0.432682931 0.438246429 0.444474816 0.450915813 0.457750022 0.464552164 0.471544623 0.47787118 0.484855473 0.493379146 0.501079142 0.509523869 0.517717063 0.525766611 0.534412503 0.544524193 0.553055882 0.562644839 0.573864698 0.584187984 0.596487641 0.609000266 0.62261194 0.637561977 0.652086139 0.670379162 0.693606317 0.713380098 0.742832899 0.788308859 0.846511424 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.100003853 0.124608919 0.145458475 0.160948068 0.172449619 0.185908347 0.197020203 0.205583602 0.2165813 0.227939367 0.23757638 0.248219222 0.25766319 0.267383277 0.275504112 0.283986658 0.29253149 0.301822424 0.310400486 0.318315357 0.325392187 0.334090829 0.342682868 0.349874377 0.357404202 0.365152508 0.372035742 0.378689766 0.386128306 0.393027574 0.399624884 0.405524403 0.411024272 0.41609478 0.420632005 0.425474167 0.430541337 0.435294211 0.439555794 0.444558144 0.449040115 0.453564107 0.457634062 0.461912274 0.466478229 0.470975071 0.475461006 0.478452027 0.482341826 0.486720741 0.490575552 0.494453132 0.498292089 0.502542078 0.50733602 0.511478543 0.51599896 0.520533204 0.525468946 0.529659033 0.534349084 0.53890872 0.544282138 0.549453259 0.554404199 0.559085608 0.563406825 0.568650961 0.573886871 0.578804314 0.583995461 0.589426398 0.594967961 0.600376368 0.605447769 0.611441612 0.617701352 0.623658299 0.629926562 0.637353301 0.644953966 0.651830077 0.659740686 0.666389048 0.674302936 0.68131721 0.68937099 0.698739767 0.706751585 0.716677308 0.726896882 0.739023447 0.751648664 0.764492273 0.780242801 0.796369791 0.812884331 0.835964441 0.865198731 0.904915214 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.3104439 22.1204605 22.6168442 23.1122017 23.5986042 23.9871483 24.3880997 24.8230305 25.1569023 25.5167389 25.8658752 26.2098656 26.5603981 26.9064579 27.2387028 27.5420322 27.7980766 28.1068497 28.4266052 28.7263927 29.0218315 29.3068352 29.6167927 29.8800697 30.1526604 30.4397945 30.7101383 30.9845543 31.2535286 31.5149918 31.7892303 32.0575714 32.3247147 32.602417 32.9022675 33.1914444 33.5006027 33.7823792 34.1078949 34.3979607 34.6817818 34.9808922 35.3024139 35.6190605 35.9556885 36.2340698 36.56007 36.9384613 37.2725487 37.607048 37.9157829 38.2925377 38.6306458 38.9477844 39.3582191 39.7160339 40.1043396 40.5235252 40.9086838 41.3263016 41.7962036 42.3124924 42.6787109 43.0649414 43.5671692 44.0936737 44.6094208 45.1605682 45.707634 46.3243294 46.8287735 47.3909988 47.985508 48.7006149 49.4211121 50.1233292 50.8068314 51.6161842 52.5226593 53.464859 54.4091454 55.3180389 56.4762421 57.6371765 58.8574829 60.0160789 61.2923088 62.9964905 64.7343216 66.4951096 68.58638 70.9614029 73.3766022 76.9228058 80.6018219 85.0491791 88.724617 94.9823914 107.850189 381.504089 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.583498 10.9228249 11.2373266 11.5047302 11.7569046 11.9830341 12.2435884 12.4099998 12.6070642 12.8523989 13.0860415 13.3222942 13.5384369 13.7500172 13.9374323 14.1583214 14.3573036 14.5757084 14.7790318 14.9726162 15.1521091 15.3394442 15.52742 15.7184277 15.9159565 16.1404877 16.2866364 16.4631119 16.6613464 16.8619003 17.0313034 17.2554207 17.4791679 17.6813469 17.8592129 18.0513344 18.2532978 18.4608517 18.6610928 18.8519096 19.0632725 19.2503777 19.4692574 19.6856136 19.8845673 20.1243401 20.343277 20.5785751 20.7495575 21.0019188 21.2589989 21.5268917 21.7403755 21.9673634 22.1938705 22.4337921 22.6824875 22.9395142 23.184948 23.4677811 23.7059288 23.9425621 24.2425022 24.5294266 24.8226204 25.1352787 25.4402275 25.7244682 26.0219116 26.3045311 26.6250706 26.9896717 27.2963715 27.6248703 27.9636917 28.3031769 28.7047768 29.1466751 29.5793114 30.0999794 30.5895691 31.1164722 31.6657925 32.2212982 32.885952 33.4474754 34.1341934 34.9163094 35.8052788 36.7542191 37.8069 38.9394836 40.2134171 41.7898674 43.7149506 45.4378357 48.6350441 53.2563934 61.3720016 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 55.5 38.0 34.1 8.1 32.6 54.5 39.0 50.6 -30.9 -4.6 -9.0 9.2 8.4 2 55.5 100.0 63.6 49.6 16.1 59.0 94.2 64.4 90.2 -50.4 -17.0 -27.9 33.7 24.7 3 38.0 63.6 100.0 27.0 -5.7 25.4 67.0 46.6 69.5 -19.5 -18.3 -32.1 67.1 11.5 4 34.1 49.6 27.0 100.0 -0.5 23.1 51.4 38.0 54.7 -14.2 -21.9 -37.6 12.2 71.2 5 8.1 16.1 -5.7 -0.5 100.0 79.5 -11.3 44.6 42.6 31.5 -0.6 0.9 -10.9 -5.5 6 32.6 59.0 25.4 23.1 79.5 100.0 37.1 72.0 74.3 -3.1 -8.4 -12.6 7.8 7.9 7 54.5 94.2 67.0 51.4 -11.3 37.1 100.0 57.6 78.3 -57.2 -15.9 -27.6 38.0 27.5 8 39.0 64.4 46.6 38.0 44.6 72.0 57.6 100.0 76.3 -9.1 -16.2 -24.0 24.5 19.7 9 50.6 90.2 69.5 54.7 42.6 74.3 78.3 76.3 100.0 -24.8 -19.9 -33.7 38.7 29.3 10 -30.9 -50.4 -19.5 -14.2 31.5 -3.1 -57.2 -9.1 -24.8 100.0 3.1 5.7 -7.8 -4.4 11 -4.6 -17.0 -18.3 -21.9 -0.6 -8.4 -15.9 -16.2 -19.9 3.1 100.0 59.9 -7.8 -12.8 12 -9.0 -27.9 -32.1 -37.6 0.9 -12.6 -27.6 -24.0 -33.7 5.7 59.9 100.0 -12.2 -16.4 13 9.2 33.7 67.1 12.2 -10.9 7.8 38.0 24.5 38.7 -7.8 -7.8 -12.2 100.0 40.3 14 8.4 24.7 11.5 71.2 -5.5 7.9 27.5 19.7 29.3 -4.4 -12.8 -16.4 40.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 122.780827 TOTAL CORRELATION OF ALL VARIABLES 60.9416969 ROUND 1: MAX CORR ( 60.9413382) AFTER KILLING INPUT VARIABLE 11 CONTR 0.209092516 ROUND 2: MAX CORR ( 60.9399666) AFTER KILLING INPUT VARIABLE 6 CONTR 0.408875878 ROUND 3: MAX CORR ( 60.8516974) AFTER KILLING INPUT VARIABLE 8 CONTR 3.27878764 ROUND 4: MAX CORR ( 60.7643941) AFTER KILLING INPUT VARIABLE 2 CONTR 3.25844746 ROUND 5: MAX CORR ( 60.6823715) AFTER KILLING INPUT VARIABLE 9 CONTR 3.15616641 ROUND 6: MAX CORR ( 60.3355639) AFTER KILLING INPUT VARIABLE 10 CONTR 6.47842059 ROUND 7: MAX CORR ( 59.9805539) AFTER KILLING INPUT VARIABLE 14 CONTR 6.53555093 ROUND 8: MAX CORR ( 59.2279967) AFTER KILLING INPUT VARIABLE 4 CONTR 9.47160295 ROUND 9: MAX CORR ( 58.5256072) AFTER KILLING INPUT VARIABLE 12 CONTR 9.0944427 ROUND 10: MAX CORR ( 57.4942237) AFTER KILLING INPUT VARIABLE 3 CONTR 10.9389642 ROUND 11: MAX CORR ( 56.344286) AFTER KILLING INPUT VARIABLE 13 CONTR 11.4414683 ROUND 12: MAX CORR ( 54.4781774) AFTER KILLING INPUT VARIABLE 5 CONTR 14.380777 LAST REMAINING VARIABLE: 7 total correlation to target: 60.9416969 % total significance: 123.723821 sigma correlations of single variables to target: variable 2: 55.522017 % , in sigma: 112.720788 variable 3: 37.9925285 % , in sigma: 77.1324241 variable 4: 34.0833365 % , in sigma: 69.1959832 variable 5: 8.14475933 % , in sigma: 16.5354888 variable 6: 32.6044584 % , in sigma: 66.1935652 variable 7: 54.4781774 % , in sigma: 110.601585 variable 8: 38.9538193 % , in sigma: 79.0840365 variable 9: 50.6025838 % , in sigma: 102.733356 variable 10: -30.9166222 % , in sigma: 62.7669204 variable 11: -4.57041854 % , in sigma: 9.27886284 variable 12: -8.9890436 % , in sigma: 18.2495546 variable 13: 9.15721826 % , in sigma: 18.5909827 variable 14: 8.40631272 % , in sigma: 17.0664945 variables sorted by significance: 1 most relevant variable 7 corr 54.4781761 , in sigma: 110.601583 2 most relevant variable 5 corr 14.3807774 , in sigma: 29.1958514 3 most relevant variable 13 corr 11.4414682 , in sigma: 23.2284666 4 most relevant variable 3 corr 10.9389639 , in sigma: 22.2082824 5 most relevant variable 12 corr 9.09444237 , in sigma: 18.4635351 6 most relevant variable 4 corr 9.47160339 , in sigma: 19.2292474 7 most relevant variable 14 corr 6.53555107 , in sigma: 13.2684745 8 most relevant variable 10 corr 6.47842073 , in sigma: 13.1524885 9 most relevant variable 9 corr 3.15616632 , in sigma: 6.40764824 10 most relevant variable 2 corr 3.25844741 , in sigma: 6.6152993 11 most relevant variable 8 corr 3.27878761 , in sigma: 6.65659398 12 most relevant variable 6 corr 0.408875883 , in sigma: 0.830099738 13 most relevant variable 11 corr 0.209092513 , in sigma: 0.424499579 global correlations between input variables: variable 2: 99.0489452 % variable 3: 93.4837469 % variable 4: 90.8572375 % variable 5: 94.797665 % variable 6: 93.5739539 % variable 7: 98.5738938 % variable 8: 85.6990916 % variable 9: 98.7488776 % variable 10: 72.4052241 % variable 11: 60.5783103 % variable 12: 68.4677101 % variable 13: 85.8413266 % variable 14: 87.5511553 % significance loss when removing single variables: variable 2: corr = 4.20486991 % , sigma = 8.53672609 variable 3: corr = 10.915286 % , sigma = 22.1602116 variable 4: corr = 12.7835212 % , sigma = 25.9531024 variable 5: corr = 6.08014641 % , sigma = 12.3439121 variable 6: corr = 0.404845614 % , sigma = 0.821917488 variable 7: corr = 3.69033383 % , sigma = 7.49211503 variable 8: corr = 2.9254183 % , sigma = 5.93918367 variable 9: corr = 5.36093153 % , sigma = 10.8837622 variable 10: corr = 6.18155185 % , sigma = 12.5497854 variable 11: corr = 0.209092516 % , sigma = 0.424499586 variable 12: corr = 9.74539033 % , sigma = 19.7850896 variable 13: corr = 7.04454117 % , sigma = 14.3018261 variable 14: corr = 6.45384011 % , sigma = 13.102585 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 19.0768738 sigma out 15 active outputs RANK 2 NODE 5 --> 18.0769062 sigma out 15 active outputs RANK 3 NODE 4 --> 17.3897305 sigma out 15 active outputs RANK 4 NODE 8 --> 17.2291145 sigma out 15 active outputs RANK 5 NODE 11 --> 16.3186226 sigma out 15 active outputs RANK 6 NODE 7 --> 13.0796671 sigma out 15 active outputs RANK 7 NODE 12 --> 12.443162 sigma out 15 active outputs RANK 8 NODE 2 --> 12.2724066 sigma out 15 active outputs RANK 9 NODE 1 --> 11.9011898 sigma out 15 active outputs RANK 10 NODE 9 --> 11.073391 sigma out 15 active outputs RANK 11 NODE 3 --> 10.8895464 sigma out 15 active outputs RANK 12 NODE 10 --> 10.6207981 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 31.9020977 sigma in 12act. ( 32.9479599 sig out 1act.) RANK 2 NODE 7 --> 18.2023392 sigma in 12act. ( 15.8311462 sig out 1act.) RANK 3 NODE 4 --> 16.5930386 sigma in 12act. ( 15.9212894 sig out 1act.) RANK 4 NODE 5 --> 14.380621 sigma in 12act. ( 11.7543898 sig out 1act.) RANK 5 NODE 9 --> 14.3672647 sigma in 12act. ( 14.3778343 sig out 1act.) RANK 6 NODE 15 --> 13.6862879 sigma in 12act. ( 13.2502842 sig out 1act.) RANK 7 NODE 3 --> 8.75279236 sigma in 12act. ( 7.37177086 sig out 1act.) RANK 8 NODE 6 --> 8.40542984 sigma in 12act. ( 10.2925692 sig out 1act.) RANK 9 NODE 2 --> 7.1237402 sigma in 12act. ( 8.57501221 sig out 1act.) RANK 10 NODE 8 --> 5.61557674 sigma in 12act. ( 0.9757061 sig out 1act.) RANK 11 NODE 13 --> 4.95854282 sigma in 12act. ( 2.91178441 sig out 1act.) RANK 12 NODE 1 --> 4.81065893 sigma in 12act. ( 3.58139539 sig out 1act.) RANK 13 NODE 11 --> 4.77325773 sigma in 12act. ( 5.92668962 sig out 1act.) RANK 14 NODE 14 --> 1.63820016 sigma in 12act. ( 2.36490393 sig out 1act.) RANK 15 NODE 12 --> 0.856043518 sigma in 12act. ( 0.518707514 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 32.9479599 sigma out 1act.( 31.9020977 sig in 12act.) RANK 2 NODE 4 --> 15.9212894 sigma out 1act.( 16.5930386 sig in 12act.) RANK 3 NODE 7 --> 15.8311462 sigma out 1act.( 18.2023392 sig in 12act.) RANK 4 NODE 9 --> 14.3778343 sigma out 1act.( 14.3672647 sig in 12act.) RANK 5 NODE 15 --> 13.2502842 sigma out 1act.( 13.6862879 sig in 12act.) RANK 6 NODE 5 --> 11.7543898 sigma out 1act.( 14.380621 sig in 12act.) RANK 7 NODE 6 --> 10.2925692 sigma out 1act.( 8.40542984 sig in 12act.) RANK 8 NODE 2 --> 8.57501221 sigma out 1act.( 7.1237402 sig in 12act.) RANK 9 NODE 3 --> 7.37177086 sigma out 1act.( 8.75279236 sig in 12act.) RANK 10 NODE 11 --> 5.92668962 sigma out 1act.( 4.77325773 sig in 12act.) RANK 11 NODE 1 --> 3.58139539 sigma out 1act.( 4.81065893 sig in 12act.) RANK 12 NODE 13 --> 2.91178441 sigma out 1act.( 4.95854282 sig in 12act.) RANK 13 NODE 14 --> 2.36490393 sigma out 1act.( 1.63820016 sig in 12act.) RANK 14 NODE 8 --> 0.9757061 sigma out 1act.( 5.61557674 sig in 12act.) RANK 15 NODE 12 --> 0.518707514 sigma out 1act.( 0.856043518 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 49.0631599 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 22.5428734 sigma out 15 active outputs RANK 2 NODE 6 --> 18.4221668 sigma out 15 active outputs RANK 3 NODE 5 --> 18.1647263 sigma out 15 active outputs RANK 4 NODE 4 --> 18.0592442 sigma out 15 active outputs RANK 5 NODE 8 --> 17.2129784 sigma out 15 active outputs RANK 6 NODE 1 --> 14.5857525 sigma out 15 active outputs RANK 7 NODE 12 --> 13.2285929 sigma out 15 active outputs RANK 8 NODE 2 --> 12.5988312 sigma out 15 active outputs RANK 9 NODE 7 --> 12.566638 sigma out 15 active outputs RANK 10 NODE 9 --> 11.1500854 sigma out 15 active outputs RANK 11 NODE 10 --> 11.0193558 sigma out 15 active outputs RANK 12 NODE 3 --> 10.4293585 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 30.5056553 sigma in 12act. ( 31.2877789 sig out 1act.) RANK 2 NODE 4 --> 15.4860773 sigma in 12act. ( 14.8789864 sig out 1act.) RANK 3 NODE 7 --> 14.4628019 sigma in 12act. ( 13.9389954 sig out 1act.) RANK 4 NODE 9 --> 14.1815224 sigma in 12act. ( 13.417944 sig out 1act.) RANK 5 NODE 15 --> 14.0754862 sigma in 12act. ( 12.3564835 sig out 1act.) RANK 6 NODE 6 --> 13.1006184 sigma in 12act. ( 11.0156994 sig out 1act.) RANK 7 NODE 5 --> 12.5846195 sigma in 12act. ( 10.4127254 sig out 1act.) RANK 8 NODE 14 --> 12.2826595 sigma in 12act. ( 5.25184011 sig out 1act.) RANK 9 NODE 12 --> 12.124774 sigma in 12act. ( 4.51378965 sig out 1act.) RANK 10 NODE 2 --> 11.8945036 sigma in 12act. ( 9.35256386 sig out 1act.) RANK 11 NODE 3 --> 9.44334221 sigma in 12act. ( 6.40840578 sig out 1act.) RANK 12 NODE 11 --> 8.65220737 sigma in 12act. ( 6.96723413 sig out 1act.) RANK 13 NODE 8 --> 8.52644253 sigma in 12act. ( 0.354745835 sig out 1act.) RANK 14 NODE 13 --> 6.78791189 sigma in 12act. ( 2.43886781 sig out 1act.) RANK 15 NODE 1 --> 5.27863836 sigma in 12act. ( 3.24110365 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 31.2877789 sigma out 1act.( 30.5056553 sig in 12act.) RANK 2 NODE 4 --> 14.8789864 sigma out 1act.( 15.4860773 sig in 12act.) RANK 3 NODE 7 --> 13.9389954 sigma out 1act.( 14.4628019 sig in 12act.) RANK 4 NODE 9 --> 13.417944 sigma out 1act.( 14.1815224 sig in 12act.) RANK 5 NODE 15 --> 12.3564835 sigma out 1act.( 14.0754862 sig in 12act.) RANK 6 NODE 6 --> 11.0156994 sigma out 1act.( 13.1006184 sig in 12act.) RANK 7 NODE 5 --> 10.4127254 sigma out 1act.( 12.5846195 sig in 12act.) RANK 8 NODE 2 --> 9.35256386 sigma out 1act.( 11.8945036 sig in 12act.) RANK 9 NODE 11 --> 6.96723413 sigma out 1act.( 8.65220737 sig in 12act.) RANK 10 NODE 3 --> 6.40840578 sigma out 1act.( 9.44334221 sig in 12act.) RANK 11 NODE 14 --> 5.25184011 sigma out 1act.( 12.2826595 sig in 12act.) RANK 12 NODE 12 --> 4.51378965 sigma out 1act.( 12.124774 sig in 12act.) RANK 13 NODE 1 --> 3.24110365 sigma out 1act.( 5.27863836 sig in 12act.) RANK 14 NODE 13 --> 2.43886781 sigma out 1act.( 6.78791189 sig in 12act.) RANK 15 NODE 8 --> 0.354745835 sigma out 1act.( 8.52644253 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.8904533 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.399425417 *** contribution from regularisation: 0.00466461666 *** contribution from error: -0.404090047 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.444099754 *** contribution from regularisation: 0.00221709022 *** contribution from error: -0.446316838 *********************************************** -----------------> Test sample ENTER BFGS code START -44234.3011 0.0777795985 -0.0114107104 EXIT FROM BFGS code FG_START 0. 0.0777795985 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.467560947 *** contribution from regularisation: 0.00224117772 *** contribution from error: -0.469802111 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46560.6529 0.0777795985 108.628777 EXIT FROM BFGS code FG_LNSRCH 0. 0.0926162302 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.507319868 *** contribution from regularisation: 0.00301137334 *** contribution from error: -0.510331213 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50519.929 0.0926162302 22.7182465 EXIT FROM BFGS code NEW_X -50519.929 0.0926162302 22.7182465 ENTER BFGS code NEW_X -50519.929 0.0926162302 22.7182465 EXIT FROM BFGS code FG_LNSRCH 0. 0.0959450379 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.508306623 *** contribution from regularisation: 0.00301986909 *** contribution from error: -0.511326492 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50618.1907 0.0959450379 16.5100765 EXIT FROM BFGS code NEW_X -50618.1907 0.0959450379 16.5100765 ENTER BFGS code NEW_X -50618.1907 0.0959450379 16.5100765 EXIT FROM BFGS code FG_LNSRCH 0. 0.102709375 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.509284735 *** contribution from regularisation: 0.00292323297 *** contribution from error: -0.512207985 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50715.5914 0.102709375 21.72052 EXIT FROM BFGS code NEW_X -50715.5914 0.102709375 21.72052 ENTER BFGS code NEW_X -50715.5914 0.102709375 21.72052 EXIT FROM BFGS code FG_LNSRCH 0. 0.13337855 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.510336637 *** contribution from regularisation: 0.00289993663 *** contribution from error: -0.513236582 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50820.3422 0.13337855 23.1092949 EXIT FROM BFGS code NEW_X -50820.3422 0.13337855 23.1092949 ENTER BFGS code NEW_X -50820.3422 0.13337855 23.1092949 EXIT FROM BFGS code FG_LNSRCH 0. 0.152031481 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.511317134 *** contribution from regularisation: 0.0029574919 *** contribution from error: -0.514274597 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50917.9822 0.152031481 11.5532522 EXIT FROM BFGS code NEW_X -50917.9822 0.152031481 11.5532522 ENTER BFGS code NEW_X -50917.9822 0.152031481 11.5532522 EXIT FROM BFGS code FG_LNSRCH 0. 0.438720971 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.436335981 *** contribution from regularisation: 0.00546087511 *** contribution from error: -0.441796869 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -43451.2108 0.438720971 -9.80508423 EXIT FROM BFGS code FG_LNSRCH 0. 0.177956447 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 38.4401932 sigma out 15 active outputs RANK 2 NODE 1 --> 21.3710155 sigma out 15 active outputs RANK 3 NODE 4 --> 16.9091339 sigma out 15 active outputs RANK 4 NODE 3 --> 15.2634449 sigma out 15 active outputs RANK 5 NODE 8 --> 14.314456 sigma out 15 active outputs RANK 6 NODE 9 --> 11.449295 sigma out 15 active outputs RANK 7 NODE 6 --> 11.1025171 sigma out 15 active outputs RANK 8 NODE 5 --> 10.2009783 sigma out 15 active outputs RANK 9 NODE 12 --> 9.83219814 sigma out 15 active outputs RANK 10 NODE 10 --> 9.76409245 sigma out 15 active outputs RANK 11 NODE 2 --> 9.28240204 sigma out 15 active outputs RANK 12 NODE 7 --> 8.39313221 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 31.064661 sigma in 12act. ( 31.4914608 sig out 1act.) RANK 2 NODE 14 --> 30.5754337 sigma in 12act. ( 38.3307343 sig out 1act.) RANK 3 NODE 6 --> 20.9968548 sigma in 12act. ( 18.4369373 sig out 1act.) RANK 4 NODE 10 --> 16.0360794 sigma in 12act. ( 14.728508 sig out 1act.) RANK 5 NODE 11 --> 12.3320971 sigma in 12act. ( 9.79239273 sig out 1act.) RANK 6 NODE 9 --> 10.8456364 sigma in 12act. ( 10.6789026 sig out 1act.) RANK 7 NODE 2 --> 9.80802917 sigma in 12act. ( 9.08707142 sig out 1act.) RANK 8 NODE 15 --> 9.76553345 sigma in 12act. ( 8.35781288 sig out 1act.) RANK 9 NODE 3 --> 8.47876644 sigma in 12act. ( 8.56697178 sig out 1act.) RANK 10 NODE 13 --> 7.55157328 sigma in 12act. ( 7.94073725 sig out 1act.) RANK 11 NODE 1 --> 7.53349495 sigma in 12act. ( 7.23199272 sig out 1act.) RANK 12 NODE 4 --> 6.52876186 sigma in 12act. ( 6.09848309 sig out 1act.) RANK 13 NODE 8 --> 6.14657259 sigma in 12act. ( 5.23987532 sig out 1act.) RANK 14 NODE 7 --> 5.47217941 sigma in 12act. ( 4.74543953 sig out 1act.) RANK 15 NODE 5 --> 3.16364646 sigma in 12act. ( 0.49404344 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 38.3307343 sigma out 1act.( 30.5754337 sig in 12act.) RANK 2 NODE 12 --> 31.4914608 sigma out 1act.( 31.064661 sig in 12act.) RANK 3 NODE 6 --> 18.4369373 sigma out 1act.( 20.9968548 sig in 12act.) RANK 4 NODE 10 --> 14.728508 sigma out 1act.( 16.0360794 sig in 12act.) RANK 5 NODE 9 --> 10.6789026 sigma out 1act.( 10.8456364 sig in 12act.) RANK 6 NODE 11 --> 9.79239273 sigma out 1act.( 12.3320971 sig in 12act.) RANK 7 NODE 2 --> 9.08707142 sigma out 1act.( 9.80802917 sig in 12act.) RANK 8 NODE 3 --> 8.56697178 sigma out 1act.( 8.47876644 sig in 12act.) RANK 9 NODE 15 --> 8.35781288 sigma out 1act.( 9.76553345 sig in 12act.) RANK 10 NODE 13 --> 7.94073725 sigma out 1act.( 7.55157328 sig in 12act.) RANK 11 NODE 1 --> 7.23199272 sigma out 1act.( 7.53349495 sig in 12act.) RANK 12 NODE 4 --> 6.09848309 sigma out 1act.( 6.52876186 sig in 12act.) RANK 13 NODE 8 --> 5.23987532 sigma out 1act.( 6.14657259 sig in 12act.) RANK 14 NODE 7 --> 4.74543953 sigma out 1act.( 5.47217941 sig in 12act.) RANK 15 NODE 5 --> 0.49404344 sigma out 1act.( 3.16364646 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.4675636 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.514282882 *** contribution from regularisation: 0.00137594633 *** contribution from error: -0.515658855 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51213.3154 0.177956447 -0.423448503 EXIT FROM BFGS code NEW_X -51213.3154 0.177956447 -0.423448503 ENTER BFGS code NEW_X -51213.3154 0.177956447 -0.423448503 EXIT FROM BFGS code FG_LNSRCH 0. 0.289058328 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.511291444 *** contribution from regularisation: 0.00384993944 *** contribution from error: -0.515141368 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50915.4227 0.289058328 -25.4573383 EXIT FROM BFGS code FG_LNSRCH 0. 0.212317556 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.514972568 *** contribution from regularisation: 0.0023168386 *** contribution from error: -0.5172894 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51281.9998 0.212317556 -11.8141413 EXIT FROM BFGS code NEW_X -51281.9998 0.212317556 -11.8141413 ENTER BFGS code NEW_X -51281.9998 0.212317556 -11.8141413 EXIT FROM BFGS code FG_LNSRCH 0. 0.268544555 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.515714824 *** contribution from regularisation: 0.00332782581 *** contribution from error: -0.519042671 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51355.9161 0.268544555 -9.59542179 EXIT FROM BFGS code NEW_X -51355.9161 0.268544555 -9.59542179 ENTER BFGS code NEW_X -51355.9161 0.268544555 -9.59542179 EXIT FROM BFGS code FG_LNSRCH 0. 0.292549759 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.517009854 *** contribution from regularisation: 0.0030897921 *** contribution from error: -0.52009964 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51484.8761 0.292549759 5.13267851 EXIT FROM BFGS code NEW_X -51484.8761 0.292549759 5.13267851 ENTER BFGS code NEW_X -51484.8761 0.292549759 5.13267851 EXIT FROM BFGS code FG_LNSRCH 0. 0.289990634 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.517374277 *** contribution from regularisation: 0.00304254657 *** contribution from error: -0.520416796 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51521.1652 0.289990634 8.3114357 EXIT FROM BFGS code NEW_X -51521.1652 0.289990634 8.3114357 ENTER BFGS code NEW_X -51521.1652 0.289990634 8.3114357 EXIT FROM BFGS code FG_LNSRCH 0. 0.301461577 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.51803267 *** contribution from regularisation: 0.00311641744 *** contribution from error: -0.521149099 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51586.7289 0.301461577 9.03408241 EXIT FROM BFGS code NEW_X -51586.7289 0.301461577 9.03408241 ENTER BFGS code NEW_X -51586.7289 0.301461577 9.03408241 EXIT FROM BFGS code FG_LNSRCH 0. 0.330786854 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.519039571 *** contribution from regularisation: 0.00326225231 *** contribution from error: -0.522301853 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51686.9995 0.330786854 1.21715343 EXIT FROM BFGS code NEW_X -51686.9995 0.330786854 1.21715343 ENTER BFGS code NEW_X -51686.9995 0.330786854 1.21715343 EXIT FROM BFGS code FG_LNSRCH 0. 0.356264681 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.518788338 *** contribution from regularisation: 0.00335727003 *** contribution from error: -0.522145629 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51661.9825 0.356264681 -11.2070789 EXIT FROM BFGS code FG_LNSRCH 0. 0.342001498 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.519724131 *** contribution from regularisation: 0.00299872342 *** contribution from error: -0.52272284 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51755.1673 0.342001498 -6.6926589 EXIT FROM BFGS code NEW_X -51755.1673 0.342001498 -6.6926589 ENTER BFGS code NEW_X -51755.1673 0.342001498 -6.6926589 EXIT FROM BFGS code FG_LNSRCH 0. 0.347535819 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 59.7569656 sigma out 15 active outputs RANK 2 NODE 3 --> 46.1585464 sigma out 15 active outputs RANK 3 NODE 1 --> 24.7382584 sigma out 15 active outputs RANK 4 NODE 4 --> 21.9079113 sigma out 15 active outputs RANK 5 NODE 12 --> 16.6421299 sigma out 15 active outputs RANK 6 NODE 8 --> 13.4351625 sigma out 15 active outputs RANK 7 NODE 6 --> 13.3435001 sigma out 15 active outputs RANK 8 NODE 9 --> 12.5340786 sigma out 15 active outputs RANK 9 NODE 10 --> 11.7848921 sigma out 15 active outputs RANK 10 NODE 5 --> 11.3043385 sigma out 15 active outputs RANK 11 NODE 2 --> 9.5095787 sigma out 15 active outputs RANK 12 NODE 7 --> 5.84115791 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 64.7073975 sigma in 12act. ( 88.6626511 sig out 1act.) RANK 2 NODE 12 --> 40.7984505 sigma in 12act. ( 44.683197 sig out 1act.) RANK 3 NODE 9 --> 20.0379581 sigma in 12act. ( 22.2486286 sig out 1act.) RANK 4 NODE 6 --> 19.8189068 sigma in 12act. ( 19.3618469 sig out 1act.) RANK 5 NODE 1 --> 17.0954628 sigma in 12act. ( 19.7346821 sig out 1act.) RANK 6 NODE 10 --> 14.996583 sigma in 12act. ( 15.7120142 sig out 1act.) RANK 7 NODE 13 --> 14.6386652 sigma in 12act. ( 15.8983831 sig out 1act.) RANK 8 NODE 15 --> 14.4959078 sigma in 12act. ( 13.5033016 sig out 1act.) RANK 9 NODE 3 --> 14.0969801 sigma in 12act. ( 16.2776852 sig out 1act.) RANK 10 NODE 8 --> 7.83798409 sigma in 12act. ( 7.98325825 sig out 1act.) RANK 11 NODE 11 --> 6.17383146 sigma in 12act. ( 4.7752614 sig out 1act.) RANK 12 NODE 2 --> 5.70162916 sigma in 12act. ( 2.68748116 sig out 1act.) RANK 13 NODE 4 --> 4.9489131 sigma in 12act. ( 3.74900103 sig out 1act.) RANK 14 NODE 5 --> 4.26882267 sigma in 12act. ( 3.3368535 sig out 1act.) RANK 15 NODE 7 --> 4.04249811 sigma in 12act. ( 3.28779364 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 88.6626511 sigma out 1act.( 64.7073975 sig in 12act.) RANK 2 NODE 12 --> 44.683197 sigma out 1act.( 40.7984505 sig in 12act.) RANK 3 NODE 9 --> 22.2486286 sigma out 1act.( 20.0379581 sig in 12act.) RANK 4 NODE 1 --> 19.7346821 sigma out 1act.( 17.0954628 sig in 12act.) RANK 5 NODE 6 --> 19.3618469 sigma out 1act.( 19.8189068 sig in 12act.) RANK 6 NODE 3 --> 16.2776852 sigma out 1act.( 14.0969801 sig in 12act.) RANK 7 NODE 13 --> 15.8983831 sigma out 1act.( 14.6386652 sig in 12act.) RANK 8 NODE 10 --> 15.7120142 sigma out 1act.( 14.996583 sig in 12act.) RANK 9 NODE 15 --> 13.5033016 sigma out 1act.( 14.4959078 sig in 12act.) RANK 10 NODE 8 --> 7.98325825 sigma out 1act.( 7.83798409 sig in 12act.) RANK 11 NODE 11 --> 4.7752614 sigma out 1act.( 6.17383146 sig in 12act.) RANK 12 NODE 4 --> 3.74900103 sigma out 1act.( 4.9489131 sig in 12act.) RANK 13 NODE 5 --> 3.3368535 sigma out 1act.( 4.26882267 sig in 12act.) RANK 14 NODE 7 --> 3.28779364 sigma out 1act.( 4.04249811 sig in 12act.) RANK 15 NODE 2 --> 2.68748116 sigma out 1act.( 5.70162916 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 110.424995 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.519899547 *** contribution from regularisation: 0.00322240847 *** contribution from error: -0.523121953 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51772.6348 0.347535819 -10.9605522 EXIT FROM BFGS code NEW_X -51772.6348 0.347535819 -10.9605522 ENTER BFGS code NEW_X -51772.6348 0.347535819 -10.9605522 EXIT FROM BFGS code FG_LNSRCH 0. 0.346239895 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.520126045 *** contribution from regularisation: 0.00315411063 *** contribution from error: -0.523280144 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51795.1944 0.346239895 -10.2475796 EXIT FROM BFGS code NEW_X -51795.1944 0.346239895 -10.2475796 ENTER BFGS code NEW_X -51795.1944 0.346239895 -10.2475796 EXIT FROM BFGS code FG_LNSRCH 0. 0.342439443 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.520397127 *** contribution from regularisation: 0.00318892696 *** contribution from error: -0.523586035 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51822.1866 0.342439443 -9.06220245 EXIT FROM BFGS code NEW_X -51822.1866 0.342439443 -9.06220245 ENTER BFGS code NEW_X -51822.1866 0.342439443 -9.06220245 EXIT FROM BFGS code FG_LNSRCH 0. 0.332042009 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.520806253 *** contribution from regularisation: 0.00319056888 *** contribution from error: -0.52399683 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51862.9297 0.332042009 -7.27376175 EXIT FROM BFGS code NEW_X -51862.9297 0.332042009 -7.27376175 ENTER BFGS code NEW_X -51862.9297 0.332042009 -7.27376175 EXIT FROM BFGS code FG_LNSRCH 0. 0.308576822 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.520248234 *** contribution from regularisation: 0.00327446894 *** contribution from error: -0.523522675 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51807.3623 0.308576822 -4.98988581 EXIT FROM BFGS code FG_LNSRCH 0. 0.325022101 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.520995975 *** contribution from regularisation: 0.00318786548 *** contribution from error: -0.524183869 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51881.8202 0.325022101 -7.71331358 EXIT FROM BFGS code NEW_X -51881.8202 0.325022101 -7.71331358 ENTER BFGS code NEW_X -51881.8202 0.325022101 -7.71331358 EXIT FROM BFGS code FG_LNSRCH 0. 0.313947678 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.521234751 *** contribution from regularisation: 0.00318660145 *** contribution from error: -0.524421334 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51905.6017 0.313947678 -7.34709835 EXIT FROM BFGS code NEW_X -51905.6017 0.313947678 -7.34709835 ENTER BFGS code NEW_X -51905.6017 0.313947678 -7.34709835 EXIT FROM BFGS code FG_LNSRCH 0. 0.308968574 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.521310866 *** contribution from regularisation: 0.0031980332 *** contribution from error: -0.524508893 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51913.1812 0.308968574 -7.05422974 EXIT FROM BFGS code NEW_X -51913.1812 0.308968574 -7.05422974 ENTER BFGS code NEW_X -51913.1812 0.308968574 -7.05422974 EXIT FROM BFGS code FG_LNSRCH 0. 0.284352869 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.521622181 *** contribution from regularisation: 0.00313058798 *** contribution from error: -0.524752796 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51944.1781 0.284352869 -6.26498508 EXIT FROM BFGS code NEW_X -51944.1781 0.284352869 -6.26498508 ENTER BFGS code NEW_X -51944.1781 0.284352869 -6.26498508 EXIT FROM BFGS code FG_LNSRCH 0. 0.246988684 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.521667302 *** contribution from regularisation: 0.0031611498 *** contribution from error: -0.524828434 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51948.6754 0.246988684 -2.25894189 EXIT FROM BFGS code NEW_X -51948.6754 0.246988684 -2.25894189 ENTER BFGS code NEW_X -51948.6754 0.246988684 -2.25894189 EXIT FROM BFGS code FG_LNSRCH 0. 0.231489941 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 77.1251297 sigma out 15 active outputs RANK 2 NODE 3 --> 57.180069 sigma out 15 active outputs RANK 3 NODE 1 --> 49.9736786 sigma out 15 active outputs RANK 4 NODE 6 --> 25.0491772 sigma out 15 active outputs RANK 5 NODE 10 --> 24.5133228 sigma out 15 active outputs RANK 6 NODE 4 --> 24.3128242 sigma out 15 active outputs RANK 7 NODE 9 --> 20.5075378 sigma out 15 active outputs RANK 8 NODE 8 --> 20.1635132 sigma out 15 active outputs RANK 9 NODE 12 --> 17.773737 sigma out 15 active outputs RANK 10 NODE 5 --> 15.3757038 sigma out 15 active outputs RANK 11 NODE 2 --> 9.93814945 sigma out 15 active outputs RANK 12 NODE 7 --> 8.15670586 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 79.9267426 sigma in 12act. ( 69.3214722 sig out 1act.) RANK 2 NODE 14 --> 71.2089233 sigma in 12act. ( 107.944862 sig out 1act.) RANK 3 NODE 9 --> 28.3790264 sigma in 12act. ( 32.7102509 sig out 1act.) RANK 4 NODE 1 --> 26.2903633 sigma in 12act. ( 28.4753189 sig out 1act.) RANK 5 NODE 6 --> 21.7128048 sigma in 12act. ( 21.446209 sig out 1act.) RANK 6 NODE 10 --> 20.4497147 sigma in 12act. ( 21.2648659 sig out 1act.) RANK 7 NODE 13 --> 19.4849873 sigma in 12act. ( 21.3734531 sig out 1act.) RANK 8 NODE 15 --> 18.584425 sigma in 12act. ( 21.1435509 sig out 1act.) RANK 9 NODE 3 --> 17.292532 sigma in 12act. ( 21.2017231 sig out 1act.) RANK 10 NODE 8 --> 10.056695 sigma in 12act. ( 11.8260193 sig out 1act.) RANK 11 NODE 4 --> 6.81459379 sigma in 12act. ( 6.71142197 sig out 1act.) RANK 12 NODE 5 --> 4.34982157 sigma in 12act. ( 3.83801556 sig out 1act.) RANK 13 NODE 11 --> 4.2256093 sigma in 12act. ( 3.97420955 sig out 1act.) RANK 14 NODE 2 --> 3.61450171 sigma in 12act. ( 0.961942315 sig out 1act.) RANK 15 NODE 7 --> 3.57172322 sigma in 12act. ( 3.35942531 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 107.944862 sigma out 1act.( 71.2089233 sig in 12act.) RANK 2 NODE 12 --> 69.3214722 sigma out 1act.( 79.9267426 sig in 12act.) RANK 3 NODE 9 --> 32.7102509 sigma out 1act.( 28.3790264 sig in 12act.) RANK 4 NODE 1 --> 28.4753189 sigma out 1act.( 26.2903633 sig in 12act.) RANK 5 NODE 6 --> 21.446209 sigma out 1act.( 21.7128048 sig in 12act.) RANK 6 NODE 13 --> 21.3734531 sigma out 1act.( 19.4849873 sig in 12act.) RANK 7 NODE 10 --> 21.2648659 sigma out 1act.( 20.4497147 sig in 12act.) RANK 8 NODE 3 --> 21.2017231 sigma out 1act.( 17.292532 sig in 12act.) RANK 9 NODE 15 --> 21.1435509 sigma out 1act.( 18.584425 sig in 12act.) RANK 10 NODE 8 --> 11.8260193 sigma out 1act.( 10.056695 sig in 12act.) RANK 11 NODE 4 --> 6.71142197 sigma out 1act.( 6.81459379 sig in 12act.) RANK 12 NODE 11 --> 3.97420955 sigma out 1act.( 4.2256093 sig in 12act.) RANK 13 NODE 5 --> 3.83801556 sigma out 1act.( 4.34982157 sig in 12act.) RANK 14 NODE 7 --> 3.35942531 sigma out 1act.( 3.57172322 sig in 12act.) RANK 15 NODE 2 --> 0.961942315 sigma out 1act.( 3.61450171 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 144.331284 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.521713495 *** contribution from regularisation: 0.0032755204 *** contribution from error: -0.524989009 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51953.2749 0.231489941 -6.42492247 EXIT FROM BFGS code NEW_X -51953.2749 0.231489941 -6.42492247 ENTER BFGS code NEW_X -51953.2749 0.231489941 -6.42492247 EXIT FROM BFGS code FG_LNSRCH 0. 0.234984472 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.521742642 *** contribution from regularisation: 0.00332934549 *** contribution from error: -0.525071979 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51956.176 0.234984472 -5.57597685 EXIT FROM BFGS code NEW_X -51956.176 0.234984472 -5.57597685 ENTER BFGS code NEW_X -51956.176 0.234984472 -5.57597685 EXIT FROM BFGS code FG_LNSRCH 0. 0.231104538 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.521827281 *** contribution from regularisation: 0.00329464697 *** contribution from error: -0.525121927 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51964.6053 0.231104538 -5.31032753 EXIT FROM BFGS code NEW_X -51964.6053 0.231104538 -5.31032753 ENTER BFGS code NEW_X -51964.6053 0.231104538 -5.31032753 EXIT FROM BFGS code FG_LNSRCH 0. 0.213278532 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.521964133 *** contribution from regularisation: 0.00323671708 *** contribution from error: -0.525200844 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51978.2328 0.213278532 -4.6190052 EXIT FROM BFGS code NEW_X -51978.2328 0.213278532 -4.6190052 ENTER BFGS code NEW_X -51978.2328 0.213278532 -4.6190052 EXIT FROM BFGS code FG_LNSRCH 0. 0.183989927 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.52194947 *** contribution from regularisation: 0.00324343494 *** contribution from error: -0.525192916 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51976.7701 0.183989927 2.22152042 EXIT FROM BFGS code FG_LNSRCH 0. 0.202944368 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.52173084 *** contribution from regularisation: 0.00352896564 *** contribution from error: -0.525259793 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51955.0015 0.202944368 -2.65468073 EXIT FROM BFGS code FG_LNSRCH 0. 0.212596655 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.521784425 *** contribution from regularisation: 0.00342206401 *** contribution from error: -0.525206506 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51960.3363 0.212596655 -4.49118757 EXIT FROM BFGS code FG_LNSRCH 0. 0.213273451 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.521845341 *** contribution from regularisation: 0.00335548935 *** contribution from error: -0.525200844 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51966.4048 0.213273451 -4.60995436 EXIT FROM BFGS code FG_LNSRCH 0. 0.213278532 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.521838486 *** contribution from regularisation: 0.00336235273 *** contribution from error: -0.525200844 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51965.7218 0.213278532 -4.61902571 EXIT FROM BFGS code FG_LNSRCH 0. 0.213278532 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.521833837 *** contribution from regularisation: 0.00336700678 *** contribution from error: -0.525200844 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51965.2583 0.213278532 -4.6166544 EXIT FROM BFGS code FG_LNSRCH 0. 0.213278532 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 80.3107224 sigma out 15 active outputs RANK 2 NODE 3 --> 62.0217743 sigma out 15 active outputs RANK 3 NODE 1 --> 50.2655144 sigma out 15 active outputs RANK 4 NODE 6 --> 25.03615 sigma out 15 active outputs RANK 5 NODE 10 --> 24.8279362 sigma out 15 active outputs RANK 6 NODE 4 --> 22.7163849 sigma out 15 active outputs RANK 7 NODE 9 --> 21.4663353 sigma out 15 active outputs RANK 8 NODE 12 --> 18.5554295 sigma out 15 active outputs RANK 9 NODE 8 --> 16.9162102 sigma out 15 active outputs RANK 10 NODE 5 --> 15.7278433 sigma out 15 active outputs RANK 11 NODE 2 --> 10.3340025 sigma out 15 active outputs RANK 12 NODE 7 --> 8.50418949 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 79.6883698 sigma in 12act. ( 72.4818726 sig out 1act.) RANK 2 NODE 14 --> 76.3614426 sigma in 12act. ( 109.583656 sig out 1act.) RANK 3 NODE 9 --> 28.7636318 sigma in 12act. ( 33.4433861 sig out 1act.) RANK 4 NODE 1 --> 27.939291 sigma in 12act. ( 30.5805073 sig out 1act.) RANK 5 NODE 10 --> 21.7120743 sigma in 12act. ( 22.0910759 sig out 1act.) RANK 6 NODE 6 --> 21.6214828 sigma in 12act. ( 22.0913124 sig out 1act.) RANK 7 NODE 13 --> 20.9973602 sigma in 12act. ( 22.6945133 sig out 1act.) RANK 8 NODE 15 --> 20.0453892 sigma in 12act. ( 22.5724182 sig out 1act.) RANK 9 NODE 3 --> 17.5674477 sigma in 12act. ( 21.2406673 sig out 1act.) RANK 10 NODE 8 --> 10.4331675 sigma in 12act. ( 12.2099991 sig out 1act.) RANK 11 NODE 4 --> 6.92923927 sigma in 12act. ( 6.92421913 sig out 1act.) RANK 12 NODE 5 --> 4.56596756 sigma in 12act. ( 4.10530424 sig out 1act.) RANK 13 NODE 11 --> 4.21142149 sigma in 12act. ( 4.06865644 sig out 1act.) RANK 14 NODE 2 --> 3.57250309 sigma in 12act. ( 1.38956463 sig out 1act.) RANK 15 NODE 7 --> 3.52900767 sigma in 12act. ( 3.38822627 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 109.583656 sigma out 1act.( 76.3614426 sig in 12act.) RANK 2 NODE 12 --> 72.4818726 sigma out 1act.( 79.6883698 sig in 12act.) RANK 3 NODE 9 --> 33.4433861 sigma out 1act.( 28.7636318 sig in 12act.) RANK 4 NODE 1 --> 30.5805073 sigma out 1act.( 27.939291 sig in 12act.) RANK 5 NODE 13 --> 22.6945133 sigma out 1act.( 20.9973602 sig in 12act.) RANK 6 NODE 15 --> 22.5724182 sigma out 1act.( 20.0453892 sig in 12act.) RANK 7 NODE 6 --> 22.0913124 sigma out 1act.( 21.6214828 sig in 12act.) RANK 8 NODE 10 --> 22.0910759 sigma out 1act.( 21.7120743 sig in 12act.) RANK 9 NODE 3 --> 21.2406673 sigma out 1act.( 17.5674477 sig in 12act.) RANK 10 NODE 8 --> 12.2099991 sigma out 1act.( 10.4331675 sig in 12act.) RANK 11 NODE 4 --> 6.92421913 sigma out 1act.( 6.92923927 sig in 12act.) RANK 12 NODE 5 --> 4.10530424 sigma out 1act.( 4.56596756 sig in 12act.) RANK 13 NODE 11 --> 4.06865644 sigma out 1act.( 4.21142149 sig in 12act.) RANK 14 NODE 7 --> 3.38822627 sigma out 1act.( 3.52900767 sig in 12act.) RANK 15 NODE 2 --> 1.38956463 sigma out 1act.( 3.57250309 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 148.362518 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.521832824 *** contribution from regularisation: 0.0033680473 *** contribution from error: -0.525200844 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51965.1547 0.213278532 -4.61269188 EXIT FROM BFGS code FG_LNSRCH 0. 0.213278532 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.521844447 *** contribution from regularisation: 0.00335639273 *** contribution from error: -0.525200844 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51966.3153 0.213278532 -4.61368465 EXIT FROM BFGS code NEW_X -51966.3153 0.213278532 -4.61368465 ENTER BFGS code NEW_X -51966.3153 0.213278532 -4.61368465 EXIT FROM BFGS code CONVERGENC -51966.3153 0.213278532 -4.61368465 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 123.291794 sigma out 15 active outputs RANK 2 NODE 3 --> 90.9069519 sigma out 15 active outputs RANK 3 NODE 1 --> 77.9223328 sigma out 15 active outputs RANK 4 NODE 6 --> 38.6228752 sigma out 15 active outputs RANK 5 NODE 10 --> 37.8234825 sigma out 15 active outputs RANK 6 NODE 4 --> 35.3191223 sigma out 15 active outputs RANK 7 NODE 9 --> 32.7703094 sigma out 15 active outputs RANK 8 NODE 12 --> 28.0452156 sigma out 15 active outputs RANK 9 NODE 8 --> 26.3322315 sigma out 15 active outputs RANK 10 NODE 5 --> 22.8634167 sigma out 15 active outputs RANK 11 NODE 2 --> 15.2725134 sigma out 15 active outputs RANK 12 NODE 7 --> 13.3117456 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 124.269722 sigma in 12act. ( 112.892654 sig out 1act.) RANK 2 NODE 14 --> 112.742035 sigma in 12act. ( 172.896393 sig out 1act.) RANK 3 NODE 9 --> 43.5982094 sigma in 12act. ( 51.9413261 sig out 1act.) RANK 4 NODE 1 --> 42.9013023 sigma in 12act. ( 47.7784271 sig out 1act.) RANK 5 NODE 10 --> 32.971096 sigma in 12act. ( 34.6213036 sig out 1act.) RANK 6 NODE 6 --> 32.7831917 sigma in 12act. ( 34.4223137 sig out 1act.) RANK 7 NODE 13 --> 32.2040596 sigma in 12act. ( 35.6838264 sig out 1act.) RANK 8 NODE 15 --> 30.6335545 sigma in 12act. ( 35.6826172 sig out 1act.) RANK 9 NODE 3 --> 26.2194748 sigma in 12act. ( 33.110775 sig out 1act.) RANK 10 NODE 8 --> 15.7684994 sigma in 12act. ( 19.1578598 sig out 1act.) RANK 11 NODE 4 --> 10.2291803 sigma in 12act. ( 10.7882099 sig out 1act.) RANK 12 NODE 5 --> 6.58410311 sigma in 12act. ( 6.38277769 sig out 1act.) RANK 13 NODE 11 --> 6.09147358 sigma in 12act. ( 6.36849928 sig out 1act.) RANK 14 NODE 7 --> 4.97597075 sigma in 12act. ( 5.22675371 sig out 1act.) RANK 15 NODE 2 --> 3.90543485 sigma in 12act. ( 2.15955663 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 172.896393 sigma out 1act.( 112.742035 sig in 12act.) RANK 2 NODE 12 --> 112.892654 sigma out 1act.( 124.269722 sig in 12act.) RANK 3 NODE 9 --> 51.9413261 sigma out 1act.( 43.5982094 sig in 12act.) RANK 4 NODE 1 --> 47.7784271 sigma out 1act.( 42.9013023 sig in 12act.) RANK 5 NODE 13 --> 35.6838264 sigma out 1act.( 32.2040596 sig in 12act.) RANK 6 NODE 15 --> 35.6826172 sigma out 1act.( 30.6335545 sig in 12act.) RANK 7 NODE 10 --> 34.6213036 sigma out 1act.( 32.971096 sig in 12act.) RANK 8 NODE 6 --> 34.4223137 sigma out 1act.( 32.7831917 sig in 12act.) RANK 9 NODE 3 --> 33.110775 sigma out 1act.( 26.2194748 sig in 12act.) RANK 10 NODE 8 --> 19.1578598 sigma out 1act.( 15.7684994 sig in 12act.) RANK 11 NODE 4 --> 10.7882099 sigma out 1act.( 10.2291803 sig in 12act.) RANK 12 NODE 5 --> 6.38277769 sigma out 1act.( 6.58410311 sig in 12act.) RANK 13 NODE 11 --> 6.36849928 sigma out 1act.( 6.09147358 sig in 12act.) RANK 14 NODE 7 --> 5.22675371 sigma out 1act.( 4.97597075 sig in 12act.) RANK 15 NODE 2 --> 2.15955663 sigma out 1act.( 3.90543485 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 232.898529 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.521836162 *** contribution from regularisation: 0.00336467684 *** contribution from error: -0.525200844 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 31601 Closing output file done