NNInput NNInputs_115.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 194697 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 47762 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 47762 Chosen entries: 47762 Signal fraction: 1 Background fraction: 0.325055 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 47762 Entries to split: 47762 Test with : 23881 Train with : 23881 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 47762 for Signal Prepared event 0 for Signal with 47762 events ====Entry 0 Variable Ht : 147.2 Variable LepAPt : 33.8436 Variable LepBPt : 16.8195 Variable MetSigLeptonsJets : 7.93922 Variable MetSpec : 69.8321 Variable SumEtLeptonsJets : 77.3669 Variable VSumJetLeptonsPt : 74.5437 Variable addEt : 120.496 Variable dPhiLepSumMet : 2.77597 Variable dPhiLeptons : 0.349396 Variable dRLeptons : 0.409585 Variable lep1_E : 34.748 Variable lep2_E : 16.8224 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2115 Ht = 147.2 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.8439 LepAPt = 33.8436 LepBEt = 16.82 LepBPt = 16.8195 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 69.8321 MetDelPhi = 2.54203 MetSig = 5.42558 MetSigLeptonsJets = 7.93922 MetSpec = 69.8321 Mjj = 0 MostCentralJetEta = -1.25048 MtllMet = 121.128 Njets = 1 SB = 0 SumEt = 165.661 SumEtJets = 0 SumEtLeptonsJets = 77.3669 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 74.5437 addEt = 120.496 dPhiLepSumMet = 2.77597 dPhiLeptons = 0.349396 dRLeptons = 0.409585 diltype = 17 dimass = 9.74565 event = 4187 jet1_Et = 26.7039 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.748 lep2_E = 16.8224 rand = 0.999742 run = 237705 weight = 5.90147e-07 ===Show End Prepared event 10000 for Signal with 47762 events Prepared event 20000 for Signal with 47762 events Prepared event 30000 for Signal with 47762 events Prepared event 40000 for Signal with 47762 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.252804 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4592 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 194697 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4592 negative weights. Signal fraction: 62.65868 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 61.4199028 63.9100037 65.8865967 67.2947998 68.3195038 69.1866302 70.1496658 70.9035568 71.6793671 72.6058197 73.3418579 73.9886017 74.4334869 75.0466309 75.5465393 76.0682526 76.7070312 77.2164764 77.7076797 78.2855835 78.8012848 79.3090439 79.7734375 80.3021088 80.8983154 81.4938583 82.0967102 82.6430817 83.3108978 83.9446716 84.7443695 85.5165558 86.4074097 87.0762482 87.9711761 88.7811737 89.6719818 90.5265121 91.4285278 92.2638092 93.2921295 94.1556702 95.0731659 95.9062805 96.7301025 97.6863403 98.5401993 99.4781036 100.245651 101.100494 101.962936 102.780319 103.616837 104.471436 105.364777 106.23111 107.095566 107.950371 108.718018 109.606384 110.469482 111.383263 112.423828 113.431908 114.576492 115.882492 117.214836 118.716751 120.241318 121.723373 123.342697 125.042526 126.957397 128.755157 130.541718 132.503326 134.412628 136.466003 138.455505 140.588028 142.971832 145.492767 147.838226 150.562317 153.612061 156.734238 159.852661 163.350311 167.470932 172.13945 177.00412 182.280518 188.893646 195.951157 204.875839 217.848083 232.912354 255.801666 291.76181 871.385864 ------------------------------ Transdef: Tab for variable 3 20.0001068 20.2567101 20.5055447 20.7150879 20.9844437 21.1931 21.4302349 21.6002617 21.827528 22.0099792 22.2088127 22.3888016 22.5740452 22.7876663 22.9753265 23.1583099 23.3332329 23.515667 23.6646461 23.7929878 23.9700356 24.164856 24.370636 24.5309601 24.7067261 24.9409847 25.1292744 25.3299026 25.5100899 25.674057 25.8708706 26.0476723 26.226366 26.3966694 26.6013546 26.7935753 26.9606323 27.1543636 27.3415699 27.5721359 27.7541809 27.9372253 28.1168594 28.3019142 28.5275154 28.7421284 28.9501495 29.1612549 29.3688469 29.6013031 29.7846603 30.0102596 30.2450409 30.4972839 30.7250175 30.9798813 31.2446575 31.4861126 31.7087631 31.9592972 32.2360306 32.500946 32.7589569 33.0171585 33.2614822 33.5626717 33.8755722 34.1800842 34.4881287 34.8140488 35.1514053 35.4752197 35.7822151 36.1389771 36.493866 36.8172684 37.2178383 37.6167145 38.0812225 38.5219688 39.0195541 39.4524002 39.9842377 40.4857635 41.0594559 41.6973572 42.4053421 43.1141319 44.0042191 44.9117355 45.9410858 47.0144615 48.2862129 49.8050385 51.5811157 53.7722282 56.9090233 60.2484512 65.6906586 75.8621063 178.378601 ------------------------------ Transdef: Tab for variable 4 10.0000381 10.0863628 10.1685791 10.2554626 10.3397694 10.4300442 10.494772 10.5899897 10.6754742 10.7682848 10.8542385 10.9259167 11.0017557 11.0924559 11.1798153 11.2824678 11.3765926 11.4615316 11.5462065 11.6387634 11.7363911 11.8363991 11.9241962 12.0358829 12.1394949 12.2259159 12.3251657 12.4439774 12.5631714 12.651638 12.763629 12.8701973 12.9777718 13.0868759 13.1988277 13.3252316 13.4464912 13.5514097 13.645196 13.759779 13.8765125 14.0080128 14.1359282 14.2486992 14.3768024 14.5007343 14.6376028 14.7805576 14.9085617 15.0428677 15.1805296 15.310894 15.4502993 15.5648632 15.6994772 15.8460598 15.982748 16.1433678 16.2962494 16.4379253 16.5812531 16.7352257 16.8778458 17.029705 17.2177544 17.3936348 17.5824928 17.7604771 17.9575729 18.1354179 18.3338566 18.5175915 18.7536087 18.9649887 19.1595459 19.3732471 19.6039772 19.8400154 20.0803299 20.3147812 20.547245 20.7850227 21.0439224 21.3023872 21.5858707 21.8575268 22.1826859 22.5407028 22.9662952 23.3751831 23.8213539 24.2599182 24.7737408 25.4045792 26.1195335 26.9695778 28.0071182 29.2762947 31.2852631 34.621727 68.5402756 ------------------------------ Transdef: Tab for variable 5 1.04271269 2.22690392 2.58677745 2.83960915 3.04473305 3.21184278 3.37180948 3.53694153 3.67670012 3.80792713 3.93240595 4.04889107 4.1528163 4.24139881 4.32480574 4.41618395 4.50234461 4.57820702 4.6478138 4.71624851 4.7834034 4.85029697 4.92089558 4.98004055 5.05037403 5.10415649 5.15692472 5.20830488 5.26713371 5.32005978 5.36748362 5.41381741 5.45694637 5.50386906 5.54176044 5.59119654 5.63202095 5.66980314 5.71608448 5.75653839 5.79326057 5.83247375 5.87168646 5.91296434 5.94814396 5.9897995 6.02440262 6.06319141 6.09701395 6.13100719 6.16911268 6.20484924 6.23977661 6.27213097 6.30646944 6.33960104 6.37447405 6.41279936 6.44787455 6.48172379 6.5199852 6.55862236 6.59824944 6.64014769 6.67370605 6.70937252 6.74557686 6.78316975 6.82377386 6.86025333 6.89892864 6.94032288 6.97924519 7.02118874 7.05852842 7.10955715 7.15732098 7.19919109 7.24606228 7.28952122 7.33749104 7.38664627 7.43653965 7.49168968 7.54874802 7.61187744 7.68289089 7.75006628 7.82243109 7.90182877 7.98922062 8.09139633 8.19161606 8.31534004 8.45616531 8.61642265 8.81453705 9.0642128 9.43344307 10.1757431 18.6198635 ------------------------------ Transdef: Tab for variable 6 15.0098324 18.4898186 21.3715401 24.351059 25.5906868 26.3218174 26.9491615 27.6197739 28.3035622 28.9785118 29.6461563 30.2291985 30.7699165 31.2495575 31.7287292 32.2493744 32.6384964 33.0343246 33.4683075 33.8917046 34.284935 34.6631241 34.8896446 35.2131882 35.5329514 35.8939285 36.1729965 36.4602394 36.7848167 37.0747108 37.3406296 37.6309814 37.8764572 38.1516571 38.4599304 38.7202225 39.0069885 39.2906036 39.5361824 39.7900352 40.0972672 40.405056 40.6671753 40.9675064 41.2976456 41.6518326 41.9417 42.2631912 42.575058 42.8783798 43.1455994 43.4762955 43.7808838 44.1098518 44.4814682 44.9115601 45.3248711 45.7388 46.0974197 46.5219002 46.9227142 47.3461952 47.7442703 48.1201782 48.5088654 48.9370651 49.3398438 49.7635498 50.1959343 50.5987244 50.990303 51.4025421 51.8775558 52.3644829 52.8148384 53.3220062 53.7941208 54.2584076 54.8467445 55.3669319 55.9142838 56.5264206 57.141037 57.7823601 58.4319687 59.1786041 60.0363121 61.0012283 62.0345383 63.1537323 64.3218842 65.6846542 67.2779541 68.978363 71.1152954 73.4931183 76.9299622 81.1485443 86.8532028 97.9653015 214.544067 ------------------------------ Transdef: Tab for variable 7 30.1199875 32.4678421 33.3508377 33.9672508 34.4532013 34.9577789 35.4064941 35.8352509 36.1967239 36.5669708 36.8938942 37.181076 37.5047531 37.7674103 38.1012802 38.3787651 38.6670227 38.9159241 39.1707382 39.4162331 39.6386414 39.9007416 40.1889153 40.4534836 40.7213516 40.9982567 41.3408051 41.6315231 41.9527512 42.3097992 42.7223129 43.1055984 43.4888039 43.9381104 44.4411697 44.8480453 45.1823845 45.6318359 46.1650734 46.6176682 47.1142883 47.5699272 48.057663 48.5310974 49.0890617 49.6334419 50.1874008 50.7512741 51.2918167 51.8359604 52.4377441 53.01511 53.6395073 54.2698135 54.9053345 55.5529099 56.2314529 57.0118942 57.7442703 58.6323776 59.4522781 60.4886093 61.5088654 62.6341934 63.7612305 64.973175 66.1352386 67.5103531 68.7446365 70.1902924 71.4472275 72.94384 74.2636414 75.7548523 76.9202194 78.5194168 79.9947586 81.5927582 83.242569 85.1064301 87.0499802 89.2325439 91.2872314 93.5800018 96.2008972 98.7758942 101.467224 104.391411 107.849205 111.171616 115.225647 119.566666 124.380081 130.407135 136.910828 143.846191 154.105621 166.657913 184.780121 213.143661 510.394806 ------------------------------ Transdef: Tab for variable 8 0.678276479 19.7456589 24.5414371 27.4438248 29.4150925 30.6667614 31.5672913 32.198288 32.7191544 33.2139969 33.6238632 33.9626122 34.3598366 34.6954498 35.010128 35.309166 35.6040688 35.9109192 36.1568756 36.4139404 36.6365623 36.8732681 37.1192627 37.3303528 37.5548172 37.7900276 38.0222282 38.237606 38.4874115 38.7094879 38.9479294 39.1845551 39.3675613 39.6169968 39.8449936 40.0892792 40.3340302 40.5493164 40.8282166 41.0962982 41.339035 41.6164474 41.89888 42.2356148 42.537487 42.8128586 43.1105995 43.4162827 43.7166328 44.0284195 44.3358688 44.6688309 45.0153961 45.3402786 45.7299042 46.0868111 46.4512939 46.7815742 47.1664467 47.5521317 47.9235535 48.2940216 48.6518478 49.0284576 49.3879089 49.7620468 50.1943817 50.5566559 50.9786606 51.3880005 51.8204651 52.2702293 52.7184792 53.1450577 53.6590195 54.0708351 54.5607681 55.1118736 55.6852951 56.2411194 56.7978058 57.4455719 58.1811676 58.8918076 59.7897186 60.5978699 61.5885849 62.6795464 63.8404922 65.1847 66.5405121 68.133049 69.861557 71.8529205 74.1320724 76.7057953 80.2595062 84.8216248 91.7182846 105.774857 363.523895 ------------------------------ Transdef: Tab for variable 9 47.1748543 60.5900803 62.9098663 64.7957153 66.1878815 67.3007507 68.2331238 68.9718781 69.8006592 70.4719238 71.1136169 71.7527847 72.5193024 73.2167435 73.7836456 74.2484741 74.6573181 75.1977081 75.61306 76.0218964 76.5477753 77.0231552 77.4540939 77.9014282 78.3822784 78.7884521 79.2056351 79.6058502 79.9382629 80.4309235 80.9233856 81.4326782 81.933075 82.3832397 82.8174896 83.3777847 83.8571472 84.5310898 85.0541306 85.6878357 86.3312683 86.8891449 87.442215 88.0543365 88.6459198 89.3117523 89.8766632 90.5197144 91.1692505 91.8288269 92.4633026 93.2105408 93.8377075 94.4996338 95.1892471 95.8140564 96.4727936 97.135437 97.8855362 98.5423203 99.2008514 99.7907257 100.461731 101.169891 101.808159 102.369499 103.019875 103.592972 104.2547 104.8694 105.502304 106.159393 106.789597 107.419968 108.066338 108.69989 109.381393 110.098427 110.77948 111.437363 112.198227 113.065811 113.960167 114.807953 115.623611 116.569366 117.598511 118.776688 120.178085 121.797089 123.591377 125.57962 127.946083 130.817474 134.390961 138.776901 144.319305 150.731873 161.349213 182.8526 434.914825 ------------------------------ Transdef: Tab for variable 10 0.00483142957 0.869580388 1.1278249 1.31669033 1.46184409 1.57962322 1.67742467 1.76905894 1.85491419 1.92216194 1.99098778 2.06365323 2.11909103 2.17607975 2.22713256 2.27007103 2.31144476 2.34964228 2.39070916 2.42856455 2.46465635 2.49648929 2.52479339 2.55314684 2.58434677 2.61039472 2.63463855 2.65934443 2.68291903 2.70485568 2.72639894 2.74755955 2.76605988 2.78097582 2.79673958 2.81108975 2.82441378 2.83803511 2.84920788 2.85942531 2.870296 2.88054371 2.89003825 2.90129161 2.910604 2.91826773 2.92634726 2.93436813 2.94161391 2.94877338 2.95611 2.96286488 2.96969509 2.97722244 2.98329663 2.98841047 2.99281502 2.99841571 3.00321317 3.00833893 3.0130372 3.01749444 3.02243972 3.02680826 3.03132296 3.03562284 3.03952336 3.04299593 3.04685688 3.05105877 3.05531526 3.05912709 3.06242466 3.06624341 3.06960225 3.07310534 3.07579517 3.07881093 3.0822556 3.08561468 3.08855128 3.09183693 3.09449005 3.09678221 3.09980249 3.1021843 3.10475969 3.1076839 3.1104908 3.11340714 3.11568928 3.11816001 3.12106061 3.12412167 3.12678599 3.12910175 3.13171148 3.13394928 3.1364522 3.13914824 3.14159131 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00661274791 0.0128837824 0.0200995952 0.0266190153 0.033232294 0.0415319204 0.049207449 0.0575608015 0.0650464296 0.0738707781 0.0822048038 0.0895696878 0.0975261927 0.105182558 0.113132916 0.120676756 0.128865957 0.137105882 0.144058883 0.152096808 0.15883255 0.165511727 0.171900988 0.178589284 0.185079366 0.19191581 0.197640777 0.204158425 0.209580481 0.214699179 0.220661551 0.226386607 0.231386006 0.237101078 0.243927836 0.250095189 0.25605762 0.261182517 0.266326189 0.272505134 0.27868253 0.283745527 0.289308548 0.295461059 0.301618606 0.307076454 0.31291759 0.319107115 0.324886024 0.331825912 0.338546216 0.344845653 0.351002693 0.356251031 0.362699986 0.369548917 0.376152277 0.382815301 0.388393044 0.394120455 0.399746299 0.406695902 0.41318953 0.419173419 0.426071882 0.432493985 0.4388237 0.44565469 0.451427013 0.45733875 0.464047194 0.469488919 0.475278318 0.482225895 0.489531994 0.49727124 0.504960477 0.512683213 0.519372344 0.527443409 0.536155939 0.544339418 0.552430034 0.56138587 0.571162045 0.579622626 0.591946125 0.602979064 0.613870442 0.62658143 0.640514374 0.654467344 0.669330478 0.687684894 0.707952321 0.728578329 0.761190891 0.79628396 0.855496287 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200011998 0.210494399 0.2205787 0.23132804 0.240192398 0.249115273 0.257921636 0.266352952 0.274641216 0.282250226 0.290770292 0.299123019 0.30766657 0.315288424 0.324374378 0.331692427 0.33880496 0.346623719 0.353791296 0.361530423 0.36938262 0.376974255 0.385075092 0.392045617 0.397936881 0.40387243 0.409502238 0.413879275 0.419090927 0.423620462 0.427323312 0.43252182 0.436696172 0.440922678 0.445268691 0.449593097 0.454599559 0.459223747 0.463798881 0.468213886 0.472004175 0.476172894 0.480416238 0.48429364 0.488263309 0.492291689 0.496686935 0.500597715 0.504935503 0.509096324 0.513108253 0.51734221 0.521105528 0.524963975 0.529229939 0.533972204 0.538468063 0.543017387 0.547497511 0.552134991 0.556739748 0.560628772 0.565332651 0.569974303 0.574720502 0.579408884 0.583882093 0.588432431 0.593654633 0.597969592 0.603638649 0.609342396 0.614227116 0.619466841 0.625009775 0.630888462 0.636844873 0.643221378 0.649687111 0.656459332 0.662440896 0.668456912 0.674934208 0.681756198 0.689650059 0.697898507 0.706966519 0.715465128 0.725004494 0.733639002 0.744034767 0.753829539 0.765498519 0.779543579 0.795021772 0.813129246 0.831173301 0.850869298 0.880915761 0.931079745 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0231152 21.360754 22.0716095 22.5701141 23.0888557 23.5495892 23.9592342 24.3710861 24.7713928 25.1402473 25.5231514 25.8770714 26.2911301 26.6622505 27.0189037 27.3189011 27.6487045 27.9485359 28.2607994 28.5856628 28.8650131 29.1710911 29.4515572 29.7082481 30.0065632 30.291214 30.5359039 30.7702904 31.045948 31.3735619 31.6902313 31.9860649 32.2618103 32.5156403 32.8030281 33.0950394 33.3735352 33.6788101 33.9889297 34.3147583 34.6017303 34.9189224 35.2298203 35.5504684 35.8952332 36.1824417 36.459938 36.7873154 37.0996933 37.4786224 37.8177032 38.1756134 38.5195084 38.8979187 39.3022232 39.7392578 40.1453056 40.5363312 40.9402084 41.3391342 41.795414 42.2755737 42.709671 43.1860123 43.6557083 44.1812096 44.70504 45.2785339 45.8139725 46.3949051 46.9919052 47.5941887 48.1547928 48.8665199 49.5631676 50.3186646 51.0075912 51.8638077 52.6959 53.6952362 54.623188 55.5431976 56.6509552 57.7862511 58.9141006 60.3039551 61.5768547 62.7779922 64.3106461 66.1717072 68.0314789 70.286377 72.6319122 75.2171631 78.4419861 81.9043961 86.0276031 90.8615875 97.9024506 108.985916 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.485569 10.8150196 11.0689526 11.3170204 11.538662 11.7288885 11.9330883 12.1452169 12.3414726 12.5538702 12.7453041 12.915554 13.1134624 13.2987881 13.475502 13.6361494 13.8039093 13.9346323 14.103405 14.2796822 14.4579163 14.6182613 14.7897463 14.9507217 15.1282358 15.2839718 15.472393 15.6526451 15.8376188 16.0244713 16.2081013 16.3627911 16.5598869 16.7442245 16.9182777 17.0693016 17.261055 17.4475651 17.6374702 17.7926903 17.9588432 18.1646194 18.3731384 18.5821419 18.7621384 18.9724369 19.1642284 19.3366127 19.5439682 19.7509956 19.9684906 20.1923523 20.3833504 20.6208267 20.8457432 21.0753498 21.2964821 21.5176048 21.7365799 21.9419899 22.1938133 22.4379959 22.724926 23.0042152 23.2708168 23.5496387 23.8271885 24.1203022 24.457428 24.7700386 25.0835495 25.394125 25.7245407 26.0363083 26.327549 26.6809349 27.0779381 27.4815121 27.8691597 28.3251381 28.8068619 29.2394943 29.7773399 30.4122086 31.0662575 31.5693359 32.2841034 33.033165 33.9098091 34.6658325 35.6862488 36.9355087 38.0954285 39.4196358 41.4399948 43.8665924 46.4307327 50.5561371 57.1704788 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 54.4 40.4 24.7 3.6 28.4 53.1 35.2 49.0 -32.5 -3.4 -9.7 8.4 -5.6 2 54.4 100.0 64.1 43.3 9.2 53.1 93.8 58.9 88.6 -52.2 -16.0 -30.4 33.2 14.9 3 40.4 64.1 100.0 19.9 -10.1 21.8 67.6 44.0 69.3 -21.4 -15.5 -34.1 64.9 2.0 4 24.7 43.3 19.9 100.0 -6.1 14.5 45.8 30.1 46.5 -14.5 -19.8 -37.2 7.4 66.4 5 3.6 9.2 -10.1 -6.1 100.0 79.5 -19.0 41.4 39.5 35.0 3.0 7.0 -13.0 -7.8 6 28.4 53.1 21.8 14.5 79.5 100.0 29.4 68.9 72.0 1.1 -4.6 -8.1 5.6 0.5 7 53.1 93.8 67.6 45.8 -19.0 29.4 100.0 52.0 75.4 -58.7 -15.5 -31.4 37.4 17.9 8 35.2 58.9 44.0 30.1 41.4 68.9 52.0 100.0 72.9 -6.9 -12.7 -21.5 22.1 10.7 9 49.0 88.6 69.3 46.5 39.5 72.0 75.4 72.9 100.0 -24.8 -16.8 -33.5 37.6 18.3 10 -32.5 -52.2 -21.4 -14.5 35.0 1.1 -58.7 -6.9 -24.8 100.0 5.3 9.4 -8.9 -2.4 11 -3.4 -16.0 -15.5 -19.8 3.0 -4.6 -15.5 -12.7 -16.8 5.3 100.0 54.8 -5.0 -10.2 12 -9.7 -30.4 -34.1 -37.2 7.0 -8.1 -31.4 -21.5 -33.5 9.4 54.8 100.0 -14.2 -14.3 13 8.4 33.2 64.9 7.4 -13.0 5.6 37.4 22.1 37.6 -8.9 -5.0 -14.2 100.0 37.5 14 -5.6 14.9 2.0 66.4 -7.8 0.5 17.9 10.7 18.3 -2.4 -10.2 -14.3 37.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 117.221981 TOTAL CORRELATION OF ALL VARIABLES 60.7293881 ROUND 1: MAX CORR ( 60.7273999) AFTER KILLING INPUT VARIABLE 6 CONTR 0.491401084 ROUND 2: MAX CORR ( 60.7226297) AFTER KILLING INPUT VARIABLE 11 CONTR 0.761150162 ROUND 3: MAX CORR ( 60.6638658) AFTER KILLING INPUT VARIABLE 9 CONTR 2.67079327 ROUND 4: MAX CORR ( 60.6358957) AFTER KILLING INPUT VARIABLE 8 CONTR 1.84194588 ROUND 5: MAX CORR ( 60.6109306) AFTER KILLING INPUT VARIABLE 2 CONTR 1.73981029 ROUND 6: MAX CORR ( 60.3050863) AFTER KILLING INPUT VARIABLE 13 CONTR 6.08124001 ROUND 7: MAX CORR ( 59.7443195) AFTER KILLING INPUT VARIABLE 10 CONTR 8.20485957 ROUND 8: MAX CORR ( 59.2585763) AFTER KILLING INPUT VARIABLE 3 CONTR 7.60295002 ROUND 9: MAX CORR ( 58.4112126) AFTER KILLING INPUT VARIABLE 12 CONTR 9.98544441 ROUND 10: MAX CORR ( 57.1399204) AFTER KILLING INPUT VARIABLE 5 CONTR 12.1202007 ROUND 11: MAX CORR ( 55.3353798) AFTER KILLING INPUT VARIABLE 4 CONTR 14.2466221 ROUND 12: MAX CORR ( 53.1469871) AFTER KILLING INPUT VARIABLE 14 CONTR 15.4078558 LAST REMAINING VARIABLE: 7 total correlation to target: 60.7293881 % total significance: 119.002504 sigma correlations of single variables to target: variable 2: 54.3998498 % , in sigma: 106.599433 variable 3: 40.3660246 % , in sigma: 79.0993972 variable 4: 24.6647795 % , in sigma: 48.3319625 variable 5: 3.57925822 % , in sigma: 7.01374907 variable 6: 28.3687511 % , in sigma: 55.5900942 variable 7: 53.1469871 % , in sigma: 104.144381 variable 8: 35.1809269 % , in sigma: 68.9389194 variable 9: 48.9703674 % , in sigma: 95.9600699 variable 10: -32.517581 % , in sigma: 63.7199496 variable 11: -3.4299036 % , in sigma: 6.72108067 variable 12: -9.72162063 % , in sigma: 19.0500387 variable 13: 8.39600911 % , in sigma: 16.4524316 variable 14: -5.63275047 % , in sigma: 11.0376776 variables sorted by significance: 1 most relevant variable 7 corr 53.1469879 , in sigma: 104.144383 2 most relevant variable 14 corr 15.407856 , in sigma: 30.1925229 3 most relevant variable 4 corr 14.2466221 , in sigma: 27.9170226 4 most relevant variable 5 corr 12.1202011 , in sigma: 23.7501862 5 most relevant variable 12 corr 9.98544407 , in sigma: 19.5670149 6 most relevant variable 3 corr 7.6029501 , in sigma: 14.8983898 7 most relevant variable 10 corr 8.20485973 , in sigma: 16.0778641 8 most relevant variable 13 corr 6.08124018 , in sigma: 11.9165173 9 most relevant variable 2 corr 1.73981023 , in sigma: 3.40925176 10 most relevant variable 8 corr 1.84194589 , in sigma: 3.60939208 11 most relevant variable 9 corr 2.67079329 , in sigma: 5.23356317 12 most relevant variable 11 corr 0.761150181 , in sigma: 1.49151474 13 most relevant variable 6 corr 0.491401076 , in sigma: 0.96292685 global correlations between input variables: variable 2: 98.9602854 % variable 3: 93.528818 % variable 4: 89.009671 % variable 5: 94.6875905 % variable 6: 93.3342373 % variable 7: 98.4934273 % variable 8: 83.9157819 % variable 9: 98.5504178 % variable 10: 72.7791587 % variable 11: 55.7008444 % variable 12: 65.7711227 % variable 13: 84.8494125 % variable 14: 85.7856399 % significance loss when removing single variables: variable 2: corr = 3.30847564 % , sigma = 6.48313604 variable 3: corr = 10.0597358 % , sigma = 19.7125936 variable 4: corr = 11.3473799 % , sigma = 22.2358016 variable 5: corr = 4.0631995 % , sigma = 7.96205805 variable 6: corr = 0.491401084 % , sigma = 0.962926866 variable 7: corr = 3.20318545 % , sigma = 6.27681424 variable 8: corr = 2.39478218 % , sigma = 4.69270453 variable 9: corr = 2.73647909 % , sigma = 5.36227802 variable 10: corr = 7.43136493 % , sigma = 14.5621594 variable 11: corr = 0.749744123 % , sigma = 1.46916395 variable 12: corr = 9.68428197 % , sigma = 18.9768716 variable 13: corr = 6.03691499 % , sigma = 11.8296598 variable 14: corr = 10.3211709 % , sigma = 20.2248896 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.9148922 sigma out 15 active outputs RANK 2 NODE 7 --> 22.0773754 sigma out 15 active outputs RANK 3 NODE 5 --> 21.6240158 sigma out 15 active outputs RANK 4 NODE 8 --> 18.172123 sigma out 15 active outputs RANK 5 NODE 11 --> 17.0480404 sigma out 15 active outputs RANK 6 NODE 9 --> 16.7343864 sigma out 15 active outputs RANK 7 NODE 3 --> 16.4975224 sigma out 15 active outputs RANK 8 NODE 12 --> 16.0444012 sigma out 15 active outputs RANK 9 NODE 10 --> 16.0353851 sigma out 15 active outputs RANK 10 NODE 4 --> 15.6346855 sigma out 15 active outputs RANK 11 NODE 1 --> 15.1499939 sigma out 15 active outputs RANK 12 NODE 6 --> 14.4181051 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 28.5688667 sigma in 12act. ( 31.1449738 sig out 1act.) RANK 2 NODE 15 --> 26.0480461 sigma in 12act. ( 25.9282932 sig out 1act.) RANK 3 NODE 11 --> 22.6700859 sigma in 12act. ( 26.5007515 sig out 1act.) RANK 4 NODE 6 --> 22.2909107 sigma in 12act. ( 22.8213062 sig out 1act.) RANK 5 NODE 12 --> 18.8789635 sigma in 12act. ( 18.335453 sig out 1act.) RANK 6 NODE 10 --> 17.1602478 sigma in 12act. ( 16.3804798 sig out 1act.) RANK 7 NODE 3 --> 15.340044 sigma in 12act. ( 15.8799362 sig out 1act.) RANK 8 NODE 7 --> 12.6340961 sigma in 12act. ( 13.9929495 sig out 1act.) RANK 9 NODE 2 --> 12.0587387 sigma in 12act. ( 14.9840164 sig out 1act.) RANK 10 NODE 8 --> 9.18473721 sigma in 12act. ( 11.5654802 sig out 1act.) RANK 11 NODE 1 --> 8.32189846 sigma in 12act. ( 8.5080986 sig out 1act.) RANK 12 NODE 9 --> 4.96293306 sigma in 12act. ( 6.54849958 sig out 1act.) RANK 13 NODE 4 --> 4.02915287 sigma in 12act. ( 5.41776419 sig out 1act.) RANK 14 NODE 13 --> 1.74746394 sigma in 12act. ( 1.19916344 sig out 1act.) RANK 15 NODE 14 --> 1.46078885 sigma in 12act. ( 0.153921679 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 31.1449738 sigma out 1act.( 28.5688667 sig in 12act.) RANK 2 NODE 11 --> 26.5007515 sigma out 1act.( 22.6700859 sig in 12act.) RANK 3 NODE 15 --> 25.9282932 sigma out 1act.( 26.0480461 sig in 12act.) RANK 4 NODE 6 --> 22.8213062 sigma out 1act.( 22.2909107 sig in 12act.) RANK 5 NODE 12 --> 18.335453 sigma out 1act.( 18.8789635 sig in 12act.) RANK 6 NODE 10 --> 16.3804798 sigma out 1act.( 17.1602478 sig in 12act.) RANK 7 NODE 3 --> 15.8799362 sigma out 1act.( 15.340044 sig in 12act.) RANK 8 NODE 2 --> 14.9840164 sigma out 1act.( 12.0587387 sig in 12act.) RANK 9 NODE 7 --> 13.9929495 sigma out 1act.( 12.6340961 sig in 12act.) RANK 10 NODE 8 --> 11.5654802 sigma out 1act.( 9.18473721 sig in 12act.) RANK 11 NODE 1 --> 8.5080986 sigma out 1act.( 8.32189846 sig in 12act.) RANK 12 NODE 9 --> 6.54849958 sigma out 1act.( 4.96293306 sig in 12act.) RANK 13 NODE 4 --> 5.41776419 sigma out 1act.( 4.02915287 sig in 12act.) RANK 14 NODE 13 --> 1.19916344 sigma out 1act.( 1.74746394 sig in 12act.) RANK 15 NODE 14 --> 0.153921679 sigma out 1act.( 1.46078885 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.4999008 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 29.3441696 sigma out 15 active outputs RANK 2 NODE 7 --> 21.8260002 sigma out 15 active outputs RANK 3 NODE 5 --> 21.2056808 sigma out 15 active outputs RANK 4 NODE 8 --> 19.7953186 sigma out 15 active outputs RANK 5 NODE 3 --> 18.8353844 sigma out 15 active outputs RANK 6 NODE 12 --> 18.3144855 sigma out 15 active outputs RANK 7 NODE 1 --> 17.2703228 sigma out 15 active outputs RANK 8 NODE 9 --> 17.0086365 sigma out 15 active outputs RANK 9 NODE 10 --> 16.920742 sigma out 15 active outputs RANK 10 NODE 4 --> 16.8534756 sigma out 15 active outputs RANK 11 NODE 11 --> 16.5854378 sigma out 15 active outputs RANK 12 NODE 6 --> 15.6859016 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 32.0035324 sigma in 12act. ( 30.0086288 sig out 1act.) RANK 2 NODE 11 --> 27.6379795 sigma in 12act. ( 25.0435429 sig out 1act.) RANK 3 NODE 15 --> 22.9024677 sigma in 12act. ( 23.4760551 sig out 1act.) RANK 4 NODE 6 --> 20.1124229 sigma in 12act. ( 20.8255138 sig out 1act.) RANK 5 NODE 3 --> 16.9087162 sigma in 12act. ( 15.3258762 sig out 1act.) RANK 6 NODE 2 --> 16.7610512 sigma in 12act. ( 14.9332781 sig out 1act.) RANK 7 NODE 12 --> 16.3114567 sigma in 12act. ( 16.8699188 sig out 1act.) RANK 8 NODE 10 --> 14.9716139 sigma in 12act. ( 15.0555038 sig out 1act.) RANK 9 NODE 7 --> 14.4176865 sigma in 12act. ( 13.6938934 sig out 1act.) RANK 10 NODE 8 --> 13.0403194 sigma in 12act. ( 11.788538 sig out 1act.) RANK 11 NODE 9 --> 10.7534676 sigma in 12act. ( 7.11783028 sig out 1act.) RANK 12 NODE 4 --> 10.0948782 sigma in 12act. ( 6.68334579 sig out 1act.) RANK 13 NODE 1 --> 9.94707203 sigma in 12act. ( 8.49484158 sig out 1act.) RANK 14 NODE 13 --> 7.28451586 sigma in 12act. ( 2.3230083 sig out 1act.) RANK 15 NODE 14 --> 5.15525436 sigma in 12act. ( 0.065150708 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 30.0086288 sigma out 1act.( 32.0035324 sig in 12act.) RANK 2 NODE 11 --> 25.0435429 sigma out 1act.( 27.6379795 sig in 12act.) RANK 3 NODE 15 --> 23.4760551 sigma out 1act.( 22.9024677 sig in 12act.) RANK 4 NODE 6 --> 20.8255138 sigma out 1act.( 20.1124229 sig in 12act.) RANK 5 NODE 12 --> 16.8699188 sigma out 1act.( 16.3114567 sig in 12act.) RANK 6 NODE 3 --> 15.3258762 sigma out 1act.( 16.9087162 sig in 12act.) RANK 7 NODE 10 --> 15.0555038 sigma out 1act.( 14.9716139 sig in 12act.) RANK 8 NODE 2 --> 14.9332781 sigma out 1act.( 16.7610512 sig in 12act.) RANK 9 NODE 7 --> 13.6938934 sigma out 1act.( 14.4176865 sig in 12act.) RANK 10 NODE 8 --> 11.788538 sigma out 1act.( 13.0403194 sig in 12act.) RANK 11 NODE 1 --> 8.49484158 sigma out 1act.( 9.94707203 sig in 12act.) RANK 12 NODE 9 --> 7.11783028 sigma out 1act.( 10.7534676 sig in 12act.) RANK 13 NODE 4 --> 6.68334579 sigma out 1act.( 10.0948782 sig in 12act.) RANK 14 NODE 13 --> 2.3230083 sigma out 1act.( 7.28451586 sig in 12act.) RANK 15 NODE 14 --> 0.065150708 sigma out 1act.( 5.15525436 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.095623 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.443303227 *** contribution from regularisation: 0.00402246229 *** contribution from error: -0.447325677 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.478170633 *** contribution from regularisation: 0.00289322925 *** contribution from error: -0.481063873 *********************************************** -----------------> Test sample ENTER BFGS code START -46558.6898 0.253436059 0.450730324 EXIT FROM BFGS code FG_START 0. 0.253436059 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.496408284 *** contribution from regularisation: 0.00260249968 *** contribution from error: -0.499010772 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48324.3539 0.253436059 201.248535 EXIT FROM BFGS code FG_LNSRCH 0. 0.306298345 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.515066683 *** contribution from regularisation: 0.0032394405 *** contribution from error: -0.518306136 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50140.7091 0.306298345 -10.2238007 EXIT FROM BFGS code NEW_X -50140.7091 0.306298345 -10.2238007 ENTER BFGS code NEW_X -50140.7091 0.306298345 -10.2238007 EXIT FROM BFGS code FG_LNSRCH 0. 0.304557681 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.517239451 *** contribution from regularisation: 0.00312094367 *** contribution from error: -0.52036041 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50352.2272 0.304557681 37.9812584 EXIT FROM BFGS code NEW_X -50352.2272 0.304557681 37.9812584 ENTER BFGS code NEW_X -50352.2272 0.304557681 37.9812584 EXIT FROM BFGS code FG_LNSRCH 0. 0.316144735 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.517760217 *** contribution from regularisation: 0.00309926644 *** contribution from error: -0.52085948 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50402.9204 0.316144735 32.394619 EXIT FROM BFGS code NEW_X -50402.9204 0.316144735 32.394619 ENTER BFGS code NEW_X -50402.9204 0.316144735 32.394619 EXIT FROM BFGS code FG_LNSRCH 0. 0.339284003 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.518142104 *** contribution from regularisation: 0.00308081554 *** contribution from error: -0.521222949 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50440.0985 0.339284003 4.82715416 EXIT FROM BFGS code NEW_X -50440.0985 0.339284003 4.82715416 ENTER BFGS code NEW_X -50440.0985 0.339284003 4.82715416 EXIT FROM BFGS code FG_LNSRCH 0. 0.349506587 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.51854527 *** contribution from regularisation: 0.0030429184 *** contribution from error: -0.521588206 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50479.3462 0.349506587 -7.17366171 EXIT FROM BFGS code FG_LNSRCH 0. 0.390396863 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.519807577 *** contribution from regularisation: 0.00290590548 *** contribution from error: -0.522713482 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50602.2282 0.390396863 -45.553257 EXIT FROM BFGS code NEW_X -50602.2282 0.390396863 -45.553257 ENTER BFGS code NEW_X -50602.2282 0.390396863 -45.553257 EXIT FROM BFGS code FG_LNSRCH 0. 0.502534926 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 47.4855804 sigma out 15 active outputs RANK 2 NODE 1 --> 25.3954105 sigma out 15 active outputs RANK 3 NODE 5 --> 25.2414722 sigma out 15 active outputs RANK 4 NODE 3 --> 21.9884796 sigma out 15 active outputs RANK 5 NODE 9 --> 16.5241337 sigma out 15 active outputs RANK 6 NODE 12 --> 15.7825327 sigma out 15 active outputs RANK 7 NODE 11 --> 14.5706253 sigma out 15 active outputs RANK 8 NODE 7 --> 13.4982538 sigma out 15 active outputs RANK 9 NODE 10 --> 12.3110218 sigma out 15 active outputs RANK 10 NODE 6 --> 11.5354271 sigma out 15 active outputs RANK 11 NODE 8 --> 11.3977633 sigma out 15 active outputs RANK 12 NODE 4 --> 9.20198441 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 49.0867767 sigma in 12act. ( 56.2992477 sig out 1act.) RANK 2 NODE 5 --> 34.9334373 sigma in 12act. ( 41.0290833 sig out 1act.) RANK 3 NODE 8 --> 21.6860867 sigma in 12act. ( 18.6199245 sig out 1act.) RANK 4 NODE 13 --> 16.7071056 sigma in 12act. ( 13.4528408 sig out 1act.) RANK 5 NODE 10 --> 16.4551773 sigma in 12act. ( 16.8872814 sig out 1act.) RANK 6 NODE 1 --> 14.9927435 sigma in 12act. ( 12.3338594 sig out 1act.) RANK 7 NODE 4 --> 12.151907 sigma in 12act. ( 11.1161079 sig out 1act.) RANK 8 NODE 11 --> 11.8876066 sigma in 12act. ( 11.3431683 sig out 1act.) RANK 9 NODE 6 --> 9.07196903 sigma in 12act. ( 8.97300243 sig out 1act.) RANK 10 NODE 2 --> 7.53913689 sigma in 12act. ( 5.20197582 sig out 1act.) RANK 11 NODE 3 --> 7.16793966 sigma in 12act. ( 3.26616025 sig out 1act.) RANK 12 NODE 7 --> 6.41995478 sigma in 12act. ( 3.28269529 sig out 1act.) RANK 13 NODE 15 --> 4.8101778 sigma in 12act. ( 2.50113368 sig out 1act.) RANK 14 NODE 12 --> 3.49112606 sigma in 12act. ( 0.817039967 sig out 1act.) RANK 15 NODE 14 --> 2.32734036 sigma in 12act. ( 0.360973924 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 56.2992477 sigma out 1act.( 49.0867767 sig in 12act.) RANK 2 NODE 5 --> 41.0290833 sigma out 1act.( 34.9334373 sig in 12act.) RANK 3 NODE 8 --> 18.6199245 sigma out 1act.( 21.6860867 sig in 12act.) RANK 4 NODE 10 --> 16.8872814 sigma out 1act.( 16.4551773 sig in 12act.) RANK 5 NODE 13 --> 13.4528408 sigma out 1act.( 16.7071056 sig in 12act.) RANK 6 NODE 1 --> 12.3338594 sigma out 1act.( 14.9927435 sig in 12act.) RANK 7 NODE 11 --> 11.3431683 sigma out 1act.( 11.8876066 sig in 12act.) RANK 8 NODE 4 --> 11.1161079 sigma out 1act.( 12.151907 sig in 12act.) RANK 9 NODE 6 --> 8.97300243 sigma out 1act.( 9.07196903 sig in 12act.) RANK 10 NODE 2 --> 5.20197582 sigma out 1act.( 7.53913689 sig in 12act.) RANK 11 NODE 7 --> 3.28269529 sigma out 1act.( 6.41995478 sig in 12act.) RANK 12 NODE 3 --> 3.26616025 sigma out 1act.( 7.16793966 sig in 12act.) RANK 13 NODE 15 --> 2.50113368 sigma out 1act.( 4.8101778 sig in 12act.) RANK 14 NODE 12 --> 0.817039967 sigma out 1act.( 3.49112606 sig in 12act.) RANK 15 NODE 14 --> 0.360973924 sigma out 1act.( 2.32734036 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 78.7799759 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.519826114 *** contribution from regularisation: 0.00343001587 *** contribution from error: -0.523256123 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50604.0303 0.502534926 -7.53908348 EXIT FROM BFGS code FG_LNSRCH 0. 0.43221283 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.522182703 *** contribution from regularisation: 0.00221983506 *** contribution from error: -0.524402559 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50833.4408 0.43221283 -35.9768143 EXIT FROM BFGS code NEW_X -50833.4408 0.43221283 -35.9768143 ENTER BFGS code NEW_X -50833.4408 0.43221283 -35.9768143 EXIT FROM BFGS code FG_LNSRCH 0. 0.560384989 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.523515105 *** contribution from regularisation: 0.00421314407 *** contribution from error: -0.52772826 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50963.1503 0.560384989 -12.4731998 EXIT FROM BFGS code NEW_X -50963.1503 0.560384989 -12.4731998 ENTER BFGS code NEW_X -50963.1503 0.560384989 -12.4731998 EXIT FROM BFGS code FG_LNSRCH 0. 0.559512019 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.524858236 *** contribution from regularisation: 0.00283966237 *** contribution from error: -0.527697921 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51093.9011 0.559512019 -1.70695746 EXIT FROM BFGS code FG_LNSRCH 0. 0.559976995 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.526449084 *** contribution from regularisation: 0.00279863668 *** contribution from error: -0.529247701 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51248.7655 0.559976995 -10.3984833 EXIT FROM BFGS code NEW_X -51248.7655 0.559976995 -10.3984833 ENTER BFGS code NEW_X -51248.7655 0.559976995 -10.3984833 EXIT FROM BFGS code FG_LNSRCH 0. 0.548487544 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.526632071 *** contribution from regularisation: 0.00275051291 *** contribution from error: -0.529382586 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51266.5771 0.548487544 -9.64918613 EXIT FROM BFGS code NEW_X -51266.5771 0.548487544 -9.64918613 ENTER BFGS code NEW_X -51266.5771 0.548487544 -9.64918613 EXIT FROM BFGS code FG_LNSRCH 0. 0.544844687 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.52717495 *** contribution from regularisation: 0.00287701469 *** contribution from error: -0.530051947 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51319.429 0.544844687 -6.9231286 EXIT FROM BFGS code NEW_X -51319.429 0.544844687 -6.9231286 ENTER BFGS code NEW_X -51319.429 0.544844687 -6.9231286 EXIT FROM BFGS code FG_LNSRCH 0. 0.537036896 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.529005229 *** contribution from regularisation: 0.00321123051 *** contribution from error: -0.532216489 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51497.6007 0.537036896 -1.63509369 EXIT FROM BFGS code NEW_X -51497.6007 0.537036896 -1.63509369 ENTER BFGS code NEW_X -51497.6007 0.537036896 -1.63509369 EXIT FROM BFGS code FG_LNSRCH 0. 0.517636538 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.529080451 *** contribution from regularisation: 0.00317735295 *** contribution from error: -0.532257795 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51504.9215 0.517636538 -15.641058 EXIT FROM BFGS code FG_LNSRCH 0. 0.528284252 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.530153751 *** contribution from regularisation: 0.00276687671 *** contribution from error: -0.532920599 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51609.4102 0.528284252 -9.41749001 EXIT FROM BFGS code NEW_X -51609.4102 0.528284252 -9.41749001 ENTER BFGS code NEW_X -51609.4102 0.528284252 -9.41749001 EXIT FROM BFGS code FG_LNSRCH 0. 0.521966517 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 72.644455 sigma out 15 active outputs RANK 2 NODE 5 --> 57.4916878 sigma out 15 active outputs RANK 3 NODE 1 --> 32.3770561 sigma out 15 active outputs RANK 4 NODE 10 --> 25.6925964 sigma out 15 active outputs RANK 5 NODE 3 --> 23.1526833 sigma out 15 active outputs RANK 6 NODE 11 --> 21.5810871 sigma out 15 active outputs RANK 7 NODE 9 --> 19.9252357 sigma out 15 active outputs RANK 8 NODE 8 --> 15.9416103 sigma out 15 active outputs RANK 9 NODE 7 --> 14.867753 sigma out 15 active outputs RANK 10 NODE 6 --> 12.5790071 sigma out 15 active outputs RANK 11 NODE 12 --> 10.8883247 sigma out 15 active outputs RANK 12 NODE 4 --> 10.1214809 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 85.9645462 sigma in 12act. ( 99.8375092 sig out 1act.) RANK 2 NODE 5 --> 45.0007324 sigma in 12act. ( 53.9914703 sig out 1act.) RANK 3 NODE 10 --> 29.0808468 sigma in 12act. ( 33.7592125 sig out 1act.) RANK 4 NODE 1 --> 24.918869 sigma in 12act. ( 27.7215195 sig out 1act.) RANK 5 NODE 13 --> 24.521265 sigma in 12act. ( 28.3173962 sig out 1act.) RANK 6 NODE 8 --> 19.3347626 sigma in 12act. ( 19.8653069 sig out 1act.) RANK 7 NODE 6 --> 13.2506142 sigma in 12act. ( 14.8929749 sig out 1act.) RANK 8 NODE 11 --> 12.9288435 sigma in 12act. ( 12.69419 sig out 1act.) RANK 9 NODE 2 --> 10.0925512 sigma in 12act. ( 9.23043633 sig out 1act.) RANK 10 NODE 4 --> 8.87595749 sigma in 12act. ( 8.58206463 sig out 1act.) RANK 11 NODE 15 --> 8.73464012 sigma in 12act. ( 7.84361506 sig out 1act.) RANK 12 NODE 3 --> 7.80832767 sigma in 12act. ( 5.97962141 sig out 1act.) RANK 13 NODE 7 --> 4.67007685 sigma in 12act. ( 2.07293272 sig out 1act.) RANK 14 NODE 12 --> 2.05911517 sigma in 12act. ( 0.405205518 sig out 1act.) RANK 15 NODE 14 --> 0.82810235 sigma in 12act. ( 0.178715989 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 99.8375092 sigma out 1act.( 85.9645462 sig in 12act.) RANK 2 NODE 5 --> 53.9914703 sigma out 1act.( 45.0007324 sig in 12act.) RANK 3 NODE 10 --> 33.7592125 sigma out 1act.( 29.0808468 sig in 12act.) RANK 4 NODE 13 --> 28.3173962 sigma out 1act.( 24.521265 sig in 12act.) RANK 5 NODE 1 --> 27.7215195 sigma out 1act.( 24.918869 sig in 12act.) RANK 6 NODE 8 --> 19.8653069 sigma out 1act.( 19.3347626 sig in 12act.) RANK 7 NODE 6 --> 14.8929749 sigma out 1act.( 13.2506142 sig in 12act.) RANK 8 NODE 11 --> 12.69419 sigma out 1act.( 12.9288435 sig in 12act.) RANK 9 NODE 2 --> 9.23043633 sigma out 1act.( 10.0925512 sig in 12act.) RANK 10 NODE 4 --> 8.58206463 sigma out 1act.( 8.87595749 sig in 12act.) RANK 11 NODE 15 --> 7.84361506 sigma out 1act.( 8.73464012 sig in 12act.) RANK 12 NODE 3 --> 5.97962141 sigma out 1act.( 7.80832767 sig in 12act.) RANK 13 NODE 7 --> 2.07293272 sigma out 1act.( 4.67007685 sig in 12act.) RANK 14 NODE 12 --> 0.405205518 sigma out 1act.( 2.05911517 sig in 12act.) RANK 15 NODE 14 --> 0.178715989 sigma out 1act.( 0.82810235 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 128.960632 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.530651271 *** contribution from regularisation: 0.00309526385 *** contribution from error: -0.533746541 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51657.8406 0.521966517 -20.3827763 EXIT FROM BFGS code NEW_X -51657.8406 0.521966517 -20.3827763 ENTER BFGS code NEW_X -51657.8406 0.521966517 -20.3827763 EXIT FROM BFGS code FG_LNSRCH 0. 0.515169501 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.531017959 *** contribution from regularisation: 0.00292433519 *** contribution from error: -0.533942282 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51693.5364 0.515169501 -10.9811487 EXIT FROM BFGS code NEW_X -51693.5364 0.515169501 -10.9811487 ENTER BFGS code NEW_X -51693.5364 0.515169501 -10.9811487 EXIT FROM BFGS code FG_LNSRCH 0. 0.509554386 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.531065643 *** contribution from regularisation: 0.00296015502 *** contribution from error: -0.534025788 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51698.1778 0.509554386 -17.5216522 EXIT FROM BFGS code NEW_X -51698.1778 0.509554386 -17.5216522 ENTER BFGS code NEW_X -51698.1778 0.509554386 -17.5216522 EXIT FROM BFGS code FG_LNSRCH 0. 0.487195134 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.531281114 *** contribution from regularisation: 0.00290410523 *** contribution from error: -0.534185231 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51719.154 0.487195134 -7.50354528 EXIT FROM BFGS code NEW_X -51719.154 0.487195134 -7.50354528 ENTER BFGS code NEW_X -51719.154 0.487195134 -7.50354528 EXIT FROM BFGS code FG_LNSRCH 0. 0.452456385 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.531411052 *** contribution from regularisation: 0.00289684883 *** contribution from error: -0.534307897 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51731.8039 0.452456385 -31.7038536 EXIT FROM BFGS code NEW_X -51731.8039 0.452456385 -31.7038536 ENTER BFGS code NEW_X -51731.8039 0.452456385 -31.7038536 EXIT FROM BFGS code FG_LNSRCH 0. 0.422736913 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.531527221 *** contribution from regularisation: 0.00295247976 *** contribution from error: -0.534479678 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51743.1137 0.422736913 -10.4594326 EXIT FROM BFGS code NEW_X -51743.1137 0.422736913 -10.4594326 ENTER BFGS code NEW_X -51743.1137 0.422736913 -10.4594326 EXIT FROM BFGS code FG_LNSRCH 0. 0.418742508 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.531608462 *** contribution from regularisation: 0.00301228091 *** contribution from error: -0.534620762 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51751.0222 0.418742508 2.2723794 EXIT FROM BFGS code NEW_X -51751.0222 0.418742508 2.2723794 ENTER BFGS code NEW_X -51751.0222 0.418742508 2.2723794 EXIT FROM BFGS code FG_LNSRCH 0. 0.414776206 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.531713724 *** contribution from regularisation: 0.00299737277 *** contribution from error: -0.534711123 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51761.2673 0.414776206 -4.04104328 EXIT FROM BFGS code NEW_X -51761.2673 0.414776206 -4.04104328 ENTER BFGS code NEW_X -51761.2673 0.414776206 -4.04104328 EXIT FROM BFGS code FG_LNSRCH 0. 0.385953039 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.53203541 *** contribution from regularisation: 0.00299825915 *** contribution from error: -0.535033643 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51792.5818 0.385953039 -12.7483521 EXIT FROM BFGS code NEW_X -51792.5818 0.385953039 -12.7483521 ENTER BFGS code NEW_X -51792.5818 0.385953039 -12.7483521 EXIT FROM BFGS code FG_LNSRCH 0. 0.33189702 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.53219831 *** contribution from regularisation: 0.00305319321 *** contribution from error: -0.535251498 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51808.4386 0.33189702 -7.4937253 EXIT FROM BFGS code NEW_X -51808.4386 0.33189702 -7.4937253 ENTER BFGS code NEW_X -51808.4386 0.33189702 -7.4937253 EXIT FROM BFGS code FG_LNSRCH 0. 0.316996783 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 84.3079376 sigma out 15 active outputs RANK 2 NODE 5 --> 62.7762489 sigma out 15 active outputs RANK 3 NODE 1 --> 41.2962494 sigma out 15 active outputs RANK 4 NODE 10 --> 32.5638809 sigma out 15 active outputs RANK 5 NODE 6 --> 28.1097813 sigma out 15 active outputs RANK 6 NODE 3 --> 25.2166805 sigma out 15 active outputs RANK 7 NODE 7 --> 20.0690823 sigma out 15 active outputs RANK 8 NODE 12 --> 19.5027142 sigma out 15 active outputs RANK 9 NODE 11 --> 18.7326527 sigma out 15 active outputs RANK 10 NODE 9 --> 17.381712 sigma out 15 active outputs RANK 11 NODE 4 --> 16.6905384 sigma out 15 active outputs RANK 12 NODE 8 --> 16.3508606 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 97.1269684 sigma in 12act. ( 105.456497 sig out 1act.) RANK 2 NODE 5 --> 52.8707771 sigma in 12act. ( 67.3846741 sig out 1act.) RANK 3 NODE 13 --> 37.6979485 sigma in 12act. ( 42.0399628 sig out 1act.) RANK 4 NODE 10 --> 31.5009747 sigma in 12act. ( 37.3574905 sig out 1act.) RANK 5 NODE 1 --> 31.3308411 sigma in 12act. ( 35.7360573 sig out 1act.) RANK 6 NODE 8 --> 23.5888386 sigma in 12act. ( 26.0949421 sig out 1act.) RANK 7 NODE 6 --> 18.0486832 sigma in 12act. ( 19.8307438 sig out 1act.) RANK 8 NODE 4 --> 15.103406 sigma in 12act. ( 15.2827549 sig out 1act.) RANK 9 NODE 15 --> 12.6097202 sigma in 12act. ( 12.4901114 sig out 1act.) RANK 10 NODE 11 --> 12.0861158 sigma in 12act. ( 12.6064453 sig out 1act.) RANK 11 NODE 2 --> 10.4558277 sigma in 12act. ( 10.5581236 sig out 1act.) RANK 12 NODE 3 --> 7.84261751 sigma in 12act. ( 7.44801998 sig out 1act.) RANK 13 NODE 7 --> 3.04685426 sigma in 12act. ( 1.16055489 sig out 1act.) RANK 14 NODE 12 --> 1.62071168 sigma in 12act. ( 0.690312386 sig out 1act.) RANK 15 NODE 14 --> 0.663728595 sigma in 12act. ( 0.0739277974 sig out 1 act.) sorted by output significance RANK 1 NODE 9 --> 105.456497 sigma out 1act.( 97.1269684 sig in 12act.) RANK 2 NODE 5 --> 67.3846741 sigma out 1act.( 52.8707771 sig in 12act.) RANK 3 NODE 13 --> 42.0399628 sigma out 1act.( 37.6979485 sig in 12act.) RANK 4 NODE 10 --> 37.3574905 sigma out 1act.( 31.5009747 sig in 12act.) RANK 5 NODE 1 --> 35.7360573 sigma out 1act.( 31.3308411 sig in 12act.) RANK 6 NODE 8 --> 26.0949421 sigma out 1act.( 23.5888386 sig in 12act.) RANK 7 NODE 6 --> 19.8307438 sigma out 1act.( 18.0486832 sig in 12act.) RANK 8 NODE 4 --> 15.2827549 sigma out 1act.( 15.103406 sig in 12act.) RANK 9 NODE 11 --> 12.6064453 sigma out 1act.( 12.0861158 sig in 12act.) RANK 10 NODE 15 --> 12.4901114 sigma out 1act.( 12.6097202 sig in 12act.) RANK 11 NODE 2 --> 10.5581236 sigma out 1act.( 10.4558277 sig in 12act.) RANK 12 NODE 3 --> 7.44801998 sigma out 1act.( 7.84261751 sig in 12act.) RANK 13 NODE 7 --> 1.16055489 sigma out 1act.( 3.04685426 sig in 12act.) RANK 14 NODE 12 --> 0.690312386 sigma out 1act.( 1.62071168 sig in 12act.) RANK 15 NODE 14 --> 0.0739277974 sigma out 1act.( 0.663728595 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 147.963638 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.532358944 *** contribution from regularisation: 0.00312406011 *** contribution from error: -0.535483003 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51824.0793 0.316996783 -23.8500767 EXIT FROM BFGS code NEW_X -51824.0793 0.316996783 -23.8500767 ENTER BFGS code NEW_X -51824.0793 0.316996783 -23.8500767 EXIT FROM BFGS code FG_LNSRCH 0. 0.321104914 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.532442868 *** contribution from regularisation: 0.00312820449 *** contribution from error: -0.535571098 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51832.2501 0.321104914 1.59044683 EXIT FROM BFGS code NEW_X -51832.2501 0.321104914 1.59044683 ENTER BFGS code NEW_X -51832.2501 0.321104914 1.59044683 EXIT FROM BFGS code FG_LNSRCH 0. 0.318196625 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.53248018 *** contribution from regularisation: 0.00312508992 *** contribution from error: -0.535605252 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51835.8797 0.318196625 5.41499043 EXIT FROM BFGS code NEW_X -51835.8797 0.318196625 5.41499043 ENTER BFGS code NEW_X -51835.8797 0.318196625 5.41499043 EXIT FROM BFGS code FG_LNSRCH 0. 0.296300471 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.532668948 *** contribution from regularisation: 0.00306594279 *** contribution from error: -0.535734892 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51854.2565 0.296300471 16.6723537 EXIT FROM BFGS code NEW_X -51854.2565 0.296300471 16.6723537 ENTER BFGS code NEW_X -51854.2565 0.296300471 16.6723537 EXIT FROM BFGS code FG_LNSRCH 0. 0.277225465 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.532721758 *** contribution from regularisation: 0.00310775451 *** contribution from error: -0.535829484 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51859.3974 0.277225465 12.4042654 EXIT FROM BFGS code NEW_X -51859.3974 0.277225465 12.4042654 ENTER BFGS code NEW_X -51859.3974 0.277225465 12.4042654 EXIT FROM BFGS code FG_LNSRCH 0. 0.259521365 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.53270483 *** contribution from regularisation: 0.00310261524 *** contribution from error: -0.535807431 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51857.7511 0.259521365 -30.0143661 EXIT FROM BFGS code FG_LNSRCH 0. 0.270135731 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.532668173 *** contribution from regularisation: 0.00321165356 *** contribution from error: -0.53587985 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51854.1791 0.270135731 -3.89675546 EXIT FROM BFGS code FG_LNSRCH 0. 0.27621156 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.532664597 *** contribution from regularisation: 0.00317662419 *** contribution from error: -0.535841227 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51853.8303 0.27621156 10.1167984 EXIT FROM BFGS code FG_LNSRCH 0. 0.277191579 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.532665849 *** contribution from regularisation: 0.00316434121 *** contribution from error: -0.5358302 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51853.9531 0.277191579 12.3153553 EXIT FROM BFGS code FG_LNSRCH 0. 0.277225405 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.532666624 *** contribution from regularisation: 0.00316291139 *** contribution from error: -0.535829544 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51854.0278 0.277225405 12.4095268 EXIT FROM BFGS code FG_LNSRCH 0. 0.277225465 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 85.8668365 sigma out 15 active outputs RANK 2 NODE 5 --> 64.9311981 sigma out 15 active outputs RANK 3 NODE 1 --> 40.1151581 sigma out 15 active outputs RANK 4 NODE 10 --> 37.5921059 sigma out 15 active outputs RANK 5 NODE 6 --> 30.900053 sigma out 15 active outputs RANK 6 NODE 3 --> 25.496439 sigma out 15 active outputs RANK 7 NODE 12 --> 22.7308064 sigma out 15 active outputs RANK 8 NODE 7 --> 21.9098415 sigma out 15 active outputs RANK 9 NODE 11 --> 19.4698162 sigma out 15 active outputs RANK 10 NODE 8 --> 18.8877678 sigma out 15 active outputs RANK 11 NODE 4 --> 17.8202038 sigma out 15 active outputs RANK 12 NODE 9 --> 17.3135586 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 98.4040146 sigma in 12act. ( 107.291428 sig out 1act.) RANK 2 NODE 5 --> 55.5584755 sigma in 12act. ( 70.8962479 sig out 1act.) RANK 3 NODE 13 --> 41.1358147 sigma in 12act. ( 44.5055008 sig out 1act.) RANK 4 NODE 10 --> 33.6910515 sigma in 12act. ( 38.4055672 sig out 1act.) RANK 5 NODE 1 --> 33.5828133 sigma in 12act. ( 37.9425087 sig out 1act.) RANK 6 NODE 8 --> 24.8087959 sigma in 12act. ( 28.1195889 sig out 1act.) RANK 7 NODE 6 --> 19.6623268 sigma in 12act. ( 20.8705101 sig out 1act.) RANK 8 NODE 4 --> 17.7948284 sigma in 12act. ( 18.5358219 sig out 1act.) RANK 9 NODE 15 --> 14.0677443 sigma in 12act. ( 14.3948221 sig out 1act.) RANK 10 NODE 2 --> 11.6382256 sigma in 12act. ( 11.9616137 sig out 1act.) RANK 11 NODE 11 --> 11.1699896 sigma in 12act. ( 11.7348871 sig out 1act.) RANK 12 NODE 3 --> 7.45960283 sigma in 12act. ( 7.29396772 sig out 1act.) RANK 13 NODE 7 --> 2.50185752 sigma in 12act. ( 0.801766574 sig out 1act.) RANK 14 NODE 12 --> 1.4413445 sigma in 12act. ( 0.676667213 sig out 1act.) RANK 15 NODE 14 --> 0.580524445 sigma in 12act. ( 0.0641784593 sig out 1 act.) sorted by output significance RANK 1 NODE 9 --> 107.291428 sigma out 1act.( 98.4040146 sig in 12act.) RANK 2 NODE 5 --> 70.8962479 sigma out 1act.( 55.5584755 sig in 12act.) RANK 3 NODE 13 --> 44.5055008 sigma out 1act.( 41.1358147 sig in 12act.) RANK 4 NODE 10 --> 38.4055672 sigma out 1act.( 33.6910515 sig in 12act.) RANK 5 NODE 1 --> 37.9425087 sigma out 1act.( 33.5828133 sig in 12act.) RANK 6 NODE 8 --> 28.1195889 sigma out 1act.( 24.8087959 sig in 12act.) RANK 7 NODE 6 --> 20.8705101 sigma out 1act.( 19.6623268 sig in 12act.) RANK 8 NODE 4 --> 18.5358219 sigma out 1act.( 17.7948284 sig in 12act.) RANK 9 NODE 15 --> 14.3948221 sigma out 1act.( 14.0677443 sig in 12act.) RANK 10 NODE 2 --> 11.9616137 sigma out 1act.( 11.6382256 sig in 12act.) RANK 11 NODE 11 --> 11.7348871 sigma out 1act.( 11.1699896 sig in 12act.) RANK 12 NODE 3 --> 7.29396772 sigma out 1act.( 7.45960283 sig in 12act.) RANK 13 NODE 7 --> 0.801766574 sigma out 1act.( 2.50185752 sig in 12act.) RANK 14 NODE 12 --> 0.676667213 sigma out 1act.( 1.4413445 sig in 12act.) RANK 15 NODE 14 --> 0.0641784593 sigma out 1act.( 0.580524445 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 153.444656 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.532669246 *** contribution from regularisation: 0.00316024083 *** contribution from error: -0.535829484 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51854.2879 0.277225465 12.4051914 EXIT FROM BFGS code FG_LNSRCH 0. 0.277225465 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.532666743 *** contribution from regularisation: 0.00316278916 *** contribution from error: -0.535829544 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51854.0399 0.277225465 12.409111 EXIT FROM BFGS code FG_LNSRCH 0. 0.277225465 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.532666922 *** contribution from regularisation: 0.00316260988 *** contribution from error: -0.535829544 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51854.0573 0.277225465 12.4267225 EXIT FROM BFGS code NEW_X -51854.0573 0.277225465 12.4267225 ENTER BFGS code NEW_X -51854.0573 0.277225465 12.4267225 EXIT FROM BFGS code CONVERGENC -51854.0573 0.277225465 12.4267225 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 135.092239 sigma out 15 active outputs RANK 2 NODE 5 --> 98.9506454 sigma out 15 active outputs RANK 3 NODE 1 --> 62.8448677 sigma out 15 active outputs RANK 4 NODE 10 --> 58.9473267 sigma out 15 active outputs RANK 5 NODE 6 --> 48.3444939 sigma out 15 active outputs RANK 6 NODE 3 --> 40.048542 sigma out 15 active outputs RANK 7 NODE 7 --> 34.8097496 sigma out 15 active outputs RANK 8 NODE 12 --> 34.6675835 sigma out 15 active outputs RANK 9 NODE 11 --> 30.5139751 sigma out 15 active outputs RANK 10 NODE 8 --> 29.9243507 sigma out 15 active outputs RANK 11 NODE 4 --> 27.5519733 sigma out 15 active outputs RANK 12 NODE 9 --> 27.2340317 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 154.183014 sigma in 12act. ( 167.427475 sig out 1act.) RANK 2 NODE 5 --> 86.3787842 sigma in 12act. ( 111.615395 sig out 1act.) RANK 3 NODE 13 --> 63.3531227 sigma in 12act. ( 70.8479538 sig out 1act.) RANK 4 NODE 10 --> 52.6730652 sigma in 12act. ( 60.9774094 sig out 1act.) RANK 5 NODE 1 --> 52.2369461 sigma in 12act. ( 60.3430786 sig out 1act.) RANK 6 NODE 8 --> 38.9472427 sigma in 12act. ( 43.8565407 sig out 1act.) RANK 7 NODE 6 --> 30.4216461 sigma in 12act. ( 33.2446098 sig out 1act.) RANK 8 NODE 4 --> 27.4972572 sigma in 12act. ( 28.7737713 sig out 1act.) RANK 9 NODE 15 --> 21.4638195 sigma in 12act. ( 22.4654427 sig out 1act.) RANK 10 NODE 2 --> 17.6753387 sigma in 12act. ( 18.6659374 sig out 1act.) RANK 11 NODE 11 --> 17.0709 sigma in 12act. ( 18.3100376 sig out 1act.) RANK 12 NODE 3 --> 11.1209049 sigma in 12act. ( 11.3998547 sig out 1act.) RANK 13 NODE 7 --> 2.66728234 sigma in 12act. ( 1.23592412 sig out 1act.) RANK 14 NODE 12 --> 1.68298554 sigma in 12act. ( 1.03387427 sig out 1act.) RANK 15 NODE 14 --> 0.584169745 sigma in 12act. ( 0.0956167579 sig out 1 act.) sorted by output significance RANK 1 NODE 9 --> 167.427475 sigma out 1act.( 154.183014 sig in 12act.) RANK 2 NODE 5 --> 111.615395 sigma out 1act.( 86.3787842 sig in 12act.) RANK 3 NODE 13 --> 70.8479538 sigma out 1act.( 63.3531227 sig in 12act.) RANK 4 NODE 10 --> 60.9774094 sigma out 1act.( 52.6730652 sig in 12act.) RANK 5 NODE 1 --> 60.3430786 sigma out 1act.( 52.2369461 sig in 12act.) RANK 6 NODE 8 --> 43.8565407 sigma out 1act.( 38.9472427 sig in 12act.) RANK 7 NODE 6 --> 33.2446098 sigma out 1act.( 30.4216461 sig in 12act.) RANK 8 NODE 4 --> 28.7737713 sigma out 1act.( 27.4972572 sig in 12act.) RANK 9 NODE 15 --> 22.4654427 sigma out 1act.( 21.4638195 sig in 12act.) RANK 10 NODE 2 --> 18.6659374 sigma out 1act.( 17.6753387 sig in 12act.) RANK 11 NODE 11 --> 18.3100376 sigma out 1act.( 17.0709 sig in 12act.) RANK 12 NODE 3 --> 11.3998547 sigma out 1act.( 11.1209049 sig in 12act.) RANK 13 NODE 7 --> 1.23592412 sigma out 1act.( 2.66728234 sig in 12act.) RANK 14 NODE 12 --> 1.03387427 sigma out 1act.( 1.68298554 sig in 12act.) RANK 15 NODE 14 --> 0.0956167579 sigma out 1act.( 0.584169745 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 240.928177 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.532673657 *** contribution from regularisation: 0.00315586547 *** contribution from error: -0.535829544 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 31601 Closing output file done