NNInput NNInputs_135.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 186081 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 46281 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 46281 Chosen entries: 46281 Signal fraction: 1 Background fraction: 0.331051 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 46281 Entries to split: 46281 Test with : 23140 Train with : 23140 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 46281 for Signal Prepared event 0 for Signal with 46281 events ====Entry 0 Variable Ht : 232.766 Variable LepAPt : 74.3556 Variable LepBPt : 30.6959 Variable MetSigLeptonsJets : 3.09436 Variable MetSpec : 41.4986 Variable SumEtLeptonsJets : 190.102 Variable VSumJetLeptonsPt : 35.9078 Variable addEt : 147.716 Variable dPhiLepSumMet : 2.12661 Variable dPhiLeptons : 0.248817 Variable dRLeptons : 0.333981 Variable lep1_E : 86.3275 Variable lep2_E : 32.4592 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2135 Ht = 232.766 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 74.3557 LepAPt = 74.3556 LepBEt = 30.6962 LepBPt = 30.6959 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 42.6642 MetDelPhi = 1.33651 MetSig = 2.91556 MetSigLeptonsJets = 3.09436 MetSpec = 41.4986 Mjj = 0 MostCentralJetEta = -1.56143 MtllMet = 152.006 Njets = 1 SB = 0 SumEt = 214.133 SumEtJets = 0 SumEtLeptonsJets = 190.102 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 35.9078 addEt = 147.716 dPhiLepSumMet = 2.12661 dPhiLeptons = 0.248817 dRLeptons = 0.333981 diltype = 17 dimass = 15.9508 event = 435 jet1_Et = 85.0503 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 86.3275 lep2_E = 32.4592 rand = 0.999742 run = 230778 weight = 2.42631e-06 ===Show End Prepared event 10000 for Signal with 46281 events Prepared event 20000 for Signal with 46281 events Prepared event 30000 for Signal with 46281 events Prepared event 40000 for Signal with 46281 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.273912 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4371 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 186081 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4371 negative weights. Signal fraction: 62.7975464 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 63.1057739 65.3161392 67.0922852 67.9760971 68.8894424 69.9228668 70.7197342 71.6113815 72.5901642 73.3427429 73.9723663 74.4996719 75.2123337 75.7650681 76.4193115 77.0461578 77.5774841 78.329422 78.8956451 79.4661636 80.0829926 80.8395691 81.3832855 81.9863052 82.5726929 83.3209 84.0721817 84.9925842 85.8148346 86.571022 87.5537491 88.7321472 89.6343613 90.8041382 92.0151596 93.2019272 94.5327301 95.605484 96.8312683 98.0731354 99.2346649 100.405655 101.50238 102.733536 103.834396 105.095749 106.204895 107.408936 108.491043 109.624771 110.705727 111.703201 112.722244 113.655853 114.766266 115.800438 116.916252 118.101288 119.275597 120.106903 121.20874 122.303421 123.391815 124.47287 125.574165 126.711304 128.014679 129.041611 130.329926 131.557281 132.831543 134.21286 135.719116 137.530365 139.424683 141.384995 143.198853 145.335327 147.71785 149.901581 152.288605 154.785675 157.021393 159.449966 162.08371 165.243622 168.614182 172.08493 176.141968 180.519592 185.231415 190.806641 197.128357 205.172806 214.184067 225.799316 240.179321 263.644531 312.178711 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3131676 20.6022415 20.8619919 21.1509304 21.3869629 21.5603371 21.7959652 21.987711 22.1759071 22.3883381 22.599369 22.8028488 23.0032902 23.1717834 23.3638382 23.5591774 23.7402458 23.9035568 24.0943451 24.2869606 24.4781609 24.6562119 24.8494835 25.070179 25.2593269 25.4479561 25.6146049 25.7824211 25.9561272 26.1570511 26.3097935 26.4796944 26.674839 26.8791199 27.0858879 27.2648563 27.4729481 27.6837978 27.8670197 28.0405197 28.193388 28.430233 28.6739769 28.8908424 29.1027184 29.2890739 29.497963 29.7137623 29.9497871 30.1552429 30.4213753 30.662117 30.9206772 31.1551876 31.4235992 31.6770973 31.8983727 32.1362991 32.3896866 32.6478958 32.8893509 33.1668701 33.4490356 33.7390976 34.0032005 34.3054543 34.6056671 34.9035683 35.2074127 35.4814949 35.8243713 36.1756363 36.5333061 36.8367157 37.1595688 37.5734863 38.0202065 38.4444733 38.8633766 39.2223091 39.6897659 40.2171936 40.7190857 41.124752 41.6880951 42.3230362 43.0265808 43.7406693 44.5341721 45.4459801 46.3859787 47.5681648 48.8920593 50.3546143 52.0111732 54.0056152 56.9088745 61.2557068 69.4141922 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0005026 10.1116581 10.221777 10.3469429 10.4585304 10.5634079 10.6720486 10.7834835 10.8975754 10.99757 11.1123066 11.241106 11.359333 11.473814 11.602602 11.7462444 11.8908281 12.0290327 12.1804619 12.3133678 12.4605465 12.5954571 12.746973 12.8769121 13.0109711 13.1580791 13.3141403 13.4624043 13.6116352 13.7456551 13.8666096 14.0109882 14.1633244 14.2976103 14.4504795 14.608717 14.8012867 14.9647541 15.1192989 15.2915363 15.4342575 15.6045017 15.7779417 15.9485302 16.1164532 16.3278732 16.5257568 16.7075043 16.8586197 17.0442219 17.2452888 17.4468765 17.6646767 17.831995 17.9862728 18.1808472 18.4016705 18.6240387 18.8348217 19.0272942 19.2241173 19.4500351 19.6987114 19.9467278 20.1692123 20.3576832 20.5880165 20.7916641 21.0202389 21.2368183 21.4658737 21.7243271 21.94491 22.1268349 22.3866558 22.6464348 22.9341621 23.2307854 23.5062065 23.7762775 24.0637016 24.3808517 24.6879234 25.0379639 25.4237404 25.7971134 26.145546 26.5007286 26.9210815 27.3887291 27.8459263 28.3154373 28.904705 29.5117283 30.2107086 31.0477333 32.1028938 33.6245728 35.9646034 40.2179031 74.1576004 ------------------------------ Transdef: Tab for variable 5 1.07960415 2.50856733 2.91864014 3.15596819 3.39578199 3.62567139 3.80968761 3.9978323 4.11967182 4.21838951 4.32207489 4.42836857 4.53177357 4.62912416 4.71712685 4.79281425 4.86911821 4.95394325 5.01315403 5.07290363 5.13145733 5.18571615 5.24741173 5.30138683 5.35726404 5.41035938 5.45519304 5.50063515 5.54257107 5.59434986 5.63752031 5.677845 5.72404957 5.76993847 5.81367302 5.85464001 5.89737225 5.93935204 5.98140526 6.02113438 6.0568862 6.09561157 6.13469934 6.17717266 6.21670532 6.25646496 6.29355717 6.33040142 6.36871004 6.4083252 6.44701099 6.48260784 6.52201939 6.56138277 6.60024786 6.64246798 6.69056749 6.72962046 6.76716328 6.81048107 6.84972811 6.88965607 6.92721033 6.96958494 7.01141644 7.05644894 7.10932255 7.15533972 7.20249271 7.24975014 7.29817486 7.34813786 7.3972683 7.44782543 7.48940659 7.53822994 7.58638763 7.64304543 7.69777393 7.76008892 7.80770636 7.8647213 7.92261934 7.9873209 8.04935837 8.1200676 8.18883705 8.26369286 8.34427643 8.42474556 8.51831627 8.62375641 8.73878098 8.86739445 9.0302763 9.20931435 9.40877342 9.66358376 10.0854893 10.9702492 16.7564106 ------------------------------ Transdef: Tab for variable 6 15.000617 19.9465866 24.5461636 25.8290997 26.844738 27.653923 28.5003185 29.2383919 29.937809 30.5854511 31.1570625 31.7109032 32.2070084 32.6938705 33.1717796 33.5836716 34.0865669 34.5043869 34.8240509 35.1480598 35.5356064 35.8778725 36.280777 36.5885353 36.9576492 37.2802505 37.6186333 37.9745522 38.2544174 38.5775452 38.8864365 39.2251167 39.5299568 39.8673439 40.231041 40.5064316 40.8424606 41.2154312 41.5785484 41.9694748 42.3187103 42.6825104 43.0397034 43.4680061 43.7886887 44.2957458 44.7376556 45.2394257 45.7103195 46.2112007 46.687294 47.1949615 47.7084694 48.2247849 48.7021828 49.1355057 49.7616501 50.2620163 50.6602402 51.2181854 51.8208084 52.3273048 52.8512955 53.4350739 53.9742584 54.4716034 55.0661469 55.6013489 56.1256638 56.685257 57.2512856 57.8623009 58.3913879 58.8754959 59.4527435 60.0426788 60.6609192 61.3403473 61.9617004 62.6146164 63.2542877 63.9743805 64.7046814 65.5212402 66.3175888 67.1367188 68.0119858 69.0194397 69.9941406 71.1210022 72.5337524 73.9977036 75.7357178 77.1441193 79.2777023 81.98983 84.9408417 89.2914581 95.1947479 106.596893 225.452026 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.7181168 33.6790466 34.2279587 34.9803391 35.5047226 35.9129181 36.2614937 36.590004 36.9681892 37.3693542 37.7275772 38.0019455 38.2929077 38.5900192 38.8217545 39.1331558 39.389595 39.6184883 39.8936539 40.2107468 40.5247879 40.7926025 41.0954285 41.4317894 41.8063507 42.167244 42.5941925 43.0408173 43.5229759 44.122139 44.7214432 45.1821976 45.6557846 46.3726006 46.9442177 47.6173401 48.2111282 48.9543266 49.6016006 50.383255 51.1814651 51.8244591 52.5976944 53.2633514 53.8444138 54.5467453 55.2481766 55.894001 56.504818 57.1083145 57.7228012 58.4707222 59.184227 59.8604813 60.5558357 61.181469 61.7685471 62.3678284 63.102356 63.8193665 64.5744476 65.4892197 66.3479538 67.3757782 68.4452057 69.4686966 70.5554962 71.6208038 72.9776917 74.1672211 75.4535217 76.760437 78.0777817 79.2346191 80.8628922 82.4072647 83.9342346 85.6376038 87.3698425 89.2780762 91.1521225 93.1996307 95.390564 97.7027588 100.097839 102.606094 105.292831 108.301483 111.567673 115.366783 119.793159 124.667175 129.762299 136.883606 144.867798 153.44577 166.350861 184.923126 219.847687 458.64209 ------------------------------ Transdef: Tab for variable 8 1.19621754 22.2973747 26.6219501 29.6738892 31.0225391 31.9361763 32.71278 33.2136536 33.7171478 34.1422272 34.530941 34.9518433 35.299118 35.5657082 35.9222832 36.2192154 36.5072708 36.8140182 37.103344 37.338726 37.5993423 37.8215637 38.0405502 38.2607117 38.5407867 38.7065926 38.95784 39.2468147 39.4943466 39.7243042 39.9963646 40.2339706 40.5003319 40.7844467 41.0712929 41.3922882 41.7415123 42.0868301 42.4672928 42.8692322 43.1998787 43.563839 43.9320564 44.3776093 44.8235741 45.2402954 45.7064781 46.0844612 46.5279465 46.914238 47.3733025 47.8578873 48.3619843 48.8582306 49.3386536 49.8039207 50.2933884 50.8027229 51.2157593 51.746624 52.3060417 52.8157959 53.2490234 53.7044754 54.2014084 54.7114639 55.2651901 55.7366943 56.2571869 56.7794456 57.3308716 57.8431511 58.4388351 59.0004501 59.5758743 60.1206589 60.6993637 61.1485977 61.8185081 62.4048767 63.0640869 63.7233429 64.4325409 65.2593384 66.0172653 66.8438721 67.8034134 68.8563538 70.031044 71.2787781 72.7874298 74.4431839 76.3152466 78.3828125 80.5086823 83.60495 87.8348083 93.1571732 101.447006 117.107788 326.868286 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.6183891 64.6212082 66.2143402 67.357338 68.2381287 68.971817 69.8816071 70.5595779 71.3284454 72.0821381 72.8827972 73.4527969 74.0195465 74.5150146 75.1594467 75.6767578 76.2090454 76.8561707 77.3070068 77.8609238 78.4562912 78.9325867 79.4284363 79.9474792 80.5317383 81.0251465 81.5723801 82.0780334 82.5547104 83.1759415 83.7738495 84.4668961 85.2101288 85.8607025 86.4198456 87.1268768 87.984726 88.7823792 89.5148468 90.3518295 91.2074738 92.255455 93.0549622 93.9749832 94.9032745 95.7150116 96.4932632 97.3998108 98.3675919 99.2252045 100.122375 100.936569 101.895676 102.74913 103.666763 104.667374 105.594315 106.480423 107.384941 108.25354 109.080307 109.924934 110.673752 111.474213 112.324539 113.173622 114.076584 114.999115 115.79908 116.630356 117.450165 118.350044 119.229294 119.857819 120.685623 121.56102 122.437088 123.303436 124.092972 124.930992 125.806946 126.77108 127.842422 128.824142 129.878571 130.937988 132.08374 133.192337 134.437775 135.770386 137.350586 139.277954 141.358826 144.108032 147.524689 151.530853 158.268921 169.102371 192.891724 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.836588264 1.19549608 1.41317964 1.59697294 1.72397804 1.83378863 1.92948389 2.01432967 2.07758331 2.1385293 2.20159578 2.25316691 2.30330324 2.34564161 2.39064765 2.42887878 2.46605539 2.49777508 2.52899504 2.55819345 2.58227682 2.60903168 2.63044262 2.65508366 2.67803502 2.70011091 2.71957207 2.73771954 2.7545166 2.77159119 2.78502941 2.80073977 2.81458616 2.82731462 2.84038353 2.85194254 2.86361694 2.87438154 2.88419056 2.89320135 2.90242338 2.91104317 2.91942358 2.92753196 2.93484974 2.9422226 2.94852161 2.95482492 2.96126318 2.96801662 2.97473097 2.98024559 2.98548841 2.98949027 2.99384403 2.99902773 3.00430775 3.00881147 3.01369071 3.01727343 3.02210617 3.02633405 3.03007126 3.03447437 3.03801107 3.04254341 3.04652023 3.05036306 3.05404377 3.05813622 3.06170082 3.06507254 3.0682559 3.07175398 3.07507372 3.07840729 3.0811882 3.08423567 3.08744431 3.09029722 3.09332895 3.09578896 3.0987978 3.10136795 3.10380006 3.10615396 3.10934877 3.11221552 3.11461496 3.11699367 3.11944246 3.1216197 3.12451935 3.12690687 3.12937021 3.13141012 3.13384676 3.1363368 3.13884783 3.14158678 ------------------------------ Transdef: Tab for variable 11 1.70387302E-05 0.00535178185 0.0113044083 0.0184714813 0.0247294903 0.0309470892 0.0402981341 0.0474664569 0.0562341213 0.0637945533 0.0715915412 0.0783711672 0.0865525156 0.094180584 0.102053568 0.108079851 0.115860701 0.123697519 0.130756259 0.139380008 0.146692038 0.15420723 0.160911679 0.169218361 0.175410986 0.182544231 0.189106882 0.195966721 0.202066839 0.208069563 0.214027703 0.22106576 0.227526426 0.233236432 0.239210844 0.246112943 0.252359748 0.257677376 0.263172746 0.268886924 0.275121927 0.280541897 0.286009729 0.29161185 0.297248065 0.302072346 0.307759106 0.313031912 0.319173545 0.324856281 0.330254138 0.335912287 0.341506183 0.346449733 0.35243535 0.358356833 0.364440203 0.369495273 0.376330376 0.381579101 0.387358606 0.393030405 0.399004221 0.404824197 0.410418808 0.416279197 0.422713548 0.429131091 0.435624361 0.44043386 0.44620657 0.451060414 0.457244635 0.464265376 0.471214771 0.477029204 0.48357904 0.491340637 0.499051571 0.506918311 0.513885975 0.521279037 0.530101299 0.538646221 0.544773221 0.553780079 0.564870238 0.576063514 0.587122917 0.599272013 0.612786114 0.629397035 0.644882679 0.660224438 0.678775191 0.699118257 0.719691217 0.754434586 0.798074007 0.861449718 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.221553504 0.23796165 0.250279129 0.261893064 0.273441494 0.283037126 0.292248726 0.300688207 0.309432447 0.317678839 0.325354815 0.332630575 0.339402556 0.34570545 0.351707697 0.359067142 0.365562826 0.371464491 0.377797484 0.384111673 0.389975071 0.39549619 0.40065527 0.404721081 0.409270704 0.41311264 0.417334378 0.421144783 0.42531085 0.429262757 0.433081716 0.436819702 0.440482974 0.444361717 0.448059946 0.452374011 0.456023365 0.459962249 0.464239776 0.468258798 0.471903503 0.47610122 0.478301525 0.481846213 0.485117763 0.488613963 0.492480516 0.495977789 0.499717206 0.503353238 0.507804811 0.511842012 0.516166091 0.520443439 0.523849428 0.528339744 0.532200217 0.536785364 0.541113853 0.545604944 0.54863441 0.553049088 0.557673693 0.562340498 0.566822052 0.57045579 0.575251877 0.580059052 0.585368633 0.59068799 0.595659375 0.601739705 0.60744071 0.612573743 0.61885947 0.625729799 0.632289767 0.639294267 0.646191716 0.653104126 0.66088295 0.667470813 0.674299181 0.682385981 0.691489577 0.700603724 0.709175587 0.717818856 0.727748752 0.737909675 0.749672174 0.761737466 0.775096178 0.790885627 0.805820346 0.824763656 0.845629811 0.877143383 0.921361685 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.424366 22.1886444 22.7077103 23.3276024 23.81394 24.3138084 24.7534332 25.1602135 25.5034714 25.8664589 26.2426167 26.6278114 26.9660416 27.2790871 27.6292534 27.9358368 28.251276 28.5856762 28.8958817 29.1986542 29.4884109 29.7647247 30.0784035 30.3575382 30.6236076 30.9026909 31.1684361 31.4633083 31.7367172 32.0369759 32.3417931 32.6269493 32.9423904 33.1880722 33.5223846 33.8292542 34.1332932 34.4467163 34.7529984 35.071373 35.3931351 35.6874962 35.9977112 36.2820969 36.6093941 36.9206161 37.2771568 37.6447525 37.9737244 38.2852402 38.6122627 38.9689522 39.3623886 39.7107162 40.1254501 40.5290222 40.9236298 41.3634415 41.838295 42.3182144 42.7647591 43.2141609 43.7154274 44.225563 44.7499237 45.2440071 45.8090744 46.3996429 46.9916153 47.5552597 48.1525154 48.8354988 49.5631905 50.3090553 50.9674301 51.7765808 52.5414581 53.3613586 54.2032623 55.1192093 55.987133 57.0228882 58.0100708 59.0544739 60.2590103 61.51828 63.016449 64.7424316 66.4783096 68.1423416 69.6823883 71.8841019 74.4499359 77.0233002 80.0684357 84.1891937 87.8323517 94.0171204 103.440781 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6281509 11.0412216 11.360178 11.6473112 11.9765682 12.3010921 12.5782919 12.8347454 13.1442108 13.3883801 13.6368275 13.8529072 14.0713015 14.3126698 14.5645247 14.7797222 15.0282707 15.2626648 15.4947329 15.7396269 15.954649 16.234972 16.4881763 16.7239418 16.941288 17.1759109 17.4162502 17.6571312 17.8740234 18.0844002 18.3082199 18.5413361 18.7460251 18.9957581 19.1649132 19.3655167 19.631218 19.8763542 20.1441154 20.3833752 20.6365833 20.8977928 21.1593361 21.3808975 21.6354465 21.8685684 22.1118774 22.3634377 22.6223106 22.8963909 23.1413689 23.3749447 23.6488457 23.9157333 24.1680965 24.4161797 24.7257576 24.9955673 25.2726536 25.5439682 25.8159447 26.0978832 26.3741779 26.6837082 26.9741879 27.2485962 27.5115871 27.7976856 28.0188828 28.281002 28.6333466 28.9610901 29.3091927 29.6791191 30.025177 30.4730148 30.8867874 31.2698822 31.6710968 32.1793823 32.6977806 33.2318268 33.6154022 34.1118011 34.7333946 35.3776779 36.1382141 36.8941803 37.6595383 38.5651779 39.5477371 40.7695618 42.0882759 43.5416641 45.3082886 47.4711227 49.9798927 53.9940071 61.5179901 120.716866 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 57.6 39.7 42.0 15.6 38.4 55.3 42.9 54.0 -27.3 -10.7 -27.8 4.3 11.8 2 57.6 100.0 62.3 52.7 25.1 62.6 94.1 68.2 90.5 -49.6 -19.2 -42.8 27.0 24.4 3 39.7 62.3 100.0 31.3 -0.3 27.1 65.7 47.6 68.1 -17.4 -20.9 -47.4 61.4 11.8 4 42.0 52.7 31.3 100.0 5.3 28.0 53.9 42.1 58.0 -12.8 -25.6 -55.6 10.1 68.9 5 15.6 25.1 -0.3 5.3 100.0 81.7 -2.9 50.6 50.6 25.1 -2.0 -2.1 -8.7 -3.0 6 38.4 62.6 27.1 28.0 81.7 100.0 40.4 74.2 77.1 -5.2 -10.4 -21.4 5.2 9.3 7 55.3 94.1 65.7 53.9 -2.9 40.4 100.0 60.5 78.1 -56.7 -18.4 -43.7 31.6 27.1 8 42.9 68.2 47.6 42.1 50.6 74.2 60.5 100.0 79.4 -10.6 -17.8 -36.0 21.0 20.7 9 54.0 90.5 68.1 58.0 50.6 77.1 78.1 79.4 100.0 -24.2 -22.2 -48.9 31.8 29.0 10 -27.3 -49.6 -17.4 -12.8 25.1 -5.2 -56.7 -10.6 -24.2 100.0 2.2 8.4 -5.4 -3.8 11 -10.7 -19.2 -20.9 -25.6 -2.0 -10.4 -18.4 -17.8 -22.2 2.2 100.0 52.1 -7.6 -14.8 12 -27.8 -42.8 -47.4 -55.6 -2.1 -21.4 -43.7 -36.0 -48.9 8.4 52.1 100.0 -20.7 -30.4 13 4.3 27.0 61.4 10.1 -8.7 5.2 31.6 21.0 31.8 -5.4 -7.6 -20.7 100.0 40.9 14 11.8 24.4 11.8 68.9 -3.0 9.3 27.1 20.7 29.0 -3.8 -14.8 -30.4 40.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 134.080604 TOTAL CORRELATION OF ALL VARIABLES 63.6656561 ROUND 1: MAX CORR ( 63.6586358) AFTER KILLING INPUT VARIABLE 7 CONTR 0.945438694 ROUND 2: MAX CORR ( 63.6304388) AFTER KILLING INPUT VARIABLE 11 CONTR 1.89451241 ROUND 3: MAX CORR ( 63.5217042) AFTER KILLING INPUT VARIABLE 8 CONTR 3.71830998 ROUND 4: MAX CORR ( 63.3956901) AFTER KILLING INPUT VARIABLE 10 CONTR 3.99917295 ROUND 5: MAX CORR ( 63.2228064) AFTER KILLING INPUT VARIABLE 14 CONTR 4.67870481 ROUND 6: MAX CORR ( 63.0098606) AFTER KILLING INPUT VARIABLE 12 CONTR 5.18466142 ROUND 7: MAX CORR ( 62.7854277) AFTER KILLING INPUT VARIABLE 6 CONTR 5.31343525 ROUND 8: MAX CORR ( 61.9936164) AFTER KILLING INPUT VARIABLE 9 CONTR 9.93989228 ROUND 9: MAX CORR ( 61.9341181) AFTER KILLING INPUT VARIABLE 5 CONTR 2.71541822 ROUND 10: MAX CORR ( 60.5601942) AFTER KILLING INPUT VARIABLE 4 CONTR 12.9729666 ROUND 11: MAX CORR ( 58.7684083) AFTER KILLING INPUT VARIABLE 3 CONTR 14.6222877 ROUND 12: MAX CORR ( 57.5890257) AFTER KILLING INPUT VARIABLE 13 CONTR 11.7145184 LAST REMAINING VARIABLE: 2 total correlation to target: 63.6656561 % total significance: 122.521052 sigma correlations of single variables to target: variable 2: 57.5890257 % , in sigma: 110.826911 variable 3: 39.6899147 % , in sigma: 76.3810571 variable 4: 41.966203 % , in sigma: 80.7616486 variable 5: 15.6326553 % , in sigma: 30.0841851 variable 6: 38.3871179 % , in sigma: 73.8738963 variable 7: 55.2514779 % , in sigma: 106.328429 variable 8: 42.9345437 % , in sigma: 82.625167 variable 9: 54.0127864 % , in sigma: 103.944636 variable 10: -27.3078235 % , in sigma: 52.5524039 variable 11: -10.7355655 % , in sigma: 20.6600051 variable 12: -27.8279248 % , in sigma: 53.5533102 variable 13: 4.2802978 % , in sigma: 8.23719761 variable 14: 11.8128843 % , in sigma: 22.7332459 variables sorted by significance: 1 most relevant variable 2 corr 57.5890274 , in sigma: 110.826915 2 most relevant variable 13 corr 11.7145185 , in sigma: 22.5439464 3 most relevant variable 3 corr 14.6222878 , in sigma: 28.1397883 4 most relevant variable 4 corr 12.9729662 , in sigma: 24.9657597 5 most relevant variable 5 corr 2.71541834 , in sigma: 5.22567319 6 most relevant variable 9 corr 9.93989182 , in sigma: 19.1287749 7 most relevant variable 6 corr 5.31343508 , in sigma: 10.2254135 8 most relevant variable 12 corr 5.18466139 , in sigma: 9.97759558 9 most relevant variable 14 corr 4.67870474 , in sigma: 9.00390985 10 most relevant variable 10 corr 3.99917293 , in sigma: 7.69618826 11 most relevant variable 8 corr 3.71830988 , in sigma: 7.15568278 12 most relevant variable 11 corr 1.89451241 , in sigma: 3.64588491 13 most relevant variable 7 corr 0.945438683 , in sigma: 1.81944473 global correlations between input variables: variable 2: 99.0919629 % variable 3: 92.9539847 % variable 4: 91.1689546 % variable 5: 94.9863697 % variable 6: 93.6035634 % variable 7: 98.5941143 % variable 8: 87.2489962 % variable 9: 98.8440283 % variable 10: 72.0082028 % variable 11: 52.9170339 % variable 12: 73.4484599 % variable 13: 83.9099165 % variable 14: 86.6800222 % significance loss when removing single variables: variable 2: corr = 7.51042969 % , sigma = 14.4534087 variable 3: corr = 15.0796373 % , sigma = 29.0199324 variable 4: corr = 16.0531573 % , sigma = 30.8934179 variable 5: corr = 6.55749968 % , sigma = 12.6195473 variable 6: corr = 3.91485384 % , sigma = 7.53392083 variable 7: corr = 0.945438694 % , sigma = 1.81944475 variable 8: corr = 2.80685254 % , sigma = 5.40163328 variable 9: corr = 9.94509396 % , sigma = 19.1387861 variable 10: corr = 4.15200164 % , sigma = 7.9902987 variable 11: corr = 1.82657994 % , sigma = 3.5151526 variable 12: corr = 3.88223784 % , sigma = 7.47115312 variable 13: corr = 8.65809774 % , sigma = 16.6620327 variable 14: corr = 4.66114319 % , sigma = 8.97011361 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 26.8705368 sigma out 15 active outputs RANK 2 NODE 2 --> 26.5536385 sigma out 15 active outputs RANK 3 NODE 7 --> 24.2014484 sigma out 15 active outputs RANK 4 NODE 1 --> 20.0726032 sigma out 15 active outputs RANK 5 NODE 12 --> 19.1045189 sigma out 15 active outputs RANK 6 NODE 5 --> 18.7745991 sigma out 15 active outputs RANK 7 NODE 11 --> 16.3076725 sigma out 15 active outputs RANK 8 NODE 8 --> 14.4897881 sigma out 15 active outputs RANK 9 NODE 4 --> 12.644599 sigma out 15 active outputs RANK 10 NODE 10 --> 11.390913 sigma out 15 active outputs RANK 11 NODE 6 --> 10.9200048 sigma out 15 active outputs RANK 12 NODE 3 --> 8.07447433 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 39.1471252 sigma in 12act. ( 39.6438522 sig out 1act.) RANK 2 NODE 9 --> 34.7581978 sigma in 12act. ( 34.8211212 sig out 1act.) RANK 3 NODE 14 --> 20.3360901 sigma in 12act. ( 19.7263126 sig out 1act.) RANK 4 NODE 8 --> 19.9734402 sigma in 12act. ( 21.6181965 sig out 1act.) RANK 5 NODE 11 --> 12.3236656 sigma in 12act. ( 11.0849085 sig out 1act.) RANK 6 NODE 2 --> 11.7945423 sigma in 12act. ( 11.6770897 sig out 1act.) RANK 7 NODE 15 --> 10.2411308 sigma in 12act. ( 10.0525427 sig out 1act.) RANK 8 NODE 4 --> 7.22121048 sigma in 12act. ( 8.90638447 sig out 1act.) RANK 9 NODE 13 --> 4.98137665 sigma in 12act. ( 5.04006672 sig out 1act.) RANK 10 NODE 1 --> 4.88959837 sigma in 12act. ( 3.89377475 sig out 1act.) RANK 11 NODE 3 --> 3.86525822 sigma in 12act. ( 5.95410872 sig out 1act.) RANK 12 NODE 7 --> 2.91788292 sigma in 12act. ( 2.35056448 sig out 1act.) RANK 13 NODE 6 --> 2.21155429 sigma in 12act. ( 3.35014224 sig out 1act.) RANK 14 NODE 12 --> 1.9605453 sigma in 12act. ( 0.0299639013 sig out 1act.) RANK 15 NODE 10 --> 1.06744385 sigma in 12act. ( 0.75741595 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 39.6438522 sigma out 1act.( 39.1471252 sig in 12act.) RANK 2 NODE 9 --> 34.8211212 sigma out 1act.( 34.7581978 sig in 12act.) RANK 3 NODE 8 --> 21.6181965 sigma out 1act.( 19.9734402 sig in 12act.) RANK 4 NODE 14 --> 19.7263126 sigma out 1act.( 20.3360901 sig in 12act.) RANK 5 NODE 2 --> 11.6770897 sigma out 1act.( 11.7945423 sig in 12act.) RANK 6 NODE 11 --> 11.0849085 sigma out 1act.( 12.3236656 sig in 12act.) RANK 7 NODE 15 --> 10.0525427 sigma out 1act.( 10.2411308 sig in 12act.) RANK 8 NODE 4 --> 8.90638447 sigma out 1act.( 7.22121048 sig in 12act.) RANK 9 NODE 3 --> 5.95410872 sigma out 1act.( 3.86525822 sig in 12act.) RANK 10 NODE 13 --> 5.04006672 sigma out 1act.( 4.98137665 sig in 12act.) RANK 11 NODE 1 --> 3.89377475 sigma out 1act.( 4.88959837 sig in 12act.) RANK 12 NODE 6 --> 3.35014224 sigma out 1act.( 2.21155429 sig in 12act.) RANK 13 NODE 7 --> 2.35056448 sigma out 1act.( 2.91788292 sig in 12act.) RANK 14 NODE 10 --> 0.75741595 sigma out 1act.( 1.06744385 sig in 12act.) RANK 15 NODE 12 --> 0.0299639013 sigma out 1act.( 1.9605453 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.6031342 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 34.3234634 sigma out 15 active outputs RANK 2 NODE 9 --> 28.0959148 sigma out 15 active outputs RANK 3 NODE 7 --> 25.1672173 sigma out 15 active outputs RANK 4 NODE 1 --> 21.3826694 sigma out 15 active outputs RANK 5 NODE 12 --> 19.4181309 sigma out 15 active outputs RANK 6 NODE 5 --> 19.1587925 sigma out 15 active outputs RANK 7 NODE 11 --> 17.9119892 sigma out 15 active outputs RANK 8 NODE 4 --> 13.6942377 sigma out 15 active outputs RANK 9 NODE 8 --> 13.198844 sigma out 15 active outputs RANK 10 NODE 10 --> 12.3948498 sigma out 15 active outputs RANK 11 NODE 6 --> 11.5554314 sigma out 15 active outputs RANK 12 NODE 3 --> 9.13232517 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 42.8706322 sigma in 12act. ( 38.073204 sig out 1act.) RANK 2 NODE 9 --> 35.3285675 sigma in 12act. ( 33.0169029 sig out 1act.) RANK 3 NODE 8 --> 20.6616173 sigma in 12act. ( 20.4031639 sig out 1act.) RANK 4 NODE 14 --> 18.7023926 sigma in 12act. ( 17.0894184 sig out 1act.) RANK 5 NODE 11 --> 12.5162868 sigma in 12act. ( 10.1497278 sig out 1act.) RANK 6 NODE 4 --> 11.5931587 sigma in 12act. ( 10.5456057 sig out 1act.) RANK 7 NODE 15 --> 11.5306664 sigma in 12act. ( 9.31248665 sig out 1act.) RANK 8 NODE 3 --> 11.3867922 sigma in 12act. ( 7.72461033 sig out 1act.) RANK 9 NODE 6 --> 10.8696833 sigma in 12act. ( 4.63801146 sig out 1act.) RANK 10 NODE 2 --> 10.3043823 sigma in 12act. ( 10.4572668 sig out 1act.) RANK 11 NODE 10 --> 7.9273591 sigma in 12act. ( 2.24350691 sig out 1act.) RANK 12 NODE 1 --> 7.64158869 sigma in 12act. ( 3.68574023 sig out 1act.) RANK 13 NODE 7 --> 6.15139055 sigma in 12act. ( 2.46466422 sig out 1act.) RANK 14 NODE 12 --> 5.36290216 sigma in 12act. ( 0.398496002 sig out 1act.) RANK 15 NODE 13 --> 5.17969036 sigma in 12act. ( 4.2913332 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 38.073204 sigma out 1act.( 42.8706322 sig in 12act.) RANK 2 NODE 9 --> 33.0169029 sigma out 1act.( 35.3285675 sig in 12act.) RANK 3 NODE 8 --> 20.4031639 sigma out 1act.( 20.6616173 sig in 12act.) RANK 4 NODE 14 --> 17.0894184 sigma out 1act.( 18.7023926 sig in 12act.) RANK 5 NODE 4 --> 10.5456057 sigma out 1act.( 11.5931587 sig in 12act.) RANK 6 NODE 2 --> 10.4572668 sigma out 1act.( 10.3043823 sig in 12act.) RANK 7 NODE 11 --> 10.1497278 sigma out 1act.( 12.5162868 sig in 12act.) RANK 8 NODE 15 --> 9.31248665 sigma out 1act.( 11.5306664 sig in 12act.) RANK 9 NODE 3 --> 7.72461033 sigma out 1act.( 11.3867922 sig in 12act.) RANK 10 NODE 6 --> 4.63801146 sigma out 1act.( 10.8696833 sig in 12act.) RANK 11 NODE 13 --> 4.2913332 sigma out 1act.( 5.17969036 sig in 12act.) RANK 12 NODE 1 --> 3.68574023 sigma out 1act.( 7.64158869 sig in 12act.) RANK 13 NODE 7 --> 2.46466422 sigma out 1act.( 6.15139055 sig in 12act.) RANK 14 NODE 10 --> 2.24350691 sigma out 1act.( 7.9273591 sig in 12act.) RANK 15 NODE 12 --> 0.398496002 sigma out 1act.( 5.36290216 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.5042572 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.45632869 *** contribution from regularisation: 0.00443260092 *** contribution from error: -0.460761279 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.491277516 *** contribution from regularisation: 0.00249174493 *** contribution from error: -0.493769258 *********************************************** -----------------> Test sample ENTER BFGS code START -45717.7648 0.121031709 -0.0631610602 EXIT FROM BFGS code FG_START 0. 0.121031709 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.505334556 *** contribution from regularisation: 0.00235596136 *** contribution from error: -0.507690489 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47016.3285 0.121031709 -230.592133 EXIT FROM BFGS code FG_LNSRCH 0. 0.0607980154 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.524099171 *** contribution from regularisation: 0.00296543352 *** contribution from error: -0.527064621 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48762.188 0.0607980154 -29.8520565 EXIT FROM BFGS code NEW_X -48762.188 0.0607980154 -29.8520565 ENTER BFGS code NEW_X -48762.188 0.0607980154 -29.8520565 EXIT FROM BFGS code FG_LNSRCH 0. 0.0557900555 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.526852906 *** contribution from regularisation: 0.00294241286 *** contribution from error: -0.529795289 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49018.3932 0.0557900555 -18.1858368 EXIT FROM BFGS code NEW_X -49018.3932 0.0557900555 -18.1858368 ENTER BFGS code NEW_X -49018.3932 0.0557900555 -18.1858368 EXIT FROM BFGS code FG_LNSRCH 0. 0.0493408069 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.527522266 *** contribution from regularisation: 0.0029438897 *** contribution from error: -0.530466139 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49080.6711 0.0493408069 -9.3478651 EXIT FROM BFGS code NEW_X -49080.6711 0.0493408069 -9.3478651 ENTER BFGS code NEW_X -49080.6711 0.0493408069 -9.3478651 EXIT FROM BFGS code FG_LNSRCH 0. 0.0376869068 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.52822274 *** contribution from regularisation: 0.00293164607 *** contribution from error: -0.531154394 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49145.8441 0.0376869068 3.20031452 EXIT FROM BFGS code NEW_X -49145.8441 0.0376869068 3.20031452 ENTER BFGS code NEW_X -49145.8441 0.0376869068 3.20031452 EXIT FROM BFGS code FG_LNSRCH 0. 0.0290920194 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.529005945 *** contribution from regularisation: 0.00293354574 *** contribution from error: -0.531939507 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49218.7137 0.0290920194 4.18189192 EXIT FROM BFGS code NEW_X -49218.7137 0.0290920194 4.18189192 ENTER BFGS code NEW_X -49218.7137 0.0290920194 4.18189192 EXIT FROM BFGS code FG_LNSRCH 0. -0.012803603 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.531624556 *** contribution from regularisation: 0.00305653759 *** contribution from error: -0.534681082 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49462.3459 -0.012803603 -0.37621516 EXIT FROM BFGS code NEW_X -49462.3459 -0.012803603 -0.37621516 ENTER BFGS code NEW_X -49462.3459 -0.012803603 -0.37621516 EXIT FROM BFGS code FG_LNSRCH 0. -0.04906803 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 48.0834961 sigma out 15 active outputs RANK 2 NODE 1 --> 33.3724403 sigma out 15 active outputs RANK 3 NODE 8 --> 21.16502 sigma out 15 active outputs RANK 4 NODE 10 --> 19.6626682 sigma out 15 active outputs RANK 5 NODE 11 --> 17.4886227 sigma out 15 active outputs RANK 6 NODE 9 --> 16.6199112 sigma out 15 active outputs RANK 7 NODE 7 --> 16.4144173 sigma out 15 active outputs RANK 8 NODE 3 --> 15.1106739 sigma out 15 active outputs RANK 9 NODE 5 --> 13.0326643 sigma out 15 active outputs RANK 10 NODE 6 --> 8.90678501 sigma out 15 active outputs RANK 11 NODE 4 --> 7.63069439 sigma out 15 active outputs RANK 12 NODE 12 --> 7.50988293 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 57.2015305 sigma in 12act. ( 51.2165794 sig out 1act.) RANK 2 NODE 9 --> 31.2496719 sigma in 12act. ( 32.4703445 sig out 1act.) RANK 3 NODE 3 --> 19.6679306 sigma in 12act. ( 20.2444897 sig out 1act.) RANK 4 NODE 8 --> 14.0092878 sigma in 12act. ( 11.2614555 sig out 1act.) RANK 5 NODE 10 --> 13.174799 sigma in 12act. ( 10.4984102 sig out 1act.) RANK 6 NODE 7 --> 11.7026396 sigma in 12act. ( 11.5536156 sig out 1act.) RANK 7 NODE 4 --> 11.1283789 sigma in 12act. ( 9.3419199 sig out 1act.) RANK 8 NODE 6 --> 10.8931971 sigma in 12act. ( 8.97228146 sig out 1act.) RANK 9 NODE 11 --> 9.36711311 sigma in 12act. ( 8.25334549 sig out 1act.) RANK 10 NODE 13 --> 7.56614828 sigma in 12act. ( 7.38582087 sig out 1act.) RANK 11 NODE 1 --> 6.75100517 sigma in 12act. ( 6.17804384 sig out 1act.) RANK 12 NODE 12 --> 6.66831875 sigma in 12act. ( 5.76853371 sig out 1act.) RANK 13 NODE 14 --> 6.31795025 sigma in 12act. ( 5.37650728 sig out 1act.) RANK 14 NODE 15 --> 5.56273317 sigma in 12act. ( 3.85563922 sig out 1act.) RANK 15 NODE 2 --> 3.66062427 sigma in 12act. ( 3.08804798 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 51.2165794 sigma out 1act.( 57.2015305 sig in 12act.) RANK 2 NODE 9 --> 32.4703445 sigma out 1act.( 31.2496719 sig in 12act.) RANK 3 NODE 3 --> 20.2444897 sigma out 1act.( 19.6679306 sig in 12act.) RANK 4 NODE 7 --> 11.5536156 sigma out 1act.( 11.7026396 sig in 12act.) RANK 5 NODE 8 --> 11.2614555 sigma out 1act.( 14.0092878 sig in 12act.) RANK 6 NODE 10 --> 10.4984102 sigma out 1act.( 13.174799 sig in 12act.) RANK 7 NODE 4 --> 9.3419199 sigma out 1act.( 11.1283789 sig in 12act.) RANK 8 NODE 6 --> 8.97228146 sigma out 1act.( 10.8931971 sig in 12act.) RANK 9 NODE 11 --> 8.25334549 sigma out 1act.( 9.36711311 sig in 12act.) RANK 10 NODE 13 --> 7.38582087 sigma out 1act.( 7.56614828 sig in 12act.) RANK 11 NODE 1 --> 6.17804384 sigma out 1act.( 6.75100517 sig in 12act.) RANK 12 NODE 12 --> 5.76853371 sigma out 1act.( 6.66831875 sig in 12act.) RANK 13 NODE 14 --> 5.37650728 sigma out 1act.( 6.31795025 sig in 12act.) RANK 14 NODE 15 --> 3.85563922 sigma out 1act.( 5.56273317 sig in 12act.) RANK 15 NODE 2 --> 3.08804798 sigma out 1act.( 3.66062427 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 69.8069992 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.530974209 *** contribution from regularisation: 0.00327700889 *** contribution from error: -0.534251213 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49401.8429 -0.04906803 40.029911 EXIT FROM BFGS code FG_LNSRCH 0. -0.0274183434 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.53234756 *** contribution from regularisation: 0.00304278824 *** contribution from error: -0.535390377 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49529.6154 -0.0274183434 6.27597713 EXIT FROM BFGS code NEW_X -49529.6154 -0.0274183434 6.27597713 ENTER BFGS code NEW_X -49529.6154 -0.0274183434 6.27597713 EXIT FROM BFGS code FG_LNSRCH 0. -0.0312979333 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.532644153 *** contribution from regularisation: 0.00321815466 *** contribution from error: -0.535862327 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49557.2118 -0.0312979333 6.01850653 EXIT FROM BFGS code NEW_X -49557.2118 -0.0312979333 6.01850653 ENTER BFGS code NEW_X -49557.2118 -0.0312979333 6.01850653 EXIT FROM BFGS code FG_LNSRCH 0. -0.0292840488 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.533053339 *** contribution from regularisation: 0.00321536767 *** contribution from error: -0.536268711 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49595.2806 -0.0292840488 3.60378957 EXIT FROM BFGS code NEW_X -49595.2806 -0.0292840488 3.60378957 ENTER BFGS code NEW_X -49595.2806 -0.0292840488 3.60378957 EXIT FROM BFGS code FG_LNSRCH 0. -0.0232981294 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.534124672 *** contribution from regularisation: 0.00333968829 *** contribution from error: -0.53746438 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49694.962 -0.0232981294 -5.9088335 EXIT FROM BFGS code NEW_X -49694.962 -0.0232981294 -5.9088335 ENTER BFGS code NEW_X -49694.962 -0.0232981294 -5.9088335 EXIT FROM BFGS code FG_LNSRCH 0. -0.0139512401 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.53150636 *** contribution from regularisation: 0.00417813007 *** contribution from error: -0.535684466 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49451.3542 -0.0139512401 -119.761223 EXIT FROM BFGS code FG_LNSRCH 0. -0.0203070473 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.535306036 *** contribution from regularisation: 0.00316990609 *** contribution from error: -0.538475931 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49804.8724 -0.0203070473 -18.5139751 EXIT FROM BFGS code NEW_X -49804.8724 -0.0203070473 -18.5139751 ENTER BFGS code NEW_X -49804.8724 -0.0203070473 -18.5139751 EXIT FROM BFGS code FG_LNSRCH 0. -0.0287345573 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.534116626 *** contribution from regularisation: 0.00410445221 *** contribution from error: -0.538221061 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49694.2092 -0.0287345573 15.6265612 EXIT FROM BFGS code FG_LNSRCH 0. -0.0227292236 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.535716116 *** contribution from regularisation: 0.00335663673 *** contribution from error: -0.539072752 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49843.0288 -0.0227292236 -9.50135708 EXIT FROM BFGS code NEW_X -49843.0288 -0.0227292236 -9.50135708 ENTER BFGS code NEW_X -49843.0288 -0.0227292236 -9.50135708 EXIT FROM BFGS code FG_LNSRCH 0. -0.02728929 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.535743713 *** contribution from regularisation: 0.00373362098 *** contribution from error: -0.539477348 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49845.5961 -0.02728929 2.3873744 EXIT FROM BFGS code NEW_X -49845.5961 -0.02728929 2.3873744 ENTER BFGS code NEW_X -49845.5961 -0.02728929 2.3873744 EXIT FROM BFGS code FG_LNSRCH 0. -0.0287012476 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 60.1163902 sigma out 15 active outputs RANK 2 NODE 1 --> 27.8075638 sigma out 15 active outputs RANK 3 NODE 11 --> 25.6769562 sigma out 15 active outputs RANK 4 NODE 7 --> 22.9608059 sigma out 15 active outputs RANK 5 NODE 8 --> 18.0781746 sigma out 15 active outputs RANK 6 NODE 9 --> 17.9781513 sigma out 15 active outputs RANK 7 NODE 3 --> 17.5847416 sigma out 15 active outputs RANK 8 NODE 4 --> 13.8179588 sigma out 15 active outputs RANK 9 NODE 10 --> 12.7977629 sigma out 15 active outputs RANK 10 NODE 5 --> 12.4964914 sigma out 15 active outputs RANK 11 NODE 12 --> 11.368597 sigma out 15 active outputs RANK 12 NODE 6 --> 10.1863317 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 64.1949921 sigma in 12act. ( 70.0092621 sig out 1act.) RANK 2 NODE 9 --> 32.4166832 sigma in 12act. ( 32.8053741 sig out 1act.) RANK 3 NODE 3 --> 24.3146553 sigma in 12act. ( 27.0270481 sig out 1act.) RANK 4 NODE 7 --> 16.8939419 sigma in 12act. ( 17.9287624 sig out 1act.) RANK 5 NODE 8 --> 13.8721857 sigma in 12act. ( 11.5292377 sig out 1act.) RANK 6 NODE 13 --> 13.7740641 sigma in 12act. ( 15.1701117 sig out 1act.) RANK 7 NODE 11 --> 13.5184994 sigma in 12act. ( 12.1412725 sig out 1act.) RANK 8 NODE 10 --> 12.6345863 sigma in 12act. ( 9.18679619 sig out 1act.) RANK 9 NODE 6 --> 12.3367758 sigma in 12act. ( 10.4791384 sig out 1act.) RANK 10 NODE 4 --> 10.5498219 sigma in 12act. ( 8.15250015 sig out 1act.) RANK 11 NODE 14 --> 8.06599522 sigma in 12act. ( 7.7707634 sig out 1act.) RANK 12 NODE 15 --> 7.45750332 sigma in 12act. ( 6.8909831 sig out 1act.) RANK 13 NODE 1 --> 7.25100565 sigma in 12act. ( 6.57650805 sig out 1act.) RANK 14 NODE 12 --> 7.23122168 sigma in 12act. ( 6.17381716 sig out 1act.) RANK 15 NODE 2 --> 3.8552177 sigma in 12act. ( 3.47334003 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 70.0092621 sigma out 1act.( 64.1949921 sig in 12act.) RANK 2 NODE 9 --> 32.8053741 sigma out 1act.( 32.4166832 sig in 12act.) RANK 3 NODE 3 --> 27.0270481 sigma out 1act.( 24.3146553 sig in 12act.) RANK 4 NODE 7 --> 17.9287624 sigma out 1act.( 16.8939419 sig in 12act.) RANK 5 NODE 13 --> 15.1701117 sigma out 1act.( 13.7740641 sig in 12act.) RANK 6 NODE 11 --> 12.1412725 sigma out 1act.( 13.5184994 sig in 12act.) RANK 7 NODE 8 --> 11.5292377 sigma out 1act.( 13.8721857 sig in 12act.) RANK 8 NODE 6 --> 10.4791384 sigma out 1act.( 12.3367758 sig in 12act.) RANK 9 NODE 10 --> 9.18679619 sigma out 1act.( 12.6345863 sig in 12act.) RANK 10 NODE 4 --> 8.15250015 sigma out 1act.( 10.5498219 sig in 12act.) RANK 11 NODE 14 --> 7.7707634 sigma out 1act.( 8.06599522 sig in 12act.) RANK 12 NODE 15 --> 6.8909831 sigma out 1act.( 7.45750332 sig in 12act.) RANK 13 NODE 1 --> 6.57650805 sigma out 1act.( 7.25100565 sig in 12act.) RANK 14 NODE 12 --> 6.17381716 sigma out 1act.( 7.23122168 sig in 12act.) RANK 15 NODE 2 --> 3.47334003 sigma out 1act.( 3.8552177 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 89.4529572 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.536104977 *** contribution from regularisation: 0.00351622654 *** contribution from error: -0.539621174 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49879.2081 -0.0287012476 27.3321629 EXIT FROM BFGS code NEW_X -49879.2081 -0.0287012476 27.3321629 ENTER BFGS code NEW_X -49879.2081 -0.0287012476 27.3321629 EXIT FROM BFGS code FG_LNSRCH 0. -0.0250064582 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.536185563 *** contribution from regularisation: 0.00359915383 *** contribution from error: -0.539784729 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49886.7057 -0.0250064582 11.5776129 EXIT FROM BFGS code NEW_X -49886.7057 -0.0250064582 11.5776129 ENTER BFGS code NEW_X -49886.7057 -0.0250064582 11.5776129 EXIT FROM BFGS code FG_LNSRCH 0. -0.0186414495 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.536463678 *** contribution from regularisation: 0.00359267229 *** contribution from error: -0.540056348 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49912.5803 -0.0186414495 -7.74142981 EXIT FROM BFGS code NEW_X -49912.5803 -0.0186414495 -7.74142981 ENTER BFGS code NEW_X -49912.5803 -0.0186414495 -7.74142981 EXIT FROM BFGS code FG_LNSRCH 0. -0.0116621545 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.536690295 *** contribution from regularisation: 0.00361397956 *** contribution from error: -0.540304303 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49933.6643 -0.0116621545 -22.1006718 EXIT FROM BFGS code NEW_X -49933.6643 -0.0116621545 -22.1006718 ENTER BFGS code NEW_X -49933.6643 -0.0116621545 -22.1006718 EXIT FROM BFGS code FG_LNSRCH 0. -0.00335789053 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.536908925 *** contribution from regularisation: 0.0036033392 *** contribution from error: -0.540512264 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49954.0048 -0.00335789053 -17.171257 EXIT FROM BFGS code NEW_X -49954.0048 -0.00335789053 -17.171257 ENTER BFGS code NEW_X -49954.0048 -0.00335789053 -17.171257 EXIT FROM BFGS code FG_LNSRCH 0. 6.76124546E-05 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.537058473 *** contribution from regularisation: 0.00364802452 *** contribution from error: -0.540706515 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49967.9199 6.76124546E-05 -7.74656868 EXIT FROM BFGS code NEW_X -49967.9199 6.76124546E-05 -7.74656868 ENTER BFGS code NEW_X -49967.9199 6.76124546E-05 -7.74656868 EXIT FROM BFGS code FG_LNSRCH 0. -0.0015920602 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.537093222 *** contribution from regularisation: 0.00368014467 *** contribution from error: -0.540773392 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49971.1524 -0.0015920602 5.41567135 EXIT FROM BFGS code NEW_X -49971.1524 -0.0015920602 5.41567135 ENTER BFGS code NEW_X -49971.1524 -0.0015920602 5.41567135 EXIT FROM BFGS code FG_LNSRCH 0. -0.000394031813 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.537198007 *** contribution from regularisation: 0.00363594736 *** contribution from error: -0.54083395 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49980.9013 -0.000394031813 13.3194189 EXIT FROM BFGS code NEW_X -49980.9013 -0.000394031813 13.3194189 ENTER BFGS code NEW_X -49980.9013 -0.000394031813 13.3194189 EXIT FROM BFGS code FG_LNSRCH 0. 0.00697515439 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.537479281 *** contribution from regularisation: 0.00346551393 *** contribution from error: -0.540944815 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50007.071 0.00697515439 24.0244255 EXIT FROM BFGS code NEW_X -50007.071 0.00697515439 24.0244255 ENTER BFGS code NEW_X -50007.071 0.00697515439 24.0244255 EXIT FROM BFGS code FG_LNSRCH 0. 0.0213192049 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.53764075 *** contribution from regularisation: 0.00341049256 *** contribution from error: -0.541051269 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50022.0956 0.0213192049 30.161726 EXIT FROM BFGS code NEW_X -50022.0956 0.0213192049 30.161726 ENTER BFGS code NEW_X -50022.0956 0.0213192049 30.161726 EXIT FROM BFGS code FG_LNSRCH 0. 0.0521277674 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 91.8969116 sigma out 15 active outputs RANK 2 NODE 1 --> 39.0762596 sigma out 15 active outputs RANK 3 NODE 7 --> 29.0613823 sigma out 15 active outputs RANK 4 NODE 9 --> 28.4679031 sigma out 15 active outputs RANK 5 NODE 3 --> 28.3809166 sigma out 15 active outputs RANK 6 NODE 4 --> 22.6413212 sigma out 15 active outputs RANK 7 NODE 11 --> 20.0722656 sigma out 15 active outputs RANK 8 NODE 12 --> 19.8327446 sigma out 15 active outputs RANK 9 NODE 6 --> 19.3660622 sigma out 15 active outputs RANK 10 NODE 8 --> 17.6831589 sigma out 15 active outputs RANK 11 NODE 10 --> 16.6191006 sigma out 15 active outputs RANK 12 NODE 5 --> 13.7850389 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 98.894043 sigma in 12act. ( 108.418518 sig out 1act.) RANK 2 NODE 9 --> 40.654995 sigma in 12act. ( 42.8384171 sig out 1act.) RANK 3 NODE 3 --> 36.2234993 sigma in 12act. ( 36.2159882 sig out 1act.) RANK 4 NODE 7 --> 26.523859 sigma in 12act. ( 29.8485889 sig out 1act.) RANK 5 NODE 13 --> 19.2975388 sigma in 12act. ( 22.3139458 sig out 1act.) RANK 6 NODE 11 --> 18.0144672 sigma in 12act. ( 17.4640884 sig out 1act.) RANK 7 NODE 1 --> 10.9304171 sigma in 12act. ( 10.7581596 sig out 1act.) RANK 8 NODE 10 --> 10.9213934 sigma in 12act. ( 9.19661427 sig out 1act.) RANK 9 NODE 14 --> 10.510788 sigma in 12act. ( 11.1665754 sig out 1act.) RANK 10 NODE 12 --> 10.3413191 sigma in 12act. ( 10.8854198 sig out 1act.) RANK 11 NODE 6 --> 9.6362505 sigma in 12act. ( 7.61980963 sig out 1act.) RANK 12 NODE 15 --> 9.02714634 sigma in 12act. ( 9.76931477 sig out 1act.) RANK 13 NODE 8 --> 6.84285259 sigma in 12act. ( 5.15797091 sig out 1act.) RANK 14 NODE 4 --> 6.11938047 sigma in 12act. ( 4.12981939 sig out 1act.) RANK 15 NODE 2 --> 5.92126656 sigma in 12act. ( 5.99153852 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 108.418518 sigma out 1act.( 98.894043 sig in 12act.) RANK 2 NODE 9 --> 42.8384171 sigma out 1act.( 40.654995 sig in 12act.) RANK 3 NODE 3 --> 36.2159882 sigma out 1act.( 36.2234993 sig in 12act.) RANK 4 NODE 7 --> 29.8485889 sigma out 1act.( 26.523859 sig in 12act.) RANK 5 NODE 13 --> 22.3139458 sigma out 1act.( 19.2975388 sig in 12act.) RANK 6 NODE 11 --> 17.4640884 sigma out 1act.( 18.0144672 sig in 12act.) RANK 7 NODE 14 --> 11.1665754 sigma out 1act.( 10.510788 sig in 12act.) RANK 8 NODE 12 --> 10.8854198 sigma out 1act.( 10.3413191 sig in 12act.) RANK 9 NODE 1 --> 10.7581596 sigma out 1act.( 10.9304171 sig in 12act.) RANK 10 NODE 15 --> 9.76931477 sigma out 1act.( 9.02714634 sig in 12act.) RANK 11 NODE 10 --> 9.19661427 sigma out 1act.( 10.9213934 sig in 12act.) RANK 12 NODE 6 --> 7.61980963 sigma out 1act.( 9.6362505 sig in 12act.) RANK 13 NODE 2 --> 5.99153852 sigma out 1act.( 5.92126656 sig in 12act.) RANK 14 NODE 8 --> 5.15797091 sigma out 1act.( 6.84285259 sig in 12act.) RANK 15 NODE 4 --> 4.12981939 sigma out 1act.( 6.11938047 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 131.421875 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.535702229 *** contribution from regularisation: 0.00343740638 *** contribution from error: -0.539139628 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49841.7353 0.0521277674 -100.839783 EXIT FROM BFGS code FG_LNSRCH 0. 0.0252707899 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.53704983 *** contribution from regularisation: 0.00404678378 *** contribution from error: -0.541096628 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49967.1165 0.0252707899 17.2289619 EXIT FROM BFGS code FG_LNSRCH 0. 0.0214357115 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.537353814 *** contribution from regularisation: 0.00369963679 *** contribution from error: -0.541053474 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49995.3969 0.0214357115 29.8697643 EXIT FROM BFGS code FG_LNSRCH 0. 0.0213194396 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.537345648 *** contribution from regularisation: 0.00370562868 *** contribution from error: -0.541051269 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49994.6377 0.0213194396 30.2578373 EXIT FROM BFGS code FG_LNSRCH 0. 0.0213192049 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.537359834 *** contribution from regularisation: 0.00369141996 *** contribution from error: -0.541051269 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49995.9582 0.0213192049 30.2512722 EXIT FROM BFGS code FG_LNSRCH 0. 0.0213192049 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.537340224 *** contribution from regularisation: 0.00371101499 *** contribution from error: -0.541051209 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49994.135 0.0213192049 30.2665558 EXIT FROM BFGS code FG_LNSRCH 0. 0.0213192049 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.537348092 *** contribution from regularisation: 0.00370312552 *** contribution from error: -0.541051209 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49994.8691 0.0213192049 30.2729549 EXIT FROM BFGS code NEW_X -49994.8691 0.0213192049 30.2729549 ENTER BFGS code NEW_X -49994.8691 0.0213192049 30.2729549 EXIT FROM BFGS code CONVERGENC -49994.8691 0.0213192049 30.2729549 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 127.935913 sigma out 15 active outputs RANK 2 NODE 1 --> 52.1121521 sigma out 15 active outputs RANK 3 NODE 7 --> 43.1671753 sigma out 15 active outputs RANK 4 NODE 3 --> 40.1747208 sigma out 15 active outputs RANK 5 NODE 9 --> 35.0089073 sigma out 15 active outputs RANK 6 NODE 8 --> 31.327076 sigma out 15 active outputs RANK 7 NODE 11 --> 30.9982433 sigma out 15 active outputs RANK 8 NODE 4 --> 28.6924953 sigma out 15 active outputs RANK 9 NODE 12 --> 23.6083679 sigma out 15 active outputs RANK 10 NODE 10 --> 23.1501102 sigma out 15 active outputs RANK 11 NODE 5 --> 21.4717255 sigma out 15 active outputs RANK 12 NODE 6 --> 20.466877 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 134.056824 sigma in 12act. ( 156.779648 sig out 1act.) RANK 2 NODE 9 --> 58.6406021 sigma in 12act. ( 61.3797874 sig out 1act.) RANK 3 NODE 3 --> 50.8918571 sigma in 12act. ( 54.8322945 sig out 1act.) RANK 4 NODE 7 --> 36.899025 sigma in 12act. ( 41.7475433 sig out 1act.) RANK 5 NODE 13 --> 27.5913067 sigma in 12act. ( 32.1738167 sig out 1act.) RANK 6 NODE 11 --> 26.1390018 sigma in 12act. ( 26.2203579 sig out 1act.) RANK 7 NODE 10 --> 17.6207886 sigma in 12act. ( 14.4909363 sig out 1act.) RANK 8 NODE 6 --> 16.6683235 sigma in 12act. ( 14.6090956 sig out 1act.) RANK 9 NODE 14 --> 15.2380896 sigma in 12act. ( 16.331007 sig out 1act.) RANK 10 NODE 1 --> 14.3608913 sigma in 12act. ( 14.0458689 sig out 1act.) RANK 11 NODE 12 --> 14.1963139 sigma in 12act. ( 14.4352512 sig out 1act.) RANK 12 NODE 8 --> 12.6582727 sigma in 12act. ( 9.74701977 sig out 1act.) RANK 13 NODE 15 --> 12.2722225 sigma in 12act. ( 13.026824 sig out 1act.) RANK 14 NODE 4 --> 11.1693869 sigma in 12act. ( 8.91284752 sig out 1act.) RANK 15 NODE 2 --> 7.42745924 sigma in 12act. ( 7.5005374 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 156.779648 sigma out 1act.( 134.056824 sig in 12act.) RANK 2 NODE 9 --> 61.3797874 sigma out 1act.( 58.6406021 sig in 12act.) RANK 3 NODE 3 --> 54.8322945 sigma out 1act.( 50.8918571 sig in 12act.) RANK 4 NODE 7 --> 41.7475433 sigma out 1act.( 36.899025 sig in 12act.) RANK 5 NODE 13 --> 32.1738167 sigma out 1act.( 27.5913067 sig in 12act.) RANK 6 NODE 11 --> 26.2203579 sigma out 1act.( 26.1390018 sig in 12act.) RANK 7 NODE 14 --> 16.331007 sigma out 1act.( 15.2380896 sig in 12act.) RANK 8 NODE 6 --> 14.6090956 sigma out 1act.( 16.6683235 sig in 12act.) RANK 9 NODE 10 --> 14.4909363 sigma out 1act.( 17.6207886 sig in 12act.) RANK 10 NODE 12 --> 14.4352512 sigma out 1act.( 14.1963139 sig in 12act.) RANK 11 NODE 1 --> 14.0458689 sigma out 1act.( 14.3608913 sig in 12act.) RANK 12 NODE 15 --> 13.026824 sigma out 1act.( 12.2722225 sig in 12act.) RANK 13 NODE 8 --> 9.74701977 sigma out 1act.( 12.6582727 sig in 12act.) RANK 14 NODE 4 --> 8.91284752 sigma out 1act.( 11.1693869 sig in 12act.) RANK 15 NODE 2 --> 7.5005374 sigma out 1act.( 7.42745924 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 190.566574 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.537351787 *** contribution from regularisation: 0.00369945471 *** contribution from error: -0.541051269 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29884 Closing output file done