NNInput NNInputs_120.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 182566 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 46230 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 46230 Chosen entries: 46230 Signal fraction: 1 Background fraction: 0.339089 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 46230 Entries to split: 46230 Test with : 23115 Train with : 23115 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 46230 for Signal Prepared event 0 for Signal with 46230 events ====Entry 0 Variable Ht : 156.497 Variable LepAPt : 24.4462 Variable LepBPt : 15.2546 Variable MetSigLeptonsJets : 4.03888 Variable MetSpec : 26.0087 Variable SumEtLeptonsJets : 113.473 Variable VSumJetLeptonsPt : 37.0367 Variable addEt : 82.7245 Variable dPhiLepSumMet : 0.85328 Variable dPhiLeptons : 0.330941 Variable dRLeptons : 0.538617 Variable lep1_E : 30.9903 Variable lep2_E : 15.9065 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2120 Ht = 156.497 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 24.4462 LepAPt = 24.4462 LepBEt = 15.2546 LepBPt = 15.2546 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 43.0236 MetDelPhi = 0.649165 MetSig = 3.00203 MetSigLeptonsJets = 4.03888 MetSpec = 26.0087 Mjj = 0 MostCentralJetEta = -1.64867 MtllMet = 86.7807 Njets = 1 SB = 0 SumEt = 205.392 SumEtJets = 0 SumEtLeptonsJets = 113.473 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 37.0367 addEt = 82.7245 dPhiLepSumMet = 0.85328 dPhiLeptons = 0.330941 dRLeptons = 0.538617 diltype = 45 dimass = 10.4324 event = 71 jet1_Et = 73.7722 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 30.9903 lep2_E = 15.9065 rand = 0.999742 run = 232428 weight = 1.10299e-06 ===Show End Prepared event 10000 for Signal with 46230 events Prepared event 20000 for Signal with 46230 events Prepared event 30000 for Signal with 46230 events Prepared event 40000 for Signal with 46230 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.33649 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4373 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 182566 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4373 negative weights. Signal fraction: 62.8775101 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.03479 65.3924637 66.8709564 68.019371 68.9819946 70.1345673 71.1356812 71.8654327 72.6427002 73.4886627 74.210968 74.8551788 75.5144348 76.2209854 76.8684006 77.4430389 78.1173706 78.6878281 79.2854004 79.7868118 80.4680481 80.9618073 81.4955139 82.1744232 82.8064423 83.4333496 84.1803284 85.0749359 85.9426041 86.8226318 87.779007 88.6323853 89.300705 90.2434387 91.1982727 92.0216675 92.9602509 93.7003479 94.7321854 95.6179886 96.5897522 97.5302277 98.3693542 99.2708435 100.152649 101.007607 101.839661 102.628448 103.544098 104.17691 105.019714 105.899094 106.824959 107.810051 108.618134 109.45536 110.383217 111.35009 112.234436 113.152893 114.020096 115.063919 116.189964 117.244568 118.339645 119.576172 120.827118 122.256332 123.664581 125.368195 127.015495 128.500168 130.26268 132.216797 133.927856 135.863525 137.799988 139.748306 141.797974 144.084229 146.283997 148.316681 150.938156 153.565216 156.497711 159.882019 163.438995 167.225586 171.455139 175.752426 180.945282 186.383606 193.113037 201.080093 209.606689 223.161133 239.438065 267.002625 320.819611 893.967896 ------------------------------ Transdef: Tab for variable 3 20.0009289 20.3129234 20.5788612 20.8738937 21.1224365 21.3642387 21.602562 21.8633766 22.0521126 22.249754 22.4256821 22.6034451 22.8160915 23.0154839 23.2082634 23.3367119 23.5385437 23.7398396 23.940918 24.1578522 24.3649788 24.5546589 24.734169 24.9194908 25.107563 25.2914314 25.4777756 25.686018 25.8602867 26.0539494 26.1997147 26.4053288 26.6196327 26.8167229 27.0396805 27.2259598 27.4547386 27.6545563 27.8746681 28.0929909 28.2682114 28.4704323 28.6632881 28.8381119 29.0510941 29.2382336 29.4619331 29.6691895 29.8693428 30.0836601 30.3240376 30.5457172 30.7486019 30.9927139 31.2359333 31.4887104 31.7300758 31.9616776 32.2158165 32.4649811 32.7138176 32.9862595 33.2394638 33.5359802 33.8068008 34.0748291 34.3243484 34.6018829 34.903904 35.249649 35.588356 35.8967247 36.253315 36.665638 37.0218048 37.3969841 37.7516594 38.1499023 38.5773621 39.0113831 39.4863968 39.9519119 40.4581833 40.8137054 41.3387146 41.932518 42.5796585 43.3151245 44.0552139 44.9333649 45.8432388 46.8781509 48.0172234 49.4740448 51.0415955 53.064003 55.7454376 59.3319855 63.8409958 72.3202133 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0000496 10.1046791 10.2291317 10.3283272 10.4308653 10.5044451 10.5998516 10.701684 10.7953577 10.8973522 10.9992132 11.0940399 11.2017689 11.3006897 11.4060259 11.5023232 11.6059113 11.7100601 11.8030996 11.9116011 12.0230541 12.1306925 12.2463923 12.3376207 12.4492607 12.5703735 12.6904764 12.8191662 12.9375992 13.0537825 13.1908102 13.3221684 13.4506702 13.5648794 13.6698761 13.797389 13.9150028 14.028326 14.1593304 14.3146095 14.4394684 14.5754776 14.7091522 14.8510761 14.9955711 15.148015 15.2727432 15.4216537 15.567894 15.7255201 15.8583126 15.992198 16.1686115 16.3389206 16.4700699 16.6257858 16.7683182 16.928257 17.1022568 17.3014317 17.4847355 17.6649208 17.8496628 17.9862728 18.1577644 18.3507309 18.5552998 18.7464333 18.9699135 19.1941681 19.4204445 19.6675911 19.8913269 20.1143456 20.2835884 20.4573536 20.6683731 20.8844814 21.1196423 21.3677578 21.6248817 21.8850193 22.1402931 22.4412212 22.7548409 23.0654297 23.3651695 23.7407913 24.1461449 24.5919304 25.0682335 25.5473976 26.0901737 26.6638298 27.2832928 28.0193176 29.0814209 30.4968739 32.4815063 36.1434746 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.0228225 2.40985107 2.76298499 3.03782582 3.27464008 3.4749825 3.6664958 3.81376576 3.97047901 4.08409834 4.18319225 4.27936172 4.37221813 4.45749903 4.54749775 4.63090611 4.70116949 4.77825594 4.83467197 4.90865135 4.9819355 5.03595734 5.09582806 5.15066767 5.2057066 5.25752401 5.3059063 5.3550005 5.40062428 5.44857502 5.49466658 5.52442551 5.56994438 5.61692619 5.66149139 5.70812988 5.74905014 5.78969049 5.83375597 5.87252331 5.91802073 5.95731831 5.99758673 6.0308156 6.07082748 6.10823059 6.14806843 6.18780279 6.21970749 6.25783062 6.28360748 6.32204247 6.35660553 6.39681625 6.43673325 6.47295856 6.50961924 6.55286312 6.59786034 6.63793182 6.6715498 6.71197891 6.74690056 6.78392601 6.82136774 6.8574276 6.89435959 6.9379673 6.9736948 7.01597214 7.05894566 7.1072669 7.15520334 7.19919109 7.24209213 7.29059029 7.33255148 7.38328743 7.43114853 7.4821949 7.52824497 7.58038712 7.63564825 7.6994853 7.76619816 7.83231306 7.89552307 7.96858406 8.05079556 8.12767506 8.21116638 8.30679321 8.41364861 8.53660965 8.67433739 8.84539223 9.04731941 9.33078384 9.72983932 10.6604004 18.5645885 ------------------------------ Transdef: Tab for variable 6 15.0050735 19.2627544 23.8060799 25.6501122 26.508934 27.3402023 28.1701279 28.9242935 29.5077362 30.1612797 30.7518463 31.2988491 31.8521538 32.2972107 32.7900658 33.2304688 33.6102219 34.0214157 34.4517555 34.7867165 35.1491699 35.5436935 35.901329 36.2185707 36.5864677 36.9414215 37.2350311 37.5762329 37.8502007 38.1597214 38.4549751 38.7963638 39.1627579 39.4703712 39.7611313 40.0681992 40.3493271 40.676506 40.984623 41.2799149 41.6494598 41.975853 42.3251343 42.606102 42.9545898 43.1964493 43.5561523 43.9210739 44.2401581 44.6150436 45.0226974 45.365509 45.7861557 46.2084618 46.6231956 47.037674 47.4634666 47.8859138 48.2226028 48.6116257 49.0279312 49.4316788 49.8557167 50.2507248 50.6416473 51.0400391 51.5043869 51.9475327 52.3879013 52.9053192 53.332489 53.845459 54.2991714 54.8216934 55.3079224 55.7708588 56.2217216 56.7058182 57.1683273 57.6853485 58.2494583 58.8989792 59.602726 60.3122482 61.1195335 61.8671303 62.7334328 63.7120667 64.786499 65.9770203 67.2587128 68.7273102 70.2424622 72.13237 74.2965012 76.7138824 78.9122772 82.8110199 88.3730621 98.6632538 250.623764 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.6796036 33.5823288 34.4131737 34.8942871 35.4061317 35.8607712 36.3376884 36.7390556 37.0797234 37.4665985 37.7676811 38.0870514 38.3993378 38.6926193 38.9610367 39.2528687 39.5549507 39.8637047 40.1370773 40.3878326 40.6677856 40.9770584 41.3077164 41.6358185 41.9758148 42.3113632 42.6739197 43.0753174 43.4733047 43.9574471 44.4897156 44.8432159 45.1631393 45.6040955 46.081768 46.6441422 47.2357407 47.8038712 48.2930527 48.8419266 49.3028183 49.8792114 50.4415741 50.9595337 51.5500031 52.0721283 52.6035919 53.1081429 53.6826363 54.2706757 54.8652496 55.4662971 56.0032654 56.6722565 57.3019791 57.9944038 58.6661835 59.3900681 60.2227478 61.0036545 61.7408104 62.6794548 63.7256851 64.8708191 65.9943542 67.2270508 68.5440826 69.7317276 70.9341125 72.1460648 73.3900833 74.5978851 76.0239105 77.5262604 78.8870621 80.4682159 82.1844635 84.0959625 86.0416794 88.0101547 90.2025986 92.3052063 94.5970612 97.043808 99.6060028 102.208717 105.251701 108.44812 112.028481 116.166069 120.649216 125.358444 131.029877 138.277863 147.372253 157.977295 170.377899 191.582352 228.102905 521.871643 ------------------------------ Transdef: Tab for variable 8 2.18757391 20.6868019 25.8518448 28.5397549 30.2671013 31.3719482 32.1793289 32.8054657 33.315567 33.8280296 34.2167435 34.5225487 34.899437 35.223774 35.5513611 35.8741989 36.1496391 36.4757729 36.7507858 37.0454025 37.3261108 37.5997849 37.8315811 38.0568542 38.3010979 38.5786285 38.789711 38.9968719 39.2456245 39.4530144 39.7082558 39.9235535 40.1865692 40.4598923 40.7337341 41.0210838 41.3078156 41.5797729 41.8690033 42.2079201 42.5444908 42.8588028 43.1689682 43.4782677 43.8132858 44.1788406 44.4337692 44.7950363 45.1175079 45.4923477 45.8713799 46.290596 46.6669693 47.0468521 47.4609604 47.8502769 48.1808853 48.4909668 48.8652573 49.2517471 49.6433182 50.0345535 50.4570236 50.8777695 51.2732315 51.6772919 52.0673141 52.4885025 52.9251785 53.2799606 53.7412109 54.1547089 54.6327972 55.120079 55.6074638 56.1116409 56.6808929 57.1997604 57.7964172 58.3216476 58.9347229 59.5958023 60.3547897 61.0658722 61.8652725 62.8324471 63.7831573 64.8841553 66.0135803 67.2446136 68.7024384 70.259697 72.1124115 74.2394638 76.9216156 79.5880432 83.5112152 88.7459259 97.1128235 116.530807 406.55069 ------------------------------ Transdef: Tab for variable 9 49.4992676 62.325985 64.4803925 66.0898438 67.2040405 68.1716766 69.0003281 70.0190125 70.8920593 71.552002 72.2764435 72.9747009 73.6786499 74.3009186 74.8626099 75.394455 75.9555206 76.5211945 77.0594635 77.5561066 78.0995331 78.5820618 79.0693283 79.5936127 80.0308685 80.5677109 80.9726562 81.4357452 81.9650345 82.506897 83.0412598 83.553566 84.0727997 84.7573776 85.4255753 86.1682053 86.6898041 87.2995605 88.0305634 88.6386719 89.2211685 89.880722 90.5901108 91.2516861 91.8615875 92.5186157 93.0914612 93.8177109 94.5918427 95.3547058 95.966301 96.6208115 97.2867355 97.9954071 98.600441 99.2865448 99.9900513 100.721161 101.338844 101.956696 102.609535 103.313675 103.955505 104.623352 105.233292 105.861359 106.481361 107.243683 107.875664 108.557236 109.204712 109.919647 110.555359 111.269592 111.896637 112.620148 113.295837 114.031548 114.724091 115.508293 116.433548 117.249146 118.090225 118.985184 119.928726 120.871689 122.050415 123.153008 124.584473 126.113838 127.962288 129.988602 132.289612 134.908691 138.5242 143.017365 148.134979 155.188751 166.927109 193.647797 446.331207 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.740862608 1.07284164 1.27871406 1.45372295 1.59571862 1.71200633 1.80576611 1.88975549 1.97278333 2.04560375 2.10728264 2.16075277 2.21232176 2.26220298 2.30645514 2.3508563 2.39143562 2.42799044 2.46057367 2.49214125 2.52141571 2.54881644 2.58097601 2.60966682 2.63312793 2.65736341 2.68118286 2.70328045 2.72572255 2.74602413 2.76404381 2.77892804 2.79544973 2.80889559 2.8243742 2.83908987 2.85071087 2.86223888 2.8736639 2.88414383 2.89401984 2.90211248 2.91152334 2.91874409 2.92597055 2.93355823 2.94198155 2.94945431 2.95636272 2.96290207 2.9686017 2.97505093 2.98016167 2.98566771 2.99086523 2.99482799 3.00089788 3.00540209 3.01049304 3.014678 3.01922655 3.02361727 3.02825308 3.03223991 3.03573656 3.03988123 3.04333591 3.04725981 3.05088615 3.05526233 3.05861378 3.06239986 3.06603885 3.06911993 3.07248759 3.0758791 3.07892966 3.08206701 3.08468246 3.08801413 3.09135437 3.09431553 3.09716082 3.09982467 3.10288286 3.10561228 3.10834813 3.11084318 3.11318445 3.11590385 3.11859393 3.12129092 3.12410903 3.12665224 3.12910175 3.13169765 3.1338625 3.13630152 3.13883448 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00672109146 0.0120255947 0.0198182948 0.0271741208 0.0355296135 0.0433238745 0.052182436 0.0607780814 0.069316864 0.0785725117 0.0865559578 0.0948028564 0.102593184 0.110985994 0.119045019 0.127895355 0.136891603 0.145244122 0.153920591 0.161485225 0.169320971 0.176673651 0.184120059 0.191715181 0.199121833 0.206138313 0.212876171 0.220091194 0.226743221 0.232635021 0.238555685 0.245034814 0.251414001 0.258262217 0.263238847 0.269216537 0.275334299 0.281764925 0.288025737 0.293265164 0.298906982 0.304676771 0.310899496 0.316524804 0.323075533 0.329498529 0.335149884 0.341389775 0.347473264 0.352746725 0.358326137 0.363671899 0.369066358 0.375149131 0.381180406 0.386186063 0.390719295 0.396788299 0.40224129 0.408750594 0.414343119 0.419915885 0.425477505 0.430760384 0.437126637 0.441624403 0.447440803 0.453962147 0.459988832 0.46560806 0.473171473 0.479015231 0.485172331 0.492693901 0.500745773 0.507365584 0.514270246 0.521100163 0.528782368 0.535010815 0.540272355 0.549075842 0.557521462 0.566777229 0.577251434 0.5857265 0.596040487 0.607223868 0.618237257 0.631846249 0.64391005 0.656805456 0.670470953 0.68943584 0.708341837 0.731088281 0.75820756 0.79746604 0.848661184 1.1246134 ------------------------------ Transdef: Tab for variable 12 0.200070545 0.226792663 0.246262416 0.259147644 0.272306323 0.284397364 0.294914603 0.304203182 0.313410759 0.322268724 0.33068949 0.338774204 0.346410751 0.352179468 0.358256698 0.365453601 0.372172892 0.37889114 0.385427654 0.392005026 0.397302866 0.402006924 0.406969905 0.411599666 0.415926635 0.420300841 0.425288141 0.42938602 0.433603346 0.437765628 0.44182986 0.445802629 0.450121999 0.454806447 0.458566666 0.462638915 0.467141151 0.470926642 0.474480003 0.478236079 0.482038766 0.485718876 0.489894629 0.493577182 0.497326732 0.500803351 0.504662871 0.508494854 0.512324214 0.516074419 0.51996851 0.523741245 0.528145015 0.53217268 0.536788642 0.541212916 0.54569447 0.548247039 0.552484274 0.556962609 0.560347438 0.564894557 0.569629014 0.574088573 0.579055071 0.583930552 0.588276267 0.592977524 0.597537935 0.602663577 0.607931972 0.613487422 0.618591666 0.623557448 0.629788995 0.63615948 0.643036544 0.648917854 0.655885458 0.662349463 0.667782724 0.674302936 0.679999053 0.68758285 0.694153607 0.70204258 0.709296107 0.717556655 0.726353526 0.7354846 0.744863033 0.754368424 0.765891671 0.778863549 0.791949272 0.808522344 0.826592922 0.846247673 0.87258935 0.915789902 1.13453126 ------------------------------ Transdef: Tab for variable 13 20.0361443 21.4054413 22.083416 22.66782 23.29603 23.7552509 24.2308865 24.644228 25.0830688 25.4934788 25.8420715 26.1842041 26.5778599 26.9965649 27.3668194 27.6888657 28.052845 28.3644524 28.647047 28.9530716 29.2625256 29.5638714 29.8307838 30.1618671 30.4542656 30.6793365 30.9420624 31.2529068 31.5680599 31.8533516 32.1288338 32.3990784 32.6668663 32.9564133 33.2836685 33.5783958 33.901619 34.2338829 34.4296417 34.7198792 35.0156174 35.340374 35.6165771 35.9539375 36.2136307 36.5119553 36.8679276 37.2442474 37.5841293 37.91679 38.2557831 38.6192245 38.9750214 39.3887367 39.7274742 40.1365204 40.5869713 40.9555511 41.3512268 41.7926407 42.2555504 42.6990814 43.0750732 43.5254135 44.0398788 44.5314789 45.1134949 45.6752129 46.2966766 46.8100128 47.3753204 47.9305725 48.6100922 49.2737198 49.9843063 50.8080254 51.5792007 52.4059029 53.2394714 54.1064415 54.9521408 55.8694153 56.8693848 58.0104828 59.0068893 60.235878 61.620018 63.1061096 64.5865784 66.1643372 67.7640686 69.0997391 71.2416382 73.4539185 76.6705551 80.1350937 84.0441589 88.7801971 94.5287781 105.366852 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.5590744 10.9017687 11.1752319 11.4212341 11.677599 11.8760576 12.114377 12.3180332 12.5151367 12.7474365 12.9529667 13.1610126 13.3539276 13.5690327 13.747468 13.9394264 14.1442108 14.3486443 14.5308666 14.7181158 14.8996029 15.0952482 15.2766485 15.4804373 15.6650276 15.8626003 16.0532379 16.2807388 16.4752388 16.661438 16.8332329 17.0214996 17.2369595 17.4765854 17.6890163 17.8939629 18.0996819 18.2802849 18.5098419 18.6962051 18.8889923 19.093399 19.3279419 19.5452843 19.7760334 19.9893246 20.2044182 20.4413033 20.638504 20.856781 21.071291 21.2812653 21.5105133 21.7328911 21.9344444 22.1669502 22.404295 22.6582031 22.8800659 23.1346054 23.3666611 23.6140842 23.9055023 24.1854877 24.4507866 24.7126694 25.0169754 25.3544312 25.6668549 25.9651909 26.3144302 26.6327934 26.9815254 27.2924995 27.6417046 27.9612503 28.2463779 28.6345901 29.0787354 29.4952087 29.9714928 30.4810638 31.0378113 31.5443268 32.1079979 32.8532181 33.5436859 34.3275528 35.0962677 36.0604706 37.1253891 38.492363 39.8498688 40.6998978 42.5332947 44.3141632 47.2739182 51.3610001 57.9214172 128.659836 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 50.7 36.0 27.1 3.4 27.9 49.5 33.3 45.3 -28.8 -8.6 -18.9 4.5 -1.9 2 50.7 100.0 62.7 44.6 14.5 56.7 94.0 61.9 89.3 -53.5 -19.8 -40.1 30.7 16.7 3 36.0 62.7 100.0 21.6 -7.0 23.1 65.9 44.4 68.8 -20.5 -19.9 -44.9 63.9 3.2 4 27.1 44.6 21.6 100.0 -3.4 18.5 46.8 33.7 49.1 -14.3 -25.2 -49.2 7.3 67.4 5 3.4 14.5 -7.0 -3.4 100.0 79.5 -13.2 43.7 42.9 28.4 1.3 5.0 -10.7 -7.0 6 27.9 56.7 23.1 18.5 79.5 100.0 34.0 69.9 73.7 -4.2 -8.7 -15.1 5.4 2.7 7 49.5 94.0 65.9 46.8 -13.2 34.0 100.0 55.3 76.6 -59.8 -19.1 -41.2 34.9 19.9 8 33.3 61.9 44.4 33.7 43.7 69.9 55.3 100.0 74.8 -11.3 -17.1 -30.6 21.4 13.9 9 45.3 89.3 68.8 49.1 42.9 73.7 76.6 74.8 100.0 -27.4 -22.1 -45.4 35.9 20.7 10 -28.8 -53.5 -20.5 -14.3 28.4 -4.2 -59.8 -11.3 -27.4 100.0 4.4 11.2 -7.5 -3.2 11 -8.6 -19.8 -19.9 -25.2 1.3 -8.7 -19.1 -17.1 -22.1 4.4 100.0 54.7 -8.6 -16.2 12 -18.9 -40.1 -44.9 -49.2 5.0 -15.1 -41.2 -30.6 -45.4 11.2 54.7 100.0 -21.9 -24.6 13 4.5 30.7 63.9 7.3 -10.7 5.4 34.9 21.4 35.9 -7.5 -8.6 -21.9 100.0 37.0 14 -1.9 16.7 3.2 67.4 -7.0 2.7 19.9 13.9 20.7 -3.2 -16.2 -24.6 37.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 110.855776 TOTAL CORRELATION OF ALL VARIABLES 56.2523028 ROUND 1: MAX CORR ( 56.2514388) AFTER KILLING INPUT VARIABLE 11 CONTR 0.311775381 ROUND 2: MAX CORR ( 56.2480452) AFTER KILLING INPUT VARIABLE 7 CONTR 0.617875905 ROUND 3: MAX CORR ( 56.2413715) AFTER KILLING INPUT VARIABLE 5 CONTR 0.866446124 ROUND 4: MAX CORR ( 56.1685954) AFTER KILLING INPUT VARIABLE 8 CONTR 2.86020191 ROUND 5: MAX CORR ( 56.0963334) AFTER KILLING INPUT VARIABLE 10 CONTR 2.84824343 ROUND 6: MAX CORR ( 55.8505787) AFTER KILLING INPUT VARIABLE 6 CONTR 5.24513898 ROUND 7: MAX CORR ( 55.702871) AFTER KILLING INPUT VARIABLE 9 CONTR 4.05922351 ROUND 8: MAX CORR ( 55.1570311) AFTER KILLING INPUT VARIABLE 13 CONTR 7.77893086 ROUND 9: MAX CORR ( 54.6778801) AFTER KILLING INPUT VARIABLE 3 CONTR 7.25448167 ROUND 10: MAX CORR ( 54.3950492) AFTER KILLING INPUT VARIABLE 12 CONTR 5.55420535 ROUND 11: MAX CORR ( 51.821353) AFTER KILLING INPUT VARIABLE 4 CONTR 16.5338668 ROUND 12: MAX CORR ( 50.746064) AFTER KILLING INPUT VARIABLE 14 CONTR 10.5018862 LAST REMAINING VARIABLE: 2 total correlation to target: 56.2523028 % total significance: 108.139078 sigma correlations of single variables to target: variable 2: 50.746064 % , in sigma: 97.5539188 variable 3: 35.9524917 % , in sigma: 69.1148472 variable 4: 27.1238943 % , in sigma: 52.1428063 variable 5: 3.42876181 % , in sigma: 6.59143045 variable 6: 27.8788712 % , in sigma: 53.5941691 variable 7: 49.491934 % , in sigma: 95.1429872 variable 8: 33.3353775 % , in sigma: 64.0837231 variable 9: 45.3151675 % , in sigma: 87.113597 variable 10: -28.7874323 % , in sigma: 55.3407814 variable 11: -8.60848517 % , in sigma: 16.5488985 variable 12: -18.8688405 % , in sigma: 36.2733419 variable 13: 4.47656861 % , in sigma: 8.60572774 variable 14: -1.87255875 % , in sigma: 3.59979534 variables sorted by significance: 1 most relevant variable 2 corr 50.7460632 , in sigma: 97.5539174 2 most relevant variable 14 corr 10.5018864 , in sigma: 20.1887613 3 most relevant variable 4 corr 16.5338669 , in sigma: 31.7846032 4 most relevant variable 12 corr 5.55420542 , in sigma: 10.6773701 5 most relevant variable 3 corr 7.25448179 , in sigma: 13.9459708 6 most relevant variable 13 corr 7.77893066 , in sigma: 14.9541681 7 most relevant variable 9 corr 4.05922365 , in sigma: 7.80342638 8 most relevant variable 6 corr 5.24513912 , in sigma: 10.0832229 9 most relevant variable 10 corr 2.84824347 , in sigma: 5.4754456 10 most relevant variable 8 corr 2.86020184 , in sigma: 5.49843428 11 most relevant variable 5 corr 0.866446137 , in sigma: 1.66565068 12 most relevant variable 7 corr 0.617875934 , in sigma: 1.18780086 13 most relevant variable 11 corr 0.311775386 , in sigma: 0.59935507 global correlations between input variables: variable 2: 99.0036605 % variable 3: 93.7656738 % variable 4: 89.8320761 % variable 5: 94.6255761 % variable 6: 93.0188212 % variable 7: 98.5040386 % variable 8: 84.7413526 % variable 9: 98.7555191 % variable 10: 72.3802019 % variable 11: 55.9712384 % variable 12: 72.5176829 % variable 13: 84.1621455 % variable 14: 85.8083809 % significance loss when removing single variables: variable 2: corr = 6.57218194 % , sigma = 12.6343218 variable 3: corr = 10.0433052 % , sigma = 19.3071877 variable 4: corr = 11.7114644 % , sigma = 22.5140465 variable 5: corr = 1.01636964 % , sigma = 1.9538627 variable 6: corr = 4.2544828 % , sigma = 8.17879136 variable 7: corr = 0.594363448 % , sigma = 1.14260061 variable 8: corr = 2.58424616 % , sigma = 4.96793881 variable 9: corr = 4.06441703 % , sigma = 7.8134101 variable 10: corr = 2.72899812 % , sigma = 5.24620908 variable 11: corr = 0.311775381 % , sigma = 0.599355059 variable 12: corr = 6.72098996 % , sigma = 12.9203894 variable 13: corr = 7.54029995 % , sigma = 14.4954259 variable 14: corr = 8.4014165 % , sigma = 16.150831 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 22.5278587 sigma out 15 active outputs RANK 2 NODE 5 --> 19.0206795 sigma out 15 active outputs RANK 3 NODE 1 --> 17.3448544 sigma out 15 active outputs RANK 4 NODE 9 --> 17.084343 sigma out 15 active outputs RANK 5 NODE 3 --> 16.652462 sigma out 15 active outputs RANK 6 NODE 4 --> 16.6510201 sigma out 15 active outputs RANK 7 NODE 8 --> 14.4709511 sigma out 15 active outputs RANK 8 NODE 2 --> 12.6139727 sigma out 15 active outputs RANK 9 NODE 11 --> 11.861248 sigma out 15 active outputs RANK 10 NODE 7 --> 11.4444275 sigma out 15 active outputs RANK 11 NODE 6 --> 8.64699936 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 30.9942207 sigma in 11act. ( 31.8536682 sig out 1act.) RANK 2 NODE 10 --> 22.2931194 sigma in 11act. ( 22.5902519 sig out 1act.) RANK 3 NODE 2 --> 16.0575447 sigma in 11act. ( 18.2022629 sig out 1act.) RANK 4 NODE 13 --> 13.9578772 sigma in 11act. ( 10.5532265 sig out 1act.) RANK 5 NODE 8 --> 13.6855745 sigma in 11act. ( 13.7059174 sig out 1act.) RANK 6 NODE 7 --> 13.2978468 sigma in 11act. ( 11.2037992 sig out 1act.) RANK 7 NODE 11 --> 10.0443287 sigma in 11act. ( 7.88321304 sig out 1act.) RANK 8 NODE 15 --> 9.64919376 sigma in 11act. ( 9.88799667 sig out 1act.) RANK 9 NODE 6 --> 8.49811935 sigma in 11act. ( 7.67510271 sig out 1act.) RANK 10 NODE 12 --> 6.94677925 sigma in 11act. ( 7.00698662 sig out 1act.) RANK 11 NODE 1 --> 6.77443409 sigma in 11act. ( 5.36957693 sig out 1act.) RANK 12 NODE 9 --> 5.98226738 sigma in 11act. ( 5.752985 sig out 1act.) RANK 13 NODE 3 --> 5.42065573 sigma in 11act. ( 4.55312634 sig out 1act.) RANK 14 NODE 4 --> 5.02523565 sigma in 11act. ( 3.9481616 sig out 1act.) RANK 15 NODE 5 --> 2.51356578 sigma in 11act. ( 2.43011642 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 31.8536682 sigma out 1act.( 30.9942207 sig in 11act.) RANK 2 NODE 10 --> 22.5902519 sigma out 1act.( 22.2931194 sig in 11act.) RANK 3 NODE 2 --> 18.2022629 sigma out 1act.( 16.0575447 sig in 11act.) RANK 4 NODE 8 --> 13.7059174 sigma out 1act.( 13.6855745 sig in 11act.) RANK 5 NODE 7 --> 11.2037992 sigma out 1act.( 13.2978468 sig in 11act.) RANK 6 NODE 13 --> 10.5532265 sigma out 1act.( 13.9578772 sig in 11act.) RANK 7 NODE 15 --> 9.88799667 sigma out 1act.( 9.64919376 sig in 11act.) RANK 8 NODE 11 --> 7.88321304 sigma out 1act.( 10.0443287 sig in 11act.) RANK 9 NODE 6 --> 7.67510271 sigma out 1act.( 8.49811935 sig in 11act.) RANK 10 NODE 12 --> 7.00698662 sigma out 1act.( 6.94677925 sig in 11act.) RANK 11 NODE 9 --> 5.752985 sigma out 1act.( 5.98226738 sig in 11act.) RANK 12 NODE 1 --> 5.36957693 sigma out 1act.( 6.77443409 sig in 11act.) RANK 13 NODE 3 --> 4.55312634 sigma out 1act.( 5.42065573 sig in 11act.) RANK 14 NODE 4 --> 3.9481616 sigma out 1act.( 5.02523565 sig in 11act.) RANK 15 NODE 5 --> 2.43011642 sigma out 1act.( 2.51356578 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 51.5084648 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 23.5966969 sigma out 15 active outputs RANK 2 NODE 5 --> 19.7771244 sigma out 15 active outputs RANK 3 NODE 9 --> 18.1315536 sigma out 15 active outputs RANK 4 NODE 4 --> 17.8285179 sigma out 15 active outputs RANK 5 NODE 3 --> 17.4414883 sigma out 15 active outputs RANK 6 NODE 8 --> 16.3268604 sigma out 15 active outputs RANK 7 NODE 2 --> 15.8505545 sigma out 15 active outputs RANK 8 NODE 1 --> 15.0345039 sigma out 15 active outputs RANK 9 NODE 11 --> 12.4094439 sigma out 15 active outputs RANK 10 NODE 7 --> 11.8228874 sigma out 15 active outputs RANK 11 NODE 6 --> 8.82424355 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 31.9372635 sigma in 11act. ( 31.458416 sig out 1act.) RANK 2 NODE 10 --> 21.1232166 sigma in 11act. ( 22.0837631 sig out 1act.) RANK 3 NODE 2 --> 20.3752232 sigma in 11act. ( 19.0765038 sig out 1act.) RANK 4 NODE 8 --> 14.813241 sigma in 11act. ( 13.7193928 sig out 1act.) RANK 5 NODE 15 --> 11.5854921 sigma in 11act. ( 9.73355865 sig out 1act.) RANK 6 NODE 13 --> 10.9441843 sigma in 11act. ( 9.14637089 sig out 1act.) RANK 7 NODE 7 --> 10.8215046 sigma in 11act. ( 9.91802216 sig out 1act.) RANK 8 NODE 6 --> 10.3517408 sigma in 11act. ( 7.42843533 sig out 1act.) RANK 9 NODE 4 --> 9.14228153 sigma in 11act. ( 4.1255765 sig out 1act.) RANK 10 NODE 11 --> 8.85804367 sigma in 11act. ( 7.31183243 sig out 1act.) RANK 11 NODE 9 --> 8.22667217 sigma in 11act. ( 5.63167858 sig out 1act.) RANK 12 NODE 12 --> 8.1157608 sigma in 11act. ( 6.76652145 sig out 1act.) RANK 13 NODE 5 --> 7.2588172 sigma in 11act. ( 3.47066021 sig out 1act.) RANK 14 NODE 1 --> 7.13461828 sigma in 11act. ( 4.84667444 sig out 1act.) RANK 15 NODE 3 --> 6.00267935 sigma in 11act. ( 4.00939703 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 31.458416 sigma out 1act.( 31.9372635 sig in 11act.) RANK 2 NODE 10 --> 22.0837631 sigma out 1act.( 21.1232166 sig in 11act.) RANK 3 NODE 2 --> 19.0765038 sigma out 1act.( 20.3752232 sig in 11act.) RANK 4 NODE 8 --> 13.7193928 sigma out 1act.( 14.813241 sig in 11act.) RANK 5 NODE 7 --> 9.91802216 sigma out 1act.( 10.8215046 sig in 11act.) RANK 6 NODE 15 --> 9.73355865 sigma out 1act.( 11.5854921 sig in 11act.) RANK 7 NODE 13 --> 9.14637089 sigma out 1act.( 10.9441843 sig in 11act.) RANK 8 NODE 6 --> 7.42843533 sigma out 1act.( 10.3517408 sig in 11act.) RANK 9 NODE 11 --> 7.31183243 sigma out 1act.( 8.85804367 sig in 11act.) RANK 10 NODE 12 --> 6.76652145 sigma out 1act.( 8.1157608 sig in 11act.) RANK 11 NODE 9 --> 5.63167858 sigma out 1act.( 8.22667217 sig in 11act.) RANK 12 NODE 1 --> 4.84667444 sigma out 1act.( 7.13461828 sig in 11act.) RANK 13 NODE 4 --> 4.1255765 sigma out 1act.( 9.14228153 sig in 11act.) RANK 14 NODE 3 --> 4.00939703 sigma out 1act.( 6.00267935 sig in 11act.) RANK 15 NODE 5 --> 3.47066021 sigma out 1act.( 7.2588172 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 50.6063461 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.41175887 *** contribution from regularisation: 0.00385802961 *** contribution from error: -0.4156169 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.443386137 *** contribution from regularisation: 0.00248664292 *** contribution from error: -0.445872784 *********************************************** -----------------> Test sample ENTER BFGS code START -40482.7445 0.387001127 0.456578463 EXIT FROM BFGS code FG_START 0. 0.387001127 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.46347335 *** contribution from regularisation: 0.00197924837 *** contribution from error: -0.465452611 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -42307.2388 0.387001127 351.630554 EXIT FROM BFGS code FG_LNSRCH 0. 0.474206775 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.492798954 *** contribution from regularisation: 0.00295006298 *** contribution from error: -0.495749027 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -44984.168 0.474206775 -54.3006897 EXIT FROM BFGS code NEW_X -44984.168 0.474206775 -54.3006897 ENTER BFGS code NEW_X -44984.168 0.474206775 -54.3006897 EXIT FROM BFGS code FG_LNSRCH 0. 0.476920843 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.498784751 *** contribution from regularisation: 0.00321474322 *** contribution from error: -0.501999497 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45530.5689 0.476920843 0.354227006 EXIT FROM BFGS code NEW_X -45530.5689 0.476920843 0.354227006 ENTER BFGS code NEW_X -45530.5689 0.476920843 0.354227006 EXIT FROM BFGS code FG_LNSRCH 0. 0.483726621 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.499689341 *** contribution from regularisation: 0.00309640239 *** contribution from error: -0.502785742 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45613.1411 0.483726621 2.08268881 EXIT FROM BFGS code NEW_X -45613.1411 0.483726621 2.08268881 ENTER BFGS code NEW_X -45613.1411 0.483726621 2.08268881 EXIT FROM BFGS code FG_LNSRCH 0. 0.490704268 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.500329554 *** contribution from regularisation: 0.0030147424 *** contribution from error: -0.503344297 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45671.5844 0.490704268 -1.57848096 EXIT FROM BFGS code NEW_X -45671.5844 0.490704268 -1.57848096 ENTER BFGS code NEW_X -45671.5844 0.490704268 -1.57848096 EXIT FROM BFGS code FG_LNSRCH 0. 0.496754527 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.501374841 *** contribution from regularisation: 0.00290033431 *** contribution from error: -0.504275203 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45766.9992 0.496754527 -5.66335821 EXIT FROM BFGS code NEW_X -45766.9992 0.496754527 -5.66335821 ENTER BFGS code NEW_X -45766.9992 0.496754527 -5.66335821 EXIT FROM BFGS code FG_LNSRCH 0. 0.507805943 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.503658652 *** contribution from regularisation: 0.00315823709 *** contribution from error: -0.506816864 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45975.4712 0.507805943 6.14476776 EXIT FROM BFGS code NEW_X -45975.4712 0.507805943 6.14476776 ENTER BFGS code NEW_X -45975.4712 0.507805943 6.14476776 EXIT FROM BFGS code FG_LNSRCH 0. 0.537366509 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 39.7969818 sigma out 15 active outputs RANK 2 NODE 1 --> 29.111311 sigma out 15 active outputs RANK 3 NODE 10 --> 27.8360863 sigma out 15 active outputs RANK 4 NODE 8 --> 25.2652187 sigma out 15 active outputs RANK 5 NODE 5 --> 20.393013 sigma out 15 active outputs RANK 6 NODE 11 --> 18.244545 sigma out 15 active outputs RANK 7 NODE 3 --> 17.1201 sigma out 15 active outputs RANK 8 NODE 7 --> 16.9822979 sigma out 15 active outputs RANK 9 NODE 9 --> 14.6516008 sigma out 15 active outputs RANK 10 NODE 6 --> 12.3944597 sigma out 15 active outputs RANK 11 NODE 4 --> 7.81925964 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 37.2875137 sigma in 11act. ( 36.5417709 sig out 1act.) RANK 2 NODE 2 --> 35.9603691 sigma in 11act. ( 25.2801476 sig out 1act.) RANK 3 NODE 15 --> 26.8403397 sigma in 11act. ( 29.715601 sig out 1act.) RANK 4 NODE 5 --> 23.6291904 sigma in 11act. ( 24.3602066 sig out 1act.) RANK 5 NODE 8 --> 23.0077858 sigma in 11act. ( 25.2904663 sig out 1act.) RANK 6 NODE 10 --> 19.4713573 sigma in 11act. ( 16.9584751 sig out 1act.) RANK 7 NODE 4 --> 18.9410858 sigma in 11act. ( 18.4122887 sig out 1act.) RANK 8 NODE 12 --> 12.0549974 sigma in 11act. ( 9.15712643 sig out 1act.) RANK 9 NODE 7 --> 9.16384983 sigma in 11act. ( 8.22848129 sig out 1act.) RANK 10 NODE 11 --> 7.85281515 sigma in 11act. ( 7.60231972 sig out 1act.) RANK 11 NODE 6 --> 5.35918856 sigma in 11act. ( 0.00690734759 sig out 1act.) RANK 12 NODE 13 --> 4.5398798 sigma in 11act. ( 2.75109196 sig out 1act.) RANK 13 NODE 9 --> 3.55562663 sigma in 11act. ( 1.67171133 sig out 1act.) RANK 14 NODE 3 --> 3.32895255 sigma in 11act. ( 1.31244886 sig out 1act.) RANK 15 NODE 1 --> 3.25378561 sigma in 11act. ( 2.01455855 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 36.5417709 sigma out 1act.( 37.2875137 sig in 11act.) RANK 2 NODE 15 --> 29.715601 sigma out 1act.( 26.8403397 sig in 11act.) RANK 3 NODE 8 --> 25.2904663 sigma out 1act.( 23.0077858 sig in 11act.) RANK 4 NODE 2 --> 25.2801476 sigma out 1act.( 35.9603691 sig in 11act.) RANK 5 NODE 5 --> 24.3602066 sigma out 1act.( 23.6291904 sig in 11act.) RANK 6 NODE 4 --> 18.4122887 sigma out 1act.( 18.9410858 sig in 11act.) RANK 7 NODE 10 --> 16.9584751 sigma out 1act.( 19.4713573 sig in 11act.) RANK 8 NODE 12 --> 9.15712643 sigma out 1act.( 12.0549974 sig in 11act.) RANK 9 NODE 7 --> 8.22848129 sigma out 1act.( 9.16384983 sig in 11act.) RANK 10 NODE 11 --> 7.60231972 sigma out 1act.( 7.85281515 sig in 11act.) RANK 11 NODE 13 --> 2.75109196 sigma out 1act.( 4.5398798 sig in 11act.) RANK 12 NODE 1 --> 2.01455855 sigma out 1act.( 3.25378561 sig in 11act.) RANK 13 NODE 9 --> 1.67171133 sigma out 1act.( 3.55562663 sig in 11act.) RANK 14 NODE 3 --> 1.31244886 sigma out 1act.( 3.32895255 sig in 11act.) RANK 15 NODE 6 --> 0.00690734759 sigma out 1act.( 5.35918856 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 70.303154 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.506760001 *** contribution from regularisation: 0.00338841206 *** contribution from error: -0.510148406 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -46258.5717 0.537366509 -115.968849 EXIT FROM BFGS code NEW_X -46258.5717 0.537366509 -115.968849 ENTER BFGS code NEW_X -46258.5717 0.537366509 -115.968849 EXIT FROM BFGS code FG_LNSRCH 0. 0.516521513 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.507982194 *** contribution from regularisation: 0.00364304846 *** contribution from error: -0.51162523 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46370.1363 0.516521513 -8.02806759 EXIT FROM BFGS code FG_LNSRCH 0. 0.526508451 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.509349167 *** contribution from regularisation: 0.00234981393 *** contribution from error: -0.511698961 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46494.9218 0.526508451 -55.1977577 EXIT FROM BFGS code NEW_X -46494.9218 0.526508451 -55.1977577 ENTER BFGS code NEW_X -46494.9218 0.526508451 -55.1977577 EXIT FROM BFGS code FG_LNSRCH 0. 0.504857898 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.509654403 *** contribution from regularisation: 0.00296302233 *** contribution from error: -0.512617409 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46522.7815 0.504857898 -21.3337498 EXIT FROM BFGS code NEW_X -46522.7815 0.504857898 -21.3337498 ENTER BFGS code NEW_X -46522.7815 0.504857898 -21.3337498 EXIT FROM BFGS code FG_LNSRCH 0. 0.462442219 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.511234701 *** contribution from regularisation: 0.00297274976 *** contribution from error: -0.514207423 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46667.036 0.462442219 9.60169315 EXIT FROM BFGS code NEW_X -46667.036 0.462442219 9.60169315 ENTER BFGS code NEW_X -46667.036 0.462442219 9.60169315 EXIT FROM BFGS code FG_LNSRCH 0. 0.340957701 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.513687372 *** contribution from regularisation: 0.00340035325 *** contribution from error: -0.517087698 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46890.9246 0.340957701 56.2970772 EXIT FROM BFGS code NEW_X -46890.9246 0.340957701 56.2970772 ENTER BFGS code NEW_X -46890.9246 0.340957701 56.2970772 EXIT FROM BFGS code FG_LNSRCH 0. 0.260386169 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.511847675 *** contribution from regularisation: 0.00341797178 *** contribution from error: -0.515265644 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46722.9915 0.260386169 -83.2235947 EXIT FROM BFGS code FG_LNSRCH 0. 0.31483379 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.515066266 *** contribution from regularisation: 0.00284024654 *** contribution from error: -0.517906487 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47016.7926 0.31483379 -5.82066631 EXIT FROM BFGS code NEW_X -47016.7926 0.31483379 -5.82066631 ENTER BFGS code NEW_X -47016.7926 0.31483379 -5.82066631 EXIT FROM BFGS code FG_LNSRCH 0. 0.306369483 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.515559852 *** contribution from regularisation: 0.00302566984 *** contribution from error: -0.518585503 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47061.8524 0.306369483 -41.0224876 EXIT FROM BFGS code NEW_X -47061.8524 0.306369483 -41.0224876 ENTER BFGS code NEW_X -47061.8524 0.306369483 -41.0224876 EXIT FROM BFGS code FG_LNSRCH 0. 0.292527467 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.515876293 *** contribution from regularisation: 0.00297971489 *** contribution from error: -0.518855989 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47090.7376 0.292527467 -40.0520973 EXIT FROM BFGS code NEW_X -47090.7376 0.292527467 -40.0520973 ENTER BFGS code NEW_X -47090.7376 0.292527467 -40.0520973 EXIT FROM BFGS code FG_LNSRCH 0. 0.258007973 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 67.5024109 sigma out 15 active outputs RANK 2 NODE 10 --> 31.9428082 sigma out 15 active outputs RANK 3 NODE 8 --> 30.4766178 sigma out 15 active outputs RANK 4 NODE 1 --> 30.0114613 sigma out 15 active outputs RANK 5 NODE 3 --> 29.7434635 sigma out 15 active outputs RANK 6 NODE 7 --> 26.6453724 sigma out 15 active outputs RANK 7 NODE 5 --> 20.5124264 sigma out 15 active outputs RANK 8 NODE 9 --> 18.7053814 sigma out 15 active outputs RANK 9 NODE 11 --> 18.0287056 sigma out 15 active outputs RANK 10 NODE 4 --> 15.753685 sigma out 15 active outputs RANK 11 NODE 6 --> 12.273551 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 65.2758713 sigma in 11act. ( 84.6686096 sig out 1act.) RANK 2 NODE 4 --> 40.7320557 sigma in 11act. ( 46.3308868 sig out 1act.) RANK 3 NODE 15 --> 38.2316666 sigma in 11act. ( 42.5108948 sig out 1act.) RANK 4 NODE 8 --> 37.5701752 sigma in 11act. ( 46.0761032 sig out 1act.) RANK 5 NODE 10 --> 23.7287102 sigma in 11act. ( 21.5432987 sig out 1act.) RANK 6 NODE 2 --> 19.0214481 sigma in 11act. ( 17.3863621 sig out 1act.) RANK 7 NODE 5 --> 17.7803555 sigma in 11act. ( 17.6071606 sig out 1act.) RANK 8 NODE 7 --> 16.1623688 sigma in 11act. ( 18.1367874 sig out 1act.) RANK 9 NODE 11 --> 8.63527966 sigma in 11act. ( 9.10869408 sig out 1act.) RANK 10 NODE 12 --> 6.0682025 sigma in 11act. ( 3.30001187 sig out 1act.) RANK 11 NODE 9 --> 5.50601721 sigma in 11act. ( 5.6636076 sig out 1act.) RANK 12 NODE 1 --> 4.68985844 sigma in 11act. ( 4.87840366 sig out 1act.) RANK 13 NODE 6 --> 4.03871441 sigma in 11act. ( 0.86243403 sig out 1act.) RANK 14 NODE 13 --> 3.94528151 sigma in 11act. ( 3.45336819 sig out 1act.) RANK 15 NODE 3 --> 2.13498998 sigma in 11act. ( 0.914394557 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 84.6686096 sigma out 1act.( 65.2758713 sig in 11act.) RANK 2 NODE 4 --> 46.3308868 sigma out 1act.( 40.7320557 sig in 11act.) RANK 3 NODE 8 --> 46.0761032 sigma out 1act.( 37.5701752 sig in 11act.) RANK 4 NODE 15 --> 42.5108948 sigma out 1act.( 38.2316666 sig in 11act.) RANK 5 NODE 10 --> 21.5432987 sigma out 1act.( 23.7287102 sig in 11act.) RANK 6 NODE 7 --> 18.1367874 sigma out 1act.( 16.1623688 sig in 11act.) RANK 7 NODE 5 --> 17.6071606 sigma out 1act.( 17.7803555 sig in 11act.) RANK 8 NODE 2 --> 17.3863621 sigma out 1act.( 19.0214481 sig in 11act.) RANK 9 NODE 11 --> 9.10869408 sigma out 1act.( 8.63527966 sig in 11act.) RANK 10 NODE 9 --> 5.6636076 sigma out 1act.( 5.50601721 sig in 11act.) RANK 11 NODE 1 --> 4.87840366 sigma out 1act.( 4.68985844 sig in 11act.) RANK 12 NODE 13 --> 3.45336819 sigma out 1act.( 3.94528151 sig in 11act.) RANK 13 NODE 12 --> 3.30001187 sigma out 1act.( 6.0682025 sig in 11act.) RANK 14 NODE 3 --> 0.914394557 sigma out 1act.( 2.13498998 sig in 11act.) RANK 15 NODE 6 --> 0.86243403 sigma out 1act.( 4.03871441 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 121.713196 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.516164601 *** contribution from regularisation: 0.00297894189 *** contribution from error: -0.519143522 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47117.0518 0.258007973 -36.5699043 EXIT FROM BFGS code NEW_X -47117.0518 0.258007973 -36.5699043 ENTER BFGS code NEW_X -47117.0518 0.258007973 -36.5699043 EXIT FROM BFGS code FG_LNSRCH 0. 0.204890862 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.516497195 *** contribution from regularisation: 0.00301537965 *** contribution from error: -0.519512594 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47147.4114 0.204890862 -20.122963 EXIT FROM BFGS code NEW_X -47147.4114 0.204890862 -20.122963 ENTER BFGS code NEW_X -47147.4114 0.204890862 -20.122963 EXIT FROM BFGS code FG_LNSRCH 0. 0.130211323 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.516815603 *** contribution from regularisation: 0.00310045201 *** contribution from error: -0.519916058 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47176.4799 0.130211323 -19.1054153 EXIT FROM BFGS code NEW_X -47176.4799 0.130211323 -19.1054153 ENTER BFGS code NEW_X -47176.4799 0.130211323 -19.1054153 EXIT FROM BFGS code FG_LNSRCH 0. 0.0681401193 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.516741812 *** contribution from regularisation: 0.00322320219 *** contribution from error: -0.519964993 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47169.7432 0.0681401193 -38.8572655 EXIT FROM BFGS code FG_LNSRCH 0. 0.105669841 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.516833305 *** contribution from regularisation: 0.00327302259 *** contribution from error: -0.520106316 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47178.0963 0.105669841 -28.061573 EXIT FROM BFGS code NEW_X -47178.0963 0.105669841 -28.061573 ENTER BFGS code NEW_X -47178.0963 0.105669841 -28.061573 EXIT FROM BFGS code FG_LNSRCH 0. 0.0731595606 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.517125905 *** contribution from regularisation: 0.00324404542 *** contribution from error: -0.520369947 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47204.8055 0.0731595606 -26.5381451 EXIT FROM BFGS code NEW_X -47204.8055 0.0731595606 -26.5381451 ENTER BFGS code NEW_X -47204.8055 0.0731595606 -26.5381451 EXIT FROM BFGS code FG_LNSRCH 0. -0.0308337808 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.517725587 *** contribution from regularisation: 0.00330624916 *** contribution from error: -0.521031857 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47259.5471 -0.0308337808 -15.0368872 EXIT FROM BFGS code NEW_X -47259.5471 -0.0308337808 -15.0368872 ENTER BFGS code NEW_X -47259.5471 -0.0308337808 -15.0368872 EXIT FROM BFGS code FG_LNSRCH 0. -0.195645541 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.517713904 *** contribution from regularisation: 0.00348220393 *** contribution from error: -0.521196127 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47258.4774 -0.195645541 58.3038406 EXIT FROM BFGS code FG_LNSRCH 0. -0.113997675 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.518096924 *** contribution from regularisation: 0.00336422375 *** contribution from error: -0.521461129 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47293.4434 -0.113997675 13.8293753 EXIT FROM BFGS code NEW_X -47293.4434 -0.113997675 13.8293753 ENTER BFGS code NEW_X -47293.4434 -0.113997675 13.8293753 EXIT FROM BFGS code FG_LNSRCH 0. -0.174289092 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.518490493 *** contribution from regularisation: 0.00343026966 *** contribution from error: -0.521920741 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47329.3656 -0.174289092 3.89956069 EXIT FROM BFGS code NEW_X -47329.3656 -0.174289092 3.89956069 ENTER BFGS code NEW_X -47329.3656 -0.174289092 3.89956069 EXIT FROM BFGS code FG_LNSRCH 0. -0.190998927 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 79.8527451 sigma out 15 active outputs RANK 2 NODE 1 --> 48.722683 sigma out 15 active outputs RANK 3 NODE 10 --> 39.9848366 sigma out 15 active outputs RANK 4 NODE 3 --> 37.4130325 sigma out 15 active outputs RANK 5 NODE 8 --> 37.2024689 sigma out 15 active outputs RANK 6 NODE 7 --> 30.6916122 sigma out 15 active outputs RANK 7 NODE 6 --> 25.3776188 sigma out 15 active outputs RANK 8 NODE 9 --> 23.5913582 sigma out 15 active outputs RANK 9 NODE 5 --> 22.8835125 sigma out 15 active outputs RANK 10 NODE 4 --> 22.3084087 sigma out 15 active outputs RANK 11 NODE 11 --> 16.3009472 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 67.6251526 sigma in 11act. ( 98.9651108 sig out 1act.) RANK 2 NODE 4 --> 60.7498169 sigma in 11act. ( 68.6054459 sig out 1act.) RANK 3 NODE 8 --> 48.6679649 sigma in 11act. ( 50.0666504 sig out 1act.) RANK 4 NODE 10 --> 41.9663277 sigma in 11act. ( 41.0111542 sig out 1act.) RANK 5 NODE 15 --> 38.9742661 sigma in 11act. ( 38.651104 sig out 1act.) RANK 6 NODE 5 --> 29.9391632 sigma in 11act. ( 30.5237675 sig out 1act.) RANK 7 NODE 7 --> 25.6805019 sigma in 11act. ( 31.6790352 sig out 1act.) RANK 8 NODE 2 --> 19.0682049 sigma in 11act. ( 18.7189026 sig out 1act.) RANK 9 NODE 11 --> 19.0674992 sigma in 11act. ( 21.6471272 sig out 1act.) RANK 10 NODE 9 --> 12.5993118 sigma in 11act. ( 13.7804785 sig out 1act.) RANK 11 NODE 13 --> 9.73806667 sigma in 11act. ( 10.2186604 sig out 1act.) RANK 12 NODE 1 --> 8.24346161 sigma in 11act. ( 8.89538002 sig out 1act.) RANK 13 NODE 12 --> 4.73695469 sigma in 11act. ( 2.43353701 sig out 1act.) RANK 14 NODE 3 --> 3.56264019 sigma in 11act. ( 3.23551726 sig out 1act.) RANK 15 NODE 6 --> 3.22396135 sigma in 11act. ( 0.714379549 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 98.9651108 sigma out 1act.( 67.6251526 sig in 11act.) RANK 2 NODE 4 --> 68.6054459 sigma out 1act.( 60.7498169 sig in 11act.) RANK 3 NODE 8 --> 50.0666504 sigma out 1act.( 48.6679649 sig in 11act.) RANK 4 NODE 10 --> 41.0111542 sigma out 1act.( 41.9663277 sig in 11act.) RANK 5 NODE 15 --> 38.651104 sigma out 1act.( 38.9742661 sig in 11act.) RANK 6 NODE 7 --> 31.6790352 sigma out 1act.( 25.6805019 sig in 11act.) RANK 7 NODE 5 --> 30.5237675 sigma out 1act.( 29.9391632 sig in 11act.) RANK 8 NODE 11 --> 21.6471272 sigma out 1act.( 19.0674992 sig in 11act.) RANK 9 NODE 2 --> 18.7189026 sigma out 1act.( 19.0682049 sig in 11act.) RANK 10 NODE 9 --> 13.7804785 sigma out 1act.( 12.5993118 sig in 11act.) RANK 11 NODE 13 --> 10.2186604 sigma out 1act.( 9.73806667 sig in 11act.) RANK 12 NODE 1 --> 8.89538002 sigma out 1act.( 8.24346161 sig in 11act.) RANK 13 NODE 3 --> 3.23551726 sigma out 1act.( 3.56264019 sig in 11act.) RANK 14 NODE 12 --> 2.43353701 sigma out 1act.( 4.73695469 sig in 11act.) RANK 15 NODE 6 --> 0.714379549 sigma out 1act.( 3.22396135 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 152.734741 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.518676162 *** contribution from regularisation: 0.00340992399 *** contribution from error: -0.522086084 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47346.3186 -0.190998927 17.3734627 EXIT FROM BFGS code NEW_X -47346.3186 -0.190998927 17.3734627 ENTER BFGS code NEW_X -47346.3186 -0.190998927 17.3734627 EXIT FROM BFGS code FG_LNSRCH 0. -0.194536015 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.518896163 *** contribution from regularisation: 0.00339156622 *** contribution from error: -0.522287726 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47366.3994 -0.194536015 6.06406546 EXIT FROM BFGS code NEW_X -47366.3994 -0.194536015 6.06406546 ENTER BFGS code NEW_X -47366.3994 -0.194536015 6.06406546 EXIT FROM BFGS code FG_LNSRCH 0. -0.201670289 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.519311547 *** contribution from regularisation: 0.00335748913 *** contribution from error: -0.522669017 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47404.3151 -0.201670289 1.09018922 EXIT FROM BFGS code NEW_X -47404.3151 -0.201670289 1.09018922 ENTER BFGS code NEW_X -47404.3151 -0.201670289 1.09018922 EXIT FROM BFGS code FG_LNSRCH 0. -0.214127243 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.51869458 *** contribution from regularisation: 0.00340028806 *** contribution from error: -0.522094846 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47347.9981 -0.214127243 -8.09266758 EXIT FROM BFGS code FG_LNSRCH 0. -0.204904139 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.519316554 *** contribution from regularisation: 0.00350970938 *** contribution from error: -0.522826254 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47404.7706 -0.204904139 -1.551332 EXIT FROM BFGS code NEW_X -47404.7706 -0.204904139 -1.551332 ENTER BFGS code NEW_X -47404.7706 -0.204904139 -1.551332 EXIT FROM BFGS code FG_LNSRCH 0. -0.206903443 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.51959455 *** contribution from regularisation: 0.00340781384 *** contribution from error: -0.523002386 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47430.1489 -0.206903443 -2.80464935 EXIT FROM BFGS code NEW_X -47430.1489 -0.206903443 -2.80464935 ENTER BFGS code NEW_X -47430.1489 -0.206903443 -2.80464935 EXIT FROM BFGS code FG_LNSRCH 0. -0.207723901 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.519631505 *** contribution from regularisation: 0.00345443143 *** contribution from error: -0.523085952 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47433.5205 -0.207723901 8.99034309 EXIT FROM BFGS code NEW_X -47433.5205 -0.207723901 8.99034309 ENTER BFGS code NEW_X -47433.5205 -0.207723901 8.99034309 EXIT FROM BFGS code FG_LNSRCH 0. -0.206767991 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.519711435 *** contribution from regularisation: 0.00346439262 *** contribution from error: -0.523175836 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47440.8181 -0.206767991 3.15608644 EXIT FROM BFGS code NEW_X -47440.8181 -0.206767991 3.15608644 ENTER BFGS code NEW_X -47440.8181 -0.206767991 3.15608644 EXIT FROM BFGS code FG_LNSRCH 0. -0.203491747 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.520049453 *** contribution from regularisation: 0.00344858924 *** contribution from error: -0.523498058 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47471.6766 -0.203491747 18.9061565 EXIT FROM BFGS code NEW_X -47471.6766 -0.203491747 18.9061565 ENTER BFGS code NEW_X -47471.6766 -0.203491747 18.9061565 EXIT FROM BFGS code FG_LNSRCH 0. -0.192831993 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.519780338 *** contribution from regularisation: 0.00346449343 *** contribution from error: -0.523244858 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47447.11 -0.192831993 -62.2127228 EXIT FROM BFGS code FG_LNSRCH 0. -0.200608671 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 86.1406631 sigma out 15 active outputs RANK 2 NODE 1 --> 58.2653351 sigma out 15 active outputs RANK 3 NODE 10 --> 42.8703423 sigma out 15 active outputs RANK 4 NODE 8 --> 41.2380371 sigma out 15 active outputs RANK 5 NODE 3 --> 38.6023369 sigma out 15 active outputs RANK 6 NODE 9 --> 32.9812393 sigma out 15 active outputs RANK 7 NODE 7 --> 32.1445999 sigma out 15 active outputs RANK 8 NODE 5 --> 28.6502361 sigma out 15 active outputs RANK 9 NODE 6 --> 28.0501118 sigma out 15 active outputs RANK 10 NODE 4 --> 21.8781185 sigma out 15 active outputs RANK 11 NODE 11 --> 20.5537834 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 66.8857269 sigma in 11act. ( 105.262184 sig out 1act.) RANK 2 NODE 8 --> 63.1074104 sigma in 11act. ( 58.4700775 sig out 1act.) RANK 3 NODE 4 --> 60.652771 sigma in 11act. ( 69.0595169 sig out 1act.) RANK 4 NODE 10 --> 49.8116302 sigma in 11act. ( 51.401226 sig out 1act.) RANK 5 NODE 15 --> 42.2561417 sigma in 11act. ( 43.4796219 sig out 1act.) RANK 6 NODE 5 --> 37.6950455 sigma in 11act. ( 39.1339798 sig out 1act.) RANK 7 NODE 7 --> 34.569809 sigma in 11act. ( 42.7965851 sig out 1act.) RANK 8 NODE 11 --> 23.6191673 sigma in 11act. ( 27.3505268 sig out 1act.) RANK 9 NODE 2 --> 18.2702351 sigma in 11act. ( 18.7394562 sig out 1act.) RANK 10 NODE 9 --> 16.8355408 sigma in 11act. ( 18.6928616 sig out 1act.) RANK 11 NODE 13 --> 11.4347544 sigma in 11act. ( 11.9238338 sig out 1act.) RANK 12 NODE 1 --> 9.95583057 sigma in 11act. ( 11.045166 sig out 1act.) RANK 13 NODE 3 --> 4.97075796 sigma in 11act. ( 4.5700736 sig out 1act.) RANK 14 NODE 12 --> 4.24328089 sigma in 11act. ( 2.43303943 sig out 1act.) RANK 15 NODE 6 --> 2.8243885 sigma in 11act. ( 0.763783157 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 105.262184 sigma out 1act.( 66.8857269 sig in 11act.) RANK 2 NODE 4 --> 69.0595169 sigma out 1act.( 60.652771 sig in 11act.) RANK 3 NODE 8 --> 58.4700775 sigma out 1act.( 63.1074104 sig in 11act.) RANK 4 NODE 10 --> 51.401226 sigma out 1act.( 49.8116302 sig in 11act.) RANK 5 NODE 15 --> 43.4796219 sigma out 1act.( 42.2561417 sig in 11act.) RANK 6 NODE 7 --> 42.7965851 sigma out 1act.( 34.569809 sig in 11act.) RANK 7 NODE 5 --> 39.1339798 sigma out 1act.( 37.6950455 sig in 11act.) RANK 8 NODE 11 --> 27.3505268 sigma out 1act.( 23.6191673 sig in 11act.) RANK 9 NODE 2 --> 18.7394562 sigma out 1act.( 18.2702351 sig in 11act.) RANK 10 NODE 9 --> 18.6928616 sigma out 1act.( 16.8355408 sig in 11act.) RANK 11 NODE 13 --> 11.9238338 sigma out 1act.( 11.4347544 sig in 11act.) RANK 12 NODE 1 --> 11.045166 sigma out 1act.( 9.95583057 sig in 11act.) RANK 13 NODE 3 --> 4.5700736 sigma out 1act.( 4.97075796 sig in 11act.) RANK 14 NODE 12 --> 2.43303943 sigma out 1act.( 4.24328089 sig in 11act.) RANK 15 NODE 6 --> 0.763783157 sigma out 1act.( 2.8243885 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 170.011398 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.520098805 *** contribution from regularisation: 0.00347756059 *** contribution from error: -0.523576379 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47476.1772 -0.200608671 -2.87781572 EXIT FROM BFGS code NEW_X -47476.1772 -0.200608671 -2.87781572 ENTER BFGS code NEW_X -47476.1772 -0.200608671 -2.87781572 EXIT FROM BFGS code FG_LNSRCH 0. -0.199243486 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.520163 *** contribution from regularisation: 0.00346536329 *** contribution from error: -0.523628354 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47482.04 -0.199243486 5.07932568 EXIT FROM BFGS code NEW_X -47482.04 -0.199243486 5.07932568 ENTER BFGS code NEW_X -47482.04 -0.199243486 5.07932568 EXIT FROM BFGS code FG_LNSRCH 0. -0.194475919 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.520235181 *** contribution from regularisation: 0.00345610478 *** contribution from error: -0.523691297 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47488.6295 -0.194475919 5.91271639 EXIT FROM BFGS code NEW_X -47488.6295 -0.194475919 5.91271639 ENTER BFGS code NEW_X -47488.6295 -0.194475919 5.91271639 EXIT FROM BFGS code FG_LNSRCH 0. -0.182777822 0. --------------------------------------------------- Iteration : 43 *********************************************** *** Learn Path 43 *** loss function: -0.520372629 *** contribution from regularisation: 0.00344586861 *** contribution from error: -0.523818493 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47501.1749 -0.182777822 30.1074238 EXIT FROM BFGS code NEW_X -47501.1749 -0.182777822 30.1074238 ENTER BFGS code NEW_X -47501.1749 -0.182777822 30.1074238 EXIT FROM BFGS code FG_LNSRCH 0. -0.161162227 0. --------------------------------------------------- Iteration : 44 *********************************************** *** Learn Path 44 *** loss function: -0.52056855 *** contribution from regularisation: 0.00343781011 *** contribution from error: -0.524006367 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47519.0588 -0.161162227 20.2585659 EXIT FROM BFGS code NEW_X -47519.0588 -0.161162227 20.2585659 ENTER BFGS code NEW_X -47519.0588 -0.161162227 20.2585659 EXIT FROM BFGS code FG_LNSRCH 0. -0.130185694 0. --------------------------------------------------- Iteration : 45 *********************************************** *** Learn Path 45 *** loss function: -0.520757794 *** contribution from regularisation: 0.00344238547 *** contribution from error: -0.524200201 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47536.3331 -0.130185694 36.1479111 EXIT FROM BFGS code NEW_X -47536.3331 -0.130185694 36.1479111 ENTER BFGS code NEW_X -47536.3331 -0.130185694 36.1479111 EXIT FROM BFGS code FG_LNSRCH 0. -0.117503002 0. --------------------------------------------------- Iteration : 46 *********************************************** *** Learn Path 46 *** loss function: -0.520812571 *** contribution from regularisation: 0.00346399401 *** contribution from error: -0.524276555 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47541.3323 -0.117503002 -29.4697742 EXIT FROM BFGS code NEW_X -47541.3323 -0.117503002 -29.4697742 ENTER BFGS code NEW_X -47541.3323 -0.117503002 -29.4697742 EXIT FROM BFGS code FG_LNSRCH 0. -0.127602667 0. --------------------------------------------------- Iteration : 47 *********************************************** *** Learn Path 47 *** loss function: -0.520925522 *** contribution from regularisation: 0.00346089527 *** contribution from error: -0.524386406 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47551.6465 -0.127602667 -4.71021175 EXIT FROM BFGS code NEW_X -47551.6465 -0.127602667 -4.71021175 ENTER BFGS code NEW_X -47551.6465 -0.127602667 -4.71021175 EXIT FROM BFGS code FG_LNSRCH 0. -0.124804586 0. --------------------------------------------------- Iteration : 48 *********************************************** *** Learn Path 48 *** loss function: -0.520990491 *** contribution from regularisation: 0.00346119539 *** contribution from error: -0.524451673 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47557.5769 -0.124804586 -2.50506544 EXIT FROM BFGS code NEW_X -47557.5769 -0.124804586 -2.50506544 ENTER BFGS code NEW_X -47557.5769 -0.124804586 -2.50506544 EXIT FROM BFGS code FG_LNSRCH 0. -0.107440501 0. --------------------------------------------------- Iteration : 49 *********************************************** *** Learn Path 49 *** loss function: -0.521205604 *** contribution from regularisation: 0.00346060493 *** contribution from error: -0.52466619 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47577.2088 -0.107440501 15.6686821 EXIT FROM BFGS code NEW_X -47577.2088 -0.107440501 15.6686821 ENTER BFGS code NEW_X -47577.2088 -0.107440501 15.6686821 EXIT FROM BFGS code FG_LNSRCH 0. -0.0864478648 0. --------------------------------------------------- Iteration : 50 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 100.756424 sigma out 15 active outputs RANK 2 NODE 1 --> 80.8849182 sigma out 15 active outputs RANK 3 NODE 8 --> 49.4610481 sigma out 15 active outputs RANK 4 NODE 3 --> 46.2955284 sigma out 15 active outputs RANK 5 NODE 10 --> 46.223999 sigma out 15 active outputs RANK 6 NODE 9 --> 44.1802979 sigma out 15 active outputs RANK 7 NODE 5 --> 36.9955482 sigma out 15 active outputs RANK 8 NODE 7 --> 36.8963852 sigma out 15 active outputs RANK 9 NODE 6 --> 34.1445084 sigma out 15 active outputs RANK 10 NODE 4 --> 28.6772423 sigma out 15 active outputs RANK 11 NODE 11 --> 27.0047798 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 84.314682 sigma in 11act. ( 75.6958237 sig out 1act.) RANK 2 NODE 14 --> 75.4884338 sigma in 11act. ( 123.720207 sig out 1act.) RANK 3 NODE 4 --> 69.8522263 sigma in 11act. ( 78.2518692 sig out 1act.) RANK 4 NODE 10 --> 60.942585 sigma in 11act. ( 65.8428116 sig out 1act.) RANK 5 NODE 7 --> 49.1524391 sigma in 11act. ( 59.5623169 sig out 1act.) RANK 6 NODE 15 --> 47.1695099 sigma in 11act. ( 48.7691116 sig out 1act.) RANK 7 NODE 5 --> 43.3861771 sigma in 11act. ( 44.7169876 sig out 1act.) RANK 8 NODE 11 --> 35.2983971 sigma in 11act. ( 40.0712624 sig out 1act.) RANK 9 NODE 9 --> 28.6986217 sigma in 11act. ( 31.8438358 sig out 1act.) RANK 10 NODE 2 --> 18.2007351 sigma in 11act. ( 18.1449451 sig out 1act.) RANK 11 NODE 1 --> 14.872714 sigma in 11act. ( 16.9832935 sig out 1act.) RANK 12 NODE 13 --> 14.1949463 sigma in 11act. ( 14.2378159 sig out 1act.) RANK 13 NODE 3 --> 7.88470793 sigma in 11act. ( 7.44342661 sig out 1act.) RANK 14 NODE 12 --> 2.67822886 sigma in 11act. ( 1.27125549 sig out 1act.) RANK 15 NODE 6 --> 1.72642434 sigma in 11act. ( 0.0252102502 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 123.720207 sigma out 1act.( 75.4884338 sig in 11act.) RANK 2 NODE 4 --> 78.2518692 sigma out 1act.( 69.8522263 sig in 11act.) RANK 3 NODE 8 --> 75.6958237 sigma out 1act.( 84.314682 sig in 11act.) RANK 4 NODE 10 --> 65.8428116 sigma out 1act.( 60.942585 sig in 11act.) RANK 5 NODE 7 --> 59.5623169 sigma out 1act.( 49.1524391 sig in 11act.) RANK 6 NODE 15 --> 48.7691116 sigma out 1act.( 47.1695099 sig in 11act.) RANK 7 NODE 5 --> 44.7169876 sigma out 1act.( 43.3861771 sig in 11act.) RANK 8 NODE 11 --> 40.0712624 sigma out 1act.( 35.2983971 sig in 11act.) RANK 9 NODE 9 --> 31.8438358 sigma out 1act.( 28.6986217 sig in 11act.) RANK 10 NODE 2 --> 18.1449451 sigma out 1act.( 18.2007351 sig in 11act.) RANK 11 NODE 1 --> 16.9832935 sigma out 1act.( 14.872714 sig in 11act.) RANK 12 NODE 13 --> 14.2378159 sigma out 1act.( 14.1949463 sig in 11act.) RANK 13 NODE 3 --> 7.44342661 sigma out 1act.( 7.88470793 sig in 11act.) RANK 14 NODE 12 --> 1.27125549 sigma out 1act.( 2.67822886 sig in 11act.) RANK 15 NODE 6 --> 0.0252102502 sigma out 1act.( 1.72642434 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 207.166656 sigma in 15 active inputs *********************************************** *** Learn Path 50 *** loss function: -0.521373153 *** contribution from regularisation: 0.00347202411 *** contribution from error: -0.524845183 *********************************************** -----------------> Test sample Iteration No: 50 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47592.5054 -0.0864478648 6.65672731 EXIT FROM BFGS code NEW_X -47592.5054 -0.0864478648 6.65672731 ENTER BFGS code NEW_X -47592.5054 -0.0864478648 6.65672731 EXIT FROM BFGS code FG_LNSRCH 0. -0.0641507208 0. --------------------------------------------------- Iteration : 51 *********************************************** *** Learn Path 51 *** loss function: -0.521383345 *** contribution from regularisation: 0.00347608072 *** contribution from error: -0.524859428 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47593.4344 -0.0641507208 58.8281059 EXIT FROM BFGS code FG_LNSRCH 0. -0.0756053701 0. --------------------------------------------------- Iteration : 52 *********************************************** *** Learn Path 52 *** loss function: -0.521461248 *** contribution from regularisation: 0.00346157257 *** contribution from error: -0.524922848 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47600.5488 -0.0756053701 30.6477318 EXIT FROM BFGS code NEW_X -47600.5488 -0.0756053701 30.6477318 ENTER BFGS code NEW_X -47600.5488 -0.0756053701 30.6477318 EXIT FROM BFGS code FG_LNSRCH 0. -0.0675744712 0. --------------------------------------------------- Iteration : 53 *********************************************** *** Learn Path 53 *** loss function: -0.521528661 *** contribution from regularisation: 0.00346316095 *** contribution from error: -0.52499181 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47606.7013 -0.0675744712 3.68039083 EXIT FROM BFGS code NEW_X -47606.7013 -0.0675744712 3.68039083 ENTER BFGS code NEW_X -47606.7013 -0.0675744712 3.68039083 EXIT FROM BFGS code FG_LNSRCH 0. -0.0617771149 0. --------------------------------------------------- Iteration : 54 *********************************************** *** Learn Path 54 *** loss function: -0.521593451 *** contribution from regularisation: 0.00345557788 *** contribution from error: -0.525049031 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47612.613 -0.0617771149 -2.93796086 EXIT FROM BFGS code NEW_X -47612.613 -0.0617771149 -2.93796086 ENTER BFGS code NEW_X -47612.613 -0.0617771149 -2.93796086 EXIT FROM BFGS code FG_LNSRCH 0. -0.0328780301 0. --------------------------------------------------- Iteration : 55 *********************************************** *** Learn Path 55 *** loss function: -0.521786034 *** contribution from regularisation: 0.00344222854 *** contribution from error: -0.525228262 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47630.197 -0.0328780301 -28.4375267 EXIT FROM BFGS code NEW_X -47630.197 -0.0328780301 -28.4375267 ENTER BFGS code NEW_X -47630.197 -0.0328780301 -28.4375267 EXIT FROM BFGS code FG_LNSRCH 0. -0.0166762862 0. --------------------------------------------------- Iteration : 56 *********************************************** *** Learn Path 56 *** loss function: -0.521829605 *** contribution from regularisation: 0.00344958925 *** contribution from error: -0.525279224 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47634.1732 -0.0166762862 26.5503845 EXIT FROM BFGS code NEW_X -47634.1732 -0.0166762862 26.5503845 ENTER BFGS code NEW_X -47634.1732 -0.0166762862 26.5503845 EXIT FROM BFGS code FG_LNSRCH 0. -0.0116587169 0. --------------------------------------------------- Iteration : 57 *********************************************** *** Learn Path 57 *** loss function: -0.521898746 *** contribution from regularisation: 0.00346095441 *** contribution from error: -0.52535969 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47640.4833 -0.0116587169 -2.64818931 EXIT FROM BFGS code NEW_X -47640.4833 -0.0116587169 -2.64818931 ENTER BFGS code NEW_X -47640.4833 -0.0116587169 -2.64818931 EXIT FROM BFGS code FG_LNSRCH 0. -0.0141091738 0. --------------------------------------------------- Iteration : 58 *********************************************** *** Learn Path 58 *** loss function: -0.521921575 *** contribution from regularisation: 0.00345886662 *** contribution from error: -0.525380433 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47642.5698 -0.0141091738 -0.549201488 EXIT FROM BFGS code NEW_X -47642.5698 -0.0141091738 -0.549201488 ENTER BFGS code NEW_X -47642.5698 -0.0141091738 -0.549201488 EXIT FROM BFGS code FG_LNSRCH 0. -0.0143150408 0. --------------------------------------------------- Iteration : 59 *********************************************** *** Learn Path 59 *** loss function: -0.521971583 *** contribution from regularisation: 0.00344339712 *** contribution from error: -0.525415003 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47647.1315 -0.0143150408 -15.3934546 EXIT FROM BFGS code NEW_X -47647.1315 -0.0143150408 -15.3934546 ENTER BFGS code NEW_X -47647.1315 -0.0143150408 -15.3934546 EXIT FROM BFGS code FG_LNSRCH 0. -0.0144188832 0. --------------------------------------------------- Iteration : 60 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 108.668373 sigma out 15 active outputs RANK 2 NODE 1 --> 95.3820572 sigma out 15 active outputs RANK 3 NODE 8 --> 55.2594986 sigma out 15 active outputs RANK 4 NODE 3 --> 52.1382484 sigma out 15 active outputs RANK 5 NODE 9 --> 47.5392761 sigma out 15 active outputs RANK 6 NODE 10 --> 47.2039795 sigma out 15 active outputs RANK 7 NODE 7 --> 38.0361977 sigma out 15 active outputs RANK 8 NODE 6 --> 37.7306786 sigma out 15 active outputs RANK 9 NODE 5 --> 37.0772247 sigma out 15 active outputs RANK 10 NODE 4 --> 30.8732395 sigma out 15 active outputs RANK 11 NODE 11 --> 29.9171257 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 91.9860001 sigma in 11act. ( 83.2808685 sig out 1act.) RANK 2 NODE 14 --> 79.4581757 sigma in 11act. ( 137.478287 sig out 1act.) RANK 3 NODE 4 --> 74.8430939 sigma in 11act. ( 83.7064514 sig out 1act.) RANK 4 NODE 10 --> 67.118782 sigma in 11act. ( 75.3967438 sig out 1act.) RANK 5 NODE 7 --> 57.2150192 sigma in 11act. ( 68.4478302 sig out 1act.) RANK 6 NODE 15 --> 48.1204567 sigma in 11act. ( 50.0129433 sig out 1act.) RANK 7 NODE 11 --> 45.4073105 sigma in 11act. ( 51.9929581 sig out 1act.) RANK 8 NODE 5 --> 44.3273926 sigma in 11act. ( 46.3685074 sig out 1act.) RANK 9 NODE 9 --> 39.8833618 sigma in 11act. ( 43.0997314 sig out 1act.) RANK 10 NODE 2 --> 20.1951084 sigma in 11act. ( 19.5184746 sig out 1act.) RANK 11 NODE 1 --> 19.1483917 sigma in 11act. ( 21.7692852 sig out 1act.) RANK 12 NODE 13 --> 16.6359081 sigma in 11act. ( 16.9425087 sig out 1act.) RANK 13 NODE 3 --> 10.8123617 sigma in 11act. ( 10.2091188 sig out 1act.) RANK 14 NODE 12 --> 1.67266202 sigma in 11act. ( 0.721844375 sig out 1act.) RANK 15 NODE 6 --> 1.02986908 sigma in 11act. ( 0.205594376 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 137.478287 sigma out 1act.( 79.4581757 sig in 11act.) RANK 2 NODE 4 --> 83.7064514 sigma out 1act.( 74.8430939 sig in 11act.) RANK 3 NODE 8 --> 83.2808685 sigma out 1act.( 91.9860001 sig in 11act.) RANK 4 NODE 10 --> 75.3967438 sigma out 1act.( 67.118782 sig in 11act.) RANK 5 NODE 7 --> 68.4478302 sigma out 1act.( 57.2150192 sig in 11act.) RANK 6 NODE 11 --> 51.9929581 sigma out 1act.( 45.4073105 sig in 11act.) RANK 7 NODE 15 --> 50.0129433 sigma out 1act.( 48.1204567 sig in 11act.) RANK 8 NODE 5 --> 46.3685074 sigma out 1act.( 44.3273926 sig in 11act.) RANK 9 NODE 9 --> 43.0997314 sigma out 1act.( 39.8833618 sig in 11act.) RANK 10 NODE 1 --> 21.7692852 sigma out 1act.( 19.1483917 sig in 11act.) RANK 11 NODE 2 --> 19.5184746 sigma out 1act.( 20.1951084 sig in 11act.) RANK 12 NODE 13 --> 16.9425087 sigma out 1act.( 16.6359081 sig in 11act.) RANK 13 NODE 3 --> 10.2091188 sigma out 1act.( 10.8123617 sig in 11act.) RANK 14 NODE 12 --> 0.721844375 sigma out 1act.( 1.67266202 sig in 11act.) RANK 15 NODE 6 --> 0.205594376 sigma out 1act.( 1.02986908 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 231.670929 sigma in 15 active inputs *********************************************** *** Learn Path 60 *** loss function: -0.522000134 *** contribution from regularisation: 0.00340887206 *** contribution from error: -0.525408983 *********************************************** -----------------> Test sample Iteration No: 60 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47649.7403 -0.0144188832 28.8867893 EXIT FROM BFGS code NEW_X -47649.7403 -0.0144188832 28.8867893 ENTER BFGS code NEW_X -47649.7403 -0.0144188832 28.8867893 EXIT FROM BFGS code FG_LNSRCH 0. -0.011540276 0. --------------------------------------------------- Iteration : 61 *********************************************** *** Learn Path 61 *** loss function: -0.521998286 *** contribution from regularisation: 0.00344029325 *** contribution from error: -0.525438607 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47649.5687 -0.011540276 -12.2364807 EXIT FROM BFGS code FG_LNSRCH 0. -0.0135790491 0. --------------------------------------------------- Iteration : 62 *********************************************** *** Learn Path 62 *** loss function: -0.521945 *** contribution from regularisation: 0.00348207029 *** contribution from error: -0.525427043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47644.7049 -0.0135790491 17.0195599 EXIT FROM BFGS code FG_LNSRCH 0. -0.0143705066 0. --------------------------------------------------- Iteration : 63 *********************************************** *** Learn Path 63 *** loss function: -0.521941006 *** contribution from regularisation: 0.00346898381 *** contribution from error: -0.525409997 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47644.3387 -0.0143705066 28.2100067 EXIT FROM BFGS code FG_LNSRCH 0. -0.0144186858 0. --------------------------------------------------- Iteration : 64 *********************************************** *** Learn Path 64 *** loss function: -0.521943867 *** contribution from regularisation: 0.00346519123 *** contribution from error: -0.525409043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47644.5998 -0.0144186858 28.8880825 EXIT FROM BFGS code FG_LNSRCH 0. -0.0144188832 0. --------------------------------------------------- Iteration : 65 *********************************************** *** Learn Path 65 *** loss function: -0.521949828 *** contribution from regularisation: 0.0034592147 *** contribution from error: -0.525409043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47645.1449 -0.0144188832 28.8907719 EXIT FROM BFGS code FG_LNSRCH 0. -0.0144188832 0. --------------------------------------------------- Iteration : 66 *********************************************** *** Learn Path 66 *** loss function: -0.521941602 *** contribution from regularisation: 0.00346743572 *** contribution from error: -0.525409043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47644.3945 -0.0144188832 28.8896904 EXIT FROM BFGS code FG_LNSRCH 0. -0.0144188832 0. --------------------------------------------------- Iteration : 67 *********************************************** *** Learn Path 67 *** loss function: -0.521947622 *** contribution from regularisation: 0.00346140028 *** contribution from error: -0.525409043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47644.9454 -0.0144188832 28.8897476 EXIT FROM BFGS code FG_LNSRCH 0. -0.0144188832 0. --------------------------------------------------- Iteration : 68 *********************************************** *** Learn Path 68 *** loss function: -0.521943033 *** contribution from regularisation: 0.00346599636 *** contribution from error: -0.525409043 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47644.5259 -0.0144188832 28.8890648 EXIT FROM BFGS code NEW_X -47644.5259 -0.0144188832 28.8890648 ENTER BFGS code NEW_X -47644.5259 -0.0144188832 28.8890648 EXIT FROM BFGS code CONVERGENC -47644.5259 -0.0144188832 28.8890648 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 171.28714 sigma out 15 active outputs RANK 2 NODE 1 --> 149.664734 sigma out 15 active outputs RANK 3 NODE 8 --> 86.1208115 sigma out 15 active outputs RANK 4 NODE 3 --> 81.2526627 sigma out 15 active outputs RANK 5 NODE 9 --> 75.0480423 sigma out 15 active outputs RANK 6 NODE 10 --> 73.6670761 sigma out 15 active outputs RANK 7 NODE 7 --> 60.2417946 sigma out 15 active outputs RANK 8 NODE 6 --> 58.3711052 sigma out 15 active outputs RANK 9 NODE 5 --> 56.0147057 sigma out 15 active outputs RANK 10 NODE 4 --> 49.1942139 sigma out 15 active outputs RANK 11 NODE 11 --> 48.2646828 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 8 --> 144.445129 sigma in 11act. ( 130.589691 sig out 1act.) RANK 2 NODE 14 --> 125.814949 sigma in 11act. ( 214.198929 sig out 1act.) RANK 3 NODE 4 --> 118.07856 sigma in 11act. ( 131.144653 sig out 1act.) RANK 4 NODE 10 --> 104.857475 sigma in 11act. ( 117.958611 sig out 1act.) RANK 5 NODE 7 --> 88.3447037 sigma in 11act. ( 107.855782 sig out 1act.) RANK 6 NODE 15 --> 75.4580231 sigma in 11act. ( 78.754715 sig out 1act.) RANK 7 NODE 11 --> 71.2731552 sigma in 11act. ( 81.7440491 sig out 1act.) RANK 8 NODE 5 --> 69.4469681 sigma in 11act. ( 71.8423767 sig out 1act.) RANK 9 NODE 9 --> 62.2854424 sigma in 11act. ( 67.2309494 sig out 1act.) RANK 10 NODE 2 --> 31.3850765 sigma in 11act. ( 29.9236393 sig out 1act.) RANK 11 NODE 1 --> 29.6960735 sigma in 11act. ( 33.8480186 sig out 1act.) RANK 12 NODE 13 --> 25.9784107 sigma in 11act. ( 26.3188553 sig out 1act.) RANK 13 NODE 3 --> 16.7610855 sigma in 11act. ( 16.052557 sig out 1act.) RANK 14 NODE 12 --> 1.975618 sigma in 11act. ( 1.02255189 sig out 1act.) RANK 15 NODE 6 --> 1.07562613 sigma in 11act. ( 0.289195478 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 214.198929 sigma out 1act.( 125.814949 sig in 11act.) RANK 2 NODE 4 --> 131.144653 sigma out 1act.( 118.07856 sig in 11act.) RANK 3 NODE 8 --> 130.589691 sigma out 1act.( 144.445129 sig in 11act.) RANK 4 NODE 10 --> 117.958611 sigma out 1act.( 104.857475 sig in 11act.) RANK 5 NODE 7 --> 107.855782 sigma out 1act.( 88.3447037 sig in 11act.) RANK 6 NODE 11 --> 81.7440491 sigma out 1act.( 71.2731552 sig in 11act.) RANK 7 NODE 15 --> 78.754715 sigma out 1act.( 75.4580231 sig in 11act.) RANK 8 NODE 5 --> 71.8423767 sigma out 1act.( 69.4469681 sig in 11act.) RANK 9 NODE 9 --> 67.2309494 sigma out 1act.( 62.2854424 sig in 11act.) RANK 10 NODE 1 --> 33.8480186 sigma out 1act.( 29.6960735 sig in 11act.) RANK 11 NODE 2 --> 29.9236393 sigma out 1act.( 31.3850765 sig in 11act.) RANK 12 NODE 13 --> 26.3188553 sigma out 1act.( 25.9784107 sig in 11act.) RANK 13 NODE 3 --> 16.052557 sigma out 1act.( 16.7610855 sig in 11act.) RANK 14 NODE 12 --> 1.02255189 sigma out 1act.( 1.975618 sig in 11act.) RANK 15 NODE 6 --> 0.289195478 sigma out 1act.( 1.07562613 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 362.269531 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.521945715 *** contribution from regularisation: 0.00346332416 *** contribution from error: -0.525409043 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 33955 Closing output file done