NNInput NNInputs_160.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 192442 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 56106 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 56106 Chosen entries: 56106 Signal fraction: 1 Background fraction: 0.411527 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 56106 Entries to split: 56106 Test with : 28053 Train with : 28053 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 56106 for Signal Prepared event 0 for Signal with 56106 events ====Entry 0 Variable Ht : 120.598 Variable LepAPt : 29.9056 Variable LepBPt : 13.5082 Variable MetSigLeptonsJets : 11.7141 Variable MetSpec : 77.1834 Variable SumEtLeptonsJets : 43.4138 Variable VSumJetLeptonsPt : 43.304 Variable addEt : 120.598 Variable dPhiLepSumMet : 2.82377 Variable dPhiLeptons : 0.153702 Variable dRLeptons : 0.732968 Variable lep1_E : 40.451 Variable lep2_E : 32.7603 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2160 Ht = 120.598 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 29.9058 LepAPt = 29.9056 LepBEt = 13.5084 LepBPt = 13.5082 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 77.1834 MetDelPhi = 2.77599 MetSig = 6.78472 MetSigLeptonsJets = 11.7141 MetSpec = 77.1834 Mjj = 0 MostCentralJetEta = 0 MtllMet = 139.14 Njets = 0 SB = 0 SumEt = 129.415 SumEtJets = 0 SumEtLeptonsJets = 43.4138 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 43.304 addEt = 120.598 dPhiLepSumMet = 2.82377 dPhiLeptons = 0.153702 dRLeptons = 0.732968 diltype = 34 dimass = 15.0375 event = 2600 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.451 lep2_E = 32.7603 rand = 0.999742 run = 233650 weight = 2.30027e-06 ===Show End Prepared event 10000 for Signal with 56106 events Prepared event 20000 for Signal with 56106 events Prepared event 30000 for Signal with 56106 events Prepared event 40000 for Signal with 56106 events Prepared event 50000 for Signal with 56106 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.409127 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4454 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 192442 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4454 negative weights. Signal fraction: 61.9489784 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.5994186 65.857132 67.2536316 68.4533386 69.5391388 70.6576538 71.5438461 72.4209137 73.3865356 74.1637726 74.914566 75.5469513 76.2559814 77.0263519 77.7811432 78.4708252 79.1596222 79.7845612 80.5355682 81.2728577 82.0044022 82.7324295 83.5235901 84.5343933 85.6358948 86.6594772 87.876297 88.970459 90.0945129 91.7806931 93.1028061 94.4337158 95.7606354 97.2866974 98.85112 100.51445 102.076836 103.719849 105.175659 106.579704 108.184357 109.741608 111.170868 112.858612 114.610847 116.264282 117.844757 119.670372 121.390045 123.05632 124.816925 126.506958 128.121872 129.73967 131.212402 132.870667 134.342926 135.885712 137.354065 138.869171 140.301514 141.832794 143.204712 144.673126 146.147552 147.508972 148.79657 150.259186 151.570282 152.942184 154.358322 155.871979 157.163284 158.698334 160.106323 161.851562 163.779175 166.177795 168.606735 170.92009 173.381226 175.836502 178.478333 181.442169 184.489197 187.720108 191.022873 194.202484 197.911804 202.209503 206.973145 212.480621 218.596848 225.815155 234.94873 246.62262 260.844116 282.508789 329.537292 1486.89319 ------------------------------ Transdef: Tab for variable 3 20.0032291 20.3642826 20.7121658 21.0714855 21.3638763 21.6714096 21.9358788 22.1701679 22.4155331 22.677784 22.8624306 23.0979958 23.345623 23.5817356 23.8028336 24.0954971 24.3175697 24.5443535 24.7655411 25.0168686 25.230299 25.4546547 25.6546974 25.8522873 26.0948067 26.333477 26.5639801 26.8063927 27.0547066 27.2367268 27.515564 27.7424927 27.9749069 28.2262383 28.4401894 28.6833191 28.9040585 29.1334591 29.3800068 29.6624107 29.8528805 30.1430779 30.45755 30.6923103 30.9534779 31.1864834 31.4318905 31.7002811 31.9863663 32.2382278 32.499176 32.7965088 33.1134338 33.3811264 33.6415787 33.9003944 34.1800842 34.4694214 34.7775269 35.0969734 35.4140739 35.6623764 35.9499168 36.2628822 36.5661316 36.8719826 37.1789398 37.4873047 37.794735 38.0880737 38.419796 38.7554092 39.0715561 39.3954124 39.7414055 40.0785446 40.4619789 40.8136063 41.0795288 41.4852219 41.9057846 42.3244019 42.6786804 43.166275 43.5869217 44.0625839 44.5951195 45.174408 45.8268051 46.5004959 47.275383 48.0949669 49.0562592 50.2786865 51.5302696 53.1901321 55.1292801 57.7620735 61.5400658 68.1404419 155.865875 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1365967 10.285759 10.3883076 10.4935818 10.6086903 10.7714052 10.8964252 11.0416746 11.2042542 11.3396549 11.5009604 11.6417637 11.7702827 11.9371042 12.0931034 12.2628679 12.4101849 12.5695448 12.7423439 12.915205 13.0955734 13.2928143 13.4705477 13.6175442 13.8059683 13.9604626 14.1418476 14.3282604 14.5167007 14.7405071 14.97855 15.1882944 15.3668461 15.6093245 15.8407326 16.0489902 16.3139801 16.5626221 16.8256474 17.0955162 17.4059582 17.7023163 17.9603405 18.1206932 18.4398155 18.712986 19.0207424 19.3376942 19.667017 19.9763756 20.199749 20.4778576 20.7799301 21.0706596 21.3937492 21.6787491 21.9812889 22.2877274 22.617487 22.9541054 23.2833271 23.6034622 23.9516754 24.3010521 24.6338501 25.0198612 25.4116879 25.777504 26.1388397 26.4812775 26.8668308 27.2287216 27.6096153 27.9627686 28.2971573 28.6748695 29.0681095 29.4682732 29.8716431 30.2398434 30.6414909 31.0786705 31.5282936 31.939127 32.3650665 32.831192 33.2831039 33.7748184 34.2605286 34.7813416 35.3819199 36.0117569 36.7261581 37.4631042 38.478157 39.6044922 41.3148041 43.633419 47.8561096 71.4964066 ------------------------------ Transdef: Tab for variable 5 1.04102874 2.73891735 3.17836428 3.52226448 3.7852838 3.98780632 4.13882828 4.26925373 4.39407158 4.52375364 4.61996746 4.71245861 4.82037926 4.91702843 5.00883579 5.08383465 5.15500975 5.21859932 5.28458786 5.34699726 5.40570068 5.46621704 5.51588631 5.55433369 5.60841751 5.65947819 5.71408558 5.76143026 5.81090832 5.85643005 5.90980339 5.95922947 6.00732327 6.04872227 6.09903049 6.14113712 6.18652534 6.22978783 6.2750721 6.31155014 6.36016083 6.41245556 6.46133327 6.50524902 6.55799103 6.60791063 6.66005039 6.70979595 6.76125002 6.81002903 6.84594536 6.88190937 6.93281889 6.98113346 7.03734112 7.08942366 7.14346266 7.1975503 7.24676418 7.29995823 7.3523488 7.40694523 7.4605279 7.51281881 7.55901909 7.61385441 7.66456413 7.72813988 7.78892708 7.84272099 7.90408659 7.95437813 8.01632595 8.08038712 8.13345814 8.18981934 8.24292374 8.29762745 8.35917473 8.42421341 8.49261475 8.55853653 8.62287521 8.69303322 8.76022911 8.83228493 8.90750217 8.98547935 9.0672226 9.16692734 9.26306629 9.37271976 9.49845695 9.63737869 9.79651833 10.0057316 10.2597275 10.602828 11.1378183 12.2242088 26.9916515 ------------------------------ Transdef: Tab for variable 6 15.0022345 21.869772 25.6516476 26.7405014 27.7246075 28.7181244 29.5284843 30.3290157 31.0683727 31.7219162 32.2635803 32.7959213 33.2848473 33.7792816 34.2946396 34.7508659 35.075058 35.5997238 35.993782 36.3915749 36.7816582 37.2067566 37.6545868 38.0175476 38.386879 38.7752991 39.1546555 39.5830841 39.9926682 40.3489418 40.8098373 41.2474174 41.7149315 42.1844482 42.6983871 43.1334 43.5480194 43.957634 44.4808578 45.101059 45.6814842 46.2488823 46.9639206 47.4543152 48.0719604 48.8224106 49.3653755 50.013237 50.499649 51.3182755 52.0844727 52.8994598 53.6974525 54.3939934 55.1448288 55.9078674 56.5744247 57.3731384 58.1523781 58.8756332 59.5999298 60.3997459 61.2091675 61.9654465 62.7811966 63.5885925 64.389328 65.1859894 65.9376526 66.6939621 67.4244232 68.22258 68.9465332 69.6941147 70.436554 71.2626801 72.0073929 72.8055115 73.5859985 74.4421692 75.1767273 75.9760437 76.7151642 77.3177185 78.1148834 79.0205994 80.0158997 81.0757751 82.063324 83.276947 84.7574463 86.3378448 88.2393036 90.4024658 93.0279541 96.3370209 100.015961 104.805313 112.51593 125.999672 738.435913 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.8205872 33.9146347 34.6873779 35.1873016 35.7382088 36.2645683 36.7445755 37.1285858 37.5049744 37.8469315 38.1992188 38.5657578 38.8579941 39.1639252 39.460144 39.7799721 40.0849457 40.3702087 40.6577225 41.0666122 41.449955 41.8527946 42.2826958 42.7342911 43.1923141 43.9440308 44.6434975 45.2332993 45.8892021 46.5757446 47.3065872 48.1997604 49.004776 49.7377625 50.7112427 51.7360687 52.6273422 53.5964088 54.6507225 55.6107788 56.5410728 57.4527473 58.3968277 59.3358078 60.2407875 61.153801 62.0174255 62.84758 63.8181305 64.6155548 65.3815155 66.285347 67.1427155 67.9844513 68.8146667 69.7438202 70.6263351 71.4372406 72.2868042 73.1677856 74.0246201 74.8818054 75.7170105 76.5904694 77.4523926 78.3882904 79.320816 80.3381348 81.4982986 82.646637 84.0705719 85.5554581 86.9789276 88.4936829 90.0849991 91.6938324 93.4257202 95.1236267 96.8179779 98.6812592 100.53949 102.36319 104.60495 106.944672 109.380051 112.038307 115.230789 118.083969 121.455841 124.952438 129.087677 133.495209 138.26062 143.983902 151.785339 161.74527 173.385773 191.096451 228.254776 748.456726 ------------------------------ Transdef: Tab for variable 8 3.97794557 26.002079 29.5507164 31.2177238 32.3588028 33.0637894 33.731636 34.1355515 34.6148224 35.0398102 35.4439316 35.83255 36.1546936 36.5092354 36.8076859 37.081852 37.3707199 37.7015686 38.0202942 38.2862778 38.5864029 38.8515015 39.0916367 39.370575 39.6317139 39.9166832 40.2729492 40.6185379 40.9536858 41.3169441 41.6950874 42.0867462 42.5255585 42.9819489 43.5383682 43.9720993 44.458847 44.9949684 45.4026184 46.0212479 46.672226 47.2755508 47.9045639 48.371151 48.9443817 49.6579895 50.3432236 51.0390472 51.7620049 52.480484 53.1370697 53.8197556 54.5495911 55.2533226 55.975174 56.7379913 57.4014282 58.1549988 58.8017235 59.4673615 60.1872787 60.8793793 61.5864754 62.2906342 62.9998245 63.7131577 64.358551 65.0559235 65.7286072 66.3928986 67.0800018 67.7527618 68.449585 69.1595917 69.8327026 70.5676117 71.2821503 72.0016403 72.7897186 73.5663452 74.2431335 75.054184 75.8390656 76.6579742 77.5469513 78.4546585 79.2679291 80.3305588 81.5559692 82.9570541 84.448822 86.2315369 88.2803268 90.6490173 93.6248932 97.0026093 101.426575 107.155891 116.469131 137.858582 744.690247 ------------------------------ Transdef: Tab for variable 9 48.8581314 63.0500298 65.2087708 66.7533493 67.7657471 68.7786255 69.8792572 70.8439484 71.6364288 72.447998 73.3368225 74.0449371 74.7443542 75.3394165 75.916008 76.6172485 77.1593475 77.9183655 78.5118942 79.0858078 79.7034378 80.2361298 80.9146729 81.4736557 82.1873398 82.8096466 83.4689026 84.1436691 84.9586487 85.9291229 86.7285233 87.7005386 88.6504898 89.4609985 90.4258118 91.6491547 92.9202576 93.9627151 95.2108459 96.3195343 97.5676117 99.0050964 100.450249 101.64389 103.136368 104.376137 105.773712 107.04007 108.374397 109.712692 110.937126 112.234512 113.61055 114.894958 116.146332 117.367958 118.792053 119.99234 121.267319 122.499084 123.845222 125.191971 126.487518 127.756744 128.957214 130.246262 131.307037 132.576904 133.691193 134.881531 136.044937 137.148529 138.387634 139.57962 140.748871 141.911835 143.022583 144.163834 145.276077 146.413101 147.601807 148.597885 149.700729 150.798508 151.90683 153.0121 154.09549 155.232758 156.321533 157.53566 158.919159 160.289917 161.772247 163.387054 165.560059 168.330765 171.634384 177.123749 186.564026 209.28952 801.871094 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.983415127 1.38667202 1.62293339 1.80110979 1.93091094 2.02646399 2.10853052 2.1826849 2.24114776 2.29699183 2.34129882 2.38453722 2.42487574 2.45691442 2.49114823 2.52270842 2.55375552 2.58080053 2.60744143 2.63118076 2.65341115 2.67605782 2.69716144 2.71719646 2.73467636 2.75176191 2.76732516 2.77909517 2.79552126 2.8087368 2.8225913 2.83562994 2.84830117 2.85797453 2.87018633 2.87962008 2.88844538 2.89767838 2.90553308 2.91391206 2.9208746 2.92854452 2.93608856 2.94365215 2.95018983 2.95676231 2.96341181 2.96864223 2.97499776 2.97994709 2.9845736 2.98913527 2.99322605 2.99922442 3.00366259 3.00808978 3.01281595 3.0169611 3.02197313 3.02614594 3.03033113 3.03439784 3.03830028 3.04219794 3.04597473 3.04990911 3.05366206 3.05727863 3.06080365 3.06398869 3.06683111 3.06995416 3.07267737 3.07567906 3.07864213 3.08144426 3.08420467 3.08723593 3.08995581 3.09262085 3.09554243 3.09813213 3.10098457 3.10336828 3.10551548 3.10815287 3.11079311 3.1131134 3.11555266 3.1175766 3.12014127 3.12256289 3.12466145 3.12721729 3.1294899 3.13225508 3.13423395 3.13649893 3.13901091 3.1415906 ------------------------------ Transdef: Tab for variable 11 2.8014183E-06 0.00527477171 0.0112807676 0.0186407864 0.0241239667 0.0309909284 0.0383261777 0.0458180904 0.054621391 0.0617150143 0.0691045523 0.0771416202 0.084635362 0.0923083127 0.0996797085 0.107543349 0.114765167 0.12204349 0.128942609 0.13509202 0.142050654 0.148954868 0.155434489 0.16086638 0.167110205 0.173386335 0.178939998 0.184268773 0.190030694 0.195778847 0.201354384 0.206573009 0.211595297 0.216932684 0.222234577 0.228080526 0.233235598 0.237944007 0.243501425 0.248544216 0.253276348 0.258431226 0.262665153 0.267425776 0.272526383 0.277731419 0.283031851 0.288488388 0.293533415 0.298807949 0.303727537 0.309566915 0.314415216 0.31998235 0.325620353 0.330890596 0.336571813 0.341930032 0.34781456 0.353099823 0.358321428 0.363319933 0.369457006 0.374945432 0.380675256 0.386158705 0.391162276 0.397468925 0.402727008 0.408780932 0.415614724 0.421777695 0.428282857 0.435332298 0.440750837 0.447687387 0.454778671 0.461213589 0.469468355 0.47696057 0.486002445 0.496382952 0.505711913 0.514196575 0.523284435 0.535279989 0.543007612 0.552935183 0.565638423 0.577879667 0.592498302 0.607232213 0.625277758 0.640548587 0.656805456 0.678348541 0.707591534 0.735494673 0.774699807 0.832776785 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200000316 0.210250363 0.220582232 0.229733139 0.237323567 0.245466128 0.253133655 0.259388149 0.265771329 0.272608489 0.279113948 0.284850568 0.29170081 0.297959089 0.30311358 0.308525741 0.313553751 0.318883389 0.324631333 0.329869121 0.335412979 0.340804785 0.346349865 0.350794733 0.355623364 0.360859573 0.365750968 0.37111941 0.37610364 0.380996168 0.385835439 0.390024424 0.394585788 0.398999572 0.403030455 0.406864583 0.410952508 0.413804621 0.417605728 0.421074748 0.425217777 0.428810656 0.432224989 0.436442077 0.440216959 0.444202423 0.447601318 0.452032536 0.455986708 0.460101366 0.464255214 0.46894753 0.472458392 0.476377785 0.480604231 0.485200584 0.489924282 0.494176388 0.498715043 0.503007293 0.508133054 0.512845516 0.517950177 0.522721112 0.528187275 0.53312403 0.539060652 0.544577122 0.548436761 0.553726077 0.558894396 0.564352632 0.570829988 0.577289641 0.583619237 0.589232147 0.595772326 0.602375269 0.609180808 0.618351698 0.625941455 0.634408295 0.643302441 0.650793016 0.66016376 0.667377889 0.677237511 0.685470819 0.697298646 0.707844377 0.719178319 0.728316665 0.742478013 0.75438863 0.770515501 0.785417378 0.80271554 0.829900563 0.859980166 0.89844507 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0277634 21.7913914 22.5704842 23.268692 23.8516655 24.4271774 24.9954643 25.4933205 25.9931374 26.4817085 26.9633026 27.3613319 27.7797718 28.2017307 28.6205597 29.0095215 29.3981934 29.6659775 30.0531368 30.4540596 30.7959213 31.0536728 31.3955288 31.7293968 32.091526 32.4098206 32.6982269 33.0820885 33.4517975 33.7712631 34.1029434 34.4458542 34.7549629 35.0804291 35.4149399 35.7377434 36.0535736 36.3055878 36.6733093 37.0357208 37.3075867 37.6455536 37.9699936 38.3043594 38.6169891 38.9738159 39.3234558 39.6429443 39.9528084 40.3258781 40.6989822 41.0692139 41.4174042 41.8052559 42.1967545 42.5618973 42.9531975 43.2697678 43.6666031 44.0728378 44.4913063 44.952858 45.3927765 45.8578415 46.3126678 46.7256699 47.1442986 47.5940399 48.0275192 48.5432358 49.0713234 49.6366768 50.216095 50.7651062 51.3538475 51.986618 52.5818634 53.2796135 53.9893341 54.6738129 55.4281693 56.1711807 57.056694 57.9983826 58.9235306 59.975174 60.9771194 62.3010864 63.722084 65.0980377 66.7182312 68.1410217 69.8341904 72.0686951 74.6272278 77.6324844 81.0706024 85.975647 91.0976715 101.372063 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.6652374 11.1819115 11.6027355 11.916626 12.3029861 12.5904465 12.8947935 13.2590771 13.598259 13.8638153 14.2358894 14.5177975 14.8669128 15.1900158 15.5032625 15.8310509 16.202528 16.4993134 16.7811852 17.1076641 17.4558258 17.7825127 18.0586815 18.3764343 18.6891556 19.0327911 19.3577003 19.716114 20.0661774 20.3787956 20.6827545 21.0041542 21.3102951 21.6822586 21.9346371 22.2182617 22.5591774 22.9107685 23.1911659 23.4877625 23.7961082 24.1310616 24.4793205 24.8190212 25.1560822 25.4845104 25.8108597 26.1301613 26.4722862 26.7833748 27.1144905 27.4513035 27.7534065 27.975029 28.2564774 28.6209717 28.9728012 29.3082962 29.6513577 30.0243149 30.3511734 30.6930161 31.0771141 31.4462814 31.7520142 32.1085472 32.480278 32.8605499 33.2268486 33.6263466 34.0132065 34.4201012 34.8294373 35.2606087 35.6685562 36.1163216 36.556839 37.0094948 37.4730301 37.9842377 38.5173645 39.0500641 39.5973511 40.1907959 40.78302 41.4076843 42.2014618 42.9695282 43.793499 44.4229622 45.4290848 46.4563789 47.7579193 49.1367874 50.6933899 53.0800018 55.725338 59.8665352 66.582901 127.567856 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 64.0 48.0 56.8 28.9 49.1 61.6 53.8 62.3 -22.9 -21.2 -41.9 13.0 33.3 2 64.0 100.0 65.5 63.3 39.2 70.4 94.6 76.8 92.1 -43.7 -27.0 -52.0 30.5 40.3 3 48.0 65.5 100.0 50.8 10.4 34.4 69.2 53.6 71.0 -14.7 -30.0 -57.6 62.0 32.2 4 56.8 63.3 50.8 100.0 20.4 41.6 63.4 55.9 70.3 -10.6 -33.6 -66.4 22.9 75.0 5 28.9 39.2 10.4 20.4 100.0 84.4 12.8 59.7 59.5 20.7 -9.7 -15.3 -3.5 10.2 6 49.1 70.4 34.4 41.6 84.4 100.0 50.1 79.7 80.5 -6.9 -18.8 -33.4 9.4 24.7 7 61.6 94.6 69.2 63.4 12.8 50.1 100.0 68.7 81.3 -52.0 -25.4 -51.8 35.3 41.5 8 53.8 76.8 53.6 55.9 59.7 79.7 68.7 100.0 84.5 -11.6 -25.6 -46.3 24.3 36.9 9 62.3 92.1 71.0 70.3 59.5 80.5 81.3 84.5 100.0 -20.2 -30.3 -58.6 34.9 46.6 10 -22.9 -43.7 -14.7 -10.6 20.7 -6.9 -52.0 -11.6 -20.2 100.0 2.0 6.7 -5.4 -4.5 11 -21.2 -27.0 -30.0 -33.6 -9.7 -18.8 -25.4 -25.6 -30.3 2.0 100.0 55.2 -11.8 -24.4 12 -41.9 -52.0 -57.6 -66.4 -15.3 -33.4 -51.8 -46.3 -58.6 6.7 55.2 100.0 -27.1 -44.0 13 13.0 30.5 62.0 22.9 -3.5 9.4 35.3 24.3 34.9 -5.4 -11.8 -27.1 100.0 49.8 14 33.3 40.3 32.2 75.0 10.2 24.7 41.5 36.9 46.6 -4.5 -24.4 -44.0 49.8 100.0 TOTAL CORRELATION TO TARGET (diagonal) 165.709489 TOTAL CORRELATION OF ALL VARIABLES 70.9944422 ROUND 1: MAX CORR ( 70.9938377) AFTER KILLING INPUT VARIABLE 8 CONTR 0.292970765 ROUND 2: MAX CORR ( 70.9883788) AFTER KILLING INPUT VARIABLE 14 CONTR 0.880381021 ROUND 3: MAX CORR ( 70.9813665) AFTER KILLING INPUT VARIABLE 11 CONTR 0.99776423 ROUND 4: MAX CORR ( 70.9357157) AFTER KILLING INPUT VARIABLE 10 CONTR 2.54531654 ROUND 5: MAX CORR ( 70.8840877) AFTER KILLING INPUT VARIABLE 12 CONTR 2.70589553 ROUND 6: MAX CORR ( 70.6799993) AFTER KILLING INPUT VARIABLE 2 CONTR 5.37508968 ROUND 7: MAX CORR ( 70.3924128) AFTER KILLING INPUT VARIABLE 6 CONTR 6.36949877 ROUND 8: MAX CORR ( 69.4381945) AFTER KILLING INPUT VARIABLE 9 CONTR 11.5511441 ROUND 9: MAX CORR ( 68.5474197) AFTER KILLING INPUT VARIABLE 3 CONTR 11.0866635 ROUND 10: MAX CORR ( 68.080664) AFTER KILLING INPUT VARIABLE 13 CONTR 7.98573348 ROUND 11: MAX CORR ( 65.7101442) AFTER KILLING INPUT VARIABLE 5 CONTR 17.8088111 ROUND 12: MAX CORR ( 61.5919335) AFTER KILLING INPUT VARIABLE 4 CONTR 22.8966543 LAST REMAINING VARIABLE: 7 total correlation to target: 70.9944422 % total significance: 151.493298 sigma correlations of single variables to target: variable 2: 63.9768386 % , in sigma: 136.518606 variable 3: 48.0347287 % , in sigma: 102.500129 variable 4: 56.7612927 % , in sigma: 121.121529 variable 5: 28.9336376 % , in sigma: 61.7407792 variable 6: 49.1415929 % , in sigma: 104.862039 variable 7: 61.5919335 % , in sigma: 131.429515 variable 8: 53.8049272 % , in sigma: 114.813014 variable 9: 62.3437573 % , in sigma: 133.033814 variable 10: -22.9120613 % , in sigma: 48.8914852 variable 11: -21.2200432 % , in sigma: 45.2809293 variable 12: -41.9264655 % , in sigma: 89.4658556 variable 13: 12.9748032 % , in sigma: 27.6866141 variable 14: 33.2965517 % , in sigma: 71.0506945 variables sorted by significance: 1 most relevant variable 7 corr 61.5919342 , in sigma: 131.429517 2 most relevant variable 4 corr 22.8966541 , in sigma: 48.8586083 3 most relevant variable 5 corr 17.8088112 , in sigma: 38.0017851 4 most relevant variable 13 corr 7.98573351 , in sigma: 17.0405607 5 most relevant variable 3 corr 11.0866632 , in sigma: 23.6575586 6 most relevant variable 9 corr 11.5511436 , in sigma: 24.6487019 7 most relevant variable 6 corr 6.36949873 , in sigma: 13.591717 8 most relevant variable 2 corr 5.37508965 , in sigma: 11.4697719 9 most relevant variable 12 corr 2.70589542 , in sigma: 5.77404383 10 most relevant variable 10 corr 2.54531646 , in sigma: 5.43138832 11 most relevant variable 11 corr 0.99776423 , in sigma: 2.1291046 12 most relevant variable 14 corr 0.880381048 , in sigma: 1.87862351 13 most relevant variable 8 corr 0.292970777 , in sigma: 0.62516315 global correlations between input variables: variable 2: 99.1893429 % variable 3: 92.2078355 % variable 4: 93.0039706 % variable 5: 95.2392196 % variable 6: 94.591074 % variable 7: 98.7856182 % variable 8: 90.263842 % variable 9: 98.8145003 % variable 10: 70.9637411 % variable 11: 56.6011359 % variable 12: 78.62935 % variable 13: 84.2755144 % variable 14: 88.931945 % significance loss when removing single variables: variable 2: corr = 4.48357374 % , sigma = 9.56738796 variable 3: corr = 16.2966219 % , sigma = 34.7749615 variable 4: corr = 15.0616762 % , sigma = 32.1397412 variable 5: corr = 10.6059352 % , sigma = 22.6317448 variable 6: corr = 5.04292497 % , sigma = 10.7609738 variable 7: corr = 5.16717604 % , sigma = 11.0261101 variable 8: corr = 0.292970765 % , sigma = 0.625163126 variable 9: corr = 12.6158667 % , sigma = 26.9206883 variable 10: corr = 2.46429841 % , sigma = 5.2585059 variable 11: corr = 1.05853206 % , sigma = 2.25877557 variable 12: corr = 1.86166252 % , sigma = 3.97255597 variable 13: corr = 8.97455559 % , sigma = 19.1505839 variable 14: corr = 0.88339242 % , sigma = 1.8850494 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 22.1755466 sigma out 15 active outputs RANK 2 NODE 3 --> 18.1966553 sigma out 15 active outputs RANK 3 NODE 9 --> 16.7169228 sigma out 15 active outputs RANK 4 NODE 11 --> 16.5994892 sigma out 15 active outputs RANK 5 NODE 2 --> 16.0016193 sigma out 15 active outputs RANK 6 NODE 1 --> 14.5129671 sigma out 15 active outputs RANK 7 NODE 5 --> 14.3375463 sigma out 15 active outputs RANK 8 NODE 7 --> 11.4481878 sigma out 15 active outputs RANK 9 NODE 6 --> 10.4620848 sigma out 15 active outputs RANK 10 NODE 4 --> 10.1525574 sigma out 15 active outputs RANK 11 NODE 8 --> 9.67943954 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 32.1545639 sigma in 11act. ( 35.3417892 sig out 1act.) RANK 2 NODE 6 --> 17.746891 sigma in 11act. ( 21.4509945 sig out 1act.) RANK 3 NODE 5 --> 14.4930592 sigma in 11act. ( 15.5007019 sig out 1act.) RANK 4 NODE 14 --> 13.5028324 sigma in 11act. ( 19.4325123 sig out 1act.) RANK 5 NODE 3 --> 11.8305941 sigma in 11act. ( 16.1242123 sig out 1act.) RANK 6 NODE 13 --> 11.7715979 sigma in 11act. ( 9.66286755 sig out 1act.) RANK 7 NODE 15 --> 11.3512392 sigma in 11act. ( 3.73861766 sig out 1act.) RANK 8 NODE 9 --> 9.23003864 sigma in 11act. ( 5.34247875 sig out 1act.) RANK 9 NODE 10 --> 7.93391943 sigma in 11act. ( 7.06897736 sig out 1act.) RANK 10 NODE 8 --> 7.73388672 sigma in 11act. ( 8.71779823 sig out 1act.) RANK 11 NODE 11 --> 5.90687323 sigma in 11act. ( 6.41175604 sig out 1act.) RANK 12 NODE 7 --> 5.58102512 sigma in 11act. ( 7.68098068 sig out 1act.) RANK 13 NODE 1 --> 5.15414906 sigma in 11act. ( 7.76172781 sig out 1act.) RANK 14 NODE 12 --> 4.6328373 sigma in 11act. ( 4.44827223 sig out 1act.) RANK 15 NODE 4 --> 4.09251356 sigma in 11act. ( 2.12026501 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 35.3417892 sigma out 1act.( 32.1545639 sig in 11act.) RANK 2 NODE 6 --> 21.4509945 sigma out 1act.( 17.746891 sig in 11act.) RANK 3 NODE 14 --> 19.4325123 sigma out 1act.( 13.5028324 sig in 11act.) RANK 4 NODE 3 --> 16.1242123 sigma out 1act.( 11.8305941 sig in 11act.) RANK 5 NODE 5 --> 15.5007019 sigma out 1act.( 14.4930592 sig in 11act.) RANK 6 NODE 13 --> 9.66286755 sigma out 1act.( 11.7715979 sig in 11act.) RANK 7 NODE 8 --> 8.71779823 sigma out 1act.( 7.73388672 sig in 11act.) RANK 8 NODE 1 --> 7.76172781 sigma out 1act.( 5.15414906 sig in 11act.) RANK 9 NODE 7 --> 7.68098068 sigma out 1act.( 5.58102512 sig in 11act.) RANK 10 NODE 10 --> 7.06897736 sigma out 1act.( 7.93391943 sig in 11act.) RANK 11 NODE 11 --> 6.41175604 sigma out 1act.( 5.90687323 sig in 11act.) RANK 12 NODE 9 --> 5.34247875 sigma out 1act.( 9.23003864 sig in 11act.) RANK 13 NODE 12 --> 4.44827223 sigma out 1act.( 4.6328373 sig in 11act.) RANK 14 NODE 15 --> 3.73861766 sigma out 1act.( 11.3512392 sig in 11act.) RANK 15 NODE 4 --> 2.12026501 sigma out 1act.( 4.09251356 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.0778351 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 23.7823792 sigma out 15 active outputs RANK 2 NODE 9 --> 23.5533161 sigma out 15 active outputs RANK 3 NODE 3 --> 19.9748192 sigma out 15 active outputs RANK 4 NODE 1 --> 18.0613308 sigma out 15 active outputs RANK 5 NODE 11 --> 17.6758118 sigma out 15 active outputs RANK 6 NODE 2 --> 17.6465015 sigma out 15 active outputs RANK 7 NODE 5 --> 16.2153091 sigma out 15 active outputs RANK 8 NODE 7 --> 13.3938789 sigma out 15 active outputs RANK 9 NODE 4 --> 12.6972895 sigma out 15 active outputs RANK 10 NODE 6 --> 12.6269341 sigma out 15 active outputs RANK 11 NODE 8 --> 11.9681396 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 34.2132645 sigma in 11act. ( 32.9714813 sig out 1act.) RANK 2 NODE 14 --> 21.9561443 sigma in 11act. ( 18.537571 sig out 1act.) RANK 3 NODE 6 --> 20.9138126 sigma in 11act. ( 20.446312 sig out 1act.) RANK 4 NODE 3 --> 15.9376459 sigma in 11act. ( 15.6706095 sig out 1act.) RANK 5 NODE 5 --> 15.1639576 sigma in 11act. ( 14.5713024 sig out 1act.) RANK 6 NODE 1 --> 11.092041 sigma in 11act. ( 8.62165642 sig out 1act.) RANK 7 NODE 7 --> 11.031868 sigma in 11act. ( 8.05251026 sig out 1act.) RANK 8 NODE 8 --> 10.0007391 sigma in 11act. ( 8.30352116 sig out 1act.) RANK 9 NODE 13 --> 9.78255844 sigma in 11act. ( 8.38537025 sig out 1act.) RANK 10 NODE 11 --> 9.44903755 sigma in 11act. ( 5.97371435 sig out 1act.) RANK 11 NODE 12 --> 8.37949276 sigma in 11act. ( 4.29785204 sig out 1act.) RANK 12 NODE 15 --> 7.94700289 sigma in 11act. ( 2.52853131 sig out 1act.) RANK 13 NODE 10 --> 7.26766205 sigma in 11act. ( 6.38688278 sig out 1act.) RANK 14 NODE 9 --> 6.80211258 sigma in 11act. ( 4.21370029 sig out 1act.) RANK 15 NODE 4 --> 6.28291035 sigma in 11act. ( 1.84481502 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 32.9714813 sigma out 1act.( 34.2132645 sig in 11act.) RANK 2 NODE 6 --> 20.446312 sigma out 1act.( 20.9138126 sig in 11act.) RANK 3 NODE 14 --> 18.537571 sigma out 1act.( 21.9561443 sig in 11act.) RANK 4 NODE 3 --> 15.6706095 sigma out 1act.( 15.9376459 sig in 11act.) RANK 5 NODE 5 --> 14.5713024 sigma out 1act.( 15.1639576 sig in 11act.) RANK 6 NODE 1 --> 8.62165642 sigma out 1act.( 11.092041 sig in 11act.) RANK 7 NODE 13 --> 8.38537025 sigma out 1act.( 9.78255844 sig in 11act.) RANK 8 NODE 8 --> 8.30352116 sigma out 1act.( 10.0007391 sig in 11act.) RANK 9 NODE 7 --> 8.05251026 sigma out 1act.( 11.031868 sig in 11act.) RANK 10 NODE 10 --> 6.38688278 sigma out 1act.( 7.26766205 sig in 11act.) RANK 11 NODE 11 --> 5.97371435 sigma out 1act.( 9.44903755 sig in 11act.) RANK 12 NODE 12 --> 4.29785204 sigma out 1act.( 8.37949276 sig in 11act.) RANK 13 NODE 9 --> 4.21370029 sigma out 1act.( 6.80211258 sig in 11act.) RANK 14 NODE 15 --> 2.52853131 sigma out 1act.( 7.94700289 sig in 11act.) RANK 15 NODE 4 --> 1.84481502 sigma out 1act.( 6.28291035 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.0350151 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.399587393 *** contribution from regularisation: 0.0038849304 *** contribution from error: -0.403472334 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.447405457 *** contribution from regularisation: 0.00234913081 *** contribution from error: -0.449754596 *********************************************** -----------------> Test sample ENTER BFGS code START -43059.4232 -0.0383099094 -0.335509449 EXIT FROM BFGS code FG_START 0. -0.0383099094 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.470061004 *** contribution from regularisation: 0.00227371301 *** contribution from error: -0.472334713 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -45229.7399 -0.0383099094 -350.887482 EXIT FROM BFGS code FG_LNSRCH 0. -0.0844714567 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.517138302 *** contribution from regularisation: 0.00313690491 *** contribution from error: -0.520275235 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49759.5631 -0.0844714567 -25.1168747 EXIT FROM BFGS code NEW_X -49759.5631 -0.0844714567 -25.1168747 ENTER BFGS code NEW_X -49759.5631 -0.0844714567 -25.1168747 EXIT FROM BFGS code FG_LNSRCH 0. -0.0925750732 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.524665654 *** contribution from regularisation: 0.00336580048 *** contribution from error: -0.528031468 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50483.8518 -0.0925750732 60.2054749 EXIT FROM BFGS code NEW_X -50483.8518 -0.0925750732 60.2054749 ENTER BFGS code NEW_X -50483.8518 -0.0925750732 60.2054749 EXIT FROM BFGS code FG_LNSRCH 0. -0.0768704489 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.52811712 *** contribution from regularisation: 0.00310404482 *** contribution from error: -0.531221151 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50815.9583 -0.0768704489 115.806938 EXIT FROM BFGS code NEW_X -50815.9583 -0.0768704489 115.806938 ENTER BFGS code NEW_X -50815.9583 -0.0768704489 115.806938 EXIT FROM BFGS code FG_LNSRCH 0. -0.00468822708 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.530243993 *** contribution from regularisation: 0.0029911173 *** contribution from error: -0.533235133 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51020.6054 -0.00468822708 53.6826744 EXIT FROM BFGS code NEW_X -51020.6054 -0.00468822708 53.6826744 ENTER BFGS code NEW_X -51020.6054 -0.00468822708 53.6826744 EXIT FROM BFGS code FG_LNSRCH 0. 0.0477801077 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.531886339 *** contribution from regularisation: 0.00293403235 *** contribution from error: -0.534820378 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51178.6383 0.0477801077 188.295425 EXIT FROM BFGS code NEW_X -51178.6383 0.0477801077 188.295425 ENTER BFGS code NEW_X -51178.6383 0.0477801077 188.295425 EXIT FROM BFGS code FG_LNSRCH 0. 0.24178867 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.534045994 *** contribution from regularisation: 0.00320641603 *** contribution from error: -0.537252426 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51386.4405 0.24178867 -19.4128227 EXIT FROM BFGS code NEW_X -51386.4405 0.24178867 -19.4128227 ENTER BFGS code NEW_X -51386.4405 0.24178867 -19.4128227 EXIT FROM BFGS code FG_LNSRCH 0. 0.346647471 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 49.6005058 sigma out 15 active outputs RANK 2 NODE 5 --> 43.1533623 sigma out 15 active outputs RANK 3 NODE 1 --> 34.1825409 sigma out 15 active outputs RANK 4 NODE 3 --> 30.0279446 sigma out 15 active outputs RANK 5 NODE 2 --> 26.9198532 sigma out 15 active outputs RANK 6 NODE 10 --> 23.6494331 sigma out 15 active outputs RANK 7 NODE 8 --> 21.6822166 sigma out 15 active outputs RANK 8 NODE 11 --> 18.9593925 sigma out 15 active outputs RANK 9 NODE 4 --> 14.7434874 sigma out 15 active outputs RANK 10 NODE 6 --> 12.3762722 sigma out 15 active outputs RANK 11 NODE 7 --> 10.0978718 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 52.7779274 sigma in 11act. ( 47.0542145 sig out 1act.) RANK 2 NODE 14 --> 43.4120865 sigma in 11act. ( 40.7507973 sig out 1act.) RANK 3 NODE 1 --> 38.5312309 sigma in 11act. ( 35.4199829 sig out 1act.) RANK 4 NODE 3 --> 31.3419933 sigma in 11act. ( 25.769186 sig out 1act.) RANK 5 NODE 5 --> 20.6653442 sigma in 11act. ( 19.6287594 sig out 1act.) RANK 6 NODE 7 --> 19.6886177 sigma in 11act. ( 17.0703869 sig out 1act.) RANK 7 NODE 6 --> 15.5414219 sigma in 11act. ( 13.6541214 sig out 1act.) RANK 8 NODE 11 --> 14.0853453 sigma in 11act. ( 13.3803301 sig out 1act.) RANK 9 NODE 12 --> 12.4728851 sigma in 11act. ( 12.71457 sig out 1act.) RANK 10 NODE 8 --> 11.3069344 sigma in 11act. ( 10.5776701 sig out 1act.) RANK 11 NODE 10 --> 10.744606 sigma in 11act. ( 10.2545614 sig out 1act.) RANK 12 NODE 4 --> 10.461113 sigma in 11act. ( 11.3595257 sig out 1act.) RANK 13 NODE 13 --> 6.15546846 sigma in 11act. ( 5.01921988 sig out 1act.) RANK 14 NODE 15 --> 5.3095746 sigma in 11act. ( 2.91402793 sig out 1act.) RANK 15 NODE 9 --> 3.53537202 sigma in 11act. ( 1.90827155 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 47.0542145 sigma out 1act.( 52.7779274 sig in 11act.) RANK 2 NODE 14 --> 40.7507973 sigma out 1act.( 43.4120865 sig in 11act.) RANK 3 NODE 1 --> 35.4199829 sigma out 1act.( 38.5312309 sig in 11act.) RANK 4 NODE 3 --> 25.769186 sigma out 1act.( 31.3419933 sig in 11act.) RANK 5 NODE 5 --> 19.6287594 sigma out 1act.( 20.6653442 sig in 11act.) RANK 6 NODE 7 --> 17.0703869 sigma out 1act.( 19.6886177 sig in 11act.) RANK 7 NODE 6 --> 13.6541214 sigma out 1act.( 15.5414219 sig in 11act.) RANK 8 NODE 11 --> 13.3803301 sigma out 1act.( 14.0853453 sig in 11act.) RANK 9 NODE 12 --> 12.71457 sigma out 1act.( 12.4728851 sig in 11act.) RANK 10 NODE 4 --> 11.3595257 sigma out 1act.( 10.461113 sig in 11act.) RANK 11 NODE 8 --> 10.5776701 sigma out 1act.( 11.3069344 sig in 11act.) RANK 12 NODE 10 --> 10.2545614 sigma out 1act.( 10.744606 sig in 11act.) RANK 13 NODE 13 --> 5.01921988 sigma out 1act.( 6.15546846 sig in 11act.) RANK 14 NODE 15 --> 2.91402793 sigma out 1act.( 5.3095746 sig in 11act.) RANK 15 NODE 9 --> 1.90827155 sigma out 1act.( 3.53537202 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 85.9102707 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.534520805 *** contribution from regularisation: 0.00320376875 *** contribution from error: -0.537724555 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51432.1244 0.346647471 63.8167686 EXIT FROM BFGS code NEW_X -51432.1244 0.346647471 63.8167686 ENTER BFGS code NEW_X -51432.1244 0.346647471 63.8167686 EXIT FROM BFGS code FG_LNSRCH 0. 0.321885735 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.535355926 *** contribution from regularisation: 0.00298053282 *** contribution from error: -0.538336456 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51512.482 0.321885735 17.4183788 EXIT FROM BFGS code NEW_X -51512.482 0.321885735 17.4183788 ENTER BFGS code NEW_X -51512.482 0.321885735 17.4183788 EXIT FROM BFGS code FG_LNSRCH 0. 0.319463849 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.535638392 *** contribution from regularisation: 0.00305453571 *** contribution from error: -0.538692951 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51539.664 0.319463849 -2.0249126 EXIT FROM BFGS code NEW_X -51539.664 0.319463849 -2.0249126 ENTER BFGS code NEW_X -51539.664 0.319463849 -2.0249126 EXIT FROM BFGS code FG_LNSRCH 0. 0.345937431 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.536880076 *** contribution from regularisation: 0.00309596816 *** contribution from error: -0.53997606 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51659.1381 0.345937431 -44.235508 EXIT FROM BFGS code NEW_X -51659.1381 0.345937431 -44.235508 ENTER BFGS code NEW_X -51659.1381 0.345937431 -44.235508 EXIT FROM BFGS code FG_LNSRCH 0. 0.377782106 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.537630141 *** contribution from regularisation: 0.00321765942 *** contribution from error: -0.540847778 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51731.3113 0.377782106 -38.0200462 EXIT FROM BFGS code NEW_X -51731.3113 0.377782106 -38.0200462 ENTER BFGS code NEW_X -51731.3113 0.377782106 -38.0200462 EXIT FROM BFGS code FG_LNSRCH 0. 0.405600637 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.537933707 *** contribution from regularisation: 0.00331021217 *** contribution from error: -0.541243911 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51760.5177 0.405600637 108.887131 EXIT FROM BFGS code NEW_X -51760.5177 0.405600637 108.887131 ENTER BFGS code NEW_X -51760.5177 0.405600637 108.887131 EXIT FROM BFGS code FG_LNSRCH 0. 0.41225782 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.538362741 *** contribution from regularisation: 0.0031814992 *** contribution from error: -0.541544259 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51801.8028 0.41225782 37.9008446 EXIT FROM BFGS code NEW_X -51801.8028 0.41225782 37.9008446 ENTER BFGS code NEW_X -51801.8028 0.41225782 37.9008446 EXIT FROM BFGS code FG_LNSRCH 0. 0.420334905 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.538500369 *** contribution from regularisation: 0.00318884407 *** contribution from error: -0.541689217 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51815.0416 0.420334905 13.9488001 EXIT FROM BFGS code NEW_X -51815.0416 0.420334905 13.9488001 ENTER BFGS code NEW_X -51815.0416 0.420334905 13.9488001 EXIT FROM BFGS code FG_LNSRCH 0. 0.477777183 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.539009571 *** contribution from regularisation: 0.00327923312 *** contribution from error: -0.54228878 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51864.0415 0.477777183 -1.26723909 EXIT FROM BFGS code NEW_X -51864.0415 0.477777183 -1.26723909 ENTER BFGS code NEW_X -51864.0415 0.477777183 -1.26723909 EXIT FROM BFGS code FG_LNSRCH 0. 0.575880527 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.539257884 *** contribution from regularisation: 0.00340213487 *** contribution from error: -0.542659998 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51887.9335 0.575880527 -232.713257 EXIT FROM BFGS code NEW_X -51887.9335 0.575880527 -232.713257 ENTER BFGS code NEW_X -51887.9335 0.575880527 -232.713257 EXIT FROM BFGS code FG_LNSRCH 0. 0.592901349 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 64.9661789 sigma out 15 active outputs RANK 2 NODE 5 --> 50.8079872 sigma out 15 active outputs RANK 3 NODE 1 --> 44.3233757 sigma out 15 active outputs RANK 4 NODE 3 --> 37.5061874 sigma out 15 active outputs RANK 5 NODE 2 --> 32.9500771 sigma out 15 active outputs RANK 6 NODE 11 --> 32.0467262 sigma out 15 active outputs RANK 7 NODE 7 --> 26.9455013 sigma out 15 active outputs RANK 8 NODE 10 --> 25.9243889 sigma out 15 active outputs RANK 9 NODE 8 --> 23.8365364 sigma out 15 active outputs RANK 10 NODE 4 --> 21.4354572 sigma out 15 active outputs RANK 11 NODE 6 --> 18.1749363 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 58.7221565 sigma in 11act. ( 59.1652641 sig out 1act.) RANK 2 NODE 14 --> 57.8824844 sigma in 11act. ( 64.4172821 sig out 1act.) RANK 3 NODE 1 --> 52.5965004 sigma in 11act. ( 55.0525513 sig out 1act.) RANK 4 NODE 3 --> 34.753643 sigma in 11act. ( 29.9409809 sig out 1act.) RANK 5 NODE 5 --> 30.3610172 sigma in 11act. ( 34.6226807 sig out 1act.) RANK 6 NODE 4 --> 29.8648796 sigma in 11act. ( 35.0757484 sig out 1act.) RANK 7 NODE 8 --> 25.0771961 sigma in 11act. ( 24.4506512 sig out 1act.) RANK 8 NODE 12 --> 23.250206 sigma in 11act. ( 25.0406971 sig out 1act.) RANK 9 NODE 11 --> 19.3695564 sigma in 11act. ( 21.030983 sig out 1act.) RANK 10 NODE 10 --> 18.0032158 sigma in 11act. ( 18.5623684 sig out 1act.) RANK 11 NODE 6 --> 16.6525898 sigma in 11act. ( 16.6134586 sig out 1act.) RANK 12 NODE 7 --> 12.7111683 sigma in 11act. ( 11.348485 sig out 1act.) RANK 13 NODE 13 --> 10.2764244 sigma in 11act. ( 9.74722767 sig out 1act.) RANK 14 NODE 9 --> 4.65657663 sigma in 11act. ( 4.55917645 sig out 1act.) RANK 15 NODE 15 --> 4.54587507 sigma in 11act. ( 3.22417092 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 64.4172821 sigma out 1act.( 57.8824844 sig in 11act.) RANK 2 NODE 2 --> 59.1652641 sigma out 1act.( 58.7221565 sig in 11act.) RANK 3 NODE 1 --> 55.0525513 sigma out 1act.( 52.5965004 sig in 11act.) RANK 4 NODE 4 --> 35.0757484 sigma out 1act.( 29.8648796 sig in 11act.) RANK 5 NODE 5 --> 34.6226807 sigma out 1act.( 30.3610172 sig in 11act.) RANK 6 NODE 3 --> 29.9409809 sigma out 1act.( 34.753643 sig in 11act.) RANK 7 NODE 12 --> 25.0406971 sigma out 1act.( 23.250206 sig in 11act.) RANK 8 NODE 8 --> 24.4506512 sigma out 1act.( 25.0771961 sig in 11act.) RANK 9 NODE 11 --> 21.030983 sigma out 1act.( 19.3695564 sig in 11act.) RANK 10 NODE 10 --> 18.5623684 sigma out 1act.( 18.0032158 sig in 11act.) RANK 11 NODE 6 --> 16.6134586 sigma out 1act.( 16.6525898 sig in 11act.) RANK 12 NODE 7 --> 11.348485 sigma out 1act.( 12.7111683 sig in 11act.) RANK 13 NODE 13 --> 9.74722767 sigma out 1act.( 10.2764244 sig in 11act.) RANK 14 NODE 9 --> 4.55917645 sigma out 1act.( 4.65657663 sig in 11act.) RANK 15 NODE 15 --> 3.22417092 sigma out 1act.( 4.54587507 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 128.643372 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.539711416 *** contribution from regularisation: 0.00345210568 *** contribution from error: -0.543163538 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51931.5725 0.592901349 -74.5966644 EXIT FROM BFGS code NEW_X -51931.5725 0.592901349 -74.5966644 ENTER BFGS code NEW_X -51931.5725 0.592901349 -74.5966644 EXIT FROM BFGS code FG_LNSRCH 0. 0.597200096 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.539972782 *** contribution from regularisation: 0.00342468335 *** contribution from error: -0.543397486 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51956.7204 0.597200096 -9.30856609 EXIT FROM BFGS code NEW_X -51956.7204 0.597200096 -9.30856609 ENTER BFGS code NEW_X -51956.7204 0.597200096 -9.30856609 EXIT FROM BFGS code FG_LNSRCH 0. 0.606661677 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.540304899 *** contribution from regularisation: 0.00347904605 *** contribution from error: -0.543783963 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51988.6777 0.606661677 61.8226929 EXIT FROM BFGS code NEW_X -51988.6777 0.606661677 61.8226929 ENTER BFGS code NEW_X -51988.6777 0.606661677 61.8226929 EXIT FROM BFGS code FG_LNSRCH 0. 0.609220386 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.540663898 *** contribution from regularisation: 0.00347083807 *** contribution from error: -0.544134736 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52023.2225 0.609220386 64.1448059 EXIT FROM BFGS code NEW_X -52023.2225 0.609220386 64.1448059 ENTER BFGS code NEW_X -52023.2225 0.609220386 64.1448059 EXIT FROM BFGS code FG_LNSRCH 0. 0.615446627 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.540557921 *** contribution from regularisation: 0.00349327107 *** contribution from error: -0.54405117 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52013.0212 0.615446627 -37.2200623 EXIT FROM BFGS code FG_LNSRCH 0. 0.611948848 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.540845573 *** contribution from regularisation: 0.00344670005 *** contribution from error: -0.544292271 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52040.7001 0.611948848 20.999136 EXIT FROM BFGS code NEW_X -52040.7001 0.611948848 20.999136 ENTER BFGS code NEW_X -52040.7001 0.611948848 20.999136 EXIT FROM BFGS code FG_LNSRCH 0. 0.60853231 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.540954649 *** contribution from regularisation: 0.0034317309 *** contribution from error: -0.544386387 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52051.1996 0.60853231 -3.58480334 EXIT FROM BFGS code NEW_X -52051.1996 0.60853231 -3.58480334 ENTER BFGS code NEW_X -52051.1996 0.60853231 -3.58480334 EXIT FROM BFGS code FG_LNSRCH 0. 0.602080345 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.541069627 *** contribution from regularisation: 0.00341588818 *** contribution from error: -0.544485509 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52062.2593 0.602080345 6.74379349 EXIT FROM BFGS code NEW_X -52062.2593 0.602080345 6.74379349 ENTER BFGS code NEW_X -52062.2593 0.602080345 6.74379349 EXIT FROM BFGS code FG_LNSRCH 0. 0.594077408 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.541246533 *** contribution from regularisation: 0.00333226449 *** contribution from error: -0.544578791 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52079.2815 0.594077408 -74.462616 EXIT FROM BFGS code NEW_X -52079.2815 0.594077408 -74.462616 ENTER BFGS code NEW_X -52079.2815 0.594077408 -74.462616 EXIT FROM BFGS code FG_LNSRCH 0. 0.580684423 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.54127562 *** contribution from regularisation: 0.00339737767 *** contribution from error: -0.544673026 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52082.0818 0.580684423 47.5287247 EXIT FROM BFGS code NEW_X -52082.0818 0.580684423 47.5287247 ENTER BFGS code NEW_X -52082.0818 0.580684423 47.5287247 EXIT FROM BFGS code FG_LNSRCH 0. 0.580757439 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 73.338356 sigma out 15 active outputs RANK 2 NODE 1 --> 54.8692055 sigma out 15 active outputs RANK 3 NODE 5 --> 47.5635071 sigma out 15 active outputs RANK 4 NODE 11 --> 38.8255882 sigma out 15 active outputs RANK 5 NODE 3 --> 37.7241669 sigma out 15 active outputs RANK 6 NODE 2 --> 37.7094803 sigma out 15 active outputs RANK 7 NODE 7 --> 31.5455227 sigma out 15 active outputs RANK 8 NODE 4 --> 28.366354 sigma out 15 active outputs RANK 9 NODE 10 --> 27.3068771 sigma out 15 active outputs RANK 10 NODE 8 --> 24.5999374 sigma out 15 active outputs RANK 11 NODE 6 --> 20.7621708 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 61.841156 sigma in 11act. ( 66.8251648 sig out 1act.) RANK 2 NODE 2 --> 56.4297295 sigma in 11act. ( 56.4691505 sig out 1act.) RANK 3 NODE 1 --> 56.0535469 sigma in 11act. ( 56.4483032 sig out 1act.) RANK 4 NODE 4 --> 45.3822784 sigma in 11act. ( 50.5920906 sig out 1act.) RANK 5 NODE 5 --> 37.1945839 sigma in 11act. ( 43.1218834 sig out 1act.) RANK 6 NODE 8 --> 36.6764183 sigma in 11act. ( 37.0140686 sig out 1act.) RANK 7 NODE 3 --> 34.0723419 sigma in 11act. ( 31.3407974 sig out 1act.) RANK 8 NODE 12 --> 29.4581127 sigma in 11act. ( 33.8891602 sig out 1act.) RANK 9 NODE 10 --> 22.2991161 sigma in 11act. ( 22.1314716 sig out 1act.) RANK 10 NODE 11 --> 20.7993393 sigma in 11act. ( 24.3983936 sig out 1act.) RANK 11 NODE 6 --> 18.3207989 sigma in 11act. ( 20.4830685 sig out 1act.) RANK 12 NODE 7 --> 12.7937002 sigma in 11act. ( 12.062335 sig out 1act.) RANK 13 NODE 13 --> 12.3227978 sigma in 11act. ( 12.3801126 sig out 1act.) RANK 14 NODE 9 --> 4.38203096 sigma in 11act. ( 4.51854324 sig out 1act.) RANK 15 NODE 15 --> 4.2299099 sigma in 11act. ( 3.55105042 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 66.8251648 sigma out 1act.( 61.841156 sig in 11act.) RANK 2 NODE 2 --> 56.4691505 sigma out 1act.( 56.4297295 sig in 11act.) RANK 3 NODE 1 --> 56.4483032 sigma out 1act.( 56.0535469 sig in 11act.) RANK 4 NODE 4 --> 50.5920906 sigma out 1act.( 45.3822784 sig in 11act.) RANK 5 NODE 5 --> 43.1218834 sigma out 1act.( 37.1945839 sig in 11act.) RANK 6 NODE 8 --> 37.0140686 sigma out 1act.( 36.6764183 sig in 11act.) RANK 7 NODE 12 --> 33.8891602 sigma out 1act.( 29.4581127 sig in 11act.) RANK 8 NODE 3 --> 31.3407974 sigma out 1act.( 34.0723419 sig in 11act.) RANK 9 NODE 11 --> 24.3983936 sigma out 1act.( 20.7993393 sig in 11act.) RANK 10 NODE 10 --> 22.1314716 sigma out 1act.( 22.2991161 sig in 11act.) RANK 11 NODE 6 --> 20.4830685 sigma out 1act.( 18.3207989 sig in 11act.) RANK 12 NODE 13 --> 12.3801126 sigma out 1act.( 12.3227978 sig in 11act.) RANK 13 NODE 7 --> 12.062335 sigma out 1act.( 12.7937002 sig in 11act.) RANK 14 NODE 9 --> 4.51854324 sigma out 1act.( 4.38203096 sig in 11act.) RANK 15 NODE 15 --> 3.55105042 sigma out 1act.( 4.2299099 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 143.516663 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.541325808 *** contribution from regularisation: 0.00343662733 *** contribution from error: -0.544762433 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52086.908 0.580757439 20.9913654 EXIT FROM BFGS code NEW_X -52086.908 0.580757439 20.9913654 ENTER BFGS code NEW_X -52086.908 0.580757439 20.9913654 EXIT FROM BFGS code FG_LNSRCH 0. 0.579960048 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.541402102 *** contribution from regularisation: 0.00341970799 *** contribution from error: -0.544821799 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52094.2492 0.579960048 11.4530392 EXIT FROM BFGS code NEW_X -52094.2492 0.579960048 11.4530392 ENTER BFGS code NEW_X -52094.2492 0.579960048 11.4530392 EXIT FROM BFGS code FG_LNSRCH 0. 0.580890596 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.541436136 *** contribution from regularisation: 0.00342320441 *** contribution from error: -0.54485935 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52097.5283 0.580890596 -14.5224104 EXIT FROM BFGS code NEW_X -52097.5283 0.580890596 -14.5224104 ENTER BFGS code NEW_X -52097.5283 0.580890596 -14.5224104 EXIT FROM BFGS code FG_LNSRCH 0. 0.578118443 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.54139322 *** contribution from regularisation: 0.003418501 *** contribution from error: -0.544811726 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52093.399 0.578118443 47.2754822 EXIT FROM BFGS code FG_LNSRCH 0. 0.579976737 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.541379809 *** contribution from regularisation: 0.00350431912 *** contribution from error: -0.544884145 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52092.1064 0.579976737 6.12420988 EXIT FROM BFGS code FG_LNSRCH 0. 0.580795228 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.541383386 *** contribution from regularisation: 0.00348016596 *** contribution from error: -0.544863522 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52092.4491 0.580795228 -12.4655228 EXIT FROM BFGS code FG_LNSRCH 0. 0.580888927 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.541389108 *** contribution from regularisation: 0.00347029557 *** contribution from error: -0.544859409 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52093.0019 0.580888927 -14.6432724 EXIT FROM BFGS code FG_LNSRCH 0. 0.580890596 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.541390359 *** contribution from regularisation: 0.00346897962 *** contribution from error: -0.54485935 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52093.1235 0.580890596 -14.685998 EXIT FROM BFGS code FG_LNSRCH 0. 0.580890596 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.541399539 *** contribution from regularisation: 0.00345981587 *** contribution from error: -0.54485935 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52094.0055 0.580890596 -14.7264137 EXIT FROM BFGS code FG_LNSRCH 0. 0.580890596 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.541394949 *** contribution from regularisation: 0.00346439937 *** contribution from error: -0.54485935 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52093.5645 0.580890596 -14.7420435 EXIT FROM BFGS code FG_LNSRCH 0. 0.580890596 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 72.5272522 sigma out 15 active outputs RANK 2 NODE 1 --> 57.3625565 sigma out 15 active outputs RANK 3 NODE 5 --> 48.9502182 sigma out 15 active outputs RANK 4 NODE 3 --> 37.1909561 sigma out 15 active outputs RANK 5 NODE 2 --> 36.3815231 sigma out 15 active outputs RANK 6 NODE 11 --> 36.351387 sigma out 15 active outputs RANK 7 NODE 7 --> 29.6940632 sigma out 15 active outputs RANK 8 NODE 4 --> 29.0695782 sigma out 15 active outputs RANK 9 NODE 10 --> 27.7667179 sigma out 15 active outputs RANK 10 NODE 8 --> 25.4398708 sigma out 15 active outputs RANK 11 NODE 6 --> 20.5045643 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 62.7516823 sigma in 11act. ( 67.052681 sig out 1act.) RANK 2 NODE 2 --> 56.8440437 sigma in 11act. ( 57.2753067 sig out 1act.) RANK 3 NODE 1 --> 54.2319412 sigma in 11act. ( 57.4050217 sig out 1act.) RANK 4 NODE 4 --> 45.5129013 sigma in 11act. ( 51.096611 sig out 1act.) RANK 5 NODE 8 --> 37.259037 sigma in 11act. ( 36.8020897 sig out 1act.) RANK 6 NODE 5 --> 36.3902969 sigma in 11act. ( 43.7979698 sig out 1act.) RANK 7 NODE 3 --> 33.7644005 sigma in 11act. ( 30.6621647 sig out 1act.) RANK 8 NODE 12 --> 29.7089405 sigma in 11act. ( 33.9066734 sig out 1act.) RANK 9 NODE 10 --> 21.8873177 sigma in 11act. ( 21.5733433 sig out 1act.) RANK 10 NODE 11 --> 20.8304081 sigma in 11act. ( 23.8845234 sig out 1act.) RANK 11 NODE 6 --> 18.9538269 sigma in 11act. ( 21.5082531 sig out 1act.) RANK 12 NODE 7 --> 12.9238043 sigma in 11act. ( 12.284112 sig out 1act.) RANK 13 NODE 13 --> 12.1212606 sigma in 11act. ( 12.0234346 sig out 1act.) RANK 14 NODE 9 --> 4.40839529 sigma in 11act. ( 4.52657032 sig out 1act.) RANK 15 NODE 15 --> 4.25484371 sigma in 11act. ( 3.59117556 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 67.052681 sigma out 1act.( 62.7516823 sig in 11act.) RANK 2 NODE 1 --> 57.4050217 sigma out 1act.( 54.2319412 sig in 11act.) RANK 3 NODE 2 --> 57.2753067 sigma out 1act.( 56.8440437 sig in 11act.) RANK 4 NODE 4 --> 51.096611 sigma out 1act.( 45.5129013 sig in 11act.) RANK 5 NODE 5 --> 43.7979698 sigma out 1act.( 36.3902969 sig in 11act.) RANK 6 NODE 8 --> 36.8020897 sigma out 1act.( 37.259037 sig in 11act.) RANK 7 NODE 12 --> 33.9066734 sigma out 1act.( 29.7089405 sig in 11act.) RANK 8 NODE 3 --> 30.6621647 sigma out 1act.( 33.7644005 sig in 11act.) RANK 9 NODE 11 --> 23.8845234 sigma out 1act.( 20.8304081 sig in 11act.) RANK 10 NODE 10 --> 21.5733433 sigma out 1act.( 21.8873177 sig in 11act.) RANK 11 NODE 6 --> 21.5082531 sigma out 1act.( 18.9538269 sig in 11act.) RANK 12 NODE 7 --> 12.284112 sigma out 1act.( 12.9238043 sig in 11act.) RANK 13 NODE 13 --> 12.0234346 sigma out 1act.( 12.1212606 sig in 11act.) RANK 14 NODE 9 --> 4.52657032 sigma out 1act.( 4.40839529 sig in 11act.) RANK 15 NODE 15 --> 3.59117556 sigma out 1act.( 4.25484371 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 144.473328 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.5413993 *** contribution from regularisation: 0.00346006663 *** contribution from error: -0.54485935 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52093.9814 0.580890596 -14.7539949 EXIT FROM BFGS code NEW_X -52093.9814 0.580890596 -14.7539949 ENTER BFGS code NEW_X -52093.9814 0.580890596 -14.7539949 EXIT FROM BFGS code CONVERGENC -52093.9814 0.580890596 -14.7539949 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 106.109558 sigma out 15 active outputs RANK 2 NODE 1 --> 83.3589249 sigma out 15 active outputs RANK 3 NODE 5 --> 70.8015442 sigma out 15 active outputs RANK 4 NODE 3 --> 55.212883 sigma out 15 active outputs RANK 5 NODE 2 --> 54.1686859 sigma out 15 active outputs RANK 6 NODE 11 --> 54.1060982 sigma out 15 active outputs RANK 7 NODE 7 --> 43.3382339 sigma out 15 active outputs RANK 8 NODE 4 --> 42.7010155 sigma out 15 active outputs RANK 9 NODE 10 --> 39.9389534 sigma out 15 active outputs RANK 10 NODE 8 --> 35.2355843 sigma out 15 active outputs RANK 11 NODE 6 --> 29.972065 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 91.7803268 sigma in 11act. ( 96.8791504 sig out 1act.) RANK 2 NODE 2 --> 83.2346725 sigma in 11act. ( 84.6741867 sig out 1act.) RANK 3 NODE 1 --> 79.8538895 sigma in 11act. ( 83.1843185 sig out 1act.) RANK 4 NODE 4 --> 67.0188828 sigma in 11act. ( 73.5567856 sig out 1act.) RANK 5 NODE 8 --> 54.0384293 sigma in 11act. ( 55.1883125 sig out 1act.) RANK 6 NODE 5 --> 53.1823692 sigma in 11act. ( 63.7738838 sig out 1act.) RANK 7 NODE 3 --> 48.5473289 sigma in 11act. ( 45.466362 sig out 1act.) RANK 8 NODE 12 --> 42.2585258 sigma in 11act. ( 50.5735474 sig out 1act.) RANK 9 NODE 10 --> 32.2599907 sigma in 11act. ( 32.0365715 sig out 1act.) RANK 10 NODE 11 --> 30.3744965 sigma in 11act. ( 34.9934006 sig out 1act.) RANK 11 NODE 6 --> 27.8955116 sigma in 11act. ( 31.1106205 sig out 1act.) RANK 12 NODE 7 --> 18.3698006 sigma in 11act. ( 18.058857 sig out 1act.) RANK 13 NODE 13 --> 17.6688976 sigma in 11act. ( 17.5625725 sig out 1act.) RANK 14 NODE 9 --> 6.12035227 sigma in 11act. ( 6.53362274 sig out 1act.) RANK 15 NODE 15 --> 5.29404211 sigma in 11act. ( 5.30885124 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 96.8791504 sigma out 1act.( 91.7803268 sig in 11act.) RANK 2 NODE 2 --> 84.6741867 sigma out 1act.( 83.2346725 sig in 11act.) RANK 3 NODE 1 --> 83.1843185 sigma out 1act.( 79.8538895 sig in 11act.) RANK 4 NODE 4 --> 73.5567856 sigma out 1act.( 67.0188828 sig in 11act.) RANK 5 NODE 5 --> 63.7738838 sigma out 1act.( 53.1823692 sig in 11act.) RANK 6 NODE 8 --> 55.1883125 sigma out 1act.( 54.0384293 sig in 11act.) RANK 7 NODE 12 --> 50.5735474 sigma out 1act.( 42.2585258 sig in 11act.) RANK 8 NODE 3 --> 45.466362 sigma out 1act.( 48.5473289 sig in 11act.) RANK 9 NODE 11 --> 34.9934006 sigma out 1act.( 30.3744965 sig in 11act.) RANK 10 NODE 10 --> 32.0365715 sigma out 1act.( 32.2599907 sig in 11act.) RANK 11 NODE 6 --> 31.1106205 sigma out 1act.( 27.8955116 sig in 11act.) RANK 12 NODE 7 --> 18.058857 sigma out 1act.( 18.3698006 sig in 11act.) RANK 13 NODE 13 --> 17.5625725 sigma out 1act.( 17.6688976 sig in 11act.) RANK 14 NODE 9 --> 6.53362274 sigma out 1act.( 6.12035227 sig in 11act.) RANK 15 NODE 15 --> 5.30885124 sigma out 1act.( 5.29404211 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 211.062653 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.541401625 *** contribution from regularisation: 0.00345772295 *** contribution from error: -0.54485935 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30761 Closing output file done