NNInput NNInputs_130.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 186466 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 46666 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 46666 Chosen entries: 46666 Signal fraction: 1 Background fraction: 0.333805 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 46666 Entries to split: 46666 Test with : 23333 Train with : 23333 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 46666 for Signal Prepared event 0 for Signal with 46666 events ====Entry 0 Variable Ht : 151.435 Variable LepAPt : 41.3573 Variable LepBPt : 14.9662 Variable MetSigLeptonsJets : 5.83672 Variable MetSpec : 56.7846 Variable SumEtLeptonsJets : 94.6508 Variable VSumJetLeptonsPt : 42.3463 Variable addEt : 113.108 Variable dPhiLepSumMet : 2.38762 Variable dPhiLeptons : 0.421366 Variable dRLeptons : 0.581604 Variable lep1_E : 44.5356 Variable lep2_E : 14.9672 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2130 Ht = 151.435 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 41.3573 LepAPt = 41.3573 LepBEt = 14.9662 LepBPt = 14.9662 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 56.7846 MetDelPhi = 1.62286 MetSig = 5.01275 MetSigLeptonsJets = 5.83672 MetSpec = 56.7846 Mjj = 0 MostCentralJetEta = 2.41678 MtllMet = 115.132 Njets = 1 SB = 0 SumEt = 128.324 SumEtJets = 0 SumEtLeptonsJets = 94.6508 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 42.3463 addEt = 113.108 dPhiLepSumMet = 2.38762 dPhiLeptons = 0.421366 dRLeptons = 0.581604 diltype = 55 dimass = 14.4601 event = 2096 jet1_Et = 38.3273 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 44.5356 lep2_E = 14.9672 rand = 0.999742 run = 195245 weight = 2.27324e-06 ===Show End Prepared event 10000 for Signal with 46666 events Prepared event 20000 for Signal with 46666 events Prepared event 30000 for Signal with 46666 events Prepared event 40000 for Signal with 46666 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.266497 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4430 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 186466 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4430 negative weights. Signal fraction: 62.1884041 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1575966 65.281723 67.0481415 68.1225739 68.94561 70.0650864 70.7410736 71.5170441 72.4498749 73.2343521 73.9277191 74.4265442 75.1030045 75.5708923 76.1909027 76.8443909 77.3619843 77.8945618 78.477623 79.0872726 79.6494446 80.2571869 80.8942566 81.5082626 82.1424103 82.693634 83.4151764 84.1585007 85.0908508 85.9185333 86.8583984 87.7629089 88.7463226 89.9401093 90.9397278 91.9674072 93.1451569 94.4337158 95.6438293 96.6286926 97.8839417 98.8515472 99.7290344 100.816483 101.755661 102.866875 103.922554 104.739395 105.698219 106.648811 107.649277 108.670456 109.803497 110.803543 111.837631 112.88266 113.920654 114.949448 116.116562 117.118942 118.216171 119.300926 120.065628 121.279716 122.443756 123.524094 124.765335 125.946754 127.24559 128.54953 130.001099 131.45607 133.007324 134.70462 136.496674 138.098724 140.113953 142.096313 144.190857 146.345825 148.814255 151.203888 153.596283 155.967316 158.823318 162.015839 165.535217 169.1483 172.995361 176.808044 182.00061 187.709503 194.342392 202.333557 211.677368 224.113647 238.829819 261.990814 306.391418 705.443726 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.274807 20.5766563 20.8148441 21.0734386 21.318119 21.5663071 21.8013878 21.9904099 22.184845 22.3762512 22.5846939 22.7684669 22.9542961 23.1397972 23.2760181 23.4658813 23.6558914 23.8075943 24.0258274 24.2133102 24.4285736 24.5894413 24.8125324 24.9924335 25.1804619 25.3471298 25.5225468 25.6879807 25.8807487 26.0449409 26.2055244 26.3781338 26.5651054 26.7932472 26.9997406 27.2230759 27.4178276 27.633194 27.8152695 27.9837303 28.1598034 28.3698044 28.5700493 28.7791862 28.9869175 29.179821 29.3786297 29.6243134 29.7946396 30.042408 30.297966 30.5456657 30.7475204 31.0099754 31.2697487 31.4695148 31.7079601 31.9667835 32.1931915 32.4675674 32.7182846 32.9781876 33.2394638 33.5147324 33.7846031 34.1006126 34.376236 34.7036057 34.9890366 35.3073425 35.5943222 35.9566879 36.3495026 36.7311783 37.0592194 37.4809036 37.8705215 38.315567 38.7333298 39.170784 39.5681381 40.0824661 40.6512947 41.0346603 41.6245728 42.2219353 42.9136467 43.6145096 44.461937 45.3347549 46.261013 47.3545761 48.61549 50.3980675 52.1686325 54.4641724 57.9746857 62.8410492 70.9168549 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1002922 10.2106915 10.3410816 10.4422827 10.5218115 10.6520309 10.7836437 10.8977098 10.9928246 11.0911589 11.2139969 11.3223648 11.4254303 11.5502472 11.6637745 11.7590265 11.8906822 12.0195122 12.1499443 12.2708225 12.4095058 12.5584593 12.6850853 12.8042583 12.9354992 13.0590382 13.1952991 13.3532648 13.477706 13.6116486 13.7425261 13.8740311 14.0246048 14.1538582 14.2913208 14.4496307 14.6263485 14.800374 14.9641609 15.13307 15.2999582 15.43999 15.588192 15.7323761 15.8629112 16.0159454 16.2107506 16.3968182 16.5603104 16.7442455 16.8957748 17.0864487 17.2891998 17.4910316 17.707283 17.8874245 18.0152988 18.2147446 18.4474831 18.6460037 18.8435783 19.0488014 19.2794838 19.4963017 19.7236347 19.9742432 20.1801414 20.3301945 20.5602913 20.7774029 21.0037079 21.2440205 21.4749184 21.6866608 21.9134159 22.1193123 22.4047546 22.6738911 22.9775772 23.2703705 23.5765724 23.8999405 24.230381 24.5492477 24.9076424 25.3045959 25.7522774 26.1817131 26.5580025 27.0581684 27.6060085 28.1504784 28.7440491 29.5747604 30.4736748 31.432827 32.8340607 34.8327332 39.3315125 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.23124409 2.46999884 2.9044981 3.14326429 3.35324478 3.56338596 3.74099016 3.89964724 4.05042553 4.15771818 4.26916647 4.3834219 4.48434305 4.57584858 4.6473732 4.72720098 4.80262375 4.88164139 4.95599794 5.01697826 5.08754873 5.15378904 5.20985317 5.26925659 5.31972551 5.37366247 5.42522526 5.4621954 5.50955009 5.54006815 5.58409691 5.6291275 5.66724825 5.71972179 5.76464558 5.80642509 5.84559488 5.88814735 5.92239523 5.96171761 6.00294352 6.03711128 6.07208109 6.10813332 6.14565277 6.18560171 6.22726727 6.26703167 6.30259228 6.33970356 6.3789072 6.41561413 6.45165682 6.49223948 6.53068542 6.5726676 6.61364174 6.64789534 6.68867397 6.72889042 6.76819038 6.81468916 6.85800028 6.8888855 6.93046951 6.96838093 7.01663399 7.05526257 7.09706259 7.14340401 7.18929386 7.23866177 7.28701878 7.32896376 7.37807465 7.42340183 7.47133112 7.51320982 7.56753731 7.61703014 7.67475557 7.7320199 7.789855 7.85332775 7.91563511 7.97842693 8.05128098 8.11407757 8.19140434 8.26659679 8.36070061 8.45208359 8.56277084 8.69182205 8.83015633 8.98439217 9.19840145 9.47911072 9.92182541 10.7643967 20.0349483 ------------------------------ Transdef: Tab for variable 6 15.0050735 19.5708122 24.0803833 25.710186 26.6190681 27.3649731 28.2174683 28.990324 29.7420044 30.3758373 30.9434052 31.5608349 32.0739746 32.5370445 32.9729614 33.4749222 33.9053917 34.3116035 34.6859207 34.992733 35.3563309 35.7266006 36.0863228 36.4339561 36.7429543 37.0083466 37.3239136 37.6387253 37.9479675 38.2700539 38.5863419 38.9196968 39.3178978 39.5914536 39.9062004 40.2102814 40.4985733 40.8160172 41.1489792 41.5403175 41.9168167 42.2310867 42.5945587 42.9358902 43.2117081 43.6399651 43.9950485 44.4522324 44.8485947 45.3261604 45.7435684 46.2264977 46.6964684 47.1993484 47.6665878 48.1427612 48.6700096 49.1296844 49.5884933 50.0457268 50.4638977 50.9305382 51.491024 51.9796028 52.4824371 53.0315857 53.5409355 54.0950241 54.5240555 55.0906296 55.6023216 56.0992966 56.6236458 57.1601105 57.6852798 58.2605972 58.7178192 59.2716599 59.8604507 60.5046158 61.0981903 61.7566605 62.4797821 63.2056885 63.9685669 64.7110596 65.5336761 66.4472809 67.4927063 68.6188965 69.9123077 71.2814331 72.9391479 74.9638519 76.7265167 79.3143463 82.5213394 86.6069489 92.6560059 103.321747 218.598831 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.808075 33.7022629 34.262558 34.9314613 35.4399338 35.8564148 36.2106743 36.5738754 36.9202652 37.2882004 37.614357 37.9244232 38.213028 38.5006218 38.7625504 38.9927673 39.2412949 39.4548035 39.7074661 40.0755959 40.3411598 40.6258011 40.9428177 41.3059387 41.5772095 41.9474754 42.3228836 42.7492218 43.0999985 43.5316391 44.0921822 44.5940895 45.1014633 45.578392 46.2340851 46.8599167 47.3453484 47.9946671 48.6099205 49.2624588 49.9075279 50.6615524 51.2812119 51.9426117 52.6262589 53.2404404 53.8754654 54.55159 55.1714554 55.8011627 56.3826752 57.1032181 57.6448441 58.2680435 58.932457 59.6517029 60.3269157 61.0031662 61.5303726 62.2818642 62.9626579 63.7924957 64.6048126 65.5387955 66.5518799 67.6187592 68.807724 70.0527191 71.2958145 72.6194229 73.9069672 75.2745667 76.7706375 78.2271881 79.7032547 81.2986755 82.771225 84.4862366 86.1847229 88.1911011 90.3184586 92.4029541 94.6501083 97.0193176 99.3747406 102.010071 105.016815 108.098251 111.549011 114.980598 119.031624 123.735397 128.857483 135.835144 143.051453 152.979263 165.971756 185.875702 219.594315 486.933777 ------------------------------ Transdef: Tab for variable 8 1.83868217 22.4673691 27.1564808 29.3599911 30.9049263 31.8449001 32.6468849 33.1699905 33.6060104 34.0259209 34.4226265 34.807045 35.135437 35.4375839 35.7584763 36.0590935 36.3211517 36.5439415 36.8213577 37.1257248 37.3353424 37.5849991 37.8224716 38.0788002 38.3137779 38.5637627 38.8177414 38.99823 39.2815933 39.5340729 39.7883148 40.0615196 40.31287 40.5879059 40.9030342 41.1864815 41.4300041 41.7675591 42.0894318 42.4620438 42.7284317 43.094368 43.433075 43.764782 44.1646156 44.5763931 44.9999504 45.4383392 45.8566933 46.2584457 46.7541046 47.1773987 47.6508446 48.02005 48.4809875 48.8936729 49.3362656 49.8505402 50.3400917 50.7763596 51.2028999 51.6847496 52.1720123 52.6495399 53.1233063 53.5696182 54.0197449 54.4554291 54.9160233 55.4301643 55.9194946 56.4700928 56.9448013 57.453022 57.9404373 58.4881516 59.0462189 59.6544266 60.1851578 60.7896271 61.2748871 61.9429932 62.6744003 63.4156952 64.1985626 65.0157394 65.9185028 66.937851 68.102356 69.4022369 70.7834549 72.3690338 74.3320465 76.3339005 78.7712555 81.7733307 85.6539764 90.508461 98.3311081 116.157883 296.803314 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.5413437 64.5796509 66.0990753 67.3698578 68.2803497 69.0894089 70.0201111 70.6329956 71.3569336 72.0744171 72.8554764 73.5059052 74.0406494 74.5104218 75.1261749 75.5471725 76.0356293 76.6405411 77.0623322 77.5442352 78.0591125 78.5441895 79.0395966 79.5469513 79.9750671 80.6387863 81.1167755 81.6164703 82.1460266 82.6208954 83.1997986 83.728035 84.3296967 85.0229416 85.6974106 86.4087982 86.9113617 87.5845947 88.4283295 89.1360474 90.039978 90.6873932 91.616745 92.4283295 93.2722931 94.2272339 95.0928497 96.0479889 96.8150635 97.7138672 98.6004639 99.3172302 100.173256 101.034355 101.791901 102.577576 103.405975 104.185883 104.932816 105.687256 106.473938 107.324585 108.113319 108.944321 109.796432 110.51564 111.315948 112.117218 112.92662 113.654533 114.45002 115.172852 115.999039 116.731049 117.636581 118.445824 119.245262 119.88356 120.806366 121.643661 122.503143 123.358917 124.304062 125.299622 126.242241 127.342148 128.458862 129.780914 131.179398 132.509399 134.062317 136.16243 138.432037 141.42926 144.950378 149.791199 156.321594 167.142944 191.919861 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.876738667 1.19352782 1.40150523 1.56688631 1.704808 1.81469595 1.91332567 1.99901247 2.07043409 2.13555527 2.19242406 2.24339652 2.29194164 2.33986831 2.38308263 2.41988349 2.45288706 2.48589516 2.51665878 2.54563689 2.57355762 2.59970045 2.62371206 2.64912963 2.67410517 2.69603968 2.71636629 2.73674154 2.75440168 2.77189565 2.78793049 2.80202103 2.81666136 2.82814503 2.84283757 2.85486436 2.86632323 2.87713623 2.88793111 2.89762783 2.90767264 2.91474962 2.92304945 2.93101931 2.93853331 2.94729209 2.95465732 2.9608593 2.96696949 2.97323132 2.97881603 2.98413754 2.98861575 2.99363685 2.9978199 3.00298524 3.00741601 3.01237202 3.01642966 3.02078152 3.02500391 3.02859354 3.03242421 3.03683066 3.04093957 3.04421878 3.04834414 3.05231023 3.05634594 3.05968475 3.0628612 3.06625867 3.06913638 3.07265282 3.07552814 3.07866669 3.08188295 3.08516908 3.08824062 3.09126377 3.09419465 3.09678388 3.09960508 3.10189247 3.10488725 3.10785794 3.11044884 3.11342645 3.11575413 3.11829925 3.12080717 3.12332773 3.12576246 3.12826109 3.13030028 3.13208628 3.13441038 3.1366024 3.13892126 3.1415844 ------------------------------ Transdef: Tab for variable 11 1.91926956E-05 0.00577604771 0.00957247242 0.015675962 0.0230917931 0.0298079848 0.0385670774 0.0470820069 0.0568822026 0.06448856 0.073409915 0.0816156864 0.0896952003 0.0967297852 0.104318619 0.111414373 0.119394228 0.127626717 0.135741115 0.144478872 0.152463973 0.159939647 0.166852951 0.174636126 0.181436896 0.187854528 0.195734382 0.202351809 0.208981097 0.215270996 0.222078681 0.228536278 0.233783603 0.239575863 0.24589631 0.252003193 0.257992506 0.263504088 0.269518405 0.275378764 0.280683517 0.286056638 0.292381525 0.298063815 0.303433895 0.309489727 0.314908147 0.320699692 0.326838285 0.333176017 0.339006454 0.34450525 0.34976387 0.354661763 0.360449791 0.366442412 0.372282147 0.377933502 0.38396576 0.389235377 0.39584896 0.402046889 0.408101678 0.414432466 0.421316743 0.4270643 0.433338881 0.439122915 0.44595027 0.451629102 0.457689941 0.463603139 0.470191002 0.476109356 0.482759297 0.490207314 0.497420549 0.505368233 0.512134671 0.519733906 0.527552545 0.53441453 0.540136874 0.548897624 0.556665659 0.566991806 0.576720953 0.586494088 0.596948862 0.608337283 0.622925997 0.635256052 0.648056269 0.663579226 0.681720972 0.702225566 0.724009633 0.756132662 0.794887424 0.853708088 1.14136529 ------------------------------ Transdef: Tab for variable 12 0.20003137 0.223666668 0.240088969 0.253420174 0.265864909 0.275939763 0.284514546 0.294639647 0.304053485 0.312955201 0.321331084 0.329224765 0.336469471 0.343912721 0.350694269 0.35591951 0.362842858 0.369772375 0.376222491 0.382621884 0.388843238 0.39480722 0.399915785 0.404799998 0.409693778 0.413655818 0.417408168 0.422036767 0.425589085 0.429835677 0.433645189 0.437514335 0.440866679 0.444597185 0.448191404 0.452428192 0.456700891 0.460674226 0.464975595 0.469096184 0.472304374 0.47644037 0.479269624 0.48284179 0.486437261 0.489788234 0.493399084 0.497333586 0.501255512 0.505313635 0.509423673 0.513098717 0.517359018 0.52123785 0.524970889 0.529441595 0.533450127 0.537816644 0.542157888 0.547226548 0.550869644 0.55510354 0.559659839 0.564474225 0.568992853 0.573527753 0.577859223 0.582398057 0.587996483 0.59360671 0.597560883 0.603784144 0.609510064 0.615839601 0.621098518 0.627535999 0.633598924 0.63894707 0.645467937 0.651686609 0.65879035 0.663837671 0.671555758 0.678827405 0.688623548 0.697153211 0.705238402 0.714608192 0.721662402 0.730594933 0.741022289 0.752452493 0.763648212 0.775741816 0.791151881 0.806368351 0.825999379 0.849249005 0.877105713 0.921346903 1.14755547 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3672333 22.1168194 22.6278229 23.2114372 23.6803017 24.1836834 24.6355438 25.0789146 25.4751968 25.8219013 26.1785679 26.5644741 26.9348373 27.2806892 27.6586666 27.9881287 28.2926121 28.5916653 28.9013329 29.2140312 29.4522514 29.7612247 30.0666122 30.343853 30.6295967 30.9043484 31.1284447 31.42313 31.7187767 32.0079956 32.3085556 32.5674744 32.8844528 33.1372833 33.4344864 33.7335205 34.0673599 34.3449516 34.6279526 34.9658737 35.2836876 35.5468445 35.8929901 36.1881714 36.4371605 36.8311462 37.1729584 37.5432587 37.8958206 38.2729034 38.6099014 39.0005112 39.4119186 39.7952118 40.1818619 40.5572929 40.97686 41.4095612 41.8500214 42.3036652 42.7872581 43.2849274 43.70784 44.2004623 44.7021904 45.2376404 45.7669144 46.3497314 46.8521614 47.4297104 48.0345154 48.6628723 49.4082832 50.14151 50.8890877 51.7694969 52.5485001 53.4192734 54.3078384 55.2407684 56.1494522 57.1531143 58.2435379 59.1610107 60.3790665 61.6944542 63.1115341 64.6725006 66.5619888 68.1233368 69.4700623 71.5522614 74.3490067 77.084816 80.514679 84.3508759 88.2750702 93.8608856 105.21904 230.5327 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6318512 11.0877514 11.3615303 11.6638527 11.9159937 12.2123814 12.4492531 12.7452021 12.9966488 13.255271 13.5104027 13.7513771 13.9671183 14.1965885 14.4513311 14.6899576 14.902832 15.1427259 15.3974276 15.5946875 15.7987518 16.0255585 16.2816696 16.4826622 16.6698761 16.8713875 17.0845776 17.3003578 17.5359879 17.7368927 17.9328003 18.1470623 18.3581619 18.5797176 18.7941036 19.0258217 19.193924 19.4316673 19.70154 19.9551105 20.199543 20.4604568 20.7030697 20.9292946 21.1794758 21.4215298 21.6511402 21.8369598 22.0566864 22.3320923 22.582222 22.8149929 23.0708141 23.3004227 23.5635567 23.8289261 24.1154346 24.3569908 24.6196175 24.8841 25.1635284 25.4356556 25.7114563 25.9632339 26.2730122 26.5552158 26.8778648 27.2026939 27.5189323 27.8088646 28.0544014 28.3999023 28.7630272 29.1469822 29.5334682 29.9068165 30.3056412 30.7268372 31.1481552 31.5620461 32.0032272 32.5101204 33.0485764 33.4473686 34.0454178 34.6959229 35.3632965 36.1744614 37.092804 38.0282898 39.0438461 39.9237404 41.2294693 42.7503586 44.4603806 47.1131248 49.7493057 54.0186882 60.7052193 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 56.9 39.6 39.7 12.7 36.7 55.2 42.1 53.4 -29.7 -9.2 -25.3 4.0 7.2 2 56.9 100.0 63.0 50.8 21.0 60.8 93.9 66.9 90.3 -51.3 -19.9 -42.6 28.9 22.5 3 39.6 63.0 100.0 28.4 -2.0 26.6 66.2 47.7 68.9 -19.4 -20.7 -46.7 62.6 9.1 4 39.7 50.8 28.4 100.0 1.6 24.6 52.7 40.2 55.8 -14.4 -25.3 -53.8 8.7 66.8 5 12.7 21.0 -2.0 1.6 100.0 80.8 -7.2 47.1 47.1 26.7 -0.5 1.2 -9.1 -4.8 6 36.7 60.8 26.6 24.6 80.8 100.0 38.4 73.0 75.8 -5.6 -9.8 -18.8 5.9 6.7 7 55.2 93.9 66.2 52.7 -7.2 38.4 100.0 59.7 77.7 -57.9 -19.5 -44.0 33.4 25.4 8 42.1 66.9 47.7 40.2 47.1 73.0 59.7 100.0 78.0 -12.3 -18.4 -34.2 21.9 18.5 9 53.4 90.3 68.9 55.8 47.1 75.8 77.7 78.0 100.0 -25.9 -22.4 -48.1 33.7 26.7 10 -29.7 -51.3 -19.4 -14.4 26.7 -5.6 -57.9 -12.3 -25.9 100.0 3.4 10.1 -6.6 -4.0 11 -9.2 -19.9 -20.7 -25.3 -0.5 -9.8 -19.5 -18.4 -22.4 3.4 100.0 54.2 -8.9 -14.9 12 -25.3 -42.6 -46.7 -53.8 1.2 -18.8 -44.0 -34.2 -48.1 10.1 54.2 100.0 -21.8 -27.6 13 4.0 28.9 62.6 8.7 -9.1 5.9 33.4 21.9 33.7 -6.6 -8.9 -21.8 100.0 40.2 14 7.2 22.5 9.1 66.8 -4.8 6.7 25.4 18.5 26.7 -4.0 -14.9 -27.6 40.2 100.0 TOTAL CORRELATION TO TARGET (diagonal) 131.327438 TOTAL CORRELATION OF ALL VARIABLES 63.5903963 ROUND 1: MAX CORR ( 63.5740812) AFTER KILLING INPUT VARIABLE 8 CONTR 1.44038163 ROUND 2: MAX CORR ( 63.5464955) AFTER KILLING INPUT VARIABLE 11 CONTR 1.87262206 ROUND 3: MAX CORR ( 63.4274076) AFTER KILLING INPUT VARIABLE 2 CONTR 3.88857963 ROUND 4: MAX CORR ( 63.2412111) AFTER KILLING INPUT VARIABLE 6 CONTR 4.85646539 ROUND 5: MAX CORR ( 63.1131512) AFTER KILLING INPUT VARIABLE 9 CONTR 4.02255217 ROUND 6: MAX CORR ( 62.8426244) AFTER KILLING INPUT VARIABLE 10 CONTR 5.83732852 ROUND 7: MAX CORR ( 62.4470691) AFTER KILLING INPUT VARIABLE 14 CONTR 7.03981623 ROUND 8: MAX CORR ( 62.0203358) AFTER KILLING INPUT VARIABLE 12 CONTR 7.2879618 ROUND 9: MAX CORR ( 61.078144) AFTER KILLING INPUT VARIABLE 4 CONTR 10.7695114 ROUND 10: MAX CORR ( 59.4043452) AFTER KILLING INPUT VARIABLE 5 CONTR 14.2008253 ROUND 11: MAX CORR ( 57.263647) AFTER KILLING INPUT VARIABLE 3 CONTR 15.8035111 ROUND 12: MAX CORR ( 55.1704541) AFTER KILLING INPUT VARIABLE 13 CONTR 15.3409993 LAST REMAINING VARIABLE: 7 total correlation to target: 63.5903963 % total significance: 123.430637 sigma correlations of single variables to target: variable 2: 56.9407827 % , in sigma: 110.523562 variable 3: 39.6447261 % , in sigma: 76.9514594 variable 4: 39.6784665 % , in sigma: 77.0169504 variable 5: 12.6707373 % , in sigma: 24.5942354 variable 6: 36.7460089 % , in sigma: 71.3249728 variable 7: 55.1704541 % , in sigma: 107.087307 variable 8: 42.102446 % , in sigma: 81.7219586 variable 9: 53.4379938 % , in sigma: 103.724556 variable 10: -29.69932 % , in sigma: 57.6471636 variable 11: -9.15489498 % , in sigma: 17.7698927 variable 12: -25.3274873 % , in sigma: 49.161321 variable 13: 3.97835212 % , in sigma: 7.72208642 variable 14: 7.2496063 % , in sigma: 14.0716771 variables sorted by significance: 1 most relevant variable 7 corr 55.1704559 , in sigma: 107.087311 2 most relevant variable 13 corr 15.3409996 , in sigma: 29.777285 3 most relevant variable 3 corr 15.8035107 , in sigma: 30.6750312 4 most relevant variable 5 corr 14.2008257 , in sigma: 27.5641773 5 most relevant variable 4 corr 10.7695112 , in sigma: 20.9039054 6 most relevant variable 12 corr 7.28796196 , in sigma: 14.1461265 7 most relevant variable 14 corr 7.03981638 , in sigma: 13.6644693 8 most relevant variable 10 corr 5.83732843 , in sigma: 11.3304085 9 most relevant variable 9 corr 4.02255201 , in sigma: 7.80787959 10 most relevant variable 6 corr 4.85646534 , in sigma: 9.42652736 11 most relevant variable 2 corr 3.88857961 , in sigma: 7.54783562 12 most relevant variable 11 corr 1.87262201 , in sigma: 3.63480874 13 most relevant variable 8 corr 1.44038165 , in sigma: 2.79581878 global correlations between input variables: variable 2: 99.0406961 % variable 3: 93.2420662 % variable 4: 90.6336572 % variable 5: 94.8802836 % variable 6: 93.6488434 % variable 7: 98.5061386 % variable 8: 86.4715182 % variable 9: 98.8122447 % variable 10: 72.1277412 % variable 11: 55.195886 % variable 12: 73.9434699 % variable 13: 84.3008483 % variable 14: 85.9169036 % significance loss when removing single variables: variable 2: corr = 4.18016473 % , sigma = 8.11381003 variable 3: corr = 13.072513 % , sigma = 25.3740927 variable 4: corr = 15.6799053 % , sigma = 30.4351099 variable 5: corr = 5.48931262 % , sigma = 10.6549006 variable 6: corr = 3.96571118 % , sigma = 7.69755004 variable 7: corr = 3.439954 % , sigma = 6.67704147 variable 8: corr = 1.44038163 % , sigma = 2.79581875 variable 9: corr = 6.57330816 % , sigma = 12.7589646 variable 10: corr = 5.19617907 % , sigma = 10.0859207 variable 11: corr = 1.96366356 % , sigma = 3.81152278 variable 12: corr = 5.3400845 % , sigma = 10.3652449 variable 13: corr = 8.55752961 % , sigma = 16.6103908 variable 14: corr = 6.7071713 % , sigma = 13.0187965 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 16.2727165 sigma out 15 active outputs RANK 2 NODE 1 --> 13.9128799 sigma out 15 active outputs RANK 3 NODE 4 --> 13.5171061 sigma out 15 active outputs RANK 4 NODE 10 --> 11.7712498 sigma out 15 active outputs RANK 5 NODE 7 --> 10.0109053 sigma out 15 active outputs RANK 6 NODE 5 --> 9.61477184 sigma out 15 active outputs RANK 7 NODE 8 --> 8.37180901 sigma out 15 active outputs RANK 8 NODE 2 --> 8.29349327 sigma out 15 active outputs RANK 9 NODE 12 --> 7.34180975 sigma out 15 active outputs RANK 10 NODE 9 --> 6.56657696 sigma out 15 active outputs RANK 11 NODE 11 --> 6.18272209 sigma out 15 active outputs RANK 12 NODE 6 --> 4.41661119 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 17.5937862 sigma in 12act. ( 17.2788162 sig out 1act.) RANK 2 NODE 4 --> 16.7448483 sigma in 12act. ( 18.7675495 sig out 1act.) RANK 3 NODE 7 --> 13.2793655 sigma in 12act. ( 14.0535603 sig out 1act.) RANK 4 NODE 5 --> 10.6587057 sigma in 12act. ( 9.29795361 sig out 1act.) RANK 5 NODE 15 --> 8.89943504 sigma in 12act. ( 5.23623085 sig out 1act.) RANK 6 NODE 1 --> 8.74191666 sigma in 12act. ( 7.56372118 sig out 1act.) RANK 7 NODE 11 --> 6.99535608 sigma in 12act. ( 7.20551109 sig out 1act.) RANK 8 NODE 2 --> 6.74774933 sigma in 12act. ( 4.94386196 sig out 1act.) RANK 9 NODE 12 --> 5.82895279 sigma in 12act. ( 7.82181978 sig out 1act.) RANK 10 NODE 8 --> 4.93319511 sigma in 12act. ( 3.37785864 sig out 1act.) RANK 11 NODE 3 --> 4.6453743 sigma in 12act. ( 2.1663363 sig out 1act.) RANK 12 NODE 10 --> 4.6247344 sigma in 12act. ( 5.75504827 sig out 1act.) RANK 13 NODE 13 --> 4.20909882 sigma in 12act. ( 3.49916983 sig out 1act.) RANK 14 NODE 9 --> 3.23904538 sigma in 12act. ( 5.96696806 sig out 1act.) RANK 15 NODE 14 --> 2.54406023 sigma in 12act. ( 0.900653362 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 18.7675495 sigma out 1act.( 16.7448483 sig in 12act.) RANK 2 NODE 6 --> 17.2788162 sigma out 1act.( 17.5937862 sig in 12act.) RANK 3 NODE 7 --> 14.0535603 sigma out 1act.( 13.2793655 sig in 12act.) RANK 4 NODE 5 --> 9.29795361 sigma out 1act.( 10.6587057 sig in 12act.) RANK 5 NODE 12 --> 7.82181978 sigma out 1act.( 5.82895279 sig in 12act.) RANK 6 NODE 1 --> 7.56372118 sigma out 1act.( 8.74191666 sig in 12act.) RANK 7 NODE 11 --> 7.20551109 sigma out 1act.( 6.99535608 sig in 12act.) RANK 8 NODE 9 --> 5.96696806 sigma out 1act.( 3.23904538 sig in 12act.) RANK 9 NODE 10 --> 5.75504827 sigma out 1act.( 4.6247344 sig in 12act.) RANK 10 NODE 15 --> 5.23623085 sigma out 1act.( 8.89943504 sig in 12act.) RANK 11 NODE 2 --> 4.94386196 sigma out 1act.( 6.74774933 sig in 12act.) RANK 12 NODE 13 --> 3.49916983 sigma out 1act.( 4.20909882 sig in 12act.) RANK 13 NODE 8 --> 3.37785864 sigma out 1act.( 4.93319511 sig in 12act.) RANK 14 NODE 3 --> 2.1663363 sigma out 1act.( 4.6453743 sig in 12act.) RANK 15 NODE 14 --> 0.900653362 sigma out 1act.( 2.54406023 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 35.422966 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 3 --> 18.394598 sigma out 15 active outputs RANK 2 NODE 12 --> 14.4354296 sigma out 15 active outputs RANK 3 NODE 10 --> 14.2435532 sigma out 15 active outputs RANK 4 NODE 4 --> 14.0902443 sigma out 15 active outputs RANK 5 NODE 1 --> 14.0393028 sigma out 15 active outputs RANK 6 NODE 5 --> 12.7009306 sigma out 15 active outputs RANK 7 NODE 7 --> 12.2299404 sigma out 15 active outputs RANK 8 NODE 8 --> 11.0311918 sigma out 15 active outputs RANK 9 NODE 2 --> 9.28267479 sigma out 15 active outputs RANK 10 NODE 9 --> 8.95966053 sigma out 15 active outputs RANK 11 NODE 11 --> 7.82726002 sigma out 15 active outputs RANK 12 NODE 6 --> 6.01534271 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 18.6852798 sigma in 12act. ( 18.2008209 sig out 1act.) RANK 2 NODE 6 --> 17.1563034 sigma in 12act. ( 16.5491352 sig out 1act.) RANK 3 NODE 7 --> 14.4693851 sigma in 12act. ( 14.0477629 sig out 1act.) RANK 4 NODE 9 --> 12.9407568 sigma in 12act. ( 8.48684597 sig out 1act.) RANK 5 NODE 12 --> 10.829215 sigma in 12act. ( 9.3000145 sig out 1act.) RANK 6 NODE 5 --> 10.4836512 sigma in 12act. ( 8.47237778 sig out 1act.) RANK 7 NODE 10 --> 9.73247242 sigma in 12act. ( 6.15725231 sig out 1act.) RANK 8 NODE 8 --> 9.1723175 sigma in 12act. ( 3.15060401 sig out 1act.) RANK 9 NODE 11 --> 8.88643932 sigma in 12act. ( 7.37282324 sig out 1act.) RANK 10 NODE 2 --> 8.34981251 sigma in 12act. ( 4.23899364 sig out 1act.) RANK 11 NODE 1 --> 8.32920265 sigma in 12act. ( 6.93164015 sig out 1act.) RANK 12 NODE 15 --> 7.90224648 sigma in 12act. ( 4.13364983 sig out 1act.) RANK 13 NODE 14 --> 7.01765871 sigma in 12act. ( 1.85961092 sig out 1act.) RANK 14 NODE 13 --> 6.80721378 sigma in 12act. ( 3.29864001 sig out 1act.) RANK 15 NODE 3 --> 6.26849413 sigma in 12act. ( 1.40842843 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 18.2008209 sigma out 1act.( 18.6852798 sig in 12act.) RANK 2 NODE 6 --> 16.5491352 sigma out 1act.( 17.1563034 sig in 12act.) RANK 3 NODE 7 --> 14.0477629 sigma out 1act.( 14.4693851 sig in 12act.) RANK 4 NODE 12 --> 9.3000145 sigma out 1act.( 10.829215 sig in 12act.) RANK 5 NODE 9 --> 8.48684597 sigma out 1act.( 12.9407568 sig in 12act.) RANK 6 NODE 5 --> 8.47237778 sigma out 1act.( 10.4836512 sig in 12act.) RANK 7 NODE 11 --> 7.37282324 sigma out 1act.( 8.88643932 sig in 12act.) RANK 8 NODE 1 --> 6.93164015 sigma out 1act.( 8.32920265 sig in 12act.) RANK 9 NODE 10 --> 6.15725231 sigma out 1act.( 9.73247242 sig in 12act.) RANK 10 NODE 2 --> 4.23899364 sigma out 1act.( 8.34981251 sig in 12act.) RANK 11 NODE 15 --> 4.13364983 sigma out 1act.( 7.90224648 sig in 12act.) RANK 12 NODE 13 --> 3.29864001 sigma out 1act.( 6.80721378 sig in 12act.) RANK 13 NODE 8 --> 3.15060401 sigma out 1act.( 9.1723175 sig in 12act.) RANK 14 NODE 14 --> 1.85961092 sigma out 1act.( 7.01765871 sig in 12act.) RANK 15 NODE 3 --> 1.40842843 sigma out 1act.( 6.26849413 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 35.1340942 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.413964182 *** contribution from regularisation: 0.00432611536 *** contribution from error: -0.418290287 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.453316092 *** contribution from regularisation: 0.0020564755 *** contribution from error: -0.455372572 *********************************************** -----------------> Test sample ENTER BFGS code START -42273.3426 0.085913226 -0.0289763454 EXIT FROM BFGS code FG_START 0. 0.085913226 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.478050649 *** contribution from regularisation: 0.00205387524 *** contribution from error: -0.480104536 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -44570.0975 0.085913226 48.7531281 EXIT FROM BFGS code FG_LNSRCH 0. 0.0945613682 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.519428015 *** contribution from regularisation: 0.00326642115 *** contribution from error: -0.522694409 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48427.8295 0.0945613682 -18.6249886 EXIT FROM BFGS code NEW_X -48427.8295 0.0945613682 -18.6249886 ENTER BFGS code NEW_X -48427.8295 0.0945613682 -18.6249886 EXIT FROM BFGS code FG_LNSRCH 0. 0.0905247852 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.523005009 *** contribution from regularisation: 0.0034947414 *** contribution from error: -0.526499748 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48761.3265 0.0905247852 -6.73519564 EXIT FROM BFGS code NEW_X -48761.3265 0.0905247852 -6.73519564 ENTER BFGS code NEW_X -48761.3265 0.0905247852 -6.73519564 EXIT FROM BFGS code FG_LNSRCH 0. 0.0883927271 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.524305463 *** contribution from regularisation: 0.0032309331 *** contribution from error: -0.527536392 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48882.5704 0.0883927271 -6.00836134 EXIT FROM BFGS code NEW_X -48882.5704 0.0883927271 -6.00836134 ENTER BFGS code NEW_X -48882.5704 0.0883927271 -6.00836134 EXIT FROM BFGS code FG_LNSRCH 0. 0.0832296088 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.525196552 *** contribution from regularisation: 0.00303452834 *** contribution from error: -0.528231084 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48965.6495 0.0832296088 -5.81514978 EXIT FROM BFGS code NEW_X -48965.6495 0.0832296088 -5.81514978 ENTER BFGS code NEW_X -48965.6495 0.0832296088 -5.81514978 EXIT FROM BFGS code FG_LNSRCH 0. 0.0730027109 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.526221931 *** contribution from regularisation: 0.00310419477 *** contribution from error: -0.529326141 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49061.2475 0.0730027109 -7.36172199 EXIT FROM BFGS code NEW_X -49061.2475 0.0730027109 -7.36172199 ENTER BFGS code NEW_X -49061.2475 0.0730027109 -7.36172199 EXIT FROM BFGS code FG_LNSRCH 0. 0.0129127549 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.527937233 *** contribution from regularisation: 0.00385671877 *** contribution from error: -0.531793952 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49221.1741 0.0129127549 -1.10719514 EXIT FROM BFGS code NEW_X -49221.1741 0.0129127549 -1.10719514 ENTER BFGS code NEW_X -49221.1741 0.0129127549 -1.10719514 EXIT FROM BFGS code FG_LNSRCH 0. 0.00207352359 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 53.4967995 sigma out 15 active outputs RANK 2 NODE 1 --> 32.3592224 sigma out 15 active outputs RANK 3 NODE 5 --> 29.4372482 sigma out 15 active outputs RANK 4 NODE 11 --> 26.1660671 sigma out 15 active outputs RANK 5 NODE 3 --> 19.3642368 sigma out 15 active outputs RANK 6 NODE 10 --> 16.4882679 sigma out 15 active outputs RANK 7 NODE 8 --> 14.712326 sigma out 15 active outputs RANK 8 NODE 7 --> 14.4291124 sigma out 15 active outputs RANK 9 NODE 6 --> 12.325943 sigma out 15 active outputs RANK 10 NODE 4 --> 10.4982138 sigma out 15 active outputs RANK 11 NODE 2 --> 8.69521904 sigma out 15 active outputs RANK 12 NODE 9 --> 6.41242695 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 68.5998611 sigma in 12act. ( 76.4870071 sig out 1act.) RANK 2 NODE 12 --> 19.9121838 sigma in 12act. ( 17.6317081 sig out 1act.) RANK 3 NODE 13 --> 17.0965767 sigma in 12act. ( 19.0418015 sig out 1act.) RANK 4 NODE 7 --> 15.4231949 sigma in 12act. ( 15.0694065 sig out 1act.) RANK 5 NODE 4 --> 14.6671076 sigma in 12act. ( 13.8390398 sig out 1act.) RANK 6 NODE 5 --> 14.1549082 sigma in 12act. ( 13.3390665 sig out 1act.) RANK 7 NODE 14 --> 14.0463142 sigma in 12act. ( 11.9598808 sig out 1act.) RANK 8 NODE 11 --> 13.9035711 sigma in 12act. ( 13.7255449 sig out 1act.) RANK 9 NODE 6 --> 13.2133455 sigma in 12act. ( 12.6306686 sig out 1act.) RANK 10 NODE 1 --> 11.2539158 sigma in 12act. ( 11.0524197 sig out 1act.) RANK 11 NODE 10 --> 10.2778902 sigma in 12act. ( 7.51002502 sig out 1act.) RANK 12 NODE 3 --> 4.52934742 sigma in 12act. ( 3.78802919 sig out 1act.) RANK 13 NODE 15 --> 4.43775702 sigma in 12act. ( 3.73455787 sig out 1act.) RANK 14 NODE 8 --> 4.04300547 sigma in 12act. ( 1.45849133 sig out 1act.) RANK 15 NODE 2 --> 2.90986466 sigma in 12act. ( 0.638738394 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 76.4870071 sigma out 1act.( 68.5998611 sig in 12act.) RANK 2 NODE 13 --> 19.0418015 sigma out 1act.( 17.0965767 sig in 12act.) RANK 3 NODE 12 --> 17.6317081 sigma out 1act.( 19.9121838 sig in 12act.) RANK 4 NODE 7 --> 15.0694065 sigma out 1act.( 15.4231949 sig in 12act.) RANK 5 NODE 4 --> 13.8390398 sigma out 1act.( 14.6671076 sig in 12act.) RANK 6 NODE 11 --> 13.7255449 sigma out 1act.( 13.9035711 sig in 12act.) RANK 7 NODE 5 --> 13.3390665 sigma out 1act.( 14.1549082 sig in 12act.) RANK 8 NODE 6 --> 12.6306686 sigma out 1act.( 13.2133455 sig in 12act.) RANK 9 NODE 14 --> 11.9598808 sigma out 1act.( 14.0463142 sig in 12act.) RANK 10 NODE 1 --> 11.0524197 sigma out 1act.( 11.2539158 sig in 12act.) RANK 11 NODE 10 --> 7.51002502 sigma out 1act.( 10.2778902 sig in 12act.) RANK 12 NODE 3 --> 3.78802919 sigma out 1act.( 4.52934742 sig in 12act.) RANK 13 NODE 15 --> 3.73455787 sigma out 1act.( 4.43775702 sig in 12act.) RANK 14 NODE 8 --> 1.45849133 sigma out 1act.( 4.04300547 sig in 12act.) RANK 15 NODE 2 --> 0.638738394 sigma out 1act.( 2.90986466 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 88.4342499 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.529214084 *** contribution from regularisation: 0.00312947296 *** contribution from error: -0.532343566 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49340.2168 0.00207352359 3.75228715 EXIT FROM BFGS code FG_LNSRCH 0. 0.00744526414 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.530395985 *** contribution from regularisation: 0.00305221905 *** contribution from error: -0.533448219 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49450.408 0.00744526414 -0.422130257 EXIT FROM BFGS code NEW_X -49450.408 0.00744526414 -0.422130257 ENTER BFGS code NEW_X -49450.408 0.00744526414 -0.422130257 EXIT FROM BFGS code FG_LNSRCH 0. 0.0113337357 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.531175077 *** contribution from regularisation: 0.00301683089 *** contribution from error: -0.534191906 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49523.0477 0.0113337357 -0.457483739 EXIT FROM BFGS code NEW_X -49523.0477 0.0113337357 -0.457483739 ENTER BFGS code NEW_X -49523.0477 0.0113337357 -0.457483739 EXIT FROM BFGS code FG_LNSRCH 0. 0.0118432967 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.532017827 *** contribution from regularisation: 0.00296359393 *** contribution from error: -0.53498143 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49601.6189 0.0118432967 -0.499955386 EXIT FROM BFGS code NEW_X -49601.6189 0.0118432967 -0.499955386 ENTER BFGS code NEW_X -49601.6189 0.0118432967 -0.499955386 EXIT FROM BFGS code FG_LNSRCH 0. 0.0109086651 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.532625973 *** contribution from regularisation: 0.00302852318 *** contribution from error: -0.535654485 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49658.3176 0.0109086651 -0.419327885 EXIT FROM BFGS code NEW_X -49658.3176 0.0109086651 -0.419327885 ENTER BFGS code NEW_X -49658.3176 0.0109086651 -0.419327885 EXIT FROM BFGS code FG_LNSRCH 0. 0.00627665175 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.533647656 *** contribution from regularisation: 0.00315576629 *** contribution from error: -0.536803424 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49753.5726 0.00627665175 -0.0928997919 EXIT FROM BFGS code NEW_X -49753.5726 0.00627665175 -0.0928997919 ENTER BFGS code NEW_X -49753.5726 0.00627665175 -0.0928997919 EXIT FROM BFGS code FG_LNSRCH 0. 0.00311624375 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.534006238 *** contribution from regularisation: 0.00328790047 *** contribution from error: -0.537294149 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49787.0027 0.00311624375 -0.297577858 EXIT FROM BFGS code NEW_X -49787.0027 0.00311624375 -0.297577858 ENTER BFGS code NEW_X -49787.0027 0.00311624375 -0.297577858 EXIT FROM BFGS code FG_LNSRCH 0. 0.00281719025 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.534834325 *** contribution from regularisation: 0.00317595107 *** contribution from error: -0.538010299 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49864.2084 0.00281719025 -1.58243179 EXIT FROM BFGS code NEW_X -49864.2084 0.00281719025 -1.58243179 ENTER BFGS code NEW_X -49864.2084 0.00281719025 -1.58243179 EXIT FROM BFGS code FG_LNSRCH 0. 0.00128929038 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.535132408 *** contribution from regularisation: 0.00322252838 *** contribution from error: -0.538354933 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49892. 0.00128929038 -0.968495905 EXIT FROM BFGS code NEW_X -49892. 0.00128929038 -0.968495905 ENTER BFGS code NEW_X -49892. 0.00128929038 -0.968495905 EXIT FROM BFGS code FG_LNSRCH 0. -0.0014811923 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.535544693 *** contribution from regularisation: 0.00326187396 *** contribution from error: -0.538806558 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49930.4379 -0.0014811923 -0.134712458 EXIT FROM BFGS code NEW_X -49930.4379 -0.0014811923 -0.134712458 ENTER BFGS code NEW_X -49930.4379 -0.0014811923 -0.134712458 EXIT FROM BFGS code FG_LNSRCH 0. -0.00570136029 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 79.4024811 sigma out 15 active outputs RANK 2 NODE 5 --> 50.1900978 sigma out 15 active outputs RANK 3 NODE 1 --> 31.2202587 sigma out 15 active outputs RANK 4 NODE 3 --> 21.3459511 sigma out 15 active outputs RANK 5 NODE 7 --> 18.4623337 sigma out 15 active outputs RANK 6 NODE 11 --> 17.5515099 sigma out 15 active outputs RANK 7 NODE 8 --> 17.1548214 sigma out 15 active outputs RANK 8 NODE 2 --> 16.8989124 sigma out 15 active outputs RANK 9 NODE 10 --> 16.0355892 sigma out 15 active outputs RANK 10 NODE 4 --> 14.1958961 sigma out 15 active outputs RANK 11 NODE 6 --> 12.1603165 sigma out 15 active outputs RANK 12 NODE 9 --> 12.1151285 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 97.4036865 sigma in 12act. ( 116.444962 sig out 1act.) RANK 2 NODE 13 --> 22.5461578 sigma in 12act. ( 26.8365211 sig out 1act.) RANK 3 NODE 5 --> 21.8878384 sigma in 12act. ( 22.1075363 sig out 1act.) RANK 4 NODE 7 --> 19.1481743 sigma in 12act. ( 19.8984337 sig out 1act.) RANK 5 NODE 14 --> 16.2184391 sigma in 12act. ( 14.5744476 sig out 1act.) RANK 6 NODE 6 --> 14.7338066 sigma in 12act. ( 16.3618984 sig out 1act.) RANK 7 NODE 12 --> 14.0315533 sigma in 12act. ( 12.2190304 sig out 1act.) RANK 8 NODE 1 --> 13.7286339 sigma in 12act. ( 15.712388 sig out 1act.) RANK 9 NODE 4 --> 12.0835514 sigma in 12act. ( 12.1890688 sig out 1act.) RANK 10 NODE 11 --> 11.6414299 sigma in 12act. ( 12.2743187 sig out 1act.) RANK 11 NODE 3 --> 9.97736263 sigma in 12act. ( 10.5555897 sig out 1act.) RANK 12 NODE 10 --> 8.55474091 sigma in 12act. ( 5.95278072 sig out 1act.) RANK 13 NODE 15 --> 8.02000904 sigma in 12act. ( 8.71935749 sig out 1act.) RANK 14 NODE 8 --> 2.61811447 sigma in 12act. ( 0.782213092 sig out 1act.) RANK 15 NODE 2 --> 1.94416404 sigma in 12act. ( 0.00638552941 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 116.444962 sigma out 1act.( 97.4036865 sig in 12act.) RANK 2 NODE 13 --> 26.8365211 sigma out 1act.( 22.5461578 sig in 12act.) RANK 3 NODE 5 --> 22.1075363 sigma out 1act.( 21.8878384 sig in 12act.) RANK 4 NODE 7 --> 19.8984337 sigma out 1act.( 19.1481743 sig in 12act.) RANK 5 NODE 6 --> 16.3618984 sigma out 1act.( 14.7338066 sig in 12act.) RANK 6 NODE 1 --> 15.712388 sigma out 1act.( 13.7286339 sig in 12act.) RANK 7 NODE 14 --> 14.5744476 sigma out 1act.( 16.2184391 sig in 12act.) RANK 8 NODE 11 --> 12.2743187 sigma out 1act.( 11.6414299 sig in 12act.) RANK 9 NODE 12 --> 12.2190304 sigma out 1act.( 14.0315533 sig in 12act.) RANK 10 NODE 4 --> 12.1890688 sigma out 1act.( 12.0835514 sig in 12act.) RANK 11 NODE 3 --> 10.5555897 sigma out 1act.( 9.97736263 sig in 12act.) RANK 12 NODE 15 --> 8.71935749 sigma out 1act.( 8.02000904 sig in 12act.) RANK 13 NODE 10 --> 5.95278072 sigma out 1act.( 8.55474091 sig in 12act.) RANK 14 NODE 8 --> 0.782213092 sigma out 1act.( 2.61811447 sig in 12act.) RANK 15 NODE 2 --> 0.00638552941 sigma out 1act.( 1.94416404 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 128.698715 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.535902619 *** contribution from regularisation: 0.00339992973 *** contribution from error: -0.539302528 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49963.811 -0.00570136029 0.191975296 EXIT FROM BFGS code NEW_X -49963.811 -0.00570136029 0.191975296 ENTER BFGS code NEW_X -49963.811 -0.00570136029 0.191975296 EXIT FROM BFGS code FG_LNSRCH 0. -0.0064724749 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.536341429 *** contribution from regularisation: 0.00331724295 *** contribution from error: -0.539658666 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50004.7221 -0.0064724749 0.00107330875 EXIT FROM BFGS code NEW_X -50004.7221 -0.0064724749 0.00107330875 ENTER BFGS code NEW_X -50004.7221 -0.0064724749 0.00107330875 EXIT FROM BFGS code FG_LNSRCH 0. -0.00611400139 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.53640455 *** contribution from regularisation: 0.00330025656 *** contribution from error: -0.5397048 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50010.6062 -0.00611400139 0.171286687 EXIT FROM BFGS code NEW_X -50010.6062 -0.00611400139 0.171286687 ENTER BFGS code NEW_X -50010.6062 -0.00611400139 0.171286687 EXIT FROM BFGS code FG_LNSRCH 0. -0.00626392709 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.536495686 *** contribution from regularisation: 0.00329923071 *** contribution from error: -0.539794922 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50019.1002 -0.00626392709 0.339758039 EXIT FROM BFGS code NEW_X -50019.1002 -0.00626392709 0.339758039 ENTER BFGS code NEW_X -50019.1002 -0.00626392709 0.339758039 EXIT FROM BFGS code FG_LNSRCH 0. -0.0072454419 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.536844909 *** contribution from regularisation: 0.00326279853 *** contribution from error: -0.540107727 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50051.6613 -0.0072454419 1.55440032 EXIT FROM BFGS code NEW_X -50051.6613 -0.0072454419 1.55440032 ENTER BFGS code NEW_X -50051.6613 -0.0072454419 1.55440032 EXIT FROM BFGS code FG_LNSRCH 0. -0.00754931848 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.537028968 *** contribution from regularisation: 0.00335312472 *** contribution from error: -0.540382087 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50068.8196 -0.00754931848 2.11862898 EXIT FROM BFGS code NEW_X -50068.8196 -0.00754931848 2.11862898 ENTER BFGS code NEW_X -50068.8196 -0.00754931848 2.11862898 EXIT FROM BFGS code FG_LNSRCH 0. -0.00652888278 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.535958052 *** contribution from regularisation: 0.00336189196 *** contribution from error: -0.539319932 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49968.9772 -0.00652888278 -6.19439411 EXIT FROM BFGS code FG_LNSRCH 0. -0.00734857516 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.536809504 *** contribution from regularisation: 0.0036705907 *** contribution from error: -0.540480077 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50048.3602 -0.00734857516 1.18453145 EXIT FROM BFGS code FG_LNSRCH 0. -0.00753243314 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.536949813 *** contribution from regularisation: 0.00344397128 *** contribution from error: -0.54039377 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50061.4429 -0.00753243314 2.04898906 EXIT FROM BFGS code FG_LNSRCH 0. -0.00754889566 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.536953688 *** contribution from regularisation: 0.0034287551 *** contribution from error: -0.540382445 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50061.803 -0.00754889566 2.11337352 EXIT FROM BFGS code FG_LNSRCH 0. -0.00754931802 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 91.3045197 sigma out 15 active outputs RANK 2 NODE 5 --> 46.6976166 sigma out 15 active outputs RANK 3 NODE 1 --> 36.3503342 sigma out 15 active outputs RANK 4 NODE 7 --> 25.8695946 sigma out 15 active outputs RANK 5 NODE 10 --> 23.0169678 sigma out 15 active outputs RANK 6 NODE 3 --> 20.7278118 sigma out 15 active outputs RANK 7 NODE 11 --> 20.4632168 sigma out 15 active outputs RANK 8 NODE 4 --> 18.0156708 sigma out 15 active outputs RANK 9 NODE 2 --> 15.5249357 sigma out 15 active outputs RANK 10 NODE 9 --> 15.3155146 sigma out 15 active outputs RANK 11 NODE 8 --> 15.0395365 sigma out 15 active outputs RANK 12 NODE 6 --> 10.8266172 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 107.485535 sigma in 12act. ( 126.643959 sig out 1act.) RANK 2 NODE 13 --> 27.3069706 sigma in 12act. ( 33.8171883 sig out 1act.) RANK 3 NODE 5 --> 26.4110298 sigma in 12act. ( 27.9936752 sig out 1act.) RANK 4 NODE 7 --> 22.7781734 sigma in 12act. ( 22.6867847 sig out 1act.) RANK 5 NODE 14 --> 16.1041851 sigma in 12act. ( 15.8632078 sig out 1act.) RANK 6 NODE 6 --> 14.6260109 sigma in 12act. ( 17.5763779 sig out 1act.) RANK 7 NODE 12 --> 14.4275894 sigma in 12act. ( 12.3815212 sig out 1act.) RANK 8 NODE 1 --> 14.0426111 sigma in 12act. ( 17.0918331 sig out 1act.) RANK 9 NODE 3 --> 13.5600605 sigma in 12act. ( 15.6227608 sig out 1act.) RANK 10 NODE 4 --> 12.5348597 sigma in 12act. ( 13.4409571 sig out 1act.) RANK 11 NODE 11 --> 11.1654692 sigma in 12act. ( 12.6948299 sig out 1act.) RANK 12 NODE 15 --> 9.49789619 sigma in 12act. ( 11.5728149 sig out 1act.) RANK 13 NODE 10 --> 8.53072357 sigma in 12act. ( 6.413486 sig out 1act.) RANK 14 NODE 8 --> 2.22831178 sigma in 12act. ( 1.31916785 sig out 1act.) RANK 15 NODE 2 --> 1.43558383 sigma in 12act. ( 0.206392467 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 126.643959 sigma out 1act.( 107.485535 sig in 12act.) RANK 2 NODE 13 --> 33.8171883 sigma out 1act.( 27.3069706 sig in 12act.) RANK 3 NODE 5 --> 27.9936752 sigma out 1act.( 26.4110298 sig in 12act.) RANK 4 NODE 7 --> 22.6867847 sigma out 1act.( 22.7781734 sig in 12act.) RANK 5 NODE 6 --> 17.5763779 sigma out 1act.( 14.6260109 sig in 12act.) RANK 6 NODE 1 --> 17.0918331 sigma out 1act.( 14.0426111 sig in 12act.) RANK 7 NODE 14 --> 15.8632078 sigma out 1act.( 16.1041851 sig in 12act.) RANK 8 NODE 3 --> 15.6227608 sigma out 1act.( 13.5600605 sig in 12act.) RANK 9 NODE 4 --> 13.4409571 sigma out 1act.( 12.5348597 sig in 12act.) RANK 10 NODE 11 --> 12.6948299 sigma out 1act.( 11.1654692 sig in 12act.) RANK 11 NODE 12 --> 12.3815212 sigma out 1act.( 14.4275894 sig in 12act.) RANK 12 NODE 15 --> 11.5728149 sigma out 1act.( 9.49789619 sig in 12act.) RANK 13 NODE 10 --> 6.413486 sigma out 1act.( 8.53072357 sig in 12act.) RANK 14 NODE 8 --> 1.31916785 sigma out 1act.( 2.22831178 sig in 12act.) RANK 15 NODE 2 --> 0.206392467 sigma out 1act.( 1.43558383 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 142.300262 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.536940098 *** contribution from regularisation: 0.00344195426 *** contribution from error: -0.540382028 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50060.5378 -0.00754931802 2.11365438 EXIT FROM BFGS code FG_LNSRCH 0. -0.00754931848 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.536950171 *** contribution from regularisation: 0.00343188248 *** contribution from error: -0.540382028 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50061.4768 -0.00754931848 2.11360359 EXIT FROM BFGS code FG_LNSRCH 0. -0.00754931848 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.536933005 *** contribution from regularisation: 0.00344908144 *** contribution from error: -0.540382087 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50059.8733 -0.00754931848 2.1126256 EXIT FROM BFGS code FG_LNSRCH 0. -0.00754931848 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.536952078 *** contribution from regularisation: 0.00342996395 *** contribution from error: -0.540382028 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50061.6557 -0.00754931848 2.1114738 EXIT FROM BFGS code NEW_X -50061.6557 -0.00754931848 2.1114738 ENTER BFGS code NEW_X -50061.6557 -0.00754931848 2.1114738 EXIT FROM BFGS code CONVERGENC -50061.6557 -0.00754931848 2.1114738 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 12 --> 139.823547 sigma out 15 active outputs RANK 2 NODE 5 --> 71.5445557 sigma out 15 active outputs RANK 3 NODE 1 --> 56.731308 sigma out 15 active outputs RANK 4 NODE 7 --> 39.992733 sigma out 15 active outputs RANK 5 NODE 10 --> 35.6563797 sigma out 15 active outputs RANK 6 NODE 3 --> 32.5667915 sigma out 15 active outputs RANK 7 NODE 11 --> 31.3948498 sigma out 15 active outputs RANK 8 NODE 4 --> 27.4226456 sigma out 15 active outputs RANK 9 NODE 2 --> 24.0544243 sigma out 15 active outputs RANK 10 NODE 9 --> 23.8053741 sigma out 15 active outputs RANK 11 NODE 8 --> 23.4392014 sigma out 15 active outputs RANK 12 NODE 6 --> 16.7375965 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 165.32399 sigma in 12act. ( 200.438629 sig out 1act.) RANK 2 NODE 13 --> 42.6449966 sigma in 12act. ( 52.1727448 sig out 1act.) RANK 3 NODE 5 --> 41.0808601 sigma in 12act. ( 43.8370132 sig out 1act.) RANK 4 NODE 7 --> 34.6347771 sigma in 12act. ( 36.5527534 sig out 1act.) RANK 5 NODE 14 --> 24.786314 sigma in 12act. ( 24.6000385 sig out 1act.) RANK 6 NODE 6 --> 22.6894417 sigma in 12act. ( 27.5015564 sig out 1act.) RANK 7 NODE 1 --> 21.6221504 sigma in 12act. ( 26.9531593 sig out 1act.) RANK 8 NODE 12 --> 20.9136314 sigma in 12act. ( 19.7254124 sig out 1act.) RANK 9 NODE 3 --> 20.7792492 sigma in 12act. ( 24.5900116 sig out 1act.) RANK 10 NODE 4 --> 19.1075096 sigma in 12act. ( 21.1240501 sig out 1act.) RANK 11 NODE 11 --> 17.1868896 sigma in 12act. ( 20.0254726 sig out 1act.) RANK 12 NODE 15 --> 14.5687113 sigma in 12act. ( 18.1027527 sig out 1act.) RANK 13 NODE 10 --> 12.0711327 sigma in 12act. ( 10.0438309 sig out 1act.) RANK 14 NODE 8 --> 2.70770359 sigma in 12act. ( 2.04383683 sig out 1act.) RANK 15 NODE 2 --> 1.45830739 sigma in 12act. ( 0.330375284 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 200.438629 sigma out 1act.( 165.32399 sig in 12act.) RANK 2 NODE 13 --> 52.1727448 sigma out 1act.( 42.6449966 sig in 12act.) RANK 3 NODE 5 --> 43.8370132 sigma out 1act.( 41.0808601 sig in 12act.) RANK 4 NODE 7 --> 36.5527534 sigma out 1act.( 34.6347771 sig in 12act.) RANK 5 NODE 6 --> 27.5015564 sigma out 1act.( 22.6894417 sig in 12act.) RANK 6 NODE 1 --> 26.9531593 sigma out 1act.( 21.6221504 sig in 12act.) RANK 7 NODE 14 --> 24.6000385 sigma out 1act.( 24.786314 sig in 12act.) RANK 8 NODE 3 --> 24.5900116 sigma out 1act.( 20.7792492 sig in 12act.) RANK 9 NODE 4 --> 21.1240501 sigma out 1act.( 19.1075096 sig in 12act.) RANK 10 NODE 11 --> 20.0254726 sigma out 1act.( 17.1868896 sig in 12act.) RANK 11 NODE 12 --> 19.7254124 sigma out 1act.( 20.9136314 sig in 12act.) RANK 12 NODE 15 --> 18.1027527 sigma out 1act.( 14.5687113 sig in 12act.) RANK 13 NODE 10 --> 10.0438309 sigma out 1act.( 12.0711327 sig in 12act.) RANK 14 NODE 8 --> 2.04383683 sigma out 1act.( 2.70770359 sig in 12act.) RANK 15 NODE 2 --> 0.330375284 sigma out 1act.( 1.45830739 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 224.760498 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.536952615 *** contribution from regularisation: 0.00342944707 *** contribution from error: -0.540382087 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29884 Closing output file done