NNInput NNInputs_180.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 186564 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 39629 nbkg = 146935 Bkg Entries: 146935 Sig Entries: 39629 Chosen entries: 39629 Signal fraction: 1 Background fraction: 0.269704 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 146935 Actual Signal Entries: 39629 Entries to split: 39629 Test with : 19814 Train with : 19814 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 39629 for Signal Prepared event 0 for Signal with 39629 events ====Entry 0 Variable Ht : 181.988 Variable LepAPt : 36.3125 Variable LepBPt : 33.3263 Variable MetSigLeptonsJets : 8.50337 Variable MetSpec : 84.1215 Variable SumEtLeptonsJets : 97.8662 Variable VSumJetLeptonsPt : 93.7481 Variable addEt : 153.761 Variable dPhiLepSumMet : 2.8992 Variable dPhiLeptons : 0.358494 Variable dRLeptons : 0.375835 Variable lep1_E : 49.7842 Variable lep2_E : 42.4469 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2180 Ht = 181.988 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.3125 LepAPt = 36.3125 LepBEt = 33.3264 LepBPt = 33.3263 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 84.1215 MetDelPhi = 2.72772 MetSig = 7.11556 MetSigLeptonsJets = 8.50337 MetSpec = 84.1215 Mjj = 0 MostCentralJetEta = -2.14636 MtllMet = 165.707 Njets = 1 SB = 0 SumEt = 139.764 SumEtJets = 0 SumEtLeptonsJets = 97.8662 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 93.7481 addEt = 153.761 dPhiLepSumMet = 2.8992 dPhiLeptons = 0.358494 dRLeptons = 0.375835 diltype = 49 dimass = 13.013 event = 182 jet1_Et = 28.2274 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 49.7842 lep2_E = 42.4469 rand = 0.999742 run = 167139 weight = 3.11806e-06 ===Show End Prepared event 10000 for Signal with 39629 events Prepared event 20000 for Signal with 39629 events Prepared event 30000 for Signal with 39629 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 146935 for Background Prepared event 0 for Background with 146935 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.208307 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 146935 events Prepared event 20000 for Background with 146935 events Prepared event 30000 for Background with 146935 events Prepared event 40000 for Background with 146935 events Prepared event 50000 for Background with 146935 events Prepared event 60000 for Background with 146935 events Prepared event 70000 for Background with 146935 events Prepared event 80000 for Background with 146935 events Prepared event 90000 for Background with 146935 events Prepared event 100000 for Background with 146935 events Prepared event 110000 for Background with 146935 events Prepared event 120000 for Background with 146935 events Prepared event 130000 for Background with 146935 events Prepared event 140000 for Background with 146935 events Warning: found 4595 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 186564 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4595 negative weights. Signal fraction: 62.2269402 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 48.6484184 62.6194458 64.6246643 66.4391022 67.7039871 68.7348785 69.9385986 70.6618958 71.54039 72.3817444 73.3427429 74.0806427 74.7410431 75.4542542 76.1040192 76.8701935 77.3725891 77.9124603 78.5538483 79.2051163 79.7176361 80.3614273 81.0376587 81.8215027 82.5448456 83.2551422 84.0652466 85.1982193 86.2243042 87.5500031 88.6904526 90.1468582 91.6535492 93.1210098 94.7778473 96.0851746 97.4563141 99.1382751 100.780396 102.320084 104.247444 105.95166 107.673866 109.219055 111.219147 112.941208 114.999176 116.800461 118.793839 120.822205 122.487213 124.257912 125.939667 127.89061 129.466766 131.224121 133.003922 134.569321 136.288269 137.884155 139.50708 141.234116 142.697281 144.302765 145.887329 147.569244 149.126099 150.57637 152.31546 153.791504 155.562439 156.97757 158.77243 160.516006 162.292694 164.358459 166.215393 168.179108 170.256348 172.320862 174.701584 176.984131 179.371368 181.966736 185.019684 188.196533 191.559601 195.026047 198.869553 202.999008 207.024475 211.350128 216.637894 222.900299 229.270248 237.235565 246.59993 261.138824 282.212952 319.197662 787.769287 ------------------------------ Transdef: Tab for variable 3 20.0009289 20.313694 20.6284828 20.8995266 21.1813221 21.4843826 21.7343102 21.9765129 22.2009983 22.3951263 22.6124725 22.8529015 23.0901985 23.3081303 23.5473785 23.7367191 23.9125938 24.129097 24.3966026 24.6106415 24.8229065 25.0659885 25.2902164 25.4556446 25.6393147 25.8297253 26.0618858 26.2806664 26.4870834 26.7227707 26.9279976 27.1269264 27.325325 27.5934982 27.8453293 28.1075382 28.3196754 28.5869503 28.8561707 29.1048717 29.3688202 29.6285286 29.8674965 30.135128 30.4657269 30.811985 31.153553 31.4841499 31.765358 32.0620651 32.3719025 32.733017 33.0869789 33.420639 33.7846451 34.115303 34.4438744 34.8408203 35.2226181 35.5467224 35.9403763 36.3330994 36.6960411 37.1073532 37.5621986 37.9444695 38.3813248 38.791008 39.2882309 39.745575 40.1881256 40.6617012 41.1286087 41.6106033 42.0766983 42.6392517 43.1674805 43.7656097 44.302578 44.950676 45.572998 46.22155 46.9000092 47.5951157 48.2552414 49.0421677 49.8482208 50.6987114 51.5803909 52.4867592 53.5041046 54.5299034 55.6511841 56.9185486 58.2963943 59.9187698 61.9549713 64.5500031 68.0815125 75.5735397 161.648132 ------------------------------ Transdef: Tab for variable 4 10.000247 10.125515 10.241272 10.3423252 10.4521446 10.557188 10.6649303 10.7870007 10.9059086 11.0185719 11.1474876 11.2930222 11.4080276 11.5343027 11.6773129 11.8092003 11.9669514 12.0975685 12.2670746 12.4349394 12.6335497 12.7667999 12.9145222 13.1214828 13.3152742 13.4958401 13.6657906 13.8427305 14.0235367 14.2171545 14.3806686 14.5896626 14.7862072 14.9934578 15.1999063 15.3707829 15.5421047 15.7769766 16.0026894 16.2801857 16.5094681 16.7250538 16.935667 17.2185307 17.4650841 17.7296295 18.0120392 18.296875 18.542984 18.8319454 19.0885983 19.3445091 19.6467705 19.9468784 20.2109947 20.4355545 20.6885719 20.9443436 21.2180023 21.4477997 21.7128983 21.9477577 22.2138977 22.5051842 22.7325916 22.9988461 23.2812176 23.5397396 23.8223324 24.1018963 24.3956318 24.6751556 24.9416065 25.2487907 25.5264511 25.8030453 26.0949993 26.3694763 26.6609879 26.9657173 27.2999001 27.6061134 27.9447174 28.2736473 28.670681 29.0675259 29.4789639 29.9192581 30.4153252 30.8956947 31.4048958 31.9898338 32.603756 33.3057327 34.0328217 34.927536 35.9278412 37.3350372 39.2342606 42.9785423 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.10023916 2.68345356 3.08253145 3.34576535 3.62613821 3.8312397 4.0336504 4.18810701 4.32109308 4.4450922 4.55634689 4.64561749 4.73850775 4.82047081 4.91545916 5.00235939 5.08080578 5.15524483 5.23274374 5.29895401 5.35891914 5.41982555 5.47246552 5.52661324 5.57187319 5.62671995 5.6783123 5.72720146 5.77926445 5.83196735 5.88100672 5.92222023 5.97180557 6.01392746 6.06184578 6.10930014 6.15545464 6.19738817 6.24258709 6.28255939 6.32305527 6.36511993 6.41402435 6.45943642 6.5051012 6.54047728 6.58760071 6.63745117 6.68337917 6.73014355 6.77433825 6.82501984 6.86656666 6.91282368 6.96257591 7.00727892 7.05621052 7.11284542 7.1616745 7.21697474 7.27378893 7.33580494 7.39375591 7.45598602 7.51734066 7.57268572 7.62892914 7.68604565 7.74968815 7.81781006 7.88268709 7.94314289 8.01151085 8.07065105 8.13532639 8.20480728 8.26317787 8.33410645 8.39809608 8.4754343 8.54142761 8.60896873 8.68132687 8.75613976 8.83327484 8.91276741 8.99637032 9.09054947 9.1876564 9.28864193 9.38925648 9.49707127 9.62592793 9.76154423 9.93173218 10.1221886 10.3563957 10.6390848 11.1243057 11.8723621 18.7109776 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.9724712 25.2140465 26.196701 27.1596527 27.9953327 28.9277325 29.713295 30.5367737 31.1188545 31.7247276 32.3368034 32.8323975 33.3237457 33.850605 34.4410477 34.7798309 35.1625137 35.6017647 36.0015335 36.4134293 36.6811981 37.0305367 37.3788071 37.7593002 38.0596771 38.4600067 38.8562431 39.2759323 39.621006 39.9485168 40.3049507 40.6641083 41.0267487 41.447628 41.9158249 42.3374939 42.8478966 43.274437 43.7574158 44.2579536 44.8172684 45.4888268 46.0640564 46.7150116 47.40168 47.927681 48.5521812 49.2317238 50.0511856 50.6355476 51.4473343 52.3078232 53.1549301 53.9893723 54.8322449 55.6535873 56.5300331 57.2872963 58.1335564 58.9906654 59.8436394 60.7114258 61.5344353 62.407505 63.2387733 64.1047668 64.9297867 65.7596436 66.5860901 67.4553375 68.4213409 69.2147369 70.2087097 71.0892792 71.9446411 72.8675613 73.7431641 74.7104721 75.6394577 76.5789566 77.5301208 78.4401855 79.4710846 80.5646133 81.7477875 82.9885559 84.2470703 85.5727997 86.9210129 88.3779297 90.3506622 92.2545624 94.4693451 97.1218719 100.582848 104.675934 109.514961 116.395477 129.656036 274.839142 ------------------------------ Transdef: Tab for variable 7 30.1677856 32.5470352 33.4626541 34.0764008 34.7406082 35.2654572 35.6785965 36.1359978 36.5139694 36.8846016 37.2198715 37.616478 37.8962326 38.2231178 38.5703964 38.8140106 39.1714439 39.419384 39.7025528 40.0456276 40.318306 40.6212921 40.9745483 41.3377228 41.7138062 42.0979347 42.6043243 43.1901779 43.8889313 44.5932236 45.0678329 45.7208252 46.5898514 47.4416122 48.3922577 49.3951035 50.5430222 51.6436386 52.7658234 53.8537064 54.9455566 56.0052757 57.0607338 58.0710831 58.9977455 60.0022163 60.9606094 61.8748055 62.8283653 63.8027344 64.7097168 65.66716 66.5876465 67.5123138 68.4446716 69.3220596 70.267395 71.1633072 72.1121292 73.0402756 73.9793854 74.8910522 75.9103699 76.8321533 77.7696838 78.7441025 79.7934799 80.8891296 82.0647278 83.2501907 84.4380798 85.7742004 87.2746124 88.8171234 90.4240189 91.9670639 93.5565567 95.2084808 96.9349289 98.5739212 100.504105 102.426872 104.459549 106.581284 108.783173 111.290833 113.756866 116.546539 119.509636 122.586372 126.21209 129.969086 134.553955 139.669556 145.910355 152.65387 161.195267 172.347382 188.557266 215.196503 469.726501 ------------------------------ Transdef: Tab for variable 8 0.678276479 24.72048 28.8099098 30.868515 31.8071861 32.5387878 33.0848579 33.6435318 34.0555267 34.5293884 34.9247589 35.2658463 35.5911446 35.9328842 36.2162247 36.5445595 36.8707657 37.1775513 37.4362793 37.7050018 38.0207825 38.2242813 38.5502701 38.8297348 39.1256943 39.3607216 39.6629829 39.9366989 40.1996765 40.5005608 40.8113403 41.2058334 41.5174103 41.8736763 42.2731934 42.7826195 43.2946548 43.7358437 44.2807693 44.778717 45.2698975 45.9126511 46.5403976 47.2088165 47.9382782 48.6776619 49.2057838 49.8975067 50.6798935 51.4445419 52.1995773 52.9773178 53.6473999 54.3548393 55.1999893 55.9313126 56.7095795 57.4441109 58.1931 59.0297623 59.7663498 60.5803833 61.3732986 62.2024994 62.9743195 63.6896973 64.4405518 65.2168884 66.010498 66.719635 67.4445724 68.2117386 68.9416733 69.7338104 70.5203171 71.3427582 72.1653748 72.9086456 73.7074585 74.5270996 75.3648376 76.1822357 77.1564941 78.1235504 79.0978851 80.1808014 81.2751694 82.5025406 83.6959076 84.9959869 86.6400299 88.4378891 90.3584213 92.719574 95.3266983 99.0882645 103.158455 108.181915 115.947708 131.231415 329.840057 ------------------------------ Transdef: Tab for variable 9 48.2450905 61.9991531 64.1790619 65.8348083 67.2038574 68.1442413 69.1081696 70.0786285 70.6618958 71.4741898 72.2117462 73.0364227 73.8601074 74.3844452 75.0205231 75.5787659 76.1198425 76.7604675 77.1957855 77.7248688 78.2413788 78.7822571 79.3213196 79.7739563 80.3018494 80.9220886 81.5082626 82.2125931 82.7397308 83.4039459 84.0786896 85.0048065 85.958374 86.7534485 87.9844513 88.9564514 90.0782776 91.2331848 92.2188568 93.5333557 94.8318939 95.9617004 97.2618713 98.7891235 100.212059 101.675842 103.089928 104.624222 106.141556 107.745224 109.120056 110.621353 112.030045 113.608719 115.196014 116.585388 118.107941 119.53331 121.009689 122.43898 123.670486 125.059517 126.486084 127.822769 129.06868 130.38707 131.677963 132.992599 134.328674 135.629211 136.962708 138.199707 139.52887 140.872559 142.099579 143.21637 144.401062 145.601669 146.827087 148.146545 149.421234 150.661011 152.00351 153.304962 154.631012 156.009613 157.367599 158.856186 160.458923 162.068085 163.88884 165.849091 167.775238 169.93129 172.339325 175.022339 178.300262 182.962601 189.261169 202.995956 391.964661 ------------------------------ Transdef: Tab for variable 10 0.0054489444 1.12152481 1.42532516 1.64160717 1.78820395 1.9095968 2.00553799 2.08082628 2.15928888 2.22400188 2.27534485 2.32627106 2.37403083 2.41284037 2.44990396 2.48797679 2.51747417 2.54595518 2.57280374 2.59879804 2.62188053 2.64496899 2.66747999 2.68956518 2.71082997 2.72907209 2.74819493 2.76430535 2.77895093 2.79340577 2.80737996 2.82078457 2.83230567 2.84380913 2.85381794 2.86376262 2.87386036 2.88179827 2.8916173 2.89940691 2.90857553 2.91761303 2.92490745 2.93363905 2.94054437 2.94714141 2.95432758 2.9611063 2.96783066 2.97457552 2.97992086 2.98459744 2.99013138 2.99520159 3.00059986 3.00563097 3.0102942 3.01476049 3.019207 3.02314758 3.02692318 3.03033304 3.03441477 3.03789806 3.04182291 3.04550171 3.04893875 3.05254912 3.05618978 3.05955863 3.06290483 3.06653953 3.06986713 3.07278109 3.07559061 3.07837009 3.08139753 3.08439469 3.08732653 3.08986712 3.09286785 3.09567642 3.09824204 3.10078764 3.10349274 3.10559988 3.10819435 3.11096096 3.11345625 3.1156621 3.11787343 3.1202178 3.12247562 3.12503195 3.12740755 3.12971687 3.13206196 3.13442612 3.13663435 3.13901615 3.14158177 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00525510311 0.0111536598 0.0181617737 0.0242919885 0.030793786 0.0382767916 0.0459297299 0.0516674519 0.0592777133 0.0662139654 0.0732047558 0.0802145004 0.0870707631 0.0941679478 0.100405216 0.107251346 0.114174187 0.120995522 0.127705097 0.133795023 0.140380085 0.146975994 0.153508306 0.159196258 0.165567756 0.171838045 0.17844677 0.183976889 0.189432144 0.194884598 0.199490085 0.204565525 0.208814725 0.213701487 0.218704075 0.223365784 0.227896154 0.232506663 0.236883879 0.242027044 0.247201353 0.252061129 0.257247329 0.261544943 0.266076088 0.271191955 0.275688052 0.279819846 0.285526752 0.290501833 0.296106249 0.301735103 0.30693686 0.312250227 0.317616969 0.323061824 0.328581929 0.334005594 0.339790702 0.345187187 0.351673603 0.357332349 0.363137841 0.369092941 0.37519002 0.381335497 0.387145877 0.392831832 0.399384201 0.405701756 0.412240028 0.417853147 0.42516169 0.431373358 0.438241243 0.445041746 0.452428639 0.460036635 0.467234313 0.475281835 0.483895421 0.493346691 0.503625214 0.512374878 0.520786285 0.530216336 0.541247845 0.551779151 0.565553069 0.580224156 0.594944358 0.613469601 0.634067297 0.650385857 0.67138797 0.700198591 0.72709167 0.774699807 0.831741929 1.13201857 ------------------------------ Transdef: Tab for variable 12 0.200011998 0.207374543 0.2156564 0.223109365 0.229480535 0.234791905 0.240959287 0.24700129 0.252983302 0.258734077 0.264706999 0.270387471 0.27556777 0.280613542 0.286311418 0.291687101 0.296833336 0.302081585 0.30739969 0.312970102 0.318170667 0.323464304 0.32835722 0.33307749 0.338525236 0.344056696 0.348296642 0.35356617 0.358775169 0.363455176 0.368657708 0.373566031 0.379012436 0.384724706 0.389155984 0.393716335 0.398317605 0.402493536 0.40699482 0.410669684 0.414423943 0.417689741 0.421168357 0.425129652 0.428618073 0.433211058 0.436920404 0.440587491 0.44446373 0.448268473 0.452359438 0.456884027 0.461387396 0.465949714 0.470293343 0.474237204 0.478734314 0.483240247 0.487734139 0.492456585 0.497626066 0.501847565 0.506941438 0.511779606 0.51715982 0.521452546 0.526397705 0.531431556 0.537678659 0.544069767 0.549879789 0.555755377 0.561392784 0.567385137 0.573941231 0.580350757 0.586807191 0.593871713 0.600458801 0.608117819 0.615930915 0.624350786 0.632709384 0.64077282 0.650017083 0.660134673 0.668102503 0.677532315 0.687603474 0.69990778 0.713403106 0.726282358 0.738999963 0.751814723 0.766268253 0.786214828 0.808421612 0.831169009 0.860018015 0.904182255 1.15372479 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.4621124 22.3236885 23.0459404 23.6083012 24.1764755 24.6428146 25.1517429 25.5428162 25.9210739 26.4226341 26.8921413 27.2831783 27.6663418 28.0843601 28.4635639 28.8192978 29.1957531 29.5638714 29.8788605 30.2335777 30.5836563 30.9019203 31.3009834 31.6510086 31.9869328 32.3543777 32.7235718 33.1077156 33.5077896 33.8526039 34.2983284 34.6233215 34.9806328 35.3537369 35.6652985 36.0609436 36.4534798 36.8757401 37.2721405 37.6870499 38.071022 38.5042114 38.8741684 39.3457642 39.7264862 40.1352997 40.5533981 41.0211029 41.5157547 41.9809952 42.44944 42.8805962 43.3384705 43.8196869 44.3258057 44.8734016 45.3340263 45.8224678 46.3629456 46.8574524 47.4114151 47.8946648 48.4699249 48.9861336 49.4599991 50.0640984 50.6595688 51.2144165 51.8293304 52.3778114 53.0114746 53.7805481 54.3952904 55.1084061 55.8719559 56.5650673 57.3536987 58.1288147 58.8935394 59.7673035 60.5179977 61.3973541 62.3419952 63.2950058 64.3480072 65.5291138 66.8136673 68.1305237 69.674942 71.3084793 72.9970703 74.8145142 77.0440063 79.0443039 81.9021759 85.3595123 89.7187958 95.4164734 105.217438 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.5959721 11.0874395 11.4495583 11.7327147 12.082778 12.4467335 12.7608309 13.0576105 13.3977633 13.670414 13.941082 14.240303 14.551158 14.8133268 15.1094437 15.3932476 15.6547794 15.9704771 16.2838135 16.6188622 16.8962135 17.2107296 17.4845314 17.7369156 18.0292511 18.3004913 18.6117096 18.8734894 19.1048393 19.3612976 19.6817207 19.9878616 20.3056335 20.5869102 20.888731 21.1967163 21.4567986 21.7144928 21.9866982 22.269577 22.5612907 22.8440514 23.083725 23.3909073 23.6658096 23.9264107 24.2121201 24.4945583 24.7778225 25.0420036 25.3152657 25.5756474 25.8649139 26.1265202 26.3947716 26.6857986 26.9708099 27.2314568 27.4751854 27.7354469 28.011097 28.3073006 28.6005936 28.8950214 29.2098389 29.5027962 29.798069 30.1334343 30.4500942 30.7433662 31.0901184 31.4133339 31.7606907 32.1503868 32.5473709 32.8878441 33.3492012 33.7546082 34.1557693 34.6260452 35.0766144 35.6188126 36.1446686 36.6354599 37.1889114 37.8101883 38.4353752 39.1182709 39.8965683 40.7151871 41.551712 42.6984978 43.9388275 45.1362839 46.8843193 48.9226303 51.6364479 55.4294815 61.7992935 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.5 54.5 56.4 33.7 52.2 65.8 58.3 66.9 -26.2 -18.1 -34.5 21.6 29.3 2 68.5 100.0 69.4 61.3 40.8 71.6 94.5 77.5 92.2 -42.5 -24.0 -43.9 36.6 35.3 3 54.5 69.4 100.0 48.6 18.9 41.7 71.5 59.3 75.9 -14.4 -26.1 -49.0 67.0 27.9 4 56.4 61.3 48.6 100.0 19.1 38.8 62.5 53.2 65.8 -12.4 -28.8 -54.2 24.4 72.2 5 33.7 40.8 18.9 19.1 100.0 85.5 13.6 61.3 61.4 22.5 -8.1 -12.8 3.3 6.8 6 52.2 71.6 41.7 38.8 85.5 100.0 51.0 81.0 81.8 -6.2 -15.5 -27.0 17.5 19.6 7 65.8 94.5 71.5 62.5 13.6 51.0 100.0 68.8 80.9 -51.3 -23.4 -44.0 40.4 37.8 8 58.3 77.5 59.3 53.2 61.3 81.0 68.8 100.0 85.1 -9.9 -23.7 -39.6 31.6 31.1 9 66.9 92.2 75.9 65.8 61.4 81.8 80.9 85.1 100.0 -18.4 -26.6 -48.7 42.4 39.3 10 -26.2 -42.5 -14.4 -12.4 22.5 -6.2 -51.3 -9.9 -18.4 100.0 3.8 7.5 -4.7 -5.3 11 -18.1 -24.0 -26.1 -28.8 -8.1 -15.5 -23.4 -23.7 -26.6 3.8 100.0 55.0 -9.8 -16.2 12 -34.5 -43.9 -49.0 -54.2 -12.8 -27.0 -44.0 -39.6 -48.7 7.5 55.0 100.0 -22.2 -29.5 13 21.6 36.6 67.0 24.4 3.3 17.5 40.4 31.6 42.4 -4.7 -9.8 -22.2 100.0 49.4 14 29.3 35.3 27.9 72.2 6.8 19.6 37.8 31.1 39.3 -5.3 -16.2 -29.5 49.4 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.409191 TOTAL CORRELATION OF ALL VARIABLES 74.7160656 ROUND 1: MAX CORR ( 74.7119559) AFTER KILLING INPUT VARIABLE 8 CONTR 0.783643713 ROUND 2: MAX CORR ( 74.7100196) AFTER KILLING INPUT VARIABLE 6 CONTR 0.537900224 ROUND 3: MAX CORR ( 74.7046581) AFTER KILLING INPUT VARIABLE 11 CONTR 0.895035121 ROUND 4: MAX CORR ( 74.6880843) AFTER KILLING INPUT VARIABLE 14 CONTR 1.57353002 ROUND 5: MAX CORR ( 74.6539607) AFTER KILLING INPUT VARIABLE 2 CONTR 2.25745159 ROUND 6: MAX CORR ( 74.5295515) AFTER KILLING INPUT VARIABLE 12 CONTR 4.30810872 ROUND 7: MAX CORR ( 74.2486987) AFTER KILLING INPUT VARIABLE 10 CONTR 6.46411571 ROUND 8: MAX CORR ( 73.5180053) AFTER KILLING INPUT VARIABLE 13 CONTR 10.3909648 ROUND 9: MAX CORR ( 72.51734) AFTER KILLING INPUT VARIABLE 9 CONTR 12.088528 ROUND 10: MAX CORR ( 72.2237637) AFTER KILLING INPUT VARIABLE 3 CONTR 6.51863178 ROUND 11: MAX CORR ( 70.3672127) AFTER KILLING INPUT VARIABLE 4 CONTR 16.2704459 ROUND 12: MAX CORR ( 65.8054943) AFTER KILLING INPUT VARIABLE 5 CONTR 24.9235141 LAST REMAINING VARIABLE: 7 total correlation to target: 74.7160656 % total significance: 133.519764 sigma correlations of single variables to target: variable 2: 68.4525896 % , in sigma: 122.326751 variable 3: 54.4638522 % , in sigma: 97.3284743 variable 4: 56.3699449 % , in sigma: 100.734717 variable 5: 33.6656189 % , in sigma: 60.1614317 variable 6: 52.1968301 % , in sigma: 93.2772404 variable 7: 65.8054943 % , in sigma: 117.596316 variable 8: 58.330266 % , in sigma: 104.237867 variable 9: 66.8534686 % , in sigma: 119.469076 variable 10: -26.153521 % , in sigma: 46.7370962 variable 11: -18.0540667 % , in sigma: 32.2631377 variable 12: -34.5408306 % , in sigma: 61.7254603 variable 13: 21.6169935 % , in sigma: 38.6301908 variable 14: 29.3011176 % , in sigma: 52.3619421 variables sorted by significance: 1 most relevant variable 7 corr 65.8054962 , in sigma: 117.596319 2 most relevant variable 5 corr 24.9235134 , in sigma: 44.5390371 3 most relevant variable 4 corr 16.2704468 , in sigma: 29.0757575 4 most relevant variable 3 corr 6.51863194 , in sigma: 11.6489832 5 most relevant variable 9 corr 12.0885277 , in sigma: 21.6025475 6 most relevant variable 13 corr 10.3909645 , in sigma: 18.5689532 7 most relevant variable 10 corr 6.46411562 , in sigma: 11.551561 8 most relevant variable 12 corr 4.30810881 , in sigma: 7.69871466 9 most relevant variable 2 corr 2.25745153 , in sigma: 4.03413098 10 most relevant variable 14 corr 1.57352996 , in sigma: 2.81194341 11 most relevant variable 11 corr 0.895035148 , in sigma: 1.59945362 12 most relevant variable 6 corr 0.537900209 , in sigma: 0.961243184 13 most relevant variable 8 corr 0.783643723 , in sigma: 1.40039393 global correlations between input variables: variable 2: 99.2534392 % variable 3: 93.6400475 % variable 4: 91.785259 % variable 5: 95.7010428 % variable 6: 95.3606459 % variable 7: 98.8953404 % variable 8: 90.7409337 % variable 9: 98.8345669 % variable 10: 71.2386926 % variable 11: 55.564369 % variable 12: 71.8588605 % variable 13: 86.7264051 % variable 14: 88.4490717 % significance loss when removing single variables: variable 2: corr = 2.40737898 % , sigma = 4.30205566 variable 3: corr = 14.9677014 % , sigma = 26.747714 variable 4: corr = 14.8150447 % , sigma = 26.474912 variable 5: corr = 14.5263542 % , sigma = 25.9590138 variable 6: corr = 0.788207476 % , sigma = 1.40854949 variable 7: corr = 6.7638332 % , sigma = 12.087165 variable 8: corr = 0.783643713 % , sigma = 1.40039391 variable 9: corr = 10.287836 % , sigma = 18.3846596 variable 10: corr = 5.96864524 % , sigma = 10.6661412 variable 11: corr = 0.942556222 % , sigma = 1.68437515 variable 12: corr = 3.54970245 % , sigma = 6.34342063 variable 13: corr = 6.18792667 % , sigma = 11.0580034 variable 14: corr = 1.51895516 % , sigma = 2.71441667 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 23.1950874 sigma out 15 active outputs RANK 2 NODE 4 --> 17.8208923 sigma out 15 active outputs RANK 3 NODE 3 --> 17.6685829 sigma out 15 active outputs RANK 4 NODE 5 --> 16.8982372 sigma out 15 active outputs RANK 5 NODE 8 --> 16.2809277 sigma out 15 active outputs RANK 6 NODE 1 --> 15.9624348 sigma out 15 active outputs RANK 7 NODE 7 --> 15.5064735 sigma out 15 active outputs RANK 8 NODE 2 --> 15.2605267 sigma out 15 active outputs RANK 9 NODE 9 --> 13.0802288 sigma out 15 active outputs RANK 10 NODE 6 --> 10.1928787 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 26.7449741 sigma in 10act. ( 25.6418552 sig out 1act.) RANK 2 NODE 6 --> 20.1033783 sigma in 10act. ( 22.0865421 sig out 1act.) RANK 3 NODE 10 --> 18.7404728 sigma in 10act. ( 20.28018 sig out 1act.) RANK 4 NODE 1 --> 18.5617142 sigma in 10act. ( 19.4069061 sig out 1act.) RANK 5 NODE 5 --> 14.0246506 sigma in 10act. ( 16.0655994 sig out 1act.) RANK 6 NODE 3 --> 13.9353275 sigma in 10act. ( 13.3621941 sig out 1act.) RANK 7 NODE 9 --> 12.6891985 sigma in 10act. ( 14.438468 sig out 1act.) RANK 8 NODE 7 --> 12.3364878 sigma in 10act. ( 12.6849918 sig out 1act.) RANK 9 NODE 2 --> 8.70534706 sigma in 10act. ( 8.86404896 sig out 1act.) RANK 10 NODE 13 --> 6.38178349 sigma in 10act. ( 3.8330729 sig out 1act.) RANK 11 NODE 4 --> 5.20047522 sigma in 10act. ( 1.75675642 sig out 1act.) RANK 12 NODE 8 --> 4.84632349 sigma in 10act. ( 4.70352316 sig out 1act.) RANK 13 NODE 14 --> 4.25158453 sigma in 10act. ( 4.31868839 sig out 1act.) RANK 14 NODE 11 --> 3.11149621 sigma in 10act. ( 4.44162655 sig out 1act.) RANK 15 NODE 12 --> 2.72851539 sigma in 10act. ( 4.1139636 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 25.6418552 sigma out 1act.( 26.7449741 sig in 10act.) RANK 2 NODE 6 --> 22.0865421 sigma out 1act.( 20.1033783 sig in 10act.) RANK 3 NODE 10 --> 20.28018 sigma out 1act.( 18.7404728 sig in 10act.) RANK 4 NODE 1 --> 19.4069061 sigma out 1act.( 18.5617142 sig in 10act.) RANK 5 NODE 5 --> 16.0655994 sigma out 1act.( 14.0246506 sig in 10act.) RANK 6 NODE 9 --> 14.438468 sigma out 1act.( 12.6891985 sig in 10act.) RANK 7 NODE 3 --> 13.3621941 sigma out 1act.( 13.9353275 sig in 10act.) RANK 8 NODE 7 --> 12.6849918 sigma out 1act.( 12.3364878 sig in 10act.) RANK 9 NODE 2 --> 8.86404896 sigma out 1act.( 8.70534706 sig in 10act.) RANK 10 NODE 8 --> 4.70352316 sigma out 1act.( 4.84632349 sig in 10act.) RANK 11 NODE 11 --> 4.44162655 sigma out 1act.( 3.11149621 sig in 10act.) RANK 12 NODE 14 --> 4.31868839 sigma out 1act.( 4.25158453 sig in 10act.) RANK 13 NODE 12 --> 4.1139636 sigma out 1act.( 2.72851539 sig in 10act.) RANK 14 NODE 13 --> 3.8330729 sigma out 1act.( 6.38178349 sig in 10act.) RANK 15 NODE 4 --> 1.75675642 sigma out 1act.( 5.20047522 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.9725914 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 21.8915844 sigma out 15 active outputs RANK 2 NODE 2 --> 21.8127155 sigma out 15 active outputs RANK 3 NODE 5 --> 18.4695148 sigma out 15 active outputs RANK 4 NODE 3 --> 18.2032852 sigma out 15 active outputs RANK 5 NODE 4 --> 17.6548424 sigma out 15 active outputs RANK 6 NODE 8 --> 17.4223633 sigma out 15 active outputs RANK 7 NODE 1 --> 17.4101028 sigma out 15 active outputs RANK 8 NODE 7 --> 16.2019024 sigma out 15 active outputs RANK 9 NODE 9 --> 13.2591915 sigma out 15 active outputs RANK 10 NODE 6 --> 9.95868206 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 15 --> 24.7901154 sigma in 10act. ( 23.5030785 sig out 1act.) RANK 2 NODE 6 --> 20.9406719 sigma in 10act. ( 20.6427956 sig out 1act.) RANK 3 NODE 1 --> 18.9125061 sigma in 10act. ( 18.1867332 sig out 1act.) RANK 4 NODE 10 --> 18.4015865 sigma in 10act. ( 18.4737701 sig out 1act.) RANK 5 NODE 5 --> 16.3485584 sigma in 10act. ( 15.8918495 sig out 1act.) RANK 6 NODE 9 --> 16.29599 sigma in 10act. ( 13.6973867 sig out 1act.) RANK 7 NODE 11 --> 12.290699 sigma in 10act. ( 5.38391161 sig out 1act.) RANK 8 NODE 3 --> 11.7537251 sigma in 10act. ( 11.4288092 sig out 1act.) RANK 9 NODE 7 --> 11.5919466 sigma in 10act. ( 11.2800961 sig out 1act.) RANK 10 NODE 12 --> 10.1039047 sigma in 10act. ( 5.64330006 sig out 1act.) RANK 11 NODE 2 --> 10.0113096 sigma in 10act. ( 8.27711964 sig out 1act.) RANK 12 NODE 4 --> 7.83447313 sigma in 10act. ( 1.0546298 sig out 1act.) RANK 13 NODE 8 --> 6.5810318 sigma in 10act. ( 4.60823107 sig out 1act.) RANK 14 NODE 13 --> 6.12616253 sigma in 10act. ( 2.73265672 sig out 1act.) RANK 15 NODE 14 --> 5.74713039 sigma in 10act. ( 4.3090477 sig out 1act.) sorted by output significance RANK 1 NODE 15 --> 23.5030785 sigma out 1act.( 24.7901154 sig in 10act.) RANK 2 NODE 6 --> 20.6427956 sigma out 1act.( 20.9406719 sig in 10act.) RANK 3 NODE 10 --> 18.4737701 sigma out 1act.( 18.4015865 sig in 10act.) RANK 4 NODE 1 --> 18.1867332 sigma out 1act.( 18.9125061 sig in 10act.) RANK 5 NODE 5 --> 15.8918495 sigma out 1act.( 16.3485584 sig in 10act.) RANK 6 NODE 9 --> 13.6973867 sigma out 1act.( 16.29599 sig in 10act.) RANK 7 NODE 3 --> 11.4288092 sigma out 1act.( 11.7537251 sig in 10act.) RANK 8 NODE 7 --> 11.2800961 sigma out 1act.( 11.5919466 sig in 10act.) RANK 9 NODE 2 --> 8.27711964 sigma out 1act.( 10.0113096 sig in 10act.) RANK 10 NODE 12 --> 5.64330006 sigma out 1act.( 10.1039047 sig in 10act.) RANK 11 NODE 11 --> 5.38391161 sigma out 1act.( 12.290699 sig in 10act.) RANK 12 NODE 8 --> 4.60823107 sigma out 1act.( 6.5810318 sig in 10act.) RANK 13 NODE 14 --> 4.3090477 sigma out 1act.( 5.74713039 sig in 10act.) RANK 14 NODE 13 --> 2.73265672 sigma out 1act.( 6.12616253 sig in 10act.) RANK 15 NODE 4 --> 1.0546298 sigma out 1act.( 7.83447313 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 50.2624321 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.483361214 *** contribution from regularisation: 0.00391658302 *** contribution from error: -0.487277806 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.52661097 *** contribution from regularisation: 0.00233702944 *** contribution from error: -0.528948009 *********************************************** -----------------> Test sample ENTER BFGS code START -49132.6527 -0.0750055537 -0.0610488057 EXIT FROM BFGS code FG_START 0. -0.0750055537 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.550772965 *** contribution from regularisation: 0.00214321795 *** contribution from error: -0.552916169 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -51377.2043 -0.0750055537 -64.1217194 EXIT FROM BFGS code FG_LNSRCH 0. -0.090685606 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.582565188 *** contribution from regularisation: 0.00271034357 *** contribution from error: -0.585275531 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54342.8473 -0.090685606 -14.9348154 EXIT FROM BFGS code NEW_X -54342.8473 -0.090685606 -14.9348154 ENTER BFGS code NEW_X -54342.8473 -0.090685606 -14.9348154 EXIT FROM BFGS code FG_LNSRCH 0. -0.0957695395 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.585936725 *** contribution from regularisation: 0.00278757606 *** contribution from error: -0.588724315 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54657.347 -0.0957695395 -8.17519188 EXIT FROM BFGS code NEW_X -54657.347 -0.0957695395 -8.17519188 ENTER BFGS code NEW_X -54657.347 -0.0957695395 -8.17519188 EXIT FROM BFGS code FG_LNSRCH 0. -0.101879582 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.587371767 *** contribution from regularisation: 0.00267774728 *** contribution from error: -0.590049505 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54791.2122 -0.101879582 11.9577551 EXIT FROM BFGS code NEW_X -54791.2122 -0.101879582 11.9577551 ENTER BFGS code NEW_X -54791.2122 -0.101879582 11.9577551 EXIT FROM BFGS code FG_LNSRCH 0. -0.0939273462 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.587675273 *** contribution from regularisation: 0.00255724532 *** contribution from error: -0.590232491 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54819.5259 -0.0939273462 -4.09533405 EXIT FROM BFGS code NEW_X -54819.5259 -0.0939273462 -4.09533405 ENTER BFGS code NEW_X -54819.5259 -0.0939273462 -4.09533405 EXIT FROM BFGS code FG_LNSRCH 0. -0.0919411331 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.587812066 *** contribution from regularisation: 0.00253726426 *** contribution from error: -0.590349317 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54832.2854 -0.0919411331 4.70058775 EXIT FROM BFGS code NEW_X -54832.2854 -0.0919411331 4.70058775 ENTER BFGS code NEW_X -54832.2854 -0.0919411331 4.70058775 EXIT FROM BFGS code FG_LNSRCH 0. -0.0683982521 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.58831501 *** contribution from regularisation: 0.00236491114 *** contribution from error: -0.590679944 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54879.1998 -0.0683982521 16.4748421 EXIT FROM BFGS code NEW_X -54879.1998 -0.0683982521 16.4748421 ENTER BFGS code NEW_X -54879.1998 -0.0683982521 16.4748421 EXIT FROM BFGS code FG_LNSRCH 0. -0.004813754 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 37.0885086 sigma out 15 active outputs RANK 2 NODE 1 --> 19.0570755 sigma out 15 active outputs RANK 3 NODE 6 --> 18.7579689 sigma out 15 active outputs RANK 4 NODE 10 --> 17.7873306 sigma out 15 active outputs RANK 5 NODE 7 --> 14.571722 sigma out 15 active outputs RANK 6 NODE 4 --> 11.7763348 sigma out 15 active outputs RANK 7 NODE 5 --> 11.1870718 sigma out 15 active outputs RANK 8 NODE 8 --> 10.6482687 sigma out 15 active outputs RANK 9 NODE 3 --> 10.1965342 sigma out 15 active outputs RANK 10 NODE 9 --> 7.95226049 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 29.6978912 sigma in 10act. ( 25.7072716 sig out 1act.) RANK 2 NODE 12 --> 28.1645412 sigma in 10act. ( 24.5003147 sig out 1act.) RANK 3 NODE 15 --> 20.5803318 sigma in 10act. ( 17.3084507 sig out 1act.) RANK 4 NODE 10 --> 15.1340876 sigma in 10act. ( 13.7761621 sig out 1act.) RANK 5 NODE 1 --> 13.5646191 sigma in 10act. ( 11.5384178 sig out 1act.) RANK 6 NODE 9 --> 12.298255 sigma in 10act. ( 9.7397089 sig out 1act.) RANK 7 NODE 6 --> 10.8251438 sigma in 10act. ( 8.92196655 sig out 1act.) RANK 8 NODE 5 --> 10.7215424 sigma in 10act. ( 10.0367575 sig out 1act.) RANK 9 NODE 2 --> 9.04648685 sigma in 10act. ( 8.05014229 sig out 1act.) RANK 10 NODE 14 --> 8.57320881 sigma in 10act. ( 7.15092087 sig out 1act.) RANK 11 NODE 3 --> 5.79559851 sigma in 10act. ( 4.88028955 sig out 1act.) RANK 12 NODE 4 --> 5.24527597 sigma in 10act. ( 3.56468964 sig out 1act.) RANK 13 NODE 7 --> 4.90007162 sigma in 10act. ( 3.85985923 sig out 1act.) RANK 14 NODE 8 --> 4.61568642 sigma in 10act. ( 3.7211163 sig out 1act.) RANK 15 NODE 13 --> 2.60908389 sigma in 10act. ( 1.08017457 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 25.7072716 sigma out 1act.( 29.6978912 sig in 10act.) RANK 2 NODE 12 --> 24.5003147 sigma out 1act.( 28.1645412 sig in 10act.) RANK 3 NODE 15 --> 17.3084507 sigma out 1act.( 20.5803318 sig in 10act.) RANK 4 NODE 10 --> 13.7761621 sigma out 1act.( 15.1340876 sig in 10act.) RANK 5 NODE 1 --> 11.5384178 sigma out 1act.( 13.5646191 sig in 10act.) RANK 6 NODE 5 --> 10.0367575 sigma out 1act.( 10.7215424 sig in 10act.) RANK 7 NODE 9 --> 9.7397089 sigma out 1act.( 12.298255 sig in 10act.) RANK 8 NODE 6 --> 8.92196655 sigma out 1act.( 10.8251438 sig in 10act.) RANK 9 NODE 2 --> 8.05014229 sigma out 1act.( 9.04648685 sig in 10act.) RANK 10 NODE 14 --> 7.15092087 sigma out 1act.( 8.57320881 sig in 10act.) RANK 11 NODE 3 --> 4.88028955 sigma out 1act.( 5.79559851 sig in 10act.) RANK 12 NODE 7 --> 3.85985923 sigma out 1act.( 4.90007162 sig in 10act.) RANK 13 NODE 8 --> 3.7211163 sigma out 1act.( 4.61568642 sig in 10act.) RANK 14 NODE 4 --> 3.56468964 sigma out 1act.( 5.24527597 sig in 10act.) RANK 15 NODE 13 --> 1.08017457 sigma out 1act.( 2.60908389 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 48.3860092 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.588623524 *** contribution from regularisation: 0.00231071678 *** contribution from error: -0.590934217 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -54907.9807 -0.004813754 13.3634243 EXIT FROM BFGS code NEW_X -54907.9807 -0.004813754 13.3634243 ENTER BFGS code NEW_X -54907.9807 -0.004813754 13.3634243 EXIT FROM BFGS code FG_LNSRCH 0. 0.0346712247 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.586897373 *** contribution from regularisation: 0.00256020739 *** contribution from error: -0.589457572 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54746.9581 0.0346712247 31.3045845 EXIT FROM BFGS code FG_LNSRCH 0. 0.0010789613 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.588245928 *** contribution from regularisation: 0.00284813694 *** contribution from error: -0.591094077 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54872.7589 0.0010789613 16.407589 EXIT FROM BFGS code FG_LNSRCH 0. -0.0044320072 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.588311911 *** contribution from regularisation: 0.00263609597 *** contribution from error: -0.590947986 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54878.9122 -0.0044320072 13.4304399 EXIT FROM BFGS code FG_LNSRCH 0. -0.00481121847 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.588295341 *** contribution from regularisation: 0.00263899355 *** contribution from error: -0.590934336 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54877.3662 -0.00481121847 13.2072859 EXIT FROM BFGS code FG_LNSRCH 0. -0.004813754 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.588299215 *** contribution from regularisation: 0.00263506663 *** contribution from error: -0.590934277 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54877.7247 -0.004813754 13.1826153 EXIT FROM BFGS code FG_LNSRCH 0. -0.004813754 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.588270247 *** contribution from regularisation: 0.00266403472 *** contribution from error: -0.590934277 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54875.0225 -0.004813754 13.1610041 EXIT FROM BFGS code FG_LNSRCH 0. -0.004813754 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.58829242 *** contribution from regularisation: 0.00264180382 *** contribution from error: -0.590934217 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54877.0962 -0.004813754 13.1416483 EXIT FROM BFGS code FG_LNSRCH 0. -0.004813754 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.588277042 *** contribution from regularisation: 0.00265719416 *** contribution from error: -0.590934217 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -54875.6606 -0.004813754 13.1236935 EXIT FROM BFGS code NEW_X -54875.6606 -0.004813754 13.1236935 ENTER BFGS code NEW_X -54875.6606 -0.004813754 13.1236935 EXIT FROM BFGS code CONVERGENC -54875.6606 -0.004813754 13.1236935 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 61.2226372 sigma out 15 active outputs RANK 2 NODE 1 --> 32.3065948 sigma out 15 active outputs RANK 3 NODE 6 --> 30.7705402 sigma out 15 active outputs RANK 4 NODE 10 --> 28.3336697 sigma out 15 active outputs RANK 5 NODE 7 --> 24.3886452 sigma out 15 active outputs RANK 6 NODE 4 --> 20.1292267 sigma out 15 active outputs RANK 7 NODE 5 --> 18.253212 sigma out 15 active outputs RANK 8 NODE 8 --> 17.9463463 sigma out 15 active outputs RANK 9 NODE 3 --> 16.5004234 sigma out 15 active outputs RANK 10 NODE 9 --> 13.1931477 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 49.7248306 sigma in 10act. ( 43.9227257 sig out 1act.) RANK 2 NODE 12 --> 46.7681847 sigma in 10act. ( 41.960556 sig out 1act.) RANK 3 NODE 15 --> 34.1366692 sigma in 10act. ( 29.7787361 sig out 1act.) RANK 4 NODE 10 --> 25.1290798 sigma in 10act. ( 23.8773651 sig out 1act.) RANK 5 NODE 1 --> 22.7721939 sigma in 10act. ( 19.7793941 sig out 1act.) RANK 6 NODE 9 --> 19.9098244 sigma in 10act. ( 17.0147743 sig out 1act.) RANK 7 NODE 6 --> 18.0001678 sigma in 10act. ( 15.2735548 sig out 1act.) RANK 8 NODE 5 --> 17.0284729 sigma in 10act. ( 17.0396309 sig out 1act.) RANK 9 NODE 2 --> 14.8473988 sigma in 10act. ( 13.8340979 sig out 1act.) RANK 10 NODE 14 --> 13.5572243 sigma in 10act. ( 12.2449017 sig out 1act.) RANK 11 NODE 3 --> 9.08939171 sigma in 10act. ( 8.49330997 sig out 1act.) RANK 12 NODE 4 --> 7.64420652 sigma in 10act. ( 5.95204544 sig out 1act.) RANK 13 NODE 7 --> 7.31977463 sigma in 10act. ( 6.46653414 sig out 1act.) RANK 14 NODE 8 --> 6.9855094 sigma in 10act. ( 6.18608618 sig out 1act.) RANK 15 NODE 13 --> 3.14521861 sigma in 10act. ( 1.80432093 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 43.9227257 sigma out 1act.( 49.7248306 sig in 10act.) RANK 2 NODE 12 --> 41.960556 sigma out 1act.( 46.7681847 sig in 10act.) RANK 3 NODE 15 --> 29.7787361 sigma out 1act.( 34.1366692 sig in 10act.) RANK 4 NODE 10 --> 23.8773651 sigma out 1act.( 25.1290798 sig in 10act.) RANK 5 NODE 1 --> 19.7793941 sigma out 1act.( 22.7721939 sig in 10act.) RANK 6 NODE 5 --> 17.0396309 sigma out 1act.( 17.0284729 sig in 10act.) RANK 7 NODE 9 --> 17.0147743 sigma out 1act.( 19.9098244 sig in 10act.) RANK 8 NODE 6 --> 15.2735548 sigma out 1act.( 18.0001678 sig in 10act.) RANK 9 NODE 2 --> 13.8340979 sigma out 1act.( 14.8473988 sig in 10act.) RANK 10 NODE 14 --> 12.2449017 sigma out 1act.( 13.5572243 sig in 10act.) RANK 11 NODE 3 --> 8.49330997 sigma out 1act.( 9.08939171 sig in 10act.) RANK 12 NODE 7 --> 6.46653414 sigma out 1act.( 7.31977463 sig in 10act.) RANK 13 NODE 8 --> 6.18608618 sigma out 1act.( 6.9855094 sig in 10act.) RANK 14 NODE 4 --> 5.95204544 sigma out 1act.( 7.64420652 sig in 10act.) RANK 15 NODE 13 --> 1.80432093 sigma out 1act.( 3.14521861 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 82.9661102 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.588286579 *** contribution from regularisation: 0.00264767162 *** contribution from error: -0.590934277 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25490 Closing output file done