NNInput NNInputs_150.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 186968 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 49536 nbkg = 137432 Bkg Entries: 137432 Sig Entries: 49536 Chosen entries: 49536 Signal fraction: 1 Background fraction: 0.36044 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 137432 Actual Signal Entries: 49536 Entries to split: 49536 Test with : 24768 Train with : 24768 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 49536 for Signal Prepared event 0 for Signal with 49536 events ====Entry 0 Variable Ht : 117.82 Variable LepAPt : 47.4738 Variable LepBPt : 12.5622 Variable MetSigLeptonsJets : 3.17918 Variable MetSpec : 29.8229 Variable SumEtLeptonsJets : 87.9972 Variable VSumJetLeptonsPt : 86.2262 Variable addEt : 89.8589 Variable dPhiLepSumMet : 2.58393 Variable dPhiLeptons : 0.475938 Variable dRLeptons : 0.613309 Variable lep1_E : 64.1505 Variable lep2_E : 22.7882 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2150 Ht = 117.82 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 47.4738 LepAPt = 47.4738 LepBEt = 12.5622 LepBPt = 12.5622 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 29.8229 MetDelPhi = 2.20584 MetSig = 2.18904 MetSigLeptonsJets = 3.17918 MetSpec = 29.8229 Mjj = 0 MostCentralJetEta = 0.309078 MtllMet = 98.8413 Njets = 1 SB = 0 SumEt = 185.606 SumEtJets = 0 SumEtLeptonsJets = 87.9972 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 86.2262 addEt = 89.8589 dPhiLepSumMet = 2.58393 dPhiLeptons = 0.475938 dRLeptons = 0.613309 diltype = 1 dimass = 14.9303 event = 29 jet1_Et = 27.9612 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 64.1504 lep2_E = 22.7882 rand = 0.999742 run = 167138 weight = 3.54438e-06 ===Show End Prepared event 10000 for Signal with 49536 events Prepared event 20000 for Signal with 49536 events Prepared event 30000 for Signal with 49536 events Prepared event 40000 for Signal with 49536 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 137432 for Background Prepared event 0 for Background with 137432 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.355184 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 137432 events Prepared event 20000 for Background with 137432 events Prepared event 30000 for Background with 137432 events Prepared event 40000 for Background with 137432 events Prepared event 50000 for Background with 137432 events Prepared event 60000 for Background with 137432 events Prepared event 70000 for Background with 137432 events Prepared event 80000 for Background with 137432 events Prepared event 90000 for Background with 137432 events Prepared event 100000 for Background with 137432 events Prepared event 110000 for Background with 137432 events Prepared event 120000 for Background with 137432 events Prepared event 130000 for Background with 137432 events Warning: found 4454 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 186968 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4454 negative weights. Signal fraction: 62.8630753 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.1555634 65.5357513 67.0918045 68.4039612 69.569397 70.7079086 71.4963684 72.2977295 73.2337189 73.9730148 74.6442108 75.3463898 76.1351166 76.8275909 77.4608917 78.2084961 78.8305054 79.6038971 80.2167587 80.912735 81.5201263 82.3352509 83.1132202 83.9888306 85.0131989 86.0249176 86.9061127 88.207077 89.2671051 90.1981277 91.7051315 93.1037521 94.4342346 95.6053543 97.0408325 98.3813324 99.7122803 101.146996 102.439621 103.805031 105.294365 106.414688 107.951675 109.303726 110.663162 112.147346 113.455345 114.894417 116.263458 117.778275 119.172729 120.199196 121.489197 122.753273 124.127243 125.391029 126.730789 127.940155 129.079071 130.376831 131.849548 133.060516 134.365341 135.729797 137.003006 138.378159 139.686478 141.03096 142.483978 143.910736 145.399292 146.878586 148.248917 149.827118 151.362976 153.276215 155.352448 157.573929 159.84256 162.543198 165.117126 167.715546 170.38118 173.185242 176.004486 179.210236 182.714478 186.563782 190.818115 195.109192 199.925781 205.510437 212.392487 220.569244 230.461212 243.158417 260.799316 286.672577 346.740967 836.977722 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3026009 20.6062717 20.9274578 21.2038765 21.4673042 21.7304382 21.978405 22.2080708 22.4411564 22.6150513 22.8227997 23.0160713 23.2504768 23.4544277 23.6639462 23.9077873 24.1580009 24.3898678 24.579361 24.7749519 24.9695454 25.1670609 25.3237534 25.5325317 25.7573166 25.9781837 26.180809 26.3978481 26.6339111 26.8558292 27.0912361 27.2793503 27.5245476 27.709774 27.9084625 28.1464653 28.3563385 28.5943947 28.8201447 29.0738258 29.2968788 29.506691 29.7466507 30.0138893 30.2871189 30.5350761 30.7970676 31.0692368 31.32658 31.5241127 31.7550392 32.0139236 32.28302 32.5478935 32.8713226 33.1609955 33.4677811 33.7662201 34.0467415 34.3411713 34.6490707 34.9575958 35.2781143 35.6089401 35.9196777 36.224308 36.5442848 36.868721 37.2004166 37.548439 37.9074669 38.2811623 38.6421051 39.0018539 39.2695389 39.6676559 40.0614929 40.5004997 40.8138657 41.2326813 41.7441864 42.2813263 42.7925606 43.3555069 43.9229431 44.6219063 45.2752686 45.9667969 46.8886185 47.813179 48.9333954 50.083477 51.2347488 52.8445206 54.7592087 57.174736 60.3895493 65.4728394 75.3726196 199.997818 ------------------------------ Transdef: Tab for variable 4 10.0006914 10.1220818 10.283659 10.4106712 10.5329151 10.6444635 10.7957373 10.945015 11.0813036 11.2339582 11.395752 11.5171318 11.6663723 11.7798748 11.9479179 12.0974808 12.2340012 12.401906 12.5605145 12.7256508 12.8942604 13.0741978 13.2578278 13.4341545 13.6018419 13.7604828 13.8747358 14.0344324 14.1906261 14.3948975 14.5884113 14.8005619 15.0192661 15.2172718 15.3934393 15.6199703 15.8238754 15.9733887 16.2230301 16.444664 16.6730003 16.8995132 17.1448193 17.3804398 17.6210403 17.8488197 17.9890423 18.2492542 18.4963856 18.7535343 18.9967728 19.2223244 19.4661388 19.71315 19.968996 20.1975441 20.4100876 20.6651535 20.9224281 21.1697884 21.40662 21.6579247 21.8919163 22.054636 22.3056526 22.5619125 22.8381081 23.1007423 23.380867 23.6610718 23.9478951 24.2229042 24.5079231 24.8312187 25.1881218 25.5470676 25.8819771 26.2310944 26.5518818 26.9457054 27.3107109 27.6794872 28.0236168 28.3636818 28.7521744 29.1681175 29.6023846 30.0740662 30.5345325 31.0618439 31.5997372 32.2227325 32.8820801 33.5850754 34.4381027 35.4693069 36.8719826 38.8912354 41.7769089 47.1258278 119.526672 ------------------------------ Transdef: Tab for variable 5 1.15907621 2.57803369 3.00348663 3.30343628 3.57217169 3.80568838 3.9847436 4.11352253 4.24138927 4.36248732 4.48280716 4.58092499 4.66275597 4.75471783 4.84209347 4.92767096 5.00466013 5.07465696 5.14240789 5.20717812 5.2648077 5.31663227 5.36890745 5.43327522 5.48464203 5.53583431 5.5769248 5.62712955 5.68053341 5.73561764 5.78176355 5.83115768 5.87412167 5.92536497 5.96740818 6.01063633 6.05633307 6.10188198 6.14753914 6.19121075 6.23642159 6.27425003 6.32286882 6.37208271 6.4190197 6.46259499 6.50142384 6.54594851 6.58788013 6.63713694 6.68409395 6.7296114 6.76993418 6.81453228 6.85301495 6.8896389 6.92847109 6.97787237 7.02081013 7.07440472 7.12516928 7.17316723 7.22315979 7.26607704 7.31382608 7.36329746 7.41970682 7.4750309 7.51220322 7.56880188 7.6186347 7.6658926 7.71923971 7.7697773 7.83098602 7.88038349 7.93303871 7.98713112 8.0526638 8.10658455 8.17093658 8.23748398 8.29747009 8.36628819 8.43521881 8.51242828 8.59223366 8.66958141 8.7517767 8.83696842 8.93929863 9.05742073 9.18400955 9.33067894 9.4766655 9.67005539 9.91689491 10.2633801 10.7941656 11.8767796 24.4751568 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.6340218 25.2324524 26.2813492 27.2089481 28.1827946 29.0664673 29.8224144 30.5714722 31.1567631 31.7685509 32.279438 32.8786812 33.3320923 33.8216705 34.3365631 34.7379494 35.0889091 35.53479 35.9354782 36.4059525 36.781601 37.175827 37.5343704 37.8794403 38.2901993 38.6527367 39.0550079 39.4449463 39.8191147 40.2136345 40.5266418 40.945816 41.3450775 41.8030319 42.1995697 42.6636047 43.030304 43.4833984 43.8564377 44.3887482 44.9063988 45.4389038 45.9330368 46.6107063 47.1994476 47.6777496 48.2428894 48.882782 49.4163284 50.013813 50.5058746 51.1234436 51.7833176 52.3918228 53.0160217 53.6499939 54.2130661 54.7915955 55.4244843 56.1397667 56.7585297 57.3304749 58.0385094 58.5360107 59.0611954 59.7903214 60.4301338 61.1153831 61.7864838 62.4854736 63.173584 63.8343201 64.5581512 65.2497559 65.9808044 66.7156677 67.4018097 68.1312103 68.8545532 69.5294342 70.2448807 71.1259155 71.9483795 72.8187866 73.6778793 74.6000519 75.6685486 76.7144775 77.5897446 79.0108795 80.6069183 82.3412018 84.1949005 86.5473633 89.5322266 93.1403503 98.0337677 105.327911 119.275047 259.730835 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7924156 33.7772217 34.4451103 35.1048126 35.5985184 36.0691948 36.5757141 37.0141983 37.3836517 37.7447968 38.0712662 38.3960686 38.7263184 38.9990463 39.2708817 39.6000671 39.978054 40.2199402 40.5351906 40.9518814 41.3430557 41.6501846 42.0731583 42.5440331 42.9127731 43.3726997 44.0545197 44.7218399 45.2831459 45.8887863 46.6339264 47.2338715 47.9677734 48.8228455 49.7215729 50.4888 51.3196259 52.2005463 53.0279999 53.7368202 54.6593513 55.47966 56.207386 57.0101242 57.84729 58.6566086 59.4577141 60.1894455 60.9572754 61.4149475 62.1647987 62.9091644 63.7332306 64.422821 65.1478729 65.9219513 66.6396027 67.4236755 68.2561798 69.0685272 69.9444733 70.7013779 71.5151978 72.3495026 73.2950592 74.2861938 75.462204 76.6640778 77.8693695 79.1090088 80.4565353 82.0410233 83.5172501 85.1290741 86.7126465 88.4300003 90.2182617 92.0581818 93.8119507 95.7188263 97.7247086 99.9765549 102.005569 104.3619 106.889694 109.526108 112.452713 115.976616 119.736534 123.654312 127.883614 133.185059 138.227036 145.274078 154.125168 165.478271 178.572357 199.908752 251.089584 595.593201 ------------------------------ Transdef: Tab for variable 8 1.19986558 24.2867241 28.9228172 30.8823967 32.0182343 32.7156601 33.290802 33.8220749 34.219162 34.6884842 35.1258469 35.5035706 35.856205 36.1687698 36.5437469 36.8788757 37.1675873 37.4234238 37.7063904 38.0039215 38.2218857 38.5410309 38.8119469 39.069191 39.3407402 39.6016159 39.8715134 40.2237167 40.5706367 40.8897095 41.2147293 41.479641 41.9531097 42.2938004 42.627697 43.0297127 43.4920044 43.9470596 44.5134048 44.9707642 45.4025612 46.0255547 46.5522614 47.0041428 47.5009613 48.0828323 48.7392654 49.2169838 49.7394791 50.321907 50.9127426 51.5133591 52.1239853 52.7440643 53.2743301 53.8516541 54.4249916 55.0141373 55.5851822 56.2457199 56.8881454 57.4844131 58.1016388 58.6956291 59.2543793 59.8644943 60.4357948 61.0357513 61.4725723 62.0672302 62.6791763 63.2917709 63.887352 64.5314102 65.1281281 65.7018585 66.3650742 67.0061264 67.7092285 68.3916397 69.0778046 69.8281937 70.6096344 71.3843689 72.1441116 73.0350952 74.0172272 75.1464462 76.3128052 77.7332535 79.1169281 80.8993683 82.9795074 85.5193024 88.5423431 92.0806961 96.3725052 102.520966 111.423637 135.438278 349.597076 ------------------------------ Transdef: Tab for variable 9 49.2546883 62.8018761 64.9727478 66.5189972 67.7008362 68.795105 69.871582 70.7460938 71.4902649 72.1778488 72.9962234 73.7550201 74.342865 74.986496 75.6511688 76.2456818 76.8499832 77.3748627 78.0365143 78.585556 79.1681747 79.7716751 80.3129425 80.9337769 81.4546432 82.1796265 82.8557129 83.5537872 84.211937 85.0691986 85.8565063 86.5865479 87.5511246 88.5756226 89.341629 90.0957489 91.1654587 92.1817169 93.2584076 94.4342499 95.3998718 96.3548737 97.6554871 98.791069 99.8576202 101.054222 102.087158 103.225243 104.382454 105.497246 106.492798 107.604095 108.65696 109.673096 110.728561 111.916054 113.029541 114.107689 115.239243 116.328758 117.318863 118.406418 119.458183 120.197968 121.203201 122.237373 123.25206 124.338646 125.320709 126.341583 127.386292 128.364014 129.409103 130.423126 131.470169 132.482025 133.402771 134.365463 135.444305 136.475586 137.445129 138.502655 139.482788 140.561981 141.752594 142.879608 143.995621 145.211853 146.405518 147.67218 148.976517 150.436127 152.18689 154.366272 156.766251 160.471436 165.693512 172.629242 187.142502 224.674759 469.439911 ------------------------------ Transdef: Tab for variable 10 0.0050833188 0.837293267 1.23250985 1.47435904 1.65958691 1.79930162 1.90754271 2.00056863 2.08566451 2.15219665 2.21621037 2.26401949 2.317698 2.36440706 2.40630293 2.43895197 2.47354722 2.50733709 2.53881502 2.56484151 2.59482288 2.61868429 2.64241719 2.6663537 2.6886692 2.70986938 2.72950292 2.74680734 2.76185822 2.77654505 2.79098129 2.80502748 2.82004476 2.83318281 2.84467053 2.85394406 2.86445475 2.87438726 2.88374114 2.89315081 2.90133476 2.91059995 2.91888165 2.92804575 2.93527603 2.94277883 2.94973207 2.95611 2.96222925 2.96810198 2.97386694 2.97897816 2.98457265 2.98913932 2.99349904 2.99864006 3.00409174 3.00886154 3.0137825 3.01839685 3.02324605 3.02794361 3.031394 3.03503752 3.03904366 3.04256511 3.04609251 3.05006027 3.05379319 3.05691528 3.06083465 3.06445718 3.06736159 3.07075357 3.07402229 3.07702541 3.07989693 3.08299541 3.08544421 3.08875012 3.09183693 3.09457588 3.09728479 3.10045338 3.10341978 3.10578585 3.10843706 3.11093903 3.11338019 3.1160841 3.11842108 3.1210227 3.12341547 3.12596941 3.12840343 3.13052297 3.13219213 3.13409138 3.13648343 3.13898873 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00534415245 0.0114799738 0.0191974491 0.0245087743 0.0313667208 0.0382883549 0.0460600033 0.0542978495 0.0622555017 0.0701580644 0.0772788823 0.0840880573 0.0914959311 0.0987327099 0.106396809 0.11141932 0.11868608 0.125593454 0.133159757 0.140777528 0.14780134 0.15434885 0.160440713 0.166509718 0.172505021 0.178571224 0.184874415 0.190705359 0.196897507 0.203461424 0.209207505 0.21464695 0.220739007 0.226332337 0.231452689 0.236687928 0.242527246 0.247604966 0.253202915 0.258751512 0.263400674 0.268550754 0.274497479 0.280520678 0.286585569 0.291964054 0.297259331 0.302431196 0.309195399 0.31441617 0.319910228 0.325377584 0.331223845 0.336573601 0.342396498 0.34832567 0.354044288 0.359916866 0.365583301 0.371000946 0.37647149 0.382784843 0.388210654 0.393482804 0.399343729 0.405194998 0.411379695 0.417719632 0.424062371 0.429894835 0.435921669 0.441419423 0.44819057 0.45474571 0.461337388 0.4682163 0.475699425 0.482975006 0.492342204 0.501636446 0.50981164 0.518009961 0.52805388 0.538574934 0.545095682 0.554178476 0.56526792 0.576966524 0.588629246 0.602107227 0.616870224 0.631919861 0.648558617 0.666100502 0.685776711 0.712226748 0.738142431 0.778437018 0.842504323 1.1246134 ------------------------------ Transdef: Tab for variable 12 0.100370497 0.179361492 0.200923353 0.216908678 0.22973296 0.240312099 0.250626445 0.258728832 0.267544746 0.275204301 0.282609284 0.290248126 0.297815621 0.305314869 0.31169641 0.3186782 0.325650752 0.331886768 0.33813864 0.344668001 0.349879891 0.355689794 0.361831665 0.368012428 0.373481512 0.379259825 0.384919465 0.389927685 0.395221531 0.400382221 0.404490769 0.408921063 0.412891388 0.416488469 0.420553803 0.424541056 0.428407729 0.431879044 0.43556565 0.439133108 0.442390114 0.445944935 0.449327469 0.45347333 0.457316279 0.461170852 0.464722931 0.468882501 0.472601414 0.476280212 0.478582948 0.482921988 0.487135053 0.490797937 0.495205492 0.498814076 0.502878249 0.507737875 0.511418283 0.516365469 0.521242857 0.526004374 0.530692518 0.535816491 0.54083252 0.54636085 0.549322248 0.553829074 0.558788896 0.563596129 0.569420278 0.574559271 0.58045131 0.586834311 0.593212783 0.599744797 0.606703937 0.61356616 0.621256828 0.628415644 0.636632681 0.645721197 0.653159142 0.661133111 0.667590678 0.676577508 0.68607688 0.695220053 0.704393268 0.714660048 0.724730253 0.734724283 0.747975826 0.758119583 0.774285436 0.791328788 0.810005486 0.834763467 0.866836429 0.913131714 1.13453126 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.5134621 22.2981815 23.0086823 23.5704918 24.1188736 24.6111183 25.0406914 25.4000664 25.8294258 26.2261353 26.6557617 27.0834999 27.423481 27.8008957 28.1972675 28.5293884 28.8714085 29.2245674 29.5514755 29.890913 30.2240562 30.5605984 30.8590164 31.1329994 31.42313 31.766346 32.0583496 32.378479 32.6827812 33.021801 33.3142319 33.6698685 34.0133438 34.3478622 34.6487503 35.021431 35.4002991 35.7202568 36.0534668 36.2783737 36.6662598 37.0267754 37.333847 37.703083 38.0439529 38.39394 38.7372131 39.1192207 39.504364 39.8542061 40.2328644 40.6067047 40.9916801 41.3363037 41.7551155 42.1607056 42.586586 42.9931259 43.39785 43.8341141 44.2954178 44.7666855 45.2431488 45.7732391 46.2978096 46.8514938 47.355896 47.8085861 48.3800354 48.9424629 49.5960045 50.1921501 50.8411789 51.4367905 52.0957947 52.8004456 53.599678 54.3409119 55.1300888 55.8760185 56.8139038 57.7799377 58.7274017 59.7980728 60.9291153 62.1370316 63.4007187 64.6017609 66.1807556 67.8267975 69.1714935 71.2355042 73.6384888 76.8661041 80.1929779 84.3402252 87.9360199 93.7102051 104.836853 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.78125 11.2675476 11.6666985 11.948452 12.3120403 12.6379566 12.914525 13.2470922 13.5522499 13.845439 14.1433868 14.4309025 14.6823959 15.000102 15.2989826 15.5860271 15.8803368 16.2100906 16.4449997 16.6845245 16.9815636 17.2806187 17.5946121 17.8982124 18.1646156 18.4023056 18.667902 18.98983 19.2430325 19.5116463 19.7968903 20.065918 20.3504486 20.6282806 20.9337616 21.1967506 21.5068569 21.7737198 22.020359 22.2882156 22.5675888 22.8261528 23.0876369 23.3278694 23.5776253 23.8655205 24.1395378 24.4419632 24.7268066 24.9944611 25.272274 25.5444469 25.825592 26.1254387 26.4017868 26.6444683 26.9848633 27.2712021 27.5937462 27.9196777 28.109457 28.4269753 28.7278938 29.0461426 29.3533134 29.6833458 30.0498009 30.3997879 30.7843838 31.1593285 31.5070686 31.8709106 32.2640724 32.6959763 33.1441803 33.4473686 33.8735123 34.2503242 34.628727 35.1674118 35.6619949 36.230423 36.7548141 37.3042297 37.8771515 38.5760498 39.3228455 40.1774483 40.8987808 41.8396759 42.827858 43.9823761 45.3385544 46.8702354 48.5755386 50.7963028 53.888546 57.6887894 64.9000092 132.856903 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 59.8 43.1 49.9 21.0 42.8 57.6 47.4 57.3 -26.5 -18.1 -36.6 9.2 22.3 2 59.8 100.0 65.5 60.1 30.7 65.4 94.6 73.1 91.7 -47.2 -26.2 -50.5 32.6 34.9 3 43.1 65.5 100.0 44.6 5.1 31.5 68.5 51.9 71.5 -16.3 -28.6 -56.0 64.5 25.0 4 49.9 60.1 44.6 100.0 11.4 35.1 61.0 50.6 66.2 -14.1 -33.1 -64.0 20.5 72.4 5 21.0 30.7 5.1 11.4 100.0 82.7 3.9 54.7 52.9 23.0 -5.3 -7.1 -5.5 2.5 6 42.8 65.4 31.5 35.1 82.7 100.0 44.6 77.0 77.4 -6.1 -15.7 -27.7 9.2 17.5 7 57.6 94.6 68.5 61.0 3.9 44.6 100.0 65.3 80.5 -54.6 -25.1 -50.9 36.9 36.7 8 47.4 73.1 51.9 50.6 54.7 77.0 65.3 100.0 82.1 -12.4 -24.2 -43.0 25.7 30.3 9 57.3 91.7 71.5 66.2 52.9 77.4 80.5 82.1 100.0 -23.4 -29.4 -56.8 37.4 40.1 10 -26.5 -47.2 -16.3 -14.1 23.0 -6.1 -54.6 -12.4 -23.4 100.0 3.3 10.0 -5.8 -6.1 11 -18.1 -26.2 -28.6 -33.1 -5.3 -15.7 -25.1 -24.2 -29.4 3.3 100.0 55.7 -13.7 -23.2 12 -36.6 -50.5 -56.0 -64.0 -7.1 -27.7 -50.9 -43.0 -56.8 10.0 55.7 100.0 -29.0 -39.8 13 9.2 32.6 64.5 20.5 -5.5 9.2 36.9 25.7 37.4 -5.8 -13.7 -29.0 100.0 47.2 14 22.3 34.9 25.0 72.4 2.5 17.5 36.7 30.3 40.1 -6.1 -23.2 -39.8 47.2 100.0 TOTAL CORRELATION TO TARGET (diagonal) 148.320907 TOTAL CORRELATION OF ALL VARIABLES 66.5618178 ROUND 1: MAX CORR ( 66.5616287) AFTER KILLING INPUT VARIABLE 8 CONTR 0.158649204 ROUND 2: MAX CORR ( 66.554569) AFTER KILLING INPUT VARIABLE 11 CONTR 0.969410335 ROUND 3: MAX CORR ( 66.496204) AFTER KILLING INPUT VARIABLE 12 CONTR 2.78666759 ROUND 4: MAX CORR ( 66.4334601) AFTER KILLING INPUT VARIABLE 14 CONTR 2.88799499 ROUND 5: MAX CORR ( 66.286844) AFTER KILLING INPUT VARIABLE 7 CONTR 4.41122897 ROUND 6: MAX CORR ( 66.0920354) AFTER KILLING INPUT VARIABLE 10 CONTR 5.07824218 ROUND 7: MAX CORR ( 65.876374) AFTER KILLING INPUT VARIABLE 6 CONTR 5.33483765 ROUND 8: MAX CORR ( 64.7454926) AFTER KILLING INPUT VARIABLE 9 CONTR 12.1539226 ROUND 9: MAX CORR ( 64.6035374) AFTER KILLING INPUT VARIABLE 5 CONTR 4.28506409 ROUND 10: MAX CORR ( 63.2542114) AFTER KILLING INPUT VARIABLE 3 CONTR 13.1347544 ROUND 11: MAX CORR ( 62.2776908) AFTER KILLING INPUT VARIABLE 13 CONTR 11.0717883 ROUND 12: MAX CORR ( 59.7731056) AFTER KILLING INPUT VARIABLE 4 CONTR 17.483896 LAST REMAINING VARIABLE: 2 total correlation to target: 66.5618178 % total significance: 132.289224 sigma correlations of single variables to target: variable 2: 59.7731056 % , in sigma: 118.796902 variable 3: 43.1392005 % , in sigma: 85.7376129 variable 4: 49.918188 % , in sigma: 99.2106072 variable 5: 21.0443189 % , in sigma: 41.8248287 variable 6: 42.8207011 % , in sigma: 85.1046067 variable 7: 57.6176166 % , in sigma: 114.512945 variable 8: 47.3788472 % , in sigma: 94.1637585 variable 9: 57.288293 % , in sigma: 113.858427 variable 10: -26.5385553 % , in sigma: 52.7444262 variable 11: -18.0852793 % , in sigma: 35.9438435 variable 12: -36.5516289 % , in sigma: 72.6450506 variable 13: 9.21293286 % , in sigma: 18.3103734 variable 14: 22.32062 % , in sigma: 44.3614311 variables sorted by significance: 1 most relevant variable 2 corr 59.7731056 , in sigma: 118.796902 2 most relevant variable 4 corr 17.4838963 , in sigma: 34.7486164 3 most relevant variable 13 corr 11.0717878 , in sigma: 22.004781 4 most relevant variable 3 corr 13.1347542 , in sigma: 26.1048526 5 most relevant variable 5 corr 4.28506422 , in sigma: 8.51641136 6 most relevant variable 9 corr 12.153923 , in sigma: 24.1554859 7 most relevant variable 6 corr 5.33483744 , in sigma: 10.602798 8 most relevant variable 10 corr 5.0782423 , in sigma: 10.0928243 9 most relevant variable 7 corr 4.41122913 , in sigma: 8.7671596 10 most relevant variable 14 corr 2.887995 , in sigma: 5.73978643 11 most relevant variable 12 corr 2.78666759 , in sigma: 5.53840182 12 most relevant variable 11 corr 0.96941036 , in sigma: 1.9266683 13 most relevant variable 8 corr 0.158649206 , in sigma: 0.315309604 global correlations between input variables: variable 2: 99.2119933 % variable 3: 93.166 % variable 4: 92.5809405 % variable 5: 95.1194374 % variable 6: 93.7934468 % variable 7: 98.7743266 % variable 8: 89.1816516 % variable 9: 98.9050503 % variable 10: 71.3528296 % variable 11: 56.9045588 % variable 12: 78.3883694 % variable 13: 85.2937664 % variable 14: 88.1910705 % significance loss when removing single variables: variable 2: corr = 5.15342344 % , sigma = 10.2422442 variable 3: corr = 15.0270916 % , sigma = 29.8658052 variable 4: corr = 16.0292719 % , sigma = 31.8576027 variable 5: corr = 8.81946379 % , sigma = 17.5283678 variable 6: corr = 4.66574801 % , sigma = 9.27300674 variable 7: corr = 3.4373371 % , sigma = 6.83158413 variable 8: corr = 0.158649204 % , sigma = 0.3153096 variable 9: corr = 10.6508066 % , sigma = 21.168096 variable 10: corr = 4.72479119 % , sigma = 9.39035292 variable 11: corr = 0.97807493 % , sigma = 1.94388882 variable 12: corr = 2.04367622 % , sigma = 4.06173315 variable 13: corr = 8.74579112 % , sigma = 17.381946 variable 14: corr = 2.96438586 % , sigma = 5.89161052 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 13.9741077 sigma out 15 active outputs RANK 2 NODE 11 --> 13.6647568 sigma out 15 active outputs RANK 3 NODE 7 --> 12.3146534 sigma out 15 active outputs RANK 4 NODE 8 --> 12.0042915 sigma out 15 active outputs RANK 5 NODE 2 --> 11.6205225 sigma out 15 active outputs RANK 6 NODE 6 --> 11.5366907 sigma out 15 active outputs RANK 7 NODE 12 --> 11.4491863 sigma out 15 active outputs RANK 8 NODE 1 --> 11.030633 sigma out 15 active outputs RANK 9 NODE 5 --> 10.6347389 sigma out 15 active outputs RANK 10 NODE 10 --> 10.0739737 sigma out 15 active outputs RANK 11 NODE 3 --> 7.65986443 sigma out 15 active outputs RANK 12 NODE 9 --> 7.42443657 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 15.7027369 sigma in 12act. ( 17.3752575 sig out 1act.) RANK 2 NODE 15 --> 14.04317 sigma in 12act. ( 15.909296 sig out 1act.) RANK 3 NODE 13 --> 13.8973484 sigma in 12act. ( 18.0077076 sig out 1act.) RANK 4 NODE 7 --> 12.5175915 sigma in 12act. ( 13.4835644 sig out 1act.) RANK 5 NODE 8 --> 12.1330204 sigma in 12act. ( 7.01398277 sig out 1act.) RANK 6 NODE 9 --> 11.4877357 sigma in 12act. ( 14.7400751 sig out 1act.) RANK 7 NODE 12 --> 10.9743423 sigma in 12act. ( 15.0011969 sig out 1act.) RANK 8 NODE 11 --> 9.26916313 sigma in 12act. ( 8.5605526 sig out 1act.) RANK 9 NODE 1 --> 8.48170757 sigma in 12act. ( 9.77330017 sig out 1act.) RANK 10 NODE 3 --> 6.24104738 sigma in 12act. ( 5.17704773 sig out 1act.) RANK 11 NODE 5 --> 6.07261848 sigma in 12act. ( 6.62224579 sig out 1act.) RANK 12 NODE 4 --> 5.96355534 sigma in 12act. ( 7.86992741 sig out 1act.) RANK 13 NODE 10 --> 5.06640148 sigma in 12act. ( 4.65719032 sig out 1act.) RANK 14 NODE 2 --> 4.95977354 sigma in 12act. ( 0.656733811 sig out 1act.) RANK 15 NODE 14 --> 3.77896547 sigma in 12act. ( 5.34440231 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 18.0077076 sigma out 1act.( 13.8973484 sig in 12act.) RANK 2 NODE 6 --> 17.3752575 sigma out 1act.( 15.7027369 sig in 12act.) RANK 3 NODE 15 --> 15.909296 sigma out 1act.( 14.04317 sig in 12act.) RANK 4 NODE 12 --> 15.0011969 sigma out 1act.( 10.9743423 sig in 12act.) RANK 5 NODE 9 --> 14.7400751 sigma out 1act.( 11.4877357 sig in 12act.) RANK 6 NODE 7 --> 13.4835644 sigma out 1act.( 12.5175915 sig in 12act.) RANK 7 NODE 1 --> 9.77330017 sigma out 1act.( 8.48170757 sig in 12act.) RANK 8 NODE 11 --> 8.5605526 sigma out 1act.( 9.26916313 sig in 12act.) RANK 9 NODE 4 --> 7.86992741 sigma out 1act.( 5.96355534 sig in 12act.) RANK 10 NODE 8 --> 7.01398277 sigma out 1act.( 12.1330204 sig in 12act.) RANK 11 NODE 5 --> 6.62224579 sigma out 1act.( 6.07261848 sig in 12act.) RANK 12 NODE 14 --> 5.34440231 sigma out 1act.( 3.77896547 sig in 12act.) RANK 13 NODE 3 --> 5.17704773 sigma out 1act.( 6.24104738 sig in 12act.) RANK 14 NODE 10 --> 4.65719032 sigma out 1act.( 5.06640148 sig in 12act.) RANK 15 NODE 2 --> 0.656733811 sigma out 1act.( 4.95977354 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 43.6424866 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 21.2002125 sigma out 15 active outputs RANK 2 NODE 11 --> 16.9513893 sigma out 15 active outputs RANK 3 NODE 4 --> 16.5828495 sigma out 15 active outputs RANK 4 NODE 8 --> 15.4195328 sigma out 15 active outputs RANK 5 NODE 7 --> 14.8493223 sigma out 15 active outputs RANK 6 NODE 1 --> 14.018425 sigma out 15 active outputs RANK 7 NODE 6 --> 13.4956656 sigma out 15 active outputs RANK 8 NODE 12 --> 12.4356947 sigma out 15 active outputs RANK 9 NODE 10 --> 11.9674282 sigma out 15 active outputs RANK 10 NODE 5 --> 11.4935074 sigma out 15 active outputs RANK 11 NODE 3 --> 9.84650421 sigma out 15 active outputs RANK 12 NODE 9 --> 8.37048626 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 18.8719501 sigma in 12act. ( 18.0193348 sig out 1act.) RANK 2 NODE 6 --> 17.2698326 sigma in 12act. ( 16.4112053 sig out 1act.) RANK 3 NODE 15 --> 16.7790089 sigma in 12act. ( 15.7026262 sig out 1act.) RANK 4 NODE 9 --> 16.5016994 sigma in 12act. ( 15.6181698 sig out 1act.) RANK 5 NODE 12 --> 16.1256523 sigma in 12act. ( 14.9347935 sig out 1act.) RANK 6 NODE 7 --> 13.0576048 sigma in 12act. ( 13.1708088 sig out 1act.) RANK 7 NODE 4 --> 11.6673822 sigma in 12act. ( 8.83374882 sig out 1act.) RANK 8 NODE 1 --> 11.496315 sigma in 12act. ( 9.90548801 sig out 1act.) RANK 9 NODE 14 --> 10.6199217 sigma in 12act. ( 6.48559856 sig out 1act.) RANK 10 NODE 11 --> 9.81033897 sigma in 12act. ( 8.0955143 sig out 1act.) RANK 11 NODE 8 --> 9.38513565 sigma in 12act. ( 5.24807215 sig out 1act.) RANK 12 NODE 3 --> 8.24686909 sigma in 12act. ( 4.76783895 sig out 1act.) RANK 13 NODE 5 --> 8.2360878 sigma in 12act. ( 6.74803734 sig out 1act.) RANK 14 NODE 2 --> 8.04106045 sigma in 12act. ( 1.33265448 sig out 1act.) RANK 15 NODE 10 --> 6.40388966 sigma in 12act. ( 4.17974186 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 18.0193348 sigma out 1act.( 18.8719501 sig in 12act.) RANK 2 NODE 6 --> 16.4112053 sigma out 1act.( 17.2698326 sig in 12act.) RANK 3 NODE 15 --> 15.7026262 sigma out 1act.( 16.7790089 sig in 12act.) RANK 4 NODE 9 --> 15.6181698 sigma out 1act.( 16.5016994 sig in 12act.) RANK 5 NODE 12 --> 14.9347935 sigma out 1act.( 16.1256523 sig in 12act.) RANK 6 NODE 7 --> 13.1708088 sigma out 1act.( 13.0576048 sig in 12act.) RANK 7 NODE 1 --> 9.90548801 sigma out 1act.( 11.496315 sig in 12act.) RANK 8 NODE 4 --> 8.83374882 sigma out 1act.( 11.6673822 sig in 12act.) RANK 9 NODE 11 --> 8.0955143 sigma out 1act.( 9.81033897 sig in 12act.) RANK 10 NODE 5 --> 6.74803734 sigma out 1act.( 8.2360878 sig in 12act.) RANK 11 NODE 14 --> 6.48559856 sigma out 1act.( 10.6199217 sig in 12act.) RANK 12 NODE 8 --> 5.24807215 sigma out 1act.( 9.38513565 sig in 12act.) RANK 13 NODE 3 --> 4.76783895 sigma out 1act.( 8.24686909 sig in 12act.) RANK 14 NODE 10 --> 4.17974186 sigma out 1act.( 6.40388966 sig in 12act.) RANK 15 NODE 2 --> 1.33265448 sigma out 1act.( 8.04106045 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 43.3572693 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.428817838 *** contribution from regularisation: 0.00441038562 *** contribution from error: -0.433228225 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.47088635 *** contribution from regularisation: 0.00266221468 *** contribution from error: -0.473548561 *********************************************** -----------------> Test sample ENTER BFGS code START -44029.6883 0.788634062 0.0505284406 EXIT FROM BFGS code FG_START 0. 0.788634062 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.489140302 *** contribution from regularisation: 0.00243453798 *** contribution from error: -0.491574854 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -45726.7915 0.788634062 1.94466567 EXIT FROM BFGS code FG_LNSRCH 0. 0.789004028 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.521665514 *** contribution from regularisation: 0.00347337825 *** contribution from error: -0.525138915 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48767.3773 0.789004028 1.90341175 EXIT FROM BFGS code NEW_X -48767.3773 0.789004028 1.90341175 ENTER BFGS code NEW_X -48767.3773 0.789004028 1.90341175 EXIT FROM BFGS code FG_LNSRCH 0. 0.789387286 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.525138021 *** contribution from regularisation: 0.00350230373 *** contribution from error: -0.52864033 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49092.0047 0.789387286 -6.07269812 EXIT FROM BFGS code NEW_X -49092.0047 0.789387286 -6.07269812 ENTER BFGS code NEW_X -49092.0047 0.789387286 -6.07269812 EXIT FROM BFGS code FG_LNSRCH 0. 0.785086036 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.527293146 *** contribution from regularisation: 0.0033512935 *** contribution from error: -0.530644417 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49293.474 0.785086036 -21.5437775 EXIT FROM BFGS code NEW_X -49293.474 0.785086036 -21.5437775 ENTER BFGS code NEW_X -49293.474 0.785086036 -21.5437775 EXIT FROM BFGS code FG_LNSRCH 0. 0.771350026 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.528043687 *** contribution from regularisation: 0.00326146442 *** contribution from error: -0.531305134 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49363.636 0.771350026 -17.2952709 EXIT FROM BFGS code NEW_X -49363.636 0.771350026 -17.2952709 ENTER BFGS code NEW_X -49363.636 0.771350026 -17.2952709 EXIT FROM BFGS code FG_LNSRCH 0. 0.743597388 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.529192269 *** contribution from regularisation: 0.00324515067 *** contribution from error: -0.532437444 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49471.0115 0.743597388 -19.6170082 EXIT FROM BFGS code NEW_X -49471.0115 0.743597388 -19.6170082 ENTER BFGS code NEW_X -49471.0115 0.743597388 -19.6170082 EXIT FROM BFGS code FG_LNSRCH 0. 0.670178652 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.530747712 *** contribution from regularisation: 0.00349747436 *** contribution from error: -0.534245193 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49616.42 0.670178652 33.0635796 EXIT FROM BFGS code NEW_X -49616.42 0.670178652 33.0635796 ENTER BFGS code NEW_X -49616.42 0.670178652 33.0635796 EXIT FROM BFGS code FG_LNSRCH 0. 0.65122664 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 38.4768486 sigma out 15 active outputs RANK 2 NODE 1 --> 25.0494747 sigma out 15 active outputs RANK 3 NODE 4 --> 23.0611496 sigma out 15 active outputs RANK 4 NODE 8 --> 22.7721806 sigma out 15 active outputs RANK 5 NODE 10 --> 22.1610317 sigma out 15 active outputs RANK 6 NODE 9 --> 21.0725956 sigma out 15 active outputs RANK 7 NODE 7 --> 16.4452381 sigma out 15 active outputs RANK 8 NODE 6 --> 16.2640362 sigma out 15 active outputs RANK 9 NODE 11 --> 15.5665369 sigma out 15 active outputs RANK 10 NODE 12 --> 13.545577 sigma out 15 active outputs RANK 11 NODE 3 --> 10.5184774 sigma out 15 active outputs RANK 12 NODE 5 --> 10.0333815 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 31.4107513 sigma in 12act. ( 28.0846615 sig out 1act.) RANK 2 NODE 15 --> 29.8450279 sigma in 12act. ( 26.8600254 sig out 1act.) RANK 3 NODE 1 --> 26.8184376 sigma in 12act. ( 23.0455341 sig out 1act.) RANK 4 NODE 9 --> 24.5645332 sigma in 12act. ( 22.581274 sig out 1act.) RANK 5 NODE 4 --> 21.2134705 sigma in 12act. ( 18.8263111 sig out 1act.) RANK 6 NODE 14 --> 21.128334 sigma in 12act. ( 15.3685017 sig out 1act.) RANK 7 NODE 2 --> 16.8180332 sigma in 12act. ( 16.579752 sig out 1act.) RANK 8 NODE 12 --> 16.0735989 sigma in 12act. ( 14.5687428 sig out 1act.) RANK 9 NODE 6 --> 15.0536776 sigma in 12act. ( 11.3545055 sig out 1act.) RANK 10 NODE 7 --> 10.9996233 sigma in 12act. ( 9.02486992 sig out 1act.) RANK 11 NODE 11 --> 8.94356537 sigma in 12act. ( 7.54675102 sig out 1act.) RANK 12 NODE 5 --> 8.84044361 sigma in 12act. ( 6.44241333 sig out 1act.) RANK 13 NODE 8 --> 7.73654938 sigma in 12act. ( 6.77763414 sig out 1act.) RANK 14 NODE 3 --> 7.16034079 sigma in 12act. ( 5.06587076 sig out 1act.) RANK 15 NODE 10 --> 3.32707858 sigma in 12act. ( 0.344373018 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 28.0846615 sigma out 1act.( 31.4107513 sig in 12act.) RANK 2 NODE 15 --> 26.8600254 sigma out 1act.( 29.8450279 sig in 12act.) RANK 3 NODE 1 --> 23.0455341 sigma out 1act.( 26.8184376 sig in 12act.) RANK 4 NODE 9 --> 22.581274 sigma out 1act.( 24.5645332 sig in 12act.) RANK 5 NODE 4 --> 18.8263111 sigma out 1act.( 21.2134705 sig in 12act.) RANK 6 NODE 2 --> 16.579752 sigma out 1act.( 16.8180332 sig in 12act.) RANK 7 NODE 14 --> 15.3685017 sigma out 1act.( 21.128334 sig in 12act.) RANK 8 NODE 12 --> 14.5687428 sigma out 1act.( 16.0735989 sig in 12act.) RANK 9 NODE 6 --> 11.3545055 sigma out 1act.( 15.0536776 sig in 12act.) RANK 10 NODE 7 --> 9.02486992 sigma out 1act.( 10.9996233 sig in 12act.) RANK 11 NODE 11 --> 7.54675102 sigma out 1act.( 8.94356537 sig in 12act.) RANK 12 NODE 8 --> 6.77763414 sigma out 1act.( 7.73654938 sig in 12act.) RANK 13 NODE 5 --> 6.44241333 sigma out 1act.( 8.84044361 sig in 12act.) RANK 14 NODE 3 --> 5.06587076 sigma out 1act.( 7.16034079 sig in 12act.) RANK 15 NODE 10 --> 0.344373018 sigma out 1act.( 3.32707858 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.320816 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.530365646 *** contribution from regularisation: 0.00359853287 *** contribution from error: -0.533964157 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49580.6994 0.65122664 -211.204178 EXIT FROM BFGS code FG_LNSRCH 0. 0.66175133 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.531844556 *** contribution from regularisation: 0.00314912642 *** contribution from error: -0.534993708 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49718.9585 0.66175133 -57.0017738 EXIT FROM BFGS code NEW_X -49718.9585 0.66175133 -57.0017738 ENTER BFGS code NEW_X -49718.9585 0.66175133 -57.0017738 EXIT FROM BFGS code FG_LNSRCH 0. 0.643062651 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.532093048 *** contribution from regularisation: 0.00338456966 *** contribution from error: -0.535477638 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49742.1838 0.643062651 -23.8892117 EXIT FROM BFGS code NEW_X -49742.1838 0.643062651 -23.8892117 ENTER BFGS code NEW_X -49742.1838 0.643062651 -23.8892117 EXIT FROM BFGS code FG_LNSRCH 0. 0.628939688 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.532406986 *** contribution from regularisation: 0.00331946346 *** contribution from error: -0.535726428 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49771.5335 0.628939688 -10.9467802 EXIT FROM BFGS code NEW_X -49771.5335 0.628939688 -10.9467802 ENTER BFGS code NEW_X -49771.5335 0.628939688 -10.9467802 EXIT FROM BFGS code FG_LNSRCH 0. 0.57790184 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.533115029 *** contribution from regularisation: 0.003361549 *** contribution from error: -0.536476552 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49837.7275 0.57790184 29.1257133 EXIT FROM BFGS code NEW_X -49837.7275 0.57790184 29.1257133 ENTER BFGS code NEW_X -49837.7275 0.57790184 29.1257133 EXIT FROM BFGS code FG_LNSRCH 0. 0.520777524 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.534078479 *** contribution from regularisation: 0.00345356134 *** contribution from error: -0.537532032 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49927.7922 0.520777524 75.439949 EXIT FROM BFGS code NEW_X -49927.7922 0.520777524 75.439949 ENTER BFGS code NEW_X -49927.7922 0.520777524 75.439949 EXIT FROM BFGS code FG_LNSRCH 0. 0.475135982 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.534578383 *** contribution from regularisation: 0.003790471 *** contribution from error: -0.538368881 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49974.5265 0.475135982 -31.7256927 EXIT FROM BFGS code NEW_X -49974.5265 0.475135982 -31.7256927 ENTER BFGS code NEW_X -49974.5265 0.475135982 -31.7256927 EXIT FROM BFGS code FG_LNSRCH 0. 0.50316 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.535748541 *** contribution from regularisation: 0.00317026372 *** contribution from error: -0.538918793 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50083.9179 0.50316 20.3805599 EXIT FROM BFGS code NEW_X -50083.9179 0.50316 20.3805599 ENTER BFGS code NEW_X -50083.9179 0.50316 20.3805599 EXIT FROM BFGS code FG_LNSRCH 0. 0.513303816 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.535675406 *** contribution from regularisation: 0.00338382437 *** contribution from error: -0.539059222 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50077.0807 0.513303816 6.33255291 EXIT FROM BFGS code FG_LNSRCH 0. 0.505276382 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.53554976 *** contribution from regularisation: 0.00342114083 *** contribution from error: -0.538970888 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50065.3337 0.505276382 17.5655861 EXIT FROM BFGS code FG_LNSRCH 0. 0.503246725 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 47.8033218 sigma out 15 active outputs RANK 2 NODE 4 --> 32.7428932 sigma out 15 active outputs RANK 3 NODE 10 --> 31.0592613 sigma out 15 active outputs RANK 4 NODE 1 --> 25.1770782 sigma out 15 active outputs RANK 5 NODE 9 --> 23.9414234 sigma out 15 active outputs RANK 6 NODE 6 --> 23.6201649 sigma out 15 active outputs RANK 7 NODE 7 --> 21.8045826 sigma out 15 active outputs RANK 8 NODE 8 --> 20.2784042 sigma out 15 active outputs RANK 9 NODE 5 --> 15.4881306 sigma out 15 active outputs RANK 10 NODE 12 --> 14.0033884 sigma out 15 active outputs RANK 11 NODE 3 --> 13.8353281 sigma out 15 active outputs RANK 12 NODE 11 --> 10.9728937 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 46.6854515 sigma in 12act. ( 43.3542595 sig out 1act.) RANK 2 NODE 13 --> 38.8908463 sigma in 12act. ( 38.9158707 sig out 1act.) RANK 3 NODE 15 --> 31.4448681 sigma in 12act. ( 34.9656219 sig out 1act.) RANK 4 NODE 4 --> 27.9954491 sigma in 12act. ( 27.3764076 sig out 1act.) RANK 5 NODE 9 --> 25.9152069 sigma in 12act. ( 26.727354 sig out 1act.) RANK 6 NODE 2 --> 22.60923 sigma in 12act. ( 23.7737293 sig out 1act.) RANK 7 NODE 14 --> 17.033968 sigma in 12act. ( 13.844017 sig out 1act.) RANK 8 NODE 6 --> 13.7209635 sigma in 12act. ( 11.2661982 sig out 1act.) RANK 9 NODE 7 --> 13.3983917 sigma in 12act. ( 12.0432644 sig out 1act.) RANK 10 NODE 12 --> 12.4455957 sigma in 12act. ( 11.3345823 sig out 1act.) RANK 11 NODE 8 --> 10.5184574 sigma in 12act. ( 11.026659 sig out 1act.) RANK 12 NODE 11 --> 9.20262909 sigma in 12act. ( 8.42698097 sig out 1act.) RANK 13 NODE 5 --> 6.83228588 sigma in 12act. ( 5.76289129 sig out 1act.) RANK 14 NODE 3 --> 3.60014176 sigma in 12act. ( 1.23846424 sig out 1act.) RANK 15 NODE 10 --> 2.4992075 sigma in 12act. ( 1.06543219 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 43.3542595 sigma out 1act.( 46.6854515 sig in 12act.) RANK 2 NODE 13 --> 38.9158707 sigma out 1act.( 38.8908463 sig in 12act.) RANK 3 NODE 15 --> 34.9656219 sigma out 1act.( 31.4448681 sig in 12act.) RANK 4 NODE 4 --> 27.3764076 sigma out 1act.( 27.9954491 sig in 12act.) RANK 5 NODE 9 --> 26.727354 sigma out 1act.( 25.9152069 sig in 12act.) RANK 6 NODE 2 --> 23.7737293 sigma out 1act.( 22.60923 sig in 12act.) RANK 7 NODE 14 --> 13.844017 sigma out 1act.( 17.033968 sig in 12act.) RANK 8 NODE 7 --> 12.0432644 sigma out 1act.( 13.3983917 sig in 12act.) RANK 9 NODE 12 --> 11.3345823 sigma out 1act.( 12.4455957 sig in 12act.) RANK 10 NODE 6 --> 11.2661982 sigma out 1act.( 13.7209635 sig in 12act.) RANK 11 NODE 8 --> 11.026659 sigma out 1act.( 10.5184574 sig in 12act.) RANK 12 NODE 11 --> 8.42698097 sigma out 1act.( 9.20262909 sig in 12act.) RANK 13 NODE 5 --> 5.76289129 sigma out 1act.( 6.83228588 sig in 12act.) RANK 14 NODE 3 --> 1.23846424 sigma out 1act.( 3.60014176 sig in 12act.) RANK 15 NODE 10 --> 1.06543219 sigma out 1act.( 2.4992075 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 86.4072876 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.535517931 *** contribution from regularisation: 0.00340325711 *** contribution from error: -0.538921177 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50062.3608 0.503246725 20.6703777 EXIT FROM BFGS code FG_LNSRCH 0. 0.503160179 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.535532296 *** contribution from regularisation: 0.00338649866 *** contribution from error: -0.538918793 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50063.7038 0.503160179 20.92453 EXIT FROM BFGS code FG_LNSRCH 0. 0.50316 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.535531521 *** contribution from regularisation: 0.00338731962 *** contribution from error: -0.538918853 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50063.6266 0.50316 20.8713837 EXIT FROM BFGS code FG_LNSRCH 0. 0.50316 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.535502374 *** contribution from regularisation: 0.00341642834 *** contribution from error: -0.538918793 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50060.9054 0.50316 21.1343384 EXIT FROM BFGS code FG_LNSRCH 0. 0.50316 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.535551429 *** contribution from regularisation: 0.00336737605 *** contribution from error: -0.538918793 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50065.491 0.50316 21.1096325 EXIT FROM BFGS code NEW_X -50065.491 0.50316 21.1096325 ENTER BFGS code NEW_X -50065.491 0.50316 21.1096325 EXIT FROM BFGS code CONVERGENC -50065.491 0.50316 21.1096325 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 70.6642456 sigma out 15 active outputs RANK 2 NODE 4 --> 47.956543 sigma out 15 active outputs RANK 3 NODE 10 --> 45.9781227 sigma out 15 active outputs RANK 4 NODE 6 --> 37.2687225 sigma out 15 active outputs RANK 5 NODE 1 --> 37.1340561 sigma out 15 active outputs RANK 6 NODE 9 --> 34.1292877 sigma out 15 active outputs RANK 7 NODE 7 --> 32.453701 sigma out 15 active outputs RANK 8 NODE 8 --> 30.2006626 sigma out 15 active outputs RANK 9 NODE 5 --> 22.8721619 sigma out 15 active outputs RANK 10 NODE 3 --> 21.5869408 sigma out 15 active outputs RANK 11 NODE 12 --> 21.0760918 sigma out 15 active outputs RANK 12 NODE 11 --> 15.9261875 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 69.6060333 sigma in 12act. ( 64.5868073 sig out 1act.) RANK 2 NODE 13 --> 57.9875565 sigma in 12act. ( 59.0064087 sig out 1act.) RANK 3 NODE 15 --> 46.5631218 sigma in 12act. ( 52.6385384 sig out 1act.) RANK 4 NODE 4 --> 42.2633934 sigma in 12act. ( 40.6655579 sig out 1act.) RANK 5 NODE 9 --> 38.4539757 sigma in 12act. ( 40.2826118 sig out 1act.) RANK 6 NODE 2 --> 33.4866486 sigma in 12act. ( 36.3727493 sig out 1act.) RANK 7 NODE 14 --> 24.1668396 sigma in 12act. ( 21.0714798 sig out 1act.) RANK 8 NODE 7 --> 20.0121632 sigma in 12act. ( 18.0464783 sig out 1act.) RANK 9 NODE 6 --> 19.8995266 sigma in 12act. ( 17.071476 sig out 1act.) RANK 10 NODE 12 --> 17.9409542 sigma in 12act. ( 17.1163406 sig out 1act.) RANK 11 NODE 8 --> 15.3371162 sigma in 12act. ( 16.8316402 sig out 1act.) RANK 12 NODE 11 --> 13.5305624 sigma in 12act. ( 12.1621943 sig out 1act.) RANK 13 NODE 5 --> 9.27223587 sigma in 12act. ( 8.53993988 sig out 1act.) RANK 14 NODE 3 --> 3.95829844 sigma in 12act. ( 1.86277616 sig out 1act.) RANK 15 NODE 10 --> 2.82489491 sigma in 12act. ( 1.55928993 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 64.5868073 sigma out 1act.( 69.6060333 sig in 12act.) RANK 2 NODE 13 --> 59.0064087 sigma out 1act.( 57.9875565 sig in 12act.) RANK 3 NODE 15 --> 52.6385384 sigma out 1act.( 46.5631218 sig in 12act.) RANK 4 NODE 4 --> 40.6655579 sigma out 1act.( 42.2633934 sig in 12act.) RANK 5 NODE 9 --> 40.2826118 sigma out 1act.( 38.4539757 sig in 12act.) RANK 6 NODE 2 --> 36.3727493 sigma out 1act.( 33.4866486 sig in 12act.) RANK 7 NODE 14 --> 21.0714798 sigma out 1act.( 24.1668396 sig in 12act.) RANK 8 NODE 7 --> 18.0464783 sigma out 1act.( 20.0121632 sig in 12act.) RANK 9 NODE 12 --> 17.1163406 sigma out 1act.( 17.9409542 sig in 12act.) RANK 10 NODE 6 --> 17.071476 sigma out 1act.( 19.8995266 sig in 12act.) RANK 11 NODE 8 --> 16.8316402 sigma out 1act.( 15.3371162 sig in 12act.) RANK 12 NODE 11 --> 12.1621943 sigma out 1act.( 13.5305624 sig in 12act.) RANK 13 NODE 5 --> 8.53993988 sigma out 1act.( 9.27223587 sig in 12act.) RANK 14 NODE 3 --> 1.86277616 sigma out 1act.( 3.95829844 sig in 12act.) RANK 15 NODE 10 --> 1.55928993 sigma out 1act.( 2.82489491 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 129.951996 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.535533428 *** contribution from regularisation: 0.00338536431 *** contribution from error: -0.538918793 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done