NNInput NNInputs_120.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 186030 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 46230 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 46230 Chosen entries: 46230 Signal fraction: 1 Background fraction: 0.330687 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 46230 Entries to split: 46230 Test with : 23115 Train with : 23115 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 46230 for Signal Prepared event 0 for Signal with 46230 events ====Entry 0 Variable Ht : 156.497 Variable LepAPt : 24.4462 Variable LepBPt : 15.2546 Variable MetSigLeptonsJets : 4.03888 Variable MetSpec : 26.0087 Variable SumEtLeptonsJets : 113.473 Variable VSumJetLeptonsPt : 37.0367 Variable addEt : 82.7245 Variable dPhiLepSumMet : 0.85328 Variable dPhiLeptons : 0.330941 Variable dRLeptons : 0.538617 Variable lep1_E : 30.9903 Variable lep2_E : 15.9065 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2120 Ht = 156.497 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 24.4462 LepAPt = 24.4462 LepBEt = 15.2546 LepBPt = 15.2546 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 43.0236 MetDelPhi = 0.649165 MetSig = 3.00203 MetSigLeptonsJets = 4.03888 MetSpec = 26.0087 Mjj = 0 MostCentralJetEta = -1.64867 MtllMet = 86.7807 Njets = 1 SB = 0 SumEt = 205.392 SumEtJets = 0 SumEtLeptonsJets = 113.473 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 37.0367 addEt = 82.7245 dPhiLepSumMet = 0.85328 dPhiLeptons = 0.330941 dRLeptons = 0.538617 diltype = 45 dimass = 10.4324 event = 71 jet1_Et = 73.7722 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 30.9903 lep2_E = 15.9065 rand = 0.999742 run = 232428 weight = 1.10299e-06 ===Show End Prepared event 10000 for Signal with 46230 events Prepared event 20000 for Signal with 46230 events Prepared event 30000 for Signal with 46230 events Prepared event 40000 for Signal with 46230 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.26301 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4402 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 186030 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4402 negative weights. Signal fraction: 62.5859756 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 62.7899857 64.9044495 66.3942795 67.6274567 68.739212 69.6618805 70.4488678 71.2853165 71.98349 72.9104004 73.5765305 74.2392578 74.8728943 75.4599457 76.0682068 76.8103485 77.2893066 77.796814 78.356102 78.8956451 79.3919983 79.9131927 80.5520248 81.0430756 81.6083527 82.1697693 82.7032776 83.3777847 84.1585007 84.9185791 85.7406158 86.6046219 87.4656982 88.3865814 89.285141 90.095459 91.165535 92.1636047 93.1321793 94.2460251 95.2473907 96.1270142 97.0135117 97.9989471 98.8606873 99.6954956 100.622971 101.540909 102.360847 103.260483 104.119705 104.865273 105.817657 106.635941 107.502457 108.475113 109.367722 110.348648 111.192078 112.013824 112.925865 113.826813 114.888855 116.111526 117.137344 118.334091 119.554993 120.779022 122.207397 123.640587 125.284576 127.13707 128.848541 130.544373 132.442719 134.434982 136.249573 138.27977 140.269775 142.483582 144.944794 147.211517 149.476379 152.104584 155.105103 158.277222 161.326614 164.901367 168.839752 173.800568 178.567322 184.609482 191.449203 199.153549 207.441925 220.216644 236.43985 261.281036 308.620911 893.967896 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2972374 20.5693398 20.8135567 21.0845757 21.3077469 21.519125 21.7285614 21.9435692 22.1085892 22.2928429 22.4986057 22.6937103 22.9131145 23.0922165 23.2765198 23.422348 23.619976 23.7966423 23.9995461 24.2073135 24.3982277 24.5789948 24.7529011 24.9411507 25.1196117 25.302845 25.4709969 25.621582 25.7865906 25.944809 26.1567726 26.2924347 26.5003166 26.7042599 26.9108982 27.0998631 27.3142471 27.5283298 27.7146034 27.904068 28.090868 28.2823143 28.4886475 28.7012634 28.9192562 29.1130524 29.3142624 29.5246124 29.7465324 29.9762592 30.2229004 30.476511 30.6744003 30.9163208 31.1776352 31.4486656 31.6609879 31.8446732 32.0812302 32.3074036 32.5780029 32.8154449 33.0944748 33.3696671 33.6507111 33.9262733 34.2024002 34.5019379 34.8600922 35.2038193 35.5356064 35.8707123 36.2217178 36.6226044 36.9737015 37.3250122 37.7330971 38.1413422 38.5803528 39.0586205 39.5317917 40.0257683 40.5117531 40.8899384 41.4303665 42.0706329 42.7041359 43.5354767 44.3473244 45.241539 46.3181953 47.5526505 48.9191589 50.6610794 52.358345 54.9148636 58.6539001 63.8409958 72.7509918 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0000496 10.1097641 10.2098942 10.3099594 10.394989 10.484725 10.5852852 10.6748466 10.7697639 10.8714437 10.9478359 11.0313053 11.1248131 11.2325439 11.3323774 11.428009 11.5240755 11.6318073 11.737359 11.8479004 11.9691677 12.0736217 12.1848631 12.2963905 12.4017124 12.5172739 12.6184959 12.7389555 12.8557825 12.9668617 13.08319 13.2265568 13.3684368 13.4966507 13.6111317 13.7248707 13.8375702 13.9614201 14.1010704 14.2282944 14.342639 14.4887962 14.6362476 14.7909594 14.9387522 15.0748596 15.2168999 15.345499 15.4568977 15.5896339 15.7350359 15.8657913 15.9822807 16.1439934 16.3042603 16.4560547 16.6173859 16.7854862 16.9421062 17.1340771 17.3091373 17.4966316 17.6893501 17.8527489 18.0040436 18.1940079 18.3783531 18.5482254 18.758316 18.9603729 19.1748924 19.3851852 19.6251163 19.8479767 20.0807304 20.2745399 20.4539413 20.6665535 20.8763638 21.1153278 21.3770676 21.6233902 21.9079666 22.1828041 22.4941463 22.8312378 23.1587811 23.4983902 23.896019 24.336937 24.7515869 25.2082977 25.7589912 26.3737736 26.9826794 27.849041 28.8961029 30.3063679 32.3580551 36.1961937 71.4863358 ------------------------------ Transdef: Tab for variable 5 1.0228225 2.41559601 2.80169106 3.02906132 3.22688127 3.41756582 3.61084938 3.77636433 3.93410397 4.06063461 4.16704845 4.26787853 4.36516094 4.45493984 4.54098034 4.61174107 4.68055534 4.75417471 4.82114029 4.89316463 4.9639926 5.02036905 5.08018017 5.13309574 5.17930031 5.23758936 5.2860713 5.33435774 5.38186073 5.42532539 5.46637344 5.51210976 5.5417738 5.58541679 5.62356043 5.66007233 5.70170593 5.75054836 5.79490185 5.83278322 5.87231731 5.91039467 5.95257854 5.99069595 6.02512932 6.06092501 6.09644127 6.13178253 6.17069674 6.20781708 6.24953651 6.28407955 6.31663704 6.35020542 6.39356422 6.42752123 6.46576977 6.50185585 6.5434742 6.58758736 6.61970329 6.65198469 6.68751383 6.72916842 6.76150894 6.79512691 6.83233166 6.87004852 6.90796089 6.94860125 6.98842907 7.0333271 7.0746212 7.11963749 7.16792583 7.21698856 7.26583815 7.31400061 7.36821985 7.41849136 7.4678936 7.52105665 7.5814743 7.64193678 7.70060825 7.7598629 7.83141899 7.89701462 7.97158003 8.05242538 8.13350201 8.2322464 8.3536129 8.46277046 8.60494995 8.76091385 8.9709034 9.28292179 9.64375305 10.4938889 18.5645885 ------------------------------ Transdef: Tab for variable 6 15.0018101 19.2392426 23.8523178 25.6628265 26.5353813 27.2237759 28.0638084 28.7609291 29.3512592 29.910408 30.5356636 31.0840607 31.6062012 32.0938187 32.5693626 32.947731 33.3206482 33.7335205 34.1262894 34.5252342 34.7845078 35.1280594 35.483223 35.8430862 36.1558685 36.4817963 36.8531342 37.1718521 37.4428864 37.7476196 38.0405655 38.3532333 38.6696243 38.9345436 39.1976929 39.4502182 39.7607574 40.0695915 40.3590851 40.6405792 40.9771957 41.3065262 41.6557045 41.9531631 42.2632065 42.5552521 42.8636856 43.1152077 43.4591637 43.757782 44.0872803 44.4822083 44.8792648 45.2933197 45.7250557 46.1214523 46.5827332 47.0242462 47.4715614 47.9258575 48.3548431 48.7945175 49.1709557 49.567482 50.0092583 50.3658638 50.8405228 51.3175735 51.7957954 52.2313843 52.7185326 53.262146 53.7121048 54.2087708 54.6716843 55.1713333 55.6526566 56.1798553 56.7086601 57.2452011 57.8254509 58.4110031 59.0338364 59.7689819 60.5260086 61.3288345 62.1534538 63.0946426 64.1012115 65.1968155 66.5750122 68.0446243 69.6834717 71.5921631 73.6761017 76.175293 78.3642349 82.2363663 87.5512238 97.471283 250.623764 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.6301651 33.6056213 34.2150421 34.7805176 35.3335953 35.7398453 36.1302567 36.482254 36.8470116 37.1449356 37.4882431 37.778656 38.1221886 38.4050102 38.649086 38.8684349 39.148735 39.3625488 39.5702057 39.8624039 40.2046204 40.501503 40.8567734 41.1511993 41.4245071 41.7255478 42.0513268 42.3824921 42.7770691 43.2429352 43.6586189 44.1085052 44.6248093 45.0427742 45.4810181 45.9142456 46.4341812 46.9196701 47.4922638 47.999073 48.5958099 49.1763344 49.7391014 50.3282166 50.9049072 51.4014664 51.9739456 52.5322037 53.0843201 53.6671944 54.2866745 54.9107895 55.4697609 56.0258408 56.6372795 57.2728958 58.013092 58.8045769 59.4973755 60.3812332 61.07901 61.9124146 62.9566803 64.1057587 65.2998962 66.5004044 67.6094284 68.8089752 70.3141785 71.481514 72.9549637 74.1320801 75.6091995 76.982193 78.3999481 79.8913116 81.5226288 83.0135956 84.727211 86.7160034 88.7687683 90.7629547 93.1322784 95.4571991 98.101944 100.838936 103.990295 107.281906 110.808914 114.641571 118.946831 123.520447 129.721497 136.686066 145.200943 154.79715 167.804794 188.861313 221.442841 521.871643 ------------------------------ Transdef: Tab for variable 8 2.839571 20.6077919 25.545126 28.3331833 30.0137463 31.2437077 32.0120735 32.6186371 33.1244888 33.5706444 33.9719696 34.37323 34.7750282 35.0606194 35.3214188 35.5845871 35.9011765 36.1160431 36.4265442 36.6958275 36.9958191 37.2534485 37.5098839 37.7249832 37.958725 38.163414 38.3828278 38.5979919 38.818367 38.9911499 39.2307816 39.4828377 39.7305298 40.0103264 40.2703781 40.5003738 40.7583847 41.0451813 41.3043213 41.5990067 41.8644562 42.1949005 42.5221252 42.8573074 43.1992188 43.5369186 43.851017 44.2674408 44.5779457 44.9245911 45.3240204 45.6976852 46.0716248 46.4818535 46.8212128 47.2089577 47.6437302 48.0200195 48.3708496 48.7651558 49.1785355 49.5901566 50.0038071 50.367569 50.8088379 51.1947708 51.6180725 52.0544052 52.4939079 52.9165344 53.327343 53.7314377 54.2059593 54.6571541 55.1155777 55.6059494 56.0923462 56.6399994 57.2275925 57.8701096 58.4670181 59.1619034 59.8754387 60.637825 61.3873062 62.3280144 63.2751122 64.3670502 65.522644 66.7966919 68.2659836 69.763649 71.5747833 73.7321854 76.2128601 78.821701 82.3324585 87.6316986 95.3110809 112.556702 406.55069 ------------------------------ Transdef: Tab for variable 9 49.6214828 62.2515106 64.0934906 65.6298981 66.8742828 67.8379974 68.7689743 69.6076279 70.2203827 70.9254303 71.666748 72.3082123 73.0462952 73.6317596 74.2273865 74.8021851 75.3393402 75.817276 76.4133148 77.0081635 77.3954468 77.8324203 78.308609 78.7421112 79.2034912 79.6495514 80.0712433 80.5684814 81.008667 81.4797821 81.9006348 82.3236008 82.8046112 83.377655 83.9067154 84.4998169 85.0229492 85.6585999 86.3606873 86.8943634 87.5375824 88.1748657 88.9078217 89.4928741 90.1830063 90.9687424 91.6730804 92.4512558 93.1754303 93.9323425 94.741394 95.4399338 96.0781097 96.7597809 97.4701385 98.1368866 98.8336334 99.4543686 100.16832 100.832497 101.552361 102.198326 102.887207 103.610703 104.303658 104.981529 105.688293 106.405151 107.116341 107.724831 108.396103 109.08358 109.762047 110.456848 111.088676 111.78022 112.478683 113.190598 113.958771 114.661728 115.471817 116.338196 117.147415 118.029419 118.956589 119.999611 121.000908 122.15834 123.320503 124.776581 126.462944 128.538147 130.718369 133.245056 136.601837 141.212357 146.476471 153.448502 164.558197 189.323639 446.331207 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.817557693 1.11319566 1.30322027 1.47068644 1.60204053 1.71375442 1.81455326 1.90816545 1.99470329 2.06607866 2.12754059 2.18765402 2.23474598 2.28440666 2.32605815 2.3639884 2.40130067 2.43962717 2.47488689 2.50323486 2.53213835 2.56037378 2.58721089 2.6142478 2.63622379 2.66201687 2.68494964 2.70721579 2.72834563 2.74953151 2.76827335 2.78528643 2.80142021 2.81713676 2.82928753 2.84367013 2.85552073 2.86635971 2.87840319 2.88970566 2.89922547 2.90880775 2.9170146 2.92548513 2.93354893 2.94238377 2.94993067 2.95686197 2.9637711 2.97021008 2.97604895 2.98048067 2.98628855 2.98992538 2.99381757 2.99849916 3.00371218 3.00801873 3.01345515 3.01768684 3.02218056 3.02646399 3.02999306 3.03462934 3.0380764 3.04196739 3.04555941 3.04959488 3.05346894 3.05732393 3.06072044 3.06448722 3.06780767 3.07116795 3.07385707 3.07680798 3.08010721 3.08327723 3.08639669 3.08934593 3.09220743 3.09493637 3.09798717 3.10093856 3.10349083 3.10588837 3.10914707 3.11202478 3.11431646 3.1166048 3.11916184 3.12118101 3.12413311 3.12659121 3.12927866 3.13169765 3.13376808 3.13622904 3.13889694 3.1415906 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00610971451 0.0109299421 0.0179536529 0.0248030424 0.0324224234 0.0407812595 0.0494711399 0.0586841628 0.0678259134 0.076726675 0.0849027336 0.0927072465 0.100800514 0.11017675 0.117618322 0.126042455 0.135110855 0.143228531 0.150899768 0.157254234 0.164657712 0.172216967 0.179651767 0.187346935 0.194623262 0.201805055 0.208340287 0.214089155 0.221818566 0.228264093 0.234390974 0.240162849 0.2468431 0.253398299 0.259243608 0.265794277 0.271517903 0.278313935 0.284562349 0.290182829 0.296635866 0.301902086 0.308165073 0.313837647 0.320142746 0.326062441 0.332425237 0.337796271 0.343764067 0.350134701 0.356307983 0.361798048 0.367496789 0.374015421 0.3804878 0.385878563 0.391158402 0.397309959 0.402757168 0.408979118 0.414876223 0.420917511 0.427363038 0.43416357 0.439758062 0.445903182 0.452585459 0.459421635 0.464930654 0.47201705 0.477713883 0.484230161 0.491447687 0.499414623 0.505748689 0.512354016 0.519138098 0.526464522 0.532806635 0.539798617 0.545890689 0.553397655 0.56266582 0.572324634 0.580945492 0.591514945 0.60085988 0.613087475 0.625845373 0.63719672 0.650054455 0.663396001 0.678803563 0.696020961 0.712736487 0.732825339 0.761922717 0.802783012 0.861783504 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.22740078 0.246938437 0.260942221 0.274044842 0.285001516 0.296999276 0.305577219 0.315438211 0.324227422 0.332695782 0.340452582 0.348164052 0.355642706 0.361427814 0.369142026 0.375663549 0.382258087 0.388741136 0.394573778 0.39991796 0.405155182 0.409876108 0.414421737 0.419100285 0.423954666 0.428001404 0.432765782 0.437010705 0.441224277 0.445373952 0.448701143 0.453882039 0.457445592 0.462119281 0.466398358 0.470424235 0.47395575 0.477939367 0.482063264 0.485874712 0.489680171 0.492985666 0.49731499 0.50112915 0.505192399 0.50927031 0.513005137 0.517124355 0.520963311 0.524592638 0.528759718 0.532580197 0.537349343 0.541673899 0.546246529 0.549090266 0.553032398 0.55741632 0.560950041 0.565033495 0.569692492 0.574638724 0.578954577 0.583303511 0.588474035 0.59331584 0.597932816 0.603606999 0.60864532 0.61386776 0.618623018 0.62421 0.629893184 0.635129929 0.64134419 0.647328377 0.653998733 0.660689235 0.666302085 0.67212081 0.67839402 0.685470104 0.693040848 0.700513482 0.707274735 0.71570617 0.724794984 0.733087778 0.742483318 0.75124681 0.7595011 0.77024591 0.781339169 0.79645884 0.814665437 0.832433462 0.851677179 0.880078018 0.923209131 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3597584 22.1211414 22.5726814 23.214632 23.7180061 24.2341957 24.6554451 25.0713081 25.4422607 25.7493343 26.1163788 26.5030174 26.8764477 27.2109394 27.5306244 27.8583298 28.2134972 28.5243683 28.8180237 29.112421 29.3923531 29.6662445 29.9774208 30.2505093 30.5362892 30.7989578 31.0421448 31.3617859 31.6613274 31.9227333 32.2237511 32.5106659 32.8287811 33.1229553 33.3953476 33.7152634 34.0365982 34.3448257 34.5746651 34.924881 35.2559662 35.5572739 35.8835297 36.1210709 36.3977661 36.7448273 37.1047821 37.4158401 37.7553558 38.063797 38.4599609 38.8392868 39.2313309 39.5959892 40.0101967 40.4553299 40.8345261 41.2699966 41.6900558 42.1015778 42.6264458 43.0264587 43.4942551 43.9964905 44.523407 45.0532341 45.6133385 46.2019539 46.8261185 47.4038773 48.0606079 48.7368355 49.4017906 50.1609344 50.9132996 51.7374916 52.5251732 53.3367004 54.2290573 55.1370354 56.1069946 57.0567322 58.1778412 59.4010773 60.8054047 62.2833023 63.547596 64.9834518 66.8576813 68.1800537 69.966568 72.3352127 74.7105713 77.4695129 80.7411804 84.4438477 89.5667725 95.9711456 106.408142 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0084028 10.5597019 10.9017687 11.1549063 11.3847351 11.6462812 11.8608189 12.124507 12.3350086 12.5438719 12.7661829 12.9534864 13.1700802 13.376564 13.5696392 13.7472744 13.9600983 14.1639137 14.3924789 14.5821924 14.7582064 14.966423 15.1526699 15.3648062 15.5452976 15.7464504 15.9492493 16.1519032 16.3436356 16.530386 16.7282753 16.9184227 17.1002369 17.301506 17.513464 17.7299652 17.9247551 18.1141357 18.2754745 18.4957314 18.6734676 18.8687668 19.0582085 19.2142963 19.4265747 19.6799145 19.905262 20.1312847 20.3438473 20.5784874 20.781971 21.0116997 21.2189732 21.4664593 21.6759205 21.8904476 22.1204243 22.3629875 22.6037636 22.8500519 23.1189995 23.363739 23.6193695 23.9054794 24.2155418 24.5074787 24.779171 25.0533295 25.3780918 25.7012901 25.9813728 26.3179951 26.6451416 26.9846573 27.3014793 27.6316147 27.9611435 28.3111095 28.7581615 29.1659107 29.5911446 30.0521336 30.6038151 31.1615562 31.6052532 32.1854095 32.8619843 33.5893326 34.4094162 35.2367554 36.1746063 37.2359047 38.3912659 39.7216797 40.8127518 42.5539246 44.3191185 47.2172966 51.0972519 57.4324379 128.659836 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 54.6 39.9 30.1 6.9 31.9 52.9 37.5 50.5 -30.1 -7.4 -21.3 4.1 -2.2 2 54.6 100.0 62.9 45.4 14.6 57.0 94.0 61.8 89.5 -53.1 -18.6 -40.4 28.6 15.7 3 39.9 62.9 100.0 21.4 -7.4 23.2 66.3 44.3 68.5 -21.8 -19.4 -44.7 62.5 2.7 4 30.1 45.4 21.4 100.0 -2.2 19.9 47.3 34.6 49.9 -14.2 -23.4 -48.6 6.3 65.8 5 6.9 14.6 -7.4 -2.2 100.0 79.5 -13.2 43.9 42.7 29.3 2.3 4.3 -12.4 -7.0 6 31.9 57.0 23.2 19.9 79.5 100.0 34.3 70.4 73.8 -4.3 -7.3 -16.0 3.6 2.4 7 52.9 94.0 66.3 47.3 -13.2 34.3 100.0 55.1 76.8 -59.6 -18.4 -41.4 33.5 19.2 8 37.5 61.8 44.3 34.6 43.9 70.4 55.1 100.0 74.8 -10.8 -16.6 -31.4 19.9 13.4 9 50.5 89.5 68.5 49.9 42.7 73.8 76.8 74.8 100.0 -27.5 -20.5 -45.6 33.2 19.6 10 -30.1 -53.1 -21.8 -14.2 29.3 -4.3 -59.6 -10.8 -27.5 100.0 4.1 11.2 -7.3 -2.1 11 -7.4 -18.6 -19.4 -23.4 2.3 -7.3 -18.4 -16.6 -20.5 4.1 100.0 54.4 -9.2 -14.2 12 -21.3 -40.4 -44.7 -48.6 4.3 -16.0 -41.4 -31.4 -45.6 11.2 54.4 100.0 -22.2 -24.5 13 4.1 28.6 62.5 6.3 -12.4 3.6 33.5 19.9 33.2 -7.3 -9.2 -22.2 100.0 38.0 14 -2.2 15.7 2.7 65.8 -7.0 2.4 19.2 13.4 19.6 -2.1 -14.2 -24.5 38.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 121.356467 TOTAL CORRELATION OF ALL VARIABLES 60.5289649 ROUND 1: MAX CORR ( 60.5069134) AFTER KILLING INPUT VARIABLE 7 CONTR 1.63371497 ROUND 2: MAX CORR ( 60.4868031) AFTER KILLING INPUT VARIABLE 5 CONTR 1.55987801 ROUND 3: MAX CORR ( 60.4622419) AFTER KILLING INPUT VARIABLE 11 CONTR 1.723558 ROUND 4: MAX CORR ( 60.3679495) AFTER KILLING INPUT VARIABLE 8 CONTR 3.37540701 ROUND 5: MAX CORR ( 60.2402729) AFTER KILLING INPUT VARIABLE 10 CONTR 3.92413608 ROUND 6: MAX CORR ( 60.0055268) AFTER KILLING INPUT VARIABLE 9 CONTR 5.31293032 ROUND 7: MAX CORR ( 59.9723191) AFTER KILLING INPUT VARIABLE 6 CONTR 1.99604331 ROUND 8: MAX CORR ( 59.5063889) AFTER KILLING INPUT VARIABLE 12 CONTR 7.46114853 ROUND 9: MAX CORR ( 58.9967175) AFTER KILLING INPUT VARIABLE 14 CONTR 7.77159207 ROUND 10: MAX CORR ( 58.6599164) AFTER KILLING INPUT VARIABLE 4 CONTR 6.2949889 ROUND 11: MAX CORR ( 55.89393) AFTER KILLING INPUT VARIABLE 3 CONTR 17.800404 ROUND 12: MAX CORR ( 54.5959267) AFTER KILLING INPUT VARIABLE 13 CONTR 11.9756504 LAST REMAINING VARIABLE: 2 total correlation to target: 60.5289649 % total significance: 116.611128 sigma correlations of single variables to target: variable 2: 54.5959267 % , in sigma: 105.180926 variable 3: 39.9048833 % , in sigma: 76.8781268 variable 4: 30.0669698 % , in sigma: 57.9250489 variable 5: 6.89074224 % , in sigma: 13.2752513 variable 6: 31.9413633 % , in sigma: 61.5361323 variable 7: 52.9003893 % , in sigma: 101.914415 variable 8: 37.4578162 % , in sigma: 72.1637681 variable 9: 50.4556339 % , in sigma: 97.2045098 variable 10: -30.0561695 % , in sigma: 57.9042418 variable 11: -7.42780725 % , in sigma: 14.3099255 variable 12: -21.3313547 % , in sigma: 41.0955868 variable 13: 4.12380965 % , in sigma: 7.94466078 variable 14: -2.15244609 % , in sigma: 4.14676124 variables sorted by significance: 1 most relevant variable 2 corr 54.5959282 , in sigma: 105.180929 2 most relevant variable 13 corr 11.9756508 , in sigma: 23.0715021 3 most relevant variable 3 corr 17.8004036 , in sigma: 34.2930882 4 most relevant variable 4 corr 6.29498911 , in sigma: 12.1275125 5 most relevant variable 14 corr 7.77159214 , in sigma: 14.9722389 6 most relevant variable 12 corr 7.46114874 , in sigma: 14.374159 7 most relevant variable 6 corr 1.99604332 , in sigma: 3.84544595 8 most relevant variable 9 corr 5.31293011 , in sigma: 10.2355421 9 most relevant variable 10 corr 3.92413616 , in sigma: 7.55998295 10 most relevant variable 8 corr 3.37540698 , in sigma: 6.50283735 11 most relevant variable 11 corr 1.72355795 , in sigma: 3.32049352 12 most relevant variable 5 corr 1.55987799 , in sigma: 3.00515847 13 most relevant variable 7 corr 1.63371491 , in sigma: 3.14740783 global correlations between input variables: variable 2: 98.984757 % variable 3: 93.4210648 % variable 4: 89.4542245 % variable 5: 94.6129729 % variable 6: 93.1753625 % variable 7: 98.4712312 % variable 8: 84.9522621 % variable 9: 98.7116527 % variable 10: 72.0890243 % variable 11: 55.4825055 % variable 12: 72.3159117 % variable 13: 83.8722576 % variable 14: 85.3339137 % significance loss when removing single variables: variable 2: corr = 4.79503402 % , sigma = 9.23779755 variable 3: corr = 11.8588663 % , sigma = 22.8465127 variable 4: corr = 12.0489329 % , sigma = 23.2126826 variable 5: corr = 2.00168377 % , sigma = 3.85631245 variable 6: corr = 3.31238763 % , sigma = 6.38142842 variable 7: corr = 1.63371497 % , sigma = 3.14740793 variable 8: corr = 2.40238401 % , sigma = 4.62827522 variable 9: corr = 4.07176138 % , sigma = 7.84438799 variable 10: corr = 4.03047824 % , sigma = 7.7648546 variable 11: corr = 1.64096151 % , sigma = 3.16136864 variable 12: corr = 5.16083948 % , sigma = 9.94253433 variable 13: corr = 8.65992879 % , sigma = 16.6836499 variable 14: corr = 7.97081943 % , sigma = 15.3560571 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 16.3534393 sigma out 15 active outputs RANK 2 NODE 6 --> 15.0824394 sigma out 15 active outputs RANK 3 NODE 8 --> 15.0462093 sigma out 15 active outputs RANK 4 NODE 3 --> 14.4955845 sigma out 15 active outputs RANK 5 NODE 11 --> 13.7078524 sigma out 15 active outputs RANK 6 NODE 2 --> 12.6108522 sigma out 15 active outputs RANK 7 NODE 1 --> 12.5769825 sigma out 15 active outputs RANK 8 NODE 10 --> 11.5351868 sigma out 15 active outputs RANK 9 NODE 5 --> 10.9477606 sigma out 15 active outputs RANK 10 NODE 7 --> 10.7081146 sigma out 15 active outputs RANK 11 NODE 9 --> 8.30494213 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 20.1370373 sigma in 11act. ( 22.4508018 sig out 1act.) RANK 2 NODE 9 --> 18.3031559 sigma in 11act. ( 18.8549099 sig out 1act.) RANK 3 NODE 1 --> 16.3033543 sigma in 11act. ( 15.6026936 sig out 1act.) RANK 4 NODE 15 --> 13.977706 sigma in 11act. ( 15.1241932 sig out 1act.) RANK 5 NODE 12 --> 12.9758053 sigma in 11act. ( 10.326683 sig out 1act.) RANK 6 NODE 2 --> 10.8249226 sigma in 11act. ( 11.0336714 sig out 1act.) RANK 7 NODE 3 --> 10.5468941 sigma in 11act. ( 10.4744482 sig out 1act.) RANK 8 NODE 11 --> 10.2937517 sigma in 11act. ( 12.2185144 sig out 1act.) RANK 9 NODE 7 --> 10.1761684 sigma in 11act. ( 15.7822294 sig out 1act.) RANK 10 NODE 10 --> 4.66536999 sigma in 11act. ( 5.74526167 sig out 1act.) RANK 11 NODE 8 --> 3.60763979 sigma in 11act. ( 3.35246563 sig out 1act.) RANK 12 NODE 4 --> 3.48757458 sigma in 11act. ( 0.563543439 sig out 1act.) RANK 13 NODE 6 --> 3.27659965 sigma in 11act. ( 6.41407394 sig out 1act.) RANK 14 NODE 14 --> 2.54345369 sigma in 11act. ( 1.13215423 sig out 1act.) RANK 15 NODE 13 --> 0.980146825 sigma in 11act. ( 0.547647297 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 22.4508018 sigma out 1act.( 20.1370373 sig in 11act.) RANK 2 NODE 9 --> 18.8549099 sigma out 1act.( 18.3031559 sig in 11act.) RANK 3 NODE 7 --> 15.7822294 sigma out 1act.( 10.1761684 sig in 11act.) RANK 4 NODE 1 --> 15.6026936 sigma out 1act.( 16.3033543 sig in 11act.) RANK 5 NODE 15 --> 15.1241932 sigma out 1act.( 13.977706 sig in 11act.) RANK 6 NODE 11 --> 12.2185144 sigma out 1act.( 10.2937517 sig in 11act.) RANK 7 NODE 2 --> 11.0336714 sigma out 1act.( 10.8249226 sig in 11act.) RANK 8 NODE 3 --> 10.4744482 sigma out 1act.( 10.5468941 sig in 11act.) RANK 9 NODE 12 --> 10.326683 sigma out 1act.( 12.9758053 sig in 11act.) RANK 10 NODE 6 --> 6.41407394 sigma out 1act.( 3.27659965 sig in 11act.) RANK 11 NODE 10 --> 5.74526167 sigma out 1act.( 4.66536999 sig in 11act.) RANK 12 NODE 8 --> 3.35246563 sigma out 1act.( 3.60763979 sig in 11act.) RANK 13 NODE 14 --> 1.13215423 sigma out 1act.( 2.54345369 sig in 11act.) RANK 14 NODE 4 --> 0.563543439 sigma out 1act.( 3.48757458 sig in 11act.) RANK 15 NODE 13 --> 0.547647297 sigma out 1act.( 0.980146825 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.4272041 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 4 --> 19.9544659 sigma out 15 active outputs RANK 2 NODE 2 --> 19.5890541 sigma out 15 active outputs RANK 3 NODE 8 --> 16.4266872 sigma out 15 active outputs RANK 4 NODE 3 --> 15.8845997 sigma out 15 active outputs RANK 5 NODE 6 --> 15.7944269 sigma out 15 active outputs RANK 6 NODE 1 --> 15.3135128 sigma out 15 active outputs RANK 7 NODE 11 --> 15.0936718 sigma out 15 active outputs RANK 8 NODE 10 --> 12.9748583 sigma out 15 active outputs RANK 9 NODE 5 --> 12.8213854 sigma out 15 active outputs RANK 10 NODE 7 --> 10.7570572 sigma out 15 active outputs RANK 11 NODE 9 --> 10.1537027 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 21.9895821 sigma in 11act. ( 21.7724819 sig out 1act.) RANK 2 NODE 9 --> 19.5633183 sigma in 11act. ( 18.4754219 sig out 1act.) RANK 3 NODE 7 --> 17.6281204 sigma in 11act. ( 15.8247232 sig out 1act.) RANK 4 NODE 15 --> 15.2348022 sigma in 11act. ( 14.6936235 sig out 1act.) RANK 5 NODE 1 --> 14.8020439 sigma in 11act. ( 14.2313175 sig out 1act.) RANK 6 NODE 11 --> 13.4644918 sigma in 11act. ( 12.9546671 sig out 1act.) RANK 7 NODE 6 --> 13.2182665 sigma in 11act. ( 7.92217779 sig out 1act.) RANK 8 NODE 2 --> 10.7287626 sigma in 11act. ( 10.5488453 sig out 1act.) RANK 9 NODE 12 --> 10.5193501 sigma in 11act. ( 8.64360619 sig out 1act.) RANK 10 NODE 10 --> 9.59684658 sigma in 11act. ( 5.82769299 sig out 1act.) RANK 11 NODE 3 --> 9.57285118 sigma in 11act. ( 9.62448215 sig out 1act.) RANK 12 NODE 4 --> 8.42603588 sigma in 11act. ( 1.10149622 sig out 1act.) RANK 13 NODE 8 --> 6.20829535 sigma in 11act. ( 3.17443275 sig out 1act.) RANK 14 NODE 13 --> 6.17259073 sigma in 11act. ( 1.31037819 sig out 1act.) RANK 15 NODE 14 --> 5.10168171 sigma in 11act. ( 0.707790017 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 21.7724819 sigma out 1act.( 21.9895821 sig in 11act.) RANK 2 NODE 9 --> 18.4754219 sigma out 1act.( 19.5633183 sig in 11act.) RANK 3 NODE 7 --> 15.8247232 sigma out 1act.( 17.6281204 sig in 11act.) RANK 4 NODE 15 --> 14.6936235 sigma out 1act.( 15.2348022 sig in 11act.) RANK 5 NODE 1 --> 14.2313175 sigma out 1act.( 14.8020439 sig in 11act.) RANK 6 NODE 11 --> 12.9546671 sigma out 1act.( 13.4644918 sig in 11act.) RANK 7 NODE 2 --> 10.5488453 sigma out 1act.( 10.7287626 sig in 11act.) RANK 8 NODE 3 --> 9.62448215 sigma out 1act.( 9.57285118 sig in 11act.) RANK 9 NODE 12 --> 8.64360619 sigma out 1act.( 10.5193501 sig in 11act.) RANK 10 NODE 6 --> 7.92217779 sigma out 1act.( 13.2182665 sig in 11act.) RANK 11 NODE 10 --> 5.82769299 sigma out 1act.( 9.59684658 sig in 11act.) RANK 12 NODE 8 --> 3.17443275 sigma out 1act.( 6.20829535 sig in 11act.) RANK 13 NODE 13 --> 1.31037819 sigma out 1act.( 6.17259073 sig in 11act.) RANK 14 NODE 4 --> 1.10149622 sigma out 1act.( 8.42603588 sig in 11act.) RANK 15 NODE 14 --> 0.707790017 sigma out 1act.( 5.10168171 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 45.1764565 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.438091397 *** contribution from regularisation: 0.00401153043 *** contribution from error: -0.442102939 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.470588893 *** contribution from regularisation: 0.00232897024 *** contribution from error: -0.472917855 *********************************************** -----------------> Test sample ENTER BFGS code START -43781.1273 -0.313544601 0.275717884 EXIT FROM BFGS code FG_START 0. -0.313544601 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.48514685 *** contribution from regularisation: 0.00213652826 *** contribution from error: -0.487283379 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -45125.9353 -0.313544601 -229.886703 EXIT FROM BFGS code FG_LNSRCH 0. -0.36393562 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.511185825 *** contribution from regularisation: 0.00288876193 *** contribution from error: -0.514074564 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47547.9508 -0.36393562 12.0294781 EXIT FROM BFGS code NEW_X -47547.9508 -0.36393562 12.0294781 ENTER BFGS code NEW_X -47547.9508 -0.36393562 12.0294781 EXIT FROM BFGS code FG_LNSRCH 0. -0.364608139 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.514512062 *** contribution from regularisation: 0.00286492193 *** contribution from error: -0.517376959 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47857.3413 -0.364608139 -19.8357906 EXIT FROM BFGS code NEW_X -47857.3413 -0.364608139 -19.8357906 ENTER BFGS code NEW_X -47857.3413 -0.364608139 -19.8357906 EXIT FROM BFGS code FG_LNSRCH 0. -0.373535037 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.515585244 *** contribution from regularisation: 0.00284989458 *** contribution from error: -0.518435121 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47957.1594 -0.373535037 -11.4720125 EXIT FROM BFGS code NEW_X -47957.1594 -0.373535037 -11.4720125 ENTER BFGS code NEW_X -47957.1594 -0.373535037 -11.4720125 EXIT FROM BFGS code FG_LNSRCH 0. -0.381505787 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.516074777 *** contribution from regularisation: 0.00285109994 *** contribution from error: -0.518925905 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48002.6967 -0.381505787 14.3425465 EXIT FROM BFGS code NEW_X -48002.6967 -0.381505787 14.3425465 ENTER BFGS code NEW_X -48002.6967 -0.381505787 14.3425465 EXIT FROM BFGS code FG_LNSRCH 0. -0.379667848 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.516783357 *** contribution from regularisation: 0.00279534259 *** contribution from error: -0.519578695 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48068.6056 -0.379667848 25.1447487 EXIT FROM BFGS code NEW_X -48068.6056 -0.379667848 25.1447487 ENTER BFGS code NEW_X -48068.6056 -0.379667848 25.1447487 EXIT FROM BFGS code FG_LNSRCH 0. -0.344310433 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.518212259 *** contribution from regularisation: 0.00340190181 *** contribution from error: -0.521614134 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48201.5109 -0.344310433 43.9360199 EXIT FROM BFGS code FG_LNSRCH 0. -0.362390548 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 40.2515411 sigma out 15 active outputs RANK 2 NODE 1 --> 24.4244461 sigma out 15 active outputs RANK 3 NODE 10 --> 15.7172318 sigma out 15 active outputs RANK 4 NODE 4 --> 14.322732 sigma out 15 active outputs RANK 5 NODE 6 --> 14.3227272 sigma out 15 active outputs RANK 6 NODE 9 --> 12.282135 sigma out 15 active outputs RANK 7 NODE 8 --> 9.5993433 sigma out 15 active outputs RANK 8 NODE 3 --> 8.73983669 sigma out 15 active outputs RANK 9 NODE 5 --> 7.45478535 sigma out 15 active outputs RANK 10 NODE 7 --> 6.70036793 sigma out 15 active outputs RANK 11 NODE 11 --> 6.10695076 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 40.5026131 sigma in 11act. ( 44.1054726 sig out 1act.) RANK 2 NODE 11 --> 18.4556408 sigma in 11act. ( 17.0967388 sig out 1act.) RANK 3 NODE 9 --> 17.3182564 sigma in 11act. ( 15.5349712 sig out 1act.) RANK 4 NODE 7 --> 17.2531872 sigma in 11act. ( 14.8856974 sig out 1act.) RANK 5 NODE 13 --> 13.3144207 sigma in 11act. ( 14.2959375 sig out 1act.) RANK 6 NODE 2 --> 11.3648148 sigma in 11act. ( 11.4409084 sig out 1act.) RANK 7 NODE 5 --> 11.1316853 sigma in 11act. ( 9.90385056 sig out 1act.) RANK 8 NODE 15 --> 10.3581848 sigma in 11act. ( 9.5153513 sig out 1act.) RANK 9 NODE 8 --> 7.10428047 sigma in 11act. ( 6.01443768 sig out 1act.) RANK 10 NODE 10 --> 7.03733015 sigma in 11act. ( 5.59532261 sig out 1act.) RANK 11 NODE 12 --> 5.37262058 sigma in 11act. ( 4.82257128 sig out 1act.) RANK 12 NODE 3 --> 5.2937541 sigma in 11act. ( 4.98115301 sig out 1act.) RANK 13 NODE 4 --> 5.12156153 sigma in 11act. ( 2.19444346 sig out 1act.) RANK 14 NODE 1 --> 4.92543983 sigma in 11act. ( 3.69908118 sig out 1act.) RANK 15 NODE 14 --> 2.74206066 sigma in 11act. ( 0.539353311 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 44.1054726 sigma out 1act.( 40.5026131 sig in 11act.) RANK 2 NODE 11 --> 17.0967388 sigma out 1act.( 18.4556408 sig in 11act.) RANK 3 NODE 9 --> 15.5349712 sigma out 1act.( 17.3182564 sig in 11act.) RANK 4 NODE 7 --> 14.8856974 sigma out 1act.( 17.2531872 sig in 11act.) RANK 5 NODE 13 --> 14.2959375 sigma out 1act.( 13.3144207 sig in 11act.) RANK 6 NODE 2 --> 11.4409084 sigma out 1act.( 11.3648148 sig in 11act.) RANK 7 NODE 5 --> 9.90385056 sigma out 1act.( 11.1316853 sig in 11act.) RANK 8 NODE 15 --> 9.5153513 sigma out 1act.( 10.3581848 sig in 11act.) RANK 9 NODE 8 --> 6.01443768 sigma out 1act.( 7.10428047 sig in 11act.) RANK 10 NODE 10 --> 5.59532261 sigma out 1act.( 7.03733015 sig in 11act.) RANK 11 NODE 3 --> 4.98115301 sigma out 1act.( 5.2937541 sig in 11act.) RANK 12 NODE 12 --> 4.82257128 sigma out 1act.( 5.37262058 sig in 11act.) RANK 13 NODE 1 --> 3.69908118 sigma out 1act.( 4.92543983 sig in 11act.) RANK 14 NODE 4 --> 2.19444346 sigma out 1act.( 5.12156153 sig in 11act.) RANK 15 NODE 14 --> 0.539353311 sigma out 1act.( 2.74206066 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 57.9546967 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.519822657 *** contribution from regularisation: 0.00212018704 *** contribution from error: -0.521942854 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48351.3027 -0.362390548 44.6997452 EXIT FROM BFGS code NEW_X -48351.3027 -0.362390548 44.6997452 ENTER BFGS code NEW_X -48351.3027 -0.362390548 44.6997452 EXIT FROM BFGS code FG_LNSRCH 0. -0.32628116 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.521769404 *** contribution from regularisation: 0.00383256748 *** contribution from error: -0.525601983 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48532.3801 -0.32628116 66.521965 EXIT FROM BFGS code NEW_X -48532.3801 -0.32628116 66.521965 ENTER BFGS code NEW_X -48532.3801 -0.32628116 66.521965 EXIT FROM BFGS code FG_LNSRCH 0. -0.272082329 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.525361359 *** contribution from regularisation: 0.00363602396 *** contribution from error: -0.528997362 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48866.4862 -0.272082329 -55.6928024 EXIT FROM BFGS code NEW_X -48866.4862 -0.272082329 -55.6928024 ENTER BFGS code NEW_X -48866.4862 -0.272082329 -55.6928024 EXIT FROM BFGS code FG_LNSRCH 0. -0.298987478 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.527014017 *** contribution from regularisation: 0.0023662094 *** contribution from error: -0.529380202 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49020.2064 -0.298987478 33.7270432 EXIT FROM BFGS code NEW_X -49020.2064 -0.298987478 33.7270432 ENTER BFGS code NEW_X -49020.2064 -0.298987478 33.7270432 EXIT FROM BFGS code FG_LNSRCH 0. -0.287630022 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.526914775 *** contribution from regularisation: 0.00313535798 *** contribution from error: -0.530050159 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49010.978 -0.287630022 -15.6475687 EXIT FROM BFGS code FG_LNSRCH 0. -0.296602428 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.526847363 *** contribution from regularisation: 0.00270926696 *** contribution from error: -0.529556632 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49004.7068 -0.296602428 24.1377449 EXIT FROM BFGS code FG_LNSRCH 0. -0.298810959 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.526504278 *** contribution from regularisation: 0.00288939103 *** contribution from error: -0.529393673 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48972.7981 -0.298810959 32.9885597 EXIT FROM BFGS code FG_LNSRCH 0. -0.298987001 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.526519179 *** contribution from regularisation: 0.00286107673 *** contribution from error: -0.529380262 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48974.1801 -0.298987001 33.72892 EXIT FROM BFGS code FG_LNSRCH 0. -0.298987478 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.526509821 *** contribution from regularisation: 0.00287040346 *** contribution from error: -0.529380202 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48973.3088 -0.298987478 33.7862358 EXIT FROM BFGS code FG_LNSRCH 0. -0.298987478 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.526494861 *** contribution from regularisation: 0.00288531161 *** contribution from error: -0.529380143 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48971.9221 -0.298987478 33.8201981 EXIT FROM BFGS code FG_LNSRCH 0. -0.298987478 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 57.9768028 sigma out 15 active outputs RANK 2 NODE 1 --> 29.1993427 sigma out 15 active outputs RANK 3 NODE 10 --> 24.1471195 sigma out 15 active outputs RANK 4 NODE 6 --> 21.9723835 sigma out 15 active outputs RANK 5 NODE 9 --> 19.9692039 sigma out 15 active outputs RANK 6 NODE 4 --> 16.3554974 sigma out 15 active outputs RANK 7 NODE 7 --> 14.1593714 sigma out 15 active outputs RANK 8 NODE 8 --> 9.87588596 sigma out 15 active outputs RANK 9 NODE 11 --> 7.39682198 sigma out 15 active outputs RANK 10 NODE 5 --> 5.90737534 sigma out 15 active outputs RANK 11 NODE 3 --> 5.63718987 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 66.8458633 sigma in 11act. ( 77.681427 sig out 1act.) RANK 2 NODE 2 --> 19.9660435 sigma in 11act. ( 22.9155121 sig out 1act.) RANK 3 NODE 11 --> 17.9467945 sigma in 11act. ( 12.7636271 sig out 1act.) RANK 4 NODE 7 --> 17.7258472 sigma in 11act. ( 17.4465389 sig out 1act.) RANK 5 NODE 9 --> 17.1366215 sigma in 11act. ( 15.0644789 sig out 1act.) RANK 6 NODE 13 --> 16.2349167 sigma in 11act. ( 15.517518 sig out 1act.) RANK 7 NODE 5 --> 9.45894718 sigma in 11act. ( 8.47789764 sig out 1act.) RANK 8 NODE 3 --> 6.18643904 sigma in 11act. ( 5.95879316 sig out 1act.) RANK 9 NODE 10 --> 5.956985 sigma in 11act. ( 4.53489447 sig out 1act.) RANK 10 NODE 4 --> 5.65428305 sigma in 11act. ( 3.90830493 sig out 1act.) RANK 11 NODE 8 --> 5.5073843 sigma in 11act. ( 3.44602394 sig out 1act.) RANK 12 NODE 12 --> 5.16104937 sigma in 11act. ( 5.39802074 sig out 1act.) RANK 13 NODE 1 --> 5.04562187 sigma in 11act. ( 4.56735802 sig out 1act.) RANK 14 NODE 15 --> 4.79721355 sigma in 11act. ( 0.885835707 sig out 1act.) RANK 15 NODE 14 --> 2.06878161 sigma in 11act. ( 1.15301967 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 77.681427 sigma out 1act.( 66.8458633 sig in 11act.) RANK 2 NODE 2 --> 22.9155121 sigma out 1act.( 19.9660435 sig in 11act.) RANK 3 NODE 7 --> 17.4465389 sigma out 1act.( 17.7258472 sig in 11act.) RANK 4 NODE 13 --> 15.517518 sigma out 1act.( 16.2349167 sig in 11act.) RANK 5 NODE 9 --> 15.0644789 sigma out 1act.( 17.1366215 sig in 11act.) RANK 6 NODE 11 --> 12.7636271 sigma out 1act.( 17.9467945 sig in 11act.) RANK 7 NODE 5 --> 8.47789764 sigma out 1act.( 9.45894718 sig in 11act.) RANK 8 NODE 3 --> 5.95879316 sigma out 1act.( 6.18643904 sig in 11act.) RANK 9 NODE 12 --> 5.39802074 sigma out 1act.( 5.16104937 sig in 11act.) RANK 10 NODE 1 --> 4.56735802 sigma out 1act.( 5.04562187 sig in 11act.) RANK 11 NODE 10 --> 4.53489447 sigma out 1act.( 5.956985 sig in 11act.) RANK 12 NODE 4 --> 3.90830493 sigma out 1act.( 5.65428305 sig in 11act.) RANK 13 NODE 8 --> 3.44602394 sigma out 1act.( 5.5073843 sig in 11act.) RANK 14 NODE 14 --> 1.15301967 sigma out 1act.( 2.06878161 sig in 11act.) RANK 15 NODE 15 --> 0.885835707 sigma out 1act.( 4.79721355 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 87.7596741 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.526497304 *** contribution from regularisation: 0.00288288109 *** contribution from error: -0.529380202 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -48972.1482 -0.298987478 33.7759666 EXIT FROM BFGS code NEW_X -48972.1482 -0.298987478 33.7759666 ENTER BFGS code NEW_X -48972.1482 -0.298987478 33.7759666 EXIT FROM BFGS code CONVERGENC -48972.1482 -0.298987478 33.7759666 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 92.6150436 sigma out 15 active outputs RANK 2 NODE 1 --> 47.0818939 sigma out 15 active outputs RANK 3 NODE 10 --> 39.0627518 sigma out 15 active outputs RANK 4 NODE 6 --> 35.952961 sigma out 15 active outputs RANK 5 NODE 9 --> 32.023922 sigma out 15 active outputs RANK 6 NODE 4 --> 25.9810925 sigma out 15 active outputs RANK 7 NODE 7 --> 22.581953 sigma out 15 active outputs RANK 8 NODE 8 --> 15.702446 sigma out 15 active outputs RANK 9 NODE 11 --> 11.7988119 sigma out 15 active outputs RANK 10 NODE 3 --> 8.97619915 sigma out 15 active outputs RANK 11 NODE 5 --> 8.87238407 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 108.35424 sigma in 11act. ( 127.358185 sig out 1act.) RANK 2 NODE 2 --> 33.783905 sigma in 11act. ( 37.6893578 sig out 1act.) RANK 3 NODE 7 --> 27.8649921 sigma in 11act. ( 30.5532017 sig out 1act.) RANK 4 NODE 9 --> 27.3911438 sigma in 11act. ( 26.4802189 sig out 1act.) RANK 5 NODE 11 --> 27.0552254 sigma in 11act. ( 21.8449001 sig out 1act.) RANK 6 NODE 13 --> 24.5484695 sigma in 11act. ( 26.1523685 sig out 1act.) RANK 7 NODE 5 --> 13.5886869 sigma in 11act. ( 14.7421684 sig out 1act.) RANK 8 NODE 3 --> 9.18798161 sigma in 11act. ( 10.5652657 sig out 1act.) RANK 9 NODE 10 --> 8.68145275 sigma in 11act. ( 8.08166218 sig out 1act.) RANK 10 NODE 12 --> 8.32170868 sigma in 11act. ( 8.65505219 sig out 1act.) RANK 11 NODE 4 --> 8.13807392 sigma in 11act. ( 7.15971088 sig out 1act.) RANK 12 NODE 8 --> 7.78768396 sigma in 11act. ( 6.5028367 sig out 1act.) RANK 13 NODE 1 --> 7.30337906 sigma in 11act. ( 7.9349165 sig out 1act.) RANK 14 NODE 15 --> 4.94508553 sigma in 11act. ( 1.55300546 sig out 1act.) RANK 15 NODE 14 --> 2.57509851 sigma in 11act. ( 2.1950171 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 127.358185 sigma out 1act.( 108.35424 sig in 11act.) RANK 2 NODE 2 --> 37.6893578 sigma out 1act.( 33.783905 sig in 11act.) RANK 3 NODE 7 --> 30.5532017 sigma out 1act.( 27.8649921 sig in 11act.) RANK 4 NODE 9 --> 26.4802189 sigma out 1act.( 27.3911438 sig in 11act.) RANK 5 NODE 13 --> 26.1523685 sigma out 1act.( 24.5484695 sig in 11act.) RANK 6 NODE 11 --> 21.8449001 sigma out 1act.( 27.0552254 sig in 11act.) RANK 7 NODE 5 --> 14.7421684 sigma out 1act.( 13.5886869 sig in 11act.) RANK 8 NODE 3 --> 10.5652657 sigma out 1act.( 9.18798161 sig in 11act.) RANK 9 NODE 12 --> 8.65505219 sigma out 1act.( 8.32170868 sig in 11act.) RANK 10 NODE 10 --> 8.08166218 sigma out 1act.( 8.68145275 sig in 11act.) RANK 11 NODE 1 --> 7.9349165 sigma out 1act.( 7.30337906 sig in 11act.) RANK 12 NODE 4 --> 7.15971088 sigma out 1act.( 8.13807392 sig in 11act.) RANK 13 NODE 8 --> 6.5028367 sigma out 1act.( 7.78768396 sig in 11act.) RANK 14 NODE 14 --> 2.1950171 sigma out 1act.( 2.57509851 sig in 11act.) RANK 15 NODE 15 --> 1.55300546 sigma out 1act.( 4.94508553 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 145.152893 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.526531518 *** contribution from regularisation: 0.00284865825 *** contribution from error: -0.529380202 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27567 Closing output file done