NNInput NNInputs_115.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 46104 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 9901 nbkg = 36203 Bkg Entries: 36203 Sig Entries: 9901 Chosen entries: 9901 Signal fraction: 1 Background fraction: 0.273486 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 36203 Actual Signal Entries: 9901 Entries to split: 9901 Test with : 4950 Train with : 4950 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 9901 for Signal Prepared event 0 for Signal with 9901 events ====Entry 0 Variable Ht : 106.131 Variable LepAPt : 30.5129 Variable LepBPt : 26.7943 Variable MetSigLeptonsJets : 6.44948 Variable MetSpec : 48.8235 Variable SumEtLeptonsJets : 57.3072 Variable VSumJetLeptonsPt : 55.9567 Variable addEt : 106.131 Variable dPhiLepSumMet : 1.90191 Variable dPhiLeptons : 0.435984 Variable dRLeptons : 0.496583 Variable lep1_E : 34.7451 Variable lep2_E : 34.8788 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2115 Ht = 106.131 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 30.5129 LepAPt = 30.5129 LepBEt = 26.7943 LepBPt = 26.7943 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 48.8235 MetDelPhi = 1.66955 MetSig = 3.69432 MetSigLeptonsJets = 6.44948 MetSpec = 48.8235 Mjj = 0 MostCentralJetEta = 0 MtllMet = 111.861 Njets = 0 SB = 0 SumEt = 174.659 SumEtJets = 0 SumEtLeptonsJets = 57.3072 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 55.9567 addEt = 106.131 dPhiLepSumMet = 1.90191 dPhiLeptons = 0.435984 dRLeptons = 0.496583 diltype = 45 dimass = 14.1202 event = 3498 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.7451 lep2_E = 34.8788 rand = 0.999742 run = 237795 weight = 7.37989e-07 ===Show End Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 36203 for Background Prepared event 0 for Background with 36203 events ====Entry 0 Variable Ht : 80.3296 Variable LepAPt : 25.5911 Variable LepBPt : 11.162 Variable MetSigLeptonsJets : 7.18795 Variable MetSpec : 43.5765 Variable SumEtLeptonsJets : 36.7531 Variable VSumJetLeptonsPt : 34.1227 Variable addEt : 80.3296 Variable dPhiLepSumMet : 2.89659 Variable dPhiLeptons : 0.831637 Variable dRLeptons : 0.924544 Variable lep1_E : 25.6567 Variable lep2_E : 12.448 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 80.3296 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 25.5911 LepAPt = 25.5911 LepBEt = 11.162 LepBPt = 11.162 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 43.5765 MetDelPhi = 2.65242 MetSig = 3.63746 MetSigLeptonsJets = 7.18795 MetSpec = 43.5765 Mjj = 0 MostCentralJetEta = 0 MtllMet = 81.3504 Njets = 0 SB = 0 SumEt = 143.519 SumEtJets = 0 SumEtLeptonsJets = 36.7531 Target = 0 TrainWeight = 0.329801 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 34.1227 addEt = 80.3296 dPhiLepSumMet = 2.89659 dPhiLeptons = 0.831637 dRLeptons = 0.924544 diltype = 45 dimass = 15.2865 event = 23115824 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 25.6567 lep2_E = 12.448 rand = 0.999742 run = 271104 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 36203 events Prepared event 20000 for Background with 36203 events Prepared event 30000 for Background with 36203 events Warning: found 919 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 46104 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 919 negative weights. Signal fraction: 62.0756569 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 56.0109749 62.3353043 64.2345581 65.6874542 67.0241547 67.9835663 69.0029907 69.8703766 70.4730225 71.167099 71.7763977 72.5993652 73.3383179 73.8667679 74.2613068 74.8717499 75.4713593 76.0052567 76.4402771 76.9001923 77.3490448 77.6935577 78.0712738 78.4446182 78.9927521 79.3755646 79.7860565 80.3202744 80.8481369 81.2685547 81.911499 82.4286575 82.9982758 83.6859589 84.3975983 85.3200836 86.0733795 86.8878021 87.7011566 88.4035492 89.2579575 90.2099915 91.103096 92.1388245 92.9536285 93.9186096 94.7269821 95.6143799 96.6902466 97.8282776 98.6715012 99.5231171 100.397079 101.405243 102.265526 103.20787 104.283447 104.995842 106.002525 106.891235 107.837448 108.694641 109.638458 110.539017 111.410995 112.426041 113.438553 114.503197 115.626892 116.919632 118.42363 120.232666 121.683304 123.389771 125.512207 127.195251 129.092209 131.239624 133.221146 135.565399 137.727875 139.675827 141.719254 144.402557 147.258224 150.144745 153.608307 157.625366 161.051498 165.065613 170.024902 173.979553 180.11554 186.911102 194.393372 203.056259 214.908859 227.775452 248.091309 289.335144 625.246765 ------------------------------ Transdef: Tab for variable 3 20.0008926 20.197258 20.4205074 20.6079903 20.8294563 21.0905952 21.3377914 21.5172329 21.7493095 21.9056511 22.0598793 22.2730942 22.446785 22.65341 22.8352451 23.0199089 23.1635704 23.3734398 23.5171967 23.6974106 23.8378525 23.9887123 24.2178078 24.3959122 24.5455647 24.7066822 24.8634529 25.0255623 25.1959839 25.365036 25.5335884 25.693243 25.8467941 26.0321426 26.1717567 26.3869553 26.6096935 26.7601929 26.948967 27.1269608 27.3117008 27.5202579 27.7444992 27.9438229 28.1350269 28.3061142 28.5337181 28.6928673 28.8828735 29.134737 29.3161201 29.52668 29.7536201 30.026062 30.2123432 30.5108109 30.7198639 30.9645157 31.2441883 31.484705 31.718071 31.9827309 32.2040024 32.5198593 32.8148422 33.1257133 33.4081802 33.7185898 34.0564308 34.3406372 34.6419144 35.0668335 35.3346977 35.6482544 35.9450531 36.3123474 36.7187653 37.1193695 37.624855 38.0105133 38.400425 38.9819412 39.5453339 40.0876007 40.6154175 41.2045822 41.822155 42.6609612 43.18787 44.0704575 45.2038193 46.3706131 47.4573555 48.5367889 50.204216 52.3840561 55.9994431 59.7794037 64.7051392 73.1018982 142.871475 ------------------------------ Transdef: Tab for variable 4 10.0014067 10.0624237 10.1343384 10.2087784 10.2667713 10.3277035 10.4090996 10.4912271 10.5644684 10.6621914 10.7508087 10.8375034 10.9108105 10.9863853 11.0579567 11.1342926 11.2263069 11.3077812 11.3850241 11.4606953 11.5376492 11.6350079 11.712944 11.7961349 11.8866997 11.9705029 12.0583363 12.1811228 12.2913857 12.3970194 12.500761 12.6219826 12.7468204 12.8376589 12.9218922 13.0115929 13.1208 13.2076235 13.3302422 13.4257298 13.5196724 13.6316624 13.7405052 13.8593464 13.9610405 14.0698547 14.1755695 14.2848406 14.3813839 14.4865227 14.6036282 14.7588425 14.8870239 14.9919586 15.0948315 15.2045536 15.3377533 15.4332752 15.5504456 15.6860075 15.8619061 15.9746618 16.112606 16.2419739 16.3681602 16.5389881 16.692522 16.8618641 17.0469093 17.2055264 17.3701973 17.5377483 17.7254601 17.8873672 18.0846577 18.2510681 18.4388866 18.6548309 18.8808365 19.1018181 19.3277779 19.5859013 19.825037 20.0921478 20.3800926 20.7176304 21.0241947 21.3920212 21.6892624 22.080492 22.5017929 22.8851051 23.4086552 24.0626945 24.6987724 25.4006882 26.486393 27.7117081 29.7048798 33.3156891 61.9556808 ------------------------------ Transdef: Tab for variable 5 1.79273057 2.70071888 2.96720505 3.18955278 3.37208438 3.53404808 3.73954105 3.85250521 3.9953618 4.09429073 4.18685722 4.28861809 4.37841702 4.4626255 4.53724384 4.60975885 4.68458843 4.75940895 4.82702303 4.88174486 4.93559742 5.00016689 5.0534544 5.10823154 5.14972878 5.19137144 5.23880577 5.28800774 5.34618187 5.39204121 5.43251419 5.47720242 5.52407837 5.56931925 5.60644913 5.64378214 5.68353748 5.72075367 5.76884317 5.79925156 5.83981991 5.8799305 5.92063904 5.95599079 5.98509264 6.01720762 6.05147171 6.09545231 6.13089752 6.16296101 6.19958973 6.23088408 6.26865387 6.29986286 6.33165073 6.36240101 6.39414167 6.42822599 6.46031666 6.49556255 6.52511358 6.55870914 6.6035347 6.64732647 6.69165993 6.73018789 6.76110077 6.80591965 6.83806896 6.87566614 6.91888905 6.96374989 7.00842762 7.04735947 7.0922451 7.13159084 7.18075752 7.2230587 7.27353001 7.32098103 7.37760639 7.43297052 7.4802103 7.53435802 7.58671331 7.65690613 7.72600746 7.7873683 7.85830641 7.9394722 8.0373354 8.16059017 8.25816727 8.35848331 8.53521061 8.66965485 8.86247635 9.11299706 9.5183506 10.2206116 18.5939598 ------------------------------ Transdef: Tab for variable 6 25.0043507 25.6600761 26.2041206 26.8339901 27.4971695 28.1188774 28.7932167 29.4414616 29.8819962 30.4090424 30.8498554 31.3306389 31.7772617 32.2064285 32.5784683 32.9608383 33.2944527 33.6192627 33.9494324 34.2740746 34.5433464 34.8386612 35.1909485 35.4894676 35.8668365 36.1853485 36.4438591 36.7165909 36.9409485 37.198494 37.4485703 37.7005844 37.9564056 38.230278 38.5393982 38.8614578 39.139122 39.3606873 39.5438004 39.8506851 40.1522598 40.3948784 40.6651459 40.9824982 41.2588882 41.5327492 41.8511543 42.0731087 42.4009514 42.6715508 42.9825363 43.2542496 43.5998764 43.8910904 44.2049408 44.5105896 44.8529472 45.2752686 45.7572021 46.0914955 46.5414505 46.9608688 47.3269653 47.7372475 48.1775055 48.6483078 49.0763779 49.4674683 50.0139236 50.5280647 50.9314308 51.3621483 51.76968 52.2940826 52.882412 53.4406776 53.8777008 54.4911957 54.9676628 55.4785347 56.0683937 56.5603104 57.2287903 57.7285347 58.5214081 59.2552147 59.9797211 60.9416656 61.8556824 63.0933151 64.4479218 65.807251 67.2477646 69.1753616 71.6415253 74.3901672 77.5185699 81.0734711 87.6689911 98.6284332 179.287567 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.3684921 33.0360756 33.86203 34.3529701 34.835434 35.2253876 35.615551 35.9949989 36.2880936 36.6459846 36.9072266 37.2149811 37.4873428 37.6826477 37.9840546 38.1954575 38.41576 38.6524048 38.8557739 39.1076317 39.3177109 39.4846344 39.6964874 39.9481583 40.2267532 40.4698181 40.7367897 41.0572968 41.3456078 41.5953217 41.8453369 42.1643524 42.544651 42.9565239 43.4393845 43.8785591 44.1975861 44.5906906 45.0020294 45.4925919 45.9890671 46.384552 46.9146919 47.3638382 47.8802948 48.3973923 48.9550171 49.5536041 50.1448593 50.7545929 51.3399811 51.8901558 52.5340271 53.1706543 53.6692886 54.2266769 54.7460899 55.3443336 55.9493523 56.5720596 57.2731628 58.2188339 59.11306 60.1477852 61.1424484 62.2201462 63.5973358 64.81604 66.0748291 67.4186554 69.1657257 70.3296814 71.8323822 73.4465637 75.0739288 76.8352356 78.3584137 79.9808578 81.5545502 83.1743469 85.180069 87.4274673 90.0118866 92.3790741 94.7900848 97.3864899 99.9712219 102.905228 106.003532 109.685539 114.081833 119.074631 125.703659 132.756393 138.78656 149.728806 161.535828 180.279449 209.327026 377.001801 ------------------------------ Transdef: Tab for variable 8 3.53889132 22.6262245 26.4791641 28.9816399 30.3391266 31.2617016 31.89217 32.4151306 32.8506699 33.2805786 33.7183304 34.0084534 34.4286003 34.686676 34.9697113 35.2511253 35.5179062 35.8699722 36.0859756 36.3417664 36.5189972 36.7602997 37.0105057 37.2243042 37.4325562 37.6297455 37.8210144 38.0186996 38.1697617 38.3506012 38.5502701 38.7244949 38.9370689 39.1277161 39.2736168 39.475502 39.724369 40.0144081 40.2141418 40.4609909 40.7072144 41.0283318 41.3040962 41.5129395 41.7224426 41.9779816 42.2513962 42.5993347 42.9568405 43.2603111 43.4996109 43.8750305 44.2006111 44.5647545 44.847744 45.2279167 45.5925293 45.9181442 46.2754593 46.6553879 47.0627136 47.4690361 47.8419571 48.3481712 48.7007828 49.1291695 49.6851234 50.1468277 50.5201607 50.9274483 51.4022751 51.7673683 52.2018852 52.6481705 53.0908432 53.5434494 53.9431725 54.3700485 54.8309174 55.2705612 55.8850937 56.5250931 57.1692047 57.9612045 58.6658249 59.5641708 60.4456329 61.4775467 62.7359924 64.1792145 65.6644897 67.4267578 68.8056335 70.9718475 73.3050919 76.5553284 80.3947601 84.9051208 91.3806763 105.47937 268.138306 ------------------------------ Transdef: Tab for variable 9 56.0109749 62.1156654 63.7747917 65.0889587 66.0409698 67.3132477 68.1272049 69.0029907 69.7147751 70.3340759 70.8077469 71.396698 71.9451904 72.6357498 73.2352448 73.668045 74.1077576 74.473465 75.0544586 75.5696793 76.0632935 76.4318848 76.8448486 77.1953049 77.5586319 77.8681793 78.150116 78.4941254 78.9878998 79.3004456 79.6390762 80.1307068 80.6401672 80.9822998 81.4420013 81.8481445 82.2073212 82.6963196 83.2356949 83.7120972 84.2485504 84.9040298 85.5909729 86.2359161 86.8859558 87.4406738 88.0097809 88.6696777 89.4087219 90.1197052 90.8156128 91.4559479 92.1577835 92.7955322 93.5368805 94.2754059 94.8960571 95.5734406 96.2628174 97.0014801 97.915802 98.526474 99.1467896 99.8479691 100.619698 101.300613 101.988525 102.593109 103.270706 104.056419 104.72438 105.465149 106.197205 106.924278 107.658157 108.278519 108.922516 109.63475 110.407272 111.016121 111.928574 112.755844 113.501656 114.476677 115.366241 116.278183 117.289825 118.560905 119.745766 121.14859 122.711975 124.625076 126.590912 129.258911 132.408875 136.507568 142.155365 149.502777 158.843536 182.800171 344.857483 ------------------------------ Transdef: Tab for variable 10 0.0879002884 0.931381464 1.18142378 1.36284208 1.51485348 1.64087605 1.75051117 1.83613968 1.91584778 1.98545551 2.06224561 2.11850691 2.17373991 2.22882152 2.276793 2.31612158 2.35789275 2.40292978 2.44230843 2.48065066 2.51214623 2.53860116 2.56964135 2.59414959 2.62127638 2.64707232 2.67198181 2.6960597 2.71686268 2.73669481 2.75553608 2.77180958 2.78611231 2.80200028 2.81675625 2.82724571 2.83981967 2.85122228 2.86145496 2.8711946 2.88202238 2.8935194 2.90285397 2.91248393 2.91930962 2.9285686 2.93707848 2.94447517 2.95159292 2.95891476 2.96370435 2.9697814 2.97625709 2.98100185 2.98620796 2.99044085 2.9960413 3.00038242 3.00513482 3.00953674 3.0139091 3.01911688 3.02307653 3.02732706 3.03184748 3.03554487 3.03987646 3.04355001 3.04664373 3.05052185 3.05489016 3.05908561 3.06196356 3.06488848 3.06835103 3.07209444 3.0752387 3.07770801 3.08155584 3.0845232 3.0873251 3.09027243 3.09364796 3.09608078 3.09909391 3.10126853 3.10458755 3.10785294 3.1103878 3.11402559 3.11630774 3.11870384 3.12102127 3.1245923 3.12658596 3.12954426 3.13219404 3.13475132 3.13677907 3.13914633 3.14157367 ------------------------------ Transdef: Tab for variable 11 1.62124634E-05 0.006394892 0.01126091 0.0194446556 0.0264614224 0.0325091518 0.0404002666 0.0492601283 0.0581946485 0.0674681067 0.0761759207 0.0841694474 0.091366291 0.0984920859 0.107403934 0.11409831 0.121651113 0.129083037 0.137172699 0.145529687 0.154331565 0.162251115 0.169623137 0.176582605 0.183374047 0.190829098 0.198582262 0.203844726 0.209576428 0.214702129 0.220297754 0.22517848 0.230869174 0.236571193 0.243787408 0.249784112 0.256432295 0.263012648 0.268726915 0.276135087 0.282195807 0.287314773 0.29442358 0.300381273 0.306919664 0.313073397 0.318629891 0.324630231 0.330099821 0.337354422 0.342543125 0.349829555 0.354748666 0.360828519 0.36619544 0.372142613 0.379002929 0.385650396 0.393620878 0.399748087 0.406641603 0.414557785 0.420396805 0.428018391 0.435224652 0.442786217 0.448393345 0.454199553 0.460573733 0.467628479 0.474026054 0.478870749 0.487090468 0.495156348 0.501989782 0.508993983 0.517591953 0.524240971 0.533489823 0.542788148 0.549616396 0.557398617 0.566021204 0.573598027 0.583289266 0.591448307 0.602547169 0.612316847 0.624284923 0.636723161 0.649299979 0.661837816 0.676127076 0.691575408 0.704371572 0.723043442 0.742787361 0.778098762 0.812335253 0.884238839 1.10400426 ------------------------------ Transdef: Tab for variable 12 0.200171411 0.210562825 0.220096022 0.231289014 0.241996735 0.25276807 0.260532558 0.270175338 0.277070969 0.286202431 0.295424759 0.304749548 0.31526041 0.323537588 0.330777764 0.338805735 0.347107053 0.35408923 0.360337943 0.367936194 0.375517249 0.384767771 0.392946959 0.399068773 0.404891908 0.41029337 0.414415598 0.419195592 0.423969597 0.429575384 0.4350214 0.44067058 0.445355773 0.450889677 0.456225306 0.460510492 0.465247035 0.470049322 0.473950773 0.478254378 0.482168853 0.486609459 0.490355581 0.494747698 0.498748243 0.502600312 0.506765723 0.511419058 0.516496837 0.520813525 0.524062753 0.528510273 0.53245151 0.53723979 0.541976392 0.546165466 0.54981035 0.554355502 0.558846593 0.562274396 0.566232264 0.571130395 0.575308979 0.580126762 0.584379077 0.588942409 0.59374392 0.598888278 0.604765475 0.609026074 0.612977982 0.617440343 0.62331593 0.628504157 0.633594692 0.639602184 0.64680481 0.653177023 0.658524156 0.663376808 0.669556618 0.67605871 0.68283546 0.689710855 0.696273148 0.704104364 0.713502705 0.720779598 0.729927063 0.740395427 0.74938798 0.758051991 0.769673705 0.780197024 0.7951262 0.810631633 0.830781698 0.850540519 0.880123258 0.93740195 1.13498271 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.3300877 22.0302925 22.6481171 23.1535072 23.6703758 24.1694012 24.6801872 25.1330109 25.4722977 25.901001 26.2821655 26.7084389 27.0799522 27.4734974 27.857666 28.1427994 28.4162025 28.7424011 29.1083374 29.3760414 29.7631874 30.0641518 30.3452835 30.6718063 30.9262848 31.2738419 31.6936951 32.0109711 32.3079834 32.6737099 33.0148621 33.3354797 33.6418228 34.0469475 34.4178123 34.8152275 35.1341629 35.5158882 35.8680573 36.2065811 36.5863037 36.9839172 37.3651772 37.7918549 38.1655884 38.5497513 38.9842529 39.3873138 39.7732468 40.2583961 40.7902908 41.2445068 41.7288895 42.385994 42.8999023 43.3677444 43.8076401 44.388504 44.8975906 45.4616699 46.0379028 46.5847397 47.1477203 47.7234955 48.2060547 48.8318291 49.4882393 50.154171 50.9271011 51.6976318 52.5117722 53.3099403 54.0422516 54.8107758 55.8279076 56.7714195 57.812973 58.8836861 60.0850449 61.1078491 62.3078575 63.623085 64.9720078 66.4630585 67.679245 69.540329 71.4825134 73.4219818 75.0619354 76.6147537 78.7878723 81.2516861 83.7733002 87.0970612 90.5065613 94.2392883 98.4896545 102.859879 117.258202 216.87648 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.5170088 10.7985468 11.0625391 11.335021 11.5301399 11.708683 11.9147921 12.1347122 12.356411 12.5605335 12.7543526 12.9311199 13.1260014 13.3303719 13.478054 13.6306772 13.7953167 13.9490824 14.1041679 14.265892 14.4956264 14.6522331 14.8063202 14.9756889 15.1406002 15.2908077 15.4912844 15.6598492 15.8073845 16.0072289 16.1885128 16.4073219 16.5814438 16.7695408 16.9256096 17.1538582 17.3356361 17.4854202 17.6771088 17.8612366 18.0308876 18.272438 18.5031834 18.6746445 18.8617744 19.0513153 19.2496185 19.4463825 19.7012062 19.9421921 20.1692734 20.4367714 20.6812706 20.9311714 21.194046 21.4891357 21.7287941 21.9670258 22.2973061 22.5891857 22.8827286 23.1513958 23.4583893 23.8110085 24.1190224 24.4752502 24.8389397 25.2436066 25.5576515 25.9205208 26.2980614 26.7006683 27.1599312 27.6641846 28.0526428 28.6580582 29.1947384 29.6987762 30.2271385 30.7867012 31.291893 31.8686771 32.444664 33.2143021 34.1708527 34.845932 35.8972015 37.0664291 37.8395386 39.0631104 40.4030914 41.8775482 43.3270111 45.1819878 47.3721619 49.7563553 52.5232544 56.2385178 63.7731438 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 59.5 43.7 25.7 13.1 41.0 55.7 41.6 56.6 -30.8 -3.9 -8.1 3.2 -14.3 2 59.5 100.0 64.1 40.6 12.9 61.3 93.7 61.4 90.1 -52.7 -14.1 -26.4 23.2 2.8 3 43.7 64.1 100.0 16.8 -8.1 28.7 67.9 47.7 70.0 -22.9 -15.1 -31.8 55.2 -5.0 4 25.7 40.6 16.8 100.0 -3.1 17.6 42.9 31.1 44.8 -11.4 -18.8 -33.9 2.5 56.4 5 13.1 12.9 -8.1 -3.1 100.0 78.2 -14.9 39.3 40.1 30.9 0.2 4.1 -16.2 -10.7 6 41.0 61.3 28.7 17.6 78.2 100.0 38.3 67.9 76.8 -5.6 -6.9 -11.0 1.6 -6.6 7 55.7 93.7 67.9 42.9 -14.9 38.3 100.0 56.6 77.7 -58.3 -12.9 -26.6 29.9 8.1 8 41.6 61.4 47.7 31.1 39.3 67.9 56.6 100.0 73.1 -9.7 -13.1 -20.7 17.8 5.1 9 56.6 90.1 70.0 44.8 40.1 76.8 77.7 73.1 100.0 -28.0 -16.5 -31.2 26.9 6.3 10 -30.8 -52.7 -22.9 -11.4 30.9 -5.6 -58.3 -9.7 -28.0 100.0 2.5 5.0 -7.1 2.7 11 -3.9 -14.1 -15.1 -18.8 0.2 -6.9 -12.9 -13.1 -16.5 2.5 100.0 56.6 1.9 -0.9 12 -8.1 -26.4 -31.8 -33.9 4.1 -11.0 -26.6 -20.7 -31.2 5.0 56.6 100.0 -5.0 -4.8 13 3.2 23.2 55.2 2.5 -16.2 1.6 29.9 17.8 26.9 -7.1 1.9 -5.0 100.0 45.3 14 -14.3 2.8 -5.0 56.4 -10.7 -6.6 8.1 5.1 6.3 2.7 -0.9 -4.8 45.3 100.0 TOTAL CORRELATION TO TARGET (diagonal) 131.297186 TOTAL CORRELATION OF ALL VARIABLES 66.0176889 ROUND 1: MAX CORR ( 66.0149292) AFTER KILLING INPUT VARIABLE 11 CONTR 0.60363863 ROUND 2: MAX CORR ( 65.9898544) AFTER KILLING INPUT VARIABLE 8 CONTR 1.81933767 ROUND 3: MAX CORR ( 65.9509843) AFTER KILLING INPUT VARIABLE 13 CONTR 2.26463029 ROUND 4: MAX CORR ( 65.891561) AFTER KILLING INPUT VARIABLE 6 CONTR 2.79902252 ROUND 5: MAX CORR ( 65.8039002) AFTER KILLING INPUT VARIABLE 7 CONTR 3.39772344 ROUND 6: MAX CORR ( 65.6887377) AFTER KILLING INPUT VARIABLE 9 CONTR 3.89140269 ROUND 7: MAX CORR ( 65.4857991) AFTER KILLING INPUT VARIABLE 10 CONTR 5.15949423 ROUND 8: MAX CORR ( 65.2238603) AFTER KILLING INPUT VARIABLE 5 CONTR 5.85131941 ROUND 9: MAX CORR ( 64.3509833) AFTER KILLING INPUT VARIABLE 3 CONTR 10.6349847 ROUND 10: MAX CORR ( 63.2178108) AFTER KILLING INPUT VARIABLE 12 CONTR 12.0232044 ROUND 11: MAX CORR ( 61.5919074) AFTER KILLING INPUT VARIABLE 4 CONTR 14.2452991 ROUND 12: MAX CORR ( 59.4739939) AFTER KILLING INPUT VARIABLE 14 CONTR 16.0127172 LAST REMAINING VARIABLE: 2 total correlation to target: 66.0176889 % total significance: 58.9227232 sigma correlations of single variables to target: variable 2: 59.4739939 % , in sigma: 53.0822835 variable 3: 43.7179252 % , in sigma: 39.0195302 variable 4: 25.6514975 % , in sigma: 22.8947137 variable 5: 13.1016496 % , in sigma: 11.6936065 variable 6: 41.0317427 % , in sigma: 36.6220336 variable 7: 55.669399 % , in sigma: 49.6865711 variable 8: 41.5831049 % , in sigma: 37.1141405 variable 9: 56.6397503 % , in sigma: 50.552638 variable 10: -30.7502924 % , in sigma: 27.4455377 variable 11: -3.90623055 % , in sigma: 3.48642531 variable 12: -8.06112672 % , in sigma: 7.19479198 variable 13: 3.17538446 % , in sigma: 2.83412374 variable 14: -14.32061 % , in sigma: 12.7815644 variables sorted by significance: 1 most relevant variable 2 corr 59.4739952 , in sigma: 53.0822847 2 most relevant variable 14 corr 16.0127163 , in sigma: 14.2918188 3 most relevant variable 4 corr 14.2452993 , in sigma: 12.7143474 4 most relevant variable 12 corr 12.0232048 , in sigma: 10.7310629 5 most relevant variable 3 corr 10.634985 , in sigma: 9.49203594 6 most relevant variable 5 corr 5.85131931 , in sigma: 5.22247407 7 most relevant variable 10 corr 5.1594944 , in sigma: 4.60500005 8 most relevant variable 9 corr 3.89140272 , in sigma: 3.47319104 9 most relevant variable 7 corr 3.39772344 , in sigma: 3.0325678 10 most relevant variable 6 corr 2.79902244 , in sigma: 2.4982096 11 most relevant variable 13 corr 2.26463032 , in sigma: 2.02124897 12 most relevant variable 8 corr 1.81933773 , in sigma: 1.62381227 13 most relevant variable 11 corr 0.603638649 , in sigma: 0.538765195 global correlations between input variables: variable 2: 98.9880335 % variable 3: 93.4301008 % variable 4: 87.4329825 % variable 5: 94.7469056 % variable 6: 94.5652345 % variable 7: 98.388143 % variable 8: 83.3481111 % variable 9: 98.6718776 % variable 10: 71.8460398 % variable 11: 57.2482304 % variable 12: 65.8714512 % variable 13: 85.045471 % variable 14: 85.8187421 % significance loss when removing single variables: variable 2: corr = 5.15016567 % , sigma = 4.59667388 variable 3: corr = 10.0872407 % , sigma = 9.00315812 variable 4: corr = 14.6986878 % , sigma = 13.1190099 variable 5: corr = 4.97471312 % , sigma = 4.44007733 variable 6: corr = 2.04481189 % , sigma = 1.82505457 variable 7: corr = 1.9018777 % , sigma = 1.69748161 variable 8: corr = 1.85664213 % , sigma = 1.65710755 variable 9: corr = 4.18517256 % , sigma = 3.73538924 variable 10: corr = 5.02934092 % , sigma = 4.48883425 variable 11: corr = 0.60363863 % , sigma = 0.538765178 variable 12: corr = 11.1366226 % , sigma = 9.93976223 variable 13: corr = 2.24798913 % , sigma = 2.00639622 variable 14: corr = 13.0850829 % , sigma = 11.6788202 Keep only 7 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 8 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 9.66672611 sigma out 15 active outputs RANK 2 NODE 1 --> 8.50172806 sigma out 15 active outputs RANK 3 NODE 4 --> 7.25145674 sigma out 15 active outputs RANK 4 NODE 5 --> 7.08949137 sigma out 15 active outputs RANK 5 NODE 6 --> 6.96891975 sigma out 15 active outputs RANK 6 NODE 3 --> 6.7924037 sigma out 15 active outputs RANK 7 NODE 2 --> 4.72608519 sigma out 15 active outputs RANK 8 NODE 7 --> 4.33149767 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 10.9880257 sigma in 8act. ( 11.8279753 sig out 1act.) RANK 2 NODE 7 --> 10.5596495 sigma in 8act. ( 10.5530691 sig out 1act.) RANK 3 NODE 6 --> 8.99774647 sigma in 8act. ( 8.55687523 sig out 1act.) RANK 4 NODE 3 --> 4.4597578 sigma in 8act. ( 4.63432932 sig out 1act.) RANK 5 NODE 9 --> 4.10140324 sigma in 8act. ( 4.2576313 sig out 1act.) RANK 6 NODE 13 --> 3.23038721 sigma in 8act. ( 2.72035146 sig out 1act.) RANK 7 NODE 8 --> 3.10739231 sigma in 8act. ( 2.92970371 sig out 1act.) RANK 8 NODE 12 --> 2.96922159 sigma in 8act. ( 2.85068011 sig out 1act.) RANK 9 NODE 14 --> 2.65081906 sigma in 8act. ( 2.84394288 sig out 1act.) RANK 10 NODE 1 --> 2.49333572 sigma in 8act. ( 2.6758244 sig out 1act.) RANK 11 NODE 15 --> 2.03785253 sigma in 8act. ( 1.95831466 sig out 1act.) RANK 12 NODE 4 --> 1.97675681 sigma in 8act. ( 1.96927261 sig out 1act.) RANK 13 NODE 2 --> 1.54116023 sigma in 8act. ( 1.0146395 sig out 1act.) RANK 14 NODE 5 --> 1.18093336 sigma in 8act. ( 0.64127785 sig out 1act.) RANK 15 NODE 10 --> 0.689325333 sigma in 8act. ( 0.00969272945 sig out 1 act.) sorted by output significance RANK 1 NODE 11 --> 11.8279753 sigma out 1act.( 10.9880257 sig in 8act.) RANK 2 NODE 7 --> 10.5530691 sigma out 1act.( 10.5596495 sig in 8act.) RANK 3 NODE 6 --> 8.55687523 sigma out 1act.( 8.99774647 sig in 8act.) RANK 4 NODE 3 --> 4.63432932 sigma out 1act.( 4.4597578 sig in 8act.) RANK 5 NODE 9 --> 4.2576313 sigma out 1act.( 4.10140324 sig in 8act.) RANK 6 NODE 8 --> 2.92970371 sigma out 1act.( 3.10739231 sig in 8act.) RANK 7 NODE 12 --> 2.85068011 sigma out 1act.( 2.96922159 sig in 8act.) RANK 8 NODE 14 --> 2.84394288 sigma out 1act.( 2.65081906 sig in 8act.) RANK 9 NODE 13 --> 2.72035146 sigma out 1act.( 3.23038721 sig in 8act.) RANK 10 NODE 1 --> 2.6758244 sigma out 1act.( 2.49333572 sig in 8act.) RANK 11 NODE 4 --> 1.96927261 sigma out 1act.( 1.97675681 sig in 8act.) RANK 12 NODE 15 --> 1.95831466 sigma out 1act.( 2.03785253 sig in 8act.) RANK 13 NODE 2 --> 1.0146395 sigma out 1act.( 1.54116023 sig in 8act.) RANK 14 NODE 5 --> 0.64127785 sigma out 1act.( 1.18093336 sig in 8act.) RANK 15 NODE 10 --> 0.00969272945 sigma out 1act.( 0.689325333 sig in 8act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 20.3126698 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 11.7298927 sigma out 15 active outputs RANK 2 NODE 6 --> 11.4412336 sigma out 15 active outputs RANK 3 NODE 5 --> 10.1204071 sigma out 15 active outputs RANK 4 NODE 3 --> 9.94359016 sigma out 15 active outputs RANK 5 NODE 1 --> 9.69014931 sigma out 15 active outputs RANK 6 NODE 4 --> 9.58524036 sigma out 15 active outputs RANK 7 NODE 7 --> 7.30947208 sigma out 15 active outputs RANK 8 NODE 2 --> 6.30151653 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 12.8769579 sigma in 8act. ( 12.3521109 sig out 1act.) RANK 2 NODE 7 --> 11.930335 sigma in 8act. ( 10.8992939 sig out 1act.) RANK 3 NODE 6 --> 10.1711226 sigma in 8act. ( 8.26239491 sig out 1act.) RANK 4 NODE 14 --> 7.41433954 sigma in 8act. ( 5.04575253 sig out 1act.) RANK 5 NODE 12 --> 7.37291813 sigma in 8act. ( 3.1996634 sig out 1act.) RANK 6 NODE 4 --> 6.48522902 sigma in 8act. ( 2.70819497 sig out 1act.) RANK 7 NODE 9 --> 6.17946434 sigma in 8act. ( 5.39006138 sig out 1act.) RANK 8 NODE 2 --> 5.02661371 sigma in 8act. ( 1.14219451 sig out 1act.) RANK 9 NODE 15 --> 4.9753027 sigma in 8act. ( 2.52764106 sig out 1act.) RANK 10 NODE 13 --> 4.48335981 sigma in 8act. ( 1.9984417 sig out 1act.) RANK 11 NODE 8 --> 4.44562912 sigma in 8act. ( 3.16573453 sig out 1act.) RANK 12 NODE 3 --> 4.37041092 sigma in 8act. ( 4.35826874 sig out 1act.) RANK 13 NODE 1 --> 4.23982143 sigma in 8act. ( 3.48222828 sig out 1act.) RANK 14 NODE 5 --> 3.90456557 sigma in 8act. ( 0.75722903 sig out 1act.) RANK 15 NODE 10 --> 2.30636382 sigma in 8act. ( 0.235661805 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 12.3521109 sigma out 1act.( 12.8769579 sig in 8act.) RANK 2 NODE 7 --> 10.8992939 sigma out 1act.( 11.930335 sig in 8act.) RANK 3 NODE 6 --> 8.26239491 sigma out 1act.( 10.1711226 sig in 8act.) RANK 4 NODE 9 --> 5.39006138 sigma out 1act.( 6.17946434 sig in 8act.) RANK 5 NODE 14 --> 5.04575253 sigma out 1act.( 7.41433954 sig in 8act.) RANK 6 NODE 3 --> 4.35826874 sigma out 1act.( 4.37041092 sig in 8act.) RANK 7 NODE 1 --> 3.48222828 sigma out 1act.( 4.23982143 sig in 8act.) RANK 8 NODE 12 --> 3.1996634 sigma out 1act.( 7.37291813 sig in 8act.) RANK 9 NODE 8 --> 3.16573453 sigma out 1act.( 4.44562912 sig in 8act.) RANK 10 NODE 4 --> 2.70819497 sigma out 1act.( 6.48522902 sig in 8act.) RANK 11 NODE 15 --> 2.52764106 sigma out 1act.( 4.9753027 sig in 8act.) RANK 12 NODE 13 --> 1.9984417 sigma out 1act.( 4.48335981 sig in 8act.) RANK 13 NODE 2 --> 1.14219451 sigma out 1act.( 5.02661371 sig in 8act.) RANK 14 NODE 5 --> 0.75722903 sigma out 1act.( 3.90456557 sig in 8act.) RANK 15 NODE 10 --> 0.235661805 sigma out 1act.( 2.30636382 sig in 8act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 21.5680218 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.455363125 *** contribution from regularisation: 0.00942072179 *** contribution from error: -0.464783847 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.499875039 *** contribution from regularisation: 0.00473253429 *** contribution from error: -0.504607558 *********************************************** -----------------> Test sample ENTER BFGS code START -11525.4247 0.05113893 -0.0165554695 EXIT FROM BFGS code FG_START 0. 0.05113893 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.516019404 *** contribution from regularisation: 0.00393420504 *** contribution from error: -0.519953609 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -11895.2786 0.05113893 -13.59202 EXIT FROM BFGS code FG_LNSRCH 0. 0.0359082408 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.546359062 *** contribution from regularisation: 0.00698743248 *** contribution from error: -0.553346515 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12594.6696 0.0359082408 -28.4266415 EXIT FROM BFGS code NEW_X -12594.6696 0.0359082408 -28.4266415 ENTER BFGS code NEW_X -12594.6696 0.0359082408 -28.4266415 EXIT FROM BFGS code FG_LNSRCH 0. 0.00140893948 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.549574554 *** contribution from regularisation: 0.00747438613 *** contribution from error: -0.557048917 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12668.7924 0.00140893948 -6.13474703 EXIT FROM BFGS code NEW_X -12668.7924 0.00140893948 -6.13474703 ENTER BFGS code NEW_X -12668.7924 0.00140893948 -6.13474703 EXIT FROM BFGS code FG_LNSRCH 0. -0.0124916676 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.550893068 *** contribution from regularisation: 0.00701228669 *** contribution from error: -0.557905376 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12699.1865 -0.0124916676 -2.26187396 EXIT FROM BFGS code NEW_X -12699.1865 -0.0124916676 -2.26187396 ENTER BFGS code NEW_X -12699.1865 -0.0124916676 -2.26187396 EXIT FROM BFGS code FG_LNSRCH 0. -0.0358045213 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.55173099 *** contribution from regularisation: 0.00646959012 *** contribution from error: -0.558200598 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12718.5023 -0.0358045213 2.59127092 EXIT FROM BFGS code NEW_X -12718.5023 -0.0358045213 2.59127092 ENTER BFGS code NEW_X -12718.5023 -0.0358045213 2.59127092 EXIT FROM BFGS code FG_LNSRCH 0. -0.0666830242 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.552322268 *** contribution from regularisation: 0.00610945374 *** contribution from error: -0.558431745 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12732.1328 -0.0666830242 4.53249025 EXIT FROM BFGS code NEW_X -12732.1328 -0.0666830242 4.53249025 ENTER BFGS code NEW_X -12732.1328 -0.0666830242 4.53249025 EXIT FROM BFGS code FG_LNSRCH 0. -0.288064241 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.549103975 *** contribution from regularisation: 0.00695978524 *** contribution from error: -0.556063771 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12657.9454 -0.288064241 -20.5972805 EXIT FROM BFGS code FG_LNSRCH 0. -0.149067655 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 17.7613277 sigma out 15 active outputs RANK 2 NODE 7 --> 11.8720007 sigma out 15 active outputs RANK 3 NODE 1 --> 9.07548428 sigma out 15 active outputs RANK 4 NODE 4 --> 8.10394382 sigma out 15 active outputs RANK 5 NODE 5 --> 6.87101698 sigma out 15 active outputs RANK 6 NODE 3 --> 5.44888496 sigma out 15 active outputs RANK 7 NODE 8 --> 4.13954926 sigma out 15 active outputs RANK 8 NODE 2 --> 3.59978461 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 18.0529346 sigma in 8act. ( 19.0617752 sig out 1act.) RANK 2 NODE 15 --> 7.8214879 sigma in 8act. ( 6.45423269 sig out 1act.) RANK 3 NODE 11 --> 7.36866522 sigma in 8act. ( 4.79794788 sig out 1act.) RANK 4 NODE 7 --> 7.28737354 sigma in 8act. ( 5.43109846 sig out 1act.) RANK 5 NODE 4 --> 7.22333288 sigma in 8act. ( 5.54606867 sig out 1act.) RANK 6 NODE 9 --> 6.58083105 sigma in 8act. ( 4.61864328 sig out 1act.) RANK 7 NODE 6 --> 5.96183395 sigma in 8act. ( 4.97385454 sig out 1act.) RANK 8 NODE 12 --> 4.90208006 sigma in 8act. ( 2.79960871 sig out 1act.) RANK 9 NODE 1 --> 4.47346687 sigma in 8act. ( 2.91215038 sig out 1act.) RANK 10 NODE 2 --> 3.52495503 sigma in 8act. ( 2.20300674 sig out 1act.) RANK 11 NODE 8 --> 3.1020596 sigma in 8act. ( 1.88029397 sig out 1act.) RANK 12 NODE 5 --> 3.02156115 sigma in 8act. ( 1.74424195 sig out 1act.) RANK 13 NODE 10 --> 2.06183791 sigma in 8act. ( 1.369344 sig out 1act.) RANK 14 NODE 13 --> 1.94414294 sigma in 8act. ( 1.12246513 sig out 1act.) RANK 15 NODE 3 --> 1.63630271 sigma in 8act. ( 0.0552819371 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 19.0617752 sigma out 1act.( 18.0529346 sig in 8act.) RANK 2 NODE 15 --> 6.45423269 sigma out 1act.( 7.8214879 sig in 8act.) RANK 3 NODE 4 --> 5.54606867 sigma out 1act.( 7.22333288 sig in 8act.) RANK 4 NODE 7 --> 5.43109846 sigma out 1act.( 7.28737354 sig in 8act.) RANK 5 NODE 6 --> 4.97385454 sigma out 1act.( 5.96183395 sig in 8act.) RANK 6 NODE 11 --> 4.79794788 sigma out 1act.( 7.36866522 sig in 8act.) RANK 7 NODE 9 --> 4.61864328 sigma out 1act.( 6.58083105 sig in 8act.) RANK 8 NODE 1 --> 2.91215038 sigma out 1act.( 4.47346687 sig in 8act.) RANK 9 NODE 12 --> 2.79960871 sigma out 1act.( 4.90208006 sig in 8act.) RANK 10 NODE 2 --> 2.20300674 sigma out 1act.( 3.52495503 sig in 8act.) RANK 11 NODE 8 --> 1.88029397 sigma out 1act.( 3.1020596 sig in 8act.) RANK 12 NODE 5 --> 1.74424195 sigma out 1act.( 3.02156115 sig in 8act.) RANK 13 NODE 10 --> 1.369344 sigma out 1act.( 2.06183791 sig in 8act.) RANK 14 NODE 13 --> 1.12246513 sigma out 1act.( 1.94414294 sig in 8act.) RANK 15 NODE 3 --> 0.0552819371 sigma out 1act.( 1.63630271 sig in 8act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 23.7748432 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.553989887 *** contribution from regularisation: 0.00536365947 *** contribution from error: -0.55935353 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -12770.5749 -0.149067655 4.0396924 EXIT FROM BFGS code NEW_X -12770.5749 -0.149067655 4.0396924 ENTER BFGS code NEW_X -12770.5749 -0.149067655 4.0396924 EXIT FROM BFGS code FG_LNSRCH 0. -0.284761935 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.554931819 *** contribution from regularisation: 0.008006691 *** contribution from error: -0.562938511 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12792.2889 -0.284761935 2.34295535 EXIT FROM BFGS code NEW_X -12792.2889 -0.284761935 2.34295535 ENTER BFGS code NEW_X -12792.2889 -0.284761935 2.34295535 EXIT FROM BFGS code FG_LNSRCH 0. -0.235487983 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.557528377 *** contribution from regularisation: 0.00556133268 *** contribution from error: -0.563089728 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12852.1435 -0.235487983 5.97127247 EXIT FROM BFGS code NEW_X -12852.1435 -0.235487983 5.97127247 ENTER BFGS code NEW_X -12852.1435 -0.235487983 5.97127247 EXIT FROM BFGS code FG_LNSRCH 0. -0.206092492 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.556520045 *** contribution from regularisation: 0.00645351736 *** contribution from error: -0.562973559 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12828.9006 -0.206092492 4.74315548 EXIT FROM BFGS code FG_LNSRCH 0. -0.233279034 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.556367218 *** contribution from regularisation: 0.00672224863 *** contribution from error: -0.56308949 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12825.3775 -0.233279034 5.18863392 EXIT FROM BFGS code FG_LNSRCH 0. -0.235473156 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.556577384 *** contribution from regularisation: 0.0065122596 *** contribution from error: -0.563089669 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12830.2225 -0.235473156 5.38937807 EXIT FROM BFGS code FG_LNSRCH 0. -0.235487983 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.556613863 *** contribution from regularisation: 0.00647580763 *** contribution from error: -0.563089669 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12831.063 -0.235487983 5.35504723 EXIT FROM BFGS code FG_LNSRCH 0. -0.235487983 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.556604028 *** contribution from regularisation: 0.00648565125 *** contribution from error: -0.563089669 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12830.8361 -0.235487983 5.42990208 EXIT FROM BFGS code FG_LNSRCH 0. -0.235487983 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.556585491 *** contribution from regularisation: 0.00650419993 *** contribution from error: -0.563089669 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12830.4085 -0.235487983 5.42227221 EXIT FROM BFGS code FG_LNSRCH 0. -0.235487983 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.556518197 *** contribution from regularisation: 0.00657150429 *** contribution from error: -0.563089728 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -12828.857 -0.235487983 5.53021526 EXIT FROM BFGS code NEW_X -12828.857 -0.235487983 5.53021526 ENTER BFGS code NEW_X -12828.857 -0.235487983 5.53021526 EXIT FROM BFGS code CONVERGENC -12828.857 -0.235487983 5.53021526 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 32.3586159 sigma out 15 active outputs RANK 2 NODE 7 --> 28.0533905 sigma out 15 active outputs RANK 3 NODE 5 --> 13.9625378 sigma out 15 active outputs RANK 4 NODE 1 --> 13.4530354 sigma out 15 active outputs RANK 5 NODE 4 --> 13.0550289 sigma out 15 active outputs RANK 6 NODE 3 --> 10.1907883 sigma out 15 active outputs RANK 7 NODE 8 --> 8.17935658 sigma out 15 active outputs RANK 8 NODE 2 --> 6.34401894 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 42.0568581 sigma in 8act. ( 47.1663437 sig out 1act.) RANK 2 NODE 15 --> 14.2860308 sigma in 8act. ( 14.250658 sig out 1act.) RANK 3 NODE 7 --> 11.6091881 sigma in 8act. ( 9.16776943 sig out 1act.) RANK 4 NODE 4 --> 10.5905008 sigma in 8act. ( 8.43450737 sig out 1act.) RANK 5 NODE 9 --> 9.3826952 sigma in 8act. ( 6.41001797 sig out 1act.) RANK 6 NODE 6 --> 9.18302631 sigma in 8act. ( 8.27560997 sig out 1act.) RANK 7 NODE 11 --> 9.006567 sigma in 8act. ( 6.18274069 sig out 1act.) RANK 8 NODE 1 --> 6.00306129 sigma in 8act. ( 4.28416967 sig out 1act.) RANK 9 NODE 12 --> 5.05580902 sigma in 8act. ( 3.21892357 sig out 1act.) RANK 10 NODE 8 --> 4.00357008 sigma in 8act. ( 2.59220934 sig out 1act.) RANK 11 NODE 2 --> 3.88815165 sigma in 8act. ( 2.86058259 sig out 1act.) RANK 12 NODE 5 --> 3.57959437 sigma in 8act. ( 2.53486252 sig out 1act.) RANK 13 NODE 10 --> 2.8983736 sigma in 8act. ( 2.42289138 sig out 1act.) RANK 14 NODE 3 --> 1.55806518 sigma in 8act. ( 0.549954712 sig out 1act.) RANK 15 NODE 13 --> 1.33220482 sigma in 8act. ( 1.24278009 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 47.1663437 sigma out 1act.( 42.0568581 sig in 8act.) RANK 2 NODE 15 --> 14.250658 sigma out 1act.( 14.2860308 sig in 8act.) RANK 3 NODE 7 --> 9.16776943 sigma out 1act.( 11.6091881 sig in 8act.) RANK 4 NODE 4 --> 8.43450737 sigma out 1act.( 10.5905008 sig in 8act.) RANK 5 NODE 6 --> 8.27560997 sigma out 1act.( 9.18302631 sig in 8act.) RANK 6 NODE 9 --> 6.41001797 sigma out 1act.( 9.3826952 sig in 8act.) RANK 7 NODE 11 --> 6.18274069 sigma out 1act.( 9.006567 sig in 8act.) RANK 8 NODE 1 --> 4.28416967 sigma out 1act.( 6.00306129 sig in 8act.) RANK 9 NODE 12 --> 3.21892357 sigma out 1act.( 5.05580902 sig in 8act.) RANK 10 NODE 2 --> 2.86058259 sigma out 1act.( 3.88815165 sig in 8act.) RANK 11 NODE 8 --> 2.59220934 sigma out 1act.( 4.00357008 sig in 8act.) RANK 12 NODE 5 --> 2.53486252 sigma out 1act.( 3.57959437 sig in 8act.) RANK 13 NODE 10 --> 2.42289138 sigma out 1act.( 2.8983736 sig in 8act.) RANK 14 NODE 13 --> 1.24278009 sigma out 1act.( 1.33220482 sig in 8act.) RANK 15 NODE 3 --> 0.549954712 sigma out 1act.( 1.55806518 sig in 8act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.8062057 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.556461632 *** contribution from regularisation: 0.00662805559 *** contribution from error: -0.563089669 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 24530 Closing output file done