NNInput NNInputs_145.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 187577 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 47777 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 47777 Chosen entries: 47777 Signal fraction: 1 Background fraction: 0.341752 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 47777 Entries to split: 47777 Test with : 23888 Train with : 23888 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 47777 for Signal Prepared event 0 for Signal with 47777 events ====Entry 0 Variable Ht : 172.917 Variable LepAPt : 28.3138 Variable LepBPt : 20.098 Variable MetSigLeptonsJets : 7.843 Variable MetSpec : 76.8658 Variable SumEtLeptonsJets : 96.051 Variable VSumJetLeptonsPt : 77.1984 Variable addEt : 125.278 Variable dPhiLepSumMet : 2.50109 Variable dPhiLeptons : 0.378813 Variable dRLeptons : 0.471432 Variable lep1_E : 39.4547 Variable lep2_E : 23.5705 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2145 Ht = 172.917 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 28.314 LepAPt = 28.3138 LepBEt = 20.098 LepBPt = 20.098 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 76.8658 MetDelPhi = 2.27916 MetSig = 5.37355 MetSigLeptonsJets = 7.843 MetSpec = 76.8658 Mjj = 0 MostCentralJetEta = 1.79326 MtllMet = 134.112 Njets = 1 SB = 0 SumEt = 204.618 SumEtJets = 0 SumEtLeptonsJets = 96.051 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 77.1984 addEt = 125.278 dPhiLepSumMet = 2.50109 dPhiLeptons = 0.378813 dRLeptons = 0.471432 diltype = 49 dimass = 11.2172 event = 188 jet1_Et = 47.6392 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 39.4547 lep2_E = 23.5705 rand = 0.999742 run = 236503 weight = 3.13807e-06 ===Show End Prepared event 10000 for Signal with 47777 events Prepared event 20000 for Signal with 47777 events Prepared event 30000 for Signal with 47777 events Prepared event 40000 for Signal with 47777 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.278254 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4369 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 187577 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4369 negative weights. Signal fraction: 63.2186127 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.5463905 65.5337982 67.2286606 68.318222 69.282196 70.185585 70.9345856 71.7999878 72.7231293 73.3977509 74.0645294 74.752655 75.3530884 75.8527679 76.6130524 77.1483307 77.8183441 78.3996582 79.0985336 79.6056061 80.2736969 81.0202484 81.6351624 82.3096313 83.0241928 83.9009399 84.7680664 85.7138977 86.875 87.9808502 89.1093903 90.1152649 91.3840256 92.8397064 93.8153229 95.0143814 96.3258209 97.7522202 99.0040741 100.298141 101.641296 102.999123 104.503799 105.775391 106.873322 108.209686 109.521744 110.823303 112.126511 113.390701 114.721542 116.19165 117.372665 118.685806 120.020531 121.319092 122.493561 123.806152 124.990211 126.244705 127.46769 128.691071 129.928711 131.202362 132.428299 133.678665 134.915878 136.179016 137.589966 138.931458 140.296356 141.728485 143.339417 144.875626 146.784851 148.44519 150.44751 152.686157 154.881958 157.121063 159.716217 162.05101 164.537369 167.06485 169.900482 173.023788 176.332825 179.538086 183.095001 187.506882 192.033417 197.10173 203.555634 210.702621 218.600189 229.56723 243.674545 262.940735 295.907623 820.901062 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3258152 20.6428452 20.9116383 21.2092552 21.4572906 21.6833801 21.8972855 22.1028671 22.3158379 22.5254765 22.7390137 22.9212914 23.1007767 23.3065948 23.4979782 23.6793251 23.8687687 24.0702381 24.2674065 24.4566593 24.6459579 24.8450317 25.0577087 25.2305527 25.4064903 25.5867844 25.7720566 25.9579144 26.16786 26.3391266 26.5574493 26.7710915 26.9962921 27.2009201 27.4287872 27.6536713 27.8547783 28.0566292 28.249321 28.4917507 28.7093868 28.8892879 29.1192284 29.3064461 29.5401573 29.7774239 30.0136757 30.2631626 30.522583 30.7532425 31.031229 31.2897072 31.5188637 31.7530327 31.9685249 32.2082291 32.4900055 32.7546463 33.0299301 33.268158 33.5660591 33.8385468 34.1354218 34.4466133 34.7734375 35.0904999 35.3786697 35.6674652 35.9837494 36.3085556 36.6206589 36.9356003 37.3046265 37.6851044 38.0737267 38.4617233 38.884613 39.3116226 39.7515106 40.2096901 40.7298012 41.2089806 41.7123795 42.2241631 42.8315506 43.3792648 44.0243607 44.7129593 45.5260162 46.3236694 47.2844009 48.3868561 49.6062813 50.8538895 52.552681 54.7484055 57.588913 61.2790604 70.0780029 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.128912 10.2597523 10.3761635 10.4742117 10.6309843 10.7608356 10.8854551 10.9782658 11.0911713 11.2311611 11.3670635 11.502511 11.6367369 11.7652197 11.9186344 12.0749798 12.2326241 12.3718719 12.5172968 12.6802368 12.8382092 12.9605856 13.1232224 13.2744484 13.4685879 13.6313858 13.7757683 13.9232187 14.0670261 14.2190971 14.3618813 14.5485601 14.7535419 14.9277134 15.101368 15.3007412 15.4784813 15.6622295 15.8458261 15.9988937 16.1996384 16.3842964 16.6094894 16.7988968 17.0060081 17.2422867 17.4544487 17.702383 17.9124527 18.1483383 18.3750324 18.5865936 18.798481 19.0240326 19.2662163 19.5125198 19.7584534 19.9947739 20.1973743 20.3954544 20.6027412 20.8391342 21.1033382 21.3283501 21.5624237 21.7892284 22.0249977 22.2927761 22.5302181 22.7737007 23.0619926 23.3445415 23.6299591 23.9243546 24.2223682 24.5283241 24.8673859 25.1685219 25.5043869 25.8239994 26.1910439 26.5384865 26.8801765 27.2735577 27.6520157 28.024519 28.4360542 28.8759995 29.3571739 29.8152161 30.3469734 30.9549217 31.5854683 32.2692337 33.1119385 34.2629852 35.7406693 38.0365906 42.1898384 69.9040909 ------------------------------ Transdef: Tab for variable 5 1.19692361 2.5670979 2.99324274 3.2827599 3.53311014 3.73673868 3.94792032 4.08401966 4.21942234 4.32521534 4.43018532 4.53542852 4.62980461 4.71559954 4.80659151 4.88584423 4.95739746 5.03719473 5.1005125 5.15757656 5.21598101 5.28375244 5.34404373 5.39112663 5.43945837 5.48488855 5.52293921 5.56687403 5.61356974 5.65858316 5.69708014 5.74718475 5.79041576 5.83799982 5.88799191 5.93108845 5.96932793 6.01767349 6.06270123 6.1005888 6.13772106 6.18324661 6.22073269 6.26300287 6.29882383 6.33693361 6.37843466 6.42320538 6.46812487 6.50764751 6.55133295 6.59959698 6.64039946 6.68145657 6.7274313 6.77017307 6.81509781 6.85230064 6.88965797 6.93281746 6.9819622 7.02833128 7.07335281 7.12092686 7.16559935 7.20523548 7.24676466 7.29354239 7.34149265 7.39546204 7.43655729 7.49399519 7.54940701 7.60524178 7.66139698 7.72193146 7.77887249 7.83276749 7.88386154 7.93847084 7.99888277 8.06006718 8.12218952 8.18717003 8.24834824 8.31790924 8.38729 8.46226978 8.53972435 8.62122726 8.71411705 8.81881523 8.93100548 9.05614662 9.202528 9.36765671 9.56591797 9.85698414 10.2884827 11.0263939 22.6250648 ------------------------------ Transdef: Tab for variable 6 15.0146933 20.517231 25.130003 26.1892433 27.1370697 27.9835587 28.9225998 29.7045517 30.4593849 30.9716625 31.597887 32.1631851 32.6686325 33.0653038 33.4716187 33.9320984 34.4409409 34.7762299 35.0802841 35.5191727 35.8695145 36.2413177 36.5280685 36.8993759 37.2598572 37.5576859 37.9095459 38.250885 38.5954285 38.9638519 39.3418961 39.6603394 40.0417328 40.3982964 40.7381897 41.1405907 41.5227699 41.9830856 42.3823624 42.7664566 43.1305084 43.5908737 43.9892197 44.4345856 44.9155693 45.4851799 46.0222549 46.5580177 47.1490936 47.6067886 48.1789017 48.7700577 49.3610191 49.8555794 50.3522644 50.9378014 51.523819 52.2049103 52.8552704 53.4542007 54.0296326 54.6479187 55.3225479 55.9622841 56.5688133 57.135994 57.7484169 58.3217659 58.9943466 59.6673584 60.3163223 60.9757614 61.6267929 62.2720337 62.8739853 63.5546379 64.1974182 64.8486633 65.6091614 66.348587 67.1394653 67.8356781 68.56987 69.4082718 70.1721191 71.0255585 72.0151825 72.9708557 74.1348114 75.3528137 76.6417313 78.153717 79.9907379 81.8363037 84.3009949 86.9951019 90.6043091 95.4580002 102.738235 114.7649 259.076752 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7325249 33.7400742 34.4356155 35.1143646 35.5887337 35.9428329 36.306736 36.7004585 37.0441132 37.3741531 37.71595 38.0463562 38.3703613 38.6586533 38.9099884 39.1831474 39.4519958 39.6941681 40.0982285 40.4015732 40.7745361 41.0599899 41.3804092 41.7071228 42.0865555 42.5207062 42.954071 43.5220642 44.1563835 44.6451569 45.2864876 45.8493156 46.6115265 47.2768593 48.0502853 48.7677879 49.4069061 50.2432861 51.0912704 51.9441032 52.7339706 53.4746323 54.2379379 55.1684265 55.9292679 56.6180115 57.2826157 58.0750046 58.9109268 59.5869675 60.285759 61.0556717 61.6862221 62.3795509 63.1031647 63.8348007 64.6376495 65.4106598 66.2592545 66.9853516 67.7410736 68.5842896 69.4893494 70.3962173 71.3407745 72.2734375 73.4260559 74.6688843 75.8527222 77.1795197 78.5738983 79.973938 81.5123749 82.9071045 84.4597015 86.1665344 87.9020233 89.5189514 91.2818527 93.1651459 95.0077057 96.8015366 98.9718018 101.485413 103.760529 105.97821 108.709076 111.430878 114.730743 118.375076 122.464615 126.990662 131.68045 137.578094 144.00061 152.341522 164.022247 179.992355 207.2565 467.62793 ------------------------------ Transdef: Tab for variable 8 2.62431407 23.2959023 28.3113499 30.1800804 31.3824692 32.2188454 32.949295 33.4751968 33.9092255 34.3735809 34.7903366 35.1159973 35.4475441 35.7643967 36.0767746 36.3572006 36.626091 36.9226913 37.2116966 37.4864502 37.7965279 38.0265884 38.2243538 38.5033493 38.7245903 38.9795914 39.2593307 39.5328064 39.8044281 40.111145 40.3830757 40.6974564 40.9778137 41.3061066 41.6210556 41.9767075 42.3456497 42.7467041 43.1537399 43.5488739 43.9584846 44.4436188 44.8859329 45.4187851 45.8785782 46.4168701 46.8573227 47.4690742 48.0054703 48.5419693 49.0002136 49.453804 50.0524521 50.6080475 51.1750412 51.76194 52.3587112 52.928154 53.3897667 53.9308434 54.5472031 55.1043472 55.6391754 56.1976433 56.7736435 57.3603516 57.9346008 58.5056801 59.0813904 59.6835175 60.271183 60.8617172 61.453537 62.1073227 62.7414932 63.359581 64.0236053 64.6233063 65.328186 66.0016479 66.6598206 67.3500671 68.0958099 68.8345642 69.6861649 70.5455017 71.5520782 72.6088638 73.8082123 75.0819244 76.4677505 78.1897278 79.9140778 82.3139267 84.697464 87.6409454 91.4987488 96.3774338 104.441429 118.646927 346.391968 ------------------------------ Transdef: Tab for variable 9 48.7045631 63.0406723 64.7729034 66.3853912 67.5940247 68.6068268 69.533844 70.2084961 70.9186783 71.666687 72.4815369 73.1578217 73.670433 74.3200684 74.9124756 75.4358444 75.8591614 76.4944687 77.0456543 77.5770645 78.1197357 78.6024933 79.2034912 79.6495514 80.148613 80.8272095 81.3561935 81.9851913 82.4857483 83.0203857 83.7070618 84.3323975 85.0544739 85.9130554 86.7316284 87.6601028 88.6214294 89.4190674 90.3913727 91.2963715 92.3175201 93.1851807 94.2432938 95.1928864 96.2031479 97.4744568 98.3865433 99.55513 100.613098 101.662773 102.76326 103.863037 104.930908 105.947342 106.911987 107.951447 108.997612 109.94371 110.919228 111.935234 112.974716 113.906654 114.955902 115.891907 116.858887 117.878433 118.869202 119.849266 120.751358 121.658134 122.650345 123.610809 124.605774 125.584915 126.484711 127.430313 128.350906 129.262924 130.171967 131.131851 132.146652 133.071442 134.104248 135.139709 136.137741 137.283005 138.393707 139.547333 140.760712 141.979858 143.435577 144.862152 146.57103 148.240906 150.412842 153.178528 156.825623 161.88028 170.212921 187.510132 424.390259 ------------------------------ Transdef: Tab for variable 10 0.00602381537 1.04292071 1.3536346 1.55995178 1.7156961 1.82336152 1.91835201 2.00091553 2.0752039 2.14177895 2.2013557 2.25613928 2.30376101 2.34450746 2.38276339 2.42037868 2.45463419 2.48597479 2.51742268 2.54411483 2.569453 2.59537935 2.61889386 2.64276457 2.66564178 2.68685508 2.70725322 2.72613096 2.74440527 2.76146102 2.77810335 2.79296231 2.80753946 2.82164764 2.83340263 2.84513259 2.85712051 2.86651492 2.87751341 2.8867805 2.89589119 2.90567064 2.9145565 2.92162561 2.92929983 2.93708658 2.94603586 2.95233965 2.95907021 2.96533895 2.97079873 2.97732067 2.98242092 2.98717642 2.99118805 2.99743605 3.00265837 3.00752449 3.01244736 3.01694393 3.02175236 3.02642798 3.02984762 3.03398514 3.03788662 3.04175901 3.04562473 3.04936433 3.05325699 3.05694675 3.06043625 3.06421041 3.06741524 3.07084155 3.07361722 3.07663703 3.0799346 3.08286023 3.08607507 3.08900237 3.09205866 3.09469056 3.09723973 3.10019732 3.10271263 3.10500622 3.10774088 3.10975885 3.11257362 3.11516809 3.11733723 3.11967468 3.12216759 3.12456799 3.12706137 3.12926245 3.13185906 3.1340313 3.13638353 3.13884926 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.0063524507 0.0115721226 0.0186915994 0.025190711 0.0328555107 0.0408446193 0.048665911 0.0575042889 0.0639690161 0.0713231564 0.0786194801 0.0858211964 0.0926045179 0.100166589 0.108020186 0.116284132 0.123741746 0.131278515 0.13872385 0.14608103 0.153487206 0.160493374 0.167031646 0.173678756 0.179775119 0.186197042 0.192511559 0.198738843 0.204321235 0.209882021 0.216137081 0.22200501 0.227773488 0.232897535 0.238329887 0.244491577 0.250121474 0.25558424 0.261033952 0.266551495 0.271902561 0.277606249 0.283737183 0.289252102 0.294719815 0.29997468 0.305470943 0.311353207 0.316976368 0.322266698 0.327413678 0.333328485 0.338647604 0.34471941 0.350423574 0.356283426 0.361311674 0.366745055 0.372578979 0.378622234 0.385637164 0.391177416 0.39730984 0.402581304 0.408465862 0.414235234 0.42027843 0.426068068 0.432249188 0.438881308 0.444620967 0.449996352 0.456086397 0.461892247 0.469336927 0.476100445 0.482848406 0.490786374 0.498901427 0.506537199 0.514329553 0.521407008 0.530201912 0.540544271 0.549715221 0.560329437 0.571623206 0.583034396 0.595220327 0.60853231 0.623372972 0.63783741 0.653435946 0.670061827 0.690545082 0.714366078 0.741191626 0.786328733 0.855388641 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.216860741 0.229083613 0.24077037 0.251356959 0.260730684 0.270534843 0.279543668 0.286593914 0.294968188 0.30263257 0.310402274 0.317502052 0.323571205 0.330444932 0.337470949 0.344627261 0.350168228 0.356340766 0.362354785 0.368413448 0.374517798 0.380164325 0.386698723 0.392788768 0.39762789 0.401957333 0.406214148 0.41018939 0.414345115 0.418053627 0.422194272 0.426151216 0.429949433 0.433644712 0.437059104 0.440676451 0.444621742 0.447781026 0.451620847 0.455059797 0.458691716 0.461958617 0.465416968 0.469097465 0.473170131 0.476782382 0.480405986 0.484051108 0.487622023 0.491117895 0.495203793 0.498836815 0.502597809 0.506758511 0.510505557 0.514315248 0.51876533 0.522793174 0.526904583 0.531546474 0.536781073 0.541848779 0.546667874 0.551439643 0.556190848 0.56088078 0.566391468 0.571522474 0.576597571 0.582260728 0.587702632 0.593360782 0.598454833 0.604763508 0.611053348 0.61740005 0.624254465 0.630895019 0.637603045 0.6450423 0.652302563 0.660670221 0.66766715 0.67598474 0.683431268 0.692829013 0.700625896 0.709899247 0.720602274 0.728837609 0.740588546 0.751163542 0.764283657 0.780392528 0.796396792 0.815396905 0.838314056 0.870379329 0.914966047 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0025482 21.4910564 22.2034988 22.7800217 23.4095993 23.8925762 24.4354935 24.8853645 25.2940178 25.6356926 26.0104561 26.4419594 26.8186073 27.2204094 27.5637779 27.9421482 28.2620792 28.5874863 28.8917351 29.1919365 29.4798126 29.795269 30.1092663 30.4094334 30.6718693 30.9856987 31.3165913 31.5916138 31.8854332 32.1693192 32.4678993 32.8212318 33.1398849 33.4440002 33.7647629 34.0472145 34.4517899 34.7543449 35.0338898 35.3607407 35.6852417 36.0092163 36.2297974 36.5828667 36.9173279 37.2694016 37.6187744 38.0093689 38.3661728 38.7177963 39.1242867 39.5167007 39.9164505 40.3272362 40.7235184 41.1455688 41.5729446 41.9900284 42.4238052 42.8811913 43.2645187 43.6860275 44.098175 44.5734749 45.0565681 45.5188522 46.0377197 46.4974594 46.9568253 47.4883041 48.062088 48.6509323 49.2025986 49.8246384 50.4459343 51.1025543 51.8666534 52.5257683 53.3464317 54.1472015 54.9330139 55.7760849 56.6061478 57.5928574 58.6202469 59.6034317 60.8740883 62.1842384 63.3156738 64.8589935 66.5568848 68.6032715 70.5738373 73.2371674 75.7927399 78.7156982 82.6370392 87.6032867 93.5953064 104.366745 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7778816 11.1527376 11.497015 11.8469563 12.2630234 12.5319548 12.8210497 13.152607 13.4453812 13.7442226 14.0235176 14.2755222 14.554451 14.8126602 15.0860519 15.3554525 15.6080456 15.8964443 16.1964417 16.4607277 16.7400951 16.9529419 17.2204285 17.484024 17.7295151 17.9586792 18.2155991 18.4937057 18.7446537 18.9852848 19.1932869 19.4316921 19.7229004 19.9724922 20.2435684 20.4977608 20.7356186 20.982172 21.270092 21.5183563 21.7634315 21.9869518 22.2524853 22.5205116 22.7561264 23.0095215 23.2609825 23.5016785 23.7943726 24.085762 24.366333 24.6347561 24.9160156 25.2335892 25.5162582 25.7392254 25.98032 26.2370758 26.5136204 26.8004723 27.0775642 27.3840218 27.6533127 27.9509811 28.2353916 28.5646935 28.9266491 29.2258072 29.5275192 29.8087692 30.1807899 30.5089722 30.8974609 31.2390785 31.6276131 31.9946556 32.4587898 32.9119568 33.4084473 33.8550339 34.3124084 34.7926445 35.2867584 35.8209496 36.4296341 37.0431328 37.7179413 38.4494324 39.2970047 40.1689529 41.1282043 42.2730522 43.745491 44.9493294 46.7434196 49.0188904 52.1480789 55.971077 62.6871758 118.581718 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 62.5 44.0 47.8 23.0 44.4 59.8 50.1 59.9 -29.0 -13.9 -32.8 7.5 17.4 2 62.5 100.0 63.9 57.2 28.6 65.8 94.2 71.4 91.0 -48.1 -22.9 -47.2 27.5 28.7 3 44.0 63.9 100.0 38.6 3.4 30.4 67.3 50.1 69.5 -17.4 -24.1 -51.8 62.3 18.5 4 47.8 57.2 38.6 100.0 10.5 33.2 58.0 48.2 63.2 -14.7 -27.3 -58.9 13.6 69.4 5 23.0 28.6 3.4 10.5 100.0 82.6 0.5 53.5 52.7 26.0 -4.4 -7.0 -8.3 0.7 6 44.4 65.8 30.4 33.2 82.6 100.0 44.0 77.8 78.8 -6.8 -12.9 -26.1 6.1 13.7 7 59.8 94.2 67.3 58.0 0.5 44.0 100.0 62.8 78.9 -56.1 -22.4 -47.7 32.3 30.9 8 50.1 71.4 50.1 48.2 53.5 77.8 62.8 100.0 81.4 -10.8 -21.7 -41.2 21.1 25.4 9 59.9 91.0 69.5 63.2 52.7 78.8 78.9 81.4 100.0 -22.9 -25.5 -53.4 32.2 34.3 10 -29.0 -48.1 -17.4 -14.7 26.0 -6.8 -56.1 -10.8 -22.9 100.0 4.1 9.8 -4.2 -4.0 11 -13.9 -22.9 -24.1 -27.3 -4.4 -12.9 -22.4 -21.7 -25.5 4.1 100.0 53.5 -10.2 -17.0 12 -32.8 -47.2 -51.8 -58.9 -7.0 -26.1 -47.7 -41.2 -53.4 9.8 53.5 100.0 -24.0 -33.8 13 7.5 27.5 62.3 13.6 -8.3 6.1 32.3 21.1 32.2 -4.2 -10.2 -24.0 100.0 43.6 14 17.4 28.7 18.5 69.4 0.7 13.7 30.9 25.4 34.3 -4.0 -17.0 -33.8 43.6 100.0 TOTAL CORRELATION TO TARGET (diagonal) 150.886926 TOTAL CORRELATION OF ALL VARIABLES 68.7308852 ROUND 1: MAX CORR ( 68.7191236) AFTER KILLING INPUT VARIABLE 6 CONTR 1.27146735 ROUND 2: MAX CORR ( 68.6974588) AFTER KILLING INPUT VARIABLE 11 CONTR 1.72542963 ROUND 3: MAX CORR ( 68.6380681) AFTER KILLING INPUT VARIABLE 8 CONTR 2.85595089 ROUND 4: MAX CORR ( 68.5258393) AFTER KILLING INPUT VARIABLE 2 CONTR 3.92348531 ROUND 5: MAX CORR ( 68.4048246) AFTER KILLING INPUT VARIABLE 14 CONTR 4.07070385 ROUND 6: MAX CORR ( 68.244644) AFTER KILLING INPUT VARIABLE 12 CONTR 4.67852479 ROUND 7: MAX CORR ( 67.8984869) AFTER KILLING INPUT VARIABLE 10 CONTR 6.86490368 ROUND 8: MAX CORR ( 67.2314908) AFTER KILLING INPUT VARIABLE 9 CONTR 9.49374387 ROUND 9: MAX CORR ( 66.0931085) AFTER KILLING INPUT VARIABLE 3 CONTR 12.3196738 ROUND 10: MAX CORR ( 65.3639557) AFTER KILLING INPUT VARIABLE 13 CONTR 9.79041843 ROUND 11: MAX CORR ( 63.9987986) AFTER KILLING INPUT VARIABLE 4 CONTR 13.2891111 ROUND 12: MAX CORR ( 59.8274609) AFTER KILLING INPUT VARIABLE 5 CONTR 22.7271017 LAST REMAINING VARIABLE: 7 total correlation to target: 68.7308852 % total significance: 133.869371 sigma correlations of single variables to target: variable 2: 62.5347677 % , in sigma: 121.800992 variable 3: 43.9610717 % , in sigma: 85.624403 variable 4: 47.7634869 % , in sigma: 93.0304904 variable 5: 23.0309273 % , in sigma: 44.8580829 variable 6: 44.4224918 % , in sigma: 86.5231259 variable 7: 59.8274609 % , in sigma: 116.527883 variable 8: 50.1046 % , in sigma: 97.5903522 variable 9: 59.8627438 % , in sigma: 116.596605 variable 10: -28.9892674 % , in sigma: 56.463335 variable 11: -13.8789465 % , in sigma: 27.0324735 variable 12: -32.7737417 % , in sigma: 63.8344782 variable 13: 7.47708706 % , in sigma: 14.5633646 variable 14: 17.383537 % , in sigma: 33.858478 variables sorted by significance: 1 most relevant variable 7 corr 59.8274612 , in sigma: 116.527884 2 most relevant variable 5 corr 22.7271023 , in sigma: 44.2663131 3 most relevant variable 4 corr 13.2891111 , in sigma: 25.8836321 4 most relevant variable 13 corr 9.79041862 , in sigma: 19.0691154 5 most relevant variable 3 corr 12.3196735 , in sigma: 23.9954271 6 most relevant variable 9 corr 9.4937439 , in sigma: 18.4912724 7 most relevant variable 10 corr 6.86490345 , in sigma: 13.3709948 8 most relevant variable 12 corr 4.67852497 , in sigma: 9.1125146 9 most relevant variable 14 corr 4.07070398 , in sigma: 7.92864198 10 most relevant variable 2 corr 3.92348528 , in sigma: 7.64189934 11 most relevant variable 8 corr 2.85595083 , in sigma: 5.56262793 12 most relevant variable 11 corr 1.72542965 , in sigma: 3.36067522 13 most relevant variable 6 corr 1.27146733 , in sigma: 2.47647809 global correlations between input variables: variable 2: 99.130282 % variable 3: 92.625508 % variable 4: 91.5994676 % variable 5: 95.3359783 % variable 6: 94.8693235 % variable 7: 98.6892284 % variable 8: 88.7238456 % variable 9: 98.7876698 % variable 10: 72.6914498 % variable 11: 54.4796622 % variable 12: 75.6445235 % variable 13: 84.5771785 % variable 14: 86.945376 % significance loss when removing single variables: variable 2: corr = 4.959965 % , sigma = 9.66068446 variable 3: corr = 14.7282008 % , sigma = 28.6865936 variable 4: corr = 15.7762672 % , sigma = 30.7279465 variable 5: corr = 13.0650418 % , sigma = 25.4472051 variable 6: corr = 1.27146735 % , sigma = 2.47647814 variable 7: corr = 4.84483061 % , sigma = 9.43643348 variable 8: corr = 3.20422866 % , sigma = 6.24097994 variable 9: corr = 10.3750371 % , sigma = 20.2077958 variable 10: corr = 6.24230156 % , sigma = 12.1583329 variable 11: corr = 1.76751993 % , sigma = 3.44265582 variable 12: corr = 3.67545302 % , sigma = 7.15879889 variable 13: corr = 7.33031694 % , sigma = 14.2774957 variable 14: corr = 3.92431335 % , sigma = 7.64351221 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 24.6223469 sigma out 15 active outputs RANK 2 NODE 11 --> 24.0626259 sigma out 15 active outputs RANK 3 NODE 9 --> 21.8391895 sigma out 15 active outputs RANK 4 NODE 1 --> 21.3295918 sigma out 15 active outputs RANK 5 NODE 8 --> 21.0840225 sigma out 15 active outputs RANK 6 NODE 7 --> 20.1011696 sigma out 15 active outputs RANK 7 NODE 12 --> 17.8416119 sigma out 15 active outputs RANK 8 NODE 4 --> 16.8113289 sigma out 15 active outputs RANK 9 NODE 3 --> 15.814394 sigma out 15 active outputs RANK 10 NODE 10 --> 13.6992331 sigma out 15 active outputs RANK 11 NODE 6 --> 12.3770323 sigma out 15 active outputs RANK 12 NODE 2 --> 9.95501232 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 30.2875309 sigma in 12act. ( 34.6047173 sig out 1act.) RANK 2 NODE 8 --> 29.5814342 sigma in 12act. ( 30.489584 sig out 1act.) RANK 3 NODE 4 --> 26.6503372 sigma in 12act. ( 27.7463169 sig out 1act.) RANK 4 NODE 7 --> 25.2280197 sigma in 12act. ( 22.6755085 sig out 1act.) RANK 5 NODE 3 --> 15.4168453 sigma in 12act. ( 12.4764709 sig out 1act.) RANK 6 NODE 12 --> 15.2643986 sigma in 12act. ( 15.0779638 sig out 1act.) RANK 7 NODE 13 --> 13.7751875 sigma in 12act. ( 17.6106472 sig out 1act.) RANK 8 NODE 14 --> 11.4575357 sigma in 12act. ( 12.4862041 sig out 1act.) RANK 9 NODE 1 --> 10.6646433 sigma in 12act. ( 13.4251213 sig out 1act.) RANK 10 NODE 9 --> 8.5124197 sigma in 12act. ( 5.22499037 sig out 1act.) RANK 11 NODE 6 --> 7.84022188 sigma in 12act. ( 7.51238918 sig out 1act.) RANK 12 NODE 2 --> 6.03081989 sigma in 12act. ( 9.04777431 sig out 1act.) RANK 13 NODE 15 --> 5.60279036 sigma in 12act. ( 3.99036026 sig out 1act.) RANK 14 NODE 10 --> 3.01733923 sigma in 12act. ( 0.850634038 sig out 1act.) RANK 15 NODE 11 --> 1.19713676 sigma in 12act. ( 0.580357254 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 34.6047173 sigma out 1act.( 30.2875309 sig in 12act.) RANK 2 NODE 8 --> 30.489584 sigma out 1act.( 29.5814342 sig in 12act.) RANK 3 NODE 4 --> 27.7463169 sigma out 1act.( 26.6503372 sig in 12act.) RANK 4 NODE 7 --> 22.6755085 sigma out 1act.( 25.2280197 sig in 12act.) RANK 5 NODE 13 --> 17.6106472 sigma out 1act.( 13.7751875 sig in 12act.) RANK 6 NODE 12 --> 15.0779638 sigma out 1act.( 15.2643986 sig in 12act.) RANK 7 NODE 1 --> 13.4251213 sigma out 1act.( 10.6646433 sig in 12act.) RANK 8 NODE 14 --> 12.4862041 sigma out 1act.( 11.4575357 sig in 12act.) RANK 9 NODE 3 --> 12.4764709 sigma out 1act.( 15.4168453 sig in 12act.) RANK 10 NODE 2 --> 9.04777431 sigma out 1act.( 6.03081989 sig in 12act.) RANK 11 NODE 6 --> 7.51238918 sigma out 1act.( 7.84022188 sig in 12act.) RANK 12 NODE 9 --> 5.22499037 sigma out 1act.( 8.5124197 sig in 12act.) RANK 13 NODE 15 --> 3.99036026 sigma out 1act.( 5.60279036 sig in 12act.) RANK 14 NODE 10 --> 0.850634038 sigma out 1act.( 3.01733923 sig in 12act.) RANK 15 NODE 11 --> 0.580357254 sigma out 1act.( 1.19713676 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 67.9926605 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 27.9171391 sigma out 15 active outputs RANK 2 NODE 5 --> 25.1312599 sigma out 15 active outputs RANK 3 NODE 9 --> 21.0509396 sigma out 15 active outputs RANK 4 NODE 8 --> 20.568306 sigma out 15 active outputs RANK 5 NODE 7 --> 20.5246696 sigma out 15 active outputs RANK 6 NODE 1 --> 20.3097801 sigma out 15 active outputs RANK 7 NODE 4 --> 17.1631584 sigma out 15 active outputs RANK 8 NODE 12 --> 16.7266598 sigma out 15 active outputs RANK 9 NODE 3 --> 16.3250122 sigma out 15 active outputs RANK 10 NODE 6 --> 13.7268887 sigma out 15 active outputs RANK 11 NODE 10 --> 13.5350037 sigma out 15 active outputs RANK 12 NODE 2 --> 11.621213 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 34.8679237 sigma in 12act. ( 35.0426369 sig out 1act.) RANK 2 NODE 8 --> 26.9849663 sigma in 12act. ( 27.9154625 sig out 1act.) RANK 3 NODE 4 --> 25.2814884 sigma in 12act. ( 25.1000881 sig out 1act.) RANK 4 NODE 7 --> 20.7030678 sigma in 12act. ( 18.8543396 sig out 1act.) RANK 5 NODE 13 --> 17.0139236 sigma in 12act. ( 17.2058697 sig out 1act.) RANK 6 NODE 12 --> 13.5810947 sigma in 12act. ( 13.161787 sig out 1act.) RANK 7 NODE 1 --> 13.5528316 sigma in 12act. ( 13.2095385 sig out 1act.) RANK 8 NODE 14 --> 13.4919233 sigma in 12act. ( 11.9344463 sig out 1act.) RANK 9 NODE 3 --> 12.5917358 sigma in 12act. ( 10.5573177 sig out 1act.) RANK 10 NODE 2 --> 11.4708719 sigma in 12act. ( 9.73333645 sig out 1act.) RANK 11 NODE 6 --> 10.8654594 sigma in 12act. ( 6.98493814 sig out 1act.) RANK 12 NODE 9 --> 8.38414001 sigma in 12act. ( 4.10467863 sig out 1act.) RANK 13 NODE 11 --> 7.52735567 sigma in 12act. ( 2.11837888 sig out 1act.) RANK 14 NODE 10 --> 6.64112043 sigma in 12act. ( 0.598377287 sig out 1act.) RANK 15 NODE 15 --> 5.27436209 sigma in 12act. ( 3.0574789 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 35.0426369 sigma out 1act.( 34.8679237 sig in 12act.) RANK 2 NODE 8 --> 27.9154625 sigma out 1act.( 26.9849663 sig in 12act.) RANK 3 NODE 4 --> 25.1000881 sigma out 1act.( 25.2814884 sig in 12act.) RANK 4 NODE 7 --> 18.8543396 sigma out 1act.( 20.7030678 sig in 12act.) RANK 5 NODE 13 --> 17.2058697 sigma out 1act.( 17.0139236 sig in 12act.) RANK 6 NODE 1 --> 13.2095385 sigma out 1act.( 13.5528316 sig in 12act.) RANK 7 NODE 12 --> 13.161787 sigma out 1act.( 13.5810947 sig in 12act.) RANK 8 NODE 14 --> 11.9344463 sigma out 1act.( 13.4919233 sig in 12act.) RANK 9 NODE 3 --> 10.5573177 sigma out 1act.( 12.5917358 sig in 12act.) RANK 10 NODE 2 --> 9.73333645 sigma out 1act.( 11.4708719 sig in 12act.) RANK 11 NODE 6 --> 6.98493814 sigma out 1act.( 10.8654594 sig in 12act.) RANK 12 NODE 9 --> 4.10467863 sigma out 1act.( 8.38414001 sig in 12act.) RANK 13 NODE 15 --> 3.0574789 sigma out 1act.( 5.27436209 sig in 12act.) RANK 14 NODE 11 --> 2.11837888 sigma out 1act.( 7.52735567 sig in 12act.) RANK 15 NODE 10 --> 0.598377287 sigma out 1act.( 6.64112043 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.757225 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.424864173 *** contribution from regularisation: 0.00413395418 *** contribution from error: -0.428998113 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.474584997 *** contribution from regularisation: 0.00274082529 *** contribution from error: -0.477325827 *********************************************** -----------------> Test sample ENTER BFGS code START -44519.7578 -0.0206084959 0.00631000288 EXIT FROM BFGS code FG_START 0. -0.0206084959 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.503607452 *** contribution from regularisation: 0.00245316001 *** contribution from error: -0.5060606 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -47232.3341 -0.0206084959 -176.71347 EXIT FROM BFGS code FG_LNSRCH 0. -0.0554487146 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.537626326 *** contribution from regularisation: 0.00311044883 *** contribution from error: -0.540736794 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50422.8986 -0.0554487146 -205.395935 EXIT FROM BFGS code NEW_X -50422.8986 -0.0554487146 -205.395935 ENTER BFGS code NEW_X -50422.8986 -0.0554487146 -205.395935 EXIT FROM BFGS code FG_LNSRCH 0. -0.104007259 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.540733933 *** contribution from regularisation: 0.00320532545 *** contribution from error: -0.543939233 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50714.3563 -0.104007259 -96.8826904 EXIT FROM BFGS code NEW_X -50714.3563 -0.104007259 -96.8826904 ENTER BFGS code NEW_X -50714.3563 -0.104007259 -96.8826904 EXIT FROM BFGS code FG_LNSRCH 0. -0.147355944 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.541823387 *** contribution from regularisation: 0.00312837656 *** contribution from error: -0.544951737 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50816.5344 -0.147355944 -27.6875153 EXIT FROM BFGS code NEW_X -50816.5344 -0.147355944 -27.6875153 ENTER BFGS code NEW_X -50816.5344 -0.147355944 -27.6875153 EXIT FROM BFGS code FG_LNSRCH 0. -0.177740902 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.542204559 *** contribution from regularisation: 0.00304304552 *** contribution from error: -0.545247614 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50852.2816 -0.177740902 -30.1067829 EXIT FROM BFGS code NEW_X -50852.2816 -0.177740902 -30.1067829 ENTER BFGS code NEW_X -50852.2816 -0.177740902 -30.1067829 EXIT FROM BFGS code FG_LNSRCH 0. -0.236734226 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.542623401 *** contribution from regularisation: 0.00297967112 *** contribution from error: -0.545603096 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50891.5642 -0.236734226 12.8001204 EXIT FROM BFGS code NEW_X -50891.5642 -0.236734226 12.8001204 ENTER BFGS code NEW_X -50891.5642 -0.236734226 12.8001204 EXIT FROM BFGS code FG_LNSRCH 0. -0.412210375 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.543846488 *** contribution from regularisation: 0.00276121567 *** contribution from error: -0.546607733 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51006.2753 -0.412210375 19.6910305 EXIT FROM BFGS code NEW_X -51006.2753 -0.412210375 19.6910305 ENTER BFGS code NEW_X -51006.2753 -0.412210375 19.6910305 EXIT FROM BFGS code FG_LNSRCH 0. -0.678441346 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 47.5990334 sigma out 15 active outputs RANK 2 NODE 1 --> 24.6856728 sigma out 15 active outputs RANK 3 NODE 5 --> 20.6740665 sigma out 15 active outputs RANK 4 NODE 3 --> 18.6434708 sigma out 15 active outputs RANK 5 NODE 6 --> 18.3695488 sigma out 15 active outputs RANK 6 NODE 10 --> 17.6457939 sigma out 15 active outputs RANK 7 NODE 2 --> 17.4759998 sigma out 15 active outputs RANK 8 NODE 7 --> 11.8692722 sigma out 15 active outputs RANK 9 NODE 9 --> 11.5413284 sigma out 15 active outputs RANK 10 NODE 12 --> 10.9038496 sigma out 15 active outputs RANK 11 NODE 4 --> 10.7525949 sigma out 15 active outputs RANK 12 NODE 8 --> 9.52372837 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 39.8764 sigma in 12act. ( 44.0089798 sig out 1act.) RANK 2 NODE 11 --> 35.3294716 sigma in 12act. ( 37.063179 sig out 1act.) RANK 3 NODE 4 --> 24.4997768 sigma in 12act. ( 21.0849495 sig out 1act.) RANK 4 NODE 2 --> 20.6067085 sigma in 12act. ( 17.022028 sig out 1act.) RANK 5 NODE 6 --> 19.8760376 sigma in 12act. ( 20.5445118 sig out 1act.) RANK 6 NODE 14 --> 18.6332951 sigma in 12act. ( 19.8206902 sig out 1act.) RANK 7 NODE 8 --> 13.3889141 sigma in 12act. ( 13.8957777 sig out 1act.) RANK 8 NODE 13 --> 13.1793861 sigma in 12act. ( 11.0222883 sig out 1act.) RANK 9 NODE 1 --> 9.17271233 sigma in 12act. ( 8.80527115 sig out 1act.) RANK 10 NODE 12 --> 7.88213491 sigma in 12act. ( 7.40467644 sig out 1act.) RANK 11 NODE 9 --> 6.97369576 sigma in 12act. ( 6.37408972 sig out 1act.) RANK 12 NODE 7 --> 4.5207963 sigma in 12act. ( 3.91232204 sig out 1act.) RANK 13 NODE 3 --> 4.06749058 sigma in 12act. ( 1.04626596 sig out 1act.) RANK 14 NODE 10 --> 2.99677253 sigma in 12act. ( 1.05858576 sig out 1act.) RANK 15 NODE 15 --> 2.07716322 sigma in 12act. ( 0.772220254 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 44.0089798 sigma out 1act.( 39.8764 sig in 12act.) RANK 2 NODE 11 --> 37.063179 sigma out 1act.( 35.3294716 sig in 12act.) RANK 3 NODE 4 --> 21.0849495 sigma out 1act.( 24.4997768 sig in 12act.) RANK 4 NODE 6 --> 20.5445118 sigma out 1act.( 19.8760376 sig in 12act.) RANK 5 NODE 14 --> 19.8206902 sigma out 1act.( 18.6332951 sig in 12act.) RANK 6 NODE 2 --> 17.022028 sigma out 1act.( 20.6067085 sig in 12act.) RANK 7 NODE 8 --> 13.8957777 sigma out 1act.( 13.3889141 sig in 12act.) RANK 8 NODE 13 --> 11.0222883 sigma out 1act.( 13.1793861 sig in 12act.) RANK 9 NODE 1 --> 8.80527115 sigma out 1act.( 9.17271233 sig in 12act.) RANK 10 NODE 12 --> 7.40467644 sigma out 1act.( 7.88213491 sig in 12act.) RANK 11 NODE 9 --> 6.37408972 sigma out 1act.( 6.97369576 sig in 12act.) RANK 12 NODE 7 --> 3.91232204 sigma out 1act.( 4.5207963 sig in 12act.) RANK 13 NODE 10 --> 1.05858576 sigma out 1act.( 2.99677253 sig in 12act.) RANK 14 NODE 3 --> 1.04626596 sigma out 1act.( 4.06749058 sig in 12act.) RANK 15 NODE 15 --> 0.772220254 sigma out 1act.( 2.07716322 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 73.2490463 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.544593871 *** contribution from regularisation: 0.0031599754 *** contribution from error: -0.54775387 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51076.3684 -0.678441346 29.3544235 EXIT FROM BFGS code NEW_X -51076.3684 -0.678441346 29.3544235 ENTER BFGS code NEW_X -51076.3684 -0.678441346 29.3544235 EXIT FROM BFGS code FG_LNSRCH 0. -0.713987291 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.545339882 *** contribution from regularisation: 0.00300368387 *** contribution from error: -0.548343539 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51146.3372 -0.713987291 -11.1094322 EXIT FROM BFGS code NEW_X -51146.3372 -0.713987291 -11.1094322 ENTER BFGS code NEW_X -51146.3372 -0.713987291 -11.1094322 EXIT FROM BFGS code FG_LNSRCH 0. -0.642905056 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.545628548 *** contribution from regularisation: 0.00286159525 *** contribution from error: -0.548490167 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51173.4099 -0.642905056 -11.7900696 EXIT FROM BFGS code NEW_X -51173.4099 -0.642905056 -11.7900696 ENTER BFGS code NEW_X -51173.4099 -0.642905056 -11.7900696 EXIT FROM BFGS code FG_LNSRCH 0. -0.639992118 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.545710504 *** contribution from regularisation: 0.00293023651 *** contribution from error: -0.548640728 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51181.0952 -0.639992118 -10.2780857 EXIT FROM BFGS code NEW_X -51181.0952 -0.639992118 -10.2780857 ENTER BFGS code NEW_X -51181.0952 -0.639992118 -10.2780857 EXIT FROM BFGS code FG_LNSRCH 0. -0.650590718 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.545945168 *** contribution from regularisation: 0.00289248535 *** contribution from error: -0.548837662 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51203.1051 -0.650590718 9.79912758 EXIT FROM BFGS code NEW_X -51203.1051 -0.650590718 9.79912758 ENTER BFGS code NEW_X -51203.1051 -0.650590718 9.79912758 EXIT FROM BFGS code FG_LNSRCH 0. -0.666279316 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.546326637 *** contribution from regularisation: 0.00292125857 *** contribution from error: -0.549247921 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51238.8806 -0.666279316 -16.5658817 EXIT FROM BFGS code NEW_X -51238.8806 -0.666279316 -16.5658817 ENTER BFGS code NEW_X -51238.8806 -0.666279316 -16.5658817 EXIT FROM BFGS code FG_LNSRCH 0. -0.704239011 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.546515882 *** contribution from regularisation: 0.00311903143 *** contribution from error: -0.549634933 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51256.6317 -0.704239011 93.5780792 EXIT FROM BFGS code NEW_X -51256.6317 -0.704239011 93.5780792 ENTER BFGS code NEW_X -51256.6317 -0.704239011 93.5780792 EXIT FROM BFGS code FG_LNSRCH 0. -0.692470551 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.547012806 *** contribution from regularisation: 0.00310362945 *** contribution from error: -0.55011642 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51303.2361 -0.692470551 18.6924782 EXIT FROM BFGS code NEW_X -51303.2361 -0.692470551 18.6924782 ENTER BFGS code NEW_X -51303.2361 -0.692470551 18.6924782 EXIT FROM BFGS code FG_LNSRCH 0. -0.694494307 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.547130287 *** contribution from regularisation: 0.00312413694 *** contribution from error: -0.550254405 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51314.2568 -0.694494307 -0.978456974 EXIT FROM BFGS code NEW_X -51314.2568 -0.694494307 -0.978456974 ENTER BFGS code NEW_X -51314.2568 -0.694494307 -0.978456974 EXIT FROM BFGS code FG_LNSRCH 0. -0.694512427 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.547220707 *** contribution from regularisation: 0.00312643591 *** contribution from error: -0.550347149 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51322.7351 -0.694512427 -4.55004644 EXIT FROM BFGS code NEW_X -51322.7351 -0.694512427 -4.55004644 ENTER BFGS code NEW_X -51322.7351 -0.694512427 -4.55004644 EXIT FROM BFGS code FG_LNSRCH 0. -0.690090775 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 60.9955139 sigma out 15 active outputs RANK 2 NODE 1 --> 30.3262081 sigma out 15 active outputs RANK 3 NODE 3 --> 26.9754791 sigma out 15 active outputs RANK 4 NODE 2 --> 22.3444386 sigma out 15 active outputs RANK 5 NODE 10 --> 20.5445232 sigma out 15 active outputs RANK 6 NODE 5 --> 19.7785416 sigma out 15 active outputs RANK 7 NODE 8 --> 14.4127283 sigma out 15 active outputs RANK 8 NODE 12 --> 12.237566 sigma out 15 active outputs RANK 9 NODE 7 --> 12.1755905 sigma out 15 active outputs RANK 10 NODE 6 --> 11.6006622 sigma out 15 active outputs RANK 11 NODE 9 --> 7.58506918 sigma out 15 active outputs RANK 12 NODE 4 --> 7.43016481 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 57.1086884 sigma in 12act. ( 59.9127007 sig out 1act.) RANK 2 NODE 5 --> 44.0002632 sigma in 12act. ( 46.1363182 sig out 1act.) RANK 3 NODE 14 --> 24.3520546 sigma in 12act. ( 24.9316578 sig out 1act.) RANK 4 NODE 4 --> 21.3975563 sigma in 12act. ( 22.1415272 sig out 1act.) RANK 5 NODE 2 --> 20.1597309 sigma in 12act. ( 18.6458149 sig out 1act.) RANK 6 NODE 6 --> 18.0906067 sigma in 12act. ( 20.3713074 sig out 1act.) RANK 7 NODE 8 --> 11.231679 sigma in 12act. ( 12.3468618 sig out 1act.) RANK 8 NODE 12 --> 9.72197151 sigma in 12act. ( 10.3332453 sig out 1act.) RANK 9 NODE 1 --> 8.89703274 sigma in 12act. ( 9.52031803 sig out 1act.) RANK 10 NODE 13 --> 7.73640156 sigma in 12act. ( 6.58861256 sig out 1act.) RANK 11 NODE 9 --> 7.3188529 sigma in 12act. ( 7.46855164 sig out 1act.) RANK 12 NODE 7 --> 4.70491457 sigma in 12act. ( 5.05601692 sig out 1act.) RANK 13 NODE 3 --> 3.52108526 sigma in 12act. ( 2.52058697 sig out 1act.) RANK 14 NODE 10 --> 1.50296009 sigma in 12act. ( 0.384702682 sig out 1act.) RANK 15 NODE 15 --> 1.17138159 sigma in 12act. ( 0.525378406 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 59.9127007 sigma out 1act.( 57.1086884 sig in 12act.) RANK 2 NODE 5 --> 46.1363182 sigma out 1act.( 44.0002632 sig in 12act.) RANK 3 NODE 14 --> 24.9316578 sigma out 1act.( 24.3520546 sig in 12act.) RANK 4 NODE 4 --> 22.1415272 sigma out 1act.( 21.3975563 sig in 12act.) RANK 5 NODE 6 --> 20.3713074 sigma out 1act.( 18.0906067 sig in 12act.) RANK 6 NODE 2 --> 18.6458149 sigma out 1act.( 20.1597309 sig in 12act.) RANK 7 NODE 8 --> 12.3468618 sigma out 1act.( 11.231679 sig in 12act.) RANK 8 NODE 12 --> 10.3332453 sigma out 1act.( 9.72197151 sig in 12act.) RANK 9 NODE 1 --> 9.52031803 sigma out 1act.( 8.89703274 sig in 12act.) RANK 10 NODE 9 --> 7.46855164 sigma out 1act.( 7.3188529 sig in 12act.) RANK 11 NODE 13 --> 6.58861256 sigma out 1act.( 7.73640156 sig in 12act.) RANK 12 NODE 7 --> 5.05601692 sigma out 1act.( 4.70491457 sig in 12act.) RANK 13 NODE 3 --> 2.52058697 sigma out 1act.( 3.52108526 sig in 12act.) RANK 14 NODE 15 --> 0.525378406 sigma out 1act.( 1.17138159 sig in 12act.) RANK 15 NODE 10 --> 0.384702682 sigma out 1act.( 1.50296009 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 89.8552704 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.547555983 *** contribution from regularisation: 0.00319482246 *** contribution from error: -0.550750792 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51354.1786 -0.690090775 -10.423708 EXIT FROM BFGS code NEW_X -51354.1786 -0.690090775 -10.423708 ENTER BFGS code NEW_X -51354.1786 -0.690090775 -10.423708 EXIT FROM BFGS code FG_LNSRCH 0. -0.664669275 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.547421992 *** contribution from regularisation: 0.00337944948 *** contribution from error: -0.550801456 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51341.6118 -0.664669275 -53.8292961 EXIT FROM BFGS code FG_LNSRCH 0. -0.679171085 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.547818244 *** contribution from regularisation: 0.00318829436 *** contribution from error: -0.551006556 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51378.7791 -0.679171085 -26.9824562 EXIT FROM BFGS code NEW_X -51378.7791 -0.679171085 -26.9824562 ENTER BFGS code NEW_X -51378.7791 -0.679171085 -26.9824562 EXIT FROM BFGS code FG_LNSRCH 0. -0.672523141 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.547949493 *** contribution from regularisation: 0.00335635268 *** contribution from error: -0.55130583 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51391.0894 -0.672523141 28.5014057 EXIT FROM BFGS code NEW_X -51391.0894 -0.672523141 28.5014057 ENTER BFGS code NEW_X -51391.0894 -0.672523141 28.5014057 EXIT FROM BFGS code FG_LNSRCH 0. -0.668637276 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.548118293 *** contribution from regularisation: 0.00321105449 *** contribution from error: -0.551329374 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51406.9199 -0.668637276 11.5032654 EXIT FROM BFGS code NEW_X -51406.9199 -0.668637276 11.5032654 ENTER BFGS code NEW_X -51406.9199 -0.668637276 11.5032654 EXIT FROM BFGS code FG_LNSRCH 0. -0.655569375 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.548166513 *** contribution from regularisation: 0.00318091875 *** contribution from error: -0.551347435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51411.4411 -0.655569375 -3.73986506 EXIT FROM BFGS code NEW_X -51411.4411 -0.655569375 -3.73986506 ENTER BFGS code NEW_X -51411.4411 -0.655569375 -3.73986506 EXIT FROM BFGS code FG_LNSRCH 0. -0.629464805 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.548147142 *** contribution from regularisation: 0.00312197534 *** contribution from error: -0.551269114 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51409.6267 -0.629464805 9.87883759 EXIT FROM BFGS code FG_LNSRCH 0. -0.647833884 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.547915041 *** contribution from regularisation: 0.00344202248 *** contribution from error: -0.55135709 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51387.8544 -0.647833884 -0.525834322 EXIT FROM BFGS code FG_LNSRCH 0. -0.655250251 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.548034012 *** contribution from regularisation: 0.00331405457 *** contribution from error: -0.55134809 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51399.0145 -0.655250251 -3.80320811 EXIT FROM BFGS code FG_LNSRCH 0. -0.655568123 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.548059642 *** contribution from regularisation: 0.00328776264 *** contribution from error: -0.551347435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51401.4199 -0.655568123 -3.96548271 EXIT FROM BFGS code FG_LNSRCH 0. -0.655569375 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 70.4676361 sigma out 15 active outputs RANK 2 NODE 3 --> 34.4881783 sigma out 15 active outputs RANK 3 NODE 1 --> 33.4252701 sigma out 15 active outputs RANK 4 NODE 2 --> 25.1195755 sigma out 15 active outputs RANK 5 NODE 10 --> 20.7740707 sigma out 15 active outputs RANK 6 NODE 5 --> 18.8792381 sigma out 15 active outputs RANK 7 NODE 8 --> 15.9238052 sigma out 15 active outputs RANK 8 NODE 6 --> 13.8100309 sigma out 15 active outputs RANK 9 NODE 7 --> 13.0228138 sigma out 15 active outputs RANK 10 NODE 12 --> 12.9872723 sigma out 15 active outputs RANK 11 NODE 4 --> 9.00546074 sigma out 15 active outputs RANK 12 NODE 9 --> 7.44579363 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 68.9868698 sigma in 12act. ( 70.3345108 sig out 1act.) RANK 2 NODE 5 --> 48.8980865 sigma in 12act. ( 51.6796074 sig out 1act.) RANK 3 NODE 14 --> 26.4250031 sigma in 12act. ( 29.594408 sig out 1act.) RANK 4 NODE 4 --> 22.8119373 sigma in 12act. ( 24.2380161 sig out 1act.) RANK 5 NODE 2 --> 20.3729458 sigma in 12act. ( 19.8642006 sig out 1act.) RANK 6 NODE 6 --> 18.4006996 sigma in 12act. ( 21.1403732 sig out 1act.) RANK 7 NODE 8 --> 11.8696766 sigma in 12act. ( 13.6439953 sig out 1act.) RANK 8 NODE 12 --> 10.2997656 sigma in 12act. ( 11.7692518 sig out 1act.) RANK 9 NODE 1 --> 9.6776228 sigma in 12act. ( 11.1801138 sig out 1act.) RANK 10 NODE 9 --> 8.15910435 sigma in 12act. ( 8.63634109 sig out 1act.) RANK 11 NODE 13 --> 6.36717939 sigma in 12act. ( 5.95658731 sig out 1act.) RANK 12 NODE 7 --> 5.24833775 sigma in 12act. ( 5.94287872 sig out 1act.) RANK 13 NODE 3 --> 3.30841064 sigma in 12act. ( 2.62016344 sig out 1act.) RANK 14 NODE 10 --> 0.924496055 sigma in 12act. ( 0.266338557 sig out 1act.) RANK 15 NODE 15 --> 0.910518885 sigma in 12act. ( 0.510487854 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 70.3345108 sigma out 1act.( 68.9868698 sig in 12act.) RANK 2 NODE 5 --> 51.6796074 sigma out 1act.( 48.8980865 sig in 12act.) RANK 3 NODE 14 --> 29.594408 sigma out 1act.( 26.4250031 sig in 12act.) RANK 4 NODE 4 --> 24.2380161 sigma out 1act.( 22.8119373 sig in 12act.) RANK 5 NODE 6 --> 21.1403732 sigma out 1act.( 18.4006996 sig in 12act.) RANK 6 NODE 2 --> 19.8642006 sigma out 1act.( 20.3729458 sig in 12act.) RANK 7 NODE 8 --> 13.6439953 sigma out 1act.( 11.8696766 sig in 12act.) RANK 8 NODE 12 --> 11.7692518 sigma out 1act.( 10.2997656 sig in 12act.) RANK 9 NODE 1 --> 11.1801138 sigma out 1act.( 9.6776228 sig in 12act.) RANK 10 NODE 9 --> 8.63634109 sigma out 1act.( 8.15910435 sig in 12act.) RANK 11 NODE 13 --> 5.95658731 sigma out 1act.( 6.36717939 sig in 12act.) RANK 12 NODE 7 --> 5.94287872 sigma out 1act.( 5.24833775 sig in 12act.) RANK 13 NODE 3 --> 2.62016344 sigma out 1act.( 3.30841064 sig in 12act.) RANK 14 NODE 15 --> 0.510487854 sigma out 1act.( 0.910518885 sig in 12act.) RANK 15 NODE 10 --> 0.266338557 sigma out 1act.( 0.924496055 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 102.590393 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.548065066 *** contribution from regularisation: 0.00328235445 *** contribution from error: -0.551347435 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51401.9276 -0.655569375 -3.97000551 EXIT FROM BFGS code FG_LNSRCH 0. -0.655569375 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.548056304 *** contribution from regularisation: 0.00329110166 *** contribution from error: -0.551347435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51401.1073 -0.655569375 -4.11619759 EXIT FROM BFGS code FG_LNSRCH 0. -0.655569375 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.548066795 *** contribution from regularisation: 0.00328066759 *** contribution from error: -0.551347435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51402.0858 -0.655569375 -4.08344221 EXIT FROM BFGS code FG_LNSRCH 0. -0.655569375 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.548070669 *** contribution from regularisation: 0.00327677792 *** contribution from error: -0.551347435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51402.4507 -0.655569375 -4.15932369 EXIT FROM BFGS code NEW_X -51402.4507 -0.655569375 -4.15932369 ENTER BFGS code NEW_X -51402.4507 -0.655569375 -4.15932369 EXIT FROM BFGS code CONVERGENC -51402.4507 -0.655569375 -4.15932369 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 106.179672 sigma out 15 active outputs RANK 2 NODE 3 --> 53.711174 sigma out 15 active outputs RANK 3 NODE 1 --> 52.0754166 sigma out 15 active outputs RANK 4 NODE 2 --> 37.0647926 sigma out 15 active outputs RANK 5 NODE 10 --> 33.1731071 sigma out 15 active outputs RANK 6 NODE 5 --> 28.2663174 sigma out 15 active outputs RANK 7 NODE 8 --> 24.3939209 sigma out 15 active outputs RANK 8 NODE 6 --> 21.09272 sigma out 15 active outputs RANK 9 NODE 7 --> 19.6137772 sigma out 15 active outputs RANK 10 NODE 12 --> 19.3184834 sigma out 15 active outputs RANK 11 NODE 4 --> 14.1150932 sigma out 15 active outputs RANK 12 NODE 9 --> 11.4471092 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 105.132675 sigma in 12act. ( 109.444572 sig out 1act.) RANK 2 NODE 5 --> 74.2356415 sigma in 12act. ( 79.8460617 sig out 1act.) RANK 3 NODE 14 --> 40.8917236 sigma in 12act. ( 45.8712387 sig out 1act.) RANK 4 NODE 4 --> 35.1517677 sigma in 12act. ( 37.403923 sig out 1act.) RANK 5 NODE 2 --> 30.8812847 sigma in 12act. ( 30.8881092 sig out 1act.) RANK 6 NODE 6 --> 27.1499023 sigma in 12act. ( 33.079998 sig out 1act.) RANK 7 NODE 8 --> 18.2185154 sigma in 12act. ( 21.2598267 sig out 1act.) RANK 8 NODE 12 --> 15.7845993 sigma in 12act. ( 18.2143078 sig out 1act.) RANK 9 NODE 1 --> 14.6653061 sigma in 12act. ( 17.3336525 sig out 1act.) RANK 10 NODE 9 --> 12.188303 sigma in 12act. ( 13.1356936 sig out 1act.) RANK 11 NODE 13 --> 9.09789944 sigma in 12act. ( 9.29340553 sig out 1act.) RANK 12 NODE 7 --> 7.77991772 sigma in 12act. ( 9.2735033 sig out 1act.) RANK 13 NODE 3 --> 4.45804024 sigma in 12act. ( 4.09050369 sig out 1act.) RANK 14 NODE 15 --> 1.04482341 sigma in 12act. ( 0.734212995 sig out 1act.) RANK 15 NODE 10 --> 0.96045047 sigma in 12act. ( 0.393799573 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 109.444572 sigma out 1act.( 105.132675 sig in 12act.) RANK 2 NODE 5 --> 79.8460617 sigma out 1act.( 74.2356415 sig in 12act.) RANK 3 NODE 14 --> 45.8712387 sigma out 1act.( 40.8917236 sig in 12act.) RANK 4 NODE 4 --> 37.403923 sigma out 1act.( 35.1517677 sig in 12act.) RANK 5 NODE 6 --> 33.079998 sigma out 1act.( 27.1499023 sig in 12act.) RANK 6 NODE 2 --> 30.8881092 sigma out 1act.( 30.8812847 sig in 12act.) RANK 7 NODE 8 --> 21.2598267 sigma out 1act.( 18.2185154 sig in 12act.) RANK 8 NODE 12 --> 18.2143078 sigma out 1act.( 15.7845993 sig in 12act.) RANK 9 NODE 1 --> 17.3336525 sigma out 1act.( 14.6653061 sig in 12act.) RANK 10 NODE 9 --> 13.1356936 sigma out 1act.( 12.188303 sig in 12act.) RANK 11 NODE 13 --> 9.29340553 sigma out 1act.( 9.09789944 sig in 12act.) RANK 12 NODE 7 --> 9.2735033 sigma out 1act.( 7.77991772 sig in 12act.) RANK 13 NODE 3 --> 4.09050369 sigma out 1act.( 4.45804024 sig in 12act.) RANK 14 NODE 15 --> 0.734212995 sigma out 1act.( 1.04482341 sig in 12act.) RANK 15 NODE 10 --> 0.393799573 sigma out 1act.( 0.96045047 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 159.221954 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.548077643 *** contribution from regularisation: 0.00326977158 *** contribution from error: -0.551347435 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29884 Closing output file done