NNInput NNInputs_130.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 80373 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 21683 nbkg = 58690 Bkg Entries: 58690 Sig Entries: 21683 Chosen entries: 21683 Signal fraction: 1 Background fraction: 0.36945 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 58690 Actual Signal Entries: 21683 Entries to split: 21683 Test with : 10841 Train with : 10841 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 21683 for Signal Prepared event 0 for Signal with 21683 events ====Entry 0 Variable Ht : 164.482 Variable LepAPt : 43.9185 Variable LepBPt : 38.1242 Variable MetSigLeptonsJets : 2.20904 Variable MetSpec : 18.0515 Variable SumEtLeptonsJets : 138.486 Variable VSumJetLeptonsPt : 26.0524 Variable addEt : 108.039 Variable dPhiLepSumMet : 2.46361 Variable dPhiLeptons : 0.170417 Variable dRLeptons : 0.236291 Variable lep1_E : 59.7924 Variable lep2_E : 58.3916 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2130 Ht = 164.482 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 43.9185 LepAPt = 43.9185 LepBEt = 38.1243 LepBPt = 38.1242 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 25.996 MetDelPhi = 0.767583 MetSig = 1.90741 MetSigLeptonsJets = 2.20904 MetSpec = 18.0515 Mjj = 0 MostCentralJetEta = 2.12972 MtllMet = 116.604 Njets = 1 SB = 0 SumEt = 185.747 SumEtJets = 0 SumEtLeptonsJets = 138.486 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 26.0524 addEt = 108.039 dPhiLepSumMet = 2.46361 dPhiLeptons = 0.170417 dRLeptons = 0.236291 diltype = 52 dimass = 9.66991 event = 2127 jet1_Et = 56.4436 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 59.7924 lep2_E = 58.3916 rand = 0.999742 run = 195245 weight = 2.25392e-06 ===Show End Prepared event 10000 for Signal with 21683 events Prepared event 20000 for Signal with 21683 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 58690 for Background Prepared event 0 for Background with 58690 events ====Entry 0 Variable Ht : 65.1543 Variable LepAPt : 20.8407 Variable LepBPt : 10.82 Variable MetSigLeptonsJets : 5.95247 Variable MetSpec : 33.4933 Variable SumEtLeptonsJets : 31.6607 Variable VSumJetLeptonsPt : 31.4507 Variable addEt : 65.1543 Variable dPhiLepSumMet : 3.01433 Variable dPhiLeptons : 0.243032 Variable dRLeptons : 0.763155 Variable lep1_E : 24.0883 Variable lep2_E : 10.9808 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 65.1543 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 20.8411 LepAPt = 20.8407 LepBEt = 10.82 LepBPt = 10.82 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 33.4933 MetDelPhi = 2.93145 MetSig = 3.89076 MetSigLeptonsJets = 5.95247 MetSpec = 33.4933 Mjj = 0 MostCentralJetEta = 0 MtllMet = 67.7985 Njets = 0 SB = 0 SumEt = 74.1048 SumEtJets = 0 SumEtLeptonsJets = 31.6607 Target = 0 TrainWeight = 1.08374 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 31.4507 addEt = 65.1543 dPhiLepSumMet = 3.01433 dPhiLeptons = 0.243032 dRLeptons = 0.763155 diltype = 110 dimass = 11.6846 event = 12144548 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 24.0883 lep2_E = 10.9808 rand = 0.999742 run = 272126 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 58690 events Prepared event 20000 for Background with 58690 events Prepared event 30000 for Background with 58690 events Prepared event 40000 for Background with 58690 events Prepared event 50000 for Background with 58690 events Warning: found 1930 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 80373 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 1930 negative weights. Signal fraction: 63.506382 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 47.1748543 60.3315697 63.2266998 65.333725 66.910202 68.0856628 69.1604233 70.107338 71.1627274 71.9907379 72.7288132 73.5611572 74.0442734 74.5728531 75.2741699 75.8126373 76.4523315 77.0544968 77.4987793 78.1259079 78.7491608 79.4134827 79.9462662 80.7150116 81.4858856 82.1164551 82.7022705 83.5788116 84.4827576 85.4651947 86.4074097 87.4734955 88.6571121 89.9663544 91.0192795 92.1493988 93.1916809 94.5547714 95.7016449 96.9953156 98.1819458 99.2758636 100.402199 101.348534 102.343246 103.314316 104.329468 105.442902 106.626938 107.71373 108.759315 109.722038 110.695396 111.619995 112.670586 113.830055 114.837128 115.915825 116.999435 118.135284 119.225815 120.239532 121.38282 122.461685 123.565422 124.816498 126.003799 127.326462 128.508179 129.645569 130.918167 132.448914 134.083664 135.858719 137.527023 139.345535 141.294037 143.064056 145.271866 147.212372 149.303497 151.58725 153.901367 156.295441 158.783325 161.299225 164.387299 167.563385 171.088409 174.929306 178.568146 183.18219 188.535324 194.4272 201.264175 210.531876 222.325485 236.734421 257.906677 296.893158 803.330627 ------------------------------ Transdef: Tab for variable 3 20.0032291 20.2618828 20.4782906 20.6962757 20.9445992 21.146595 21.3167229 21.5193996 21.7057705 21.8961449 22.0874577 22.2915764 22.4650612 22.6371479 22.8440437 23.0720615 23.2184391 23.3820076 23.5442696 23.6975002 23.8608208 24.065918 24.2584343 24.4665947 24.6622467 24.8514862 25.0685616 25.2473049 25.4064903 25.6409721 25.8339443 26.0174084 26.203125 26.4062347 26.5936508 26.8087044 27.0370598 27.2675323 27.4707718 27.6962471 27.8916512 28.1114407 28.3187542 28.5757751 28.7763596 28.9426727 29.1406116 29.3232994 29.6060257 29.8574028 30.095211 30.3626976 30.5990372 30.8708153 31.1161633 31.4212208 31.703764 31.9466438 32.2295303 32.503685 32.7961121 33.0768814 33.3690414 33.6833458 33.9287643 34.2674942 34.5477295 34.8688354 35.1626472 35.465416 35.8554077 36.2060165 36.5316963 36.940773 37.3268204 37.7557068 38.1584549 38.6241531 39.0943947 39.5485115 40.0335846 40.5007133 41.0196533 41.6168327 42.2503471 42.9028625 43.5413513 44.2639236 45.1541672 46.0851822 47.0264359 48.0878677 49.3803749 50.8144264 52.4181061 54.3361664 56.7989273 60.5282288 64.8002625 73.4919128 161.648132 ------------------------------ Transdef: Tab for variable 4 10.0005541 10.123951 10.225811 10.358036 10.4818277 10.6073799 10.7462635 10.8601103 10.9809513 11.1241379 11.2254639 11.3403778 11.4535189 11.5776396 11.7049122 11.8049259 11.9193773 12.0255966 12.1560516 12.298708 12.4121761 12.583066 12.7168007 12.8371677 12.9688568 13.0835533 13.2288322 13.3913021 13.5385113 13.7078972 13.8856678 14.0270481 14.1224852 14.2576885 14.3811579 14.5389872 14.6865454 14.851778 15.0108891 15.1794262 15.3511257 15.5114574 15.6545162 15.8165989 15.9547968 16.1676559 16.3281403 16.5068703 16.6856689 16.8490372 16.9867058 17.1787109 17.3607407 17.5529137 17.7490959 18.003479 18.193779 18.4229851 18.5885963 18.8251629 19.0248146 19.2196522 19.4163704 19.6301327 19.8981514 20.1023178 20.3134956 20.5113029 20.7254372 20.9377213 21.1826706 21.4152145 21.6452332 21.9366837 22.191021 22.4723396 22.7153435 22.9692516 23.2354336 23.5305824 23.8211708 24.1128235 24.3938179 24.7264805 25.1186638 25.5000343 25.8837166 26.2918911 26.6800575 27.2021065 27.6773586 28.2247162 28.8183632 29.5004921 30.3006172 31.227705 32.3269043 33.8117638 36.2388382 41.0217285 66.0857925 ------------------------------ Transdef: Tab for variable 5 0.978936255 2.03688622 2.43246531 2.70054722 2.93864322 3.11251378 3.29263091 3.44551229 3.61337137 3.72884583 3.86255598 4.01687813 4.13081741 4.24499321 4.35059071 4.44519711 4.5662117 4.63661671 4.72138882 4.78997135 4.87712002 4.96308613 5.0444994 5.11104298 5.16813564 5.23557568 5.30493164 5.36058807 5.42549515 5.45955086 5.50712061 5.54795361 5.59574032 5.63797522 5.68153381 5.71840858 5.7666297 5.80841064 5.85179329 5.89544964 5.93153381 5.97253513 6.01093388 6.0573473 6.09408379 6.130723 6.16992474 6.21535015 6.2576642 6.29746771 6.3351984 6.37386894 6.40889263 6.44111013 6.49019575 6.52609158 6.57226562 6.61572695 6.65893269 6.70105982 6.7355566 6.77197361 6.81116772 6.85685968 6.89779139 6.94394493 6.98596382 7.03189659 7.07402802 7.12308121 7.17260647 7.22323799 7.26227522 7.31148911 7.36106205 7.41105938 7.45790577 7.51275587 7.56733227 7.62446213 7.67836761 7.73678207 7.79130554 7.84480762 7.90478468 7.96827984 8.04094887 8.10619545 8.18083 8.25568867 8.33961582 8.42606354 8.52291775 8.61512375 8.74716187 8.91648197 9.10826302 9.36097336 9.73141766 10.316555 17.7297993 ------------------------------ Transdef: Tab for variable 6 15.0119848 16.8821983 18.628479 20.1063004 21.6878529 23.3403244 24.9360275 25.9729385 27.0450935 27.9806633 28.9685974 29.5520935 30.0904522 30.823431 31.6047325 32.0803452 32.6284714 33.1972046 33.5975342 34.016983 34.3490753 34.6602936 34.972023 35.3715973 35.6706543 36.0563736 36.3932076 36.7662277 37.0851974 37.4495316 37.7268448 38.085186 38.4990768 38.8713913 39.1526756 39.5057602 39.7447014 40.0936127 40.4225616 40.6862793 41.0574837 41.3930511 41.7466202 42.1207047 42.5476456 42.9676819 43.3910217 43.7506676 44.2399979 44.6603889 45.1689224 45.6826897 46.1741714 46.7379189 47.3064499 47.8086128 48.2581177 48.6760178 49.1301537 49.6302719 50.140728 50.6792145 51.1709442 51.6478996 52.1920242 52.7264099 53.2249413 53.7545319 54.2746048 54.8427353 55.438179 55.9372101 56.4634705 56.963913 57.5514412 58.105835 58.7128334 59.3175583 59.9704895 60.5773621 61.1982956 61.8295364 62.5192566 63.191925 63.9129715 64.6274872 65.3450775 66.3284912 67.4097443 68.4919968 69.8875961 71.210022 72.5784912 74.2901306 76.5738831 79.3134003 82.0986557 86.1947632 91.6928711 102.173828 214.54039 ------------------------------ Transdef: Tab for variable 7 30.1797848 32.3574066 33.2528229 33.9168167 34.4942322 35.0233383 35.4271851 35.8328438 36.158123 36.49897 36.8629684 37.1427193 37.5167961 37.8601074 38.142601 38.4657288 38.8140717 39.0874062 39.2934418 39.5237427 39.7012062 40.1061249 40.4477768 40.8472862 41.2146835 41.6253357 42.0615311 42.5062561 42.9636536 43.4631844 44.0526428 44.6741028 45.286026 45.9748917 46.6017265 47.2391548 47.8594589 48.5404129 49.260746 49.9893188 50.5975609 51.2300949 51.8417435 52.5580063 53.2483673 53.8917351 54.567543 55.1482239 55.7302246 56.3196335 56.938652 57.5388565 58.2155304 58.9219513 59.6445541 60.3436203 60.9478989 61.6695404 62.4104729 63.1867523 63.9906387 64.8976898 65.8298035 66.8010406 68.061615 69.1335907 70.3097229 71.5882416 73.0816269 74.1257935 75.358017 76.885643 78.2919922 79.7538605 81.3005981 82.6976624 84.346756 86.1710968 87.8717651 89.6100616 91.5713196 93.5293427 95.8862915 98.110733 100.398163 102.830093 105.929741 108.748543 112.262009 114.945763 118.907379 123.411224 127.413834 132.582733 138.749695 146.438095 156.363098 168.659271 186.706894 216.847092 498.085754 ------------------------------ Transdef: Tab for variable 8 3.10723281 19.5705032 24.0449791 27.022438 29.2793961 30.7176933 31.6855621 32.270443 32.8356628 33.2593994 33.5836487 33.9606018 34.3532257 34.735733 34.9954834 35.3389816 35.6851845 35.9932365 36.204567 36.5381546 36.9062347 37.1392593 37.3625526 37.6917877 37.9468384 38.2537651 38.5053329 38.7441177 39.0077515 39.1875877 39.4203644 39.6440468 39.8616333 40.1526604 40.3792419 40.6807671 40.9906769 41.2962494 41.7238083 42.0570183 42.4209976 42.7660294 43.1604156 43.5993919 44.0412674 44.3962021 44.8654327 45.3200531 45.8292503 46.2393112 46.6883278 47.1420441 47.5863152 47.9791451 48.5377121 48.9933167 49.4361267 49.8702545 50.3490372 50.7325592 51.1050949 51.5539246 52.1169052 52.6178856 53.1572266 53.6184311 54.0552979 54.5066071 54.9394455 55.4470291 55.8706589 56.3835335 56.9325638 57.4468842 57.9446182 58.4434204 58.9988251 59.5612907 60.0844231 60.6762009 61.2615967 61.958992 62.6961517 63.3541145 64.1233521 65.0135345 65.9376984 66.9963837 68.0381546 69.3714752 70.6233826 72.2763443 74.1824265 76.2384796 78.4257889 81.4820557 84.7343903 88.6450806 95.518837 109.330116 326.868286 ------------------------------ Transdef: Tab for variable 9 47.1748543 59.0025635 61.6928329 63.9867477 65.6164856 66.7654724 67.7098694 68.5718536 69.3782883 70.2858963 71.2766266 71.9526901 72.6793976 73.3893585 73.8335953 74.3158112 74.9037323 75.4524231 75.8629303 76.3788147 76.8877792 77.3311615 77.8579559 78.3225479 78.8536835 79.4499817 79.906662 80.4871445 81.1703415 81.7093048 82.2631531 82.7308044 83.3883286 83.9041824 84.7676392 85.4651947 86.2275391 86.9398499 87.8989105 88.749649 89.7157288 90.6226349 91.6034622 92.400589 93.1324005 94.1270905 94.9901123 95.9345245 96.8772736 97.8240509 98.5924835 99.5207214 100.398483 101.279152 102.04187 102.863922 103.614998 104.413162 105.231743 105.921936 106.709549 107.513741 108.314087 109.111679 109.920029 110.704529 111.600388 112.301346 113.036026 113.842209 114.623726 115.375854 116.091484 116.814865 117.601837 118.467697 119.254776 120.061409 121.023575 121.820839 122.536079 123.345619 124.21698 125.19635 126.096771 127.193787 128.267456 129.417297 130.576508 131.920639 133.190048 135.026337 137.007294 139.413681 142.235413 145.758331 149.768906 155.553406 164.551605 183.150696 409.191406 ------------------------------ Transdef: Tab for variable 10 0.0330989063 0.905828238 1.1843574 1.35912716 1.54389203 1.67976403 1.78443217 1.87294662 1.95322907 2.03559375 2.10178828 2.16220856 2.21510601 2.26199079 2.30652761 2.34744167 2.38334656 2.42001557 2.4575057 2.48736334 2.51736116 2.54432225 2.57432818 2.5984714 2.62143064 2.64193344 2.66574192 2.68582487 2.70748758 2.72311163 2.74147129 2.75848126 2.77692223 2.79198122 2.80871582 2.82112122 2.83293843 2.84696436 2.85933471 2.86996222 2.88028622 2.89136195 2.90117788 2.90926814 2.92124128 2.92980218 2.93757772 2.94629526 2.95407152 2.96132231 2.96848178 2.97373271 2.97992182 2.9845469 2.99059868 2.99691916 3.00170207 3.00653076 3.0108099 3.01578236 3.02104735 3.02560759 3.02871609 3.03230906 3.0364604 3.041008 3.04480791 3.04825163 3.05124688 3.05487418 3.0582037 3.06175137 3.06569886 3.06848335 3.07178402 3.07474875 3.07751107 3.08027768 3.08350253 3.08641148 3.08919597 3.09194374 3.09457111 3.09802699 3.10070086 3.10344672 3.10594821 3.10842037 3.11164594 3.11436963 3.11702728 3.11976957 3.12203693 3.12479973 3.12727952 3.12940335 3.13148069 3.13413787 3.13623071 3.13883781 3.1415906 ------------------------------ Transdef: Tab for variable 11 4.69684601E-05 0.00631654263 0.0115291774 0.0170924962 0.0230628252 0.0288863163 0.0363077521 0.0435137749 0.0523056984 0.0593236685 0.0664832592 0.073656559 0.080329895 0.088178888 0.0949283093 0.101271868 0.107298523 0.114269406 0.121932745 0.128361106 0.134705245 0.140892506 0.147405267 0.155612111 0.162781119 0.168664485 0.174269915 0.180844203 0.186348438 0.192109823 0.196454287 0.201904774 0.206376076 0.211458325 0.21709995 0.221146971 0.225963473 0.230135202 0.234606266 0.239189267 0.245613635 0.251781404 0.256504774 0.261559963 0.266298294 0.271463692 0.276370585 0.280858159 0.28625083 0.291553348 0.296766073 0.30232352 0.307725906 0.313157618 0.317650199 0.323398829 0.328088313 0.335325301 0.341563284 0.347716212 0.352864504 0.358641148 0.364284277 0.370582253 0.377236366 0.383931905 0.389556766 0.396006823 0.402044982 0.408749044 0.415941834 0.422790498 0.430240512 0.436328351 0.442404628 0.449666083 0.456736863 0.464001119 0.470946252 0.479757071 0.48836261 0.496251583 0.504731953 0.51417172 0.522638798 0.531575918 0.54208827 0.553394854 0.564204812 0.575890541 0.589225173 0.601702452 0.61459446 0.63152194 0.648079157 0.66937995 0.695773005 0.731109858 0.783023059 0.835573733 1.11914444 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.209588766 0.21659708 0.223452181 0.230294332 0.237211451 0.242376447 0.24952431 0.256092191 0.261773914 0.267390132 0.273197234 0.279312909 0.285673767 0.291605413 0.298538864 0.305017173 0.311109066 0.315942168 0.321668208 0.327864945 0.334030092 0.338663429 0.34475702 0.350620836 0.356481552 0.362256795 0.367256105 0.37270546 0.378663331 0.384853065 0.389774144 0.395314872 0.399915695 0.404701948 0.409360915 0.413594961 0.418001413 0.422482014 0.426262915 0.430988252 0.435351491 0.439766526 0.444225192 0.448415071 0.452715039 0.456628263 0.460931718 0.465070367 0.469040871 0.472803116 0.477247715 0.482650638 0.486682862 0.490626812 0.495481372 0.499583155 0.503834903 0.50896883 0.512872577 0.517330348 0.522471607 0.52770102 0.532845616 0.538043022 0.543122351 0.548819423 0.554871321 0.559653997 0.565628886 0.570327222 0.577261984 0.583837509 0.588813543 0.594453871 0.599504411 0.606203198 0.612627268 0.61962086 0.625034809 0.629616499 0.636598587 0.643773496 0.651164234 0.66039145 0.669062614 0.677976191 0.687352836 0.697899699 0.707025051 0.719883442 0.731849909 0.745329261 0.761566877 0.777861238 0.795187056 0.81591332 0.83477366 0.872151971 0.914934754 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.3359795 21.9226952 22.3794861 22.8680935 23.2429371 23.5510044 23.8139172 24.1388969 24.4734287 24.8595695 25.3366489 25.6074219 25.8581352 26.1423054 26.4214687 26.7351723 27.1091766 27.3838081 27.6930237 27.9642792 28.1933098 28.453083 28.7545319 29.0237827 29.2995281 29.6054859 29.90481 30.154171 30.4014091 30.6585274 30.886879 31.163496 31.4223385 31.7096405 31.9203415 32.1582947 32.4228249 32.7161255 32.9827881 33.2876587 33.6049805 33.8943672 34.1596756 34.4778824 34.7587128 35.0999146 35.3633575 35.6567879 35.9610481 36.2556686 36.5631943 36.87854 37.2067108 37.5759811 37.9174576 38.2412033 38.5334778 38.9378281 39.3376045 39.7164612 40.0659714 40.5022507 40.8964157 41.307766 41.76651 42.2042084 42.7008743 43.1454239 43.6700974 44.1091881 44.6611404 45.1735458 45.67379 46.2492065 46.7799797 47.4175949 47.9871826 48.5712929 49.3596725 50.0715179 50.845787 51.8289299 52.7058792 53.4496536 54.6387215 55.728447 56.7059898 57.8871307 59.39431 60.8045807 62.3228798 64.1927185 66.3362122 69.0586395 72.0075378 75.9031677 79.9102325 86.770874 95.8959961 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0171442 10.589201 10.9829044 11.2665768 11.5788975 11.8366146 12.0719042 12.3349724 12.5672836 12.8076591 13.0155792 13.1724663 13.3707571 13.5985031 13.8044987 14.0128384 14.1759701 14.3491745 14.5375977 14.7274437 14.8875618 15.0680017 15.2417259 15.4111423 15.5903578 15.8390656 16.0386353 16.248785 16.44487 16.6589775 16.8834152 17.0849571 17.3015213 17.4904327 17.6809654 17.8715286 18.0790558 18.3216743 18.5204506 18.6998577 18.9416962 19.124258 19.3052902 19.5216637 19.7707214 20.0035439 20.2247734 20.4748096 20.6837406 20.8925247 21.1143208 21.336647 21.5950966 21.8588295 22.0529804 22.3296928 22.5806389 22.8443031 23.0901699 23.351757 23.6152706 23.8471527 24.135273 24.3482018 24.6096382 24.8613091 25.159647 25.4727364 25.6913719 25.9970665 26.3477097 26.6568298 26.9480743 27.2857323 27.6475525 27.9977989 28.3176918 28.6985321 29.0075798 29.3594093 29.7662868 30.2094193 30.6626492 31.0900326 31.4925728 32.0952988 32.6404343 33.3266678 33.9084473 34.6862068 35.4733772 36.4145508 37.4434662 38.4822845 39.7119942 41.1402359 43.3942261 46.0546417 50.0816574 57.2007294 115.518631 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 58.1 43.3 37.2 10.1 31.7 57.0 40.4 52.1 -32.3 -2.2 -13.8 26.7 21.0 2 58.1 100.0 66.1 52.9 16.7 53.9 94.2 62.4 88.9 -50.6 -15.0 -32.0 47.9 36.1 3 43.3 66.1 100.0 32.9 -4.4 22.6 69.2 45.0 70.0 -21.5 -18.2 -37.1 77.7 20.0 4 37.2 52.9 32.9 100.0 0.7 21.9 54.1 37.7 57.3 -15.2 -18.6 -40.8 24.1 80.4 5 10.1 16.7 -4.4 0.7 100.0 82.5 -11.6 50.2 46.0 31.5 1.7 3.6 -8.4 -2.6 6 31.7 53.9 22.6 21.9 82.5 100.0 30.4 73.4 72.1 0.6 -4.4 -9.5 12.2 12.6 7 57.0 94.2 69.2 54.1 -11.6 30.4 100.0 52.3 75.4 -58.6 -14.4 -32.4 51.7 37.9 8 40.4 62.4 45.0 37.7 50.2 73.4 52.3 100.0 76.6 -6.9 -11.9 -22.3 31.1 25.4 9 52.1 88.9 70.0 57.3 46.0 72.1 75.4 76.6 100.0 -22.3 -17.2 -36.0 51.1 39.9 10 -32.3 -50.6 -21.5 -15.2 31.5 0.6 -58.6 -6.9 -22.3 100.0 3.4 6.9 -15.7 -9.5 11 -2.2 -15.0 -18.2 -18.6 1.7 -4.4 -14.4 -11.9 -17.2 3.4 100.0 52.3 -14.4 -17.8 12 -13.8 -32.0 -37.1 -40.8 3.6 -9.5 -32.4 -22.3 -36.0 6.9 52.3 100.0 -23.6 -23.9 13 26.7 47.9 77.7 24.1 -8.4 12.2 51.7 31.1 51.1 -15.7 -14.4 -23.6 100.0 36.9 14 21.0 36.1 20.0 80.4 -2.6 12.6 37.9 25.4 39.9 -9.5 -17.8 -23.9 36.9 100.0 TOTAL CORRELATION TO TARGET (diagonal) 133.09813 TOTAL CORRELATION OF ALL VARIABLES 63.08567 ROUND 1: MAX CORR ( 63.0769704) AFTER KILLING INPUT VARIABLE 6 CONTR 1.04764639 ROUND 2: MAX CORR ( 63.0046553) AFTER KILLING INPUT VARIABLE 13 CONTR 3.01953658 ROUND 3: MAX CORR ( 62.9324105) AFTER KILLING INPUT VARIABLE 11 CONTR 3.01633902 ROUND 4: MAX CORR ( 62.8391299) AFTER KILLING INPUT VARIABLE 7 CONTR 3.4252075 ROUND 5: MAX CORR ( 62.3612183) AFTER KILLING INPUT VARIABLE 10 CONTR 7.73528934 ROUND 6: MAX CORR ( 61.9016983) AFTER KILLING INPUT VARIABLE 8 CONTR 7.55653978 ROUND 7: MAX CORR ( 61.1342808) AFTER KILLING INPUT VARIABLE 12 CONTR 9.71699344 ROUND 8: MAX CORR ( 60.5484519) AFTER KILLING INPUT VARIABLE 14 CONTR 8.44305978 ROUND 9: MAX CORR ( 59.0716904) AFTER KILLING INPUT VARIABLE 5 CONTR 13.2909905 ROUND 10: MAX CORR ( 58.9606189) AFTER KILLING INPUT VARIABLE 9 CONTR 3.62077639 ROUND 11: MAX CORR ( 58.5643811) AFTER KILLING INPUT VARIABLE 3 CONTR 6.82406426 ROUND 12: MAX CORR ( 58.0638022) AFTER KILLING INPUT VARIABLE 4 CONTR 7.64078533 LAST REMAINING VARIABLE: 2 total correlation to target: 63.08567 % total significance: 82.4587793 sigma correlations of single variables to target: variable 2: 58.0638022 % , in sigma: 75.8947357 variable 3: 43.3028806 % , in sigma: 56.600852 variable 4: 37.1763657 % , in sigma: 48.592933 variable 5: 10.1249324 % , in sigma: 13.2342189 variable 6: 31.6673266 % , in sigma: 41.3921116 variable 7: 56.9594472 % , in sigma: 74.451242 variable 8: 40.4007688 % , in sigma: 52.8075247 variable 9: 52.093928 % , in sigma: 68.0915604 variable 10: -32.3253533 % , in sigma: 42.2522132 variable 11: -2.17153553 % , in sigma: 2.83839688 variable 12: -13.8123933 % , in sigma: 18.0540698 variable 13: 26.6618694 % , in sigma: 34.8495181 variable 14: 20.9640634 % , in sigma: 27.4019611 variables sorted by significance: 1 most relevant variable 2 corr 58.0638008 , in sigma: 75.8947339 2 most relevant variable 4 corr 7.64078522 , in sigma: 9.9872098 3 most relevant variable 3 corr 6.82406425 , in sigma: 8.91968031 4 most relevant variable 9 corr 3.62077641 , in sigma: 4.73268816 5 most relevant variable 5 corr 13.2909908 , in sigma: 17.3725488 6 most relevant variable 14 corr 8.44305992 , in sigma: 11.0358567 7 most relevant variable 12 corr 9.71699333 , in sigma: 12.701005 8 most relevant variable 8 corr 7.55654001 , in sigma: 9.87709357 9 most relevant variable 10 corr 7.73528957 , in sigma: 10.1107357 10 most relevant variable 7 corr 3.42520738 , in sigma: 4.47706142 11 most relevant variable 11 corr 3.01633906 , in sigma: 3.94263289 12 most relevant variable 13 corr 3.0195365 , in sigma: 3.94681222 13 most relevant variable 6 corr 1.0476464 , in sigma: 1.36937031 global correlations between input variables: variable 2: 99.1123202 % variable 3: 93.7893015 % variable 4: 91.963582 % variable 5: 94.8223016 % variable 6: 93.4783155 % variable 7: 98.6870799 % variable 8: 85.7514953 % variable 9: 98.6461618 % variable 10: 73.0503411 % variable 11: 54.4201169 % variable 12: 66.4301095 % variable 13: 86.7416393 % variable 14: 88.8005441 % significance loss when removing single variables: variable 2: corr = 6.4909171 % , sigma = 8.4842263 variable 3: corr = 13.6513697 % , sigma = 17.8435971 variable 4: corr = 14.3944035 % , sigma = 18.8148107 variable 5: corr = 11.5602692 % , sigma = 15.1103362 variable 6: corr = 1.04764639 % , sigma = 1.3693703 variable 7: corr = 3.12122426 % , sigma = 4.07972749 variable 8: corr = 5.70205468 % , sigma = 7.45311049 variable 9: corr = 11.2494204 % , sigma = 14.7040282 variable 10: corr = 7.54281258 % , sigma = 9.85915055 variable 11: corr = 3.16446601 % , sigma = 4.13624845 variable 12: corr = 6.22639065 % , sigma = 8.13846587 variable 13: corr = 3.02226701 % , sigma = 3.95038125 variable 14: corr = 5.34078512 % , sigma = 6.9808979 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 8 --> 15.0868826 sigma out 15 active outputs RANK 2 NODE 6 --> 14.355587 sigma out 15 active outputs RANK 3 NODE 7 --> 14.1448174 sigma out 15 active outputs RANK 4 NODE 4 --> 12.4882088 sigma out 15 active outputs RANK 5 NODE 11 --> 11.5551949 sigma out 15 active outputs RANK 6 NODE 2 --> 11.3938608 sigma out 15 active outputs RANK 7 NODE 10 --> 10.1287174 sigma out 15 active outputs RANK 8 NODE 9 --> 10.0340805 sigma out 15 active outputs RANK 9 NODE 1 --> 9.82497692 sigma out 15 active outputs RANK 10 NODE 5 --> 8.77375126 sigma out 15 active outputs RANK 11 NODE 3 --> 7.08875895 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 22.4898548 sigma in 11act. ( 22.3268471 sig out 1act.) RANK 2 NODE 3 --> 18.4931316 sigma in 11act. ( 19.3037663 sig out 1act.) RANK 3 NODE 14 --> 13.0648451 sigma in 11act. ( 14.1001387 sig out 1act.) RANK 4 NODE 2 --> 10.8785934 sigma in 11act. ( 10.2549143 sig out 1act.) RANK 5 NODE 1 --> 10.4893513 sigma in 11act. ( 9.93614864 sig out 1act.) RANK 6 NODE 7 --> 9.12765217 sigma in 11act. ( 8.75685692 sig out 1act.) RANK 7 NODE 10 --> 7.251019 sigma in 11act. ( 7.5524807 sig out 1act.) RANK 8 NODE 8 --> 5.23183918 sigma in 11act. ( 5.14233875 sig out 1act.) RANK 9 NODE 5 --> 5.2052207 sigma in 11act. ( 4.57076502 sig out 1act.) RANK 10 NODE 15 --> 4.02487373 sigma in 11act. ( 4.67135668 sig out 1act.) RANK 11 NODE 4 --> 3.83348608 sigma in 11act. ( 3.78219938 sig out 1act.) RANK 12 NODE 9 --> 3.01413727 sigma in 11act. ( 4.1009388 sig out 1act.) RANK 13 NODE 12 --> 1.19770801 sigma in 11act. ( 0.792583644 sig out 1act.) RANK 14 NODE 11 --> 1.00154328 sigma in 11act. ( 0.54151547 sig out 1act.) RANK 15 NODE 13 --> 0.69151777 sigma in 11act. ( 0.392586768 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 22.3268471 sigma out 1act.( 22.4898548 sig in 11act.) RANK 2 NODE 3 --> 19.3037663 sigma out 1act.( 18.4931316 sig in 11act.) RANK 3 NODE 14 --> 14.1001387 sigma out 1act.( 13.0648451 sig in 11act.) RANK 4 NODE 2 --> 10.2549143 sigma out 1act.( 10.8785934 sig in 11act.) RANK 5 NODE 1 --> 9.93614864 sigma out 1act.( 10.4893513 sig in 11act.) RANK 6 NODE 7 --> 8.75685692 sigma out 1act.( 9.12765217 sig in 11act.) RANK 7 NODE 10 --> 7.5524807 sigma out 1act.( 7.251019 sig in 11act.) RANK 8 NODE 8 --> 5.14233875 sigma out 1act.( 5.23183918 sig in 11act.) RANK 9 NODE 15 --> 4.67135668 sigma out 1act.( 4.02487373 sig in 11act.) RANK 10 NODE 5 --> 4.57076502 sigma out 1act.( 5.2052207 sig in 11act.) RANK 11 NODE 9 --> 4.1009388 sigma out 1act.( 3.01413727 sig in 11act.) RANK 12 NODE 4 --> 3.78219938 sigma out 1act.( 3.83348608 sig in 11act.) RANK 13 NODE 12 --> 0.792583644 sigma out 1act.( 1.19770801 sig in 11act.) RANK 14 NODE 11 --> 0.54151547 sigma out 1act.( 1.00154328 sig in 11act.) RANK 15 NODE 13 --> 0.392586768 sigma out 1act.( 0.69151777 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.844635 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 20.2525578 sigma out 15 active outputs RANK 2 NODE 8 --> 16.246706 sigma out 15 active outputs RANK 3 NODE 7 --> 14.3796377 sigma out 15 active outputs RANK 4 NODE 6 --> 13.9757013 sigma out 15 active outputs RANK 5 NODE 4 --> 12.492362 sigma out 15 active outputs RANK 6 NODE 2 --> 12.4143534 sigma out 15 active outputs RANK 7 NODE 1 --> 12.0432177 sigma out 15 active outputs RANK 8 NODE 10 --> 11.4719124 sigma out 15 active outputs RANK 9 NODE 5 --> 11.2947855 sigma out 15 active outputs RANK 10 NODE 9 --> 10.614871 sigma out 15 active outputs RANK 11 NODE 3 --> 8.08154488 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 20.7025013 sigma in 11act. ( 20.3330822 sig out 1act.) RANK 2 NODE 3 --> 20.3333511 sigma in 11act. ( 18.5120945 sig out 1act.) RANK 3 NODE 14 --> 14.1457253 sigma in 11act. ( 13.6357298 sig out 1act.) RANK 4 NODE 1 --> 12.0582695 sigma in 11act. ( 9.15571404 sig out 1act.) RANK 5 NODE 2 --> 11.115181 sigma in 11act. ( 9.41464996 sig out 1act.) RANK 6 NODE 9 --> 10.1436224 sigma in 11act. ( 5.32378817 sig out 1act.) RANK 7 NODE 12 --> 9.16350174 sigma in 11act. ( 3.00968266 sig out 1act.) RANK 8 NODE 10 --> 9.01328659 sigma in 11act. ( 7.58390999 sig out 1act.) RANK 9 NODE 7 --> 8.93477058 sigma in 11act. ( 7.25804234 sig out 1act.) RANK 10 NODE 11 --> 8.75660038 sigma in 11act. ( 2.9225781 sig out 1act.) RANK 11 NODE 15 --> 8.08386421 sigma in 11act. ( 5.67053318 sig out 1act.) RANK 12 NODE 13 --> 7.6247468 sigma in 11act. ( 2.04079819 sig out 1act.) RANK 13 NODE 4 --> 7.08108234 sigma in 11act. ( 3.91363358 sig out 1act.) RANK 14 NODE 8 --> 5.60672903 sigma in 11act. ( 4.70153427 sig out 1act.) RANK 15 NODE 5 --> 5.27553797 sigma in 11act. ( 3.46772885 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 20.3330822 sigma out 1act.( 20.7025013 sig in 11act.) RANK 2 NODE 3 --> 18.5120945 sigma out 1act.( 20.3333511 sig in 11act.) RANK 3 NODE 14 --> 13.6357298 sigma out 1act.( 14.1457253 sig in 11act.) RANK 4 NODE 2 --> 9.41464996 sigma out 1act.( 11.115181 sig in 11act.) RANK 5 NODE 1 --> 9.15571404 sigma out 1act.( 12.0582695 sig in 11act.) RANK 6 NODE 10 --> 7.58390999 sigma out 1act.( 9.01328659 sig in 11act.) RANK 7 NODE 7 --> 7.25804234 sigma out 1act.( 8.93477058 sig in 11act.) RANK 8 NODE 15 --> 5.67053318 sigma out 1act.( 8.08386421 sig in 11act.) RANK 9 NODE 9 --> 5.32378817 sigma out 1act.( 10.1436224 sig in 11act.) RANK 10 NODE 8 --> 4.70153427 sigma out 1act.( 5.60672903 sig in 11act.) RANK 11 NODE 4 --> 3.91363358 sigma out 1act.( 7.08108234 sig in 11act.) RANK 12 NODE 5 --> 3.46772885 sigma out 1act.( 5.27553797 sig in 11act.) RANK 13 NODE 12 --> 3.00968266 sigma out 1act.( 9.16350174 sig in 11act.) RANK 14 NODE 11 --> 2.9225781 sigma out 1act.( 8.75660038 sig in 11act.) RANK 15 NODE 13 --> 2.04079819 sigma out 1act.( 7.6247468 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 36.8297577 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.397054464 *** contribution from regularisation: 0.00969171338 *** contribution from error: -0.406746179 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.454742342 *** contribution from regularisation: 0.00467766961 *** contribution from error: -0.459420025 *********************************************** -----------------> Test sample ENTER BFGS code START -18278.2942 0.338041067 0.389539927 EXIT FROM BFGS code FG_START 0. 0.338041067 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.477510124 *** contribution from regularisation: 0.00427548075 *** contribution from error: -0.481785595 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -19189.2218 0.338041067 90.0079727 EXIT FROM BFGS code FG_LNSRCH 0. 0.37025848 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.504396498 *** contribution from regularisation: 0.0060512363 *** contribution from error: -0.510447741 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20269.6777 0.37025848 20.4864388 EXIT FROM BFGS code NEW_X -20269.6777 0.37025848 20.4864388 ENTER BFGS code NEW_X -20269.6777 0.37025848 20.4864388 EXIT FROM BFGS code FG_LNSRCH 0. 0.374880612 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.507885396 *** contribution from regularisation: 0.00592252333 *** contribution from error: -0.513807893 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20409.8833 0.374880612 15.8930578 EXIT FROM BFGS code NEW_X -20409.8833 0.374880612 15.8930578 ENTER BFGS code NEW_X -20409.8833 0.374880612 15.8930578 EXIT FROM BFGS code FG_LNSRCH 0. 0.383984089 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.509644151 *** contribution from regularisation: 0.00589063019 *** contribution from error: -0.515534759 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20480.5595 0.383984089 8.2825861 EXIT FROM BFGS code NEW_X -20480.5595 0.383984089 8.2825861 ENTER BFGS code NEW_X -20480.5595 0.383984089 8.2825861 EXIT FROM BFGS code FG_LNSRCH 0. 0.398376852 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.510852695 *** contribution from regularisation: 0.00583465584 *** contribution from error: -0.516687334 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20529.1273 0.398376852 -11.7630844 EXIT FROM BFGS code NEW_X -20529.1273 0.398376852 -11.7630844 ENTER BFGS code NEW_X -20529.1273 0.398376852 -11.7630844 EXIT FROM BFGS code FG_LNSRCH 0. 0.390999168 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.511640787 *** contribution from regularisation: 0.00565009657 *** contribution from error: -0.51729089 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20560.796 0.390999168 -11.9021006 EXIT FROM BFGS code NEW_X -20560.796 0.390999168 -11.9021006 ENTER BFGS code NEW_X -20560.796 0.390999168 -11.9021006 EXIT FROM BFGS code FG_LNSRCH 0. 0.35183993 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.51313591 *** contribution from regularisation: 0.00540685374 *** contribution from error: -0.518542767 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20620.8798 0.35183993 -9.84113026 EXIT FROM BFGS code NEW_X -20620.8798 0.35183993 -9.84113026 ENTER BFGS code NEW_X -20620.8798 0.35183993 -9.84113026 EXIT FROM BFGS code FG_LNSRCH 0. 0.321492463 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 28.6838188 sigma out 15 active outputs RANK 2 NODE 1 --> 16.2022648 sigma out 15 active outputs RANK 3 NODE 6 --> 12.7136974 sigma out 15 active outputs RANK 4 NODE 7 --> 10.2620974 sigma out 15 active outputs RANK 5 NODE 8 --> 8.92321968 sigma out 15 active outputs RANK 6 NODE 5 --> 8.62553596 sigma out 15 active outputs RANK 7 NODE 10 --> 7.04516697 sigma out 15 active outputs RANK 8 NODE 2 --> 6.9216156 sigma out 15 active outputs RANK 9 NODE 4 --> 6.5614562 sigma out 15 active outputs RANK 10 NODE 3 --> 5.94856548 sigma out 15 active outputs RANK 11 NODE 9 --> 4.84955931 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 21.3228893 sigma in 11act. ( 21.8683586 sig out 1act.) RANK 2 NODE 11 --> 19.2176723 sigma in 11act. ( 18.6833591 sig out 1act.) RANK 3 NODE 9 --> 12.5383854 sigma in 11act. ( 10.9468842 sig out 1act.) RANK 4 NODE 14 --> 11.3259268 sigma in 11act. ( 8.48836231 sig out 1act.) RANK 5 NODE 13 --> 11.0762157 sigma in 11act. ( 9.69483185 sig out 1act.) RANK 6 NODE 15 --> 10.0774689 sigma in 11act. ( 8.52679348 sig out 1act.) RANK 7 NODE 3 --> 9.87590313 sigma in 11act. ( 7.2154007 sig out 1act.) RANK 8 NODE 6 --> 9.35633564 sigma in 11act. ( 8.5215807 sig out 1act.) RANK 9 NODE 7 --> 6.9264679 sigma in 11act. ( 6.55729198 sig out 1act.) RANK 10 NODE 10 --> 6.23124218 sigma in 11act. ( 4.73654938 sig out 1act.) RANK 11 NODE 1 --> 5.32816696 sigma in 11act. ( 2.17305064 sig out 1act.) RANK 12 NODE 2 --> 5.26482534 sigma in 11act. ( 3.44579816 sig out 1act.) RANK 13 NODE 8 --> 4.88639641 sigma in 11act. ( 3.69103432 sig out 1act.) RANK 14 NODE 4 --> 3.71557736 sigma in 11act. ( 0.363543451 sig out 1act.) RANK 15 NODE 5 --> 2.52341962 sigma in 11act. ( 0.878185451 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 21.8683586 sigma out 1act.( 21.3228893 sig in 11act.) RANK 2 NODE 11 --> 18.6833591 sigma out 1act.( 19.2176723 sig in 11act.) RANK 3 NODE 9 --> 10.9468842 sigma out 1act.( 12.5383854 sig in 11act.) RANK 4 NODE 13 --> 9.69483185 sigma out 1act.( 11.0762157 sig in 11act.) RANK 5 NODE 15 --> 8.52679348 sigma out 1act.( 10.0774689 sig in 11act.) RANK 6 NODE 6 --> 8.5215807 sigma out 1act.( 9.35633564 sig in 11act.) RANK 7 NODE 14 --> 8.48836231 sigma out 1act.( 11.3259268 sig in 11act.) RANK 8 NODE 3 --> 7.2154007 sigma out 1act.( 9.87590313 sig in 11act.) RANK 9 NODE 7 --> 6.55729198 sigma out 1act.( 6.9264679 sig in 11act.) RANK 10 NODE 10 --> 4.73654938 sigma out 1act.( 6.23124218 sig in 11act.) RANK 11 NODE 8 --> 3.69103432 sigma out 1act.( 4.88639641 sig in 11act.) RANK 12 NODE 2 --> 3.44579816 sigma out 1act.( 5.26482534 sig in 11act.) RANK 13 NODE 1 --> 2.17305064 sigma out 1act.( 5.32816696 sig in 11act.) RANK 14 NODE 5 --> 0.878185451 sigma out 1act.( 2.52341962 sig in 11act.) RANK 15 NODE 4 --> 0.363543451 sigma out 1act.( 3.71557736 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 37.5114746 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.513843834 *** contribution from regularisation: 0.00552440668 *** contribution from error: -0.519368231 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -20649.3273 0.321492463 -8.08124352 EXIT FROM BFGS code NEW_X -20649.3273 0.321492463 -8.08124352 ENTER BFGS code NEW_X -20649.3273 0.321492463 -8.08124352 EXIT FROM BFGS code FG_LNSRCH 0. 0.164670199 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.516172767 *** contribution from regularisation: 0.00608437182 *** contribution from error: -0.522257149 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20742.918 0.164670199 -5.66793156 EXIT FROM BFGS code NEW_X -20742.918 0.164670199 -5.66793156 ENTER BFGS code NEW_X -20742.918 0.164670199 -5.66793156 EXIT FROM BFGS code FG_LNSRCH 0. 0.110405982 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.513936102 *** contribution from regularisation: 0.00597684272 *** contribution from error: -0.519912958 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20653.0351 0.110405982 36.4437675 EXIT FROM BFGS code FG_LNSRCH 0. 0.145776466 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.517546833 *** contribution from regularisation: 0.0057960269 *** contribution from error: -0.523342848 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20798.1367 0.145776466 6.13014507 EXIT FROM BFGS code NEW_X -20798.1367 0.145776466 6.13014507 ENTER BFGS code NEW_X -20798.1367 0.145776466 6.13014507 EXIT FROM BFGS code FG_LNSRCH 0. 0.16589883 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.517803192 *** contribution from regularisation: 0.00564701576 *** contribution from error: -0.523450196 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20808.44 0.16589883 0.769766688 EXIT FROM BFGS code NEW_X -20808.44 0.16589883 0.769766688 ENTER BFGS code NEW_X -20808.44 0.16589883 0.769766688 EXIT FROM BFGS code FG_LNSRCH 0. 0.167907432 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.518022239 *** contribution from regularisation: 0.00566809671 *** contribution from error: -0.523690343 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20817.241 0.167907432 -0.327080995 EXIT FROM BFGS code NEW_X -20817.241 0.167907432 -0.327080995 ENTER BFGS code NEW_X -20817.241 0.167907432 -0.327080995 EXIT FROM BFGS code FG_LNSRCH 0. 0.167866215 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.518643796 *** contribution from regularisation: 0.00548860477 *** contribution from error: -0.524132431 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20842.2191 0.167866215 -1.22764182 EXIT FROM BFGS code NEW_X -20842.2191 0.167866215 -1.22764182 ENTER BFGS code NEW_X -20842.2191 0.167866215 -1.22764182 EXIT FROM BFGS code FG_LNSRCH 0. 0.161370084 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.519005716 *** contribution from regularisation: 0.00574690895 *** contribution from error: -0.524752617 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20856.7638 0.161370084 -12.2190886 EXIT FROM BFGS code NEW_X -20856.7638 0.161370084 -12.2190886 ENTER BFGS code NEW_X -20856.7638 0.161370084 -12.2190886 EXIT FROM BFGS code FG_LNSRCH 0. 0.14346616 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.519216597 *** contribution from regularisation: 0.00605968758 *** contribution from error: -0.525276303 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20865.238 0.14346616 3.86891866 EXIT FROM BFGS code NEW_X -20865.238 0.14346616 3.86891866 ENTER BFGS code NEW_X -20865.238 0.14346616 3.86891866 EXIT FROM BFGS code FG_LNSRCH 0. 0.141032785 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.519772291 *** contribution from regularisation: 0.00615405012 *** contribution from error: -0.525926352 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20887.5682 0.141032785 3.23880506 EXIT FROM BFGS code NEW_X -20887.5682 0.141032785 3.23880506 ENTER BFGS code NEW_X -20887.5682 0.141032785 3.23880506 EXIT FROM BFGS code FG_LNSRCH 0. 0.139703766 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 38.1059685 sigma out 15 active outputs RANK 2 NODE 6 --> 28.3343735 sigma out 15 active outputs RANK 3 NODE 1 --> 16.403738 sigma out 15 active outputs RANK 4 NODE 10 --> 12.3300943 sigma out 15 active outputs RANK 5 NODE 5 --> 8.87122059 sigma out 15 active outputs RANK 6 NODE 2 --> 7.77032232 sigma out 15 active outputs RANK 7 NODE 7 --> 7.7246027 sigma out 15 active outputs RANK 8 NODE 8 --> 7.64931726 sigma out 15 active outputs RANK 9 NODE 9 --> 7.55298662 sigma out 15 active outputs RANK 10 NODE 3 --> 7.26249933 sigma out 15 active outputs RANK 11 NODE 4 --> 5.60170269 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 38.1702347 sigma in 11act. ( 50.3242569 sig out 1act.) RANK 2 NODE 11 --> 26.0221519 sigma in 11act. ( 31.5716057 sig out 1act.) RANK 3 NODE 7 --> 14.9411068 sigma in 11act. ( 15.435812 sig out 1act.) RANK 4 NODE 14 --> 14.201972 sigma in 11act. ( 15.8404627 sig out 1act.) RANK 5 NODE 15 --> 11.9499826 sigma in 11act. ( 12.4408159 sig out 1act.) RANK 6 NODE 9 --> 10.0825281 sigma in 11act. ( 9.11110592 sig out 1act.) RANK 7 NODE 6 --> 8.63083267 sigma in 11act. ( 7.96045589 sig out 1act.) RANK 8 NODE 8 --> 8.22978878 sigma in 11act. ( 9.10953712 sig out 1act.) RANK 9 NODE 13 --> 7.45159578 sigma in 11act. ( 5.47995901 sig out 1act.) RANK 10 NODE 3 --> 4.89043856 sigma in 11act. ( 3.92321181 sig out 1act.) RANK 11 NODE 2 --> 4.63349247 sigma in 11act. ( 4.58091545 sig out 1act.) RANK 12 NODE 5 --> 3.3749249 sigma in 11act. ( 3.3799057 sig out 1act.) RANK 13 NODE 4 --> 2.84960938 sigma in 11act. ( 2.0773046 sig out 1act.) RANK 14 NODE 10 --> 2.08056712 sigma in 11act. ( 0.296571255 sig out 1act.) RANK 15 NODE 1 --> 1.99021327 sigma in 11act. ( 0.312835366 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 50.3242569 sigma out 1act.( 38.1702347 sig in 11act.) RANK 2 NODE 11 --> 31.5716057 sigma out 1act.( 26.0221519 sig in 11act.) RANK 3 NODE 14 --> 15.8404627 sigma out 1act.( 14.201972 sig in 11act.) RANK 4 NODE 7 --> 15.435812 sigma out 1act.( 14.9411068 sig in 11act.) RANK 5 NODE 15 --> 12.4408159 sigma out 1act.( 11.9499826 sig in 11act.) RANK 6 NODE 9 --> 9.11110592 sigma out 1act.( 10.0825281 sig in 11act.) RANK 7 NODE 8 --> 9.10953712 sigma out 1act.( 8.22978878 sig in 11act.) RANK 8 NODE 6 --> 7.96045589 sigma out 1act.( 8.63083267 sig in 11act.) RANK 9 NODE 13 --> 5.47995901 sigma out 1act.( 7.45159578 sig in 11act.) RANK 10 NODE 2 --> 4.58091545 sigma out 1act.( 4.63349247 sig in 11act.) RANK 11 NODE 3 --> 3.92321181 sigma out 1act.( 4.89043856 sig in 11act.) RANK 12 NODE 5 --> 3.3799057 sigma out 1act.( 3.3749249 sig in 11act.) RANK 13 NODE 4 --> 2.0773046 sigma out 1act.( 2.84960938 sig in 11act.) RANK 14 NODE 1 --> 0.312835366 sigma out 1act.( 1.99021327 sig in 11act.) RANK 15 NODE 10 --> 0.296571255 sigma out 1act.( 2.08056712 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.96978 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.520007312 *** contribution from regularisation: 0.00607832475 *** contribution from error: -0.526085615 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -20897.0137 0.139703766 -5.69627714 EXIT FROM BFGS code NEW_X -20897.0137 0.139703766 -5.69627714 ENTER BFGS code NEW_X -20897.0137 0.139703766 -5.69627714 EXIT FROM BFGS code FG_LNSRCH 0. 0.123627163 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.520296931 *** contribution from regularisation: 0.00612096349 *** contribution from error: -0.526417911 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20908.6517 0.123627163 -16.1668663 EXIT FROM BFGS code NEW_X -20908.6517 0.123627163 -16.1668663 ENTER BFGS code NEW_X -20908.6517 0.123627163 -16.1668663 EXIT FROM BFGS code FG_LNSRCH 0. 0.0966344699 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.520568371 *** contribution from regularisation: 0.00622757291 *** contribution from error: -0.526795924 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20919.5614 0.0966344699 -29.8869019 EXIT FROM BFGS code NEW_X -20919.5614 0.0966344699 -29.8869019 ENTER BFGS code NEW_X -20919.5614 0.0966344699 -29.8869019 EXIT FROM BFGS code FG_LNSRCH 0. 0.0517862402 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.520846128 *** contribution from regularisation: 0.00631424272 *** contribution from error: -0.527160347 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20930.7232 0.0517862402 4.82211876 EXIT FROM BFGS code NEW_X -20930.7232 0.0517862402 4.82211876 ENTER BFGS code NEW_X -20930.7232 0.0517862402 4.82211876 EXIT FROM BFGS code FG_LNSRCH 0. 0.0446122922 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.520979822 *** contribution from regularisation: 0.00628770748 *** contribution from error: -0.527267516 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20936.0953 0.0446122922 7.18395185 EXIT FROM BFGS code NEW_X -20936.0953 0.0446122922 7.18395185 ENTER BFGS code NEW_X -20936.0953 0.0446122922 7.18395185 EXIT FROM BFGS code FG_LNSRCH 0. 0.0336509906 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.521131814 *** contribution from regularisation: 0.00580960093 *** contribution from error: -0.526941419 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20942.2038 0.0336509906 -5.72321892 EXIT FROM BFGS code NEW_X -20942.2038 0.0336509906 -5.72321892 ENTER BFGS code NEW_X -20942.2038 0.0336509906 -5.72321892 EXIT FROM BFGS code FG_LNSRCH 0. 0.0464022718 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.520388305 *** contribution from regularisation: 0.00602895347 *** contribution from error: -0.526417255 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20912.3255 0.0464022718 40.1175995 EXIT FROM BFGS code FG_LNSRCH 0. 0.0350538902 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.520169258 *** contribution from regularisation: 0.00676925993 *** contribution from error: -0.526938498 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20903.5229 0.0350538902 -0.155691534 EXIT FROM BFGS code FG_LNSRCH 0. 0.0336660556 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.520556986 *** contribution from regularisation: 0.00638446491 *** contribution from error: -0.526941478 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20919.1022 0.0336660556 -5.6387248 EXIT FROM BFGS code FG_LNSRCH 0. 0.0336509943 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.520556033 *** contribution from regularisation: 0.00638538832 *** contribution from error: -0.526941419 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20919.0652 0.0336509943 -5.68030119 EXIT FROM BFGS code FG_LNSRCH 0. 0.0336509906 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 52.4522858 sigma out 15 active outputs RANK 2 NODE 6 --> 33.961132 sigma out 15 active outputs RANK 3 NODE 1 --> 24.9685688 sigma out 15 active outputs RANK 4 NODE 5 --> 12.9719706 sigma out 15 active outputs RANK 5 NODE 10 --> 11.8154068 sigma out 15 active outputs RANK 6 NODE 8 --> 11.4654903 sigma out 15 active outputs RANK 7 NODE 3 --> 11.3328638 sigma out 15 active outputs RANK 8 NODE 9 --> 9.29620361 sigma out 15 active outputs RANK 9 NODE 7 --> 8.9056921 sigma out 15 active outputs RANK 10 NODE 2 --> 7.70754814 sigma out 15 active outputs RANK 11 NODE 4 --> 7.29768181 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 56.202755 sigma in 11act. ( 67.154808 sig out 1act.) RANK 2 NODE 11 --> 32.1371803 sigma in 11act. ( 37.9254112 sig out 1act.) RANK 3 NODE 7 --> 20.168932 sigma in 11act. ( 20.3043556 sig out 1act.) RANK 4 NODE 14 --> 15.6867561 sigma in 11act. ( 18.4523926 sig out 1act.) RANK 5 NODE 15 --> 13.3432579 sigma in 11act. ( 14.7748547 sig out 1act.) RANK 6 NODE 8 --> 10.9334507 sigma in 11act. ( 12.5891294 sig out 1act.) RANK 7 NODE 6 --> 8.71671104 sigma in 11act. ( 8.45583916 sig out 1act.) RANK 8 NODE 9 --> 6.9544692 sigma in 11act. ( 6.56707287 sig out 1act.) RANK 9 NODE 2 --> 5.82163858 sigma in 11act. ( 6.3149724 sig out 1act.) RANK 10 NODE 5 --> 5.09535122 sigma in 11act. ( 5.58580637 sig out 1act.) RANK 11 NODE 3 --> 4.54482985 sigma in 11act. ( 4.73041534 sig out 1act.) RANK 12 NODE 13 --> 4.06278753 sigma in 11act. ( 2.96162724 sig out 1act.) RANK 13 NODE 4 --> 3.10063338 sigma in 11act. ( 2.62841582 sig out 1act.) RANK 14 NODE 10 --> 0.907274067 sigma in 11act. ( 0.114641331 sig out 1act.) RANK 15 NODE 1 --> 0.633045733 sigma in 11act. ( 0.00430669496 sig out 1 act.) sorted by output significance RANK 1 NODE 12 --> 67.154808 sigma out 1act.( 56.202755 sig in 11act.) RANK 2 NODE 11 --> 37.9254112 sigma out 1act.( 32.1371803 sig in 11act.) RANK 3 NODE 7 --> 20.3043556 sigma out 1act.( 20.168932 sig in 11act.) RANK 4 NODE 14 --> 18.4523926 sigma out 1act.( 15.6867561 sig in 11act.) RANK 5 NODE 15 --> 14.7748547 sigma out 1act.( 13.3432579 sig in 11act.) RANK 6 NODE 8 --> 12.5891294 sigma out 1act.( 10.9334507 sig in 11act.) RANK 7 NODE 6 --> 8.45583916 sigma out 1act.( 8.71671104 sig in 11act.) RANK 8 NODE 9 --> 6.56707287 sigma out 1act.( 6.9544692 sig in 11act.) RANK 9 NODE 2 --> 6.3149724 sigma out 1act.( 5.82163858 sig in 11act.) RANK 10 NODE 5 --> 5.58580637 sigma out 1act.( 5.09535122 sig in 11act.) RANK 11 NODE 3 --> 4.73041534 sigma out 1act.( 4.54482985 sig in 11act.) RANK 12 NODE 13 --> 2.96162724 sigma out 1act.( 4.06278753 sig in 11act.) RANK 13 NODE 4 --> 2.62841582 sigma out 1act.( 3.10063338 sig in 11act.) RANK 14 NODE 10 --> 0.114641331 sigma out 1act.( 0.907274067 sig in 11act.) RANK 15 NODE 1 --> 0.00430669496 sigma out 1act.( 0.633045733 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 85.4483643 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.520558357 *** contribution from regularisation: 0.00638307119 *** contribution from error: -0.526941419 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -20919.1583 0.0336509906 -5.6675868 EXIT FROM BFGS code FG_LNSRCH 0. 0.0336509906 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.520562351 *** contribution from regularisation: 0.00637906604 *** contribution from error: -0.526941419 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20919.3193 0.0336509906 -5.67575264 EXIT FROM BFGS code FG_LNSRCH 0. 0.0336509906 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.520525753 *** contribution from regularisation: 0.00641570846 *** contribution from error: -0.526941478 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -20917.8468 0.0336509906 -5.6599555 EXIT FROM BFGS code NEW_X -20917.8468 0.0336509906 -5.6599555 ENTER BFGS code NEW_X -20917.8468 0.0336509906 -5.6599555 EXIT FROM BFGS code CONVERGENC -20917.8468 0.0336509906 -5.6599555 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 11 --> 77.2770462 sigma out 15 active outputs RANK 2 NODE 6 --> 55.247776 sigma out 15 active outputs RANK 3 NODE 1 --> 38.4145508 sigma out 15 active outputs RANK 4 NODE 5 --> 18.6595459 sigma out 15 active outputs RANK 5 NODE 10 --> 18.3980522 sigma out 15 active outputs RANK 6 NODE 8 --> 17.612587 sigma out 15 active outputs RANK 7 NODE 3 --> 16.4703369 sigma out 15 active outputs RANK 8 NODE 9 --> 14.0997009 sigma out 15 active outputs RANK 9 NODE 7 --> 13.4797277 sigma out 15 active outputs RANK 10 NODE 2 --> 10.860343 sigma out 15 active outputs RANK 11 NODE 4 --> 10.7693844 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 85.9216537 sigma in 11act. ( 104.228828 sig out 1act.) RANK 2 NODE 11 --> 48.3051033 sigma in 11act. ( 58.5276031 sig out 1act.) RANK 3 NODE 7 --> 30.5085449 sigma in 11act. ( 31.8731117 sig out 1act.) RANK 4 NODE 14 --> 24.3836918 sigma in 11act. ( 29.1974831 sig out 1act.) RANK 5 NODE 15 --> 19.8415318 sigma in 11act. ( 23.2238903 sig out 1act.) RANK 6 NODE 8 --> 16.508215 sigma in 11act. ( 19.6964989 sig out 1act.) RANK 7 NODE 6 --> 12.7007427 sigma in 11act. ( 12.778512 sig out 1act.) RANK 8 NODE 9 --> 9.83804131 sigma in 11act. ( 9.83491707 sig out 1act.) RANK 9 NODE 2 --> 8.57203484 sigma in 11act. ( 9.83710957 sig out 1act.) RANK 10 NODE 5 --> 7.44746685 sigma in 11act. ( 8.68324661 sig out 1act.) RANK 11 NODE 3 --> 6.58980227 sigma in 11act. ( 7.3510294 sig out 1act.) RANK 12 NODE 13 --> 5.22650051 sigma in 11act. ( 4.37274218 sig out 1act.) RANK 13 NODE 4 --> 3.97856545 sigma in 11act. ( 4.08262444 sig out 1act.) RANK 14 NODE 10 --> 0.915650547 sigma in 11act. ( 0.165540546 sig out 1act.) RANK 15 NODE 1 --> 0.634365857 sigma in 11act. ( 0.00573287392 sig out 1 act.) sorted by output significance RANK 1 NODE 12 --> 104.228828 sigma out 1act.( 85.9216537 sig in 11act.) RANK 2 NODE 11 --> 58.5276031 sigma out 1act.( 48.3051033 sig in 11act.) RANK 3 NODE 7 --> 31.8731117 sigma out 1act.( 30.5085449 sig in 11act.) RANK 4 NODE 14 --> 29.1974831 sigma out 1act.( 24.3836918 sig in 11act.) RANK 5 NODE 15 --> 23.2238903 sigma out 1act.( 19.8415318 sig in 11act.) RANK 6 NODE 8 --> 19.6964989 sigma out 1act.( 16.508215 sig in 11act.) RANK 7 NODE 6 --> 12.778512 sigma out 1act.( 12.7007427 sig in 11act.) RANK 8 NODE 2 --> 9.83710957 sigma out 1act.( 8.57203484 sig in 11act.) RANK 9 NODE 9 --> 9.83491707 sigma out 1act.( 9.83804131 sig in 11act.) RANK 10 NODE 5 --> 8.68324661 sigma out 1act.( 7.44746685 sig in 11act.) RANK 11 NODE 3 --> 7.3510294 sigma out 1act.( 6.58980227 sig in 11act.) RANK 12 NODE 13 --> 4.37274218 sigma out 1act.( 5.22650051 sig in 11act.) RANK 13 NODE 4 --> 4.08262444 sigma out 1act.( 3.97856545 sig in 11act.) RANK 14 NODE 10 --> 0.165540546 sigma out 1act.( 0.915650547 sig in 11act.) RANK 15 NODE 1 --> 0.00573287392 sigma out 1act.( 0.634365857 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 132.690826 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.520534158 *** contribution from regularisation: 0.00640724925 *** contribution from error: -0.526941419 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 29164 Closing output file done