NNInput NNInputs_150.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 184400 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 48064 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 48064 Chosen entries: 48064 Signal fraction: 1 Background fraction: 0.352541 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 48064 Entries to split: 48064 Test with : 24032 Train with : 24032 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 48064 for Signal Prepared event 0 for Signal with 48064 events ====Entry 0 Variable Ht : 117.82 Variable LepAPt : 47.4738 Variable LepBPt : 12.5622 Variable MetSigLeptonsJets : 3.17918 Variable MetSpec : 29.8229 Variable SumEtLeptonsJets : 87.9972 Variable VSumJetLeptonsPt : 86.2262 Variable addEt : 89.8589 Variable dPhiLepSumMet : 2.58393 Variable dPhiLeptons : 0.475938 Variable dRLeptons : 0.613309 Variable lep1_E : 64.1505 Variable lep2_E : 22.7882 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2150 Ht = 117.82 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 47.4738 LepAPt = 47.4738 LepBEt = 12.5622 LepBPt = 12.5622 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 29.8229 MetDelPhi = 2.20584 MetSig = 2.18904 MetSigLeptonsJets = 3.17918 MetSpec = 29.8229 Mjj = 0 MostCentralJetEta = 0.309078 MtllMet = 98.8413 Njets = 1 SB = 0 SumEt = 185.606 SumEtJets = 0 SumEtLeptonsJets = 87.9972 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 86.2262 addEt = 89.8589 dPhiLepSumMet = 2.58393 dPhiLeptons = 0.475938 dRLeptons = 0.613309 diltype = 1 dimass = 14.9303 event = 29 jet1_Et = 27.9612 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 64.1504 lep2_E = 22.7882 rand = 0.999742 run = 167138 weight = 3.54438e-06 ===Show End Prepared event 10000 for Signal with 48064 events Prepared event 20000 for Signal with 48064 events Prepared event 30000 for Signal with 48064 events Prepared event 40000 for Signal with 48064 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.348622 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4320 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 184400 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4320 negative weights. Signal fraction: 62.2918434 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.4837265 65.730545 67.2044678 68.5044556 69.7656326 70.7236176 71.5382462 72.5129852 73.398407 74.0958405 74.8646545 75.4613037 76.1189041 76.764389 77.255249 78.0610504 78.7107239 79.3627701 80.0607147 80.7622375 81.3092957 82.117363 82.7306671 83.5321808 84.4401474 85.2982101 86.2074661 87.2728119 88.5266266 89.3599014 90.6115112 91.9674072 92.9780426 94.1161118 95.3234558 96.641655 97.995369 99.333847 100.832703 101.971336 103.318024 104.808914 106.076157 107.407852 109.055023 110.284836 111.595924 113.07753 114.477036 115.833717 117.150787 118.53801 119.980881 121.380615 122.620689 123.920418 125.339638 126.825012 128.075989 129.223419 130.604767 131.969421 133.224762 134.462769 135.893311 137.237045 138.559174 139.894409 141.271515 142.714645 144.191849 145.608063 147.077591 148.541992 150.147278 151.881744 153.757935 155.833481 157.963715 160.343048 162.942474 165.291977 167.70993 170.416275 173.266846 176.168823 179.640289 182.847443 187.16188 191.678284 196.051575 201.076752 207.327835 214.736176 224.773499 235.45755 250.922516 273.968445 324.422241 705.443726 ------------------------------ Transdef: Tab for variable 3 20.0009289 20.3661995 20.6801281 20.9958115 21.2477856 21.5003242 21.7821465 22.0203342 22.2476807 22.4860153 22.680336 22.8344841 23.0554314 23.2865295 23.4827251 23.6722069 23.8964882 24.1156273 24.3349991 24.5546589 24.7647209 24.9457722 25.1497765 25.3181305 25.5452957 25.7429428 25.937254 26.1459026 26.3439579 26.5309677 26.7352982 26.9717407 27.1677322 27.3738823 27.6215134 27.8059978 28.0128136 28.2592049 28.5018826 28.68606 28.8781013 29.1053658 29.3599625 29.6146679 29.8186531 30.0883713 30.339695 30.5607986 30.8419647 31.1234093 31.3707886 31.5867538 31.8298988 32.0530434 32.3252449 32.615715 32.8780098 33.1483459 33.4018478 33.6794586 33.8983231 34.2049179 34.47649 34.7775269 35.0732346 35.3763275 35.6356125 35.9407425 36.2509079 36.5999794 36.9229202 37.2428665 37.5925751 37.9658585 38.3290863 38.689045 39.0903625 39.4710846 39.8871002 40.2915268 40.7283478 41.0324516 41.5392685 42.0585938 42.5823975 43.1406937 43.7571106 44.4153442 45.0999641 45.8793259 46.7263451 47.7324677 48.6338348 49.8096008 51.106308 52.9563484 55.1011963 57.8633041 62.1718445 69.2205658 162.429443 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.122015 10.2656422 10.3762302 10.4539442 10.5592918 10.6981354 10.839468 10.9785042 11.1204815 11.2524128 11.3989191 11.5388737 11.6667461 11.7951107 11.9494572 12.1011591 12.2461233 12.3952751 12.5387306 12.7068739 12.8444996 13.0138807 13.2042561 13.3924122 13.5541363 13.6879759 13.8333969 14.0008087 14.1873665 14.3662357 14.5515842 14.7568007 14.9517422 15.1425705 15.3277969 15.5071259 15.7309465 15.88272 16.0993729 16.3416023 16.5652084 16.756218 16.9424629 17.1779728 17.4160271 17.6688385 17.9011402 18.0573177 18.3236771 18.5604858 18.8272171 19.0778694 19.3102455 19.5848961 19.8349571 20.0832443 20.2564659 20.5081291 20.7312317 20.9811058 21.2186508 21.4726982 21.7244873 21.9716892 22.2318439 22.4984379 22.7326126 22.9994831 23.2607841 23.5451164 23.7974148 24.076931 24.3660278 24.6870537 25.0073929 25.321209 25.6692009 26.0069904 26.3089256 26.6647587 27.0142479 27.3824005 27.7515602 28.1512508 28.5540466 28.946312 29.3973408 29.8594608 30.3158035 30.8597069 31.4689522 32.02565 32.711998 33.4738007 34.3860931 35.5336075 37.0303802 39.4670143 43.7710114 71.0537567 ------------------------------ Transdef: Tab for variable 5 1.04656506 2.6485765 3.08176517 3.38211775 3.64016581 3.8520565 4.03749371 4.15971851 4.27908182 4.40477848 4.51120043 4.61165142 4.70695496 4.79261398 4.88582897 4.96268177 5.04616117 5.1260128 5.19139004 5.25427628 5.3027339 5.35289764 5.41341305 5.46744061 5.52127552 5.56390572 5.61258507 5.66928577 5.71913147 5.76960039 5.81988239 5.86355209 5.90980339 5.95568562 6.0024991 6.0420599 6.0924654 6.13209677 6.17933655 6.21888256 6.25908709 6.29316854 6.33917141 6.38431072 6.42902374 6.47496891 6.51171875 6.55153561 6.59238911 6.63852406 6.68923473 6.73152161 6.77519798 6.81987095 6.85966778 6.89071035 6.94049931 6.98795891 7.03551626 7.08983183 7.13864422 7.18414116 7.22281551 7.26413059 7.31384277 7.36745453 7.40694046 7.45454979 7.5060811 7.55907059 7.61131954 7.66159344 7.71603203 7.77074432 7.82740307 7.88590145 7.93930054 8.00079441 8.0607481 8.12405872 8.18073082 8.23936081 8.2983017 8.36675072 8.43885517 8.50522804 8.57942009 8.66684341 8.73791313 8.81492424 8.90719032 9.01856518 9.14352226 9.26624203 9.42307854 9.60781574 9.84070015 10.1665955 10.691843 11.5691805 24.4751568 ------------------------------ Transdef: Tab for variable 6 15.0050735 20.9222145 25.3088188 26.3595963 27.3334885 28.3353653 29.370285 30.0257015 30.7024746 31.3129158 31.9736423 32.5110435 33.0253067 33.4922333 33.9846992 34.4687881 34.8830872 35.3206558 35.7134705 36.1322479 36.5584831 36.9468346 37.2778625 37.6236801 37.9080086 38.2883987 38.6033401 38.9408646 39.3507805 39.7274399 40.1442299 40.5223312 40.9623642 41.363739 41.8123779 42.2411423 42.7067795 43.059021 43.5473595 43.8902779 44.2986565 44.7730446 45.3218231 45.7817612 46.342617 46.9141312 47.4063263 47.921524 48.4121323 49.0114975 49.5235329 50.1601181 50.7631226 51.3692474 51.9651566 52.6288223 53.3175507 53.9800491 54.5321884 55.1591187 55.7427406 56.3702087 56.9743423 57.5238495 58.1845894 58.846489 59.5630493 60.226223 60.9095116 61.6426811 62.2950935 63.0234375 63.6912231 64.3505554 65.1123505 65.8119965 66.5729218 67.3327179 68.06604 68.7522354 69.4750519 70.2232666 71.0565872 71.880394 72.7378922 73.6466064 74.5492859 75.5590591 76.705925 77.4894562 78.7477036 80.2642059 82.0383301 84.1415863 86.4092865 89.3106918 93.006485 97.4417572 104.376289 115.373009 236.562576 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.7590752 33.7959061 34.5207977 35.0806313 35.6148262 36.0426674 36.4866867 36.9420815 37.3504372 37.6868286 38.0463791 38.3035355 38.571579 38.8957367 39.2393646 39.5578766 39.8946228 40.1979065 40.4736023 40.8207321 41.1501465 41.4961853 41.9226685 42.2870483 42.6994324 43.1434517 43.6487541 44.3823547 44.8711166 45.4489746 46.0047951 46.7686615 47.3194466 48.0724525 48.7785568 49.458313 50.3027725 51.0223579 51.9245567 52.7084427 53.5467148 54.4244232 55.279808 56.0181427 56.7871475 57.5257912 58.2943573 59.062851 59.9054718 60.6961136 61.4235992 62.224823 62.9174118 63.7176666 64.4969025 65.1772461 65.9550476 66.7556 67.5118561 68.2944794 69.1819077 70.07901 70.8817291 71.6993561 72.6315155 73.5224304 74.6048126 75.769928 76.9102173 78.2967377 79.5360336 80.9757538 82.3483276 83.8343506 85.2938843 86.9459076 88.5764618 90.3100433 92.0047073 93.7226562 95.5286255 97.4802551 99.6195831 101.76329 104.041504 106.663544 109.269867 112.452713 116.027496 120.017639 123.927826 128.45636 134.098236 139.884064 147.181458 157.154541 170.243912 189.860687 226.843781 453.463348 ------------------------------ Transdef: Tab for variable 8 1.19986558 24.0514889 28.5716095 30.5495472 31.8625984 32.6439552 33.2187576 33.8007965 34.2666245 34.7141876 35.0971375 35.4439316 35.8104095 36.1209106 36.4915733 36.8080597 37.1119118 37.379097 37.6677399 37.9309883 38.1674194 38.4673119 38.7069664 38.971611 39.2752151 39.5572166 39.7719193 40.0535774 40.3800354 40.6827431 41.0234222 41.3235016 41.7150459 42.097084 42.4796219 42.882431 43.2798615 43.6705704 44.064621 44.5122108 45.0251007 45.4804268 46.0278854 46.5362473 47.0641861 47.5985031 48.1574516 48.6237297 49.1478615 49.649601 50.2072296 50.8596725 51.4042587 52.0541687 52.7019119 53.3321915 53.8914871 54.4719772 55.0857925 55.6310539 56.2284393 56.8737793 57.4603043 58.075016 58.6166306 59.2125778 59.8140984 60.4108925 61.0423927 61.6105156 62.2132416 62.8257599 63.467247 64.1494446 64.7377014 65.3942108 66.0628052 66.7284241 67.4012527 68.1312866 68.8115997 69.6061096 70.2945175 71.0727386 71.8502808 72.6922989 73.6530304 74.7779007 75.8993073 77.3127975 78.652771 80.2733002 82.2685928 84.7151794 87.5518036 90.9161835 94.8215485 100.103989 108.477776 127.048233 296.803314 ------------------------------ Transdef: Tab for variable 9 48.8581314 63.0482178 65.0705261 66.6827393 67.8171616 68.7786255 69.9393921 70.7825623 71.5227051 72.3723984 73.1815643 73.8551178 74.527771 75.1313477 75.5727081 76.2321854 76.7699585 77.1939316 77.8458862 78.4138947 79.0544891 79.6419907 80.2809448 80.8982086 81.3649292 82.006073 82.6014099 83.2708282 83.8621902 84.6015167 85.2928314 86.1265411 86.8797073 87.81427 88.7032623 89.3599014 90.3057709 91.3651123 92.2080688 93.0232697 94.0903625 95.108139 96.2208862 97.1624451 98.3767395 99.4376907 100.652527 101.556427 102.586258 103.681534 104.820267 105.89164 106.910995 108.121964 109.255203 110.302628 111.362045 112.489868 113.597961 114.675201 115.763977 116.84108 117.84919 118.89621 120.009628 121.07399 122.068817 123.124001 124.105881 125.118591 126.123886 127.155991 128.124481 129.099075 130.144958 131.153702 132.149261 133.069214 134.109436 135.247559 136.305542 137.369232 138.361053 139.429535 140.593414 141.860657 142.952942 144.209854 145.352997 146.513916 147.865936 149.298401 150.859802 152.700958 155.042099 158.051758 162.036331 167.631332 177.988037 203.526001 382.729065 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.8865574 1.27916646 1.50002146 1.66983008 1.79930162 1.90972102 2.00803113 2.08930135 2.16132116 2.22439289 2.27683973 2.32580423 2.37051558 2.41381502 2.44569755 2.48086166 2.50976324 2.538692 2.56739807 2.59431005 2.62075472 2.64675331 2.66879272 2.69260335 2.71314836 2.73231268 2.75021863 2.76731896 2.78102303 2.7968514 2.81145167 2.82527113 2.83752346 2.84905744 2.85800123 2.86889386 2.87952757 2.88922071 2.89793825 2.90672517 2.91420794 2.92069197 2.92900181 2.93690825 2.94497466 2.95166302 2.95810556 2.96364427 2.96913314 2.97532606 2.98075151 2.98524046 2.99014044 2.99491787 3.00056601 3.00440311 3.00934505 3.01405382 3.01843405 3.0229373 3.02765584 3.03134918 3.03538132 3.03897047 3.04227686 3.04602599 3.05013132 3.05373526 3.05699635 3.06067681 3.06428885 3.06733513 3.0705483 3.073385 3.07622862 3.07899547 3.08219719 3.08477783 3.08811998 3.09110212 3.09396791 3.09660721 3.09907317 3.10188508 3.10454988 3.10718226 3.1093924 3.11193991 3.11425495 3.11668253 3.11955976 3.12203026 3.12456679 3.12691927 3.12910128 3.13196206 3.13406157 3.13639808 3.138973 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00717389584 0.0128424317 0.0200861692 0.0273990035 0.0354488492 0.0441579819 0.052025795 0.0594878457 0.0665581822 0.0748369619 0.0816104412 0.0885665417 0.0969097614 0.10504365 0.112606525 0.120726466 0.128287762 0.135480821 0.143709898 0.151355267 0.15845798 0.16535449 0.172000572 0.177840233 0.183639526 0.190025747 0.196072042 0.202148676 0.207484841 0.21286273 0.218927443 0.224755406 0.230278492 0.234662056 0.24036479 0.246501058 0.25227648 0.257652879 0.262573659 0.268009901 0.273894489 0.279716849 0.285353422 0.291108549 0.296486259 0.300935805 0.306379437 0.31167227 0.316648126 0.322591811 0.327991486 0.333077073 0.339145482 0.344906092 0.350154161 0.355425 0.360224009 0.366445154 0.372641325 0.378828764 0.384723008 0.388940215 0.394673079 0.400462776 0.406632841 0.41321528 0.419077009 0.425457895 0.430892825 0.43689236 0.441644073 0.447819948 0.454777479 0.461043835 0.468514323 0.475621462 0.482622385 0.490737081 0.49831903 0.506226897 0.51406157 0.523250401 0.532698989 0.53979677 0.54987365 0.561201036 0.572825909 0.584669948 0.596105278 0.609310508 0.625278592 0.637360692 0.650269151 0.668179035 0.690230846 0.715281367 0.74727416 0.787603021 0.843826592 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.214898616 0.228646725 0.238712728 0.249256402 0.258630395 0.267067343 0.275415242 0.282981634 0.290861905 0.298550338 0.305524766 0.311511278 0.317867339 0.324128091 0.330626816 0.337379038 0.343745083 0.349067301 0.354783118 0.360634446 0.366447419 0.371886909 0.376971155 0.382359415 0.388134003 0.393493056 0.398563087 0.403207898 0.407230496 0.411145627 0.414508015 0.41834414 0.422137141 0.425485015 0.429273188 0.432431996 0.436442673 0.440101981 0.443752348 0.44707793 0.450684547 0.454761982 0.458908826 0.462153971 0.465865761 0.469906926 0.473730594 0.477365017 0.481550753 0.485058129 0.489161998 0.493170142 0.496895373 0.500605464 0.504763186 0.509214044 0.513700128 0.518135369 0.523388326 0.527989984 0.532328963 0.537224174 0.54232049 0.547423601 0.551405311 0.555724978 0.560988307 0.566744447 0.571132183 0.576827824 0.581985474 0.587684631 0.593558669 0.60000968 0.607064426 0.614322782 0.620699942 0.627954483 0.635179877 0.642958045 0.650793016 0.657954931 0.664999604 0.673143983 0.680214763 0.688651145 0.697833061 0.706570685 0.715711236 0.725199699 0.738571346 0.751350045 0.764846802 0.780248761 0.795131803 0.812463403 0.840833306 0.867464066 0.916254401 1.13453126 ------------------------------ Transdef: Tab for variable 13 20.0293255 21.4652195 22.2619534 23.015604 23.584816 24.0939636 24.5877914 25.0168648 25.3993778 25.8131905 26.233078 26.6442604 27.0189037 27.3783169 27.7757645 28.1409073 28.4793777 28.8243637 29.1443748 29.4673805 29.7968845 30.1042576 30.4474678 30.7302952 31.0659122 31.4182701 31.7250137 32.1151276 32.4046021 32.732338 33.1022339 33.4245834 33.7599411 34.0990067 34.4410934 34.7011108 34.9852371 35.3070602 35.5952644 35.9165497 36.1652298 36.4990005 36.8559265 37.2134705 37.5191727 37.8164291 38.1617241 38.5264931 38.8303452 39.1870728 39.5441284 39.8785095 40.2579918 40.6335297 40.989296 41.3299828 41.7320251 42.1529236 42.5855255 42.9677811 43.3020897 43.709446 44.1685333 44.5596466 45.0628052 45.530632 46.065033 46.5294151 47.0713196 47.5869522 48.1295471 48.6854401 49.2973022 49.8849564 50.4902382 51.1227531 51.7832336 52.5156708 53.2511749 54.104126 54.9517174 55.7141533 56.6976395 57.6732635 58.6179276 59.8005981 60.9359741 62.1940002 63.7088013 65.1253281 66.8709717 68.1407242 69.8927155 72.0079803 74.6305847 78.144989 81.9872742 86.4855194 92.2428894 102.694016 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.5956335 11.0316811 11.4096479 11.7289228 12.0514736 12.3481579 12.7398977 13.042985 13.361062 13.6465282 13.9116364 14.2259197 14.508481 14.7547865 15.0669384 15.3880844 15.6257792 15.9104729 16.213232 16.4607277 16.6719151 16.9428482 17.232151 17.5638199 17.7946854 18.0783463 18.3273659 18.6082611 18.8923531 19.168911 19.4670639 19.7571259 20.0211449 20.2920609 20.5882549 20.8321838 21.1164436 21.3764648 21.6670151 21.8938141 22.1492386 22.4068031 22.6972313 22.9778023 23.2161026 23.4742737 23.7305183 24.0231094 24.3027039 24.5777359 24.8614197 25.1525002 25.4375458 25.6873627 25.9493217 26.2234554 26.4952946 26.7667313 27.0825787 27.3714752 27.658287 27.9611664 28.1715393 28.4435883 28.7414017 29.0893936 29.4341316 29.7247047 30.0581665 30.385622 30.7634125 31.1305676 31.5131836 31.9235649 32.3376198 32.7836685 33.2307892 33.6648865 34.0653648 34.5283127 35.0358009 35.5447884 36.0651398 36.6053391 37.2108765 37.8496857 38.6896973 39.4589081 40.3136559 41.1515121 42.1619339 43.2604828 44.3037033 45.6758041 47.4636116 49.4397621 52.4129562 56.5336227 64.0888824 124.81353 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 59.6 42.3 50.1 22.4 44.0 57.7 48.3 57.3 -25.5 -19.0 -36.1 7.6 22.7 2 59.6 100.0 63.4 57.5 33.5 67.3 94.4 73.9 91.5 -47.9 -23.4 -47.7 29.4 31.8 3 42.3 63.4 100.0 41.0 6.2 31.7 66.8 51.4 69.7 -15.8 -25.2 -52.7 62.4 20.9 4 50.1 57.5 41.0 100.0 13.3 35.5 58.3 49.5 64.1 -12.5 -31.1 -61.6 16.4 71.9 5 22.4 33.5 6.2 13.3 100.0 83.1 6.1 55.1 55.8 21.3 -6.2 -8.8 -5.0 3.6 6 44.0 67.3 31.7 35.5 83.1 100.0 46.3 77.5 79.2 -7.7 -15.3 -27.9 8.5 17.1 7 57.7 94.4 66.8 58.3 6.1 46.3 100.0 66.1 79.9 -55.6 -22.4 -48.2 33.7 33.6 8 48.3 73.9 51.4 49.5 55.1 77.5 66.1 100.0 82.6 -14.2 -22.3 -41.4 23.7 28.7 9 57.3 91.5 69.7 64.1 55.8 79.2 79.9 82.6 100.0 -23.8 -26.7 -54.0 34.3 37.4 10 -25.5 -47.9 -15.8 -12.5 21.3 -7.7 -55.6 -14.2 -23.8 100.0 2.4 9.2 -5.4 -4.7 11 -19.0 -23.4 -25.2 -31.1 -6.2 -15.3 -22.4 -22.3 -26.7 2.4 100.0 55.0 -11.3 -22.1 12 -36.1 -47.7 -52.7 -61.6 -8.8 -27.9 -48.2 -41.4 -54.0 9.2 55.0 100.0 -24.7 -37.7 13 7.6 29.4 62.4 16.4 -5.0 8.5 33.7 23.7 34.3 -5.4 -11.3 -24.7 100.0 44.5 14 22.7 31.8 20.9 71.9 3.6 17.1 33.6 28.7 37.4 -4.7 -22.1 -37.7 44.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 148.802853 TOTAL CORRELATION OF ALL VARIABLES 67.0195371 ROUND 1: MAX CORR ( 67.0191536) AFTER KILLING INPUT VARIABLE 8 CONTR 0.226737421 ROUND 2: MAX CORR ( 67.0038763) AFTER KILLING INPUT VARIABLE 11 CONTR 1.43091356 ROUND 3: MAX CORR ( 66.9781138) AFTER KILLING INPUT VARIABLE 14 CONTR 1.85787577 ROUND 4: MAX CORR ( 66.9341223) AFTER KILLING INPUT VARIABLE 12 CONTR 2.42713897 ROUND 5: MAX CORR ( 66.8463645) AFTER KILLING INPUT VARIABLE 10 CONTR 3.42640849 ROUND 6: MAX CORR ( 66.584894) AFTER KILLING INPUT VARIABLE 7 CONTR 5.90663553 ROUND 7: MAX CORR ( 66.283056) AFTER KILLING INPUT VARIABLE 6 CONTR 6.33281901 ROUND 8: MAX CORR ( 65.0030213) AFTER KILLING INPUT VARIABLE 9 CONTR 12.9634385 ROUND 9: MAX CORR ( 64.8700814) AFTER KILLING INPUT VARIABLE 5 CONTR 4.15515541 ROUND 10: MAX CORR ( 63.5304797) AFTER KILLING INPUT VARIABLE 3 CONTR 13.1150906 ROUND 11: MAX CORR ( 62.6988082) AFTER KILLING INPUT VARIABLE 13 CONTR 10.2460383 ROUND 12: MAX CORR ( 59.6490725) AFTER KILLING INPUT VARIABLE 4 CONTR 19.3165396 LAST REMAINING VARIABLE: 2 total correlation to target: 67.0195371 % total significance: 131.987956 sigma correlations of single variables to target: variable 2: 59.6490725 % , in sigma: 117.472598 variable 3: 42.3300628 % , in sigma: 83.3646233 variable 4: 50.1116523 % , in sigma: 98.6896484 variable 5: 22.422392 % , in sigma: 44.1585514 variable 6: 44.0208509 % , in sigma: 86.6944531 variable 7: 57.7420387 % , in sigma: 113.716895 variable 8: 48.304431 % , in sigma: 95.1305152 variable 9: 57.3008734 % , in sigma: 112.848066 variable 10: -25.5335456 % , in sigma: 50.2856426 variable 11: -19.0056224 % , in sigma: 37.4295818 variable 12: -36.0825439 % , in sigma: 71.0607893 variable 13: 7.64086888 % , in sigma: 15.0478906 variable 14: 22.7223855 % , in sigma: 44.7493573 variables sorted by significance: 1 most relevant variable 2 corr 59.6490707 , in sigma: 117.472595 2 most relevant variable 4 corr 19.3165398 , in sigma: 38.041901 3 most relevant variable 13 corr 10.2460384 , in sigma: 20.1784991 4 most relevant variable 3 corr 13.1150904 , in sigma: 25.8287962 5 most relevant variable 5 corr 4.15515518 , in sigma: 8.18314274 6 most relevant variable 9 corr 12.963438 , in sigma: 25.5301328 7 most relevant variable 6 corr 6.33281898 , in sigma: 12.4718234 8 most relevant variable 7 corr 5.90663576 , in sigma: 11.6325002 9 most relevant variable 10 corr 3.42640853 , in sigma: 6.74795256 10 most relevant variable 12 corr 2.42713904 , in sigma: 4.77999602 11 most relevant variable 14 corr 1.85787582 , in sigma: 3.65889176 12 most relevant variable 11 corr 1.43091357 , in sigma: 2.81803433 13 most relevant variable 8 corr 0.226737425 , in sigma: 0.446535599 global correlations between input variables: variable 2: 99.1827419 % variable 3: 92.8914081 % variable 4: 92.3276581 % variable 5: 95.3344222 % variable 6: 94.0883579 % variable 7: 98.7418767 % variable 8: 89.2355832 % variable 9: 98.910157 % variable 10: 71.880012 % variable 11: 56.2557866 % variable 12: 76.8470422 % variable 13: 84.5224225 % variable 14: 88.0046776 % significance loss when removing single variables: variable 2: corr = 4.79157014 % , sigma = 9.4364953 variable 3: corr = 15.5334061 % , sigma = 30.5914157 variable 4: corr = 16.2770138 % , sigma = 32.0558731 variable 5: corr = 9.38989683 % , sigma = 18.4924179 variable 6: corr = 5.54809162 % , sigma = 10.9263851 variable 7: corr = 4.66835615 % , sigma = 9.19383826 variable 8: corr = 0.226737421 % , sigma = 0.446535593 variable 9: corr = 11.7424643 % , sigma = 23.1255529 variable 10: corr = 3.42149436 % , sigma = 6.73827462 variable 11: corr = 1.41394393 % , sigma = 2.78461441 variable 12: corr = 2.88137483 % , sigma = 5.6745658 variable 13: corr = 8.84907986 % , sigma = 17.4273355 variable 14: corr = 1.96996873 % , sigma = 3.879647 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 6 --> 27.816143 sigma out 15 active outputs RANK 2 NODE 10 --> 24.8645687 sigma out 15 active outputs RANK 3 NODE 4 --> 23.1012783 sigma out 15 active outputs RANK 4 NODE 11 --> 21.659153 sigma out 15 active outputs RANK 5 NODE 2 --> 18.4491253 sigma out 15 active outputs RANK 6 NODE 9 --> 17.6909275 sigma out 15 active outputs RANK 7 NODE 7 --> 16.3593216 sigma out 15 active outputs RANK 8 NODE 1 --> 15.776535 sigma out 15 active outputs RANK 9 NODE 3 --> 12.8426409 sigma out 15 active outputs RANK 10 NODE 8 --> 12.8413782 sigma out 15 active outputs RANK 11 NODE 5 --> 11.1447325 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 39.0851936 sigma in 11act. ( 37.4723969 sig out 1act.) RANK 2 NODE 6 --> 27.1313152 sigma in 11act. ( 28.9022007 sig out 1act.) RANK 3 NODE 8 --> 25.9069233 sigma in 11act. ( 20.9727783 sig out 1act.) RANK 4 NODE 13 --> 19.1944218 sigma in 11act. ( 20.8018551 sig out 1act.) RANK 5 NODE 1 --> 14.3824348 sigma in 11act. ( 15.2990599 sig out 1act.) RANK 6 NODE 5 --> 13.7265539 sigma in 11act. ( 13.790741 sig out 1act.) RANK 7 NODE 12 --> 11.8750315 sigma in 11act. ( 10.3143406 sig out 1act.) RANK 8 NODE 9 --> 7.92095757 sigma in 11act. ( 8.72064877 sig out 1act.) RANK 9 NODE 3 --> 7.0783267 sigma in 11act. ( 12.5961142 sig out 1act.) RANK 10 NODE 4 --> 5.23530245 sigma in 11act. ( 7.22181702 sig out 1act.) RANK 11 NODE 15 --> 4.53297949 sigma in 11act. ( 4.3188076 sig out 1act.) RANK 12 NODE 14 --> 2.62711239 sigma in 11act. ( 4.88912582 sig out 1act.) RANK 13 NODE 2 --> 2.34157538 sigma in 11act. ( 3.71634889 sig out 1act.) RANK 14 NODE 7 --> 1.97404444 sigma in 11act. ( 1.51470995 sig out 1act.) RANK 15 NODE 11 --> 1.39688277 sigma in 11act. ( 0.476134688 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 37.4723969 sigma out 1act.( 39.0851936 sig in 11act.) RANK 2 NODE 6 --> 28.9022007 sigma out 1act.( 27.1313152 sig in 11act.) RANK 3 NODE 8 --> 20.9727783 sigma out 1act.( 25.9069233 sig in 11act.) RANK 4 NODE 13 --> 20.8018551 sigma out 1act.( 19.1944218 sig in 11act.) RANK 5 NODE 1 --> 15.2990599 sigma out 1act.( 14.3824348 sig in 11act.) RANK 6 NODE 5 --> 13.790741 sigma out 1act.( 13.7265539 sig in 11act.) RANK 7 NODE 3 --> 12.5961142 sigma out 1act.( 7.0783267 sig in 11act.) RANK 8 NODE 12 --> 10.3143406 sigma out 1act.( 11.8750315 sig in 11act.) RANK 9 NODE 9 --> 8.72064877 sigma out 1act.( 7.92095757 sig in 11act.) RANK 10 NODE 4 --> 7.22181702 sigma out 1act.( 5.23530245 sig in 11act.) RANK 11 NODE 14 --> 4.88912582 sigma out 1act.( 2.62711239 sig in 11act.) RANK 12 NODE 15 --> 4.3188076 sigma out 1act.( 4.53297949 sig in 11act.) RANK 13 NODE 2 --> 3.71634889 sigma out 1act.( 2.34157538 sig in 11act.) RANK 14 NODE 7 --> 1.51470995 sigma out 1act.( 1.97404444 sig in 11act.) RANK 15 NODE 11 --> 0.476134688 sigma out 1act.( 1.39688277 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 63.1543999 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 25.7026386 sigma out 15 active outputs RANK 2 NODE 6 --> 24.6567116 sigma out 15 active outputs RANK 3 NODE 10 --> 23.8099365 sigma out 15 active outputs RANK 4 NODE 4 --> 22.1130848 sigma out 15 active outputs RANK 5 NODE 11 --> 19.5702972 sigma out 15 active outputs RANK 6 NODE 1 --> 16.6611633 sigma out 15 active outputs RANK 7 NODE 9 --> 15.9551916 sigma out 15 active outputs RANK 8 NODE 7 --> 15.0072565 sigma out 15 active outputs RANK 9 NODE 3 --> 12.624814 sigma out 15 active outputs RANK 10 NODE 5 --> 12.5726767 sigma out 15 active outputs RANK 11 NODE 8 --> 11.0527258 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 34.0301094 sigma in 11act. ( 32.873806 sig out 1act.) RANK 2 NODE 6 --> 24.8008518 sigma in 11act. ( 26.7567101 sig out 1act.) RANK 3 NODE 8 --> 20.6816006 sigma in 11act. ( 16.891674 sig out 1act.) RANK 4 NODE 13 --> 18.0589066 sigma in 11act. ( 18.2708626 sig out 1act.) RANK 5 NODE 3 --> 16.7391071 sigma in 11act. ( 13.9984617 sig out 1act.) RANK 6 NODE 1 --> 13.4582186 sigma in 11act. ( 13.7739611 sig out 1act.) RANK 7 NODE 5 --> 13.3399153 sigma in 11act. ( 12.6462822 sig out 1act.) RANK 8 NODE 14 --> 12.2461834 sigma in 11act. ( 7.37691689 sig out 1act.) RANK 9 NODE 2 --> 11.7799072 sigma in 11act. ( 5.16535711 sig out 1act.) RANK 10 NODE 12 --> 10.6622677 sigma in 11act. ( 8.80092335 sig out 1act.) RANK 11 NODE 4 --> 10.6469984 sigma in 11act. ( 7.87451887 sig out 1act.) RANK 12 NODE 9 --> 8.79756451 sigma in 11act. ( 8.24395847 sig out 1act.) RANK 13 NODE 7 --> 7.44279909 sigma in 11act. ( 2.29753757 sig out 1act.) RANK 14 NODE 11 --> 7.24476528 sigma in 11act. ( 1.11857641 sig out 1act.) RANK 15 NODE 15 --> 6.09621048 sigma in 11act. ( 4.26822948 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 32.873806 sigma out 1act.( 34.0301094 sig in 11act.) RANK 2 NODE 6 --> 26.7567101 sigma out 1act.( 24.8008518 sig in 11act.) RANK 3 NODE 13 --> 18.2708626 sigma out 1act.( 18.0589066 sig in 11act.) RANK 4 NODE 8 --> 16.891674 sigma out 1act.( 20.6816006 sig in 11act.) RANK 5 NODE 3 --> 13.9984617 sigma out 1act.( 16.7391071 sig in 11act.) RANK 6 NODE 1 --> 13.7739611 sigma out 1act.( 13.4582186 sig in 11act.) RANK 7 NODE 5 --> 12.6462822 sigma out 1act.( 13.3399153 sig in 11act.) RANK 8 NODE 12 --> 8.80092335 sigma out 1act.( 10.6622677 sig in 11act.) RANK 9 NODE 9 --> 8.24395847 sigma out 1act.( 8.79756451 sig in 11act.) RANK 10 NODE 4 --> 7.87451887 sigma out 1act.( 10.6469984 sig in 11act.) RANK 11 NODE 14 --> 7.37691689 sigma out 1act.( 12.2461834 sig in 11act.) RANK 12 NODE 2 --> 5.16535711 sigma out 1act.( 11.7799072 sig in 11act.) RANK 13 NODE 15 --> 4.26822948 sigma out 1act.( 6.09621048 sig in 11act.) RANK 14 NODE 7 --> 2.29753757 sigma out 1act.( 7.44279909 sig in 11act.) RANK 15 NODE 11 --> 1.11857641 sigma out 1act.( 7.24476528 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 57.2245026 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.404353142 *** contribution from regularisation: 0.00451152213 *** contribution from error: -0.408864677 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.461489052 *** contribution from regularisation: 0.00250792224 *** contribution from error: -0.463996977 *********************************************** -----------------> Test sample ENTER BFGS code START -42558.5095 -0.502664983 0. EXIT FROM BFGS code FG_START 0. -0.502664983 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.484627604 *** contribution from regularisation: 0.00242510159 *** contribution from error: -0.487052709 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -44682.6651 -0.502664983 -63.6462517 EXIT FROM BFGS code FG_LNSRCH 0. -0.511333466 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.524167478 *** contribution from regularisation: 0.00298682577 *** contribution from error: -0.527154326 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48328.2396 -0.511333466 -162.07666 EXIT FROM BFGS code NEW_X -48328.2396 -0.511333466 -162.07666 ENTER BFGS code NEW_X -48328.2396 -0.511333466 -162.07666 EXIT FROM BFGS code FG_LNSRCH 0. -0.531380832 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.526222646 *** contribution from regularisation: 0.00308047119 *** contribution from error: -0.529303133 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48517.7259 -0.531380832 -73.3605347 EXIT FROM BFGS code NEW_X -48517.7259 -0.531380832 -73.3605347 ENTER BFGS code NEW_X -48517.7259 -0.531380832 -73.3605347 EXIT FROM BFGS code FG_LNSRCH 0. -0.552808702 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.52805382 *** contribution from regularisation: 0.00320815947 *** contribution from error: -0.531261981 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48686.5638 -0.552808702 -0.882398307 EXIT FROM BFGS code NEW_X -48686.5638 -0.552808702 -0.882398307 ENTER BFGS code NEW_X -48686.5638 -0.552808702 -0.882398307 EXIT FROM BFGS code FG_LNSRCH 0. -0.566287577 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.529105663 *** contribution from regularisation: 0.00320935552 *** contribution from error: -0.532315016 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48783.5407 -0.566287577 48.3247528 EXIT FROM BFGS code NEW_X -48783.5407 -0.566287577 48.3247528 ENTER BFGS code NEW_X -48783.5407 -0.566287577 48.3247528 EXIT FROM BFGS code FG_LNSRCH 0. -0.567225814 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.530148923 *** contribution from regularisation: 0.00321127707 *** contribution from error: -0.533360183 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -48879.7333 -0.567225814 52.0120964 EXIT FROM BFGS code NEW_X -48879.7333 -0.567225814 52.0120964 ENTER BFGS code NEW_X -48879.7333 -0.567225814 52.0120964 EXIT FROM BFGS code FG_LNSRCH 0. -0.539998114 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.531780005 *** contribution from regularisation: 0.00374907162 *** contribution from error: -0.535529077 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49030.1186 -0.539998114 -15.4105463 EXIT FROM BFGS code NEW_X -49030.1186 -0.539998114 -15.4105463 ENTER BFGS code NEW_X -49030.1186 -0.539998114 -15.4105463 EXIT FROM BFGS code FG_LNSRCH 0. -0.550368905 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 45.7418976 sigma out 15 active outputs RANK 2 NODE 1 --> 28.953537 sigma out 15 active outputs RANK 3 NODE 8 --> 23.0195541 sigma out 15 active outputs RANK 4 NODE 4 --> 22.1386757 sigma out 15 active outputs RANK 5 NODE 10 --> 21.4768105 sigma out 15 active outputs RANK 6 NODE 6 --> 19.0013618 sigma out 15 active outputs RANK 7 NODE 9 --> 17.1779366 sigma out 15 active outputs RANK 8 NODE 5 --> 16.2272377 sigma out 15 active outputs RANK 9 NODE 11 --> 12.5091524 sigma out 15 active outputs RANK 10 NODE 3 --> 11.6005697 sigma out 15 active outputs RANK 11 NODE 7 --> 10.8439903 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 38.2988243 sigma in 11act. ( 34.5016785 sig out 1act.) RANK 2 NODE 3 --> 35.4015884 sigma in 11act. ( 28.0858078 sig out 1act.) RANK 3 NODE 10 --> 26.2476425 sigma in 11act. ( 21.4731102 sig out 1act.) RANK 4 NODE 4 --> 22.0129871 sigma in 11act. ( 19.4510288 sig out 1act.) RANK 5 NODE 8 --> 21.2162838 sigma in 11act. ( 17.5652542 sig out 1act.) RANK 6 NODE 13 --> 19.9136887 sigma in 11act. ( 20.7850914 sig out 1act.) RANK 7 NODE 6 --> 17.6968346 sigma in 11act. ( 19.0187893 sig out 1act.) RANK 8 NODE 2 --> 12.7537775 sigma in 11act. ( 9.79681206 sig out 1act.) RANK 9 NODE 9 --> 11.7901316 sigma in 11act. ( 11.6655941 sig out 1act.) RANK 10 NODE 7 --> 9.78564072 sigma in 11act. ( 7.83595896 sig out 1act.) RANK 11 NODE 15 --> 9.52238274 sigma in 11act. ( 7.24586487 sig out 1act.) RANK 12 NODE 1 --> 8.48595142 sigma in 11act. ( 7.66019678 sig out 1act.) RANK 13 NODE 5 --> 7.92913628 sigma in 11act. ( 6.77997732 sig out 1act.) RANK 14 NODE 11 --> 6.45768452 sigma in 11act. ( 3.99903178 sig out 1act.) RANK 15 NODE 12 --> 4.6767807 sigma in 11act. ( 2.32975698 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 34.5016785 sigma out 1act.( 38.2988243 sig in 11act.) RANK 2 NODE 3 --> 28.0858078 sigma out 1act.( 35.4015884 sig in 11act.) RANK 3 NODE 10 --> 21.4731102 sigma out 1act.( 26.2476425 sig in 11act.) RANK 4 NODE 13 --> 20.7850914 sigma out 1act.( 19.9136887 sig in 11act.) RANK 5 NODE 4 --> 19.4510288 sigma out 1act.( 22.0129871 sig in 11act.) RANK 6 NODE 6 --> 19.0187893 sigma out 1act.( 17.6968346 sig in 11act.) RANK 7 NODE 8 --> 17.5652542 sigma out 1act.( 21.2162838 sig in 11act.) RANK 8 NODE 9 --> 11.6655941 sigma out 1act.( 11.7901316 sig in 11act.) RANK 9 NODE 2 --> 9.79681206 sigma out 1act.( 12.7537775 sig in 11act.) RANK 10 NODE 7 --> 7.83595896 sigma out 1act.( 9.78564072 sig in 11act.) RANK 11 NODE 1 --> 7.66019678 sigma out 1act.( 8.48595142 sig in 11act.) RANK 12 NODE 15 --> 7.24586487 sigma out 1act.( 9.52238274 sig in 11act.) RANK 13 NODE 5 --> 6.77997732 sigma out 1act.( 7.92913628 sig in 11act.) RANK 14 NODE 11 --> 3.99903178 sigma out 1act.( 6.45768452 sig in 11act.) RANK 15 NODE 12 --> 2.32975698 sigma out 1act.( 4.6767807 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 66.279129 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.53266561 *** contribution from regularisation: 0.00322651397 *** contribution from error: -0.535892129 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49111.7682 -0.550368905 76.089447 EXIT FROM BFGS code FG_LNSRCH 0. -0.545287728 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.534024 *** contribution from regularisation: 0.00306055835 *** contribution from error: -0.537084579 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49237.0131 -0.545287728 24.1719341 EXIT FROM BFGS code NEW_X -49237.0131 -0.545287728 24.1719341 ENTER BFGS code NEW_X -49237.0131 -0.545287728 24.1719341 EXIT FROM BFGS code FG_LNSRCH 0. -0.539862216 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.534422219 *** contribution from regularisation: 0.00297852466 *** contribution from error: -0.537400723 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49273.726 -0.539862216 7.81715584 EXIT FROM BFGS code NEW_X -49273.726 -0.539862216 7.81715584 ENTER BFGS code NEW_X -49273.726 -0.539862216 7.81715584 EXIT FROM BFGS code FG_LNSRCH 0. -0.533693492 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.534609437 *** contribution from regularisation: 0.00297429855 *** contribution from error: -0.537583709 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49290.9907 -0.533693492 4.91266155 EXIT FROM BFGS code NEW_X -49290.9907 -0.533693492 4.91266155 ENTER BFGS code NEW_X -49290.9907 -0.533693492 4.91266155 EXIT FROM BFGS code FG_LNSRCH 0. -0.52248466 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.534986854 *** contribution from regularisation: 0.00309322472 *** contribution from error: -0.538080096 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49325.7863 -0.52248466 -8.24883461 EXIT FROM BFGS code NEW_X -49325.7863 -0.52248466 -8.24883461 ENTER BFGS code NEW_X -49325.7863 -0.52248466 -8.24883461 EXIT FROM BFGS code FG_LNSRCH 0. -0.498404533 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.536041021 *** contribution from regularisation: 0.00322116772 *** contribution from error: -0.539262176 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49422.9809 -0.498404533 -15.1101141 EXIT FROM BFGS code NEW_X -49422.9809 -0.498404533 -15.1101141 ENTER BFGS code NEW_X -49422.9809 -0.498404533 -15.1101141 EXIT FROM BFGS code FG_LNSRCH 0. -0.48417905 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.536661386 *** contribution from regularisation: 0.00338949403 *** contribution from error: -0.540050864 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49480.1774 -0.48417905 25.8623466 EXIT FROM BFGS code NEW_X -49480.1774 -0.48417905 25.8623466 ENTER BFGS code NEW_X -49480.1774 -0.48417905 25.8623466 EXIT FROM BFGS code FG_LNSRCH 0. -0.488615662 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.537549257 *** contribution from regularisation: 0.00300348504 *** contribution from error: -0.540552735 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49562.0394 -0.488615662 12.5305099 EXIT FROM BFGS code NEW_X -49562.0394 -0.488615662 12.5305099 ENTER BFGS code NEW_X -49562.0394 -0.488615662 12.5305099 EXIT FROM BFGS code FG_LNSRCH 0. -0.481942356 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.537678123 *** contribution from regularisation: 0.00316609489 *** contribution from error: -0.540844202 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49573.9254 -0.481942356 -0.0796726122 EXIT FROM BFGS code NEW_X -49573.9254 -0.481942356 -0.0796726122 ENTER BFGS code NEW_X -49573.9254 -0.481942356 -0.0796726122 EXIT FROM BFGS code FG_LNSRCH 0. -0.471929014 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.537981987 *** contribution from regularisation: 0.00320490217 *** contribution from error: -0.541186869 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49601.9419 -0.471929014 3.98606706 EXIT FROM BFGS code NEW_X -49601.9419 -0.471929014 3.98606706 ENTER BFGS code NEW_X -49601.9419 -0.471929014 3.98606706 EXIT FROM BFGS code FG_LNSRCH 0. -0.458283931 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 52.4053612 sigma out 15 active outputs RANK 2 NODE 6 --> 33.0632744 sigma out 15 active outputs RANK 3 NODE 5 --> 29.6302147 sigma out 15 active outputs RANK 4 NODE 9 --> 29.5245209 sigma out 15 active outputs RANK 5 NODE 1 --> 29.3066959 sigma out 15 active outputs RANK 6 NODE 4 --> 29.2659321 sigma out 15 active outputs RANK 7 NODE 10 --> 28.5216446 sigma out 15 active outputs RANK 8 NODE 8 --> 21.1925659 sigma out 15 active outputs RANK 9 NODE 3 --> 19.8074265 sigma out 15 active outputs RANK 10 NODE 11 --> 15.8263807 sigma out 15 active outputs RANK 11 NODE 7 --> 15.3619471 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 46.8385544 sigma in 11act. ( 46.6043167 sig out 1act.) RANK 2 NODE 3 --> 45.489006 sigma in 11act. ( 40.525444 sig out 1act.) RANK 3 NODE 8 --> 39.8185539 sigma in 11act. ( 38.6872292 sig out 1act.) RANK 4 NODE 4 --> 33.9096718 sigma in 11act. ( 33.2079582 sig out 1act.) RANK 5 NODE 13 --> 33.077137 sigma in 11act. ( 40.8227692 sig out 1act.) RANK 6 NODE 10 --> 21.1313019 sigma in 11act. ( 18.6811199 sig out 1act.) RANK 7 NODE 6 --> 16.452776 sigma in 11act. ( 17.5930939 sig out 1act.) RANK 8 NODE 9 --> 14.249362 sigma in 11act. ( 15.69487 sig out 1act.) RANK 9 NODE 2 --> 13.1988544 sigma in 11act. ( 11.551096 sig out 1act.) RANK 10 NODE 5 --> 9.00718975 sigma in 11act. ( 8.24556541 sig out 1act.) RANK 11 NODE 1 --> 8.56277752 sigma in 11act. ( 8.53026295 sig out 1act.) RANK 12 NODE 7 --> 6.54786205 sigma in 11act. ( 4.65637684 sig out 1act.) RANK 13 NODE 15 --> 5.32253122 sigma in 11act. ( 3.50789976 sig out 1act.) RANK 14 NODE 11 --> 4.84735012 sigma in 11act. ( 2.70824027 sig out 1act.) RANK 15 NODE 12 --> 3.11804414 sigma in 11act. ( 0.345482707 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 46.6043167 sigma out 1act.( 46.8385544 sig in 11act.) RANK 2 NODE 13 --> 40.8227692 sigma out 1act.( 33.077137 sig in 11act.) RANK 3 NODE 3 --> 40.525444 sigma out 1act.( 45.489006 sig in 11act.) RANK 4 NODE 8 --> 38.6872292 sigma out 1act.( 39.8185539 sig in 11act.) RANK 5 NODE 4 --> 33.2079582 sigma out 1act.( 33.9096718 sig in 11act.) RANK 6 NODE 10 --> 18.6811199 sigma out 1act.( 21.1313019 sig in 11act.) RANK 7 NODE 6 --> 17.5930939 sigma out 1act.( 16.452776 sig in 11act.) RANK 8 NODE 9 --> 15.69487 sigma out 1act.( 14.249362 sig in 11act.) RANK 9 NODE 2 --> 11.551096 sigma out 1act.( 13.1988544 sig in 11act.) RANK 10 NODE 1 --> 8.53026295 sigma out 1act.( 8.56277752 sig in 11act.) RANK 11 NODE 5 --> 8.24556541 sigma out 1act.( 9.00718975 sig in 11act.) RANK 12 NODE 7 --> 4.65637684 sigma out 1act.( 6.54786205 sig in 11act.) RANK 13 NODE 15 --> 3.50789976 sigma out 1act.( 5.32253122 sig in 11act.) RANK 14 NODE 11 --> 2.70824027 sigma out 1act.( 4.84735012 sig in 11act.) RANK 15 NODE 12 --> 0.345482707 sigma out 1act.( 3.11804414 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 96.4401245 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.538211703 *** contribution from regularisation: 0.00315135438 *** contribution from error: -0.54136306 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49623.1171 -0.458283931 -21.2467842 EXIT FROM BFGS code NEW_X -49623.1171 -0.458283931 -21.2467842 ENTER BFGS code NEW_X -49623.1171 -0.458283931 -21.2467842 EXIT FROM BFGS code FG_LNSRCH 0. -0.456625432 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.538404167 *** contribution from regularisation: 0.00312301051 *** contribution from error: -0.541527152 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49640.8642 -0.456625432 0.708696008 EXIT FROM BFGS code NEW_X -49640.8642 -0.456625432 0.708696008 ENTER BFGS code NEW_X -49640.8642 -0.456625432 0.708696008 EXIT FROM BFGS code FG_LNSRCH 0. -0.448908597 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.538613796 *** contribution from regularisation: 0.00309046218 *** contribution from error: -0.541704237 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49660.1918 -0.448908597 22.5073872 EXIT FROM BFGS code NEW_X -49660.1918 -0.448908597 22.5073872 ENTER BFGS code NEW_X -49660.1918 -0.448908597 22.5073872 EXIT FROM BFGS code FG_LNSRCH 0. -0.436433136 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.538753331 *** contribution from regularisation: 0.00310131256 *** contribution from error: -0.54185462 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49673.0594 -0.436433136 22.7210674 EXIT FROM BFGS code NEW_X -49673.0594 -0.436433136 22.7210674 ENTER BFGS code NEW_X -49673.0594 -0.436433136 22.7210674 EXIT FROM BFGS code FG_LNSRCH 0. -0.407100409 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.538894475 *** contribution from regularisation: 0.00310548232 *** contribution from error: -0.541999936 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49686.0716 -0.407100409 36.0592003 EXIT FROM BFGS code NEW_X -49686.0716 -0.407100409 36.0592003 ENTER BFGS code NEW_X -49686.0716 -0.407100409 36.0592003 EXIT FROM BFGS code FG_LNSRCH 0. -0.391777366 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.539089441 *** contribution from regularisation: 0.00315918331 *** contribution from error: -0.542248607 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49704.0461 -0.391777366 -18.3109055 EXIT FROM BFGS code NEW_X -49704.0461 -0.391777366 -18.3109055 ENTER BFGS code NEW_X -49704.0461 -0.391777366 -18.3109055 EXIT FROM BFGS code FG_LNSRCH 0. -0.394269049 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.539234102 *** contribution from regularisation: 0.00316704088 *** contribution from error: -0.542401135 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49717.3858 -0.394269049 -14.1462326 EXIT FROM BFGS code NEW_X -49717.3858 -0.394269049 -14.1462326 ENTER BFGS code NEW_X -49717.3858 -0.394269049 -14.1462326 EXIT FROM BFGS code FG_LNSRCH 0. -0.368681997 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.538963854 *** contribution from regularisation: 0.00312190945 *** contribution from error: -0.542085767 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49692.4688 -0.368681997 10.1137533 EXIT FROM BFGS code FG_LNSRCH 0. -0.384350508 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.539303124 *** contribution from regularisation: 0.00329136406 *** contribution from error: -0.542594492 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49723.7472 -0.384350508 -4.65748215 EXIT FROM BFGS code NEW_X -49723.7472 -0.384350508 -4.65748215 ENTER BFGS code NEW_X -49723.7472 -0.384350508 -4.65748215 EXIT FROM BFGS code FG_LNSRCH 0. -0.374871671 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.539506912 *** contribution from regularisation: 0.00315234135 *** contribution from error: -0.542659283 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49742.5376 -0.374871671 -26.6928501 EXIT FROM BFGS code NEW_X -49742.5376 -0.374871671 -26.6928501 ENTER BFGS code NEW_X -49742.5376 -0.374871671 -26.6928501 EXIT FROM BFGS code FG_LNSRCH 0. -0.376488268 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 64.729454 sigma out 15 active outputs RANK 2 NODE 6 --> 41.0030518 sigma out 15 active outputs RANK 3 NODE 1 --> 39.0638084 sigma out 15 active outputs RANK 4 NODE 10 --> 34.2040863 sigma out 15 active outputs RANK 5 NODE 5 --> 30.6363163 sigma out 15 active outputs RANK 6 NODE 9 --> 30.4754353 sigma out 15 active outputs RANK 7 NODE 3 --> 25.5986347 sigma out 15 active outputs RANK 8 NODE 4 --> 25.1233959 sigma out 15 active outputs RANK 9 NODE 8 --> 24.654974 sigma out 15 active outputs RANK 10 NODE 7 --> 19.9605675 sigma out 15 active outputs RANK 11 NODE 11 --> 18.7684574 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 59.8694954 sigma in 11act. ( 61.6202431 sig out 1act.) RANK 2 NODE 3 --> 53.2141762 sigma in 11act. ( 48.3223839 sig out 1act.) RANK 3 NODE 8 --> 48.7395554 sigma in 11act. ( 46.6177673 sig out 1act.) RANK 4 NODE 13 --> 40.5394897 sigma in 11act. ( 52.1350288 sig out 1act.) RANK 5 NODE 4 --> 31.6390724 sigma in 11act. ( 30.5274487 sig out 1act.) RANK 6 NODE 10 --> 20.0898838 sigma in 11act. ( 17.9823093 sig out 1act.) RANK 7 NODE 9 --> 19.6679344 sigma in 11act. ( 21.0340652 sig out 1act.) RANK 8 NODE 6 --> 18.6418781 sigma in 11act. ( 19.8595371 sig out 1act.) RANK 9 NODE 2 --> 15.5610752 sigma in 11act. ( 15.1556931 sig out 1act.) RANK 10 NODE 5 --> 11.6541367 sigma in 11act. ( 11.9378033 sig out 1act.) RANK 11 NODE 1 --> 7.92370272 sigma in 11act. ( 8.1714983 sig out 1act.) RANK 12 NODE 7 --> 5.10439539 sigma in 11act. ( 3.63589954 sig out 1act.) RANK 13 NODE 15 --> 4.03544617 sigma in 11act. ( 2.87428403 sig out 1act.) RANK 14 NODE 11 --> 3.99310255 sigma in 11act. ( 2.41574574 sig out 1act.) RANK 15 NODE 12 --> 2.50881386 sigma in 11act. ( 1.20654476 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 61.6202431 sigma out 1act.( 59.8694954 sig in 11act.) RANK 2 NODE 13 --> 52.1350288 sigma out 1act.( 40.5394897 sig in 11act.) RANK 3 NODE 3 --> 48.3223839 sigma out 1act.( 53.2141762 sig in 11act.) RANK 4 NODE 8 --> 46.6177673 sigma out 1act.( 48.7395554 sig in 11act.) RANK 5 NODE 4 --> 30.5274487 sigma out 1act.( 31.6390724 sig in 11act.) RANK 6 NODE 9 --> 21.0340652 sigma out 1act.( 19.6679344 sig in 11act.) RANK 7 NODE 6 --> 19.8595371 sigma out 1act.( 18.6418781 sig in 11act.) RANK 8 NODE 10 --> 17.9823093 sigma out 1act.( 20.0898838 sig in 11act.) RANK 9 NODE 2 --> 15.1556931 sigma out 1act.( 15.5610752 sig in 11act.) RANK 10 NODE 5 --> 11.9378033 sigma out 1act.( 11.6541367 sig in 11act.) RANK 11 NODE 1 --> 8.1714983 sigma out 1act.( 7.92370272 sig in 11act.) RANK 12 NODE 7 --> 3.63589954 sigma out 1act.( 5.10439539 sig in 11act.) RANK 13 NODE 15 --> 2.87428403 sigma out 1act.( 4.03544617 sig in 11act.) RANK 14 NODE 11 --> 2.41574574 sigma out 1act.( 3.99310255 sig in 11act.) RANK 15 NODE 12 --> 1.20654476 sigma out 1act.( 2.50881386 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 116.547234 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.539544582 *** contribution from regularisation: 0.00323773129 *** contribution from error: -0.542782307 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49746.0091 -0.376488268 10.8856611 EXIT FROM BFGS code NEW_X -49746.0091 -0.376488268 10.8856611 ENTER BFGS code NEW_X -49746.0091 -0.376488268 10.8856611 EXIT FROM BFGS code FG_LNSRCH 0. -0.37447238 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.539660454 *** contribution from regularisation: 0.00321154576 *** contribution from error: -0.542872012 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49756.6931 -0.37447238 12.9051352 EXIT FROM BFGS code NEW_X -49756.6931 -0.37447238 12.9051352 ENTER BFGS code NEW_X -49756.6931 -0.37447238 12.9051352 EXIT FROM BFGS code FG_LNSRCH 0. -0.364643842 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.539888263 *** contribution from regularisation: 0.00321998866 *** contribution from error: -0.543108225 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49777.6986 -0.364643842 18.6248684 EXIT FROM BFGS code NEW_X -49777.6986 -0.364643842 18.6248684 ENTER BFGS code NEW_X -49777.6986 -0.364643842 18.6248684 EXIT FROM BFGS code FG_LNSRCH 0. -0.350817055 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.540127933 *** contribution from regularisation: 0.00326544861 *** contribution from error: -0.543393373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49799.7951 -0.350817055 19.4774189 EXIT FROM BFGS code NEW_X -49799.7951 -0.350817055 19.4774189 ENTER BFGS code NEW_X -49799.7951 -0.350817055 19.4774189 EXIT FROM BFGS code FG_LNSRCH 0. -0.317080379 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.537930727 *** contribution from regularisation: 0.00333005027 *** contribution from error: -0.541260779 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49597.2155 -0.317080379 -313.778412 EXIT FROM BFGS code FG_LNSRCH 0. -0.347265482 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.540099382 *** contribution from regularisation: 0.0033480844 *** contribution from error: -0.543447495 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49797.1655 -0.347265482 -8.45084953 EXIT FROM BFGS code FG_LNSRCH 0. -0.350234896 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.540108323 *** contribution from regularisation: 0.00329797878 *** contribution from error: -0.543406308 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49797.9884 -0.350234896 14.9658775 EXIT FROM BFGS code FG_LNSRCH 0. -0.350778788 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.540098906 *** contribution from regularisation: 0.0032954684 *** contribution from error: -0.543394387 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49797.1178 -0.350778788 19.1100979 EXIT FROM BFGS code FG_LNSRCH 0. -0.350816905 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.540097952 *** contribution from regularisation: 0.00329541857 *** contribution from error: -0.543393373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49797.0327 -0.350816905 19.3946228 EXIT FROM BFGS code FG_LNSRCH 0. -0.350817055 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.540098608 *** contribution from regularisation: 0.00329477084 *** contribution from error: -0.543393373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49797.0916 -0.350817055 19.3549957 EXIT FROM BFGS code FG_LNSRCH 0. -0.350817055 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 76.3171463 sigma out 15 active outputs RANK 2 NODE 1 --> 48.5157089 sigma out 15 active outputs RANK 3 NODE 6 --> 47.4518471 sigma out 15 active outputs RANK 4 NODE 10 --> 37.8901443 sigma out 15 active outputs RANK 5 NODE 9 --> 33.8337288 sigma out 15 active outputs RANK 6 NODE 5 --> 33.0727081 sigma out 15 active outputs RANK 7 NODE 3 --> 29.9310093 sigma out 15 active outputs RANK 8 NODE 4 --> 27.6373329 sigma out 15 active outputs RANK 9 NODE 8 --> 25.7661266 sigma out 15 active outputs RANK 10 NODE 7 --> 23.9158573 sigma out 15 active outputs RANK 11 NODE 11 --> 18.6349869 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 72.3329468 sigma in 11act. ( 69.9517899 sig out 1act.) RANK 2 NODE 3 --> 61.2321472 sigma in 11act. ( 54.7346687 sig out 1act.) RANK 3 NODE 8 --> 54.6380577 sigma in 11act. ( 50.4708176 sig out 1act.) RANK 4 NODE 13 --> 47.1624947 sigma in 11act. ( 61.6822205 sig out 1act.) RANK 5 NODE 4 --> 33.19487 sigma in 11act. ( 32.4616814 sig out 1act.) RANK 6 NODE 9 --> 23.5719376 sigma in 11act. ( 24.8566837 sig out 1act.) RANK 7 NODE 6 --> 20.5428467 sigma in 11act. ( 21.409914 sig out 1act.) RANK 8 NODE 10 --> 20.4899521 sigma in 11act. ( 18.4232311 sig out 1act.) RANK 9 NODE 2 --> 17.9240913 sigma in 11act. ( 18.747118 sig out 1act.) RANK 10 NODE 5 --> 14.7909985 sigma in 11act. ( 15.9995031 sig out 1act.) RANK 11 NODE 1 --> 8.13441753 sigma in 11act. ( 7.87767029 sig out 1act.) RANK 12 NODE 7 --> 4.64246225 sigma in 11act. ( 3.33592987 sig out 1act.) RANK 13 NODE 11 --> 3.67681789 sigma in 11act. ( 2.39018106 sig out 1act.) RANK 14 NODE 15 --> 3.32002068 sigma in 11act. ( 2.3267746 sig out 1act.) RANK 15 NODE 12 --> 2.00468063 sigma in 11act. ( 1.06693363 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 69.9517899 sigma out 1act.( 72.3329468 sig in 11act.) RANK 2 NODE 13 --> 61.6822205 sigma out 1act.( 47.1624947 sig in 11act.) RANK 3 NODE 3 --> 54.7346687 sigma out 1act.( 61.2321472 sig in 11act.) RANK 4 NODE 8 --> 50.4708176 sigma out 1act.( 54.6380577 sig in 11act.) RANK 5 NODE 4 --> 32.4616814 sigma out 1act.( 33.19487 sig in 11act.) RANK 6 NODE 9 --> 24.8566837 sigma out 1act.( 23.5719376 sig in 11act.) RANK 7 NODE 6 --> 21.409914 sigma out 1act.( 20.5428467 sig in 11act.) RANK 8 NODE 2 --> 18.747118 sigma out 1act.( 17.9240913 sig in 11act.) RANK 9 NODE 10 --> 18.4232311 sigma out 1act.( 20.4899521 sig in 11act.) RANK 10 NODE 5 --> 15.9995031 sigma out 1act.( 14.7909985 sig in 11act.) RANK 11 NODE 1 --> 7.87767029 sigma out 1act.( 8.13441753 sig in 11act.) RANK 12 NODE 7 --> 3.33592987 sigma out 1act.( 4.64246225 sig in 11act.) RANK 13 NODE 11 --> 2.39018106 sigma out 1act.( 3.67681789 sig in 11act.) RANK 14 NODE 15 --> 2.3267746 sigma out 1act.( 3.32002068 sig in 11act.) RANK 15 NODE 12 --> 1.06693363 sigma out 1act.( 2.00468063 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 131.922104 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.540103734 *** contribution from regularisation: 0.00328962738 *** contribution from error: -0.543393373 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49797.5658 -0.350817055 19.4204865 EXIT FROM BFGS code FG_LNSRCH 0. -0.350817055 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.540093422 *** contribution from regularisation: 0.00329998066 *** contribution from error: -0.543393373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49796.6113 -0.350817055 19.3351269 EXIT FROM BFGS code FG_LNSRCH 0. -0.350817055 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.540102601 *** contribution from regularisation: 0.00329077872 *** contribution from error: -0.543393373 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49797.4597 -0.350817055 19.3333607 EXIT FROM BFGS code NEW_X -49797.4597 -0.350817055 19.3333607 ENTER BFGS code NEW_X -49797.4597 -0.350817055 19.3333607 EXIT FROM BFGS code CONVERGENC -49797.4597 -0.350817055 19.3333607 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 113.960022 sigma out 15 active outputs RANK 2 NODE 1 --> 72.3165512 sigma out 15 active outputs RANK 3 NODE 6 --> 71.7946701 sigma out 15 active outputs RANK 4 NODE 10 --> 57.2372475 sigma out 15 active outputs RANK 5 NODE 9 --> 51.4243431 sigma out 15 active outputs RANK 6 NODE 5 --> 49.0202103 sigma out 15 active outputs RANK 7 NODE 3 --> 45.4239388 sigma out 15 active outputs RANK 8 NODE 4 --> 41.9810333 sigma out 15 active outputs RANK 9 NODE 8 --> 38.1015778 sigma out 15 active outputs RANK 10 NODE 7 --> 35.8300362 sigma out 15 active outputs RANK 11 NODE 11 --> 27.7487926 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 107.425217 sigma in 11act. ( 108.245644 sig out 1act.) RANK 2 NODE 3 --> 92.5278625 sigma in 11act. ( 82.7137985 sig out 1act.) RANK 3 NODE 8 --> 82.0437927 sigma in 11act. ( 78.5685654 sig out 1act.) RANK 4 NODE 13 --> 71.8794327 sigma in 11act. ( 93.2469635 sig out 1act.) RANK 5 NODE 4 --> 49.8643837 sigma in 11act. ( 49.4142532 sig out 1act.) RANK 6 NODE 9 --> 35.3962746 sigma in 11act. ( 37.9654732 sig out 1act.) RANK 7 NODE 10 --> 30.4521713 sigma in 11act. ( 27.8799744 sig out 1act.) RANK 8 NODE 6 --> 30.2565174 sigma in 11act. ( 32.9760246 sig out 1act.) RANK 9 NODE 2 --> 26.8149033 sigma in 11act. ( 28.2821236 sig out 1act.) RANK 10 NODE 5 --> 22.211401 sigma in 11act. ( 23.9965115 sig out 1act.) RANK 11 NODE 1 --> 12.0502386 sigma in 11act. ( 11.785327 sig out 1act.) RANK 12 NODE 7 --> 6.29013395 sigma in 11act. ( 4.96623659 sig out 1act.) RANK 13 NODE 11 --> 4.71770239 sigma in 11act. ( 3.5841291 sig out 1act.) RANK 14 NODE 15 --> 4.39441442 sigma in 11act. ( 3.44521761 sig out 1act.) RANK 15 NODE 12 --> 2.35807991 sigma in 11act. ( 1.57607138 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 108.245644 sigma out 1act.( 107.425217 sig in 11act.) RANK 2 NODE 13 --> 93.2469635 sigma out 1act.( 71.8794327 sig in 11act.) RANK 3 NODE 3 --> 82.7137985 sigma out 1act.( 92.5278625 sig in 11act.) RANK 4 NODE 8 --> 78.5685654 sigma out 1act.( 82.0437927 sig in 11act.) RANK 5 NODE 4 --> 49.4142532 sigma out 1act.( 49.8643837 sig in 11act.) RANK 6 NODE 9 --> 37.9654732 sigma out 1act.( 35.3962746 sig in 11act.) RANK 7 NODE 6 --> 32.9760246 sigma out 1act.( 30.2565174 sig in 11act.) RANK 8 NODE 2 --> 28.2821236 sigma out 1act.( 26.8149033 sig in 11act.) RANK 9 NODE 10 --> 27.8799744 sigma out 1act.( 30.4521713 sig in 11act.) RANK 10 NODE 5 --> 23.9965115 sigma out 1act.( 22.211401 sig in 11act.) RANK 11 NODE 1 --> 11.785327 sigma out 1act.( 12.0502386 sig in 11act.) RANK 12 NODE 7 --> 4.96623659 sigma out 1act.( 6.29013395 sig in 11act.) RANK 13 NODE 11 --> 3.5841291 sigma out 1act.( 4.71770239 sig in 11act.) RANK 14 NODE 15 --> 3.44521761 sigma out 1act.( 4.39441442 sig in 11act.) RANK 15 NODE 12 --> 1.57607138 sigma out 1act.( 2.35807991 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 201.84407 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.540099978 *** contribution from regularisation: 0.00329338713 *** contribution from error: -0.543393373 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30761 Closing output file done