NNInput NNInputs_180.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 174967 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 38631 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 38631 Chosen entries: 38631 Signal fraction: 1 Background fraction: 0.283351 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 38631 Entries to split: 38631 Test with : 19315 Train with : 19315 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 38631 for Signal Prepared event 0 for Signal with 38631 events ====Entry 0 Variable Ht : 181.988 Variable LepAPt : 36.3125 Variable LepBPt : 33.3263 Variable MetSigLeptonsJets : 8.50337 Variable MetSpec : 84.1215 Variable SumEtLeptonsJets : 97.8662 Variable VSumJetLeptonsPt : 93.7481 Variable addEt : 153.761 Variable dPhiLepSumMet : 2.8992 Variable dPhiLeptons : 0.358494 Variable dRLeptons : 0.375835 Variable lep1_E : 49.7842 Variable lep2_E : 42.4469 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2180 Ht = 181.988 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.3125 LepAPt = 36.3125 LepBEt = 33.3264 LepBPt = 33.3263 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 84.1215 MetDelPhi = 2.72772 MetSig = 7.11556 MetSigLeptonsJets = 8.50337 MetSpec = 84.1215 Mjj = 0 MostCentralJetEta = -2.14636 MtllMet = 165.707 Njets = 1 SB = 0 SumEt = 139.764 SumEtJets = 0 SumEtLeptonsJets = 97.8662 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 93.7481 addEt = 153.761 dPhiLepSumMet = 2.8992 dPhiLeptons = 0.358494 dRLeptons = 0.375835 diltype = 49 dimass = 13.013 event = 182 jet1_Et = 28.2274 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 49.7842 lep2_E = 42.4469 rand = 0.999742 run = 167139 weight = 3.11806e-06 ===Show End Prepared event 10000 for Signal with 38631 events Prepared event 20000 for Signal with 38631 events Prepared event 30000 for Signal with 38631 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.277537 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4370 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 174967 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4370 negative weights. Signal fraction: 62.9052353 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 63.2067108 65.6247025 67.2523956 68.5017242 69.6715546 70.7077942 71.5422974 72.4006653 73.2541504 73.9810867 74.6691132 75.3898315 76.1399765 76.8567886 77.5374146 78.2368622 78.882019 79.6752167 80.3598938 81.0680389 81.8240356 82.5562439 83.2698364 84.2462158 85.3004761 86.4991913 87.7081604 88.8597031 90.1981049 91.9664917 93.078804 94.7090302 96.2663727 98.0739136 99.9043579 101.88736 103.564926 105.109909 106.337814 108.180511 110.09066 111.975685 113.908676 115.615456 117.236168 119.159409 120.583168 122.300903 123.990799 125.727478 127.356644 128.897522 130.432861 132.111145 133.720734 135.277252 136.826569 138.297867 139.791534 141.188171 142.608337 144.092163 145.700531 147.355316 148.818207 150.284576 151.780991 153.361511 154.890259 156.361282 158.128357 159.828613 161.421387 163.396149 165.305878 167.165741 169.271225 171.377121 173.467957 175.470932 177.727966 180.277786 183.09549 185.910553 188.994324 192.17897 195.477753 199.070068 203.076324 207.387543 212.312561 217.768585 223.83905 230.632355 238.612579 248.509552 262.525269 282.530121 314.155304 819.677795 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.387394 20.7516136 21.0930347 21.3597717 21.583025 21.8548126 22.1176643 22.3688202 22.5976448 22.7986965 22.9851036 23.2262344 23.4537964 23.6851501 23.9553413 24.2178288 24.4442215 24.6966419 24.93153 25.1795597 25.3620586 25.5956154 25.8295975 26.0427895 26.2561722 26.48493 26.732254 26.9998741 27.2096977 27.4641247 27.6831818 27.9298477 28.1846046 28.4343262 28.6828957 28.9126358 29.1469002 29.4402885 29.7251358 29.9763069 30.2595673 30.5454521 30.8871117 31.1572056 31.4899597 31.8056641 32.0535316 32.346302 32.6830521 33.0424423 33.3875198 33.7749939 34.1014214 34.4563751 34.8273277 35.1922226 35.5347748 35.887085 36.2932701 36.6681061 37.0468826 37.4748611 37.8877983 38.2991829 38.7291718 39.1708412 39.4929504 39.9283676 40.3467865 40.8074265 41.3015747 41.7145729 42.2080612 42.7066345 43.2473259 43.7927933 44.3316345 44.9300117 45.5195999 46.1375427 46.7785988 47.472435 48.1130714 48.8603516 49.6838875 50.459156 51.2545624 52.210125 53.1289062 54.1335144 55.1467285 56.3086319 57.598568 59.0228119 60.6913528 62.78265 65.4108047 69.4828644 77.9678955 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1378231 10.2899494 10.4075432 10.5247726 10.6571693 10.7921686 10.8976374 11.0215235 11.1949482 11.3224545 11.4789143 11.6142292 11.7560501 11.9096184 12.0678396 12.2237558 12.397541 12.576088 12.7558079 12.8995237 13.0739689 13.2610283 13.4521646 13.617527 13.8141537 13.9957485 14.1598969 14.372016 14.5833912 14.794981 15.0118694 15.21105 15.4205179 15.6593208 15.903264 16.1418419 16.4281197 16.6282005 16.8666515 17.0909138 17.3667374 17.6292019 17.9078979 18.1693954 18.4506721 18.7194424 18.9723949 19.2040253 19.4560776 19.7492065 20.0354805 20.250103 20.4771633 20.710331 20.9569283 21.1986713 21.4459877 21.7130413 21.9523697 22.1302605 22.4077454 22.6645412 22.8889236 23.151947 23.4151306 23.6633034 23.922123 24.1722565 24.4481049 24.7262802 25.0240421 25.2821846 25.5528984 25.8432159 26.1185265 26.4014912 26.6768608 26.9583225 27.2781601 27.5951309 27.8810177 28.1679611 28.5182476 28.8759956 29.2442703 29.6381416 30.0392036 30.461998 30.9059505 31.3965549 31.9356022 32.5610771 33.316391 34.0012474 34.8804588 35.9085693 37.1799469 39.2448997 42.8427963 72.314209 ------------------------------ Transdef: Tab for variable 5 1.10023916 2.72913837 3.16950655 3.4953413 3.77688026 3.9822731 4.13927317 4.2716589 4.4034605 4.52803802 4.62914658 4.71123409 4.81438637 4.91585541 5.00663853 5.07683086 5.15498495 5.22332382 5.29024124 5.35872889 5.43094921 5.47939301 5.53719711 5.5795207 5.63389492 5.68997526 5.74647713 5.80330563 5.85581684 5.90441465 5.95191765 5.9998498 6.04499865 6.10191441 6.14543772 6.19825172 6.2346735 6.27373409 6.30564213 6.35869551 6.40645599 6.45612335 6.49952984 6.54034758 6.57952118 6.62972832 6.67214394 6.72430325 6.76956844 6.81729841 6.86432076 6.91457415 6.96656656 7.00714207 7.06366253 7.11257696 7.16165972 7.21108723 7.25866985 7.31490612 7.37633228 7.43671227 7.48364782 7.53161621 7.58921814 7.65906668 7.71707535 7.77640486 7.83774042 7.89248323 7.95322418 8.0172348 8.08602905 8.1447258 8.20477962 8.26668739 8.33552647 8.40241432 8.46923065 8.53445911 8.59837723 8.67406082 8.74742126 8.81408691 8.89471054 8.96763611 9.06056499 9.1453495 9.23791695 9.32766724 9.42963028 9.5385704 9.66858292 9.80736351 9.97313118 10.1567326 10.3943272 10.6668625 11.1532555 11.9455109 21.7385216 ------------------------------ Transdef: Tab for variable 6 15.0025911 21.2650299 25.43297 26.6050797 27.4933033 28.5203896 29.4351826 30.2483635 31.0532799 31.740736 32.319088 32.8955765 33.379982 33.8301773 34.3514175 34.7852783 35.2223129 35.6782913 36.0718307 36.4820824 36.860199 37.2231064 37.6947784 38.0377655 38.3770256 38.7732811 39.2001953 39.6385078 40.0873604 40.4455795 40.8502808 41.2559662 41.7054329 42.1952362 42.6988754 43.1111412 43.5799484 43.9577141 44.5095711 45.0194778 45.6578331 46.3542786 46.9319496 47.6474991 48.2372055 48.9364243 49.7630806 50.4227028 51.1219673 51.9089241 52.7451782 53.5382004 54.4168625 55.3131943 56.0784454 56.8960762 57.6042404 58.4556732 59.0764389 59.8016243 60.6411133 61.3557014 62.1755524 63.023571 63.872818 64.7013016 65.4375992 66.1633606 66.9295502 67.7329712 68.525795 69.3181305 70.0695496 70.9733582 71.7922211 72.530014 73.4235229 74.29039 75.1689606 76.1020966 76.987442 78.0447083 79.0206528 79.9219971 80.9941406 82.1543732 83.2680359 84.3556747 85.7469177 87.1427383 88.8106842 90.6989441 92.59095 94.8713837 97.4931793 100.873352 104.854675 110.028625 117.387459 132.046173 311.985382 ------------------------------ Transdef: Tab for variable 7 30.1648712 32.6106987 33.6401672 34.3046951 34.9787445 35.5296707 36.0585861 36.5417938 36.9594269 37.3614426 37.7353783 38.0463562 38.3389435 38.7351837 39.0190201 39.3174744 39.6557236 40.0238838 40.3583221 40.7060852 41.1134911 41.4829941 41.9662018 42.3329201 42.7558823 43.3294907 43.9794693 44.5937653 45.1821976 45.9344788 46.8449554 47.802063 48.5947914 49.408432 50.6708221 51.7066116 52.6939087 53.6935654 54.7884674 55.8784714 56.8744888 57.8345032 58.751545 59.7408142 60.7073441 61.385498 62.2579651 63.0591354 63.884716 64.8203506 65.7220078 66.6530685 67.5922089 68.4543762 69.3551788 70.3186798 71.1635132 71.970459 72.8657074 73.8136063 74.7087097 75.7590027 76.698761 77.5931015 78.5828247 79.5677643 80.5488663 81.7119522 82.7659454 83.9848328 85.2063141 86.4592896 87.8884583 89.3061676 90.9065247 92.5299072 94.1069794 95.7231293 97.4182739 99.2165985 100.998009 102.942596 104.961975 107.075958 109.200569 111.53215 114.230957 116.958252 119.927803 123.016937 126.662552 130.216705 134.811859 139.39505 145.815674 152.412292 160.796265 170.789886 185.601379 213.318924 523.715759 ------------------------------ Transdef: Tab for variable 8 1.91902053 25.9328251 29.4683399 31.0628471 32.102478 32.8365402 33.4315109 33.9228287 34.3942184 34.8829346 35.2658844 35.6802139 36.0450401 36.3621216 36.722023 37.0727806 37.3388519 37.6385727 37.9450073 38.2060165 38.4903793 38.8146362 39.0650482 39.3552246 39.6177826 39.9487152 40.3164864 40.710762 41.1156845 41.4037094 41.8398132 42.2986145 42.7145538 43.1811829 43.6735535 44.0957527 44.6438141 45.2190437 45.8323059 46.4419594 47.0671997 47.823967 48.3500519 49.0119019 49.6454544 50.451973 51.1115723 51.8108177 52.5876846 53.32724 54.0597267 54.8057175 55.5996017 56.3595085 57.0908279 57.7531433 58.4115295 59.1130981 59.8915405 60.6192322 61.1387482 61.8645859 62.5636559 63.2341805 63.8911095 64.5788498 65.3498459 66.1235428 66.813324 67.5080109 68.2054596 68.9392548 69.7159271 70.436142 71.2050323 71.9387283 72.7036514 73.443924 74.2299042 75.0858154 75.8870392 76.7641296 77.7383118 78.617012 79.572731 80.6003189 81.7433319 82.9026794 84.2200928 85.5219498 87.0053635 88.8339233 90.8098068 93.0899811 95.8004227 99.568367 103.664413 109.208176 117.20903 132.088486 363.290375 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.8013687 65.18647 66.8847656 67.9255524 68.8892975 70.0835342 70.9230194 71.666748 72.5295105 73.2558441 73.9272232 74.5566254 75.1844864 75.8129501 76.4943924 77.063324 77.6614227 78.2636871 78.8243408 79.49823 80.014328 80.7205811 81.3448486 82.05159 82.5732651 83.2143555 83.9670563 84.7567444 85.6046295 86.5706329 87.4512177 88.562851 89.4252396 90.6218262 91.9674072 92.9788666 94.247879 95.569458 96.8718414 98.5340195 99.8933411 101.372398 102.924835 104.360802 105.624275 106.896667 108.448807 109.769371 111.165466 112.428276 113.992813 115.429993 116.718796 118.176086 119.505219 120.528275 121.959312 123.293564 124.530457 125.843544 127.155426 128.463074 129.747803 131.025055 132.352966 133.608002 134.832367 136.109039 137.401505 138.631821 139.825836 141.051102 142.190445 143.364182 144.44696 145.689911 146.9104 148.147705 149.255585 150.493439 151.716034 152.922668 154.13739 155.382233 156.766968 158.199402 159.692612 161.080872 162.850861 164.64679 166.531967 168.379196 170.583954 172.872269 175.622009 179.202057 183.806946 190.962173 205.389175 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.12388539 1.44619572 1.67002821 1.8241725 1.93274951 2.03391147 2.11070395 2.17862177 2.24034309 2.29304504 2.33846951 2.38736916 2.42515349 2.46115351 2.49443388 2.52649546 2.55496669 2.58177042 2.60818577 2.63342381 2.65458155 2.67520189 2.69683242 2.71583223 2.73499203 2.7520752 2.76935244 2.78393865 2.79835796 2.81158352 2.82617712 2.83708072 2.84601974 2.85710669 2.86719894 2.87642837 2.88589931 2.89505386 2.90228391 2.91175938 2.91929579 2.92525291 2.93263388 2.93995929 2.9473474 2.9544816 2.96087909 2.96712971 2.97301722 2.9785614 2.98340559 2.98883677 2.99395657 2.99973011 3.00421309 3.00914192 3.01375437 3.0178957 3.02272463 3.02691388 3.03056359 3.03442097 3.03782892 3.04180932 3.04503679 3.04894853 3.05254769 3.05625725 3.05896425 3.06198478 3.06551838 3.06865883 3.07202053 3.07483864 3.07809067 3.08077908 3.08350205 3.08656621 3.08964133 3.09249926 3.09502649 3.09803176 3.10091591 3.10332441 3.10555124 3.10833549 3.11038709 3.11291242 3.11525726 3.11780143 3.12052536 3.12295318 3.12557817 3.12790489 3.13011217 3.13183165 3.13400054 3.13649917 3.1390357 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.21593475E-05 0.00613462785 0.0126032829 0.0197862387 0.0254375935 0.0323018506 0.0394802094 0.0467858016 0.0531039238 0.0596863031 0.0664530694 0.0738456249 0.080612421 0.0876978487 0.0949755311 0.101865768 0.108079851 0.115010276 0.122522593 0.130108714 0.137138218 0.14427644 0.15141964 0.158483699 0.164910823 0.170424998 0.175962925 0.18219471 0.188031077 0.19413799 0.199647665 0.204735771 0.209860802 0.214770913 0.220335245 0.225511432 0.230416343 0.235492527 0.241013095 0.245862484 0.250915289 0.256101131 0.260900497 0.265614927 0.270387173 0.275458932 0.280115962 0.284965992 0.290021002 0.295278668 0.300754279 0.305967659 0.311085045 0.316622734 0.322658896 0.327871799 0.333247155 0.33876735 0.344031811 0.350314438 0.356097609 0.360887706 0.366641402 0.372070312 0.377747893 0.384065151 0.38953805 0.395210147 0.401198 0.407746792 0.414031744 0.42003271 0.426438332 0.432424128 0.439745903 0.44675827 0.453688979 0.46033752 0.467536211 0.474757552 0.481477261 0.490072966 0.498917282 0.508115768 0.517093897 0.526030421 0.536040187 0.54715097 0.557551503 0.571406066 0.584785461 0.602121115 0.618186593 0.636249304 0.654065609 0.674711108 0.702717721 0.735538483 0.777952909 0.828610063 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200022802 0.211915046 0.222089052 0.231752425 0.239967555 0.247795925 0.255445808 0.262346506 0.268449485 0.274954677 0.280899316 0.286703289 0.292680234 0.29893437 0.304241121 0.309900165 0.314789534 0.320460021 0.325258791 0.330114394 0.335096359 0.340889215 0.345573425 0.349879891 0.35431236 0.359709263 0.36447975 0.369443119 0.374242157 0.379093081 0.384406507 0.389220923 0.393626332 0.398462117 0.402219653 0.405906558 0.410137594 0.413655758 0.41719678 0.420693338 0.424983829 0.428906709 0.432572156 0.436474234 0.439764202 0.443436027 0.447051883 0.451202869 0.455348551 0.45945102 0.462812185 0.466823459 0.470693856 0.474835217 0.477708519 0.481841981 0.48559323 0.490487337 0.495178461 0.499168992 0.50328809 0.507715523 0.512206197 0.517570496 0.523669541 0.52861762 0.533775568 0.539529562 0.544962585 0.550936162 0.557062864 0.562617421 0.568822682 0.574784875 0.58054328 0.587538242 0.593144655 0.599611521 0.605900586 0.613181889 0.620465994 0.62922889 0.637720525 0.646561623 0.654720902 0.663341522 0.673144579 0.681561828 0.691781402 0.702194691 0.71513325 0.726984143 0.739192069 0.753482223 0.769428134 0.78617382 0.80266422 0.824978769 0.86005801 0.902295589 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0075798 21.6111069 22.4385796 23.1161423 23.7136536 24.2899113 24.8446198 25.330986 25.7939949 26.2686577 26.8185768 27.2657928 27.6218376 28.0626583 28.5233917 28.8696442 29.2266254 29.6273956 29.9842262 30.3457603 30.6889267 31.0298538 31.3990917 31.7868958 32.1440659 32.4876022 32.8474274 33.2370529 33.6176987 34.054451 34.4505692 34.792305 35.1170883 35.4662933 35.8413773 36.1845779 36.545536 36.9819412 37.3768997 37.8077698 38.2572784 38.6294632 39.0433655 39.5050049 39.9318085 40.3457794 40.8105469 41.2732124 41.6747742 42.1312103 42.5935822 43.0059013 43.3944092 43.8730774 44.304863 44.7890778 45.2707367 45.775341 46.3001328 46.8003426 47.3431473 47.7860069 48.314949 48.8339157 49.3721237 49.9124756 50.5507889 51.0929718 51.6542511 52.3102913 52.9258957 53.6326218 54.2287521 54.9136124 55.5189972 56.2049789 56.9359741 57.6980743 58.5130615 59.1196518 59.9502258 60.7254944 61.6957245 62.7354431 63.6947517 64.6952972 65.8794403 67.1318741 68.3816681 69.9380798 71.3280487 73.0451202 75.1130829 77.5750122 80.0987778 82.9952393 86.8401718 90.3793793 96.0778351 106.400887 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.7376366 11.219717 11.5708952 11.8661156 12.1938877 12.5669947 12.9439812 13.3081656 13.6687336 13.9436016 14.2960196 14.5616617 14.8965397 15.2158546 15.5272961 15.8038511 16.1657944 16.4651833 16.7781811 17.0291023 17.3782501 17.7299652 17.9710369 18.296278 18.6434326 18.9166985 19.16959 19.4610424 19.7672691 20.0859184 20.3803787 20.6365833 20.9094887 21.1967506 21.4451561 21.7274857 21.96735 22.2100964 22.5343323 22.8261719 23.0982628 23.3749447 23.6325035 23.8840694 24.1531296 24.4271717 24.6905251 24.9764729 25.2422142 25.5012932 25.7343788 26.0065746 26.2983437 26.543108 26.8137913 27.0936623 27.3995514 27.6639442 27.9443741 28.2175598 28.5043297 28.7749119 29.0551891 29.3671494 29.6632214 29.9745884 30.2789307 30.5611439 30.871376 31.1738052 31.5043964 31.8208542 32.2079315 32.5542755 32.9053574 33.3217926 33.6269417 33.9905167 34.3919907 34.8567009 35.3487396 35.8508911 36.3393936 36.8940544 37.4362717 37.9784698 38.6231537 39.3880653 40.2037086 40.9205475 41.8048286 42.9200172 44.215683 45.3322906 46.9830818 48.871376 51.7106094 55.2637711 62.4185448 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 66.2 52.3 53.7 32.2 50.3 64.0 56.4 64.6 -25.7 -21.2 -41.8 20.5 26.3 2 66.2 100.0 68.8 60.2 40.9 71.5 94.4 77.6 92.2 -42.1 -28.9 -53.2 37.8 34.3 3 52.3 68.8 100.0 48.2 18.9 41.2 70.8 59.5 76.1 -12.3 -30.9 -59.9 68.0 27.2 4 53.7 60.2 48.2 100.0 18.7 38.0 61.6 52.8 65.1 -11.8 -33.8 -64.3 24.6 71.5 5 32.2 40.9 18.9 18.7 100.0 85.3 13.5 60.9 61.1 22.8 -12.3 -17.2 4.6 6.9 6 50.3 71.5 41.2 38.0 85.3 100.0 50.8 80.7 81.4 -6.4 -20.2 -33.9 18.6 19.3 7 64.0 94.4 70.8 61.6 13.5 50.8 100.0 68.9 80.9 -51.1 -27.4 -53.4 40.8 36.6 8 56.4 77.6 59.5 52.8 60.9 80.7 68.9 100.0 85.2 -9.5 -28.2 -48.1 33.1 31.2 9 64.6 92.2 76.1 65.1 61.1 81.4 80.9 85.2 100.0 -17.9 -32.5 -59.5 44.1 38.7 10 -25.7 -42.1 -12.3 -11.8 22.8 -6.4 -51.1 -9.5 -17.9 100.0 2.4 7.9 -3.0 -4.6 11 -21.2 -28.9 -30.9 -33.8 -12.3 -20.2 -27.4 -28.2 -32.5 2.4 100.0 55.2 -16.4 -23.1 12 -41.8 -53.2 -59.9 -64.3 -17.2 -33.9 -53.4 -48.1 -59.5 7.9 55.2 100.0 -33.6 -39.4 13 20.5 37.8 68.0 24.6 4.6 18.6 40.8 33.1 44.1 -3.0 -16.4 -33.6 100.0 48.6 14 26.3 34.3 27.2 71.5 6.9 19.3 36.6 31.2 38.7 -4.6 -23.1 -39.4 48.6 100.0 TOTAL CORRELATION TO TARGET (diagonal) 170.220301 TOTAL CORRELATION OF ALL VARIABLES 72.49731 ROUND 1: MAX CORR ( 72.4958537) AFTER KILLING INPUT VARIABLE 8 CONTR 0.459515513 ROUND 2: MAX CORR ( 72.4934758) AFTER KILLING INPUT VARIABLE 6 CONTR 0.587179277 ROUND 3: MAX CORR ( 72.4863342) AFTER KILLING INPUT VARIABLE 11 CONTR 1.01753702 ROUND 4: MAX CORR ( 72.4755399) AFTER KILLING INPUT VARIABLE 2 CONTR 1.25090379 ROUND 5: MAX CORR ( 72.4359484) AFTER KILLING INPUT VARIABLE 14 CONTR 2.39525789 ROUND 6: MAX CORR ( 72.3647771) AFTER KILLING INPUT VARIABLE 12 CONTR 3.210244 ROUND 7: MAX CORR ( 72.0748199) AFTER KILLING INPUT VARIABLE 10 CONTR 6.47157572 ROUND 8: MAX CORR ( 71.2082098) AFTER KILLING INPUT VARIABLE 13 CONTR 11.1431827 ROUND 9: MAX CORR ( 70.1627918) AFTER KILLING INPUT VARIABLE 9 CONTR 12.1569648 ROUND 10: MAX CORR ( 69.9283264) AFTER KILLING INPUT VARIABLE 3 CONTR 5.73118843 ROUND 11: MAX CORR ( 68.2800185) AFTER KILLING INPUT VARIABLE 4 CONTR 15.0933726 ROUND 12: MAX CORR ( 64.0145007) AFTER KILLING INPUT VARIABLE 5 CONTR 23.755097 LAST REMAINING VARIABLE: 7 total correlation to target: 72.49731 % total significance: 127.314936 sigma correlations of single variables to target: variable 2: 66.2016643 % , in sigma: 116.258944 variable 3: 52.2657065 % , in sigma: 91.7855448 variable 4: 53.6973126 % , in sigma: 94.2996359 variable 5: 32.1555812 % , in sigma: 56.4694852 variable 6: 50.267522 % , in sigma: 88.2764666 variable 7: 64.0145007 % , in sigma: 112.417993 variable 8: 56.4267208 % , in sigma: 99.0928405 variable 9: 64.571405 % , in sigma: 113.395991 variable 10: -25.7074568 % , in sigma: 45.1457196 variable 11: -21.2053787 % , in sigma: 37.2394705 variable 12: -41.7717288 % , in sigma: 73.3567218 variable 13: 20.4860538 % , in sigma: 35.9762402 variable 14: 26.2675686 % , in sigma: 46.1293505 variables sorted by significance: 1 most relevant variable 7 corr 64.0145035 , in sigma: 112.417998 2 most relevant variable 5 corr 23.7550964 , in sigma: 41.7171146 3 most relevant variable 4 corr 15.0933723 , in sigma: 26.505973 4 most relevant variable 3 corr 5.7311883 , in sigma: 10.0647303 5 most relevant variable 9 corr 12.1569653 , in sigma: 21.3492509 6 most relevant variable 13 corr 11.1431828 , in sigma: 19.5689137 7 most relevant variable 10 corr 6.47157574 , in sigma: 11.3649493 8 most relevant variable 12 corr 3.21024394 , in sigma: 5.63761612 9 most relevant variable 14 corr 2.39525795 , in sigma: 4.20639212 10 most relevant variable 2 corr 1.25090384 , in sigma: 2.19675383 11 most relevant variable 11 corr 1.017537 , in sigma: 1.78693055 12 most relevant variable 6 corr 0.587179303 , in sigma: 1.0311651 13 most relevant variable 8 corr 0.459515512 , in sigma: 0.806970468 global correlations between input variables: variable 2: 99.2294042 % variable 3: 93.8923909 % variable 4: 91.7989699 % variable 5: 95.7635733 % variable 6: 95.1929318 % variable 7: 98.8505203 % variable 8: 90.6246123 % variable 9: 98.89158 % variable 10: 71.7841943 % variable 11: 56.2006101 % variable 12: 78.6565389 % variable 13: 86.5057729 % variable 14: 87.7114234 % significance loss when removing single variables: variable 2: corr = 1.41348661 % , sigma = 2.48227083 variable 3: corr = 14.2052056 % , sigma = 24.9462338 variable 4: corr = 14.3240267 % , sigma = 25.1548995 variable 5: corr = 14.5995024 % , sigma = 25.6386715 variable 6: corr = 0.712737582 % , sigma = 1.25166216 variable 7: corr = 7.98666072 % , sigma = 14.0256404 variable 8: corr = 0.459515513 % , sigma = 0.806970471 variable 9: corr = 9.66535812 % , sigma = 16.9736567 variable 10: corr = 6.1273386 % , sigma = 10.760423 variable 11: corr = 1.04653004 % , sigma = 1.8378462 variable 12: corr = 2.55965507 % , sigma = 4.49509537 variable 13: corr = 6.12487612 % , sigma = 10.7560986 variable 14: corr = 2.28885929 % , sigma = 4.01954189 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 23.7288265 sigma out 15 active outputs RANK 2 NODE 6 --> 22.0110283 sigma out 15 active outputs RANK 3 NODE 7 --> 21.3384476 sigma out 15 active outputs RANK 4 NODE 8 --> 19.9541893 sigma out 15 active outputs RANK 5 NODE 2 --> 16.8683357 sigma out 15 active outputs RANK 6 NODE 4 --> 16.7953014 sigma out 15 active outputs RANK 7 NODE 9 --> 14.5384378 sigma out 15 active outputs RANK 8 NODE 3 --> 13.7605 sigma out 15 active outputs RANK 9 NODE 5 --> 12.3473692 sigma out 15 active outputs RANK 10 NODE 10 --> 11.9796181 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 28.6948185 sigma in 10act. ( 28.8937435 sig out 1act.) RANK 2 NODE 8 --> 24.1033878 sigma in 10act. ( 22.7286835 sig out 1act.) RANK 3 NODE 3 --> 22.5251045 sigma in 10act. ( 20.8870373 sig out 1act.) RANK 4 NODE 6 --> 15.131999 sigma in 10act. ( 16.1917038 sig out 1act.) RANK 5 NODE 7 --> 14.8444223 sigma in 10act. ( 13.3412085 sig out 1act.) RANK 6 NODE 11 --> 14.3879023 sigma in 10act. ( 17.5880756 sig out 1act.) RANK 7 NODE 9 --> 13.7331877 sigma in 10act. ( 15.2231321 sig out 1act.) RANK 8 NODE 15 --> 11.604495 sigma in 10act. ( 12.5980921 sig out 1act.) RANK 9 NODE 12 --> 8.61734676 sigma in 10act. ( 12.4517975 sig out 1act.) RANK 10 NODE 5 --> 8.23633671 sigma in 10act. ( 12.0333223 sig out 1act.) RANK 11 NODE 10 --> 8.0140543 sigma in 10act. ( 7.07304192 sig out 1act.) RANK 12 NODE 4 --> 6.72624063 sigma in 10act. ( 7.15811443 sig out 1act.) RANK 13 NODE 13 --> 3.71392822 sigma in 10act. ( 2.97203708 sig out 1act.) RANK 14 NODE 1 --> 2.43045354 sigma in 10act. ( 3.56119347 sig out 1act.) RANK 15 NODE 14 --> 1.31530452 sigma in 10act. ( 1.73230863 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 28.8937435 sigma out 1act.( 28.6948185 sig in 10act.) RANK 2 NODE 8 --> 22.7286835 sigma out 1act.( 24.1033878 sig in 10act.) RANK 3 NODE 3 --> 20.8870373 sigma out 1act.( 22.5251045 sig in 10act.) RANK 4 NODE 11 --> 17.5880756 sigma out 1act.( 14.3879023 sig in 10act.) RANK 5 NODE 6 --> 16.1917038 sigma out 1act.( 15.131999 sig in 10act.) RANK 6 NODE 9 --> 15.2231321 sigma out 1act.( 13.7331877 sig in 10act.) RANK 7 NODE 7 --> 13.3412085 sigma out 1act.( 14.8444223 sig in 10act.) RANK 8 NODE 15 --> 12.5980921 sigma out 1act.( 11.604495 sig in 10act.) RANK 9 NODE 12 --> 12.4517975 sigma out 1act.( 8.61734676 sig in 10act.) RANK 10 NODE 5 --> 12.0333223 sigma out 1act.( 8.23633671 sig in 10act.) RANK 11 NODE 4 --> 7.15811443 sigma out 1act.( 6.72624063 sig in 10act.) RANK 12 NODE 10 --> 7.07304192 sigma out 1act.( 8.0140543 sig in 10act.) RANK 13 NODE 1 --> 3.56119347 sigma out 1act.( 2.43045354 sig in 10act.) RANK 14 NODE 13 --> 2.97203708 sigma out 1act.( 3.71392822 sig in 10act.) RANK 15 NODE 14 --> 1.73230863 sigma out 1act.( 1.31530452 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 57.9076462 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 25.3678436 sigma out 15 active outputs RANK 2 NODE 1 --> 22.6973 sigma out 15 active outputs RANK 3 NODE 6 --> 21.5860844 sigma out 15 active outputs RANK 4 NODE 7 --> 20.5732689 sigma out 15 active outputs RANK 5 NODE 8 --> 20.0149899 sigma out 15 active outputs RANK 6 NODE 4 --> 17.2175121 sigma out 15 active outputs RANK 7 NODE 9 --> 14.4025745 sigma out 15 active outputs RANK 8 NODE 5 --> 13.9759207 sigma out 15 active outputs RANK 9 NODE 3 --> 13.7065535 sigma out 15 active outputs RANK 10 NODE 10 --> 11.5957012 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 27.0767345 sigma in 10act. ( 26.206007 sig out 1act.) RANK 2 NODE 8 --> 20.1626301 sigma in 10act. ( 20.5893211 sig out 1act.) RANK 3 NODE 3 --> 18.1775532 sigma in 10act. ( 17.8890858 sig out 1act.) RANK 4 NODE 11 --> 17.2290077 sigma in 10act. ( 17.1231194 sig out 1act.) RANK 5 NODE 9 --> 16.0434856 sigma in 10act. ( 14.2810974 sig out 1act.) RANK 6 NODE 6 --> 15.7652979 sigma in 10act. ( 15.2192917 sig out 1act.) RANK 7 NODE 12 --> 14.4586058 sigma in 10act. ( 13.2490368 sig out 1act.) RANK 8 NODE 5 --> 13.8668318 sigma in 10act. ( 13.2106838 sig out 1act.) RANK 9 NODE 15 --> 13.0433159 sigma in 10act. ( 11.7901335 sig out 1act.) RANK 10 NODE 14 --> 12.601263 sigma in 10act. ( 4.82127333 sig out 1act.) RANK 11 NODE 7 --> 12.5276957 sigma in 10act. ( 11.7038021 sig out 1act.) RANK 12 NODE 1 --> 11.5205154 sigma in 10act. ( 7.36501312 sig out 1act.) RANK 13 NODE 10 --> 8.03596306 sigma in 10act. ( 6.22861671 sig out 1act.) RANK 14 NODE 4 --> 7.98259211 sigma in 10act. ( 7.13321018 sig out 1act.) RANK 15 NODE 13 --> 6.99576378 sigma in 10act. ( 2.76802969 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 26.206007 sigma out 1act.( 27.0767345 sig in 10act.) RANK 2 NODE 8 --> 20.5893211 sigma out 1act.( 20.1626301 sig in 10act.) RANK 3 NODE 3 --> 17.8890858 sigma out 1act.( 18.1775532 sig in 10act.) RANK 4 NODE 11 --> 17.1231194 sigma out 1act.( 17.2290077 sig in 10act.) RANK 5 NODE 6 --> 15.2192917 sigma out 1act.( 15.7652979 sig in 10act.) RANK 6 NODE 9 --> 14.2810974 sigma out 1act.( 16.0434856 sig in 10act.) RANK 7 NODE 12 --> 13.2490368 sigma out 1act.( 14.4586058 sig in 10act.) RANK 8 NODE 5 --> 13.2106838 sigma out 1act.( 13.8668318 sig in 10act.) RANK 9 NODE 15 --> 11.7901335 sigma out 1act.( 13.0433159 sig in 10act.) RANK 10 NODE 7 --> 11.7038021 sigma out 1act.( 12.5276957 sig in 10act.) RANK 11 NODE 1 --> 7.36501312 sigma out 1act.( 11.5205154 sig in 10act.) RANK 12 NODE 4 --> 7.13321018 sigma out 1act.( 7.98259211 sig in 10act.) RANK 13 NODE 10 --> 6.22861671 sigma out 1act.( 8.03596306 sig in 10act.) RANK 14 NODE 14 --> 4.82127333 sigma out 1act.( 12.601263 sig in 10act.) RANK 15 NODE 13 --> 2.76802969 sigma out 1act.( 6.99576378 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 54.4090614 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.462610543 *** contribution from regularisation: 0.00484378915 *** contribution from error: -0.467454344 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.521853924 *** contribution from regularisation: 0.00269372319 *** contribution from error: -0.524547637 *********************************************** -----------------> Test sample ENTER BFGS code START -45662.0975 0.207150728 -0.389219046 EXIT FROM BFGS code FG_START 0. 0.207150728 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.552642107 *** contribution from regularisation: 0.00262946892 *** contribution from error: -0.555271566 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48346.7914 0.207150728 -240.226303 EXIT FROM BFGS code FG_LNSRCH 0. 0.13230516 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.571416914 *** contribution from regularisation: 0.00324052107 *** contribution from error: -0.57465744 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49989.2678 0.13230516 -70.8693542 EXIT FROM BFGS code NEW_X -49989.2678 0.13230516 -70.8693542 ENTER BFGS code NEW_X -49989.2678 0.13230516 -70.8693542 EXIT FROM BFGS code FG_LNSRCH 0. 0.114412181 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.573705196 *** contribution from regularisation: 0.0030939756 *** contribution from error: -0.576799154 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50189.4542 0.114412181 -13.4127731 EXIT FROM BFGS code NEW_X -50189.4542 0.114412181 -13.4127731 ENTER BFGS code NEW_X -50189.4542 0.114412181 -13.4127731 EXIT FROM BFGS code FG_LNSRCH 0. 0.107777655 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.574392974 *** contribution from regularisation: 0.00295617804 *** contribution from error: -0.577349126 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50249.6213 0.107777655 4.14914274 EXIT FROM BFGS code NEW_X -50249.6213 0.107777655 4.14914274 ENTER BFGS code NEW_X -50249.6213 0.107777655 4.14914274 EXIT FROM BFGS code FG_LNSRCH 0. 0.10670314 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.574586928 *** contribution from regularisation: 0.0028948416 *** contribution from error: -0.577481747 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50266.5876 0.10670314 -1.007604 EXIT FROM BFGS code NEW_X -50266.5876 0.10670314 -1.007604 ENTER BFGS code NEW_X -50266.5876 0.10670314 -1.007604 EXIT FROM BFGS code FG_LNSRCH 0. 0.100200713 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.57472223 *** contribution from regularisation: 0.00283924537 *** contribution from error: -0.577561498 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50278.4263 0.100200713 -1.83224857 EXIT FROM BFGS code NEW_X -50278.4263 0.100200713 -1.83224857 ENTER BFGS code NEW_X -50278.4263 0.100200713 -1.83224857 EXIT FROM BFGS code FG_LNSRCH 0. 0.07570678 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.575011671 *** contribution from regularisation: 0.00261127762 *** contribution from error: -0.57762295 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50303.7444 0.07570678 -13.471529 EXIT FROM BFGS code NEW_X -50303.7444 0.07570678 -13.471529 ENTER BFGS code NEW_X -50303.7444 0.07570678 -13.471529 EXIT FROM BFGS code FG_LNSRCH 0. 0.00568769453 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 34.2550926 sigma out 15 active outputs RANK 2 NODE 1 --> 20.957365 sigma out 15 active outputs RANK 3 NODE 8 --> 17.0897903 sigma out 15 active outputs RANK 4 NODE 6 --> 10.7169333 sigma out 15 active outputs RANK 5 NODE 4 --> 10.3602562 sigma out 15 active outputs RANK 6 NODE 5 --> 10.0053244 sigma out 15 active outputs RANK 7 NODE 10 --> 9.48614216 sigma out 15 active outputs RANK 8 NODE 9 --> 9.40330791 sigma out 15 active outputs RANK 9 NODE 7 --> 8.06587315 sigma out 15 active outputs RANK 10 NODE 3 --> 8.03277206 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 25.3453178 sigma in 10act. ( 19.1244507 sig out 1act.) RANK 2 NODE 14 --> 24.2395763 sigma in 10act. ( 20.340517 sig out 1act.) RANK 3 NODE 12 --> 18.4319077 sigma in 10act. ( 19.9384899 sig out 1act.) RANK 4 NODE 5 --> 16.2540913 sigma in 10act. ( 12.9615555 sig out 1act.) RANK 5 NODE 11 --> 14.3766994 sigma in 10act. ( 12.0174532 sig out 1act.) RANK 6 NODE 8 --> 10.8160839 sigma in 10act. ( 10.6366854 sig out 1act.) RANK 7 NODE 2 --> 8.2393837 sigma in 10act. ( 7.12897158 sig out 1act.) RANK 8 NODE 9 --> 7.98475933 sigma in 10act. ( 5.79642868 sig out 1act.) RANK 9 NODE 15 --> 7.37286139 sigma in 10act. ( 5.94585228 sig out 1act.) RANK 10 NODE 7 --> 7.08127832 sigma in 10act. ( 6.47434044 sig out 1act.) RANK 11 NODE 4 --> 6.96834612 sigma in 10act. ( 5.69140196 sig out 1act.) RANK 12 NODE 6 --> 5.87485647 sigma in 10act. ( 4.19428158 sig out 1act.) RANK 13 NODE 3 --> 5.52248955 sigma in 10act. ( 4.6682415 sig out 1act.) RANK 14 NODE 13 --> 4.35251904 sigma in 10act. ( 2.93955064 sig out 1act.) RANK 15 NODE 10 --> 2.95952034 sigma in 10act. ( 1.29901326 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 20.340517 sigma out 1act.( 24.2395763 sig in 10act.) RANK 2 NODE 12 --> 19.9384899 sigma out 1act.( 18.4319077 sig in 10act.) RANK 3 NODE 1 --> 19.1244507 sigma out 1act.( 25.3453178 sig in 10act.) RANK 4 NODE 5 --> 12.9615555 sigma out 1act.( 16.2540913 sig in 10act.) RANK 5 NODE 11 --> 12.0174532 sigma out 1act.( 14.3766994 sig in 10act.) RANK 6 NODE 8 --> 10.6366854 sigma out 1act.( 10.8160839 sig in 10act.) RANK 7 NODE 2 --> 7.12897158 sigma out 1act.( 8.2393837 sig in 10act.) RANK 8 NODE 7 --> 6.47434044 sigma out 1act.( 7.08127832 sig in 10act.) RANK 9 NODE 15 --> 5.94585228 sigma out 1act.( 7.37286139 sig in 10act.) RANK 10 NODE 9 --> 5.79642868 sigma out 1act.( 7.98475933 sig in 10act.) RANK 11 NODE 4 --> 5.69140196 sigma out 1act.( 6.96834612 sig in 10act.) RANK 12 NODE 3 --> 4.6682415 sigma out 1act.( 5.52248955 sig in 10act.) RANK 13 NODE 6 --> 4.19428158 sigma out 1act.( 5.87485647 sig in 10act.) RANK 14 NODE 13 --> 2.93955064 sigma out 1act.( 4.35251904 sig in 10act.) RANK 15 NODE 10 --> 1.29901326 sigma out 1act.( 2.95952034 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.969532 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.575118184 *** contribution from regularisation: 0.00227891305 *** contribution from error: -0.577397108 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50313.0648 0.00568769453 16.9560356 EXIT FROM BFGS code NEW_X -50313.0648 0.00568769453 16.9560356 ENTER BFGS code NEW_X -50313.0648 0.00568769453 16.9560356 EXIT FROM BFGS code FG_LNSRCH 0. -0.0509620458 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.575184107 *** contribution from regularisation: 0.00241325493 *** contribution from error: -0.57759738 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50318.8295 -0.0509620458 -4.73489189 EXIT FROM BFGS code NEW_X -50318.8295 -0.0509620458 -4.73489189 ENTER BFGS code NEW_X -50318.8295 -0.0509620458 -4.73489189 EXIT FROM BFGS code FG_LNSRCH 0. -0.0679361001 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.574970722 *** contribution from regularisation: 0.002643354 *** contribution from error: -0.577614069 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50300.1657 -0.0679361001 4.61397076 EXIT FROM BFGS code FG_LNSRCH 0. -0.0580532774 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.575455427 *** contribution from regularisation: 0.00274593872 *** contribution from error: -0.578201354 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50342.5696 -0.0580532774 -1.55496705 EXIT FROM BFGS code NEW_X -50342.5696 -0.0580532774 -1.55496705 ENTER BFGS code NEW_X -50342.5696 -0.0580532774 -1.55496705 EXIT FROM BFGS code FG_LNSRCH 0. -0.0594691634 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.57565254 *** contribution from regularisation: 0.0026031509 *** contribution from error: -0.578255713 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50359.8104 -0.0594691634 -0.814170361 EXIT FROM BFGS code NEW_X -50359.8104 -0.0594691634 -0.814170361 ENTER BFGS code NEW_X -50359.8104 -0.0594691634 -0.814170361 EXIT FROM BFGS code FG_LNSRCH 0. -0.0585493669 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.575675964 *** contribution from regularisation: 0.00259556365 *** contribution from error: -0.578271508 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50361.8619 -0.0585493669 -4.18445873 EXIT FROM BFGS code NEW_X -50361.8619 -0.0585493669 -4.18445873 ENTER BFGS code NEW_X -50361.8619 -0.0585493669 -4.18445873 EXIT FROM BFGS code FG_LNSRCH 0. -0.0584241599 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.575813532 *** contribution from regularisation: 0.00241225003 *** contribution from error: -0.578225791 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50373.8964 -0.0584241599 -3.21565533 EXIT FROM BFGS code NEW_X -50373.8964 -0.0584241599 -3.21565533 ENTER BFGS code NEW_X -50373.8964 -0.0584241599 -3.21565533 EXIT FROM BFGS code FG_LNSRCH 0. -0.0566399507 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.575659215 *** contribution from regularisation: 0.00250128377 *** contribution from error: -0.578160524 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50360.3956 -0.0566399507 -29.2133465 EXIT FROM BFGS code FG_LNSRCH 0. -0.0581197701 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.575256288 *** contribution from regularisation: 0.00298085669 *** contribution from error: -0.578237116 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50325.1445 -0.0581197701 -7.39422274 EXIT FROM BFGS code FG_LNSRCH 0. -0.058418937 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.575568438 *** contribution from regularisation: 0.00265745725 *** contribution from error: -0.578225911 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50352.4513 -0.058418937 -3.43187857 EXIT FROM BFGS code FG_LNSRCH 0. -0.0584241562 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 35.3631096 sigma out 15 active outputs RANK 2 NODE 1 --> 20.0174007 sigma out 15 active outputs RANK 3 NODE 8 --> 16.3814964 sigma out 15 active outputs RANK 4 NODE 10 --> 14.314765 sigma out 15 active outputs RANK 5 NODE 6 --> 13.4619598 sigma out 15 active outputs RANK 6 NODE 9 --> 11.132452 sigma out 15 active outputs RANK 7 NODE 3 --> 11.0190725 sigma out 15 active outputs RANK 8 NODE 5 --> 10.8094702 sigma out 15 active outputs RANK 9 NODE 4 --> 10.3611116 sigma out 15 active outputs RANK 10 NODE 7 --> 7.3048048 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 27.5068588 sigma in 10act. ( 21.4431229 sig out 1act.) RANK 2 NODE 14 --> 26.2599144 sigma in 10act. ( 23.8957424 sig out 1act.) RANK 3 NODE 12 --> 22.8971596 sigma in 10act. ( 24.1824951 sig out 1act.) RANK 4 NODE 5 --> 15.6706028 sigma in 10act. ( 12.27495 sig out 1act.) RANK 5 NODE 11 --> 13.7723408 sigma in 10act. ( 11.673173 sig out 1act.) RANK 6 NODE 7 --> 9.82889462 sigma in 10act. ( 9.48443317 sig out 1act.) RANK 7 NODE 8 --> 9.27390194 sigma in 10act. ( 8.2253561 sig out 1act.) RANK 8 NODE 15 --> 7.95561171 sigma in 10act. ( 6.4103756 sig out 1act.) RANK 9 NODE 2 --> 7.34552145 sigma in 10act. ( 5.91857243 sig out 1act.) RANK 10 NODE 4 --> 6.33171177 sigma in 10act. ( 4.54773092 sig out 1act.) RANK 11 NODE 9 --> 5.2319603 sigma in 10act. ( 3.27487063 sig out 1act.) RANK 12 NODE 13 --> 4.37007761 sigma in 10act. ( 3.24548006 sig out 1act.) RANK 13 NODE 6 --> 4.07815456 sigma in 10act. ( 1.87527776 sig out 1act.) RANK 14 NODE 3 --> 3.72489953 sigma in 10act. ( 2.34449458 sig out 1act.) RANK 15 NODE 10 --> 2.44560194 sigma in 10act. ( 1.17102921 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 24.1824951 sigma out 1act.( 22.8971596 sig in 10act.) RANK 2 NODE 14 --> 23.8957424 sigma out 1act.( 26.2599144 sig in 10act.) RANK 3 NODE 1 --> 21.4431229 sigma out 1act.( 27.5068588 sig in 10act.) RANK 4 NODE 5 --> 12.27495 sigma out 1act.( 15.6706028 sig in 10act.) RANK 5 NODE 11 --> 11.673173 sigma out 1act.( 13.7723408 sig in 10act.) RANK 6 NODE 7 --> 9.48443317 sigma out 1act.( 9.82889462 sig in 10act.) RANK 7 NODE 8 --> 8.2253561 sigma out 1act.( 9.27390194 sig in 10act.) RANK 8 NODE 15 --> 6.4103756 sigma out 1act.( 7.95561171 sig in 10act.) RANK 9 NODE 2 --> 5.91857243 sigma out 1act.( 7.34552145 sig in 10act.) RANK 10 NODE 4 --> 4.54773092 sigma out 1act.( 6.33171177 sig in 10act.) RANK 11 NODE 9 --> 3.27487063 sigma out 1act.( 5.2319603 sig in 10act.) RANK 12 NODE 13 --> 3.24548006 sigma out 1act.( 4.37007761 sig in 10act.) RANK 13 NODE 3 --> 2.34449458 sigma out 1act.( 3.72489953 sig in 10act.) RANK 14 NODE 6 --> 1.87527776 sigma out 1act.( 4.07815456 sig in 10act.) RANK 15 NODE 10 --> 1.17102921 sigma out 1act.( 2.44560194 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.7825012 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.575541854 *** contribution from regularisation: 0.0026839585 *** contribution from error: -0.578225791 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50350.1265 -0.0584241562 -3.40292668 EXIT FROM BFGS code FG_LNSRCH 0. -0.0584241599 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.575555205 *** contribution from regularisation: 0.00267061056 *** contribution from error: -0.578225791 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50351.2942 -0.0584241599 -3.40813947 EXIT FROM BFGS code FG_LNSRCH 0. -0.0584241599 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.575551033 *** contribution from regularisation: 0.00267478544 *** contribution from error: -0.578225791 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50350.929 -0.0584241599 -3.44228077 EXIT FROM BFGS code FG_LNSRCH 0. -0.0584241599 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.575563073 *** contribution from regularisation: 0.00266274204 *** contribution from error: -0.578225791 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50351.9826 -0.0584241599 -3.43575811 EXIT FROM BFGS code NEW_X -50351.9826 -0.0584241599 -3.43575811 ENTER BFGS code NEW_X -50351.9826 -0.0584241599 -3.43575811 EXIT FROM BFGS code CONVERGENC -50351.9826 -0.0584241599 -3.43575811 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 56.1880684 sigma out 15 active outputs RANK 2 NODE 1 --> 32.6850777 sigma out 15 active outputs RANK 3 NODE 8 --> 26.1430626 sigma out 15 active outputs RANK 4 NODE 10 --> 22.6406307 sigma out 15 active outputs RANK 5 NODE 6 --> 22.0600414 sigma out 15 active outputs RANK 6 NODE 9 --> 17.8671188 sigma out 15 active outputs RANK 7 NODE 3 --> 17.7839985 sigma out 15 active outputs RANK 8 NODE 5 --> 16.9291039 sigma out 15 active outputs RANK 9 NODE 4 --> 16.2068729 sigma out 15 active outputs RANK 10 NODE 7 --> 11.8927917 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 44.8145905 sigma in 10act. ( 35.5156174 sig out 1act.) RANK 2 NODE 14 --> 43.1643372 sigma in 10act. ( 39.4319572 sig out 1act.) RANK 3 NODE 12 --> 36.4240265 sigma in 10act. ( 40.4047432 sig out 1act.) RANK 4 NODE 5 --> 24.2742023 sigma in 10act. ( 20.3440571 sig out 1act.) RANK 5 NODE 11 --> 21.9865971 sigma in 10act. ( 19.7410831 sig out 1act.) RANK 6 NODE 7 --> 15.2083197 sigma in 10act. ( 15.8514795 sig out 1act.) RANK 7 NODE 8 --> 14.524806 sigma in 10act. ( 13.8418169 sig out 1act.) RANK 8 NODE 15 --> 12.3146753 sigma in 10act. ( 10.5657654 sig out 1act.) RANK 9 NODE 2 --> 11.1980572 sigma in 10act. ( 9.68826389 sig out 1act.) RANK 10 NODE 4 --> 9.50878906 sigma in 10act. ( 7.51669455 sig out 1act.) RANK 11 NODE 9 --> 7.57155991 sigma in 10act. ( 5.54628897 sig out 1act.) RANK 12 NODE 13 --> 6.13943529 sigma in 10act. ( 5.26600313 sig out 1act.) RANK 13 NODE 6 --> 5.21960831 sigma in 10act. ( 3.05923915 sig out 1act.) RANK 14 NODE 3 --> 4.82826996 sigma in 10act. ( 3.8144989 sig out 1act.) RANK 15 NODE 10 --> 2.85421729 sigma in 10act. ( 1.88661659 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 40.4047432 sigma out 1act.( 36.4240265 sig in 10act.) RANK 2 NODE 14 --> 39.4319572 sigma out 1act.( 43.1643372 sig in 10act.) RANK 3 NODE 1 --> 35.5156174 sigma out 1act.( 44.8145905 sig in 10act.) RANK 4 NODE 5 --> 20.3440571 sigma out 1act.( 24.2742023 sig in 10act.) RANK 5 NODE 11 --> 19.7410831 sigma out 1act.( 21.9865971 sig in 10act.) RANK 6 NODE 7 --> 15.8514795 sigma out 1act.( 15.2083197 sig in 10act.) RANK 7 NODE 8 --> 13.8418169 sigma out 1act.( 14.524806 sig in 10act.) RANK 8 NODE 15 --> 10.5657654 sigma out 1act.( 12.3146753 sig in 10act.) RANK 9 NODE 2 --> 9.68826389 sigma out 1act.( 11.1980572 sig in 10act.) RANK 10 NODE 4 --> 7.51669455 sigma out 1act.( 9.50878906 sig in 10act.) RANK 11 NODE 9 --> 5.54628897 sigma out 1act.( 7.57155991 sig in 10act.) RANK 12 NODE 13 --> 5.26600313 sigma out 1act.( 6.13943529 sig in 10act.) RANK 13 NODE 3 --> 3.8144989 sigma out 1act.( 4.82826996 sig in 10act.) RANK 14 NODE 6 --> 3.05923915 sigma out 1act.( 5.21960831 sig in 10act.) RANK 15 NODE 10 --> 1.88661659 sigma out 1act.( 2.85421729 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 77.7380066 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.575534165 *** contribution from regularisation: 0.00269164727 *** contribution from error: -0.578225791 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26967 Closing output file done