NNInput NNInputs_180.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 178431 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 38631 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 38631 Chosen entries: 38631 Signal fraction: 1 Background fraction: 0.27633 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 38631 Entries to split: 38631 Test with : 19315 Train with : 19315 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 38631 for Signal Prepared event 0 for Signal with 38631 events ====Entry 0 Variable Ht : 181.988 Variable LepAPt : 36.3125 Variable LepBPt : 33.3263 Variable MetSigLeptonsJets : 8.50337 Variable MetSpec : 84.1215 Variable SumEtLeptonsJets : 97.8662 Variable VSumJetLeptonsPt : 93.7481 Variable addEt : 153.761 Variable dPhiLepSumMet : 2.8992 Variable dPhiLeptons : 0.358494 Variable dRLeptons : 0.375835 Variable lep1_E : 49.7842 Variable lep2_E : 42.4469 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2180 Ht = 181.988 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.3125 LepAPt = 36.3125 LepBEt = 33.3264 LepBPt = 33.3263 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 84.1215 MetDelPhi = 2.72772 MetSig = 7.11556 MetSigLeptonsJets = 8.50337 MetSpec = 84.1215 Mjj = 0 MostCentralJetEta = -2.14636 MtllMet = 165.707 Njets = 1 SB = 0 SumEt = 139.764 SumEtJets = 0 SumEtLeptonsJets = 97.8662 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 93.7481 addEt = 153.761 dPhiLepSumMet = 2.8992 dPhiLeptons = 0.358494 dRLeptons = 0.375835 diltype = 49 dimass = 13.013 event = 182 jet1_Et = 28.2274 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 49.7842 lep2_E = 42.4469 rand = 0.999742 run = 167139 weight = 3.11806e-06 ===Show End Prepared event 10000 for Signal with 38631 events Prepared event 20000 for Signal with 38631 events Prepared event 30000 for Signal with 38631 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.216727 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4335 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 178431 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4335 negative weights. Signal fraction: 63.0124512 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 63.164299 65.2718658 66.9638367 68.1705933 69.4340973 70.3236313 71.0955963 72.0040741 72.9219666 73.7755356 74.4000549 75.2405396 75.8335114 76.5848846 77.1079102 77.8614349 78.4995575 79.2051163 79.6764832 80.494812 81.1407852 81.7920609 82.5491562 83.0732574 83.9698486 84.974823 86.0251541 87.1759491 88.5263062 89.7042542 91.2133942 92.8397827 94.4276733 96.1004105 97.8227081 99.7285919 101.541519 103.324326 104.845047 106.458801 108.096649 109.685913 111.562836 113.428055 115.37542 117.216629 119.178925 120.561493 122.304306 123.939346 125.73848 127.726181 129.296616 130.897552 132.749359 134.232269 135.880966 137.50177 138.926575 140.563812 141.976318 143.383636 144.999817 146.616867 148.320038 149.885712 151.275543 152.890533 154.566437 156.246857 157.968063 159.701782 161.34552 163.308197 165.164673 166.992615 168.89563 170.971298 173.161926 175.361511 177.861328 180.250351 182.885727 185.734467 189.08252 192.385147 195.840347 199.419403 203.393738 207.70256 212.540482 217.888947 224.060608 231.523468 239.605179 248.689011 262.383911 282.842346 320.678955 787.769287 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3918228 20.6978722 21.0216217 21.3186798 21.5575485 21.840744 22.0808334 22.3132 22.5514793 22.7378578 22.9517784 23.168438 23.4095383 23.6396942 23.8489475 24.0634613 24.2912292 24.5341873 24.7795811 24.9956245 25.2086449 25.4087238 25.5987434 25.7803783 25.9815063 26.1943188 26.3883362 26.612812 26.8667889 27.111042 27.3428898 27.6007881 27.835537 28.0626793 28.2566071 28.5341015 28.8229332 29.0891533 29.3380108 29.6168976 29.8552666 30.1275539 30.4634857 30.7583847 31.1112061 31.4300117 31.7282066 32.0534821 32.3867722 32.7137337 33.0580215 33.430706 33.7843895 34.121479 34.4954872 34.8595123 35.2427444 35.6023445 35.9621315 36.3855286 36.7369003 37.1561813 37.5970726 37.9968033 38.4223862 38.8383408 39.2236862 39.6366234 40.0898743 40.5229416 41.000206 41.5091095 41.9870148 42.5414963 43.0273132 43.5555801 44.1393585 44.6604729 45.2885666 45.9255142 46.4934502 47.2138977 47.8561096 48.5348701 49.3529129 50.1198654 50.9407005 51.8729706 52.8425446 53.8113785 54.9342804 56.072998 57.4198494 58.7915802 60.2415695 62.3448563 64.7883301 68.3242416 75.4917145 162.429443 ------------------------------ Transdef: Tab for variable 4 10.000247 10.1261387 10.2665863 10.3906479 10.4935474 10.6317444 10.7610397 10.9037523 11.0159874 11.1609077 11.3120508 11.4379244 11.6013126 11.7501326 11.9209557 12.0979843 12.2340012 12.3914623 12.5596237 12.7117805 12.8571424 13.0604992 13.24193 13.4506989 13.583046 13.7475185 13.917491 14.0871305 14.2715197 14.46311 14.6926003 14.8838081 15.1524963 15.362442 15.5716906 15.808569 15.9858198 16.2449722 16.4465122 16.6680565 16.8693638 17.11343 17.3656616 17.6343956 17.875843 18.1477242 18.4124622 18.6708679 18.893158 19.1362534 19.3950005 19.6819878 19.942997 20.2033672 20.4394341 20.7046928 20.951931 21.2277107 21.458231 21.70401 21.947773 22.1473236 22.4403877 22.6945496 22.9347076 23.2188969 23.487709 23.7576599 23.9988327 24.2817345 24.5642948 24.83671 25.1082382 25.383152 25.6663322 25.9799576 26.2417259 26.5305042 26.8672028 27.1817703 27.5066853 27.8151894 28.1212921 28.461359 28.8506737 29.2502594 29.6303444 30.0210724 30.4737034 30.9577904 31.4723701 32.0680389 32.6482849 33.2765427 34.0240555 34.8784714 35.9151573 37.3758965 39.4140472 43.1476288 72.314209 ------------------------------ Transdef: Tab for variable 5 1.06155312 2.70755506 3.14425516 3.47685432 3.74245191 3.99062347 4.15207243 4.2858057 4.41855621 4.54249001 4.63986349 4.73550749 4.82052612 4.91733837 4.9971242 5.0654211 5.13920927 5.20458889 5.27940941 5.34409714 5.39199734 5.45317173 5.50626421 5.55452728 5.60071087 5.64586115 5.69392204 5.74668646 5.79682732 5.8449707 5.89034796 5.93412924 5.98539686 6.03268099 6.07960272 6.1207552 6.17135143 6.21993256 6.27169704 6.31129837 6.35260105 6.40302706 6.44727087 6.49957371 6.53929329 6.59084797 6.64039946 6.68396473 6.73348713 6.77554893 6.82450581 6.8693881 6.90976381 6.96026087 7.00933552 7.05884933 7.11475658 7.164114 7.21504402 7.2596941 7.3194685 7.38337135 7.43848515 7.48908377 7.55567837 7.61911678 7.68169785 7.74302435 7.80023098 7.85651207 7.91846466 7.98005867 8.05000305 8.11351585 8.17559433 8.24155807 8.3040123 8.3723278 8.44595718 8.5139389 8.5825634 8.64564991 8.7193203 8.79213333 8.86271477 8.94112015 9.03053856 9.12794495 9.22788715 9.32618332 9.4259491 9.53229237 9.65626907 9.7965765 9.95203018 10.1608362 10.3920746 10.6844053 11.132041 11.9102192 19.7064457 ------------------------------ Transdef: Tab for variable 6 15.0025911 21.6951275 25.5514259 26.6984367 27.725399 28.7133732 29.435648 30.1379395 30.8603039 31.4476089 32.0495911 32.672451 33.1868362 33.6312637 34.1286545 34.6322403 34.9634399 35.4114952 35.8797073 36.3287811 36.6611404 37.052742 37.4222298 37.8456573 38.2343826 38.5931931 39.0327225 39.3831177 39.685482 40.0539017 40.4251175 40.7811546 41.1958504 41.6644707 42.1303101 42.4938354 42.9149399 43.3388176 43.817009 44.3595352 44.7601585 45.4047928 46.091301 46.7732849 47.5437546 48.2360001 48.8827667 49.6135941 50.309082 51.0576935 51.8107529 52.6027184 53.5284195 54.3364334 55.2326889 56.0607071 56.8956223 57.6586761 58.4299698 59.0226212 59.8715935 60.6722565 61.399765 62.2819862 63.2063751 64.0445862 64.8845062 65.6983566 66.4281158 67.2878036 68.1794128 68.9858704 69.8669434 70.7575226 71.6495972 72.4343262 73.3081055 74.2264557 75.1386414 76.0161896 76.9626389 77.9727707 78.9602509 79.9116211 80.9105682 82.0831299 83.1945801 84.4423676 85.6762314 86.9481354 88.5105591 90.4670334 92.3965302 94.8006058 97.3575211 100.710999 104.617752 109.749405 116.581787 129.950333 263.274963 ------------------------------ Transdef: Tab for variable 7 30.1877575 32.9169235 33.7961197 34.4527016 35.1292343 35.5725479 36.0511513 36.4628754 36.8768692 37.2413177 37.5969238 37.9244499 38.2386627 38.5366592 38.8192749 39.1299553 39.4047394 39.6611977 40.0794258 40.3314743 40.6483002 40.9811859 41.3412094 41.7091599 42.086628 42.6359634 43.1128235 43.654911 44.3736992 44.9081268 45.4752197 46.4189606 47.2569809 48.3343544 49.3951035 50.5258789 51.6672974 52.7247238 53.8281708 55.0122643 55.9650803 56.9831619 57.9022141 58.9593658 59.92379 60.925457 61.6298904 62.541008 63.4379539 64.2116241 65.1690216 66.1200409 67.0149002 67.8955841 68.7960129 69.7749176 70.6717758 71.4347687 72.2640076 73.1638489 74.0752563 74.9692383 75.9889984 76.8970032 77.9343567 78.9746323 80.15271 81.2462616 82.408493 83.6406326 84.7836914 85.967453 87.4813538 89.0991974 90.6132965 92.4724579 93.938324 95.6453934 97.4469147 99.185257 101.043503 102.796783 104.867126 106.833115 109.10051 111.64978 114.283188 116.90963 119.907707 123.041466 126.51796 130.538239 135.254181 140.371033 146.238159 153.716339 162.6987 173.64679 189.663544 217.961212 523.715759 ------------------------------ Transdef: Tab for variable 8 1.09349227 25.0207748 29.5086575 31.1864166 32.2042465 32.8844452 33.4353065 33.8958969 34.4238052 34.9232063 35.2634888 35.6592102 35.9715767 36.2801971 36.5833244 36.9080086 37.2296791 37.5067902 37.7626419 38.0318451 38.2789841 38.5659752 38.8226929 39.0779648 39.3372192 39.6917267 39.9879379 40.2683716 40.5492783 40.88871 41.287529 41.6581726 42.0643692 42.4790878 42.9138451 43.3359604 43.7873154 44.2704391 44.8390579 45.4432068 46.1140671 46.762207 47.5901947 48.3147583 48.9119377 49.5361557 50.2982712 51.0429688 51.7641373 52.5415649 53.289299 54.0096588 54.7705078 55.5359688 56.2716827 57.0258713 57.7532883 58.5592422 59.3368721 60.0961761 60.8327789 61.4116516 62.1429672 62.8391266 63.5775948 64.3161697 65.0613098 65.7975922 66.5798721 67.3319778 68.0628128 68.8235931 69.5882568 70.2903824 71.0450897 71.8066025 72.5315247 73.3033447 74.0710297 74.85495 75.6545792 76.5441513 77.5639648 78.4704132 79.5024109 80.5586166 81.7377014 82.9129715 84.0639114 85.4333344 86.9285583 88.7393875 90.6201401 93.079834 95.4343414 98.8534851 102.936035 108.129242 116.33493 131.728241 329.840057 ------------------------------ Transdef: Tab for variable 9 49.4992676 62.8013802 64.8321075 66.3852539 67.468483 68.7640228 69.7450104 70.4594879 71.2108307 72.0085144 72.8810425 73.6039124 74.2529297 74.915802 75.5469513 76.158432 76.7955933 77.2875671 77.9468613 78.4588623 78.9941483 79.5039673 80.0795593 80.7664719 81.3523788 81.8958817 82.5493927 83.0210037 83.7084122 84.5522766 85.3929062 86.2243042 87.1759491 88.2889175 89.1535339 90.1620407 91.3598938 92.4243317 93.5519104 94.981041 96.274231 97.8467789 99.3723526 100.92778 102.268433 103.972549 105.396423 107.022186 108.423416 109.923416 111.315193 112.767601 114.422089 115.734138 117.044144 118.518906 119.717735 121.008667 122.411049 123.736343 124.929199 126.304245 127.793213 128.978973 130.265884 131.630402 132.988861 134.159027 135.519958 136.831131 138.041275 139.182098 140.551178 141.613586 142.890778 144.006302 145.231323 146.488297 147.795197 148.963287 150.166809 151.386444 152.619278 154.01651 155.414948 156.702118 158.078613 159.698517 161.064026 162.733856 164.395615 166.272919 168.15564 170.470001 172.840042 175.347015 178.809113 183.273926 189.608185 204.679886 391.964661 ------------------------------ Transdef: Tab for variable 10 0.0050833188 1.10252929 1.41907334 1.62416363 1.78398454 1.91710353 2.01290751 2.0947876 2.1652751 2.22975349 2.28013659 2.32899213 2.38084507 2.42215705 2.46115351 2.49710488 2.52779675 2.55885172 2.5832212 2.6088047 2.6322298 2.65525866 2.67743158 2.6979413 2.71725845 2.73620272 2.75455427 2.77193832 2.78599215 2.80085301 2.8139472 2.82693815 2.83840275 2.84977627 2.86000013 2.87072515 2.88031197 2.8891902 2.89804292 2.90765381 2.91622972 2.92279816 2.93005562 2.93767953 2.94483328 2.95060444 2.95783472 2.9640007 2.96960735 2.9754436 2.98100471 2.98630953 2.9909656 2.99524927 3.00055981 3.00553465 3.01017714 3.01463699 3.01857424 3.02251124 3.02672434 3.03101587 3.03450632 3.03862906 3.04247999 3.04633045 3.05016565 3.05382061 3.0574193 3.06083584 3.0643611 3.06756878 3.07092142 3.0734241 3.076437 3.079638 3.08266354 3.08586884 3.08877563 3.09164882 3.09441757 3.09660625 3.09912062 3.10166264 3.10401154 3.10681272 3.10911369 3.11193037 3.11433458 3.11693859 3.11916876 3.12147331 3.12412167 3.12631798 3.1286242 3.1308322 3.1323328 3.13453364 3.13660836 3.13896585 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00504493341 0.0108620524 0.017500639 0.0241239667 0.0305224713 0.0374077708 0.0448114872 0.0509771705 0.0583627522 0.064432621 0.0716662779 0.0785377026 0.0854599476 0.0923660398 0.0997285843 0.107621431 0.11313349 0.120056838 0.127315998 0.133844703 0.141422749 0.147487983 0.154091924 0.160338044 0.166554689 0.17312865 0.179684997 0.18637681 0.192650318 0.197934389 0.202658191 0.20725596 0.212695599 0.217744589 0.22299251 0.227678448 0.233297318 0.237944335 0.243529081 0.248117268 0.252820969 0.258181453 0.263073325 0.268090487 0.2736274 0.278259754 0.283354104 0.288603544 0.293945193 0.299723148 0.305174649 0.310875893 0.316735417 0.322499305 0.327109575 0.333121002 0.338159204 0.343503892 0.349609941 0.354536533 0.360712647 0.366695404 0.372539878 0.378997207 0.385067254 0.390859663 0.396781087 0.402996421 0.408584893 0.414792836 0.421794176 0.428223073 0.435476065 0.440646887 0.447396874 0.454391241 0.460301757 0.468165278 0.475636721 0.482772589 0.492038846 0.500837088 0.511274755 0.520290256 0.529129744 0.538775206 0.549509406 0.563724101 0.577203393 0.588660479 0.603280962 0.621578574 0.640054107 0.657477379 0.680019319 0.708092272 0.732720435 0.785774529 0.843548059 1.11161757 ------------------------------ Transdef: Tab for variable 12 0.20003137 0.211965859 0.223523796 0.232392922 0.239822388 0.246583641 0.253993988 0.261731625 0.268571228 0.274927765 0.281805634 0.287941098 0.294212222 0.300374091 0.305947483 0.311869144 0.316950023 0.321862638 0.327261448 0.33234483 0.337470949 0.34272033 0.347351193 0.35193789 0.357570976 0.362630606 0.367524505 0.372765422 0.377157688 0.382870793 0.387861013 0.392462075 0.397472799 0.401819348 0.406107187 0.409622073 0.413046569 0.416708708 0.420087159 0.423921943 0.426970601 0.43053174 0.43450433 0.437522143 0.441278845 0.445021033 0.448603481 0.452589989 0.45662719 0.460182965 0.464358181 0.468746364 0.472671479 0.476497591 0.481169224 0.485446811 0.489815652 0.493597567 0.498183399 0.501830697 0.506346881 0.510958016 0.515526533 0.520740628 0.524593949 0.529714346 0.53540647 0.540430903 0.5464077 0.551849544 0.557736278 0.563370705 0.569311976 0.575312138 0.581602812 0.588163853 0.595318496 0.602259755 0.609481931 0.616065145 0.623751342 0.631241202 0.639853001 0.647604108 0.657996655 0.665916204 0.674234629 0.683896065 0.694653809 0.704296827 0.716809869 0.728806734 0.742865562 0.754832387 0.76946032 0.789991975 0.807537317 0.827769637 0.859347582 0.903178811 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.670351 22.4591866 23.2179832 23.8675003 24.5413551 25.0686493 25.5542107 25.9618683 26.4241333 26.8798676 27.2790871 27.6863976 28.0827866 28.4679604 28.8642464 29.2393703 29.5907593 29.9110355 30.3006287 30.6487217 30.9623566 31.3331566 31.678196 32.0702057 32.4325027 32.789093 33.1447754 33.5060501 33.887764 34.3498077 34.7098999 35.051384 35.4207954 35.8212967 36.1920433 36.62883 37.0192947 37.4568939 37.8488007 38.2890778 38.6910934 39.1564865 39.6012497 40.0203857 40.4736176 40.8656616 41.3665085 41.8462372 42.2755661 42.720253 43.1333237 43.5900269 44.0608559 44.5335312 45.0100708 45.4936142 46.009346 46.5293121 47.0910912 47.6241951 48.1423111 48.6170883 49.1284943 49.6567841 50.2638245 50.8284836 51.3990173 52.07724 52.646328 53.2644653 53.9262047 54.5183411 55.2263565 55.9296722 56.6120834 57.3815651 58.2379913 58.9936256 59.7673645 60.5275803 61.3265762 62.2932968 63.2623062 64.2318802 65.4871674 66.7264557 67.754776 68.9687347 70.3567963 71.968071 73.6381531 75.4753952 77.6917419 80.0326843 82.6284103 86.1933365 90.0198364 95.6413269 105.649033 232.717926 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6994038 11.1644936 11.5471554 11.9333839 12.317812 12.720006 13.047698 13.3918266 13.7247601 14.0162582 14.306181 14.6023054 14.9427681 15.2951488 15.6153316 15.9182568 16.2847595 16.5990562 16.8742619 17.1781502 17.4475021 17.7324944 18.0006466 18.2588768 18.5719414 18.8990593 19.1566467 19.430645 19.7634583 20.087883 20.377821 20.6449108 20.9371796 21.270092 21.5182571 21.7660866 22.0277634 22.2950096 22.5857544 22.883812 23.1370411 23.4098854 23.687151 23.9487 24.2413807 24.5293007 24.762394 25.0266647 25.3297997 25.5557022 25.8102417 26.0595169 26.3400135 26.59338 26.8835773 27.1663399 27.484272 27.729599 27.9947891 28.2318077 28.5144424 28.8250256 29.0995712 29.3943138 29.6892128 30.0220375 30.3449211 30.6396828 30.9410992 31.264431 31.568821 31.9108677 32.271698 32.6125183 32.9857826 33.3924713 33.6972809 34.0976868 34.5318832 34.9478836 35.4582291 35.9395142 36.5198822 37.0362244 37.6010437 38.2188339 38.7991943 39.476284 40.2560463 41.0387497 41.8973961 43.0049133 44.1971474 45.4196472 47.2141113 49.0637512 51.8803558 55.6146812 62.1110535 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.9 54.3 54.9 34.0 52.4 65.3 58.1 66.6 -26.9 -19.6 -43.1 19.3 25.5 2 67.9 100.0 69.0 60.7 40.8 71.7 94.5 77.6 92.2 -43.2 -26.4 -53.0 35.3 32.7 3 54.3 69.0 100.0 48.3 18.6 41.5 71.1 59.4 75.9 -14.9 -28.7 -59.5 65.4 26.1 4 54.9 60.7 48.3 100.0 18.8 38.9 61.9 52.8 65.5 -12.8 -31.6 -64.0 23.4 70.6 5 34.0 40.8 18.6 18.8 100.0 85.1 13.8 60.6 60.9 22.1 -9.7 -16.9 2.9 5.6 6 52.4 71.7 41.5 38.9 85.1 100.0 51.4 80.8 81.7 -7.3 -17.6 -33.9 16.8 18.1 7 65.3 94.5 71.1 61.9 13.8 51.4 100.0 69.3 81.1 -52.1 -25.4 -53.1 38.7 35.4 8 58.1 77.6 59.4 52.8 60.6 80.8 69.3 100.0 85.1 -11.4 -25.8 -47.7 30.7 29.5 9 66.6 92.2 75.9 65.5 60.9 81.7 81.1 85.1 100.0 -19.6 -29.5 -59.1 41.3 36.9 10 -26.9 -43.2 -14.9 -12.8 22.1 -7.3 -52.1 -11.4 -19.6 100.0 3.7 9.3 -3.7 -3.9 11 -19.6 -26.4 -28.7 -31.6 -9.7 -17.6 -25.4 -25.8 -29.5 3.7 100.0 53.9 -14.2 -20.1 12 -43.1 -53.0 -59.5 -64.0 -16.9 -33.9 -53.1 -47.7 -59.1 9.3 53.9 100.0 -31.5 -37.9 13 19.3 35.3 65.4 23.4 2.9 16.8 38.7 30.7 41.3 -3.7 -14.2 -31.5 100.0 49.0 14 25.5 32.7 26.1 70.6 5.6 18.1 35.4 29.5 36.9 -3.9 -20.1 -37.9 49.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 174.780673 TOTAL CORRELATION OF ALL VARIABLES 74.4909026 ROUND 1: MAX CORR ( 74.4908321) AFTER KILLING INPUT VARIABLE 8 CONTR 0.102488681 ROUND 2: MAX CORR ( 74.4891573) AFTER KILLING INPUT VARIABLE 6 CONTR 0.499505707 ROUND 3: MAX CORR ( 74.4741644) AFTER KILLING INPUT VARIABLE 11 CONTR 1.49445525 ROUND 4: MAX CORR ( 74.4587186) AFTER KILLING INPUT VARIABLE 2 CONTR 1.51670312 ROUND 5: MAX CORR ( 74.4227733) AFTER KILLING INPUT VARIABLE 14 CONTR 2.31335047 ROUND 6: MAX CORR ( 74.3705844) AFTER KILLING INPUT VARIABLE 12 CONTR 2.78664111 ROUND 7: MAX CORR ( 74.0485831) AFTER KILLING INPUT VARIABLE 10 CONTR 6.91311506 ROUND 8: MAX CORR ( 73.1189399) AFTER KILLING INPUT VARIABLE 13 CONTR 11.6967213 ROUND 9: MAX CORR ( 72.0327415) AFTER KILLING INPUT VARIABLE 9 CONTR 12.5564138 ROUND 10: MAX CORR ( 71.6761918) AFTER KILLING INPUT VARIABLE 3 CONTR 7.15816844 ROUND 11: MAX CORR ( 70.0434716) AFTER KILLING INPUT VARIABLE 4 CONTR 15.2114615 ROUND 12: MAX CORR ( 65.3394269) AFTER KILLING INPUT VARIABLE 5 CONTR 25.2358316 LAST REMAINING VARIABLE: 7 total correlation to target: 74.4909026 % total significance: 130.603513 sigma correlations of single variables to target: variable 2: 67.860548 % , in sigma: 118.978635 variable 3: 54.3323226 % , in sigma: 95.2598496 variable 4: 54.917018 % , in sigma: 96.2849852 variable 5: 33.988661 % , in sigma: 59.5916865 variable 6: 52.447808 % , in sigma: 91.9557652 variable 7: 65.3394269 % , in sigma: 114.558401 variable 8: 58.0580609 % , in sigma: 101.792117 variable 9: 66.6183199 % , in sigma: 116.80066 variable 10: -26.8542972 % , in sigma: 47.0831393 variable 11: -19.6129147 % , in sigma: 34.3869582 variable 12: -43.1262591 % , in sigma: 75.612467 variable 13: 19.3174285 % , in sigma: 33.8688878 variable 14: 25.5442984 % , in sigma: 44.7863429 variables sorted by significance: 1 most relevant variable 7 corr 65.3394241 , in sigma: 114.558396 2 most relevant variable 5 corr 25.2358322 , in sigma: 44.2455148 3 most relevant variable 4 corr 15.2114611 , in sigma: 26.6699715 4 most relevant variable 3 corr 7.15816832 , in sigma: 12.5502832 5 most relevant variable 9 corr 12.5564137 , in sigma: 22.0149263 6 most relevant variable 13 corr 11.6967211 , in sigma: 20.5076433 7 most relevant variable 10 corr 6.91311502 , in sigma: 12.1206359 8 most relevant variable 12 corr 2.78664112 , in sigma: 4.88576599 9 most relevant variable 14 corr 2.31335044 , in sigma: 4.05595425 10 most relevant variable 2 corr 1.51670313 , in sigma: 2.65920736 11 most relevant variable 11 corr 1.49445522 , in sigma: 2.62020051 12 most relevant variable 6 corr 0.499505699 , in sigma: 0.875774041 13 most relevant variable 8 corr 0.102488682 , in sigma: 0.179691497 global correlations between input variables: variable 2: 99.2001786 % variable 3: 93.4552318 % variable 4: 91.7635511 % variable 5: 95.5765725 % variable 6: 95.2087203 % variable 7: 98.8171485 % variable 8: 90.6870979 % variable 9: 98.8468966 % variable 10: 71.5040894 % variable 11: 54.819215 % variable 12: 78.4813368 % variable 13: 85.6537047 % variable 14: 87.5103708 % significance loss when removing single variables: variable 2: corr = 1.51863104 % , sigma = 2.66258753 variable 3: corr = 15.4590985 % , sigma = 27.1041495 variable 4: corr = 14.4952244 % , sigma = 25.4142071 variable 5: corr = 15.422734 % , sigma = 27.0403924 variable 6: corr = 0.502609454 % , sigma = 0.881215798 variable 7: corr = 7.99751088 % , sigma = 14.0218869 variable 8: corr = 0.102488681 % , sigma = 0.179691496 variable 9: corr = 10.1490494 % , sigma = 17.7941393 variable 10: corr = 6.453695 % , sigma = 11.3151433 variable 11: corr = 1.4983477 % , sigma = 2.62702513 variable 12: corr = 1.9865649 % , sigma = 3.48300726 variable 13: corr = 6.46420923 % , sigma = 11.3335777 variable 14: corr = 2.20188496 % , sigma = 3.8605239 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 27.9207134 sigma out 15 active outputs RANK 2 NODE 9 --> 24.5869179 sigma out 15 active outputs RANK 3 NODE 5 --> 19.0745716 sigma out 15 active outputs RANK 4 NODE 8 --> 17.1571083 sigma out 15 active outputs RANK 5 NODE 10 --> 16.1024094 sigma out 15 active outputs RANK 6 NODE 4 --> 15.0238256 sigma out 15 active outputs RANK 7 NODE 7 --> 14.107378 sigma out 15 active outputs RANK 8 NODE 6 --> 13.5098839 sigma out 15 active outputs RANK 9 NODE 2 --> 13.0789576 sigma out 15 active outputs RANK 10 NODE 3 --> 7.69639015 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 30.7254009 sigma in 10act. ( 29.7763424 sig out 1act.) RANK 2 NODE 12 --> 25.6871738 sigma in 10act. ( 29.8347435 sig out 1act.) RANK 3 NODE 8 --> 23.5043945 sigma in 10act. ( 24.85639 sig out 1act.) RANK 4 NODE 10 --> 20.6446838 sigma in 10act. ( 20.8939037 sig out 1act.) RANK 5 NODE 5 --> 11.2261066 sigma in 10act. ( 11.6822672 sig out 1act.) RANK 6 NODE 15 --> 11.166049 sigma in 10act. ( 10.7323322 sig out 1act.) RANK 7 NODE 9 --> 8.47615623 sigma in 10act. ( 8.84898663 sig out 1act.) RANK 8 NODE 4 --> 7.72166777 sigma in 10act. ( 7.98737955 sig out 1act.) RANK 9 NODE 13 --> 7.42216921 sigma in 10act. ( 7.81309748 sig out 1act.) RANK 10 NODE 6 --> 6.79039764 sigma in 10act. ( 9.01008892 sig out 1act.) RANK 11 NODE 7 --> 5.96511984 sigma in 10act. ( 5.77339792 sig out 1act.) RANK 12 NODE 14 --> 4.1496892 sigma in 10act. ( 7.7097373 sig out 1act.) RANK 13 NODE 3 --> 3.28522205 sigma in 10act. ( 3.19536853 sig out 1act.) RANK 14 NODE 1 --> 2.56236362 sigma in 10act. ( 0.492870688 sig out 1act.) RANK 15 NODE 11 --> 1.7448684 sigma in 10act. ( 2.15342641 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 29.8347435 sigma out 1act.( 25.6871738 sig in 10act.) RANK 2 NODE 2 --> 29.7763424 sigma out 1act.( 30.7254009 sig in 10act.) RANK 3 NODE 8 --> 24.85639 sigma out 1act.( 23.5043945 sig in 10act.) RANK 4 NODE 10 --> 20.8939037 sigma out 1act.( 20.6446838 sig in 10act.) RANK 5 NODE 5 --> 11.6822672 sigma out 1act.( 11.2261066 sig in 10act.) RANK 6 NODE 15 --> 10.7323322 sigma out 1act.( 11.166049 sig in 10act.) RANK 7 NODE 6 --> 9.01008892 sigma out 1act.( 6.79039764 sig in 10act.) RANK 8 NODE 9 --> 8.84898663 sigma out 1act.( 8.47615623 sig in 10act.) RANK 9 NODE 4 --> 7.98737955 sigma out 1act.( 7.72166777 sig in 10act.) RANK 10 NODE 13 --> 7.81309748 sigma out 1act.( 7.42216921 sig in 10act.) RANK 11 NODE 14 --> 7.7097373 sigma out 1act.( 4.1496892 sig in 10act.) RANK 12 NODE 7 --> 5.77339792 sigma out 1act.( 5.96511984 sig in 10act.) RANK 13 NODE 3 --> 3.19536853 sigma out 1act.( 3.28522205 sig in 10act.) RANK 14 NODE 11 --> 2.15342641 sigma out 1act.( 1.7448684 sig in 10act.) RANK 15 NODE 1 --> 0.492870688 sigma out 1act.( 2.56236362 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 58.9490242 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 26.9238701 sigma out 15 active outputs RANK 2 NODE 9 --> 23.5828857 sigma out 15 active outputs RANK 3 NODE 2 --> 22.8913841 sigma out 15 active outputs RANK 4 NODE 5 --> 19.3777485 sigma out 15 active outputs RANK 5 NODE 8 --> 17.6095505 sigma out 15 active outputs RANK 6 NODE 10 --> 17.2151089 sigma out 15 active outputs RANK 7 NODE 6 --> 15.5373564 sigma out 15 active outputs RANK 8 NODE 4 --> 15.1741247 sigma out 15 active outputs RANK 9 NODE 7 --> 14.2676525 sigma out 15 active outputs RANK 10 NODE 3 --> 8.03006649 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 27.4881935 sigma in 10act. ( 28.0663662 sig out 1act.) RANK 2 NODE 2 --> 25.8259506 sigma in 10act. ( 26.3840046 sig out 1act.) RANK 3 NODE 8 --> 22.6252041 sigma in 10act. ( 23.3624973 sig out 1act.) RANK 4 NODE 10 --> 21.6613789 sigma in 10act. ( 20.9375801 sig out 1act.) RANK 5 NODE 14 --> 14.9842367 sigma in 10act. ( 9.90593338 sig out 1act.) RANK 6 NODE 5 --> 12.6621981 sigma in 10act. ( 11.134696 sig out 1act.) RANK 7 NODE 15 --> 11.7945747 sigma in 10act. ( 9.66120243 sig out 1act.) RANK 8 NODE 6 --> 11.0440083 sigma in 10act. ( 9.49029827 sig out 1act.) RANK 9 NODE 11 --> 10.6595993 sigma in 10act. ( 4.59041691 sig out 1act.) RANK 10 NODE 9 --> 9.94926643 sigma in 10act. ( 8.45723152 sig out 1act.) RANK 11 NODE 13 --> 8.9267025 sigma in 10act. ( 7.49737072 sig out 1act.) RANK 12 NODE 4 --> 8.55725288 sigma in 10act. ( 7.33722591 sig out 1act.) RANK 13 NODE 7 --> 7.69985151 sigma in 10act. ( 5.57200336 sig out 1act.) RANK 14 NODE 3 --> 5.71457624 sigma in 10act. ( 3.40870214 sig out 1act.) RANK 15 NODE 1 --> 4.4293766 sigma in 10act. ( 0.264946431 sig out 1act.) sorted by output significance RANK 1 NODE 12 --> 28.0663662 sigma out 1act.( 27.4881935 sig in 10act.) RANK 2 NODE 2 --> 26.3840046 sigma out 1act.( 25.8259506 sig in 10act.) RANK 3 NODE 8 --> 23.3624973 sigma out 1act.( 22.6252041 sig in 10act.) RANK 4 NODE 10 --> 20.9375801 sigma out 1act.( 21.6613789 sig in 10act.) RANK 5 NODE 5 --> 11.134696 sigma out 1act.( 12.6621981 sig in 10act.) RANK 6 NODE 14 --> 9.90593338 sigma out 1act.( 14.9842367 sig in 10act.) RANK 7 NODE 15 --> 9.66120243 sigma out 1act.( 11.7945747 sig in 10act.) RANK 8 NODE 6 --> 9.49029827 sigma out 1act.( 11.0440083 sig in 10act.) RANK 9 NODE 9 --> 8.45723152 sigma out 1act.( 9.94926643 sig in 10act.) RANK 10 NODE 13 --> 7.49737072 sigma out 1act.( 8.9267025 sig in 10act.) RANK 11 NODE 4 --> 7.33722591 sigma out 1act.( 8.55725288 sig in 10act.) RANK 12 NODE 7 --> 5.57200336 sigma out 1act.( 7.69985151 sig in 10act.) RANK 13 NODE 11 --> 4.59041691 sigma out 1act.( 10.6595993 sig in 10act.) RANK 14 NODE 3 --> 3.40870214 sigma out 1act.( 5.71457624 sig in 10act.) RANK 15 NODE 1 --> 0.264946431 sigma out 1act.( 4.4293766 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 55.847271 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.481392115 *** contribution from regularisation: 0.00442143716 *** contribution from error: -0.485813558 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.532467127 *** contribution from regularisation: 0.00238986337 *** contribution from error: -0.534856975 *********************************************** -----------------> Test sample ENTER BFGS code START -47512.9766 0.655413866 -0.0682279766 EXIT FROM BFGS code FG_START 0. 0.655413866 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.561055243 *** contribution from regularisation: 0.00232232059 *** contribution from error: -0.563377559 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -50054.5457 0.655413866 -157.481216 EXIT FROM BFGS code FG_LNSRCH 0. 0.608471394 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.58210814 *** contribution from regularisation: 0.00292969123 *** contribution from error: -0.585037827 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51932.7763 0.608471394 -69.0102081 EXIT FROM BFGS code NEW_X -51932.7763 0.608471394 -69.0102081 ENTER BFGS code NEW_X -51932.7763 0.608471394 -69.0102081 EXIT FROM BFGS code FG_LNSRCH 0. 0.590270817 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.584360123 *** contribution from regularisation: 0.00292434404 *** contribution from error: -0.587284446 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52133.6877 0.590270817 -36.7781944 EXIT FROM BFGS code NEW_X -52133.6877 0.590270817 -36.7781944 ENTER BFGS code NEW_X -52133.6877 0.590270817 -36.7781944 EXIT FROM BFGS code FG_LNSRCH 0. 0.56735903 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.585631967 *** contribution from regularisation: 0.0028792175 *** contribution from error: -0.588511169 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52247.1535 0.56735903 -17.2817783 EXIT FROM BFGS code NEW_X -52247.1535 0.56735903 -17.2817783 ENTER BFGS code NEW_X -52247.1535 0.56735903 -17.2817783 EXIT FROM BFGS code FG_LNSRCH 0. 0.547074616 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.586003602 *** contribution from regularisation: 0.0028433511 *** contribution from error: -0.588846982 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52280.3106 0.547074616 -12.5481758 EXIT FROM BFGS code NEW_X -52280.3106 0.547074616 -12.5481758 ENTER BFGS code NEW_X -52280.3106 0.547074616 -12.5481758 EXIT FROM BFGS code FG_LNSRCH 0. 0.524985015 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.586207807 *** contribution from regularisation: 0.00280658784 *** contribution from error: -0.589014411 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52298.5297 0.524985015 -5.49784994 EXIT FROM BFGS code NEW_X -52298.5297 0.524985015 -5.49784994 ENTER BFGS code NEW_X -52298.5297 0.524985015 -5.49784994 EXIT FROM BFGS code FG_LNSRCH 0. 0.463827848 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.586587965 *** contribution from regularisation: 0.00261585275 *** contribution from error: -0.589203835 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52332.4459 0.463827848 -8.68536758 EXIT FROM BFGS code NEW_X -52332.4459 0.463827848 -8.68536758 ENTER BFGS code NEW_X -52332.4459 0.463827848 -8.68536758 EXIT FROM BFGS code FG_LNSRCH 0. 0.333778143 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 33.4193306 sigma out 15 active outputs RANK 2 NODE 1 --> 20.4668274 sigma out 15 active outputs RANK 3 NODE 10 --> 18.1712399 sigma out 15 active outputs RANK 4 NODE 9 --> 12.3268185 sigma out 15 active outputs RANK 5 NODE 6 --> 12.0931282 sigma out 15 active outputs RANK 6 NODE 8 --> 10.3023148 sigma out 15 active outputs RANK 7 NODE 5 --> 10.3004065 sigma out 15 active outputs RANK 8 NODE 7 --> 8.72188091 sigma out 15 active outputs RANK 9 NODE 4 --> 8.05593967 sigma out 15 active outputs RANK 10 NODE 3 --> 7.4367671 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 27.6975899 sigma in 10act. ( 26.5138035 sig out 1act.) RANK 2 NODE 11 --> 24.2397175 sigma in 10act. ( 16.4234848 sig out 1act.) RANK 3 NODE 10 --> 16.1802692 sigma in 10act. ( 11.7001677 sig out 1act.) RANK 4 NODE 12 --> 16.1523323 sigma in 10act. ( 12.5603952 sig out 1act.) RANK 5 NODE 6 --> 11.2827806 sigma in 10act. ( 10.3565521 sig out 1act.) RANK 6 NODE 8 --> 11.2291479 sigma in 10act. ( 10.8636503 sig out 1act.) RANK 7 NODE 4 --> 9.25714493 sigma in 10act. ( 7.08260965 sig out 1act.) RANK 8 NODE 5 --> 8.69076729 sigma in 10act. ( 7.39402437 sig out 1act.) RANK 9 NODE 9 --> 7.49894285 sigma in 10act. ( 5.57278299 sig out 1act.) RANK 10 NODE 7 --> 7.4810648 sigma in 10act. ( 5.82193232 sig out 1act.) RANK 11 NODE 2 --> 7.1176486 sigma in 10act. ( 6.41536522 sig out 1act.) RANK 12 NODE 15 --> 6.08590508 sigma in 10act. ( 4.44370222 sig out 1act.) RANK 13 NODE 3 --> 6.05756092 sigma in 10act. ( 4.93971539 sig out 1act.) RANK 14 NODE 13 --> 6.03294277 sigma in 10act. ( 4.55849457 sig out 1act.) RANK 15 NODE 1 --> 2.7592411 sigma in 10act. ( 1.04538655 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 26.5138035 sigma out 1act.( 27.6975899 sig in 10act.) RANK 2 NODE 11 --> 16.4234848 sigma out 1act.( 24.2397175 sig in 10act.) RANK 3 NODE 12 --> 12.5603952 sigma out 1act.( 16.1523323 sig in 10act.) RANK 4 NODE 10 --> 11.7001677 sigma out 1act.( 16.1802692 sig in 10act.) RANK 5 NODE 8 --> 10.8636503 sigma out 1act.( 11.2291479 sig in 10act.) RANK 6 NODE 6 --> 10.3565521 sigma out 1act.( 11.2827806 sig in 10act.) RANK 7 NODE 5 --> 7.39402437 sigma out 1act.( 8.69076729 sig in 10act.) RANK 8 NODE 4 --> 7.08260965 sigma out 1act.( 9.25714493 sig in 10act.) RANK 9 NODE 2 --> 6.41536522 sigma out 1act.( 7.1176486 sig in 10act.) RANK 10 NODE 7 --> 5.82193232 sigma out 1act.( 7.4810648 sig in 10act.) RANK 11 NODE 9 --> 5.57278299 sigma out 1act.( 7.49894285 sig in 10act.) RANK 12 NODE 3 --> 4.93971539 sigma out 1act.( 6.05756092 sig in 10act.) RANK 13 NODE 13 --> 4.55849457 sigma out 1act.( 6.03294277 sig in 10act.) RANK 14 NODE 15 --> 4.44370222 sigma out 1act.( 6.08590508 sig in 10act.) RANK 15 NODE 1 --> 1.04538655 sigma out 1act.( 2.7592411 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.0667305 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.586674094 *** contribution from regularisation: 0.00242900616 *** contribution from error: -0.589103103 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52340.1283 0.333778143 14.7621298 EXIT FROM BFGS code NEW_X -52340.1283 0.333778143 14.7621298 ENTER BFGS code NEW_X -52340.1283 0.333778143 14.7621298 EXIT FROM BFGS code FG_LNSRCH 0. 0.215093747 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.586883724 *** contribution from regularisation: 0.00238755532 *** contribution from error: -0.589271307 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52358.8288 0.215093747 -11.6301718 EXIT FROM BFGS code NEW_X -52358.8288 0.215093747 -11.6301718 ENTER BFGS code NEW_X -52358.8288 0.215093747 -11.6301718 EXIT FROM BFGS code FG_LNSRCH 0. 0.179159686 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.586951017 *** contribution from regularisation: 0.00254334323 *** contribution from error: -0.589494348 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52364.8337 0.179159686 -10.4120655 EXIT FROM BFGS code NEW_X -52364.8337 0.179159686 -10.4120655 ENTER BFGS code NEW_X -52364.8337 0.179159686 -10.4120655 EXIT FROM BFGS code FG_LNSRCH 0. 0.0945154428 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.586748421 *** contribution from regularisation: 0.00245764176 *** contribution from error: -0.58920604 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52346.758 0.0945154428 -0.249753803 EXIT FROM BFGS code FG_LNSRCH 0. 0.163649291 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.586774349 *** contribution from regularisation: 0.00271749846 *** contribution from error: -0.589491844 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52349.0725 0.163649291 -8.23031044 EXIT FROM BFGS code FG_LNSRCH 0. 0.178629696 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.586912394 *** contribution from regularisation: 0.00258238101 *** contribution from error: -0.589494765 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52361.3897 0.178629696 -10.366044 EXIT FROM BFGS code FG_LNSRCH 0. 0.179156467 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.58688879 *** contribution from regularisation: 0.0026055784 *** contribution from error: -0.589494348 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52359.2817 0.179156467 -10.4139032 EXIT FROM BFGS code FG_LNSRCH 0. 0.179159686 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.586894214 *** contribution from regularisation: 0.00260013179 *** contribution from error: -0.589494348 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52359.7673 0.179159686 -10.4324808 EXIT FROM BFGS code FG_LNSRCH 0. 0.179159686 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.586900175 *** contribution from regularisation: 0.00259418366 *** contribution from error: -0.589494348 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52360.2979 0.179159686 -10.4780397 EXIT FROM BFGS code FG_LNSRCH 0. 0.179159686 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.586888194 *** contribution from regularisation: 0.00260615814 *** contribution from error: -0.589494348 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52359.2297 0.179159686 -10.4514008 EXIT FROM BFGS code FG_LNSRCH 0. 0.179159686 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 36.3758469 sigma out 15 active outputs RANK 2 NODE 1 --> 19.2546253 sigma out 15 active outputs RANK 3 NODE 10 --> 17.1556206 sigma out 15 active outputs RANK 4 NODE 6 --> 13.5412273 sigma out 15 active outputs RANK 5 NODE 9 --> 12.0250206 sigma out 15 active outputs RANK 6 NODE 4 --> 11.166337 sigma out 15 active outputs RANK 7 NODE 5 --> 10.9345646 sigma out 15 active outputs RANK 8 NODE 8 --> 10.8695135 sigma out 15 active outputs RANK 9 NODE 3 --> 10.658494 sigma out 15 active outputs RANK 10 NODE 7 --> 8.28535843 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 35.2270813 sigma in 10act. ( 33.4935226 sig out 1act.) RANK 2 NODE 11 --> 24.4476166 sigma in 10act. ( 16.8612423 sig out 1act.) RANK 3 NODE 10 --> 14.8794727 sigma in 10act. ( 10.1040573 sig out 1act.) RANK 4 NODE 12 --> 13.5844669 sigma in 10act. ( 10.8858995 sig out 1act.) RANK 5 NODE 6 --> 11.5294399 sigma in 10act. ( 9.84475899 sig out 1act.) RANK 6 NODE 8 --> 10.9195814 sigma in 10act. ( 10.1225176 sig out 1act.) RANK 7 NODE 5 --> 9.89674759 sigma in 10act. ( 8.85862064 sig out 1act.) RANK 8 NODE 4 --> 7.8616786 sigma in 10act. ( 5.53649807 sig out 1act.) RANK 9 NODE 9 --> 6.37712479 sigma in 10act. ( 4.55999708 sig out 1act.) RANK 10 NODE 7 --> 6.30137539 sigma in 10act. ( 4.60199594 sig out 1act.) RANK 11 NODE 3 --> 6.20803404 sigma in 10act. ( 4.99001884 sig out 1act.) RANK 12 NODE 13 --> 5.30866289 sigma in 10act. ( 3.80698514 sig out 1act.) RANK 13 NODE 15 --> 5.29425716 sigma in 10act. ( 3.6775794 sig out 1act.) RANK 14 NODE 2 --> 4.89160299 sigma in 10act. ( 3.02998853 sig out 1act.) RANK 15 NODE 1 --> 2.3092742 sigma in 10act. ( 0.755079746 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 33.4935226 sigma out 1act.( 35.2270813 sig in 10act.) RANK 2 NODE 11 --> 16.8612423 sigma out 1act.( 24.4476166 sig in 10act.) RANK 3 NODE 12 --> 10.8858995 sigma out 1act.( 13.5844669 sig in 10act.) RANK 4 NODE 8 --> 10.1225176 sigma out 1act.( 10.9195814 sig in 10act.) RANK 5 NODE 10 --> 10.1040573 sigma out 1act.( 14.8794727 sig in 10act.) RANK 6 NODE 6 --> 9.84475899 sigma out 1act.( 11.5294399 sig in 10act.) RANK 7 NODE 5 --> 8.85862064 sigma out 1act.( 9.89674759 sig in 10act.) RANK 8 NODE 4 --> 5.53649807 sigma out 1act.( 7.8616786 sig in 10act.) RANK 9 NODE 3 --> 4.99001884 sigma out 1act.( 6.20803404 sig in 10act.) RANK 10 NODE 7 --> 4.60199594 sigma out 1act.( 6.30137539 sig in 10act.) RANK 11 NODE 9 --> 4.55999708 sigma out 1act.( 6.37712479 sig in 10act.) RANK 12 NODE 13 --> 3.80698514 sigma out 1act.( 5.30866289 sig in 10act.) RANK 13 NODE 15 --> 3.6775794 sigma out 1act.( 5.29425716 sig in 10act.) RANK 14 NODE 2 --> 3.02998853 sigma out 1act.( 4.89160299 sig in 10act.) RANK 15 NODE 1 --> 0.755079746 sigma out 1act.( 2.3092742 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 45.164875 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.586873174 *** contribution from regularisation: 0.00262114382 *** contribution from error: -0.589494288 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52357.8927 0.179159686 -10.463088 EXIT FROM BFGS code NEW_X -52357.8927 0.179159686 -10.463088 ENTER BFGS code NEW_X -52357.8927 0.179159686 -10.463088 EXIT FROM BFGS code CONVERGENC -52357.8927 0.179159686 -10.463088 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 60.2611084 sigma out 15 active outputs RANK 2 NODE 1 --> 31.5524712 sigma out 15 active outputs RANK 3 NODE 10 --> 26.9523945 sigma out 15 active outputs RANK 4 NODE 6 --> 22.4299107 sigma out 15 active outputs RANK 5 NODE 9 --> 19.587286 sigma out 15 active outputs RANK 6 NODE 4 --> 18.3343487 sigma out 15 active outputs RANK 7 NODE 3 --> 17.6296444 sigma out 15 active outputs RANK 8 NODE 5 --> 17.5834465 sigma out 15 active outputs RANK 9 NODE 8 --> 17.1873703 sigma out 15 active outputs RANK 10 NODE 7 --> 13.6575356 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 59.4408188 sigma in 10act. ( 57.8111038 sig out 1act.) RANK 2 NODE 11 --> 40.5392723 sigma in 10act. ( 28.7668209 sig out 1act.) RANK 3 NODE 10 --> 23.9176807 sigma in 10act. ( 17.6520252 sig out 1act.) RANK 4 NODE 12 --> 21.7059517 sigma in 10act. ( 18.0613155 sig out 1act.) RANK 5 NODE 6 --> 18.0963516 sigma in 10act. ( 16.9464569 sig out 1act.) RANK 6 NODE 8 --> 17.6439972 sigma in 10act. ( 17.3646069 sig out 1act.) RANK 7 NODE 5 --> 15.6376333 sigma in 10act. ( 14.9482155 sig out 1act.) RANK 8 NODE 4 --> 12.2945738 sigma in 10act. ( 9.32627487 sig out 1act.) RANK 9 NODE 9 --> 9.74412632 sigma in 10act. ( 7.70464993 sig out 1act.) RANK 10 NODE 7 --> 9.45372868 sigma in 10act. ( 7.94406366 sig out 1act.) RANK 11 NODE 3 --> 9.2533083 sigma in 10act. ( 8.11034393 sig out 1act.) RANK 12 NODE 13 --> 7.73649883 sigma in 10act. ( 6.42636967 sig out 1act.) RANK 13 NODE 15 --> 6.98753357 sigma in 10act. ( 6.22894335 sig out 1act.) RANK 14 NODE 2 --> 6.24062586 sigma in 10act. ( 5.10961008 sig out 1act.) RANK 15 NODE 1 --> 2.5141952 sigma in 10act. ( 1.2366482 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 57.8111038 sigma out 1act.( 59.4408188 sig in 10act.) RANK 2 NODE 11 --> 28.7668209 sigma out 1act.( 40.5392723 sig in 10act.) RANK 3 NODE 12 --> 18.0613155 sigma out 1act.( 21.7059517 sig in 10act.) RANK 4 NODE 10 --> 17.6520252 sigma out 1act.( 23.9176807 sig in 10act.) RANK 5 NODE 8 --> 17.3646069 sigma out 1act.( 17.6439972 sig in 10act.) RANK 6 NODE 6 --> 16.9464569 sigma out 1act.( 18.0963516 sig in 10act.) RANK 7 NODE 5 --> 14.9482155 sigma out 1act.( 15.6376333 sig in 10act.) RANK 8 NODE 4 --> 9.32627487 sigma out 1act.( 12.2945738 sig in 10act.) RANK 9 NODE 3 --> 8.11034393 sigma out 1act.( 9.2533083 sig in 10act.) RANK 10 NODE 7 --> 7.94406366 sigma out 1act.( 9.45372868 sig in 10act.) RANK 11 NODE 9 --> 7.70464993 sigma out 1act.( 9.74412632 sig in 10act.) RANK 12 NODE 13 --> 6.42636967 sigma out 1act.( 7.73649883 sig in 10act.) RANK 13 NODE 15 --> 6.22894335 sigma out 1act.( 6.98753357 sig in 10act.) RANK 14 NODE 2 --> 5.10961008 sigma out 1act.( 6.24062586 sig in 10act.) RANK 15 NODE 1 --> 1.2366482 sigma out 1act.( 2.5141952 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 77.4763336 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.586905122 *** contribution from regularisation: 0.00258924579 *** contribution from error: -0.589494348 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26967 Closing output file done