NNInput NNInputs_155.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 191095 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 51295 nbkg = 139800 Bkg Entries: 139800 Sig Entries: 51295 Chosen entries: 51295 Signal fraction: 1 Background fraction: 0.366917 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 139800 Actual Signal Entries: 51295 Entries to split: 51295 Test with : 25647 Train with : 25647 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 51295 for Signal Prepared event 0 for Signal with 51295 events ====Entry 0 Variable Ht : 266.323 Variable LepAPt : 64.2176 Variable LepBPt : 58.0643 Variable MetSigLeptonsJets : 2.54404 Variable MetSpec : 36.171 Variable SumEtLeptonsJets : 227.916 Variable VSumJetLeptonsPt : 47.3654 Variable addEt : 160.689 Variable dPhiLepSumMet : 2.30851 Variable dPhiLeptons : 0.188909 Variable dRLeptons : 0.230155 Variable lep1_E : 71.5884 Variable lep2_E : 61.5172 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2155 Ht = 266.323 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 64.2176 LepAPt = 64.2176 LepBEt = 58.0643 LepBPt = 58.0643 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 38.4071 MetDelPhi = 1.22788 MetSig = 2.2508 MetSigLeptonsJets = 2.54404 MetSpec = 36.171 Mjj = 0 MostCentralJetEta = 0.570342 MtllMet = 163.453 Njets = 1 SB = 0 SumEt = 291.171 SumEtJets = 0 SumEtLeptonsJets = 227.916 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 47.3654 addEt = 160.689 dPhiLepSumMet = 2.30851 dPhiLeptons = 0.188909 dRLeptons = 0.230155 diltype = 45 dimass = 14.0433 event = 519 jet1_Et = 105.634 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.5884 lep2_E = 61.5172 rand = 0.999742 run = 236753 weight = 3.57235e-06 ===Show End Prepared event 10000 for Signal with 51295 events Prepared event 20000 for Signal with 51295 events Prepared event 30000 for Signal with 51295 events Prepared event 40000 for Signal with 51295 events Prepared event 50000 for Signal with 51295 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 139800 for Background Prepared event 0 for Background with 139800 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.289174 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00331651 ===Show End Prepared event 10000 for Background with 139800 events Prepared event 20000 for Background with 139800 events Prepared event 30000 for Background with 139800 events Prepared event 40000 for Background with 139800 events Prepared event 50000 for Background with 139800 events Prepared event 60000 for Background with 139800 events Prepared event 70000 for Background with 139800 events Prepared event 80000 for Background with 139800 events Prepared event 90000 for Background with 139800 events Prepared event 100000 for Background with 139800 events Prepared event 110000 for Background with 139800 events Prepared event 120000 for Background with 139800 events Prepared event 130000 for Background with 139800 events Warning: found 4436 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 191095 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4436 negative weights. Signal fraction: 62.7394142 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0054131 63.0621681 64.9539948 66.5770416 67.929512 68.9308014 70.0876694 70.7940903 71.5981445 72.4848862 73.3785858 73.9781647 74.6758041 75.3325195 75.8913193 76.6956482 77.267746 77.9953461 78.6130905 79.2914352 79.8321457 80.6337433 81.3163452 82.1615677 82.693634 83.526123 84.5776672 85.4595947 86.5524139 87.7616425 88.7193909 89.8445206 91.4675903 92.8770294 94.2750931 95.5882111 97.1451263 98.6247253 100.225906 101.79306 103.379288 104.838211 106.271088 107.742104 109.201187 110.794464 112.020966 113.461182 115.086792 116.499023 118.033371 119.635208 121.199745 122.677658 124.144363 125.577484 127.141815 128.52774 130.022339 131.565369 133.03743 134.288712 135.745026 137.106964 138.469574 139.794342 141.174927 142.407623 143.863663 145.191132 146.623291 148.024109 149.421021 150.931702 152.467163 154.180176 155.967468 157.933472 160.065933 162.176254 164.451355 166.870117 169.518982 172.141129 174.76004 177.406891 180.300873 183.715881 187.070496 190.661438 194.930695 199.431305 204.642136 210.232681 216.650482 224.74675 234.834808 248.052032 268.259583 301.531372 888.225952 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3468552 20.6835785 20.9716377 21.2630081 21.4887295 21.7633171 21.9977322 22.2119198 22.4249344 22.6418591 22.845789 23.0902367 23.3130608 23.5087318 23.7201862 23.8990746 24.1052971 24.3476963 24.5608559 24.7729073 24.9656219 25.1727486 25.3645458 25.5655708 25.7436218 25.951561 26.1544075 26.3692207 26.5769424 26.7882042 27.0265274 27.2566223 27.5063515 27.7630653 27.9915161 28.2140884 28.4393902 28.6622658 28.8562374 29.0892563 29.3214035 29.570467 29.747467 29.9847717 30.259325 30.5457172 30.7542534 31.0522728 31.3010826 31.5263252 31.7712555 31.993082 32.2359543 32.5588837 32.8119545 33.0969543 33.3495026 33.6725006 33.9296341 34.2060699 34.5304222 34.8159332 35.124382 35.4321671 35.7432327 36.0592918 36.3356323 36.6596031 36.9752121 37.3248596 37.6918945 38.0802689 38.4212494 38.7777786 39.1177597 39.4693947 39.86129 40.2454758 40.6375809 41.0762787 41.5211868 41.9782715 42.4809952 43.0210037 43.5462303 44.1041183 44.7239571 45.41819 46.1430817 47.0129089 47.8478317 48.8858681 50.0838852 51.4071884 53.0764313 55.1260872 57.7230225 61.6203537 69.0393219 163.247238 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1177654 10.2509775 10.3729906 10.4753551 10.615324 10.7511387 10.8946218 10.9952974 11.1120005 11.2677183 11.390172 11.5188084 11.6717548 11.7903824 11.9439678 12.1076298 12.2564621 12.3963137 12.5504065 12.7052326 12.8470488 13.0054359 13.1778383 13.3731937 13.5550909 13.7411366 13.9052773 14.0766239 14.2486095 14.4328413 14.651516 14.8580055 15.0808744 15.2939167 15.4726877 15.6899872 15.8767586 16.0891838 16.3265762 16.5614319 16.8255177 17.0910549 17.3378582 17.6295509 17.8497925 18.1149063 18.3742065 18.6126862 18.8883209 19.1298447 19.3672333 19.6465645 19.9436188 20.1881332 20.4176064 20.6709557 20.9415169 21.1911545 21.4721394 21.7476215 22.0064201 22.2792282 22.5606308 22.8619843 23.1429901 23.4429951 23.7549744 24.0822372 24.3767338 24.6948299 25.0000992 25.3399849 25.6572495 25.9919395 26.3500309 26.6958771 27.0555878 27.3768368 27.7519627 28.0979004 28.4117546 28.8250465 29.2156773 29.6293964 30.0549011 30.4793339 30.9472923 31.4431992 31.9264851 32.4506912 33.0671883 33.6611557 34.358696 35.1502953 36.0709915 37.2113991 38.7181702 41.1463013 45.9944229 74.5743942 ------------------------------ Transdef: Tab for variable 5 1.34787333 2.68216276 3.10271263 3.40378737 3.66081476 3.88174677 4.06943369 4.20423555 4.33674717 4.44283772 4.55532551 4.64340448 4.73353481 4.81724072 4.90482235 4.98449326 5.06356907 5.12667847 5.18368626 5.24853611 5.30311203 5.36693335 5.41812134 5.45800447 5.50512028 5.54957151 5.59481192 5.63711309 5.68052578 5.72720242 5.77987099 5.83312035 5.87533998 5.92069912 5.9626503 6.00730467 6.05234623 6.0863533 6.13205671 6.17847729 6.21622896 6.26036835 6.29987526 6.33960104 6.38465881 6.43207645 6.47458363 6.51265192 6.55637074 6.60651159 6.64980602 6.69681311 6.74957752 6.78949451 6.83439064 6.86962366 6.91475964 6.97055054 7.02663136 7.07241058 7.12571669 7.17743492 7.23315525 7.28627968 7.33444071 7.38958597 7.43234396 7.48976231 7.54033375 7.60383272 7.65690708 7.71662474 7.7745719 7.83736134 7.89767075 7.95359468 8.00940514 8.07560253 8.13720322 8.19896507 8.25983429 8.32511425 8.38686943 8.44995403 8.52484894 8.60116768 8.67134285 8.75414848 8.83572197 8.92929268 9.02466202 9.13061142 9.25119781 9.37581444 9.52345467 9.69377327 9.92481041 10.2159252 10.6687679 11.4379339 23.5595493 ------------------------------ Transdef: Tab for variable 6 15.0119848 21.0460854 25.4521179 26.5945015 27.4497585 28.3595276 29.2047844 29.8555183 30.5487881 31.1433067 31.6629181 32.2131958 32.6935272 33.1964951 33.6362 34.0899658 34.5995636 34.9599991 35.3709183 35.754055 36.1546478 36.4947662 36.8825455 37.2229538 37.5477676 37.935421 38.3222656 38.769043 39.1583519 39.5010147 39.8435822 40.248333 40.5641708 40.9900742 41.3908691 41.7804527 42.1974258 42.6105042 43.054245 43.4807129 43.8882141 44.2714996 44.7838135 45.4227562 46.0318985 46.650383 47.2276268 47.9017944 48.5282593 49.2465057 49.8346062 50.4343185 51.1056595 51.8357544 52.5367661 53.3288994 54.0512085 54.6047211 55.335762 56.07061 56.7767868 57.5483627 58.2130585 58.851223 59.6278381 60.3478661 61.0061264 61.7456207 62.4793701 63.2591705 64.0386276 64.7243347 65.4605331 66.2387238 66.9090271 67.6235657 68.3631668 69.1578369 69.8503876 70.5967255 71.4000244 72.1872711 72.9664078 73.8053284 74.6976013 75.6115494 76.5751343 77.5436401 78.6693802 79.8708267 81.2633667 82.953125 84.865509 86.9759979 89.536026 92.3875504 96.0202789 100.585709 107.880249 120.815704 218.598831 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.8080139 33.7757301 34.3949127 35.057785 35.5195007 35.9138718 36.3042221 36.709156 37.0689545 37.4511948 37.7676811 38.1058731 38.3820229 38.7240067 39.0561142 39.3207932 39.6043358 39.9710579 40.2742119 40.5980492 40.9500542 41.3709641 41.6750984 42.0144043 42.4573593 42.8857536 43.4040985 43.9640274 44.601265 45.1606407 45.8628235 46.7424622 47.456131 48.3608398 49.1812515 50.0902863 51.1134338 52.1489029 53.0057068 53.9664803 54.9049454 55.7710686 56.4649162 57.3322754 58.1966515 59.0293503 59.8424225 60.6759033 61.4070129 62.2092018 62.9649467 63.7023163 64.4517059 65.2157135 66.0788422 66.8466187 67.7058868 68.5557022 69.3944244 70.2388458 71.072113 72.0007324 72.8526764 73.6740875 74.6039429 75.5952377 76.6287231 77.6211395 78.7410583 80.0026398 81.3631744 82.6894226 84.1899567 85.735466 87.2647934 88.7486954 90.4739838 92.2155914 93.8864441 95.5622635 97.5506897 99.4340668 101.610809 103.804161 106.136757 108.645187 111.207848 114.000862 117.007111 120.75087 124.666122 128.742828 133.818436 139.198929 145.711487 154.117523 165.856857 181.925354 208.921448 532.093323 ------------------------------ Transdef: Tab for variable 8 3.10723281 24.4649239 28.7693787 30.7051086 31.8503456 32.6170502 33.1692505 33.731369 34.1583443 34.5930557 34.9701042 35.2742844 35.5739098 35.9328575 36.2644501 36.5577888 36.9037514 37.2231293 37.4981308 37.7802734 38.0499649 38.340538 38.6402588 38.8898544 39.1855583 39.4055328 39.6573792 39.9473495 40.2453918 40.4856262 40.8627243 41.2209625 41.5373688 41.8813705 42.3005905 42.6787796 43.1289291 43.5598755 44.0117569 44.4834595 45.0608978 45.5156631 46.0736504 46.7217674 47.3198242 47.9340897 48.5105743 49.0351868 49.7121811 50.3865204 51.0107765 51.6608734 52.3590775 53.0191841 53.6588097 54.2574959 54.9313622 55.5580864 56.1982079 56.8656235 57.4992294 58.1135826 58.7797928 59.4193916 60.0657997 60.6701889 61.2718277 61.9092789 62.5779495 63.174942 63.8127441 64.4720001 65.1138 65.7450562 66.4016113 67.1222839 67.8171844 68.5324554 69.2089996 69.9236984 70.676239 71.4334869 72.2254639 73.0296707 73.8034821 74.6783295 75.6476593 76.6671295 77.7030487 78.7928848 80.267807 81.9146118 83.8282166 86.0219116 88.7055435 91.9072342 95.8087311 100.604568 108.061676 122.723206 348.466034 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.7242661 64.4867096 66.1341858 67.3835144 68.3629761 69.3977661 70.2084198 70.8136749 71.4993744 72.2422028 73.1000595 73.7168045 74.2619171 74.9019012 75.4689941 76.019516 76.7047882 77.2246399 77.8591232 78.4435043 78.9946823 79.5005035 80.0679932 80.7116547 81.3591309 81.9997482 82.5208511 83.0775757 83.7736435 84.6574173 85.3287735 86.1417084 87.0473862 87.9845886 88.7437592 89.6305847 90.697525 91.9660492 92.9334412 94.0766296 95.109787 96.2498779 97.5276413 98.8602448 100.210579 101.606445 102.771957 104.081757 105.44989 106.638535 107.936081 109.12886 110.390694 111.645309 112.867142 114.209129 115.304199 116.347946 117.472 118.678696 119.745758 120.841431 121.986252 123.053963 124.164978 125.284744 126.40464 127.509567 128.603043 129.728241 130.813721 131.944885 133.035202 134.157349 135.279846 136.341888 137.384598 138.421982 139.480652 140.52417 141.627228 142.754166 143.868408 144.989746 146.125931 147.327087 148.34314 149.518188 150.806503 152.162659 153.56543 155.187485 156.894531 158.926331 161.492737 164.549622 169.130066 176.948242 192.92627 450.732758 ------------------------------ Transdef: Tab for variable 10 0.00305827498 1.10850668 1.42304635 1.63450778 1.79092562 1.89927614 1.99843764 2.08203173 2.14451075 2.21015644 2.26215601 2.31598306 2.36186886 2.40301943 2.44203138 2.47525525 2.50588942 2.53835392 2.56615448 2.59114289 2.61663342 2.63646698 2.65980911 2.68150806 2.70137119 2.71945405 2.7367537 2.75362253 2.77294302 2.78590536 2.80067778 2.81515837 2.82636952 2.83918428 2.85162544 2.86165595 2.87322688 2.88341808 2.89248323 2.90151 2.91071677 2.91755009 2.92425156 2.93074822 2.93819547 2.94619823 2.95228195 2.95850134 2.9650526 2.97111511 2.97756338 2.98365068 2.98742032 2.99209404 2.996912 3.00240397 3.00730944 3.01175833 3.0162878 3.02076077 3.02502918 3.02877283 3.03239775 3.03665257 3.04079843 3.04498005 3.04902458 3.05291343 3.05632305 3.05919862 3.06218195 3.06553888 3.06833148 3.0717628 3.07489967 3.07745934 3.08052516 3.08353186 3.08670807 3.08931303 3.09221554 3.09489608 3.09713459 3.10011053 3.1027267 3.10497952 3.10802722 3.11093426 3.11341381 3.11611509 3.11835217 3.12066698 3.12333918 3.12597942 3.12833548 3.13053346 3.1328156 3.13461637 3.13697815 3.13915777 3.1415925 ------------------------------ Transdef: Tab for variable 11 5.7220459E-06 0.00570762716 0.011607565 0.0186051652 0.0247445628 0.0313642174 0.038615942 0.0462286472 0.0528770685 0.059653461 0.0670422316 0.0756939799 0.0828239843 0.0905263275 0.0980832577 0.105521269 0.113403201 0.120763302 0.127780735 0.134956598 0.142093599 0.148964524 0.155237585 0.161663771 0.168789148 0.174883068 0.180845216 0.187175333 0.19278264 0.198261976 0.204705238 0.210117161 0.215035975 0.220488906 0.225664139 0.231247842 0.236426473 0.242208004 0.247481227 0.253619909 0.258752704 0.263387918 0.267697662 0.273485661 0.278665066 0.283338308 0.288566113 0.294232965 0.29942584 0.303980827 0.309708357 0.314858913 0.320692897 0.3259781 0.332291603 0.337100804 0.342603564 0.347996861 0.353542149 0.358884454 0.364785671 0.370660901 0.376742661 0.382578135 0.38845551 0.394113541 0.399359107 0.405308098 0.412023187 0.417990923 0.424848735 0.430757761 0.436411977 0.442692995 0.44949007 0.456109554 0.463481128 0.470219433 0.477048874 0.484790683 0.495281816 0.505099416 0.513476729 0.522479653 0.531280279 0.541137815 0.551456809 0.564192057 0.575440764 0.588822246 0.601411343 0.616373897 0.631929398 0.64747566 0.663859367 0.685639024 0.712610602 0.738028884 0.782130599 0.841781318 1.12674999 ------------------------------ Transdef: Tab for variable 12 0.20003137 0.213173211 0.22427544 0.234400511 0.243714571 0.251591027 0.259074032 0.267183483 0.274578601 0.281612277 0.288610578 0.295049429 0.301630795 0.307417005 0.3133955 0.318996549 0.32508105 0.330986738 0.3369115 0.342839718 0.348471045 0.353786349 0.359518886 0.364688605 0.369801581 0.375110328 0.379855335 0.385851234 0.390900403 0.395824671 0.400630474 0.404392749 0.408512205 0.412143886 0.415775031 0.419496894 0.423196405 0.426822066 0.430562377 0.434238881 0.437738299 0.441172123 0.445029795 0.448574066 0.452586949 0.456671417 0.460466206 0.464493573 0.46824652 0.472025037 0.47588551 0.479716063 0.483378053 0.487324059 0.491626203 0.495837748 0.500444412 0.505606532 0.509782434 0.514743388 0.518526733 0.523308039 0.527757168 0.532698274 0.538003266 0.543161273 0.548412144 0.553460002 0.558956146 0.563676715 0.569304109 0.575063586 0.580052376 0.586325705 0.591978908 0.59798646 0.60454011 0.611803353 0.618174374 0.625158191 0.632213354 0.640343904 0.648060083 0.657247663 0.665226579 0.673436403 0.681770802 0.693695068 0.703112006 0.713225961 0.723569751 0.735550702 0.747805357 0.759657621 0.776679158 0.795570612 0.813498139 0.834673226 0.863893986 0.914905906 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0044594 21.5328865 22.3977337 23.0279617 23.5495892 24.1879196 24.7331543 25.1769333 25.621336 26.0357876 26.5144005 26.9802761 27.3221741 27.6986732 28.1155624 28.4952965 28.8512001 29.214819 29.5111275 29.7957611 30.129837 30.446804 30.7535095 31.0213852 31.3954296 31.7087669 32.0527649 32.3729019 32.6998978 33.0647545 33.3827705 33.723217 34.0454292 34.4119949 34.6777267 34.9965286 35.3365402 35.6235962 35.9511795 36.2000046 36.5284882 36.9010277 37.2776527 37.6314621 37.9568748 38.2890129 38.6347427 38.9907608 39.3501816 39.7303886 40.1053314 40.4655762 40.8299255 41.1890411 41.5819321 41.9848175 42.3785324 42.7881432 43.0803146 43.4871368 43.8732376 44.3026123 44.7412796 45.2006531 45.683033 46.1772079 46.6055908 47.086525 47.5651932 48.0253067 48.5305367 49.0703506 49.5792274 50.1962814 50.8305321 51.5587044 52.2404709 52.9417038 53.7426796 54.4842682 55.3348465 56.1126556 56.93013 57.8126907 58.9487457 60.088501 61.1042633 62.3301163 63.8908424 65.5924835 66.9740295 68.9427338 70.6196747 73.1499634 75.7397461 78.4477692 82.5209808 87.0217514 93.3145065 103.191971 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.7459412 11.1478004 11.4967785 11.8405733 12.2653303 12.501524 12.8379211 13.1572847 13.4723854 13.7857208 14.083662 14.4090729 14.6824036 15.0075006 15.3308372 15.6225882 15.9176254 16.2493477 16.5094833 16.7812729 17.0851841 17.415062 17.6947765 17.9586792 18.2450314 18.5702763 18.8646603 19.1154404 19.3782387 19.6982231 19.9992638 20.3252563 20.6159134 20.9122696 21.1846867 21.4748211 21.7543812 22.0142517 22.3570271 22.6437511 22.9450531 23.2131634 23.4739456 23.7906322 24.1361198 24.4368896 24.7393303 25.0351639 25.3457375 25.6451778 25.9438019 26.2489052 26.5414734 26.8483639 27.1563969 27.4362621 27.7103577 27.9926796 28.3073311 28.621273 28.9424858 29.2547035 29.5909634 29.9028702 30.2206345 30.5456753 30.9046516 31.249218 31.555912 31.8969746 32.2717094 32.6931152 33.0776825 33.4714432 33.911232 34.3227272 34.7530365 35.1467133 35.6360893 36.1697235 36.7125969 37.2169724 37.7624474 38.2996445 38.925766 39.5451965 40.2135315 40.9988022 41.7779541 42.7563553 43.7608032 44.6257401 45.9235916 47.4570427 49.3538208 51.5579224 54.3080215 58.3061447 64.8005829 139.444885 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 66.1 48.4 54.5 30.0 49.9 63.3 55.1 64.3 -26.9 -18.1 -38.6 10.3 26.2 2 66.1 100.0 65.6 62.1 34.9 69.1 94.4 74.5 91.7 -44.7 -25.9 -50.7 28.3 35.6 3 48.4 65.6 100.0 46.9 8.6 34.0 69.0 52.9 71.0 -15.9 -27.2 -55.4 60.5 25.9 4 54.5 62.1 46.9 100.0 18.4 39.9 62.2 54.1 69.1 -12.5 -31.1 -63.3 18.6 71.6 5 30.0 34.9 8.6 18.4 100.0 84.0 7.4 57.2 56.7 24.5 -8.3 -13.4 -6.4 6.8 6 49.9 69.1 34.0 39.9 84.0 100.0 48.2 79.2 80.2 -6.7 -16.6 -31.6 7.8 20.5 7 63.3 94.4 69.0 62.2 7.4 48.2 100.0 66.0 80.2 -53.3 -24.8 -50.6 33.2 37.0 8 55.1 74.5 52.9 54.1 57.2 79.2 66.0 100.0 83.1 -10.2 -25.0 -44.9 21.9 32.1 9 64.3 91.7 71.0 69.1 56.7 80.2 80.2 83.1 100.0 -20.3 -28.9 -57.5 32.4 41.6 10 -26.9 -44.7 -15.9 -12.5 24.5 -6.7 -53.3 -10.2 -20.3 100.0 3.8 8.6 -4.1 -4.4 11 -18.1 -25.9 -27.2 -31.1 -8.3 -16.6 -24.8 -25.0 -28.9 3.8 100.0 54.1 -10.7 -20.4 12 -38.6 -50.7 -55.4 -63.3 -13.4 -31.6 -50.6 -44.9 -57.5 8.6 54.1 100.0 -25.3 -38.6 13 10.3 28.3 60.5 18.6 -6.4 7.8 33.2 21.9 32.4 -4.1 -10.7 -25.3 100.0 48.0 14 26.2 35.6 25.9 71.6 6.8 20.5 37.0 32.1 41.6 -4.4 -20.4 -38.6 48.0 100.0 TOTAL CORRELATION TO TARGET (diagonal) 166.099985 TOTAL CORRELATION OF ALL VARIABLES 72.7022812 ROUND 1: MAX CORR ( 72.6947553) AFTER KILLING INPUT VARIABLE 6 CONTR 1.04605938 ROUND 2: MAX CORR ( 72.6851111) AFTER KILLING INPUT VARIABLE 8 CONTR 1.18409365 ROUND 3: MAX CORR ( 72.6727154) AFTER KILLING INPUT VARIABLE 14 CONTR 1.34231539 ROUND 4: MAX CORR ( 72.6535702) AFTER KILLING INPUT VARIABLE 11 CONTR 1.66802439 ROUND 5: MAX CORR ( 72.5912083) AFTER KILLING INPUT VARIABLE 2 CONTR 3.0096075 ROUND 6: MAX CORR ( 72.4872956) AFTER KILLING INPUT VARIABLE 12 CONTR 3.88271748 ROUND 7: MAX CORR ( 72.2135704) AFTER KILLING INPUT VARIABLE 10 CONTR 6.29350999 ROUND 8: MAX CORR ( 71.2294271) AFTER KILLING INPUT VARIABLE 9 CONTR 11.8814341 ROUND 9: MAX CORR ( 70.342997) AFTER KILLING INPUT VARIABLE 3 CONTR 11.2024126 ROUND 10: MAX CORR ( 69.7924706) AFTER KILLING INPUT VARIABLE 13 CONTR 8.78340907 ROUND 11: MAX CORR ( 68.1480969) AFTER KILLING INPUT VARIABLE 4 CONTR 15.0607387 ROUND 12: MAX CORR ( 63.2636684) AFTER KILLING INPUT VARIABLE 5 CONTR 25.3351804 LAST REMAINING VARIABLE: 7 total correlation to target: 72.7022812 % total significance: 147.373452 sigma correlations of single variables to target: variable 2: 66.1346303 % , in sigma: 134.060288 variable 3: 48.3647939 % , in sigma: 98.0393809 variable 4: 54.464965 % , in sigma: 110.404925 variable 5: 29.9683525 % , in sigma: 60.7482942 variable 6: 49.9237204 % , in sigma: 101.199452 variable 7: 63.2636684 % , in sigma: 128.240615 variable 8: 55.1153264 % , in sigma: 111.723261 variable 9: 64.3444201 % , in sigma: 130.431386 variable 10: -26.871904 % , in sigma: 54.4715405 variable 11: -18.1267041 % , in sigma: 36.7443073 variable 12: -38.6359603 % , in sigma: 78.318242 variable 13: 10.3394474 % , in sigma: 20.9589029 variable 14: 26.2456906 % , in sigma: 53.2021549 variables sorted by significance: 1 most relevant variable 7 corr 63.2636681 , in sigma: 128.240614 2 most relevant variable 5 corr 25.3351803 , in sigma: 51.3564763 3 most relevant variable 4 corr 15.0607386 , in sigma: 30.5293452 4 most relevant variable 13 corr 8.78340912 , in sigma: 17.8046865 5 most relevant variable 3 corr 11.2024126 , in sigma: 22.7082038 6 most relevant variable 9 corr 11.8814344 , in sigma: 24.0846364 7 most relevant variable 10 corr 6.29350996 , in sigma: 12.7574579 8 most relevant variable 12 corr 3.88271737 , in sigma: 7.87058472 9 most relevant variable 2 corr 3.00960755 , in sigma: 6.10071992 10 most relevant variable 11 corr 1.66802442 , in sigma: 3.38122151 11 most relevant variable 14 corr 1.34231544 , in sigma: 2.72098284 12 most relevant variable 8 corr 1.18409359 , in sigma: 2.40025427 13 most relevant variable 6 corr 1.04605937 , in sigma: 2.12044764 global correlations between input variables: variable 2: 99.1725123 % variable 3: 92.3700451 % variable 4: 92.5254814 % variable 5: 95.5179633 % variable 6: 95.0987433 % variable 7: 98.7835848 % variable 8: 89.3420884 % variable 9: 98.7895949 % variable 10: 72.0069505 % variable 11: 55.1981216 % variable 12: 77.2618333 % variable 13: 84.422484 % variable 14: 88.1140537 % significance loss when removing single variables: variable 2: corr = 3.43026911 % , sigma = 6.95343521 variable 3: corr = 15.2213848 % , sigma = 30.8549881 variable 4: corr = 14.8560925 % , sigma = 30.1145109 variable 5: corr = 15.057866 % , sigma = 30.5235222 variable 6: corr = 1.04605938 % , sigma = 2.12044767 variable 7: corr = 6.86988851 % , sigma = 13.9258242 variable 8: corr = 1.4877409 % , sigma = 3.01577212 variable 9: corr = 11.2245132 % , sigma = 22.7530036 variable 10: corr = 5.81488566 % , sigma = 11.7872474 variable 11: corr = 1.68617134 % , sigma = 3.41800681 variable 12: corr = 2.88211631 % , sigma = 5.84228478 variable 13: corr = 7.80853597 % , sigma = 15.8285391 variable 14: corr = 1.35967718 % , sigma = 2.75617652 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 17.5028076 sigma out 15 active outputs RANK 2 NODE 1 --> 14.4896917 sigma out 15 active outputs RANK 3 NODE 8 --> 13.5849152 sigma out 15 active outputs RANK 4 NODE 2 --> 13.2868958 sigma out 15 active outputs RANK 5 NODE 4 --> 11.1604061 sigma out 15 active outputs RANK 6 NODE 6 --> 10.2845192 sigma out 15 active outputs RANK 7 NODE 5 --> 8.40109444 sigma out 15 active outputs RANK 8 NODE 9 --> 8.29855156 sigma out 15 active outputs RANK 9 NODE 3 --> 6.42338085 sigma out 15 active outputs RANK 10 NODE 7 --> 6.13337898 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 16.6783123 sigma in 10act. ( 20.1708221 sig out 1act.) RANK 2 NODE 14 --> 14.9549713 sigma in 10act. ( 19.7421341 sig out 1act.) RANK 3 NODE 1 --> 14.6207209 sigma in 10act. ( 13.1770229 sig out 1act.) RANK 4 NODE 7 --> 13.3591661 sigma in 10act. ( 12.2161169 sig out 1act.) RANK 5 NODE 12 --> 12.5214443 sigma in 10act. ( 13.9850206 sig out 1act.) RANK 6 NODE 13 --> 10.2691603 sigma in 10act. ( 16.2332191 sig out 1act.) RANK 7 NODE 3 --> 6.58909035 sigma in 10act. ( 6.52200794 sig out 1act.) RANK 8 NODE 6 --> 6.54275656 sigma in 10act. ( 8.78074265 sig out 1act.) RANK 9 NODE 15 --> 4.92958021 sigma in 10act. ( 4.1989193 sig out 1act.) RANK 10 NODE 5 --> 4.87214422 sigma in 10act. ( 2.80569863 sig out 1act.) RANK 11 NODE 2 --> 3.85073614 sigma in 10act. ( 5.42722511 sig out 1act.) RANK 12 NODE 8 --> 3.36118889 sigma in 10act. ( 5.1933074 sig out 1act.) RANK 13 NODE 10 --> 2.29716492 sigma in 10act. ( 3.47271657 sig out 1act.) RANK 14 NODE 9 --> 1.68317723 sigma in 10act. ( 2.95463896 sig out 1act.) RANK 15 NODE 4 --> 1.11762357 sigma in 10act. ( 1.24021649 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 20.1708221 sigma out 1act.( 16.6783123 sig in 10act.) RANK 2 NODE 14 --> 19.7421341 sigma out 1act.( 14.9549713 sig in 10act.) RANK 3 NODE 13 --> 16.2332191 sigma out 1act.( 10.2691603 sig in 10act.) RANK 4 NODE 12 --> 13.9850206 sigma out 1act.( 12.5214443 sig in 10act.) RANK 5 NODE 1 --> 13.1770229 sigma out 1act.( 14.6207209 sig in 10act.) RANK 6 NODE 7 --> 12.2161169 sigma out 1act.( 13.3591661 sig in 10act.) RANK 7 NODE 6 --> 8.78074265 sigma out 1act.( 6.54275656 sig in 10act.) RANK 8 NODE 3 --> 6.52200794 sigma out 1act.( 6.58909035 sig in 10act.) RANK 9 NODE 2 --> 5.42722511 sigma out 1act.( 3.85073614 sig in 10act.) RANK 10 NODE 8 --> 5.1933074 sigma out 1act.( 3.36118889 sig in 10act.) RANK 11 NODE 15 --> 4.1989193 sigma out 1act.( 4.92958021 sig in 10act.) RANK 12 NODE 10 --> 3.47271657 sigma out 1act.( 2.29716492 sig in 10act.) RANK 13 NODE 9 --> 2.95463896 sigma out 1act.( 1.68317723 sig in 10act.) RANK 14 NODE 5 --> 2.80569863 sigma out 1act.( 4.87214422 sig in 10act.) RANK 15 NODE 4 --> 1.24021649 sigma out 1act.( 1.11762357 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.4555473 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 30.7171307 sigma out 15 active outputs RANK 2 NODE 8 --> 16.1613617 sigma out 15 active outputs RANK 3 NODE 1 --> 15.8058643 sigma out 15 active outputs RANK 4 NODE 2 --> 14.7768612 sigma out 15 active outputs RANK 5 NODE 4 --> 14.0205555 sigma out 15 active outputs RANK 6 NODE 5 --> 12.8703613 sigma out 15 active outputs RANK 7 NODE 6 --> 12.3444338 sigma out 15 active outputs RANK 8 NODE 7 --> 11.20261 sigma out 15 active outputs RANK 9 NODE 9 --> 9.34523106 sigma out 15 active outputs RANK 10 NODE 3 --> 7.70152378 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 20.8020763 sigma in 10act. ( 19.2759285 sig out 1act.) RANK 2 NODE 13 --> 19.2552528 sigma in 10act. ( 17.0201645 sig out 1act.) RANK 3 NODE 11 --> 18.9603806 sigma in 10act. ( 19.6253872 sig out 1act.) RANK 4 NODE 1 --> 14.4956532 sigma in 10act. ( 11.7757769 sig out 1act.) RANK 5 NODE 12 --> 13.5940428 sigma in 10act. ( 13.0895395 sig out 1act.) RANK 6 NODE 7 --> 11.5039129 sigma in 10act. ( 10.7760315 sig out 1act.) RANK 7 NODE 9 --> 11.0742731 sigma in 10act. ( 5.91594028 sig out 1act.) RANK 8 NODE 8 --> 10.9071674 sigma in 10act. ( 6.79595613 sig out 1act.) RANK 9 NODE 6 --> 10.4526491 sigma in 10act. ( 9.14233494 sig out 1act.) RANK 10 NODE 2 --> 10.3808489 sigma in 10act. ( 5.61794472 sig out 1act.) RANK 11 NODE 10 --> 9.23111343 sigma in 10act. ( 4.21537971 sig out 1act.) RANK 12 NODE 5 --> 9.01389122 sigma in 10act. ( 2.66597295 sig out 1act.) RANK 13 NODE 4 --> 7.6669507 sigma in 10act. ( 3.36358428 sig out 1act.) RANK 14 NODE 3 --> 7.24672413 sigma in 10act. ( 6.17470217 sig out 1act.) RANK 15 NODE 15 --> 5.74713612 sigma in 10act. ( 3.92500544 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 19.6253872 sigma out 1act.( 18.9603806 sig in 10act.) RANK 2 NODE 14 --> 19.2759285 sigma out 1act.( 20.8020763 sig in 10act.) RANK 3 NODE 13 --> 17.0201645 sigma out 1act.( 19.2552528 sig in 10act.) RANK 4 NODE 12 --> 13.0895395 sigma out 1act.( 13.5940428 sig in 10act.) RANK 5 NODE 1 --> 11.7757769 sigma out 1act.( 14.4956532 sig in 10act.) RANK 6 NODE 7 --> 10.7760315 sigma out 1act.( 11.5039129 sig in 10act.) RANK 7 NODE 6 --> 9.14233494 sigma out 1act.( 10.4526491 sig in 10act.) RANK 8 NODE 8 --> 6.79595613 sigma out 1act.( 10.9071674 sig in 10act.) RANK 9 NODE 3 --> 6.17470217 sigma out 1act.( 7.24672413 sig in 10act.) RANK 10 NODE 9 --> 5.91594028 sigma out 1act.( 11.0742731 sig in 10act.) RANK 11 NODE 2 --> 5.61794472 sigma out 1act.( 10.3808489 sig in 10act.) RANK 12 NODE 10 --> 4.21537971 sigma out 1act.( 9.23111343 sig in 10act.) RANK 13 NODE 15 --> 3.92500544 sigma out 1act.( 5.74713612 sig in 10act.) RANK 14 NODE 4 --> 3.36358428 sigma out 1act.( 7.6669507 sig in 10act.) RANK 15 NODE 5 --> 2.66597295 sigma out 1act.( 9.01389122 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 41.9354401 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.443155348 *** contribution from regularisation: 0.00442511076 *** contribution from error: -0.447580457 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.497893751 *** contribution from regularisation: 0.00210162881 *** contribution from error: -0.499995381 *********************************************** -----------------> Test sample ENTER BFGS code START -47581.8086 0.179501519 0.306738853 EXIT FROM BFGS code FG_START 0. 0.179501519 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.5132128 *** contribution from regularisation: 0.0021567631 *** contribution from error: -0.515369534 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -49035.9436 0.179501519 97.9764404 EXIT FROM BFGS code FG_LNSRCH 0. 0.194625989 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.546257794 *** contribution from regularisation: 0.0030475785 *** contribution from error: -0.549305379 *********************************************** -----------------> Test sample ENTER BFGS ------------------------------------------ Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.548419833 *** contribution from regularisation: 0.00297447108 *** contribution from error: -0.551394284 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52399.8679 0.212483406 57.781929 EXIT FROM BFGS code NEW_X -52399.8679 0.212483406 57.781929 ENTER BFGS code NEW_X -52399.8679 0.212483406 57.781929 EXIT FROM BFGS code FG_LNSRCH 0. 0.23188509 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.550139606 *** contribution from regularisation: 0.00287126796 *** contribution from error: -0.553010881 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52564.1874 0.23188509 9.95112133 EXIT FROM BFGS code NEW_X -52564.1874 0.23188509 9.95112133 ENTER BFGS code NEW_X -52564.1874 0.23188509 9.95112133 EXIT FROM BFGS code FG_LNSRCH 0. 0.244900987 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.55068624 *** contribution from regularisation: 0.00284617464 *** contribution from error: -0.553532422 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52616.4161 0.244900987 -2.07017231 EXIT FROM BFGS code NEW_X -52616.4161 0.244900987 -2.07017231 ENTER BFGS code NEW_X -52616.4161 0.244900987 -2.07017231 EXIT FROM BFGS code FG_LNSRCH 0. 0.25265947 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.55092454 *** contribution from regularisation: 0.00284406194 *** contribution from error: -0.553768575 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52639.1853 0.25265947 -5.0104332 EXIT FROM BFGS code NEW_X -52639.1853 0.25265947 -5.0104332 ENTER BFGS code NEW_X -52639.1853 0.25265947 -5.0104332 EXIT FROM BFGS code FG_LNSRCH 0. 0.266910553 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.551275373 *** contribution from regularisation: 0.00282267039 *** contribution from error: -0.55409807 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52672.7068 0.266910553 10.1750593 EXIT FROM BFGS code NEW_X -52672.7068 0.266910553 10.1750593 ENTER BFGS code NEW_X -52672.7068 0.266910553 10.1750593 EXIT FROM BFGS code FG_LNSRCH 0. 0.309649289 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 40.7785912 sigma out 15 active outputs RANK 2 NODE 1 --> 23.1019001 sigma out 15 active outputs RANK 3 NODE 5 --> 16.2721691 sigma out 15 active outputs RANK 4 NODE 8 --> 15.8584957 sigma out 15 active outputs RANK 5 NODE 2 --> 15.2191105 sigma out 15 active outputs RANK 6 NODE 6 --> 14.7035465 sigma out 15 active outputs RANK 7 NODE 7 --> 11.7324677 sigma out 15 active outputs RANK 8 NODE 4 --> 10.7418261 sigma out 15 active outputs RANK 9 NODE 3 --> 9.73704624 sigma out 15 active outputs RANK 10 NODE 9 --> 9.08603668 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 26.6214485 sigma in 10act. ( 24.879324 sig out 1act.) RANK 2 NODE 14 --> 22.8499241 sigma in 10act. ( 19.4193897 sig out 1act.) RANK 3 NODE 9 --> 21.4645824 sigma in 10act. ( 20.282589 sig out 1act.) RANK 4 NODE 11 --> 19.4609051 sigma in 10act. ( 19.3032169 sig out 1act.) RANK 5 NODE 2 --> 16.5481663 sigma in 10act. ( 12.098814 sig out 1act.) RANK 6 NODE 8 --> 16.1453228 sigma in 10act. ( 13.5107946 sig out 1act.) RANK 7 NODE 5 --> 15.0232744 sigma in 10act. ( 15.5673046 sig out 1act.) RANK 8 NODE 4 --> 13.0540247 sigma in 10act. ( 11.899313 sig out 1act.) RANK 9 NODE 10 --> 12.509078 sigma in 10act. ( 8.83192825 sig out 1act.) RANK 10 NODE 12 --> 11.9118624 sigma in 10act. ( 10.5629597 sig out 1act.) RANK 11 NODE 3 --> 9.02187824 sigma in 10act. ( 7.98444366 sig out 1act.) RANK 12 NODE 1 --> 8.24889469 sigma in 10act. ( 6.27756929 sig out 1act.) RANK 13 NODE 6 --> 8.13681793 sigma in 10act. ( 6.96920729 sig out 1act.) RANK 14 NODE 7 --> 6.23489141 sigma in 10act. ( 5.78920698 sig out 1act.) RANK 15 NODE 15 --> 6.10745001 sigma in 10act. ( 5.46790886 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 24.879324 sigma out 1act.( 26.6214485 sig in 10act.) RANK 2 NODE 9 --> 20.282589 sigma out 1act.( 21.4645824 sig in 10act.) RANK 3 NODE 14 --> 19.4193897 sigma out 1act.( 22.8499241 sig in 10act.) RANK 4 NODE 11 --> 19.3032169 sigma out 1act.( 19.4609051 sig in 10act.) RANK 5 NODE 5 --> 15.5673046 sigma out 1act.( 15.0232744 sig in 10act.) RANK 6 NODE 8 --> 13.5107946 sigma out 1act.( 16.1453228 sig in 10act.) RANK 7 NODE 2 --> 12.098814 sigma out 1act.( 16.5481663 sig in 10act.) RANK 8 NODE 4 --> 11.899313 sigma out 1act.( 13.0540247 sig in 10act.) RANK 9 NODE 12 --> 10.5629597 sigma out 1act.( 11.9118624 sig in 10act.) RANK 10 NODE 10 --> 8.83192825 sigma out 1act.( 12.509078 sig in 10act.) RANK 11 NODE 3 --> 7.98444366 sigma out 1act.( 9.02187824 sig in 10act.) RANK 12 NODE 6 --> 6.96920729 sigma out 1act.( 8.13681793 sig in 10act.) RANK 13 NODE 1 --> 6.27756929 sigma out 1act.( 8.24889469 sig in 10act.) RANK 14 NODE 7 --> 5.78920698 sigma out 1act.( 6.23489141 sig in 10act.) RANK 15 NODE 15 --> 5.46790886 sigma out 1act.( 6.10745001 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.8300056 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.551900983 *** contribution from regularisation: 0.00282039749 *** contribution from error: -0.554721355 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52732.4836 0.309649289 0.566728711 EXIT FROM BFGS code NEW_X -52732.4836 0.309649289 0.566728711 ENTER BFGS code NEW_X -52732.4836 0.309649289 0.566728711 EXIT FROM BFGS code FG_LNSRCH 0. 0.404372513 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.552549958 *** contribution from regularisation: 0.00317500997 *** contribution from error: -0.555724978 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52794.4911 0.404372513 123.84774 EXIT FROM BFGS code NEW_X -52794.4911 0.404372513 123.84774 ENTER BFGS code NEW_X -52794.4911 0.404372513 123.84774 EXIT FROM BFGS code FG_LNSRCH 0. 0.440643847 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.553794444 *** contribution from regularisation: 0.00277093612 *** contribution from error: -0.556565404 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52913.3987 0.440643847 -37.6528282 EXIT FROM BFGS code NEW_X -52913.3987 0.440643847 -37.6528282 ENTER BFGS code NEW_X -52913.3987 0.440643847 -37.6528282 EXIT FROM BFGS code FG_LNSRCH 0. 0.40723145 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.553937435 *** contribution from regularisation: 0.00262060761 *** contribution from error: -0.556558013 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52927.0602 0.40723145 -2.71592736 EXIT FROM BFGS code NEW_X -52927.0602 0.40723145 -2.71592736 ENTER BFGS code NEW_X -52927.0602 0.40723145 -2.71592736 EXIT FROM BFGS code FG_LNSRCH 0. 0.411908418 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.553928316 *** contribution from regularisation: 0.00275368639 *** contribution from error: -0.556681991 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52926.1874 0.411908418 7.33356476 EXIT FROM BFGS code FG_LNSRCH 0. 0.408419371 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.553875864 *** contribution from regularisation: 0.00272659631 *** contribution from error: -0.556602478 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52921.1773 0.408419371 0.0196108986 EXIT FROM BFGS code FG_LNSRCH 0. 0.407313496 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.553823173 *** contribution from regularisation: 0.00273870048 *** contribution from error: -0.556561887 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52916.1425 0.407313496 -2.26706266 EXIT FROM BFGS code FG_LNSRCH 0. 0.407231748 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.553823054 *** contribution from regularisation: 0.00273501128 *** contribution from error: -0.556558073 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52916.1307 0.407231748 -2.39243746 EXIT FROM BFGS code FG_LNSRCH 0. 0.40723145 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.55382061 *** contribution from regularisation: 0.002737439 *** contribution from error: -0.556558073 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52915.8973 0.40723145 -2.34613466 EXIT FROM BFGS code FG_LNSRCH 0. 0.40723145 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.553821981 *** contribution from regularisation: 0.00273608649 *** contribution from error: -0.556558073 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52916.0265 0.40723145 -2.28615952 EXIT FROM BFGS code FG_LNSRCH 0. 0.40723145 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 42.4502983 sigma out 15 active outputs RANK 2 NODE 1 --> 27.4770393 sigma out 15 active outputs RANK 3 NODE 8 --> 21.6329536 sigma out 15 active outputs RANK 4 NODE 2 --> 20.862402 sigma out 15 active outputs RANK 5 NODE 5 --> 18.6661797 sigma out 15 active outputs RANK 6 NODE 6 --> 15.2403803 sigma out 15 active outputs RANK 7 NODE 3 --> 14.6100826 sigma out 15 active outputs RANK 8 NODE 7 --> 12.9453239 sigma out 15 active outputs RANK 9 NODE 4 --> 10.3568783 sigma out 15 active outputs RANK 10 NODE 9 --> 8.5568552 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 35.0658951 sigma in 10act. ( 33.751152 sig out 1act.) RANK 2 NODE 9 --> 26.0589123 sigma in 10act. ( 25.9913311 sig out 1act.) RANK 3 NODE 14 --> 25.6262493 sigma in 10act. ( 22.4177876 sig out 1act.) RANK 4 NODE 11 --> 21.5714703 sigma in 10act. ( 22.1352196 sig out 1act.) RANK 5 NODE 5 --> 19.9328156 sigma in 10act. ( 21.4371815 sig out 1act.) RANK 6 NODE 8 --> 16.6615143 sigma in 10act. ( 14.5458593 sig out 1act.) RANK 7 NODE 12 --> 14.6868048 sigma in 10act. ( 14.3222818 sig out 1act.) RANK 8 NODE 2 --> 13.49683 sigma in 10act. ( 10.2976141 sig out 1act.) RANK 9 NODE 4 --> 11.8143234 sigma in 10act. ( 10.1884098 sig out 1act.) RANK 10 NODE 10 --> 11.2515507 sigma in 10act. ( 9.46078014 sig out 1act.) RANK 11 NODE 3 --> 10.5132208 sigma in 10act. ( 11.0170212 sig out 1act.) RANK 12 NODE 15 --> 7.99571753 sigma in 10act. ( 8.60512829 sig out 1act.) RANK 13 NODE 6 --> 4.96256733 sigma in 10act. ( 3.01259923 sig out 1act.) RANK 14 NODE 1 --> 4.59040689 sigma in 10act. ( 1.68806219 sig out 1act.) RANK 15 NODE 7 --> 3.55181193 sigma in 10act. ( 1.66437995 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 33.751152 sigma out 1act.( 35.0658951 sig in 10act.) RANK 2 NODE 9 --> 25.9913311 sigma out 1act.( 26.0589123 sig in 10act.) RANK 3 NODE 14 --> 22.4177876 sigma out 1act.( 25.6262493 sig in 10act.) RANK 4 NODE 11 --> 22.1352196 sigma out 1act.( 21.5714703 sig in 10act.) RANK 5 NODE 5 --> 21.4371815 sigma out 1act.( 19.9328156 sig in 10act.) RANK 6 NODE 8 --> 14.5458593 sigma out 1act.( 16.6615143 sig in 10act.) RANK 7 NODE 12 --> 14.3222818 sigma out 1act.( 14.6868048 sig in 10act.) RANK 8 NODE 3 --> 11.0170212 sigma out 1act.( 10.5132208 sig in 10act.) RANK 9 NODE 2 --> 10.2976141 sigma out 1act.( 13.49683 sig in 10act.) RANK 10 NODE 4 --> 10.1884098 sigma out 1act.( 11.8143234 sig in 10act.) RANK 11 NODE 10 --> 9.46078014 sigma out 1act.( 11.2515507 sig in 10act.) RANK 12 NODE 15 --> 8.60512829 sigma out 1act.( 7.99571753 sig in 10act.) RANK 13 NODE 6 --> 3.01259923 sigma out 1act.( 4.96256733 sig in 10act.) RANK 14 NODE 1 --> 1.68806219 sigma out 1act.( 4.59040689 sig in 10act.) RANK 15 NODE 7 --> 1.66437995 sigma out 1act.( 3.55181193 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.7529678 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.553818882 *** contribution from regularisation: 0.00273916055 *** contribution from error: -0.556558013 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -52915.7328 0.40723145 -2.22587132 EXIT FROM BFGS code FG_LNSRCH 0. 0.40723145 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.553834736 *** contribution from regularisation: 0.00272331922 *** contribution from error: -0.556558073 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -52917.2464 0.40723145 -2.20969224 EXIT FROM BFGS code NEW_X -52917.2464 0.40723145 -2.20969224 ENTER BFGS code NEW_X -52917.2464 0.40723145 -2.20969224 EXIT FROM BFGS code CONVERGENC -52917.2464 0.40723145 -2.20969224 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 65.0328903 sigma out 15 active outputs RANK 2 NODE 1 --> 41.6013756 sigma out 15 active outputs RANK 3 NODE 8 --> 32.8083687 sigma out 15 active outputs RANK 4 NODE 2 --> 32.0940514 sigma out 15 active outputs RANK 5 NODE 5 --> 28.1878471 sigma out 15 active outputs RANK 6 NODE 6 --> 23.1600895 sigma out 15 active outputs RANK 7 NODE 3 --> 22.4323025 sigma out 15 active outputs RANK 8 NODE 7 --> 19.0026608 sigma out 15 active outputs RANK 9 NODE 4 --> 15.7876606 sigma out 15 active outputs RANK 10 NODE 9 --> 12.9066582 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 13 --> 54.4208755 sigma in 10act. ( 51.7470932 sig out 1act.) RANK 2 NODE 9 --> 39.9466095 sigma in 10act. ( 39.9784164 sig out 1act.) RANK 3 NODE 14 --> 39.400013 sigma in 10act. ( 34.0886726 sig out 1act.) RANK 4 NODE 11 --> 33.0622406 sigma in 10act. ( 33.7013283 sig out 1act.) RANK 5 NODE 5 --> 30.1254101 sigma in 10act. ( 33.0592194 sig out 1act.) RANK 6 NODE 8 --> 24.9647903 sigma in 10act. ( 22.4485626 sig out 1act.) RANK 7 NODE 12 --> 22.0072098 sigma in 10act. ( 21.9461155 sig out 1act.) RANK 8 NODE 2 --> 20.2804279 sigma in 10act. ( 15.6720905 sig out 1act.) RANK 9 NODE 4 --> 17.3730602 sigma in 10act. ( 15.5439768 sig out 1act.) RANK 10 NODE 10 --> 16.7493114 sigma in 10act. ( 14.431325 sig out 1act.) RANK 11 NODE 3 --> 15.7078333 sigma in 10act. ( 16.9037876 sig out 1act.) RANK 12 NODE 15 --> 11.8703079 sigma in 10act. ( 13.3095827 sig out 1act.) RANK 13 NODE 6 --> 6.11930752 sigma in 10act. ( 4.62793398 sig out 1act.) RANK 14 NODE 1 --> 5.03023624 sigma in 10act. ( 2.56532311 sig out 1act.) RANK 15 NODE 7 --> 3.93347692 sigma in 10act. ( 2.57533574 sig out 1act.) sorted by output significance RANK 1 NODE 13 --> 51.7470932 sigma out 1act.( 54.4208755 sig in 10act.) RANK 2 NODE 9 --> 39.9784164 sigma out 1act.( 39.9466095 sig in 10act.) RANK 3 NODE 14 --> 34.0886726 sigma out 1act.( 39.400013 sig in 10act.) RANK 4 NODE 11 --> 33.7013283 sigma out 1act.( 33.0622406 sig in 10act.) RANK 5 NODE 5 --> 33.0592194 sigma out 1act.( 30.1254101 sig in 10act.) RANK 6 NODE 8 --> 22.4485626 sigma out 1act.( 24.9647903 sig in 10act.) RANK 7 NODE 12 --> 21.9461155 sigma out 1act.( 22.0072098 sig in 10act.) RANK 8 NODE 3 --> 16.9037876 sigma out 1act.( 15.7078333 sig in 10act.) RANK 9 NODE 2 --> 15.6720905 sigma out 1act.( 20.2804279 sig in 10act.) RANK 10 NODE 4 --> 15.5439768 sigma out 1act.( 17.3730602 sig in 10act.) RANK 11 NODE 10 --> 14.431325 sigma out 1act.( 16.7493114 sig in 10act.) RANK 12 NODE 15 --> 13.3095827 sigma out 1act.( 11.8703079 sig in 10act.) RANK 13 NODE 6 --> 4.62793398 sigma out 1act.( 6.11930752 sig in 10act.) RANK 14 NODE 7 --> 2.57533574 sigma out 1act.( 3.93347692 sig in 10act.) RANK 15 NODE 1 --> 2.56532311 sigma out 1act.( 5.03023624 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 99.2236938 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.553819418 *** contribution from regularisation: 0.00273860176 *** contribution from error: -0.556558013 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26967 Closing output file done