NNInput NNInputs_190.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 167751 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 30319 nbkg = 137432 Bkg Entries: 137432 Sig Entries: 30319 Chosen entries: 30319 Signal fraction: 1 Background fraction: 0.220611 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 137432 Actual Signal Entries: 30319 Entries to split: 30319 Test with : 15159 Train with : 15159 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 30319 for Signal Prepared event 0 for Signal with 30319 events ====Entry 0 Variable Ht : 421.046 Variable LepAPt : 44.3127 Variable LepBPt : 36.9318 Variable MetSigLeptonsJets : 7.65406 Variable MetSpec : 80.9944 Variable SumEtLeptonsJets : 290.573 Variable VSumJetLeptonsPt : 147.233 Variable addEt : 211.717 Variable dPhiLepSumMet : 0.752822 Variable dPhiLeptons : 0.152314 Variable dRLeptons : 0.179862 Variable lep1_E : 44.3354 Variable lep2_E : 37.0067 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2190 Ht = 421.046 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 44.3127 LepAPt = 44.3127 LepBEt = 36.9318 LepBPt = 36.9318 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 130.473 MetDelPhi = 0.669733 MetSig = 6.92202 MetSigLeptonsJets = 7.65406 MetSpec = 80.9944 Mjj = 0 MostCentralJetEta = 0.923966 MtllMet = 211.813 Njets = 1 SB = 0 SumEt = 355.282 SumEtJets = 0 SumEtLeptonsJets = 290.573 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 147.233 addEt = 211.717 dPhiLepSumMet = 0.752822 dPhiLeptons = 0.152314 dRLeptons = 0.179862 diltype = 45 dimass = 7.27193 event = 49 jet1_Et = 209.329 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 44.3354 lep2_E = 37.0067 rand = 0.999742 run = 228406 weight = 2.22218e-06 ===Show End Prepared event 10000 for Signal with 30319 events Prepared event 20000 for Signal with 30319 events Prepared event 30000 for Signal with 30319 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 137432 for Background Prepared event 0 for Background with 137432 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.216946 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 137432 events Prepared event 20000 for Background with 137432 events Prepared event 30000 for Background with 137432 events Prepared event 40000 for Background with 137432 events Prepared event 50000 for Background with 137432 events Prepared event 60000 for Background with 137432 events Prepared event 70000 for Background with 137432 events Prepared event 80000 for Background with 137432 events Prepared event 90000 for Background with 137432 events Prepared event 100000 for Background with 137432 events Prepared event 110000 for Background with 137432 events Prepared event 120000 for Background with 137432 events Prepared event 130000 for Background with 137432 events Warning: found 4409 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 167751 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4409 negative weights. Signal fraction: 62.5884476 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.4404297 65.7250977 67.2040405 68.4830017 69.5090332 70.4121628 71.3597107 72.4044495 73.2997589 74.0324554 74.8439865 75.4983673 76.1551361 76.9011917 77.5808868 78.3237152 78.944931 79.6476288 80.2486877 80.8890839 81.5941391 82.5562439 83.3186264 84.3615265 85.538765 86.5205078 87.6662292 88.8484344 90.3984528 91.944397 93.2876358 94.7816162 96.5970154 98.3295517 99.6115112 100.966095 102.660263 104.119644 105.586555 107.47084 109.203613 110.991547 112.88266 114.763779 116.85173 118.775284 120.566849 122.446175 124.215965 126.011612 127.890755 129.746307 131.444931 133.116608 134.59903 136.2995 138.055389 139.538971 141.241409 142.795471 144.365692 145.852325 147.473846 148.84462 150.507812 152.272522 154.093109 155.758148 157.35257 159.01886 160.860474 162.62912 164.493683 166.511124 168.495483 170.502625 172.658905 174.950958 177.640381 180.088043 182.677551 185.144104 187.864426 190.830017 194.312744 197.645813 201.657501 206.155731 210.011841 214.264603 219.702698 225.147888 232.482452 240.659637 250.907944 264.399414 279.931885 306.15918 367.595673 782.079102 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.394104 20.7557564 21.0909691 21.376194 21.5878525 21.8975582 22.1344109 22.3733158 22.5989227 22.805027 22.9905777 23.2100105 23.3839417 23.6122627 23.8828888 24.1156273 24.3519745 24.571907 24.7999268 25.0403214 25.2265663 25.4681549 25.6770287 25.9005966 26.1345615 26.3870716 26.6016521 26.8444099 27.1041832 27.2912483 27.5939178 27.8241501 28.097393 28.338665 28.6199474 28.9040337 29.1712494 29.4690628 29.7526436 30.0729618 30.4089012 30.6873932 30.9985123 31.3169212 31.576292 31.888588 32.1895676 32.5535812 32.8572006 33.1949768 33.6175728 33.9499969 34.3388443 34.7209549 35.1108322 35.497509 35.8765793 36.353096 36.7813721 37.2015686 37.6349258 38.0877151 38.5364342 39.0496521 39.5334587 40.0682755 40.5139122 40.8782082 41.4251633 42.0269089 42.6255951 43.1919327 43.8301697 44.4537964 45.1626663 45.7602768 46.3821106 47.0463867 47.7173462 48.4581413 49.3035278 50.0395889 50.8311081 51.6888275 52.6555405 53.5587273 54.5736542 55.6135101 56.7982559 58.0779839 59.2654343 60.7799988 62.3677826 64.2084351 66.0013275 68.5763092 72.2485504 76.4484711 86.0317078 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1424541 10.285759 10.395752 10.5278254 10.6523685 10.7957373 10.9257908 11.0747337 11.2423973 11.4034452 11.5102749 11.6556063 11.8227139 11.9717226 12.1177006 12.2585688 12.4169054 12.5769491 12.7506809 12.871727 13.0540771 13.2545071 13.4320488 13.5816021 13.7558908 13.9174385 14.0961399 14.295207 14.4798431 14.7006016 14.8993578 15.095377 15.2915363 15.4856024 15.7087774 15.8979511 16.129961 16.3763199 16.5954018 16.8116493 17.0506592 17.3038216 17.5670929 17.755024 17.9861832 18.1263123 18.3747253 18.6227322 18.8477268 19.0950623 19.3365173 19.5753098 19.8120899 20.0505943 20.2496872 20.4201622 20.6095047 20.8314667 21.0629234 21.2951469 21.5057487 21.7325687 21.9468956 22.1698494 22.4053116 22.6487617 22.8713284 23.1003437 23.3254128 23.5727482 23.7963028 24.0569954 24.3575306 24.5987263 24.8979721 25.1790428 25.4797497 25.7726936 26.0642281 26.3340378 26.6957664 27.0295029 27.3898315 27.7403831 28.0950546 28.4896965 28.9036636 29.3758507 29.8696175 30.404644 30.8800964 31.4435329 32.1038055 32.8656769 33.7627029 35.0607605 36.5777969 39.0293732 43.5379562 95.7538834 ------------------------------ Transdef: Tab for variable 5 0.853937626 2.7230835 3.12925339 3.46767211 3.76804233 3.97527218 4.11968756 4.23483562 4.34629869 4.46289062 4.59273624 4.68749475 4.78973293 4.88986206 4.97401047 5.04583025 5.12395239 5.19505072 5.26713657 5.33299828 5.38763428 5.44324923 5.49471188 5.53865147 5.58571625 5.63203335 5.68327141 5.73603153 5.78492641 5.83799124 5.8897562 5.93855 5.98963261 6.03365803 6.08390808 6.12628651 6.17743683 6.2183733 6.25794888 6.29955292 6.35003948 6.40136194 6.44943953 6.50100279 6.54971409 6.59978485 6.6496191 6.7037034 6.75588655 6.80644894 6.85094023 6.89462376 6.94560671 6.99210835 7.04776573 7.10133648 7.15953207 7.20911312 7.25603676 7.31139708 7.36964035 7.41705942 7.46839237 7.53239822 7.58594561 7.64772606 7.71740055 7.7798624 7.84177542 7.89731026 7.96224213 8.0281105 8.08994675 8.14329338 8.20382881 8.26034355 8.32949448 8.39369869 8.457407 8.52051163 8.58994102 8.66265202 8.73558617 8.81626987 8.89610863 8.97311211 9.06262779 9.14997673 9.25078869 9.34996796 9.46444511 9.58174515 9.72566414 9.87751961 10.0523348 10.2640295 10.5192575 10.9116135 11.4535885 12.5609474 19.6063156 ------------------------------ Transdef: Tab for variable 6 15.0050735 22.2527409 25.6679211 26.7251396 27.7050667 28.6246014 29.4353943 30.1732502 30.8784542 31.553791 32.1256104 32.6765404 33.2478943 33.6748505 34.1717758 34.6991997 35.0588303 35.5321541 35.9310303 36.3000183 36.6670723 37.0256348 37.4233627 37.8035431 38.1621323 38.5630798 38.9898224 39.3956146 39.8650627 40.2802963 40.6284828 41.0042 41.4643555 42.0103912 42.5235863 42.9860153 43.3818245 43.920105 44.4705582 44.960083 45.5883179 46.1267014 46.8661728 47.5315094 48.237278 48.9445648 49.5579872 50.188797 50.8605576 51.7672997 52.5259857 53.4574089 54.2130661 54.9987106 55.7614822 56.5626984 57.275032 58.1169853 58.9257317 59.7458 60.5619316 61.465332 62.1856384 63.1286812 63.9895973 64.7771912 65.6621094 66.4541168 67.2389679 68.10466 68.9055481 69.6569977 70.5220642 71.3639374 72.2407227 73.1143646 74.0245514 74.8910675 75.7938766 76.7148285 77.4009399 78.3611298 79.470047 80.5564423 81.6792908 82.746048 83.8922119 85.0682297 86.5106354 88.1507797 89.6869125 91.5061035 93.6655807 96.0570679 98.6091919 102.028015 106.199318 112.225075 120.077835 133.119858 290.769653 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.5937691 33.6987572 34.4654884 35.1069489 35.6241875 36.0572777 36.601738 36.9646187 37.4012146 37.7925606 38.123867 38.4416847 38.7477188 39.0764427 39.3816147 39.7445679 40.1097527 40.3883781 40.7461166 41.1592178 41.5394707 41.9789162 42.4088364 42.8887482 43.4256439 44.1154442 44.6727524 45.3898392 46.1546783 46.9712372 47.6793022 48.6770935 49.5447845 50.6059532 51.7103958 52.857399 53.8369293 54.8885422 55.9945984 56.9990845 57.8670311 58.9560928 59.9394836 60.8482819 61.5932846 62.5195923 63.3844414 64.3339615 65.2285919 66.0817261 67.0586548 68.0376587 69.0666046 70.0281372 70.9096146 71.8416443 72.7556839 73.6310043 74.5460892 75.6474609 76.6811523 77.6039963 78.6170349 79.7187042 80.778923 82.0379791 83.396843 84.7911987 86.1763687 87.4823761 88.7888718 90.2212219 91.7439117 93.3045349 94.9085007 96.5449677 98.3493958 100.153374 101.979691 103.973068 106.17601 108.249313 110.516235 112.79908 115.646973 118.406494 121.307617 124.646339 127.860504 131.604263 135.959641 140.722595 146.408356 152.54248 162.438522 173.311798 187.104706 207.832092 254.000824 518.545105 ------------------------------ Transdef: Tab for variable 8 1.31380045 25.8556652 29.1258965 30.9865551 32.1171112 32.8655777 33.4410248 33.9365234 34.4314499 34.8752136 35.2237091 35.6103516 36.0325241 36.3860474 36.6883011 37.055748 37.3408203 37.6457672 37.8985252 38.1822281 38.4905167 38.7810135 39.071003 39.3706818 39.6438141 39.9545708 40.3115463 40.6083221 41.0259399 41.3716736 41.7756882 42.2569046 42.6512947 43.128418 43.6700172 44.1332092 44.7036133 45.1961136 45.7733841 46.4206772 46.9957047 47.7469597 48.2280312 48.7597809 49.4509239 50.2082024 50.9749489 51.6847496 52.5669708 53.2359543 53.9327888 54.6945496 55.5343933 56.3429337 57.0826187 57.8159218 58.546524 59.2978439 59.9703598 60.7348213 61.4297867 62.1542282 62.8810196 63.6472702 64.3578415 65.0606232 65.6975555 66.3836823 67.2345581 68.0190887 68.7652817 69.500824 70.2134094 71.0667725 71.8636093 72.727478 73.5688095 74.3979645 75.1843262 76.0953827 76.9017639 77.8319397 78.7600098 79.7498016 80.8166199 82.0900803 83.3199615 84.6479187 86.1322021 87.7019501 89.3847351 91.4774475 93.4639587 95.5371552 98.3193817 102.372696 106.860626 113.62056 124.103844 145.423126 326.868286 ------------------------------ Transdef: Tab for variable 9 49.4992676 62.973011 65.085083 66.7139282 67.8407135 68.7897034 69.8081818 70.6058197 71.407547 72.3517914 73.1715851 73.830986 74.4967422 75.2171783 75.7814026 76.3957901 76.9887695 77.5776825 78.2209167 78.738739 79.3620834 79.8435211 80.4468155 80.9621887 81.5951843 82.4283981 83.0702362 83.8631439 84.697403 85.663353 86.4956207 87.2396698 88.2072144 89.1047363 90.3472595 91.6387024 92.8398895 94.1645203 95.3112335 96.7906647 98.3027496 99.4297485 100.832489 102.188553 103.775475 105.045776 106.616165 108.296799 109.859871 111.37825 112.759537 114.520752 115.737778 117.170815 118.587952 119.936234 121.234467 122.683792 123.890488 125.295731 126.662437 127.9767 129.29097 130.43808 131.775452 132.955246 134.263 135.549515 136.820007 138.08284 139.166534 140.491852 141.680466 142.921906 144.15387 145.306854 146.659821 148.003052 149.152069 150.528473 151.855286 153.316452 154.854919 156.317535 157.829376 159.403702 161.054733 162.70108 164.581787 166.55365 168.443542 171.084229 173.584351 176.404907 179.569855 183.20549 187.786346 193.981415 205.0466 234.296234 582.80835 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.894225478 1.28050339 1.52995014 1.69897103 1.8384465 1.96125937 2.05151224 2.11881065 2.18617845 2.2454586 2.29759288 2.33677888 2.38257504 2.42280054 2.45753121 2.49245691 2.52642751 2.55505872 2.58350372 2.60913372 2.63504076 2.65749884 2.68131542 2.70110631 2.72067404 2.73797178 2.75525427 2.77068567 2.78484154 2.79905653 2.81344366 2.82870841 2.83976102 2.85180902 2.8618598 2.86987424 2.87977457 2.88794732 2.89665937 2.90486407 2.91321731 2.9213717 2.92961454 2.93801451 2.94529676 2.95211101 2.95844579 2.96416044 2.96884084 2.97484827 2.98055935 2.98518705 2.99014378 2.99381733 2.99973392 3.00423908 3.00931025 3.01393747 3.01848984 3.02302027 3.02724028 3.03139138 3.03512573 3.03887844 3.0423429 3.04618263 3.05012488 3.05374455 3.05691552 3.06023836 3.06372285 3.06776047 3.07072544 3.07320237 3.07643652 3.07956338 3.08235788 3.08502197 3.08813477 3.09103251 3.09406662 3.09677505 3.09925508 3.10205126 3.10474253 3.10746717 3.10966253 3.11221242 3.11501646 3.11707973 3.11979008 3.12230587 3.12476873 3.12749958 3.13013363 3.13219333 3.13422632 3.13648105 3.13908339 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00522756577 0.0100713968 0.0166709423 0.0229847431 0.0299932957 0.0372279882 0.0450978428 0.0526939072 0.0587747693 0.0651946962 0.0727092326 0.0792055726 0.0868757367 0.0942320824 0.100661039 0.107775167 0.113609791 0.12024045 0.127199471 0.133851051 0.139846802 0.14613533 0.152310908 0.15804863 0.164377689 0.169201478 0.174929619 0.18050456 0.186455011 0.192088872 0.198105812 0.204106688 0.209656 0.214975119 0.221009642 0.226605266 0.231302857 0.236382365 0.24164629 0.247320086 0.25237298 0.257776439 0.263203561 0.267444789 0.273082405 0.278344691 0.282807767 0.287679672 0.293270767 0.299031556 0.303950846 0.309996068 0.315295815 0.321205974 0.326806903 0.332250237 0.337645173 0.343887687 0.349196732 0.355616689 0.361366093 0.367439926 0.373582661 0.379230857 0.385042787 0.389703155 0.396165013 0.402503699 0.408859015 0.415705502 0.421821237 0.427611232 0.434255779 0.441466093 0.449175477 0.457534552 0.464108407 0.471644074 0.480053008 0.488316417 0.497157872 0.506211281 0.515390038 0.52425313 0.53433001 0.542196155 0.555198431 0.567043066 0.58068943 0.594713748 0.610784769 0.625847638 0.642855287 0.659415722 0.683290184 0.712271452 0.743351936 0.782203078 0.84835875 1.15715599 ------------------------------ Transdef: Tab for variable 12 0.101212911 0.170607865 0.190741211 0.205376714 0.216666579 0.226463914 0.236161366 0.244782969 0.253903925 0.260688424 0.268217683 0.275268257 0.281835556 0.288163513 0.294801354 0.301060259 0.306726336 0.313040316 0.31853497 0.323997259 0.32989198 0.335605532 0.341353625 0.346617877 0.351503879 0.35599649 0.361106843 0.366995335 0.371758819 0.376268983 0.381856203 0.387491465 0.392167151 0.397177905 0.401722133 0.405432701 0.408969223 0.412947476 0.416736424 0.420324445 0.423971206 0.427387357 0.431066334 0.43463248 0.438109338 0.442044795 0.445598185 0.449747473 0.454054147 0.458169252 0.461496353 0.465604365 0.470088303 0.47402972 0.477986872 0.482842088 0.486891508 0.491418898 0.495571375 0.500125051 0.504447222 0.508979857 0.513466716 0.518136978 0.523669541 0.528601289 0.533242106 0.53838408 0.544904113 0.548321962 0.553919911 0.55920279 0.565370679 0.570317388 0.577042699 0.583955407 0.590812564 0.597518086 0.604608655 0.611835241 0.620007396 0.628441811 0.636893749 0.646488905 0.655238926 0.664561987 0.673535287 0.681491971 0.694145083 0.706596494 0.717955768 0.727556229 0.742500901 0.755746722 0.771553278 0.789970636 0.808522344 0.832147241 0.862479687 0.910586119 1.1651752 ------------------------------ Transdef: Tab for variable 13 20.0237312 21.7453308 22.5140209 23.2751331 23.8661118 24.4078407 24.9299774 25.4037094 25.8597488 26.3160858 26.7952061 27.2189331 27.6750488 28.1068497 28.5608864 28.9318695 29.3076859 29.6660118 30.0821075 30.4486465 30.8111858 31.1012573 31.4395294 31.7746582 32.1601028 32.4924469 32.861763 33.3065186 33.7178192 34.1542053 34.4596443 34.8161964 35.197731 35.5617447 35.9850082 36.3071594 36.7137909 37.1559143 37.5465546 38.022934 38.484787 38.8713875 39.3271484 39.8091507 40.3918724 40.8201828 41.3003693 41.8172073 42.3443794 42.7703323 43.3304138 43.8168831 44.3546982 44.8734283 45.4399796 45.9949074 46.5152283 46.9914818 47.5398827 48.0418739 48.6797256 49.2303619 49.868988 50.4804535 51.0265503 51.6636086 52.2144928 52.8723564 53.5742645 54.2553635 54.9419022 55.6745529 56.4019127 57.1118469 57.8240509 58.6251373 59.390583 60.3040886 61.2039909 62.025032 63.032486 64.0542297 65.1156311 66.1046753 67.2636261 68.1407242 69.1575012 70.2564697 71.5189209 73.0277252 74.6728973 76.7076569 78.2184753 80.7131805 83.1175766 85.9807129 89.3785477 93.3908081 98.9398651 111.040939 381.504089 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.7696743 11.2473221 11.6266317 11.9091454 12.2869663 12.6391277 13.0333118 13.4243555 13.6951962 14.0156136 14.3411522 14.6229601 14.9325523 15.2417669 15.5562611 15.823246 16.139286 16.4087715 16.6886978 16.9561539 17.2573204 17.6332817 17.8614731 18.1141491 18.3775673 18.6264458 18.8535309 19.1394005 19.4306889 19.7023735 19.9950581 20.2950954 20.5748482 20.7801456 21.0505257 21.3147392 21.5549202 21.7739449 22.016449 22.2598114 22.5103207 22.765377 23.0161324 23.2270851 23.4710693 23.6892624 23.9054489 24.1682186 24.4467926 24.6703835 24.9320107 25.1733932 25.4375458 25.6365852 25.8765793 26.1335297 26.4191418 26.6810646 26.9838486 27.2415848 27.5122929 27.7630539 27.9608421 28.2048645 28.4608822 28.7495384 29.0920639 29.3750038 29.7217407 30.0340042 30.346632 30.6972694 31.05019 31.3810463 31.6880722 32.0736313 32.4403 32.8411789 33.2375565 33.676815 34.14534 34.5460052 35.0567398 35.5943794 36.137764 36.7169571 37.3788071 38.2105942 39.0169373 39.8668213 40.5321121 41.6111908 42.8188934 44.2205276 45.8347435 48.0093307 50.6782837 54.6961174 61.8163719 115.518631 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 63.8 51.7 51.8 30.4 50.1 61.7 54.1 62.8 -25.0 -21.2 -41.3 22.1 22.1 2 63.8 100.0 70.1 58.0 41.0 70.7 94.9 78.5 92.8 -45.3 -28.2 -53.5 42.0 30.3 3 51.7 70.1 100.0 45.7 20.2 43.5 71.6 61.4 77.8 -13.7 -30.3 -60.7 71.3 22.2 4 51.8 58.0 45.7 100.0 13.5 34.5 60.3 48.6 61.2 -14.8 -32.8 -63.1 24.2 70.3 5 30.4 41.0 20.2 13.5 100.0 84.1 15.2 61.3 60.2 19.3 -9.3 -14.9 6.8 0.8 6 50.1 70.7 43.5 34.5 84.1 100.0 51.4 79.9 80.5 -8.1 -19.4 -33.7 22.0 13.6 7 61.7 94.9 71.6 60.3 15.2 51.4 100.0 70.7 82.5 -53.6 -27.3 -53.8 44.9 33.8 8 54.1 78.5 61.4 48.6 61.3 79.9 70.7 100.0 85.7 -14.1 -26.4 -47.1 37.3 25.5 9 62.8 92.8 77.8 61.2 60.2 80.5 82.5 85.7 100.0 -22.0 -30.8 -59.3 48.8 32.6 10 -25.0 -45.3 -13.7 -14.8 19.3 -8.1 -53.6 -14.1 -22.0 100.0 4.0 10.1 -6.7 -7.4 11 -21.2 -28.2 -30.3 -32.8 -9.3 -19.4 -27.3 -26.4 -30.8 4.0 100.0 57.2 -17.4 -22.1 12 -41.3 -53.5 -60.7 -63.1 -14.9 -33.7 -53.8 -47.1 -59.3 10.1 57.2 100.0 -37.2 -36.9 13 22.1 42.0 71.3 24.2 6.8 22.0 44.9 37.3 48.8 -6.7 -17.4 -37.2 100.0 44.5 14 22.1 30.3 22.2 70.3 0.8 13.6 33.8 25.5 32.6 -7.4 -22.1 -36.9 44.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 165.188499 TOTAL CORRELATION OF ALL VARIABLES 70.3449928 ROUND 1: MAX CORR ( 70.3449927) AFTER KILLING INPUT VARIABLE 11 CONTR 0.00485537704 ROUND 2: MAX CORR ( 70.3353223) AFTER KILLING INPUT VARIABLE 2 CONTR 1.16637343 ROUND 3: MAX CORR ( 70.2735575) AFTER KILLING INPUT VARIABLE 12 CONTR 2.94697886 ROUND 4: MAX CORR ( 70.1914656) AFTER KILLING INPUT VARIABLE 14 CONTR 3.39573898 ROUND 5: MAX CORR ( 70.1014875) AFTER KILLING INPUT VARIABLE 8 CONTR 3.55292709 ROUND 6: MAX CORR ( 69.9649213) AFTER KILLING INPUT VARIABLE 10 CONTR 4.37359573 ROUND 7: MAX CORR ( 69.6610095) AFTER KILLING INPUT VARIABLE 6 CONTR 6.51413533 ROUND 8: MAX CORR ( 69.1162506) AFTER KILLING INPUT VARIABLE 9 CONTR 8.69483507 ROUND 9: MAX CORR ( 67.835633) AFTER KILLING INPUT VARIABLE 13 CONTR 13.2432244 ROUND 10: MAX CORR ( 67.4426353) AFTER KILLING INPUT VARIABLE 3 CONTR 7.29136807 ROUND 11: MAX CORR ( 65.2322414) AFTER KILLING INPUT VARIABLE 4 CONTR 17.1249448 ROUND 12: MAX CORR ( 61.6882716) AFTER KILLING INPUT VARIABLE 5 CONTR 21.2085469 LAST REMAINING VARIABLE: 7 total correlation to target: 70.3449928 % total significance: 109.739904 sigma correlations of single variables to target: variable 2: 63.8242383 % , in sigma: 99.5673676 variable 3: 51.6781453 % , in sigma: 80.6191663 variable 4: 51.7550814 % , in sigma: 80.7391885 variable 5: 30.3575413 % , in sigma: 47.3585045 variable 6: 50.0722203 % , in sigma: 78.1138843 variable 7: 61.6882716 % , in sigma: 96.2352075 variable 8: 54.1145324 % , in sigma: 84.4199897 variable 9: 62.8208412 % , in sigma: 98.0020437 variable 10: -25.0004783 % , in sigma: 39.0013556 variable 11: -21.1627889 % , in sigma: 33.0144665 variable 12: -41.2875743 % , in sigma: 64.4096224 variable 13: 22.1164314 % , in sigma: 34.5021722 variable 14: 22.1067581 % , in sigma: 34.4870815 variables sorted by significance: 1 most relevant variable 7 corr 61.6882706 , in sigma: 96.2352058 2 most relevant variable 5 corr 21.2085476 , in sigma: 33.0858512 3 most relevant variable 4 corr 17.1249447 , in sigma: 26.7153312 4 most relevant variable 3 corr 7.29136801 , in sigma: 11.3747118 5 most relevant variable 13 corr 13.2432241 , in sigma: 20.6597525 6 most relevant variable 9 corr 8.69483471 , in sigma: 13.5641541 7 most relevant variable 6 corr 6.51413536 , in sigma: 10.16221 8 most relevant variable 10 corr 4.37359571 , in sigma: 6.82291593 9 most relevant variable 8 corr 3.55292702 , in sigma: 5.54265275 10 most relevant variable 14 corr 3.39573908 , in sigma: 5.29743574 11 most relevant variable 12 corr 2.94697881 , in sigma: 4.59735878 12 most relevant variable 2 corr 1.16637337 , in sigma: 1.81957089 13 most relevant variable 11 corr 0.00485537713 , in sigma: 0.00757450669 global correlations between input variables: variable 2: 99.3138954 % variable 3: 94.5868694 % variable 4: 91.6147196 % variable 5: 95.2834746 % variable 6: 93.760672 % variable 7: 98.932086 % variable 8: 91.0968079 % variable 9: 99.029953 % variable 10: 72.8410143 % variable 11: 58.4842317 % variable 12: 80.0606546 % variable 13: 87.7277523 % variable 14: 87.3936327 % significance loss when removing single variables: variable 2: corr = 1.16331604 % , sigma = 1.81480138 variable 3: corr = 13.6397503 % , sigma = 21.278343 variable 4: corr = 14.9405686 % , sigma = 23.3076512 variable 5: corr = 9.27127767 % , sigma = 14.4634192 variable 6: corr = 6.41522973 % , sigma = 10.0079148 variable 7: corr = 6.39025759 % , sigma = 9.96895762 variable 8: corr = 2.54367476 % , sigma = 3.96819464 variable 9: corr = 7.76376287 % , sigma = 12.1116593 variable 10: corr = 3.4705076 % , sigma = 5.41407646 variable 11: corr = 0.00485537715 % , sigma = 0.00757450671 variable 12: corr = 2.64010152 % , sigma = 4.11862272 variable 13: corr = 6.13850465 % , sigma = 9.57621689 variable 14: corr = 3.54949355 % , sigma = 5.53729646 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 11.1958008 sigma out 15 active outputs RANK 2 NODE 2 --> 10.6777859 sigma out 15 active outputs RANK 3 NODE 11 --> 9.93900776 sigma out 15 active outputs RANK 4 NODE 1 --> 9.88665867 sigma out 15 active outputs RANK 5 NODE 12 --> 9.24962139 sigma out 15 active outputs RANK 6 NODE 8 --> 9.16123009 sigma out 15 active outputs RANK 7 NODE 7 --> 9.04657555 sigma out 15 active outputs RANK 8 NODE 3 --> 8.5412159 sigma out 15 active outputs RANK 9 NODE 5 --> 7.37510967 sigma out 15 active outputs RANK 10 NODE 4 --> 7.1640296 sigma out 15 active outputs RANK 11 NODE 9 --> 7.12546921 sigma out 15 active outputs RANK 12 NODE 6 --> 6.97689724 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 13.5232 sigma in 12act. ( 13.3878479 sig out 1act.) RANK 2 NODE 14 --> 12.6448536 sigma in 12act. ( 14.3667135 sig out 1act.) RANK 3 NODE 9 --> 11.7503662 sigma in 12act. ( 15.0552406 sig out 1act.) RANK 4 NODE 12 --> 11.3981791 sigma in 12act. ( 11.4397993 sig out 1act.) RANK 5 NODE 13 --> 11.0435152 sigma in 12act. ( 11.6188602 sig out 1act.) RANK 6 NODE 11 --> 7.84496355 sigma in 12act. ( 6.66188478 sig out 1act.) RANK 7 NODE 10 --> 7.15057278 sigma in 12act. ( 4.89622355 sig out 1act.) RANK 8 NODE 5 --> 6.20342398 sigma in 12act. ( 5.62620878 sig out 1act.) RANK 9 NODE 8 --> 5.21695232 sigma in 12act. ( 3.37424111 sig out 1act.) RANK 10 NODE 2 --> 4.348279 sigma in 12act. ( 5.19446135 sig out 1act.) RANK 11 NODE 7 --> 3.44464827 sigma in 12act. ( 3.19253612 sig out 1act.) RANK 12 NODE 4 --> 3.29255223 sigma in 12act. ( 3.34776688 sig out 1act.) RANK 13 NODE 15 --> 2.53036165 sigma in 12act. ( 2.28928876 sig out 1act.) RANK 14 NODE 3 --> 2.31839442 sigma in 12act. ( 1.49968243 sig out 1act.) RANK 15 NODE 1 --> 0.921668589 sigma in 12act. ( 0.641465783 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 15.0552406 sigma out 1act.( 11.7503662 sig in 12act.) RANK 2 NODE 14 --> 14.3667135 sigma out 1act.( 12.6448536 sig in 12act.) RANK 3 NODE 6 --> 13.3878479 sigma out 1act.( 13.5232 sig in 12act.) RANK 4 NODE 13 --> 11.6188602 sigma out 1act.( 11.0435152 sig in 12act.) RANK 5 NODE 12 --> 11.4397993 sigma out 1act.( 11.3981791 sig in 12act.) RANK 6 NODE 11 --> 6.66188478 sigma out 1act.( 7.84496355 sig in 12act.) RANK 7 NODE 5 --> 5.62620878 sigma out 1act.( 6.20342398 sig in 12act.) RANK 8 NODE 2 --> 5.19446135 sigma out 1act.( 4.348279 sig in 12act.) RANK 9 NODE 10 --> 4.89622355 sigma out 1act.( 7.15057278 sig in 12act.) RANK 10 NODE 8 --> 3.37424111 sigma out 1act.( 5.21695232 sig in 12act.) RANK 11 NODE 4 --> 3.34776688 sigma out 1act.( 3.29255223 sig in 12act.) RANK 12 NODE 7 --> 3.19253612 sigma out 1act.( 3.44464827 sig in 12act.) RANK 13 NODE 15 --> 2.28928876 sigma out 1act.( 2.53036165 sig in 12act.) RANK 14 NODE 3 --> 1.49968243 sigma out 1act.( 2.31839442 sig in 12act.) RANK 15 NODE 1 --> 0.641465783 sigma out 1act.( 0.921668589 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 32.3394661 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 23.5085621 sigma out 15 active outputs RANK 2 NODE 2 --> 13.0322638 sigma out 15 active outputs RANK 3 NODE 11 --> 12.0793037 sigma out 15 active outputs RANK 4 NODE 1 --> 11.6963911 sigma out 15 active outputs RANK 5 NODE 12 --> 11.5146933 sigma out 15 active outputs RANK 6 NODE 8 --> 10.66716 sigma out 15 active outputs RANK 7 NODE 7 --> 10.3363209 sigma out 15 active outputs RANK 8 NODE 3 --> 10.0187902 sigma out 15 active outputs RANK 9 NODE 6 --> 9.33710384 sigma out 15 active outputs RANK 10 NODE 9 --> 9.24998665 sigma out 15 active outputs RANK 11 NODE 5 --> 8.7866478 sigma out 15 active outputs RANK 12 NODE 4 --> 8.66719913 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 16.6558647 sigma in 12act. ( 17.2079773 sig out 1act.) RANK 2 NODE 1 --> 14.4340734 sigma in 12act. ( 6.39527559 sig out 1act.) RANK 3 NODE 6 --> 14.3166265 sigma in 12act. ( 12.4038343 sig out 1act.) RANK 4 NODE 13 --> 13.9113159 sigma in 12act. ( 11.2038736 sig out 1act.) RANK 5 NODE 12 --> 13.3154573 sigma in 12act. ( 10.9535446 sig out 1act.) RANK 6 NODE 14 --> 12.3907623 sigma in 12act. ( 12.8929052 sig out 1act.) RANK 7 NODE 2 --> 11.8033524 sigma in 12act. ( 6.45606756 sig out 1act.) RANK 8 NODE 11 --> 9.34958172 sigma in 12act. ( 5.7452445 sig out 1act.) RANK 9 NODE 10 --> 8.23809147 sigma in 12act. ( 3.39289308 sig out 1act.) RANK 10 NODE 4 --> 8.07697487 sigma in 12act. ( 4.83562851 sig out 1act.) RANK 11 NODE 7 --> 6.77948523 sigma in 12act. ( 3.38349104 sig out 1act.) RANK 12 NODE 3 --> 6.59429216 sigma in 12act. ( 1.86776555 sig out 1act.) RANK 13 NODE 5 --> 6.52890348 sigma in 12act. ( 4.86960268 sig out 1act.) RANK 14 NODE 8 --> 6.50992918 sigma in 12act. ( 2.3499701 sig out 1act.) RANK 15 NODE 15 --> 5.87336063 sigma in 12act. ( 3.11958289 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 17.2079773 sigma out 1act.( 16.6558647 sig in 12act.) RANK 2 NODE 14 --> 12.8929052 sigma out 1act.( 12.3907623 sig in 12act.) RANK 3 NODE 6 --> 12.4038343 sigma out 1act.( 14.3166265 sig in 12act.) RANK 4 NODE 13 --> 11.2038736 sigma out 1act.( 13.9113159 sig in 12act.) RANK 5 NODE 12 --> 10.9535446 sigma out 1act.( 13.3154573 sig in 12act.) RANK 6 NODE 2 --> 6.45606756 sigma out 1act.( 11.8033524 sig in 12act.) RANK 7 NODE 1 --> 6.39527559 sigma out 1act.( 14.4340734 sig in 12act.) RANK 8 NODE 11 --> 5.7452445 sigma out 1act.( 9.34958172 sig in 12act.) RANK 9 NODE 5 --> 4.86960268 sigma out 1act.( 6.52890348 sig in 12act.) RANK 10 NODE 4 --> 4.83562851 sigma out 1act.( 8.07697487 sig in 12act.) RANK 11 NODE 10 --> 3.39289308 sigma out 1act.( 8.23809147 sig in 12act.) RANK 12 NODE 7 --> 3.38349104 sigma out 1act.( 6.77948523 sig in 12act.) RANK 13 NODE 15 --> 3.11958289 sigma out 1act.( 5.87336063 sig in 12act.) RANK 14 NODE 8 --> 2.3499701 sigma out 1act.( 6.50992918 sig in 12act.) RANK 15 NODE 3 --> 1.86776555 sigma out 1act.( 6.59429216 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 32.6510391 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.497835457 *** contribution from regularisation: 0.00570793264 *** contribution from error: -0.503543377 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.547134519 *** contribution from regularisation: 0.00210312405 *** contribution from error: -0.549237669 *********************************************** -----------------> Test sample ENTER BFGS code START -45899.2943 0.697026014 0.095609203 EXIT FROM BFGS code FG_START 0. 0.697026014 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.574033201 *** contribution from regularisation: 0.00233700918 *** contribution from error: -0.576370239 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48147.0371 0.697026014 13.3292952 EXIT FROM BFGS code FG_LNSRCH 0. 0.703397393 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.58640945 *** contribution from regularisation: 0.00339943077 *** contribution from error: -0.589808881 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49185.0927 0.703397393 53.2057037 EXIT FROM BFGS code NEW_X -49185.0927 0.703397393 53.2057037 ENTER BFGS code NEW_X -49185.0927 0.703397393 53.2057037 EXIT FROM BFGS code FG_LNSRCH 0. 0.718371034 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.589019775 *** contribution from regularisation: 0.00310520828 *** contribution from error: -0.592124999 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49404.0339 0.718371034 21.427597 EXIT FROM BFGS code NEW_X -49404.0339 0.718371034 21.427597 ENTER BFGS code NEW_X -49404.0339 0.718371034 21.427597 EXIT FROM BFGS code FG_LNSRCH 0. 0.731280327 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.590051472 *** contribution from regularisation: 0.00296857115 *** contribution from error: -0.593020022 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49490.5651 0.731280327 -0.636803329 EXIT FROM BFGS code NEW_X -49490.5651 0.731280327 -0.636803329 ENTER BFGS code NEW_X -49490.5651 0.731280327 -0.636803329 EXIT FROM BFGS code FG_LNSRCH 0. 0.7386446 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.590657473 *** contribution from regularisation: 0.00283677853 *** contribution from error: -0.593494236 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49541.3958 0.7386446 -23.2597313 EXIT FROM BFGS code NEW_X -49541.3958 0.7386446 -23.2597313 ENTER BFGS code NEW_X -49541.3958 0.7386446 -23.2597313 EXIT FROM BFGS code FG_LNSRCH 0. 0.724222124 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.590985775 *** contribution from regularisation: 0.00289145112 *** contribution from error: -0.593877196 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49568.9318 0.724222124 -22.575985 EXIT FROM BFGS code NEW_X -49568.9318 0.724222124 -22.575985 ENTER BFGS code NEW_X -49568.9318 0.724222124 -22.575985 EXIT FROM BFGS code FG_LNSRCH 0. 0.610529602 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.592532933 *** contribution from regularisation: 0.00275612017 *** contribution from error: -0.595289052 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49698.6989 0.610529602 -21.9188232 EXIT FROM BFGS code NEW_X -49698.6989 0.610529602 -21.9188232 ENTER BFGS code NEW_X -49698.6989 0.610529602 -21.9188232 EXIT FROM BFGS code FG_LNSRCH 0. 0.514862955 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 31.2959003 sigma out 15 active outputs RANK 2 NODE 9 --> 15.9835281 sigma out 15 active outputs RANK 3 NODE 8 --> 15.3571205 sigma out 15 active outputs RANK 4 NODE 1 --> 15.219862 sigma out 15 active outputs RANK 5 NODE 11 --> 11.3789797 sigma out 15 active outputs RANK 6 NODE 12 --> 8.74252796 sigma out 15 active outputs RANK 7 NODE 6 --> 8.38801098 sigma out 15 active outputs RANK 8 NODE 5 --> 8.25916481 sigma out 15 active outputs RANK 9 NODE 2 --> 8.04912758 sigma out 15 active outputs RANK 10 NODE 7 --> 6.18466711 sigma out 15 active outputs RANK 11 NODE 4 --> 5.24104452 sigma out 15 active outputs RANK 12 NODE 3 --> 4.31834841 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 27.5775127 sigma in 12act. ( 24.9626427 sig out 1act.) RANK 2 NODE 14 --> 18.3619175 sigma in 12act. ( 17.8449574 sig out 1act.) RANK 3 NODE 4 --> 16.0942173 sigma in 12act. ( 12.5448446 sig out 1act.) RANK 4 NODE 2 --> 12.9589481 sigma in 12act. ( 9.6797514 sig out 1act.) RANK 5 NODE 15 --> 12.7584753 sigma in 12act. ( 9.13183022 sig out 1act.) RANK 6 NODE 9 --> 12.6833382 sigma in 12act. ( 10.1978102 sig out 1act.) RANK 7 NODE 6 --> 9.824893 sigma in 12act. ( 10.2286024 sig out 1act.) RANK 8 NODE 7 --> 7.60000467 sigma in 12act. ( 6.80369663 sig out 1act.) RANK 9 NODE 12 --> 7.49990845 sigma in 12act. ( 4.60836458 sig out 1act.) RANK 10 NODE 11 --> 6.38992596 sigma in 12act. ( 6.61638451 sig out 1act.) RANK 11 NODE 10 --> 5.74451637 sigma in 12act. ( 5.52012968 sig out 1act.) RANK 12 NODE 13 --> 4.91655731 sigma in 12act. ( 1.37736106 sig out 1act.) RANK 13 NODE 5 --> 3.85197186 sigma in 12act. ( 2.41191936 sig out 1act.) RANK 14 NODE 3 --> 3.82286286 sigma in 12act. ( 0.808659732 sig out 1act.) RANK 15 NODE 8 --> 3.12366891 sigma in 12act. ( 2.46368074 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 24.9626427 sigma out 1act.( 27.5775127 sig in 12act.) RANK 2 NODE 14 --> 17.8449574 sigma out 1act.( 18.3619175 sig in 12act.) RANK 3 NODE 4 --> 12.5448446 sigma out 1act.( 16.0942173 sig in 12act.) RANK 4 NODE 6 --> 10.2286024 sigma out 1act.( 9.824893 sig in 12act.) RANK 5 NODE 9 --> 10.1978102 sigma out 1act.( 12.6833382 sig in 12act.) RANK 6 NODE 2 --> 9.6797514 sigma out 1act.( 12.9589481 sig in 12act.) RANK 7 NODE 15 --> 9.13183022 sigma out 1act.( 12.7584753 sig in 12act.) RANK 8 NODE 7 --> 6.80369663 sigma out 1act.( 7.60000467 sig in 12act.) RANK 9 NODE 11 --> 6.61638451 sigma out 1act.( 6.38992596 sig in 12act.) RANK 10 NODE 10 --> 5.52012968 sigma out 1act.( 5.74451637 sig in 12act.) RANK 11 NODE 12 --> 4.60836458 sigma out 1act.( 7.49990845 sig in 12act.) RANK 12 NODE 8 --> 2.46368074 sigma out 1act.( 3.12366891 sig in 12act.) RANK 13 NODE 5 --> 2.41191936 sigma out 1act.( 3.85197186 sig in 12act.) RANK 14 NODE 13 --> 1.37736106 sigma out 1act.( 4.91655731 sig in 12act.) RANK 15 NODE 3 --> 0.808659732 sigma out 1act.( 3.82286286 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 40.5076599 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.592743158 *** contribution from regularisation: 0.00293704518 *** contribution from error: -0.595680177 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49716.3313 0.514862955 14.3331604 EXIT FROM BFGS code NEW_X -49716.3313 0.514862955 14.3331604 ENTER BFGS code NEW_X -49716.3313 0.514862955 14.3331604 EXIT FROM BFGS code FG_LNSRCH 0. 0.506712079 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.593189716 *** contribution from regularisation: 0.00294726482 *** contribution from error: -0.596136987 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49753.7888 0.506712079 -2.81416249 EXIT FROM BFGS code NEW_X -49753.7888 0.506712079 -2.81416249 ENTER BFGS code NEW_X -49753.7888 0.506712079 -2.81416249 EXIT FROM BFGS code FG_LNSRCH 0. 0.503875494 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.59331584 *** contribution from regularisation: 0.00285031251 *** contribution from error: -0.596166134 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49764.3679 0.503875494 -10.7823458 EXIT FROM BFGS code NEW_X -49764.3679 0.503875494 -10.7823458 ENTER BFGS code NEW_X -49764.3679 0.503875494 -10.7823458 EXIT FROM BFGS code FG_LNSRCH 0. 0.474141389 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.593458533 *** contribution from regularisation: 0.00257875584 *** contribution from error: -0.596037269 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49776.332 0.474141389 -19.8166008 EXIT FROM BFGS code NEW_X -49776.332 0.474141389 -19.8166008 ENTER BFGS code NEW_X -49776.332 0.474141389 -19.8166008 EXIT FROM BFGS code FG_LNSRCH 0. 0.418442756 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.592884719 *** contribution from regularisation: 0.00243628072 *** contribution from error: -0.595321 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49728.2038 0.418442756 -29.183794 EXIT FROM BFGS code FG_LNSRCH 0. 0.46703583 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.592192531 *** contribution from regularisation: 0.00382016436 *** contribution from error: -0.596012712 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49670.1494 0.46703583 -19.4575558 EXIT FROM BFGS code FG_LNSRCH 0. 0.474065751 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.593240678 *** contribution from regularisation: 0.00279635703 *** contribution from error: -0.59603703 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49758.0642 0.474065751 -19.2974796 EXIT FROM BFGS code FG_LNSRCH 0. 0.47414133 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.593034387 *** contribution from regularisation: 0.00300289737 *** contribution from error: -0.596037269 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49740.7571 0.47414133 -19.0363293 EXIT FROM BFGS code FG_LNSRCH 0. 0.474141389 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.593113184 *** contribution from regularisation: 0.00292409747 *** contribution from error: -0.596037269 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49747.3665 0.474141389 -19.0293159 EXIT FROM BFGS code FG_LNSRCH 0. 0.474141389 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.593106568 *** contribution from regularisation: 0.00293066795 *** contribution from error: -0.596037209 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49746.8154 0.474141389 -18.9417801 EXIT FROM BFGS code FG_LNSRCH 0. 0.474141389 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 29.7151985 sigma out 15 active outputs RANK 2 NODE 1 --> 15.3438044 sigma out 15 active outputs RANK 3 NODE 8 --> 14.423625 sigma out 15 active outputs RANK 4 NODE 9 --> 13.8027868 sigma out 15 active outputs RANK 5 NODE 11 --> 10.8502865 sigma out 15 active outputs RANK 6 NODE 6 --> 8.86407089 sigma out 15 active outputs RANK 7 NODE 2 --> 8.56111336 sigma out 15 active outputs RANK 8 NODE 12 --> 8.18812084 sigma out 15 active outputs RANK 9 NODE 5 --> 8.17577648 sigma out 15 active outputs RANK 10 NODE 7 --> 6.10622692 sigma out 15 active outputs RANK 11 NODE 4 --> 4.99395323 sigma out 15 active outputs RANK 12 NODE 3 --> 4.40997458 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 26.9927082 sigma in 12act. ( 24.4792137 sig out 1act.) RANK 2 NODE 14 --> 17.772644 sigma in 12act. ( 17.4424419 sig out 1act.) RANK 3 NODE 4 --> 14.6831284 sigma in 12act. ( 11.1872044 sig out 1act.) RANK 4 NODE 2 --> 11.9321203 sigma in 12act. ( 8.28997326 sig out 1act.) RANK 5 NODE 9 --> 11.8249493 sigma in 12act. ( 8.9696703 sig out 1act.) RANK 6 NODE 15 --> 11.3570042 sigma in 12act. ( 7.84895849 sig out 1act.) RANK 7 NODE 6 --> 9.74912834 sigma in 12act. ( 9.67614841 sig out 1act.) RANK 8 NODE 7 --> 7.46511889 sigma in 12act. ( 6.67158747 sig out 1act.) RANK 9 NODE 12 --> 6.71862411 sigma in 12act. ( 3.46258354 sig out 1act.) RANK 10 NODE 10 --> 6.07245493 sigma in 12act. ( 5.66788149 sig out 1act.) RANK 11 NODE 11 --> 5.92172718 sigma in 12act. ( 6.03826714 sig out 1act.) RANK 12 NODE 13 --> 4.65261269 sigma in 12act. ( 0.697732151 sig out 1act.) RANK 13 NODE 5 --> 4.16999912 sigma in 12act. ( 3.07102895 sig out 1act.) RANK 14 NODE 3 --> 3.63469148 sigma in 12act. ( 0.292686611 sig out 1act.) RANK 15 NODE 8 --> 3.28368974 sigma in 12act. ( 2.77696753 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 24.4792137 sigma out 1act.( 26.9927082 sig in 12act.) RANK 2 NODE 14 --> 17.4424419 sigma out 1act.( 17.772644 sig in 12act.) RANK 3 NODE 4 --> 11.1872044 sigma out 1act.( 14.6831284 sig in 12act.) RANK 4 NODE 6 --> 9.67614841 sigma out 1act.( 9.74912834 sig in 12act.) RANK 5 NODE 9 --> 8.9696703 sigma out 1act.( 11.8249493 sig in 12act.) RANK 6 NODE 2 --> 8.28997326 sigma out 1act.( 11.9321203 sig in 12act.) RANK 7 NODE 15 --> 7.84895849 sigma out 1act.( 11.3570042 sig in 12act.) RANK 8 NODE 7 --> 6.67158747 sigma out 1act.( 7.46511889 sig in 12act.) RANK 9 NODE 11 --> 6.03826714 sigma out 1act.( 5.92172718 sig in 12act.) RANK 10 NODE 10 --> 5.66788149 sigma out 1act.( 6.07245493 sig in 12act.) RANK 11 NODE 12 --> 3.46258354 sigma out 1act.( 6.71862411 sig in 12act.) RANK 12 NODE 5 --> 3.07102895 sigma out 1act.( 4.16999912 sig in 12act.) RANK 13 NODE 8 --> 2.77696753 sigma out 1act.( 3.28368974 sig in 12act.) RANK 14 NODE 13 --> 0.697732151 sigma out 1act.( 4.65261269 sig in 12act.) RANK 15 NODE 3 --> 0.292686611 sigma out 1act.( 3.63469148 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 38.4166298 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.593093693 *** contribution from regularisation: 0.00294356374 *** contribution from error: -0.596037269 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -49745.7337 0.474141389 -18.9834003 EXIT FROM BFGS code NEW_X -49745.7337 0.474141389 -18.9834003 ENTER BFGS code NEW_X -49745.7337 0.474141389 -18.9834003 EXIT FROM BFGS code CONVERGENC -49745.7337 0.474141389 -18.9834003 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 49.9061165 sigma out 15 active outputs RANK 2 NODE 1 --> 27.1389523 sigma out 15 active outputs RANK 3 NODE 9 --> 23.3955803 sigma out 15 active outputs RANK 4 NODE 8 --> 22.7304573 sigma out 15 active outputs RANK 5 NODE 11 --> 19.147419 sigma out 15 active outputs RANK 6 NODE 6 --> 15.9629278 sigma out 15 active outputs RANK 7 NODE 2 --> 14.6484823 sigma out 15 active outputs RANK 8 NODE 5 --> 14.5565119 sigma out 15 active outputs RANK 9 NODE 12 --> 13.6295252 sigma out 15 active outputs RANK 10 NODE 7 --> 10.3665171 sigma out 15 active outputs RANK 11 NODE 4 --> 8.21376038 sigma out 15 active outputs RANK 12 NODE 3 --> 7.19229746 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 47.7895432 sigma in 12act. ( 41.8879547 sig out 1act.) RANK 2 NODE 14 --> 31.3372078 sigma in 12act. ( 29.605423 sig out 1act.) RANK 3 NODE 4 --> 24.9392147 sigma in 12act. ( 18.1739349 sig out 1act.) RANK 4 NODE 2 --> 19.3163128 sigma in 12act. ( 13.4960117 sig out 1act.) RANK 5 NODE 9 --> 19.0490093 sigma in 12act. ( 14.6722746 sig out 1act.) RANK 6 NODE 15 --> 18.7087917 sigma in 12act. ( 12.3011627 sig out 1act.) RANK 7 NODE 6 --> 16.316803 sigma in 12act. ( 16.107542 sig out 1act.) RANK 8 NODE 7 --> 11.8541126 sigma in 12act. ( 10.835887 sig out 1act.) RANK 9 NODE 10 --> 9.9752903 sigma in 12act. ( 9.11696339 sig out 1act.) RANK 10 NODE 11 --> 9.73413944 sigma in 12act. ( 9.61066914 sig out 1act.) RANK 11 NODE 12 --> 9.16869545 sigma in 12act. ( 5.27708483 sig out 1act.) RANK 12 NODE 5 --> 5.91761827 sigma in 12act. ( 4.6788311 sig out 1act.) RANK 13 NODE 13 --> 4.78541803 sigma in 12act. ( 1.16081786 sig out 1act.) RANK 14 NODE 8 --> 4.61407518 sigma in 12act. ( 3.89655066 sig out 1act.) RANK 15 NODE 3 --> 3.65814829 sigma in 12act. ( 0.448860168 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 41.8879547 sigma out 1act.( 47.7895432 sig in 12act.) RANK 2 NODE 14 --> 29.605423 sigma out 1act.( 31.3372078 sig in 12act.) RANK 3 NODE 4 --> 18.1739349 sigma out 1act.( 24.9392147 sig in 12act.) RANK 4 NODE 6 --> 16.107542 sigma out 1act.( 16.316803 sig in 12act.) RANK 5 NODE 9 --> 14.6722746 sigma out 1act.( 19.0490093 sig in 12act.) RANK 6 NODE 2 --> 13.4960117 sigma out 1act.( 19.3163128 sig in 12act.) RANK 7 NODE 15 --> 12.3011627 sigma out 1act.( 18.7087917 sig in 12act.) RANK 8 NODE 7 --> 10.835887 sigma out 1act.( 11.8541126 sig in 12act.) RANK 9 NODE 11 --> 9.61066914 sigma out 1act.( 9.73413944 sig in 12act.) RANK 10 NODE 10 --> 9.11696339 sigma out 1act.( 9.9752903 sig in 12act.) RANK 11 NODE 12 --> 5.27708483 sigma out 1act.( 9.16869545 sig in 12act.) RANK 12 NODE 5 --> 4.6788311 sigma out 1act.( 5.91761827 sig in 12act.) RANK 13 NODE 8 --> 3.89655066 sigma out 1act.( 4.61407518 sig in 12act.) RANK 14 NODE 13 --> 1.16081786 sigma out 1act.( 4.78541803 sig in 12act.) RANK 15 NODE 3 --> 0.448860168 sigma out 1act.( 3.65814829 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 64.2567902 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.593095601 *** contribution from regularisation: 0.00294163474 *** contribution from error: -0.596037209 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 28167 Closing output file done