NNInput NNInputs_155.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 42201 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 11757 nbkg = 30444 Bkg Entries: 30444 Sig Entries: 11757 Chosen entries: 11757 Signal fraction: 1 Background fraction: 0.386184 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 30444 Actual Signal Entries: 11757 Entries to split: 11757 Test with : 5878 Train with : 5878 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 11757 for Signal Prepared event 0 for Signal with 11757 events ====Entry 0 Variable Ht : 218.922 Variable LepAPt : 39.9099 Variable LepBPt : 14.4176 Variable MetSigLeptonsJets : 5.65701 Variable MetSpec : 63.5514 Variable SumEtLeptonsJets : 149.705 Variable VSumJetLeptonsPt : 62.6982 Variable addEt : 123.544 Variable dPhiLepSumMet : 1.4238 Variable dPhiLeptons : 0.353525 Variable dRLeptons : 0.526466 Variable lep1_E : 40.118 Variable lep2_E : 15.0207 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2155 Ht = 218.922 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 39.9101 LepAPt = 39.9099 LepBEt = 14.4183 LepBPt = 14.4176 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 69.2158 MetDelPhi = 1.16342 MetSig = 4.0642 MetSigLeptonsJets = 5.65701 MetSpec = 63.5514 Mjj = 0 MostCentralJetEta = -1.69774 MtllMet = 124.354 Njets = 1 SB = 0 SumEt = 290.042 SumEtJets = 0 SumEtLeptonsJets = 149.705 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 62.6982 addEt = 123.544 dPhiLepSumMet = 1.4238 dPhiLeptons = 0.353525 dRLeptons = 0.526466 diltype = 17 dimass = 12.6472 event = 33 jet1_Et = 95.3774 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 40.118 lep2_E = 15.0207 rand = 0.999742 run = 236756 weight = 2.85287e-06 ===Show End Prepared event 10000 for Signal with 11757 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 30444 for Background Prepared event 0 for Background with 30444 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 1.41159 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 30444 events Prepared event 20000 for Background with 30444 events Prepared event 30000 for Background with 30444 events Warning: found 1017 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 42201 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 1017 negative weights. Signal fraction: 62.9713593 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 55.9230614 62.335083 64.1055984 66.0918579 67.9826813 69.9515076 71.3737183 73.1305542 75.0291061 76.8119965 78.7278137 79.9760284 81.4750977 82.8911285 84.8022614 85.9598389 87.5028229 88.8505402 90.3339005 91.6335373 92.9516144 94.2795715 95.461174 97.01474 98.3339767 99.4951019 100.816574 102.134659 103.543007 104.81279 106.050858 107.389587 108.643478 109.813354 110.924171 112.162399 113.45256 114.752541 115.836639 117.108009 117.99614 119.357277 120.448273 121.668396 122.974503 124.111374 125.429153 126.81813 127.794258 129.000549 130.16333 131.356995 132.384735 133.613235 134.548065 135.377792 136.322083 137.684906 138.839401 139.887054 141.146362 142.232788 143.212524 144.469238 145.705582 146.709167 147.756821 148.788605 150.004333 151.155182 152.469879 153.968506 155.372162 157.220337 159.026779 160.62056 162.646393 164.954041 166.764832 169.114075 171.625992 174.091675 176.341858 179.110809 181.759247 184.847992 187.666718 190.706543 194.285233 198.221619 202.424408 206.887726 212.137405 216.987335 222.765106 230.667603 240.81665 256.903168 278.19986 311.127716 618.000122 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.5260811 21.0102844 21.4324188 21.8124409 22.2254581 22.5769539 22.9141884 23.2467251 23.5343208 23.9377384 24.2747822 24.583271 24.8592129 25.0837784 25.3584518 25.637989 25.9286308 26.1968117 26.4607239 26.760746 27.1315594 27.4471436 27.7529945 28.0444164 28.2721138 28.4974251 28.7298889 28.994648 29.2694397 29.5674953 29.7989426 30.0433121 30.3024979 30.6085281 30.8703041 31.1081123 31.349968 31.6220112 31.8937073 32.144577 32.4449539 32.6808243 32.9406433 33.1672211 33.411972 33.6646156 33.8961372 34.1734085 34.369606 34.6203232 34.8723412 35.1431046 35.3836746 35.6490707 35.8816681 36.1472092 36.3807449 36.6611023 36.9118958 37.1737785 37.3897629 37.6472168 37.955246 38.2344284 38.5675888 38.8465538 39.1749268 39.4500504 39.7089844 40.0624847 40.3692398 40.6381531 40.9757195 41.2576599 41.6462708 41.9818344 42.3623085 42.6851273 43.0901566 43.4834747 43.8676147 44.3843193 44.8893738 45.3781815 45.9741173 46.6720619 47.2926636 47.855793 48.6415939 49.4143143 50.2482719 51.4766541 52.7020645 54.3346786 56.1512833 58.028656 60.073597 64.1441956 71.9766846 215.827057 ------------------------------ Transdef: Tab for variable 4 10.0010262 10.2077179 10.4102545 10.585207 10.8430309 11.0866127 11.2575359 11.4747009 11.7152634 11.9896812 12.2301569 12.5047846 12.8051348 13.0321388 13.2971439 13.5279694 13.8030739 14.0627022 14.2811899 14.5331631 14.8073444 15.085885 15.3587904 15.6187096 15.8846931 16.1790962 16.4614296 16.7215805 16.9676323 17.1803322 17.4887028 17.7768669 18.0334167 18.3136749 18.6233521 18.8836174 19.1231537 19.390976 19.6342926 19.8959637 20.1126251 20.3569908 20.5862656 20.7951012 20.9957943 21.1933556 21.4320717 21.6136112 21.8310585 22.0797787 22.3241749 22.5380878 22.7747822 22.9739151 23.1856651 23.4119225 23.6543427 23.8631096 24.0961094 24.3214836 24.5769958 24.7958755 24.9880695 25.2415066 25.5169449 25.8002777 26.0333099 26.3058033 26.5467339 26.8263836 27.1025486 27.3850212 27.6622276 27.9583549 28.2885971 28.6000233 28.8506775 29.1242599 29.4588585 29.7719975 30.0745049 30.3734894 30.7401943 31.0886002 31.4753532 31.8479805 32.243988 32.6315918 33.0873451 33.5547447 33.9738083 34.5297508 35.1433716 35.8581657 36.5741692 37.3695526 38.3977814 40.0062485 42.2798538 46.93536 73.4754028 ------------------------------ Transdef: Tab for variable 5 1.55223811 2.63390493 2.93273664 3.15411425 3.32282186 3.47160721 3.6161201 3.73982501 3.87325811 3.96179461 4.04112577 4.13318729 4.21988535 4.28274059 4.36347198 4.43502617 4.52714109 4.61767244 4.70695496 4.7963686 4.86316299 4.9527483 5.03108025 5.12977552 5.20919657 5.30175018 5.37927628 5.45271587 5.52988338 5.60903025 5.68292284 5.74461937 5.82409954 5.87550735 5.93551826 6.00306702 6.07746696 6.14087534 6.20822239 6.27060127 6.33439636 6.39982414 6.4496336 6.5119772 6.55906105 6.6112175 6.66383648 6.71131229 6.76534462 6.82366276 6.87406158 6.9216547 6.97262192 7.01749325 7.06648922 7.11273575 7.16713428 7.2158637 7.27084351 7.31969643 7.36218739 7.4130373 7.47046375 7.51342583 7.56582451 7.61136246 7.66388416 7.71059513 7.75213814 7.79886532 7.84423161 7.89319324 7.9422617 7.99277401 8.04383945 8.09534836 8.13640976 8.18492317 8.23835468 8.29302788 8.3440485 8.40596867 8.45618153 8.51369667 8.57226562 8.64227581 8.69771767 8.75849342 8.83656311 8.9165411 8.99899483 9.09391975 9.20822525 9.31972313 9.46950436 9.63972282 9.85930252 10.1543999 10.5730953 11.2032356 17.5045052 ------------------------------ Transdef: Tab for variable 6 25.0005894 25.373682 25.7955704 26.1675396 26.549305 27.0582771 27.5120087 27.9561825 28.4702339 28.9204273 29.6357517 30.3757706 31.1207733 31.8585682 32.4635162 33.1539307 33.8066216 34.5911636 35.4604111 36.1816864 36.9544525 37.5989838 38.3199615 39.0099411 39.6391945 40.4192276 41.0443268 41.7158661 42.3726997 43.0547295 43.681633 44.3143578 44.9012871 45.4861183 46.1094437 46.6201859 47.195549 47.7762413 48.4241943 49.0177765 49.5678558 50.1216354 50.6980019 51.4007187 51.944458 52.5999298 53.2477646 53.8628082 54.4469604 54.9798508 55.5836563 56.1374207 56.681839 57.1781158 57.7570114 58.3269958 58.907032 59.4501343 60.0333061 60.5390091 61.0425606 61.5777779 62.1397438 62.7136383 63.2716675 63.8066673 64.3534088 64.8683472 65.4020538 66.0125427 66.6321716 67.2057419 67.8337555 68.4023743 68.9709702 69.6119308 70.1921005 70.7828979 71.5110474 72.0463715 72.7022705 73.4749603 74.181076 74.8800659 75.6401291 76.5652771 77.3912964 78.4317474 79.6970673 81.1139679 82.479248 84.1009064 85.7650146 88.0587769 90.7547302 93.7948074 97.5656738 102.378586 108.116341 118.747414 203.398682 ------------------------------ Transdef: Tab for variable 7 30.1229668 33.8115921 35.1491699 36.1589966 37.0769196 37.7168655 38.6880493 39.4750671 40.2627525 41.0482712 41.8343658 42.4444656 43.142643 43.8549232 44.6062355 45.2953339 45.9182091 46.5388527 47.3834419 48.330162 49.0074539 49.684433 50.3039474 51.0855446 51.7722969 52.3688965 53.0337563 53.7502327 54.6042709 55.2470322 55.7967148 56.412529 57.1153641 57.6253891 58.3043938 58.9151611 59.5083008 60.1395493 60.7803116 61.5046997 62.134964 62.7802048 63.4069977 64.1466827 64.8786697 65.4965973 66.1305237 66.741539 67.3812866 68.0474548 68.848053 69.4799347 70.1165161 70.789032 71.4148865 72.1442719 72.7764435 73.4987946 74.1794205 74.9125443 75.6319656 76.3703461 77.3582153 78.3542175 79.4739532 80.6998749 81.6910858 82.9400787 84.2354431 85.592926 87.1412201 88.5169754 89.9365768 91.2880402 92.6858826 94.2524796 95.7101898 97.2701035 99.0767746 100.704803 102.546906 104.503555 106.473816 108.866058 111.192978 113.395844 116.012756 119.063278 121.763199 124.809387 128.499725 133.286011 137.225266 143.467819 149.232605 156.838165 164.918488 175.164307 190.870605 219.257263 525.026306 ------------------------------ Transdef: Tab for variable 8 4.8277607 23.8098068 29.1325779 31.3997536 32.6501122 33.784523 34.6602364 35.3042603 35.948082 36.5408859 37.1721725 37.669838 38.2468948 38.8495178 39.4239655 40.041378 40.5404854 41.0448456 41.587944 42.1394424 42.5358353 43.0869675 43.6771431 44.131218 44.6355095 45.2009659 45.6699524 46.1580582 46.7630463 47.3154259 47.8043633 48.3750839 48.8673325 49.3589783 49.9045715 50.4707603 51.0042953 51.53339 51.9477386 52.4333344 52.8928833 53.4162674 54.0194206 54.531311 54.9309235 55.4050903 55.928009 56.4355049 56.9330139 57.3884964 57.7764511 58.2776146 58.7381744 59.2363815 59.7552261 60.2034569 60.6341209 61.1067276 61.6058884 62.0733643 62.565464 63.1407623 63.5729561 64.1079865 64.5993652 65.1182861 65.5882568 66.1286774 66.6021347 67.1700974 67.7333984 68.3734589 68.8930893 69.4273605 69.9480286 70.4480438 70.9481125 71.6458282 72.2297211 72.7484894 73.4956665 74.1538086 74.8409882 75.583847 76.3477936 77.1891174 78.1719818 79.1907501 80.3933334 81.789566 83.4111633 85.1086578 87.0834198 89.2527466 91.5940094 94.5436249 98.6821442 103.144058 109.979195 121.422646 206.022919 ------------------------------ Transdef: Tab for variable 9 55.9230614 61.8971214 63.7137184 64.9816284 66.6912994 68.0396729 69.3720551 70.549057 71.7113953 72.9980164 74.5658264 75.7568817 77.2354584 78.6733551 79.6909485 80.9453049 82.0941925 83.4219055 84.5126648 85.6817398 86.6321411 87.8538971 88.965538 90.3096924 91.2702179 92.4036407 93.6372452 94.7013397 95.6004333 96.845047 97.8505859 98.7094269 99.7344742 100.84993 101.991348 103.191757 104.136749 105.306 106.259735 107.235199 108.192276 109.306152 110.196976 111.135147 112.061646 113.071487 114.110809 115.042664 115.989258 116.83091 117.685562 118.643646 119.570862 120.49765 121.42704 122.36879 123.311447 124.293488 125.217827 126.185867 127.036636 127.840866 128.749268 129.717545 130.488007 131.449646 132.337296 133.365601 134.218323 134.888138 135.740433 136.433563 137.283508 138.18074 139.080505 139.985703 140.819794 141.865356 142.669006 143.423615 144.348373 145.199982 146.128387 147.064484 147.864182 148.775757 149.964081 150.899292 152.010345 153.026978 154.350433 155.727112 157.069153 158.97937 161.25647 164.13974 167.799408 172.036255 179.549118 194.287064 382.729065 ------------------------------ Transdef: Tab for variable 10 0.0517990664 1.11102653 1.34254909 1.54506993 1.66170144 1.76894331 1.86859822 1.94301033 2.02044773 2.0870657 2.15149117 2.20012474 2.24324131 2.28123999 2.3218894 2.36587358 2.3966856 2.42776251 2.45343399 2.48610258 2.52037597 2.55468345 2.57910538 2.60405302 2.62505722 2.64532161 2.66623116 2.68448162 2.70305777 2.71796775 2.73301101 2.7515974 2.77113414 2.78544712 2.79870343 2.81047201 2.82391262 2.83566785 2.84905839 2.8610673 2.87263584 2.88554478 2.89435959 2.90304422 2.91010141 2.91839552 2.92751551 2.93485475 2.94255686 2.95156574 2.95929241 2.96629858 2.97263241 2.97876239 2.9837265 2.9895184 2.99546432 3.00117731 3.00718641 3.01186562 3.01630235 3.02108908 3.02543712 3.02971387 3.03353477 3.03781152 3.04209638 3.04566574 3.04936266 3.05263901 3.05664301 3.06039476 3.06373239 3.06692934 3.07015419 3.07330227 3.07634187 3.07944393 3.08291864 3.08633995 3.08906674 3.0918808 3.0946188 3.09711075 3.09966803 3.10253954 3.10536647 3.1079607 3.11103082 3.11377478 3.11660385 3.11915445 3.12165737 3.12426329 3.12690473 3.12937498 3.13204813 3.13477778 3.13697767 3.13957095 3.14158249 ------------------------------ Transdef: Tab for variable 11 1.71661377E-05 0.00931167603 0.0194560289 0.0271088481 0.0342361256 0.0427283347 0.0499071479 0.0562806129 0.0619108304 0.0693385601 0.0758447647 0.0816035271 0.0874084532 0.0938116014 0.0994277 0.104904175 0.111593843 0.11858511 0.12449269 0.129925966 0.134395599 0.139684945 0.144847035 0.149351418 0.155861139 0.160996914 0.166941464 0.172218293 0.177017629 0.182009578 0.187617898 0.191475376 0.196047425 0.200534105 0.20484221 0.208348274 0.211868227 0.216431499 0.220519111 0.224723816 0.229043245 0.233647168 0.236698389 0.240054965 0.24394697 0.248131096 0.252412081 0.256768823 0.261162817 0.265411735 0.270401537 0.274914622 0.278983861 0.283481061 0.287714601 0.29273057 0.296641231 0.300777555 0.305008978 0.310150921 0.315387845 0.32004863 0.324891329 0.329535365 0.334371865 0.33967042 0.344318002 0.350150228 0.355897903 0.361210406 0.367741108 0.374136925 0.379195303 0.385152876 0.391494989 0.397880077 0.404291809 0.41044426 0.417917967 0.424731225 0.432162881 0.43901664 0.447713256 0.454155833 0.462780237 0.472828865 0.481052041 0.492542028 0.504196346 0.515376329 0.528597355 0.542694211 0.560591459 0.579018235 0.598304868 0.623535097 0.650171041 0.679459691 0.724123478 0.795546234 1.10088217 ------------------------------ Transdef: Tab for variable 12 0.200054675 0.206141755 0.211035296 0.216760993 0.223188668 0.227443457 0.232136101 0.237032145 0.241521418 0.245708704 0.250953436 0.256011248 0.261230826 0.266316175 0.270386279 0.275882006 0.280599803 0.28520304 0.289053261 0.293549597 0.298002601 0.301381528 0.305456758 0.309452176 0.31318602 0.317584217 0.321124017 0.325801909 0.330156088 0.334111631 0.338592827 0.34237951 0.346227497 0.350278467 0.35465914 0.358314872 0.362204701 0.366238236 0.370022923 0.374145627 0.377603054 0.381053686 0.385190129 0.388860345 0.392546982 0.396032274 0.399887532 0.402879208 0.406346232 0.409688711 0.413482845 0.417134464 0.420646071 0.424385458 0.42822364 0.432650328 0.436890215 0.440859497 0.444849759 0.448948741 0.453304112 0.45754829 0.461503386 0.466241419 0.471320033 0.475582004 0.480908573 0.485542893 0.48985523 0.494152158 0.499825716 0.505417168 0.510460258 0.514949203 0.520339012 0.525497556 0.531317115 0.53730303 0.544503808 0.551805854 0.558096051 0.56440711 0.573576212 0.581674695 0.590573668 0.600871086 0.609367967 0.620254099 0.630143523 0.64160943 0.652476072 0.664388895 0.677834988 0.694370925 0.71038717 0.727567554 0.751721144 0.779064476 0.822416067 0.893988371 1.12607551 ------------------------------ Transdef: Tab for variable 13 20.0044594 21.3750381 22.2236099 22.9034424 23.4497528 24.0793304 24.6035805 24.9493942 25.3407974 25.8047676 26.2222824 26.6702766 27.0342789 27.3725433 27.7677097 28.1724052 28.5405941 28.8931847 29.2658806 29.62146 29.9254665 30.2390518 30.5542545 30.9040298 31.1712399 31.495779 31.8125343 32.1606712 32.4616776 32.7883949 33.0785179 33.3564148 33.6059647 33.8403473 34.2194519 34.4984283 34.7696953 35.0363579 35.3249626 35.6629486 35.929451 36.1813583 36.5156746 36.8136673 37.13414 37.3706818 37.6239395 37.8984756 38.1643524 38.4634094 38.7701187 39.0791283 39.3754196 39.7221298 39.9870262 40.2530785 40.5981903 40.8778496 41.1348724 41.428627 41.7705841 42.1076622 42.4460449 42.7189255 43.000473 43.3202667 43.6538239 43.976738 44.4083862 44.8342438 45.2527008 45.6036491 45.9374161 46.3907089 46.8200073 47.2434387 47.7011032 48.2535019 48.7138786 49.1982422 49.793602 50.3207474 50.9366074 51.6276779 52.3266602 53.0574417 53.8153343 54.6875 55.6071815 56.6926727 57.7990227 59.1060562 60.2466393 61.7946014 63.6162071 65.9988174 68.7727661 71.930542 77.4176636 86.1491699 216.276123 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.6623116 11.2379189 11.6629486 12.0201063 12.3006506 12.6439247 12.9778423 13.2750015 13.6738586 13.9905758 14.2949762 14.6172047 14.9652996 15.333292 15.5977306 15.8999672 16.1793594 16.5438652 16.8511448 17.1343994 17.438694 17.736969 18.0089874 18.3429375 18.618782 18.9163532 19.2014408 19.5264359 19.8390617 20.138073 20.420784 20.7320862 21.0157623 21.3041096 21.5974159 21.8279972 22.0671864 22.3482285 22.6775932 22.924305 23.1856899 23.4560127 23.6952133 23.9564857 24.2197361 24.4746895 24.7261314 25.0319786 25.2596188 25.4771042 25.7274914 26.0664558 26.3462334 26.6429405 26.8998489 27.1905403 27.4237747 27.7346325 27.9752274 28.2503777 28.5555267 28.8487263 29.1453819 29.3982582 29.6990738 29.9651604 30.3006973 30.5966167 30.9016075 31.2121582 31.5329018 31.8559456 32.1908226 32.56147 32.8576965 33.1839981 33.5897141 33.9527702 34.3145828 34.7257652 35.1532173 35.6193466 35.9885063 36.4648285 36.9354401 37.4827805 37.9422302 38.4456787 39.010849 39.6635399 40.5021629 41.3525543 42.2320099 43.2649803 44.3292313 45.9885063 47.9265823 50.9797516 56.3811264 94.80896 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 49.6 28.3 40.3 25.3 41.5 43.8 38.4 47.8 -16.0 -15.6 -23.8 24.5 36.3 2 49.6 100.0 60.7 57.0 30.7 68.8 94.3 69.4 88.6 -42.2 -25.6 -42.1 55.5 51.0 3 28.3 60.7 100.0 42.4 3.9 29.9 63.3 46.6 67.5 -8.3 -27.8 -48.4 91.2 36.9 4 40.3 57.0 42.4 100.0 13.8 35.8 55.9 46.3 64.8 -4.7 -30.9 -56.3 39.8 91.3 5 25.3 30.7 3.9 13.8 100.0 85.0 0.7 57.5 57.2 32.1 -6.0 -5.3 3.0 12.5 6 41.5 68.8 29.9 35.8 85.0 100.0 44.8 78.8 82.3 1.4 -15.5 -22.5 26.9 32.1 7 43.8 94.3 63.3 55.9 0.7 44.8 100.0 57.2 74.3 -53.2 -25.5 -43.4 58.1 50.0 8 38.4 69.4 46.6 46.3 57.5 78.8 57.2 100.0 81.0 0.2 -22.8 -34.7 42.6 41.8 9 47.8 88.6 67.5 64.8 57.2 82.3 74.3 81.0 100.0 -10.7 -28.0 -47.2 61.9 58.1 10 -16.0 -42.2 -8.3 -4.7 32.1 1.4 -53.2 0.2 -10.7 100.0 2.9 3.9 -7.4 -4.0 11 -15.6 -25.6 -27.8 -30.9 -6.0 -15.5 -25.5 -22.8 -28.0 2.9 100.0 53.9 -24.4 -29.7 12 -23.8 -42.1 -48.4 -56.3 -5.3 -22.5 -43.4 -34.7 -47.2 3.9 53.9 100.0 -44.2 -48.7 13 24.5 55.5 91.2 39.8 3.0 26.9 58.1 42.6 61.9 -7.4 -24.4 -44.2 100.0 43.5 14 36.3 51.0 36.9 91.3 12.5 32.1 50.0 41.8 58.1 -4.0 -29.7 -48.7 43.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 126.110649 TOTAL CORRELATION OF ALL VARIABLES 54.4834257 ROUND 1: MAX CORR ( 54.4795732) AFTER KILLING INPUT VARIABLE 11 CONTR 0.647904845 ROUND 2: MAX CORR ( 54.4648516) AFTER KILLING INPUT VARIABLE 8 CONTR 1.26642643 ROUND 3: MAX CORR ( 54.44156) AFTER KILLING INPUT VARIABLE 14 CONTR 1.59267255 ROUND 4: MAX CORR ( 54.4158562) AFTER KILLING INPUT VARIABLE 7 CONTR 1.6727374 ROUND 5: MAX CORR ( 54.3755449) AFTER KILLING INPUT VARIABLE 12 CONTR 2.09416234 ROUND 6: MAX CORR ( 54.2928706) AFTER KILLING INPUT VARIABLE 6 CONTR 2.99734759 ROUND 7: MAX CORR ( 54.1827457) AFTER KILLING INPUT VARIABLE 13 CONTR 3.45627898 ROUND 8: MAX CORR ( 53.987738) AFTER KILLING INPUT VARIABLE 10 CONTR 4.59282873 ROUND 9: MAX CORR ( 53.5245043) AFTER KILLING INPUT VARIABLE 3 CONTR 7.05714464 ROUND 10: MAX CORR ( 52.9003983) AFTER KILLING INPUT VARIABLE 9 CONTR 8.14987269 ROUND 11: MAX CORR ( 51.6810869) AFTER KILLING INPUT VARIABLE 5 CONTR 11.29236 ROUND 12: MAX CORR ( 49.5541887) AFTER KILLING INPUT VARIABLE 4 CONTR 14.6736882 LAST REMAINING VARIABLE: 2 total correlation to target: 54.4834257 % total significance: 52.6792883 sigma correlations of single variables to target: variable 2: 49.5541887 % , in sigma: 47.9132757 variable 3: 28.3284799 % , in sigma: 27.3904245 variable 4: 40.2890399 % , in sigma: 38.9549285 variable 5: 25.2938023 % , in sigma: 24.4562357 variable 6: 41.5088159 % , in sigma: 40.1343134 variable 7: 43.7838271 % , in sigma: 42.3339909 variable 8: 38.3813379 % , in sigma: 37.1103971 variable 9: 47.8076003 % , in sigma: 46.2245229 variable 10: -15.9573034 % , in sigma: 15.4289011 variable 11: -15.6276443 % , in sigma: 15.1101582 variable 12: -23.8068352 % , in sigma: 23.0185074 variable 13: 24.5342267 % , in sigma: 23.7218124 variable 14: 36.2841664 % , in sigma: 35.0826704 variables sorted by significance: 1 most relevant variable 2 corr 49.5541878 , in sigma: 47.9132748 2 most relevant variable 4 corr 14.6736879 , in sigma: 14.1877906 3 most relevant variable 5 corr 11.2923603 , in sigma: 10.9184306 4 most relevant variable 9 corr 8.14987278 , in sigma: 7.8800019 5 most relevant variable 3 corr 7.05714464 , in sigma: 6.82345782 6 most relevant variable 10 corr 4.59282875 , in sigma: 4.44074408 7 most relevant variable 13 corr 3.45627904 , in sigma: 3.34182951 8 most relevant variable 6 corr 2.99734759 , in sigma: 2.8980949 9 most relevant variable 12 corr 2.09416223 , in sigma: 2.02481717 10 most relevant variable 7 corr 1.67273736 , in sigma: 1.61734716 11 most relevant variable 14 corr 1.59267259 , in sigma: 1.53993361 12 most relevant variable 8 corr 1.26642644 , in sigma: 1.22449062 13 most relevant variable 11 corr 0.647904873 , in sigma: 0.626450469 global correlations between input variables: variable 2: 99.3791688 % variable 3: 95.663315 % variable 4: 95.2993969 % variable 5: 96.4671222 % variable 6: 96.7708763 % variable 7: 99.0736046 % variable 8: 87.6421729 % variable 9: 98.6670691 % variable 10: 75.2043549 % variable 11: 55.2613982 % variable 12: 71.8373223 % variable 13: 93.8128832 % variable 14: 94.006453 % significance loss when removing single variables: variable 2: corr = 7.87107368 % , sigma = 7.61043482 variable 3: corr = 8.46307144 % , sigma = 8.18282945 variable 4: corr = 9.32861558 % , sigma = 9.01971239 variable 5: corr = 7.35563108 % , sigma = 7.11206032 variable 6: corr = 2.35286302 % , sigma = 2.27495147 variable 7: corr = 2.03232168 % , sigma = 1.96502438 variable 8: corr = 1.23424909 % , sigma = 1.19337878 variable 9: corr = 10.5076446 % , sigma = 10.1596997 variable 10: corr = 4.54135762 % , sigma = 4.39097734 variable 11: corr = 0.647904845 % , sigma = 0.626450442 variable 12: corr = 2.02698218 % , sigma = 1.95986169 variable 13: corr = 3.67624477 % , sigma = 3.55451141 variable 14: corr = 1.47649023 % , sigma = 1.42759846 Keep only 6 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 7 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 11.8808041 sigma out 15 active outputs RANK 2 NODE 6 --> 11.0140171 sigma out 15 active outputs RANK 3 NODE 7 --> 10.7817039 sigma out 15 active outputs RANK 4 NODE 2 --> 10.3200111 sigma out 15 active outputs RANK 5 NODE 5 --> 8.27451515 sigma out 15 active outputs RANK 6 NODE 3 --> 7.39084911 sigma out 15 active outputs RANK 7 NODE 4 --> 6.64450359 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 15.6190205 sigma in 7act. ( 16.6618423 sig out 1act.) RANK 2 NODE 8 --> 10.4507418 sigma in 7act. ( 11.2880526 sig out 1act.) RANK 3 NODE 10 --> 7.47301388 sigma in 7act. ( 7.64091253 sig out 1act.) RANK 4 NODE 5 --> 7.26610231 sigma in 7act. ( 7.15930796 sig out 1act.) RANK 5 NODE 15 --> 6.49105644 sigma in 7act. ( 6.68996859 sig out 1act.) RANK 6 NODE 11 --> 5.35816383 sigma in 7act. ( 5.63369036 sig out 1act.) RANK 7 NODE 9 --> 5.3270936 sigma in 7act. ( 5.55932331 sig out 1act.) RANK 8 NODE 2 --> 5.30592823 sigma in 7act. ( 5.15480709 sig out 1act.) RANK 9 NODE 1 --> 4.95582962 sigma in 7act. ( 5.16714191 sig out 1act.) RANK 10 NODE 13 --> 3.67400908 sigma in 7act. ( 3.3681407 sig out 1act.) RANK 11 NODE 6 --> 2.94389606 sigma in 7act. ( 3.5506525 sig out 1act.) RANK 12 NODE 3 --> 2.5594213 sigma in 7act. ( 2.58828402 sig out 1act.) RANK 13 NODE 7 --> 2.51588178 sigma in 7act. ( 2.65813446 sig out 1act.) RANK 14 NODE 12 --> 1.77005589 sigma in 7act. ( 1.82466745 sig out 1act.) RANK 15 NODE 4 --> 0.724226952 sigma in 7act. ( 0.304056317 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 16.6618423 sigma out 1act.( 15.6190205 sig in 7act.) RANK 2 NODE 8 --> 11.2880526 sigma out 1act.( 10.4507418 sig in 7act.) RANK 3 NODE 10 --> 7.64091253 sigma out 1act.( 7.47301388 sig in 7act.) RANK 4 NODE 5 --> 7.15930796 sigma out 1act.( 7.26610231 sig in 7act.) RANK 5 NODE 15 --> 6.68996859 sigma out 1act.( 6.49105644 sig in 7act.) RANK 6 NODE 11 --> 5.63369036 sigma out 1act.( 5.35816383 sig in 7act.) RANK 7 NODE 9 --> 5.55932331 sigma out 1act.( 5.3270936 sig in 7act.) RANK 8 NODE 1 --> 5.16714191 sigma out 1act.( 4.95582962 sig in 7act.) RANK 9 NODE 2 --> 5.15480709 sigma out 1act.( 5.30592823 sig in 7act.) RANK 10 NODE 6 --> 3.5506525 sigma out 1act.( 2.94389606 sig in 7act.) RANK 11 NODE 13 --> 3.3681407 sigma out 1act.( 3.67400908 sig in 7act.) RANK 12 NODE 7 --> 2.65813446 sigma out 1act.( 2.51588178 sig in 7act.) RANK 13 NODE 3 --> 2.58828402 sigma out 1act.( 2.5594213 sig in 7act.) RANK 14 NODE 12 --> 1.82466745 sigma out 1act.( 1.77005589 sig in 7act.) RANK 15 NODE 4 --> 0.304056317 sigma out 1act.( 0.724226952 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 26.7672596 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 13.097928 sigma out 15 active outputs RANK 2 NODE 2 --> 13.0348291 sigma out 15 active outputs RANK 3 NODE 6 --> 13.0224066 sigma out 15 active outputs RANK 4 NODE 1 --> 12.8157864 sigma out 15 active outputs RANK 5 NODE 7 --> 11.6665735 sigma out 15 active outputs RANK 6 NODE 3 --> 9.11315918 sigma out 15 active outputs RANK 7 NODE 4 --> 8.00094986 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 14 --> 14.806139 sigma in 7act. ( 15.544817 sig out 1act.) RANK 2 NODE 8 --> 11.1189108 sigma in 7act. ( 10.8237114 sig out 1act.) RANK 3 NODE 10 --> 8.7381115 sigma in 7act. ( 7.27835131 sig out 1act.) RANK 4 NODE 11 --> 8.63271332 sigma in 7act. ( 6.14825439 sig out 1act.) RANK 5 NODE 6 --> 8.24179459 sigma in 7act. ( 4.27120829 sig out 1act.) RANK 6 NODE 5 --> 8.16512299 sigma in 7act. ( 6.86713648 sig out 1act.) RANK 7 NODE 2 --> 7.67890739 sigma in 7act. ( 4.43255854 sig out 1act.) RANK 8 NODE 15 --> 7.49821329 sigma in 7act. ( 6.36553574 sig out 1act.) RANK 9 NODE 1 --> 7.34694815 sigma in 7act. ( 6.84020853 sig out 1act.) RANK 10 NODE 9 --> 6.66628313 sigma in 7act. ( 4.86776876 sig out 1act.) RANK 11 NODE 7 --> 5.5603404 sigma in 7act. ( 2.98469067 sig out 1act.) RANK 12 NODE 13 --> 4.94931602 sigma in 7act. ( 3.2544992 sig out 1act.) RANK 13 NODE 4 --> 4.69767427 sigma in 7act. ( 0.937534392 sig out 1act.) RANK 14 NODE 3 --> 4.49330616 sigma in 7act. ( 2.81537938 sig out 1act.) RANK 15 NODE 12 --> 4.3428359 sigma in 7act. ( 2.38115287 sig out 1act.) sorted by output significance RANK 1 NODE 14 --> 15.544817 sigma out 1act.( 14.806139 sig in 7act.) RANK 2 NODE 8 --> 10.8237114 sigma out 1act.( 11.1189108 sig in 7act.) RANK 3 NODE 10 --> 7.27835131 sigma out 1act.( 8.7381115 sig in 7act.) RANK 4 NODE 5 --> 6.86713648 sigma out 1act.( 8.16512299 sig in 7act.) RANK 5 NODE 1 --> 6.84020853 sigma out 1act.( 7.34694815 sig in 7act.) RANK 6 NODE 15 --> 6.36553574 sigma out 1act.( 7.49821329 sig in 7act.) RANK 7 NODE 11 --> 6.14825439 sigma out 1act.( 8.63271332 sig in 7act.) RANK 8 NODE 9 --> 4.86776876 sigma out 1act.( 6.66628313 sig in 7act.) RANK 9 NODE 2 --> 4.43255854 sigma out 1act.( 7.67890739 sig in 7act.) RANK 10 NODE 6 --> 4.27120829 sigma out 1act.( 8.24179459 sig in 7act.) RANK 11 NODE 13 --> 3.2544992 sigma out 1act.( 4.94931602 sig in 7act.) RANK 12 NODE 7 --> 2.98469067 sigma out 1act.( 5.5603404 sig in 7act.) RANK 13 NODE 3 --> 2.81537938 sigma out 1act.( 4.49330616 sig in 7act.) RANK 14 NODE 12 --> 2.38115287 sigma out 1act.( 4.3428359 sig in 7act.) RANK 15 NODE 4 --> 0.937534392 sigma out 1act.( 4.69767427 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 26.0690784 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.388123661 *** contribution from regularisation: 0.010641153 *** contribution from error: -0.398764819 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.426085949 *** contribution from regularisation: 0.00600496354 *** contribution from error: -0.432090908 *********************************************** -----------------> Test sample ENTER BFGS code START -8992.52362 0.481353492 0.317776442 EXIT FROM BFGS code FG_START 0. 0.481353492 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.437730849 *** contribution from regularisation: 0.00495753065 *** contribution from error: -0.442688376 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -9236.1209 0.481353492 41.8265152 EXIT FROM BFGS code FG_LNSRCH 0. 0.517967582 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.461047649 *** contribution from regularisation: 0.00713949138 *** contribution from error: -0.468187153 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9728.10524 0.517967582 -0.762666047 EXIT FROM BFGS code NEW_X -9728.10524 0.517967582 -0.762666047 ENTER BFGS code NEW_X -9728.10524 0.517967582 -0.762666047 EXIT FROM BFGS code FG_LNSRCH 0. 0.519807577 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.465614289 *** contribution from regularisation: 0.00712313317 *** contribution from error: -0.472737432 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9824.46151 0.519807577 -6.86673164 EXIT FROM BFGS code NEW_X -9824.46151 0.519807577 -6.86673164 ENTER BFGS code NEW_X -9824.46151 0.519807577 -6.86673164 EXIT FROM BFGS code FG_LNSRCH 0. 0.515844405 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.466110498 *** contribution from regularisation: 0.00716252206 *** contribution from error: -0.473273009 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9834.93123 0.515844405 -10.1662436 EXIT FROM BFGS code NEW_X -9834.93123 0.515844405 -10.1662436 ENTER BFGS code NEW_X -9834.93123 0.515844405 -10.1662436 EXIT FROM BFGS code FG_LNSRCH 0. 0.500264585 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.466391176 *** contribution from regularisation: 0.00710963085 *** contribution from error: -0.473500818 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9840.85369 0.500264585 -11.5421705 EXIT FROM BFGS code NEW_X -9840.85369 0.500264585 -11.5421705 ENTER BFGS code NEW_X -9840.85369 0.500264585 -11.5421705 EXIT FROM BFGS code FG_LNSRCH 0. 0.476751208 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.466751575 *** contribution from regularisation: 0.00686770631 *** contribution from error: -0.473619282 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9848.45793 0.476751208 -9.91418648 EXIT FROM BFGS code NEW_X -9848.45793 0.476751208 -9.91418648 ENTER BFGS code NEW_X -9848.45793 0.476751208 -9.91418648 EXIT FROM BFGS code FG_LNSRCH 0. 0.28785935 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.468478501 *** contribution from regularisation: 0.00504691107 *** contribution from error: -0.473525405 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9884.89653 0.28785935 -8.13215351 EXIT FROM BFGS code NEW_X -9884.89653 0.28785935 -8.13215351 ENTER BFGS code NEW_X -9884.89653 0.28785935 -8.13215351 EXIT FROM BFGS code FG_LNSRCH 0. 0.0890496448 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 15.6817083 sigma out 15 active outputs RANK 2 NODE 3 --> 13.0957499 sigma out 15 active outputs RANK 3 NODE 1 --> 10.8543177 sigma out 15 active outputs RANK 4 NODE 7 --> 8.90533066 sigma out 15 active outputs RANK 5 NODE 2 --> 7.19754219 sigma out 15 active outputs RANK 6 NODE 6 --> 5.19513798 sigma out 15 active outputs RANK 7 NODE 4 --> 4.48051643 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 13.1452942 sigma in 7act. ( 11.0186653 sig out 1act.) RANK 2 NODE 5 --> 10.9484797 sigma in 7act. ( 9.19863605 sig out 1act.) RANK 3 NODE 11 --> 10.1426001 sigma in 7act. ( 10.521884 sig out 1act.) RANK 4 NODE 6 --> 9.40751362 sigma in 7act. ( 8.73799515 sig out 1act.) RANK 5 NODE 15 --> 7.35998821 sigma in 7act. ( 6.23019314 sig out 1act.) RANK 6 NODE 12 --> 7.01037216 sigma in 7act. ( 6.55570364 sig out 1act.) RANK 7 NODE 9 --> 6.3353281 sigma in 7act. ( 5.74756956 sig out 1act.) RANK 8 NODE 3 --> 5.23030901 sigma in 7act. ( 4.51930189 sig out 1act.) RANK 9 NODE 4 --> 3.99009609 sigma in 7act. ( 3.3250134 sig out 1act.) RANK 10 NODE 8 --> 3.70787406 sigma in 7act. ( 2.45908642 sig out 1act.) RANK 11 NODE 14 --> 3.5949657 sigma in 7act. ( 1.53035939 sig out 1act.) RANK 12 NODE 7 --> 2.67036629 sigma in 7act. ( 1.9792701 sig out 1act.) RANK 13 NODE 2 --> 2.03576732 sigma in 7act. ( 1.17009759 sig out 1act.) RANK 14 NODE 10 --> 1.59979606 sigma in 7act. ( 0.500966132 sig out 1act.) RANK 15 NODE 13 --> 1.45892954 sigma in 7act. ( 0.439287126 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 11.0186653 sigma out 1act.( 13.1452942 sig in 7act.) RANK 2 NODE 11 --> 10.521884 sigma out 1act.( 10.1426001 sig in 7act.) RANK 3 NODE 5 --> 9.19863605 sigma out 1act.( 10.9484797 sig in 7act.) RANK 4 NODE 6 --> 8.73799515 sigma out 1act.( 9.40751362 sig in 7act.) RANK 5 NODE 12 --> 6.55570364 sigma out 1act.( 7.01037216 sig in 7act.) RANK 6 NODE 15 --> 6.23019314 sigma out 1act.( 7.35998821 sig in 7act.) RANK 7 NODE 9 --> 5.74756956 sigma out 1act.( 6.3353281 sig in 7act.) RANK 8 NODE 3 --> 4.51930189 sigma out 1act.( 5.23030901 sig in 7act.) RANK 9 NODE 4 --> 3.3250134 sigma out 1act.( 3.99009609 sig in 7act.) RANK 10 NODE 8 --> 2.45908642 sigma out 1act.( 3.70787406 sig in 7act.) RANK 11 NODE 7 --> 1.9792701 sigma out 1act.( 2.67036629 sig in 7act.) RANK 12 NODE 14 --> 1.53035939 sigma out 1act.( 3.5949657 sig in 7act.) RANK 13 NODE 2 --> 1.17009759 sigma out 1act.( 2.03576732 sig in 7act.) RANK 14 NODE 10 --> 0.500966132 sigma out 1act.( 1.59979606 sig in 7act.) RANK 15 NODE 13 --> 0.439287126 sigma out 1act.( 1.45892954 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 23.5269032 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.467692852 *** contribution from regularisation: 0.00600217283 *** contribution from error: -0.47369504 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -9868.31893 0.0890496448 -10.1699247 EXIT FROM BFGS code FG_LNSRCH 0. 0.231592551 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.46661678 *** contribution from regularisation: 0.00723582134 *** contribution from error: -0.473852605 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9845.61431 0.231592551 -7.06595087 EXIT FROM BFGS code FG_LNSRCH 0. 0.28399682 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.466986418 *** contribution from regularisation: 0.00656561693 *** contribution from error: -0.473552048 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9853.41369 0.28399682 -7.47743464 EXIT FROM BFGS code FG_LNSRCH 0. 0.287828714 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.466996998 *** contribution from regularisation: 0.00652870722 *** contribution from error: -0.473525703 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9853.63669 0.287828714 -7.62541056 EXIT FROM BFGS code FG_LNSRCH 0. 0.28785935 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.466975212 *** contribution from regularisation: 0.00655021705 *** contribution from error: -0.473525435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9853.17678 0.28785935 -7.53044367 EXIT FROM BFGS code FG_LNSRCH 0. 0.28785935 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.467067033 *** contribution from regularisation: 0.00645839656 *** contribution from error: -0.473525435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9855.11419 0.28785935 -7.59007168 EXIT FROM BFGS code FG_LNSRCH 0. 0.28785935 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.467006087 *** contribution from regularisation: 0.00651932834 *** contribution from error: -0.473525405 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9853.82853 0.28785935 -7.55160809 EXIT FROM BFGS code FG_LNSRCH 0. 0.28785935 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.467017978 *** contribution from regularisation: 0.00650745537 *** contribution from error: -0.473525435 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -9854.07905 0.28785935 -7.57451868 EXIT FROM BFGS code NEW_X -9854.07905 0.28785935 -7.57451868 ENTER BFGS code NEW_X -9854.07905 0.28785935 -7.57451868 EXIT FROM BFGS code CONVERGENC -9854.07905 0.28785935 -7.57451868 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 21.4593983 sigma out 15 active outputs RANK 2 NODE 1 --> 16.9910965 sigma out 15 active outputs RANK 3 NODE 3 --> 14.4527178 sigma out 15 active outputs RANK 4 NODE 2 --> 11.6595707 sigma out 15 active outputs RANK 5 NODE 7 --> 11.065196 sigma out 15 active outputs RANK 6 NODE 6 --> 8.18128967 sigma out 15 active outputs RANK 7 NODE 4 --> 8.04944038 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 1 --> 17.6605587 sigma in 7act. ( 14.9454079 sig out 1act.) RANK 2 NODE 6 --> 14.6640615 sigma in 7act. ( 13.4810629 sig out 1act.) RANK 3 NODE 11 --> 13.8230839 sigma in 7act. ( 12.8811369 sig out 1act.) RANK 4 NODE 5 --> 13.2765083 sigma in 7act. ( 11.7580528 sig out 1act.) RANK 5 NODE 12 --> 9.54657936 sigma in 7act. ( 8.02006721 sig out 1act.) RANK 6 NODE 15 --> 9.23914146 sigma in 7act. ( 7.79499722 sig out 1act.) RANK 7 NODE 9 --> 8.1739502 sigma in 7act. ( 6.90136337 sig out 1act.) RANK 8 NODE 3 --> 7.06036234 sigma in 7act. ( 6.7253623 sig out 1act.) RANK 9 NODE 4 --> 6.54490137 sigma in 7act. ( 5.88676786 sig out 1act.) RANK 10 NODE 8 --> 5.71593809 sigma in 7act. ( 4.4566412 sig out 1act.) RANK 11 NODE 7 --> 5.31283569 sigma in 7act. ( 4.33822012 sig out 1act.) RANK 12 NODE 14 --> 5.24305201 sigma in 7act. ( 4.02772856 sig out 1act.) RANK 13 NODE 2 --> 3.52891493 sigma in 7act. ( 0.0401998833 sig out 1act.) RANK 14 NODE 10 --> 3.28678846 sigma in 7act. ( 1.34568238 sig out 1act.) RANK 15 NODE 13 --> 2.50622272 sigma in 7act. ( 0.489283711 sig out 1act.) sorted by output significance RANK 1 NODE 1 --> 14.9454079 sigma out 1act.( 17.6605587 sig in 7act.) RANK 2 NODE 6 --> 13.4810629 sigma out 1act.( 14.6640615 sig in 7act.) RANK 3 NODE 11 --> 12.8811369 sigma out 1act.( 13.8230839 sig in 7act.) RANK 4 NODE 5 --> 11.7580528 sigma out 1act.( 13.2765083 sig in 7act.) RANK 5 NODE 12 --> 8.02006721 sigma out 1act.( 9.54657936 sig in 7act.) RANK 6 NODE 15 --> 7.79499722 sigma out 1act.( 9.23914146 sig in 7act.) RANK 7 NODE 9 --> 6.90136337 sigma out 1act.( 8.1739502 sig in 7act.) RANK 8 NODE 3 --> 6.7253623 sigma out 1act.( 7.06036234 sig in 7act.) RANK 9 NODE 4 --> 5.88676786 sigma out 1act.( 6.54490137 sig in 7act.) RANK 10 NODE 8 --> 4.4566412 sigma out 1act.( 5.71593809 sig in 7act.) RANK 11 NODE 7 --> 4.33822012 sigma out 1act.( 5.31283569 sig in 7act.) RANK 12 NODE 14 --> 4.02772856 sigma out 1act.( 5.24305201 sig in 7act.) RANK 13 NODE 10 --> 1.34568238 sigma out 1act.( 3.28678846 sig in 7act.) RANK 14 NODE 13 --> 0.489283711 sigma out 1act.( 2.50622272 sig in 7act.) RANK 15 NODE 2 --> 0.0401998833 sigma out 1act.( 3.52891493 sig in 7act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 31.9191608 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.467056334 *** contribution from regularisation: 0.00646908162 *** contribution from error: -0.473525405 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 24050 Closing output file done