NNInput NNInputs_155.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree Error in : error reading all requested bytes from file TMVAAna_out.root, got 228 of 300 Warning in : file TMVAAna_out.root has no keys Error in : Cannot find tree with name NNInput in file TMVAAna_out.root NNAna::CopyTree: entries= 46340 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 10137 nbkg = 36203 Bkg Entries: 36203 Sig Entries: 10137 Chosen entries: 10137 Signal fraction: 1 Background fraction: 0.280004 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 36203 Actual Signal Entries: 10137 Entries to split: 10137 Test with : 5068 Train with : 5068 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 10137 for Signal Prepared event 0 for Signal with 10137 events ====Entry 0 Variable Ht : 266.323 Variable LepAPt : 64.2176 Variable LepBPt : 58.0643 Variable MetSigLeptonsJets : 2.54404 Variable MetSpec : 36.171 Variable SumEtLeptonsJets : 227.916 Variable VSumJetLeptonsPt : 47.3654 Variable addEt : 160.689 Variable dPhiLepSumMet : 2.30851 Variable dPhiLeptons : 0.188909 Variable dRLeptons : 0.230155 Variable lep1_E : 71.5884 Variable lep2_E : 61.5172 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2155 Ht = 266.323 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 64.2176 LepAPt = 64.2176 LepBEt = 58.0643 LepBPt = 58.0643 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 38.4071 MetDelPhi = 1.22788 MetSig = 2.2508 MetSigLeptonsJets = 2.54404 MetSpec = 36.171 Mjj = 0 MostCentralJetEta = 0.570342 MtllMet = 163.453 Njets = 1 SB = 0 SumEt = 291.171 SumEtJets = 0 SumEtLeptonsJets = 227.916 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 47.3654 addEt = 160.689 dPhiLepSumMet = 2.30851 dPhiLeptons = 0.188909 dRLeptons = 0.230155 diltype = 45 dimass = 14.0433 event = 519 jet1_Et = 105.634 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 71.5884 lep2_E = 61.5172 rand = 0.999742 run = 236753 weight = 3.57235e-06 ===Show End Prepared event 10000 for Signal with 10137 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 36203 for Background Prepared event 0 for Background with 36203 events ====Entry 0 Variable Ht : 80.3296 Variable LepAPt : 25.5911 Variable LepBPt : 11.162 Variable MetSigLeptonsJets : 7.18795 Variable MetSpec : 43.5765 Variable SumEtLeptonsJets : 36.7531 Variable VSumJetLeptonsPt : 34.1227 Variable addEt : 80.3296 Variable dPhiLepSumMet : 2.89659 Variable dPhiLeptons : 0.831637 Variable dRLeptons : 0.924544 Variable lep1_E : 25.6567 Variable lep2_E : 12.448 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 80.3296 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 25.5911 LepAPt = 25.5911 LepBEt = 11.162 LepBPt = 11.162 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 43.5765 MetDelPhi = 2.65242 MetSig = 3.63746 MetSigLeptonsJets = 7.18795 MetSpec = 43.5765 Mjj = 0 MostCentralJetEta = 0 MtllMet = 81.3504 Njets = 0 SB = 0 SumEt = 143.519 SumEtJets = 0 SumEtLeptonsJets = 36.7531 Target = 0 TrainWeight = 0.336585 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 34.1227 addEt = 80.3296 dPhiLepSumMet = 2.89659 dPhiLeptons = 0.831637 dRLeptons = 0.924544 diltype = 45 dimass = 15.2865 event = 23115824 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 25.6567 lep2_E = 12.448 rand = 0.999742 run = 271104 weight = 0.00846748 ===Show End Prepared event 10000 for Background with 36203 events Prepared event 20000 for Background with 36203 events Prepared event 30000 for Background with 36203 events Warning: found 867 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 46340 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 867 negative weights. Signal fraction: 62.1452103 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 56.0109749 62.7646255 64.9286346 66.3395844 67.6327209 68.7044373 69.852684 70.7065964 71.4265289 72.075531 72.8839569 73.4512634 74.0147247 74.5927887 75.1282654 75.6854706 76.3221207 76.9012909 77.3892593 77.8665771 78.3252869 78.7454681 79.2358551 79.5993576 80.1254578 80.6860886 81.2295303 81.8435593 82.4896545 83.3488007 84.3314133 85.4675293 86.4222717 87.2951965 88.4942551 89.7702179 91.308075 92.8936386 94.4704437 96.0485458 97.3645477 99.0149689 100.660904 102.257568 103.842056 104.993973 106.733215 108.310081 110.061302 111.964737 113.617058 115.39595 116.771042 118.721573 120.219025 121.517113 123.026917 124.512329 126.166298 127.676033 129.423431 131.073654 132.841507 133.963196 135.369934 136.911346 138.337738 139.808838 141.342773 143.019073 144.378067 145.747955 147.232819 148.930237 150.787445 152.231705 153.751129 155.721237 157.454498 159.831329 161.847687 164.457016 167.137543 169.923431 172.219437 175.2677 178.077393 181.394974 184.735962 188.420425 191.942749 196.411072 201.519653 207.645691 213.463806 221.045563 231.11673 246.295197 265.373566 305.208496 622.971191 ------------------------------ Transdef: Tab for variable 3 20.0002766 20.2892609 20.5824089 20.8152161 21.0782146 21.3756104 21.5695076 21.7959652 22.0071659 22.1898117 22.3879051 22.6166077 22.8351517 23.0171127 23.2089424 23.4108086 23.6111794 23.780201 23.9463539 24.114275 24.3476677 24.5144081 24.7025299 24.8473873 25.0162945 25.2124977 25.4093056 25.5912552 25.7381859 25.9123154 26.0968761 26.2828465 26.5057373 26.7577534 26.9695206 27.2026825 27.3893642 27.6357193 27.8709965 28.0561333 28.2456722 28.4532204 28.7069263 28.9763508 29.1738319 29.3937569 29.6240978 29.7967663 30.0160484 30.2759285 30.5358658 30.8255081 31.0653496 31.2808857 31.5524712 31.8075447 32.0578232 32.3449173 32.6579666 32.963028 33.3105316 33.559742 33.8411179 34.2058029 34.51371 34.7916489 35.0920563 35.3900375 35.7307129 36.0083847 36.3369675 36.70784 37.0166321 37.3678513 37.8467369 38.2082214 38.6045914 38.9599609 39.3778 39.7810898 40.2309418 40.7117996 41.1556015 41.5557251 42.0067673 42.5524635 43.1907196 43.7668762 44.3680344 45.1939545 45.9023056 46.8391724 47.8934669 49.0609169 50.452858 52.2525177 54.0222855 56.2181396 60.0996552 66.4024048 151.031479 ------------------------------ Transdef: Tab for variable 4 10.0014067 10.099062 10.2040558 10.2869186 10.3719501 10.468833 10.5933819 10.7170315 10.8283854 10.937974 11.0474491 11.1815205 11.3022614 11.3911171 11.5370998 11.6878452 11.7923069 11.9397678 12.0627766 12.2181263 12.3797445 12.532938 12.657567 12.7642479 12.959384 13.1038933 13.2185211 13.3532715 13.5181608 13.6504879 13.8223257 13.9580917 14.1713715 14.3120756 14.4770575 14.6333494 14.8526173 15.0548992 15.2282867 15.4059839 15.5834751 15.7562141 15.9446049 16.0952911 16.3038483 16.4766064 16.7245388 16.900074 17.1289711 17.331995 17.5830822 17.7927322 18.0317497 18.2576599 18.485405 18.7357025 19.0271111 19.3002548 19.5930862 19.844038 20.1155281 20.4487095 20.7557125 21.0583935 21.378643 21.7226524 21.9966774 22.3327789 22.6956043 23.0650864 23.3720245 23.7218838 24.0638885 24.352211 24.6864738 25.0271339 25.4595165 25.8587418 26.1578541 26.5781593 27.0394974 27.4740829 27.9229755 28.2863884 28.6739349 29.1469059 29.633688 30.0956154 30.6024094 31.0613632 31.5669136 32.0840302 32.6808739 33.3971481 34.2157516 35.1310043 36.0131836 37.3310089 39.7082481 44.3146286 67.3520279 ------------------------------ Transdef: Tab for variable 5 1.86576259 2.98843145 3.32748437 3.62241793 3.87055612 4.04748535 4.18187523 4.3341465 4.44159317 4.53921509 4.64339256 4.74411726 4.84110641 4.91561556 4.98955011 5.06177616 5.1318469 5.20296669 5.27140808 5.34189129 5.40018368 5.44829988 5.49111176 5.54624128 5.59110832 5.63599205 5.67246389 5.71224022 5.76819372 5.80594826 5.84361362 5.89274406 5.93018627 5.97352934 6.01725578 6.05561733 6.08692932 6.12767267 6.17696762 6.21507835 6.257617 6.29697418 6.32866764 6.36642742 6.40500641 6.45006847 6.4887886 6.53241634 6.56970406 6.61083794 6.65696144 6.70217419 6.74469852 6.78205585 6.8274641 6.87646008 6.93489647 6.98814583 7.04591846 7.09953308 7.14328384 7.19235849 7.26107168 7.30495739 7.36349726 7.42743111 7.47349834 7.53210258 7.59627438 7.65661049 7.71741104 7.76927471 7.83582401 7.90573406 7.96900177 8.02288437 8.09121037 8.15023804 8.22159195 8.28042412 8.35424423 8.41226387 8.47486305 8.55208111 8.63326645 8.71007252 8.78933334 8.86619759 8.95831299 9.06632042 9.16870499 9.29458427 9.41186142 9.53252125 9.69948101 9.8993063 10.1192722 10.4569702 10.8807659 11.563448 15.4213867 ------------------------------ Transdef: Tab for variable 6 25.000145 25.8972435 26.815197 27.51754 28.4258423 29.2566452 29.9952259 30.6201477 31.2305641 31.7404556 32.3257332 32.864212 33.1927376 33.6006203 34.1016388 34.580719 34.9178123 35.2708549 35.6238403 35.9836807 36.3207397 36.6268806 36.9682808 37.2581024 37.5207634 37.7991295 38.0765648 38.3862305 38.8195724 39.1324615 39.3767319 39.5430984 39.9272232 40.2759094 40.6623535 41.0467529 41.3928986 41.7576675 42.2323151 42.5873566 43.04142 43.4305267 43.8814468 44.2915268 44.8999786 45.595787 46.2101059 46.828331 47.3988876 48.1712112 48.8548813 49.4073257 50.3239784 51.0245934 51.8001938 52.4912186 53.339653 53.9981689 54.8401108 55.6258698 56.5839119 57.2755089 57.9304008 58.7288589 59.5604095 60.2465897 61.2201309 61.9292679 62.6711578 63.5066452 64.3847198 65.2648926 65.9927063 66.7155762 67.3507843 68.0227509 68.7639618 69.4382782 70.3441238 71.0273438 71.9477539 72.7378845 73.590271 74.4348602 75.4343109 76.5741577 77.5837555 78.5277557 79.5765076 80.8662567 82.2395477 83.7727966 85.8013535 87.6048584 89.9187012 93.0829926 96.3232117 100.985703 108.683182 119.791916 197.808899 ------------------------------ Transdef: Tab for variable 7 30.1895332 32.5536995 33.4322662 34.1285095 34.6931992 35.2225037 35.6612816 36.0767059 36.4232712 36.7018661 37.0081673 37.2738266 37.5749207 37.8809814 38.1893768 38.3914642 38.6620636 38.9152946 39.1689644 39.3479767 39.5552711 39.7934303 40.1551056 40.4755325 40.8105011 41.0835037 41.3499222 41.6203156 41.9295273 42.2972565 42.7528343 43.2935944 43.7524185 44.42836 45.1233826 45.7941971 46.581646 47.3592262 48.1179047 48.8873901 49.9631767 51.0597229 52.1096954 52.9211044 53.8253479 54.9778061 55.7860413 56.6456223 57.5119743 58.3525925 59.3022995 60.0381317 60.8752937 61.5553055 62.5164948 63.366024 64.0541763 64.818985 65.7304001 66.7083282 67.6177368 68.4213791 69.1607513 70.109787 70.9960556 71.894455 72.9692764 73.8927917 74.7694855 75.6058731 76.6051636 77.8413849 78.8705597 80.4397125 81.7136841 83.0454025 84.8223343 86.284523 87.8159332 89.2970734 91.4037933 93.4558182 95.4156265 97.5399475 99.590744 102.323746 104.511765 107.086426 110.368843 112.995506 116.160767 119.811584 123.883774 128.019318 134.47171 141.358139 149.448425 160.363647 178.083649 208.381012 368.838348 ------------------------------ Transdef: Tab for variable 8 2.8272841 26.8383121 29.9110069 31.3881683 32.017765 32.7218628 33.2893181 33.8314743 34.3634682 34.6624336 35.0041313 35.2603302 35.5701714 35.9122429 36.1387253 36.4358139 36.6321869 36.9240112 37.238308 37.4767609 37.6091461 37.8076019 38.0826035 38.223465 38.4682465 38.6775131 38.9516945 39.1964188 39.4830437 39.78545 40.0324974 40.2517281 40.530571 40.831562 41.1115837 41.3738327 41.7273216 42.0816345 42.5071449 43.0098801 43.4464417 43.8993301 44.4371262 44.9366989 45.5698624 46.0382385 46.5444794 47.0802002 47.646862 48.3471413 49.0240746 49.7113266 50.4363594 51.1255112 51.8299484 52.4894753 53.1422691 53.9965134 54.6837349 55.2496147 55.9476089 56.6349716 57.2445145 58.0279922 58.7451019 59.4007797 60.0582809 60.8714371 61.5101433 62.3167191 62.9243011 63.4259071 64.119812 64.8529053 65.6280441 66.387146 67.2284546 67.9685211 68.7167511 69.3993988 70.1185532 70.9566193 71.7983246 72.7668915 73.6335297 74.5066376 75.3028107 76.408844 77.3149109 78.5269928 80.2884827 81.7980652 83.5434341 85.8749924 88.4284363 91.7605286 95.760849 100.52771 108.083435 120.725922 238.935455 ------------------------------ Transdef: Tab for variable 9 56.0109749 62.540905 64.5198898 65.803093 67.0916138 68.0562668 69.0029907 70.1011276 70.7276917 71.3930817 71.9832077 72.6494522 73.1964035 73.7832642 74.2619171 74.8214111 75.3217239 75.7587891 76.3086472 76.837265 77.2647095 77.646225 78.0693207 78.457222 78.876976 79.2941208 79.6285934 80.1168289 80.5591888 81.0421524 81.5832825 82.1674805 82.6115036 83.4722443 84.2808075 84.9665527 85.8876038 86.6028137 87.3459549 88.4282837 89.4880066 90.5306396 91.7504272 92.927803 94.2472153 95.6208801 96.9935303 98.3914948 99.640625 101.378036 102.636887 104.02372 105.147865 106.558212 107.915298 109.29557 110.688095 112.09391 113.136955 114.590645 116.008606 116.989189 118.276001 119.57312 120.8367 122.019608 123.077988 124.164001 125.562759 126.650932 127.839783 129.215729 130.362869 131.723801 132.957855 134.132782 135.182739 136.26767 137.357773 138.544952 139.928864 141.210678 142.347198 143.481689 144.55954 145.564224 146.761871 148.177261 149.684357 151.15152 152.70993 154.272766 155.845337 157.377686 159.281616 161.534088 163.908997 168.148605 175.420837 191.636993 344.857483 ------------------------------ Transdef: Tab for variable 10 0.350774139 1.15491736 1.45734119 1.65606761 1.8274852 1.94347739 2.02483845 2.10939264 2.18868566 2.24198484 2.2908411 2.33792639 2.38058996 2.42557907 2.46593475 2.50303364 2.53185725 2.5605979 2.58188915 2.60835505 2.63547897 2.65861416 2.68650723 2.70981359 2.73254657 2.74923277 2.76336217 2.77723742 2.78938961 2.8051033 2.81748104 2.82870245 2.83999205 2.85168695 2.86423349 2.87683964 2.88815784 2.89792395 2.90691328 2.91362715 2.91963816 2.92762089 2.93500566 2.94092941 2.94726372 2.95474434 2.9607296 2.96588707 2.97192621 2.97833109 2.98335814 2.9879272 2.99223518 2.99686575 3.00261116 3.00775838 3.01177835 3.0166688 3.02125168 3.02474737 3.02921534 3.03363228 3.03702784 3.04056454 3.04412937 3.0477953 3.05139613 3.05480981 3.0581243 3.06144404 3.0646987 3.06782532 3.07109928 3.0741291 3.07620335 3.07904482 3.08222246 3.08560038 3.08821106 3.09151101 3.09395313 3.09675598 3.09959936 3.10156202 3.10419607 3.10656929 3.10941887 3.11194181 3.11479044 3.1167016 3.11831474 3.12088108 3.12311053 3.12553453 3.12776041 3.12989616 3.13259649 3.13498664 3.13721681 3.13914919 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.19226625E-05 0.00643756893 0.011607565 0.0176041201 0.0232049227 0.0295494758 0.0358696282 0.0440518856 0.05057263 0.0582756996 0.0645253658 0.0708614215 0.0779634714 0.085778594 0.0921474993 0.100697488 0.108617604 0.114250049 0.122177139 0.12961632 0.137994885 0.145924494 0.15286386 0.15968132 0.166247606 0.173735976 0.180942059 0.188661933 0.194706917 0.200574875 0.205614507 0.210656568 0.21511662 0.220055997 0.224950194 0.229084969 0.235164642 0.240054846 0.243997693 0.247931242 0.2527349 0.257724643 0.261720181 0.267940879 0.273073435 0.279453456 0.284177542 0.290183067 0.296013236 0.300862074 0.304998219 0.311041981 0.317255735 0.322870255 0.328552902 0.3340168 0.33974725 0.345110595 0.350681067 0.356840193 0.362610221 0.368889689 0.375390023 0.382268876 0.388643384 0.394547105 0.400307417 0.406680167 0.414451599 0.42100966 0.427306294 0.433647633 0.44009304 0.447446704 0.452622414 0.459504724 0.466107965 0.474334717 0.48079139 0.490759313 0.49914515 0.507172823 0.516116619 0.523929656 0.533489823 0.546589553 0.556979179 0.565712512 0.579464078 0.592149854 0.60478878 0.622333169 0.636119723 0.651854992 0.672757804 0.694858611 0.71404171 0.736454487 0.78713721 0.843251824 1.08431578 ------------------------------ Transdef: Tab for variable 12 0.200196758 0.21044971 0.216894597 0.223201752 0.231727093 0.239607245 0.247044474 0.254684985 0.260417283 0.266517222 0.27339071 0.278631538 0.284902364 0.290839732 0.296886951 0.302515686 0.308725357 0.314690292 0.320459425 0.327849746 0.333860517 0.339652359 0.345279783 0.350044221 0.354068577 0.360200912 0.364682883 0.370619178 0.375762701 0.381149918 0.386694431 0.391947865 0.396244168 0.4012582 0.406315506 0.410766631 0.414235055 0.418545485 0.42269218 0.426630855 0.431365848 0.434936941 0.439277112 0.442841709 0.447359532 0.451209307 0.455670118 0.458628654 0.462889254 0.466293126 0.470212817 0.474175423 0.47812742 0.481970131 0.486608505 0.49025169 0.49474147 0.498912513 0.503731012 0.509061933 0.513336957 0.518009186 0.52287966 0.527138293 0.53234446 0.537622213 0.543910444 0.54787147 0.55305779 0.5595963 0.565559566 0.571360171 0.576594114 0.581557035 0.58706975 0.593989491 0.600881815 0.607295156 0.614213467 0.621726811 0.628924787 0.637494922 0.64575398 0.652783513 0.661228001 0.669403076 0.677492559 0.68794024 0.697837353 0.709290624 0.720092475 0.731043696 0.743720412 0.757584691 0.774122953 0.792625904 0.813380361 0.833439887 0.860724449 0.899708867 1.13498271 ------------------------------ Transdef: Tab for variable 13 20.0293255 21.494442 22.445549 23.0389786 23.6951122 24.2488861 24.8549004 25.2554588 25.7985649 26.2249985 26.7099876 27.1046505 27.5698566 27.9895172 28.3790169 28.8238277 29.1694794 29.4892807 29.8214836 30.1164761 30.4990158 30.7919197 31.236063 31.6378422 31.9289474 32.303093 32.583847 32.9860077 33.3483658 33.7033615 34.018158 34.3546982 34.7427521 35.0994415 35.4820023 35.7766037 36.0881958 36.418354 36.8569412 37.2234039 37.522583 37.8707733 38.2045898 38.50177 38.8702011 39.3102722 39.771286 40.1774368 40.5288315 41.0483017 41.4873543 41.9260674 42.31007 42.8653603 43.3319931 43.6655273 44.068264 44.4913635 44.981102 45.3932915 45.8703232 46.3488846 46.83498 47.4197884 47.9699173 48.4417953 49.0135345 49.4993134 50.0745163 50.7444 51.2433167 51.9187927 52.4730301 53.0930252 53.8378754 54.5567932 55.3969116 56.2252579 57.0186157 57.9317856 58.9112549 59.9923325 61.0071335 62.2062874 63.2233047 64.862442 66.4640503 67.8529205 69.3366089 70.7872467 73.0253983 74.545578 76.5872955 78.570549 81.2417908 84.5832748 87.7522583 93.4679413 99.2655716 109.037659 225.703049 ------------------------------ Transdef: Tab for variable 14 10.0302553 10.50634 10.98176 11.3877354 11.6832504 12.1266289 12.5267925 12.8347874 13.2041702 13.504591 13.7937164 14.0737133 14.3166513 14.6299934 14.9579926 15.2456112 15.5178566 15.7947674 16.1104202 16.3902512 16.7202377 16.9999733 17.3088551 17.578434 17.830265 18.0989742 18.4375172 18.6930332 19.0242691 19.2845612 19.6386223 19.9729748 20.2940197 20.6076679 20.9073391 21.2168198 21.4919071 21.7717628 22.0497208 22.3787117 22.7159805 22.9949646 23.3478317 23.7062798 24.0393944 24.3960514 24.6624832 25.0185356 25.3672504 25.7031136 25.9555168 26.3006554 26.6172237 26.9632492 27.2708321 27.6083031 27.9377384 28.261652 28.6032982 28.9722252 29.3126297 29.6424713 30.0156345 30.3589478 30.7358627 31.14855 31.4791603 31.8412933 32.1826935 32.5904427 32.9426918 33.3546143 33.6868172 34.1872025 34.5776443 35.0488586 35.5158119 35.9978104 36.4885941 37.0664291 37.507103 38.0096817 38.6515961 39.0836525 39.7372513 40.4214401 41.0472145 41.8290024 42.9212952 43.9577103 44.8668213 46.3169975 47.3699875 48.8504257 50.5786972 53.2823753 55.3886757 58.8041382 63.4198608 69.3555069 139.444885 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.9 50.9 54.2 38.0 59.0 64.9 59.1 68.0 -27.0 -13.2 -26.3 4.5 16.8 2 68.9 100.0 64.7 60.7 40.0 75.9 94.2 77.1 92.3 -44.7 -20.2 -38.2 19.7 26.2 3 50.9 64.7 100.0 45.1 12.8 39.9 68.4 56.6 70.7 -14.8 -21.9 -43.1 52.1 19.2 4 54.2 60.7 45.1 100.0 23.0 44.9 60.7 55.7 68.2 -10.9 -24.9 -48.4 12.3 62.7 5 38.0 40.0 12.8 23.0 100.0 84.0 13.0 55.6 60.1 19.3 -7.6 -11.6 -8.1 4.8 6 59.0 75.9 39.9 44.9 84.0 100.0 55.6 78.7 85.0 -11.0 -15.3 -26.5 4.7 16.5 7 64.9 94.2 68.4 60.7 13.0 55.6 100.0 71.1 81.2 -52.1 -18.5 -37.5 25.6 28.7 8 59.1 77.1 56.6 55.7 55.6 78.7 71.1 100.0 83.6 -13.3 -21.4 -36.1 17.8 26.0 9 68.0 92.3 70.7 68.2 60.1 85.0 81.2 83.6 100.0 -21.8 -23.0 -43.9 23.8 32.1 10 -27.0 -44.7 -14.8 -10.9 19.3 -11.0 -52.1 -13.3 -21.8 100.0 3.3 6.0 -1.9 -1.3 11 -13.2 -20.2 -21.9 -24.9 -7.6 -15.3 -18.5 -21.4 -23.0 3.3 100.0 54.4 1.6 -6.6 12 -26.3 -38.2 -43.1 -48.4 -11.6 -26.5 -37.5 -36.1 -43.9 6.0 54.4 100.0 -5.8 -15.5 13 4.5 19.7 52.1 12.3 -8.1 4.7 25.6 17.8 23.8 -1.9 1.6 -5.8 100.0 53.5 14 16.8 26.2 19.2 62.7 4.8 16.5 28.7 26.0 32.1 -1.3 -6.6 -15.5 53.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 171.539555 TOTAL CORRELATION OF ALL VARIABLES 76.3801149 ROUND 1: MAX CORR ( 76.3722527) AFTER KILLING INPUT VARIABLE 8 CONTR 1.09589115 ROUND 2: MAX CORR ( 76.362632) AFTER KILLING INPUT VARIABLE 11 CONTR 1.21219239 ROUND 3: MAX CORR ( 76.3333125) AFTER KILLING INPUT VARIABLE 6 CONTR 2.11588745 ROUND 4: MAX CORR ( 76.2733742) AFTER KILLING INPUT VARIABLE 14 CONTR 3.02439684 ROUND 5: MAX CORR ( 76.1155499) AFTER KILLING INPUT VARIABLE 2 CONTR 4.90414906 ROUND 6: MAX CORR ( 75.7610475) AFTER KILLING INPUT VARIABLE 10 CONTR 7.33761611 ROUND 7: MAX CORR ( 75.312463) AFTER KILLING INPUT VARIABLE 12 CONTR 8.23220732 ROUND 8: MAX CORR ( 74.2625109) AFTER KILLING INPUT VARIABLE 9 CONTR 12.5318219 ROUND 9: MAX CORR ( 73.2647432) AFTER KILLING INPUT VARIABLE 4 CONTR 12.1325155 ROUND 10: MAX CORR ( 71.9778482) AFTER KILLING INPUT VARIABLE 3 CONTR 13.671575 ROUND 11: MAX CORR ( 71.4011939) AFTER KILLING INPUT VARIABLE 13 CONTR 9.09286222 ROUND 12: MAX CORR ( 64.8891401) AFTER KILLING INPUT VARIABLE 5 CONTR 29.7914415 LAST REMAINING VARIABLE: 7 total correlation to target: 76.3801149 % total significance: 68.9686822 sigma correlations of single variables to target: variable 2: 68.9347947 % , in sigma: 62.2458077 variable 3: 50.8604816 % , in sigma: 45.9253092 variable 4: 54.2494161 % , in sigma: 48.9854033 variable 5: 37.9921517 % , in sigma: 34.3056389 variable 6: 58.9520096 % , in sigma: 53.2316876 variable 7: 64.8891401 % , in sigma: 58.5927173 variable 8: 59.1148845 % , in sigma: 53.3787581 variable 9: 67.9733134 % , in sigma: 61.3776224 variable 10: -26.9931298 % , in sigma: 24.3738909 variable 11: -13.2291062 % , in sigma: 11.9454392 variable 12: -26.3146726 % , in sigma: 23.7612668 variable 13: 4.46236727 % , in sigma: 4.02936799 variable 14: 16.8442226 % , in sigma: 15.2097681 variables sorted by significance: 1 most relevant variable 7 corr 64.8891373 , in sigma: 58.5927148 2 most relevant variable 5 corr 29.791441 , in sigma: 26.9006721 3 most relevant variable 13 corr 9.09286213 , in sigma: 8.21054956 4 most relevant variable 3 corr 13.6715746 , in sigma: 12.3449734 5 most relevant variable 4 corr 12.1325159 , in sigma: 10.955255 6 most relevant variable 9 corr 12.5318222 , in sigma: 11.3158152 7 most relevant variable 12 corr 8.2322073 , in sigma: 7.43340711 8 most relevant variable 10 corr 7.33761597 , in sigma: 6.62562114 9 most relevant variable 2 corr 4.90414906 , in sigma: 4.42828213 10 most relevant variable 14 corr 3.0243969 , in sigma: 2.73092897 11 most relevant variable 6 corr 2.1158874 , in sigma: 1.91057536 12 most relevant variable 11 corr 1.21219242 , in sigma: 1.0945691 13 most relevant variable 8 corr 1.09589112 , in sigma: 0.989552927 global correlations between input variables: variable 2: 99.1798719 % variable 3: 91.6601581 % variable 4: 91.1448783 % variable 5: 95.4301378 % variable 6: 96.3415792 % variable 7: 98.7048849 % variable 8: 89.6709944 % variable 9: 98.771072 % variable 10: 70.3708196 % variable 11: 55.427356 % variable 12: 69.4380334 % variable 13: 85.4683429 % variable 14: 87.9118756 % significance loss when removing single variables: variable 2: corr = 3.47704313 % , sigma = 3.13965334 variable 3: corr = 17.0365478 % , sigma = 15.3834313 variable 4: corr = 16.6718127 % , sigma = 15.0540878 variable 5: corr = 14.4843584 % , sigma = 13.0788899 variable 6: corr = 2.37478046 % , sigma = 2.14434711 variable 7: corr = 6.85448834 % , sigma = 6.18937309 variable 8: corr = 1.09589115 % , sigma = 0.989552955 variable 9: corr = 11.9021478 % , sigma = 10.7472403 variable 10: corr = 5.75353093 % , sigma = 5.19524548 variable 11: corr = 1.11705673 % , sigma = 1.00866477 variable 12: corr = 7.03021016 % , sigma = 6.348044 variable 13: corr = 6.86632358 % , sigma = 6.20005991 variable 14: corr = 2.98417801 % , sigma = 2.69461266 Keep only 9 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 10 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 8.85166454 sigma out 15 active outputs RANK 2 NODE 3 --> 8.77637577 sigma out 15 active outputs RANK 3 NODE 7 --> 8.68738556 sigma out 15 active outputs RANK 4 NODE 9 --> 6.39599657 sigma out 15 active outputs RANK 5 NODE 6 --> 6.33945227 sigma out 15 active outputs RANK 6 NODE 2 --> 6.33756495 sigma out 15 active outputs RANK 7 NODE 4 --> 6.14258385 sigma out 15 active outputs RANK 8 NODE 1 --> 6.07320309 sigma out 15 active outputs RANK 9 NODE 8 --> 5.5019846 sigma out 15 active outputs RANK 10 NODE 5 --> 5.14860487 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 11.9742155 sigma in 10act. ( 11.9921408 sig out 1act.) RANK 2 NODE 7 --> 10.2704649 sigma in 10act. ( 11.4495487 sig out 1act.) RANK 3 NODE 11 --> 9.42955303 sigma in 10act. ( 9.50446987 sig out 1act.) RANK 4 NODE 8 --> 8.70720768 sigma in 10act. ( 8.72569275 sig out 1act.) RANK 5 NODE 14 --> 3.98768854 sigma in 10act. ( 3.87342405 sig out 1act.) RANK 6 NODE 15 --> 3.38495231 sigma in 10act. ( 3.72676682 sig out 1act.) RANK 7 NODE 13 --> 2.87583899 sigma in 10act. ( 2.96688414 sig out 1act.) RANK 8 NODE 5 --> 2.74626994 sigma in 10act. ( 2.64776182 sig out 1act.) RANK 9 NODE 1 --> 2.57265592 sigma in 10act. ( 1.96639442 sig out 1act.) RANK 10 NODE 9 --> 2.26192212 sigma in 10act. ( 2.0311234 sig out 1act.) RANK 11 NODE 6 --> 2.0784657 sigma in 10act. ( 2.09581041 sig out 1act.) RANK 12 NODE 12 --> 1.70913005 sigma in 10act. ( 1.56138229 sig out 1act.) RANK 13 NODE 2 --> 1.69336355 sigma in 10act. ( 1.55521107 sig out 1act.) RANK 14 NODE 3 --> 1.56676412 sigma in 10act. ( 1.21664417 sig out 1act.) RANK 15 NODE 4 --> 1.56147337 sigma in 10act. ( 0.737291336 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 11.9921408 sigma out 1act.( 11.9742155 sig in 10act.) RANK 2 NODE 7 --> 11.4495487 sigma out 1act.( 10.2704649 sig in 10act.) RANK 3 NODE 11 --> 9.50446987 sigma out 1act.( 9.42955303 sig in 10act.) RANK 4 NODE 8 --> 8.72569275 sigma out 1act.( 8.70720768 sig in 10act.) RANK 5 NODE 14 --> 3.87342405 sigma out 1act.( 3.98768854 sig in 10act.) RANK 6 NODE 15 --> 3.72676682 sigma out 1act.( 3.38495231 sig in 10act.) RANK 7 NODE 13 --> 2.96688414 sigma out 1act.( 2.87583899 sig in 10act.) RANK 8 NODE 5 --> 2.64776182 sigma out 1act.( 2.74626994 sig in 10act.) RANK 9 NODE 6 --> 2.09581041 sigma out 1act.( 2.0784657 sig in 10act.) RANK 10 NODE 9 --> 2.0311234 sigma out 1act.( 2.26192212 sig in 10act.) RANK 11 NODE 1 --> 1.96639442 sigma out 1act.( 2.57265592 sig in 10act.) RANK 12 NODE 12 --> 1.56138229 sigma out 1act.( 1.70913005 sig in 10act.) RANK 13 NODE 2 --> 1.55521107 sigma out 1act.( 1.69336355 sig in 10act.) RANK 14 NODE 3 --> 1.21664417 sigma out 1act.( 1.56676412 sig in 10act.) RANK 15 NODE 4 --> 0.737291336 sigma out 1act.( 1.56147337 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 22.4799137 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 19.6227322 sigma out 15 active outputs RANK 2 NODE 10 --> 10.3846703 sigma out 15 active outputs RANK 3 NODE 7 --> 9.92219257 sigma out 15 active outputs RANK 4 NODE 3 --> 9.36096287 sigma out 15 active outputs RANK 5 NODE 9 --> 8.46284199 sigma out 15 active outputs RANK 6 NODE 6 --> 8.04225636 sigma out 15 active outputs RANK 7 NODE 1 --> 7.83648157 sigma out 15 active outputs RANK 8 NODE 8 --> 7.76279211 sigma out 15 active outputs RANK 9 NODE 5 --> 7.3817668 sigma out 15 active outputs RANK 10 NODE 4 --> 7.06334209 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 12.3765001 sigma in 10act. ( 11.9958239 sig out 1act.) RANK 2 NODE 8 --> 11.1715794 sigma in 10act. ( 8.12593174 sig out 1act.) RANK 3 NODE 7 --> 9.07165527 sigma in 10act. ( 9.18955612 sig out 1act.) RANK 4 NODE 11 --> 9.01222515 sigma in 10act. ( 8.13223362 sig out 1act.) RANK 5 NODE 3 --> 8.88959885 sigma in 10act. ( 3.12905216 sig out 1act.) RANK 6 NODE 5 --> 8.54833698 sigma in 10act. ( 3.98072052 sig out 1act.) RANK 7 NODE 2 --> 8.2796917 sigma in 10act. ( 2.89556074 sig out 1act.) RANK 8 NODE 14 --> 8.19933891 sigma in 10act. ( 4.88636923 sig out 1act.) RANK 9 NODE 9 --> 7.89032269 sigma in 10act. ( 3.0918715 sig out 1act.) RANK 10 NODE 6 --> 7.33524084 sigma in 10act. ( 3.66100669 sig out 1act.) RANK 11 NODE 15 --> 7.03156424 sigma in 10act. ( 4.83657408 sig out 1act.) RANK 12 NODE 1 --> 6.94731236 sigma in 10act. ( 2.74441862 sig out 1act.) RANK 13 NODE 13 --> 6.79147196 sigma in 10act. ( 5.20637512 sig out 1act.) RANK 14 NODE 12 --> 6.04127502 sigma in 10act. ( 2.70808291 sig out 1act.) RANK 15 NODE 4 --> 3.94336915 sigma in 10act. ( 0.475138605 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 11.9958239 sigma out 1act.( 12.3765001 sig in 10act.) RANK 2 NODE 7 --> 9.18955612 sigma out 1act.( 9.07165527 sig in 10act.) RANK 3 NODE 11 --> 8.13223362 sigma out 1act.( 9.01222515 sig in 10act.) RANK 4 NODE 8 --> 8.12593174 sigma out 1act.( 11.1715794 sig in 10act.) RANK 5 NODE 13 --> 5.20637512 sigma out 1act.( 6.79147196 sig in 10act.) RANK 6 NODE 14 --> 4.88636923 sigma out 1act.( 8.19933891 sig in 10act.) RANK 7 NODE 15 --> 4.83657408 sigma out 1act.( 7.03156424 sig in 10act.) RANK 8 NODE 5 --> 3.98072052 sigma out 1act.( 8.54833698 sig in 10act.) RANK 9 NODE 6 --> 3.66100669 sigma out 1act.( 7.33524084 sig in 10act.) RANK 10 NODE 3 --> 3.12905216 sigma out 1act.( 8.88959885 sig in 10act.) RANK 11 NODE 9 --> 3.0918715 sigma out 1act.( 7.89032269 sig in 10act.) RANK 12 NODE 2 --> 2.89556074 sigma out 1act.( 8.2796917 sig in 10act.) RANK 13 NODE 1 --> 2.74441862 sigma out 1act.( 6.94731236 sig in 10act.) RANK 14 NODE 12 --> 2.70808291 sigma out 1act.( 6.04127502 sig in 10act.) RANK 15 NODE 4 --> 0.475138605 sigma out 1act.( 3.94336915 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 22.5158253 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.445234716 *** contribution from regularisation: 0.0153273121 *** contribution from error: -0.460562021 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.526227057 *** contribution from regularisation: 0.00536009297 *** contribution from error: -0.531587124 *********************************************** -----------------> Test sample ENTER BFGS code START -12194.9979 0.438388497 0.0563099682 EXIT FROM BFGS code FG_START 0. 0.438388497 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.55050981 *** contribution from regularisation: 0.00528777391 *** contribution from error: -0.555797577 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -12755.3128 0.438388497 15.5396719 EXIT FROM BFGS code FG_LNSRCH 0. 0.451805592 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.582591593 *** contribution from regularisation: 0.00778673403 *** contribution from error: -0.590378344 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13498.6468 0.451805592 37.5171242 E: 5 *********************************************** *** Learn Path 5 *** loss function: -0.584539294 *** contribution from regularisation: 0.00808168389 *** contribution from error: -0.592620969 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13543.7761 0.48404628 19.2790279 EXIT FROM BFGS code NEW_X -13543.7761 0.48404628 19.2790279 ENTER BFGS code NEW_X -13543.7761 0.48404628 19.2790279 EXIT FROM BFGS code FG_LNSRCH 0. 0.532640338 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.58657968 *** contribution from regularisation: 0.0078763254 *** contribution from error: -0.594456017 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13591.0515 0.532640338 -1.05740631 EXIT FROM BFGS code NEW_X -13591.0515 0.532640338 -1.05740631 ENTER BFGS code NEW_X -13591.0515 0.532640338 -1.05740631 EXIT FROM BFGS code FG_LNSRCH 0. 0.564092934 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.586951256 *** contribution from regularisation: 0.00786022842 *** contribution from error: -0.594811499 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13599.6599 0.564092934 -18.5217285 EXIT FROM BFGS code NEW_X -13599.6599 0.564092934 -18.5217285 ENTER BFGS code NEW_X -13599.6599 0.564092934 -18.5217285 EXIT FROM BFGS code FG_LNSRCH 0. 0.543168187 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.587316096 *** contribution from regularisation: 0.00773060229 *** contribution from error: -0.595046699 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13608.1139 0.543168187 -13.7247267 EXIT FROM BFGS code NEW_X -13608.1139 0.543168187 -13.7247267 ENTER BFGS code NEW_X -13608.1139 0.543168187 -13.7247267 EXIT FROM BFGS code FG_LNSRCH 0. 0.38073808 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.586408436 *** contribution from regularisation: 0.00521073071 *** contribution from error: -0.591619194 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13587.0835 0.38073808 28.9330635 EXIT FROM BFGS code FG_LNSRCH 0. 0.494869143 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.0292873 sigma out 15 active outputs RANK 2 NODE 1 --> 11.5053749 sigma out 15 active outputs RANK 3 NODE 4 --> 8.54250526 sigma out 15 active outputs RANK 4 NODE 8 --> 6.87308502 sigma out 15 active outputs RANK 5 NODE 10 --> 6.60421038 sigma out 15 active outputs RANK 6 NODE 6 --> 5.98367357 sigma out 15 active outputs RANK 7 NODE 9 --> 5.89745617 sigma out 15 active outputs RANK 8 NODE 3 --> 5.87517023 sigma out 15 active outputs RANK 9 NODE 7 --> 5.58972025 sigma out 15 active outputs RANK 10 NODE 5 --> 5.23458672 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 11.32022 sigma in 10act. ( 6.20512009 sig out 1act.) RANK 2 NODE 9 --> 10.2114487 sigma in 10act. ( 6.04335499 sig out 1act.) RANK 3 NODE 5 --> 9.66400528 sigma in 10act. ( 5.51922131 sig out 1act.) RANK 4 NODE 6 --> 9.46988583 sigma in 10act. ( 6.12714291 sig out 1act.) RANK 5 NODE 3 --> 9.46965694 sigma in 10act. ( 5.31504583 sig out 1act.) RANK 6 NODE 13 --> 9.34214592 sigma in 10act. ( 5.12306261 sig out 1act.) RANK 7 NODE 14 --> 8.92924976 sigma in 10act. ( 5.69247007 sig out 1act.) RANK 8 NODE 1 --> 8.57135963 sigma in 10act. ( 5.47525644 sig out 1act.) RANK 9 NODE 12 --> 7.61595774 sigma in 10act. ( 4.10956335 sig out 1act.) RANK 10 NODE 15 --> 7.34457016 sigma in 10act. ( 4.20428133 sig out 1act.) RANK 11 NODE 8 --> 7.16877222 sigma in 10act. ( 3.45535254 sig out 1act.) RANK 12 NODE 10 --> 6.37832785 sigma in 10act. ( 3.40120482 sig out 1act.) RANK 13 NODE 11 --> 4.68276215 sigma in 10act. ( 2.3961277 sig out 1act.) RANK 14 NODE 7 --> 3.18455195 sigma in 10act. ( 0.747891784 sig out 1act.) RANK 15 NODE 4 --> 2.92689157 sigma in 10act. ( 0.494528145 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 6.20512009 sigma out 1act.( 11.32022 sig in 10act.) RANK 2 NODE 6 --> 6.12714291 sigma out 1act.( 9.46988583 sig in 10act.) RANK 3 NODE 9 --> 6.04335499 sigma out 1act.( 10.2114487 sig in 10act.) RANK 4 NODE 14 --> 5.69247007 sigma out 1act.( 8.92924976 sig in 10act.) RANK 5 NODE 5 --> 5.51922131 sigma out 1act.( 9.66400528 sig in 10act.) RANK 6 NODE 1 --> 5.47525644 sigma out 1act.( 8.57135963 sig in 10act.) RANK 7 NODE 3 --> 5.31504583 sigma out 1act.( 9.46965694 sig in 10act.) RANK 8 NODE 13 --> 5.12306261 sigma out 1act.( 9.34214592 sig in 10act.) RANK 9 NODE 15 --> 4.20428133 sigma out 1act.( 7.34457016 sig in 10act.) RANK 10 NODE 12 --> 4.10956335 sigma out 1act.( 7.61595774 sig in 10act.) RANK 11 NODE 8 --> 3.45535254 sigma out 1act.( 7.16877222 sig in 10act.) RANK 12 NODE 10 --> 3.40120482 sigma out 1act.( 6.37832785 sig in 10act.) RANK 13 NODE 11 --> 2.3961277 sigma out 1act.( 4.68276215 sig in 10act.) RANK 14 NODE 7 --> 0.747891784 sigma out 1act.( 3.18455195 sig in 10act.) RANK 15 NODE 4 --> 0.494528145 sigma out 1act.( 2.92689157 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 18.014576 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.582055688 *** contribution from regularisation: 0.0129390964 *** contribution from error: -0.594994783 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -13486.2297 0.494869143 -0.918986857 EXIT FROM BFGS code FG_LNSRCH 0. 0.541425467 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.587833464 *** contribution from regularisation: 0.00722042983 *** contribution from error: -0.595053911 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13620.1019 0.541425467 -13.5207262 EXIT FROM BFGS code FG_LNSRCH 0. 0.539923429 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.586912572 *** contribution from regularisation: 0.00814739615 *** contribution from error: -0.595059991 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13598.7646 0.539923429 -12.8303337 EXIT FROM BFGS code FG_LNSRCH 0. 0.541414618 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.587007225 *** contribution from regularisation: 0.00804696139 *** contribution from error: -0.595054209 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13600.957 0.541414618 -13.0269346 EXIT FROM BFGS code FG_LNSRCH 0. 0.541425467 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.587131262 *** contribution from regularisation: 0.00792268105 *** contribution from error: -0.595053971 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -13603.8307 0.541425467 -12.9692059 EXIT FROM BFGS code NEW_X -13603.8307 0.541425467 -12.9692059 ENTER BFGS code NEW_X -13603.8307 0.541425467 -12.9692059 EXIT FROM BFGS code CONVERGENC -13603.8307 0.541425467 -12.9692059 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 26.6721878 sigma out 15 active outputs RANK 2 NODE 1 --> 15.3888035 sigma out 15 active outputs RANK 3 NODE 4 --> 11.1702108 sigma out 15 active outputs RANK 4 NODE 8 --> 8.99377823 sigma out 15 active outputs RANK 5 NODE 10 --> 8.54340553 sigma out 15 active outputs RANK 6 NODE 3 --> 8.50465488 sigma out 15 active outputs RANK 7 NODE 6 --> 8.24782181 sigma out 15 active outputs RANK 8 NODE 9 --> 7.91423702 sigma out 15 active outputs RANK 9 NODE 7 --> 7.14483786 sigma out 15 active outputs RANK 10 NODE 5 --> 6.79528379 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 15.212347 sigma in 10act. ( 10.4989281 sig out 1act.) RANK 2 NODE 9 --> 13.4811249 sigma in 10act. ( 10.3453999 sig out 1act.) RANK 3 NODE 13 --> 12.4392786 sigma in 10act. ( 8.48108673 sig out 1act.) RANK 4 NODE 5 --> 11.5425482 sigma in 10act. ( 8.82658291 sig out 1act.) RANK 5 NODE 1 --> 11.3539915 sigma in 10act. ( 9.74632263 sig out 1act.) RANK 6 NODE 6 --> 11.0793447 sigma in 10act. ( 8.94823837 sig out 1act.) RANK 7 NODE 14 --> 10.9621964 sigma in 10act. ( 8.8925209 sig out 1act.) RANK 8 NODE 3 --> 10.9133701 sigma in 10act. ( 8.28953075 sig out 1act.) RANK 9 NODE 12 --> 9.59820747 sigma in 10act. ( 7.13219166 sig out 1act.) RANK 10 NODE 15 --> 8.70969486 sigma in 10act. ( 6.96662092 sig out 1act.) RANK 11 NODE 8 --> 8.01518059 sigma in 10act. ( 6.10393667 sig out 1act.) RANK 12 NODE 10 --> 7.52951431 sigma in 10act. ( 6.44552135 sig out 1act.) RANK 13 NODE 11 --> 5.53935814 sigma in 10act. ( 4.49296427 sig out 1act.) RANK 14 NODE 7 --> 3.10548615 sigma in 10act. ( 1.9033885 sig out 1act.) RANK 15 NODE 4 --> 2.40403724 sigma in 10act. ( 0.674799263 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 10.4989281 sigma out 1act.( 15.212347 sig in 10act.) RANK 2 NODE 9 --> 10.3453999 sigma out 1act.( 13.4811249 sig in 10act.) RANK 3 NODE 1 --> 9.74632263 sigma out 1act.( 11.3539915 sig in 10act.) RANK 4 NODE 6 --> 8.94823837 sigma out 1act.( 11.0793447 sig in 10act.) RANK 5 NODE 14 --> 8.8925209 sigma out 1act.( 10.9621964 sig in 10act.) RANK 6 NODE 5 --> 8.82658291 sigma out 1act.( 11.5425482 sig in 10act.) RANK 7 NODE 13 --> 8.48108673 sigma out 1act.( 12.4392786 sig in 10act.) RANK 8 NODE 3 --> 8.28953075 sigma out 1act.( 10.9133701 sig in 10act.) RANK 9 NODE 12 --> 7.13219166 sigma out 1act.( 9.59820747 sig in 10act.) RANK 10 NODE 15 --> 6.96662092 sigma out 1act.( 8.70969486 sig in 10act.) RANK 11 NODE 10 --> 6.44552135 sigma out 1act.( 7.52951431 sig in 10act.) RANK 12 NODE 8 --> 6.10393667 sigma out 1act.( 8.01518059 sig in 10act.) RANK 13 NODE 11 --> 4.49296427 sigma out 1act.( 5.53935814 sig in 10act.) RANK 14 NODE 7 --> 1.9033885 sigma out 1act.( 3.10548615 sig in 10act.) RANK 15 NODE 4 --> 0.674799263 sigma out 1act.( 2.40403724 sig in 10act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 29.8733463 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.587214112 *** contribution from regularisation: 0.00783977378 *** contribution from error: -0.595053911 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 25490 Closing output file done