NNInput NNInputs_175.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 198376 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 50034 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 50034 Chosen entries: 50034 Signal fraction: 1 Background fraction: 0.337288 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 50034 Entries to split: 50034 Test with : 25017 Train with : 25017 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 50034 for Signal Prepared event 0 for Signal with 50034 events ====Entry 0 Variable Ht : 241.352 Variable LepAPt : 26.6709 Variable LepBPt : 20.757 Variable MetSigLeptonsJets : 8.7004 Variable MetSpec : 102.516 Variable SumEtLeptonsJets : 138.836 Variable VSumJetLeptonsPt : 95.4385 Variable addEt : 149.944 Variable dPhiLepSumMet : 1.91756 Variable dPhiLeptons : 0.237715 Variable dRLeptons : 0.435475 Variable lep1_E : 34.2866 Variable lep2_E : 22.2255 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2175 Ht = 241.352 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 26.6709 LepAPt = 26.6709 LepBEt = 20.7574 LepBPt = 20.757 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 102.516 MetDelPhi = 1.78381 MetSig = 7.13205 MetSigLeptonsJets = 8.7004 MetSpec = 102.516 Mjj = 0 MostCentralJetEta = 1.70124 MtllMet = 156.27 Njets = 1 SB = 0 SumEt = 206.61 SumEtJets = 0 SumEtLeptonsJets = 138.836 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 95.4385 addEt = 149.944 dPhiLepSumMet = 1.91756 dPhiLeptons = 0.237715 dRLeptons = 0.435475 diltype = 54 dimass = 10.2815 event = 116 jet1_Et = 91.408 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.2866 lep2_E = 22.2255 rand = 0.999742 run = 236503 weight = 2.5946e-06 ===Show End Prepared event 10000 for Signal with 50034 events Prepared event 20000 for Signal with 50034 events Prepared event 30000 for Signal with 50034 events Prepared event 40000 for Signal with 50034 events Prepared event 50000 for Signal with 50034 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.300752 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4745 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 198376 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4745 negative weights. Signal fraction: 63.0929718 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.5989952 65.9142303 67.3456573 68.6026459 69.839325 70.7609711 71.6665878 72.5769653 73.5066681 74.2259979 74.9586487 75.5675812 76.2803421 77.0012817 77.63237 78.3758545 79.0134125 79.703064 80.4122162 80.9698792 81.7883759 82.5371704 83.2499847 84.3678284 85.3511505 86.4728241 87.7391663 88.975502 90.0957489 91.6540146 92.9983521 94.941391 96.663681 98.393692 100.226608 101.81398 103.34716 104.639633 106.458862 108.257156 110.176483 112.086823 114.051651 115.81073 117.88504 119.717735 121.192261 123.166382 124.999573 126.892319 128.677094 130.349731 131.888611 133.391937 134.99231 136.619614 138.296631 139.89389 141.514481 142.96843 144.493011 145.828888 147.457016 148.950684 150.423798 151.789856 153.432892 155.035828 156.608536 158.14679 159.727936 161.365158 163.214417 165.087219 166.892914 168.711792 170.654633 172.652267 175.058121 177.362244 179.776077 182.21759 184.648438 187.543655 190.689301 194.065338 197.652588 201.355011 205.345551 210.066376 215.306885 221.298569 228.018127 235.475067 244.700012 256.248962 271.739197 292.457397 334.652039 815.513794 ------------------------------ Transdef: Tab for variable 3 20.0004749 20.3819389 20.7155781 21.026947 21.288723 21.5471191 21.869442 22.0969429 22.3464661 22.5918446 22.8307533 23.0418453 23.2646866 23.4597321 23.7241096 23.9622803 24.1978073 24.4490662 24.6821995 24.8834038 25.1108551 25.2827339 25.5003929 25.7128773 25.9476967 26.1940269 26.4428062 26.6872673 26.9538937 27.1531239 27.3875904 27.6826439 27.9529839 28.2481632 28.5127182 28.7695541 29.0324993 29.292284 29.5771523 29.8875847 30.2348347 30.5363483 30.7933922 31.1346912 31.4661331 31.7486877 32.0920792 32.3995819 32.7435074 33.0824966 33.4341354 33.7837906 34.1079483 34.4220581 34.8274078 35.1874161 35.5214081 35.8834724 36.2558937 36.6482697 37.0055008 37.399025 37.7552261 38.1525116 38.577507 38.9531937 39.295311 39.7153511 40.1038742 40.536087 40.9608994 41.4277954 41.8287735 42.3126984 42.7967682 43.2586365 43.7833176 44.3208313 44.883255 45.4494896 45.9782295 46.5410004 47.1634216 47.8783684 48.5278435 49.3140717 50.0150909 50.7677116 51.5432129 52.4584732 53.3406601 54.3181992 55.4397736 56.737648 58.263588 60.1454124 62.2787552 65.570549 70.2087708 79.105484 215.283478 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1372128 10.2866735 10.4025269 10.510046 10.6442699 10.7845163 10.9449663 11.0858364 11.2525043 11.3841448 11.5057039 11.66747 11.8045101 11.9497833 12.070715 12.2243996 12.3786869 12.5355244 12.7245731 12.8601952 13.0402565 13.228466 13.4171734 13.5942478 13.7758827 13.9752178 14.1980028 14.417552 14.6572056 14.8637848 15.0995321 15.2915459 15.4859982 15.7440529 15.9658976 16.2545776 16.5130844 16.7660599 17.0172749 17.313549 17.5954266 17.8852615 18.1370659 18.4229431 18.7233067 19.0029888 19.3165817 19.6475105 19.9862404 20.2240925 20.4118805 20.676239 20.9876366 21.2659073 21.5430374 21.7669392 22.0103302 22.2777424 22.5719147 22.8699875 23.156189 23.4423771 23.7457867 24.0651703 24.3893127 24.6636848 24.9815083 25.2833958 25.5796394 25.8996296 26.2034912 26.5131588 26.8139668 27.1194611 27.4473019 27.7543335 28.0659676 28.341341 28.7012939 29.0273361 29.4106178 29.7784138 30.1440773 30.5273933 30.9199982 31.357132 31.8101654 32.282959 32.8061829 33.3384476 33.9363327 34.5720596 35.2852936 36.0958557 37.093071 38.3121796 40.2841415 42.8395576 47.9224472 113.634285 ------------------------------ Transdef: Tab for variable 5 0.959707916 2.73185921 3.19974995 3.53125858 3.82002807 4.03672695 4.18611002 4.3232832 4.45086241 4.5779748 4.66523886 4.7715168 4.8674202 4.95998764 5.04499054 5.12640285 5.1929574 5.26479387 5.31491852 5.36693335 5.42586517 5.48781967 5.52721214 5.58500576 5.63829517 5.6930933 5.74369764 5.79291344 5.83703041 5.88219118 5.93282032 5.97684622 6.016119 6.06483841 6.1122427 6.16027689 6.20698357 6.25157928 6.28599262 6.33766317 6.38801956 6.44113159 6.48700809 6.53118372 6.57502365 6.62093544 6.66297817 6.71935797 6.76337242 6.8080821 6.8598299 6.9086504 6.9664793 7.00816536 7.05971289 7.11528015 7.17290974 7.22261143 7.27289629 7.32300949 7.38141346 7.43688822 7.48394823 7.54654121 7.6150198 7.670784 7.72669411 7.79005909 7.84838009 7.91046619 7.96950912 8.02869034 8.08390427 8.15046883 8.21405411 8.27580452 8.33895874 8.40340233 8.46150017 8.52644157 8.58889771 8.65782547 8.72883606 8.79123592 8.86857414 8.9473877 9.023489 9.11057663 9.19965458 9.28991985 9.37933636 9.49046135 9.61633301 9.75990486 9.91526794 10.0996284 10.3504238 10.6722517 11.125948 11.9341269 18.7658558 ------------------------------ Transdef: Tab for variable 6 15.0069656 21.9798775 25.7322559 27.0571804 28.0395546 29.0662003 29.819397 30.6396847 31.3134346 31.9073429 32.5106583 33.0514488 33.5716553 34.0643959 34.5637856 34.9655228 35.4525909 35.8962479 36.3285027 36.6771317 37.0811996 37.4962044 37.8662567 38.2331619 38.5892563 38.9472275 39.3535309 39.7350693 40.1238365 40.4638748 40.8718414 41.2722473 41.7431183 42.2257538 42.7277412 43.1153374 43.6486282 44.0292778 44.5463943 45.1754837 45.7951813 46.4476776 47.1521568 47.8614197 48.527359 49.1886902 49.8936005 50.5412254 51.3637505 52.2617531 53.0658302 53.9354324 54.6974869 55.4724121 56.3364029 57.0382233 57.8766708 58.5360107 59.3050766 60.066803 60.9399185 61.7628288 62.5872269 63.4039764 64.2644958 65.0973816 65.8808365 66.664856 67.5440216 68.3079834 69.0254822 69.7950974 70.6866455 71.4550934 72.268898 73.0528183 73.8348846 74.5900116 75.4150238 76.2824249 77.0837631 77.9152222 78.8361816 79.7082672 80.6222992 81.5731659 82.6917725 83.8983994 85.1246796 86.5310211 88.1160736 89.9493103 91.8313599 94.3655701 97.2878036 100.861504 104.662354 109.716362 117.33181 131.831146 280.646332 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.7548676 33.7266121 34.4750137 35.1016693 35.5695572 36.0188599 36.4855843 36.905983 37.3067932 37.6553307 38.0189285 38.3035355 38.5890198 38.8870392 39.2118225 39.5971832 39.9654999 40.3261986 40.6355133 41.0237045 41.4336472 41.7846146 42.2277374 42.706028 43.1782951 43.8577881 44.5281525 45.149971 45.9036255 46.8746796 47.8871956 48.9852943 49.7377625 50.7224731 51.8385582 52.8772507 53.9021988 55.078495 56.0726624 57.1095734 58.1437988 59.1714096 60.2425842 61.0064621 61.6651039 62.6100388 63.5450974 64.470726 65.4199066 66.2763824 67.3158646 68.1631622 69.0801544 70.0235291 70.9596252 71.7210541 72.5267792 73.290863 74.1408005 74.9661331 75.8356781 76.8315887 77.7741547 78.7683105 79.7935181 80.8626099 82.0406799 83.0419312 84.4523163 85.6958389 87.0643539 88.5366516 90.1726761 91.7352905 93.289978 94.8280334 96.6327209 98.540802 100.423813 102.234924 104.3283 106.370605 108.600113 110.933029 113.383011 116.192001 119.488533 122.588173 125.849945 129.817963 134.177933 138.561493 143.90564 149.760071 158.490387 167.869339 180.19931 199.271423 232.549011 606.499451 ------------------------------ Transdef: Tab for variable 8 2.05942559 26.2169895 29.9061546 31.634407 32.5390015 33.296051 33.8292007 34.2244339 34.6467743 35.048645 35.4290466 35.826828 36.1796417 36.5471802 36.8685684 37.1545563 37.4653854 37.7593117 38.0318527 38.3011131 38.5726089 38.850029 39.1227112 39.4547501 39.7448349 40.0959549 40.4458923 40.7657661 41.1683197 41.4771881 41.9572601 42.4023895 42.7927666 43.276619 43.7274017 44.2446213 44.7726288 45.3841858 46.1403046 46.7366638 47.4690247 48.0670433 48.6213837 49.2212448 49.8939285 50.6399002 51.3507996 52.13517 52.8833313 53.6307526 54.3876724 55.2225189 55.9928513 56.8016586 57.4789352 58.2857056 59.0392876 59.786026 60.5211449 61.0989532 61.8287735 62.5974808 63.3199844 64.0663757 64.8066101 65.4836655 66.1691284 66.8796539 67.5772095 68.3631134 69.1004028 69.8317261 70.5216064 71.2342529 71.9336166 72.5811462 73.2600861 73.9856262 74.7189026 75.5444183 76.3249664 77.1690979 78.0401611 78.8655014 79.8890839 80.8176804 81.8900909 82.9311523 84.2874222 85.6971817 87.2407608 89.0175934 91.0329285 93.4260178 96.4456177 99.9919281 104.518585 110.029282 118.726334 134.243958 356.258179 ------------------------------ Transdef: Tab for variable 9 49.2546883 63.2451553 65.3222046 66.846199 68.1398239 69.184021 70.1401825 71.0305939 71.7969208 72.6282806 73.4664459 74.0791473 74.821167 75.4097824 75.9754944 76.6165543 77.1128387 77.74617 78.3718109 78.901123 79.463913 80.0533905 80.6521149 81.2298279 81.9796143 82.5553055 83.1961212 84.0307465 84.8617859 85.7096252 86.6818237 87.4579773 88.5763092 89.3946304 90.4952469 91.7168961 92.9686432 94.4086914 95.9306641 97.5615845 98.9942627 100.631073 101.931946 103.370476 104.828812 106.521622 108.080864 109.538254 110.965607 112.615189 114.135796 115.509094 117.095634 118.504662 119.717735 120.987076 122.433838 123.850235 125.147675 126.689682 128.090866 129.36853 130.714233 131.99585 133.25174 134.613434 135.894943 137.057571 138.284088 139.487335 140.686676 141.800598 142.945419 144.076721 145.290009 146.348328 147.435333 148.582657 149.678177 150.861786 151.949097 153.18541 154.443359 155.59494 156.867889 158.054214 159.323029 160.630692 161.981415 163.583939 165.164459 166.737839 168.519928 170.675751 173.045166 176.010391 179.977936 186.029297 194.773361 217.342682 582.80835 ------------------------------ Transdef: Tab for variable 10 0.00602381537 1.14785409 1.45929456 1.66417992 1.81772935 1.9361583 2.02832651 2.11099696 2.17933869 2.24580479 2.30365801 2.34899902 2.39493799 2.43532801 2.47067738 2.50428963 2.53540206 2.56411934 2.5913415 2.61387515 2.63681984 2.65855551 2.67937469 2.69947863 2.71841526 2.73587322 2.75405431 2.77092361 2.78518462 2.79950428 2.81438351 2.82632065 2.83919072 2.8500104 2.85936832 2.86928654 2.88005614 2.88784885 2.89665866 2.90527916 2.91286373 2.91993666 2.92786121 2.93510723 2.94231105 2.94964671 2.95627236 2.96320605 2.96879864 2.97513628 2.98006821 2.98491144 2.99016428 2.99393272 2.99895668 3.00405192 3.00850797 3.01384687 3.01782703 3.02254367 3.02689505 3.03098202 3.03502321 3.03868437 3.04271936 3.04618478 3.04964256 3.05312252 3.0567162 3.05997992 3.06340551 3.06693649 3.06966758 3.0726831 3.07573032 3.07860518 3.08149529 3.08456087 3.08766985 3.09069562 3.09347296 3.09621048 3.09902334 3.1015501 3.10420108 3.10674477 3.10917258 3.11175346 3.11416125 3.11668611 3.11899185 3.12142754 3.1237762 3.12610626 3.12845659 3.13058257 3.13244867 3.13466191 3.13707685 3.13936949 3.14159226 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00533759641 0.0103965998 0.0164813995 0.0219867229 0.027182579 0.0331611633 0.0388329625 0.0450890064 0.0511732101 0.0576122701 0.0628573895 0.0687741041 0.0747503042 0.0804561377 0.0866931677 0.0922913551 0.0974612236 0.102365106 0.107774317 0.111575991 0.116730571 0.121518075 0.127185225 0.132797599 0.138450444 0.143629372 0.148334205 0.153288603 0.158107042 0.162720606 0.167336106 0.172740549 0.17786324 0.182955623 0.187301338 0.192835093 0.197888047 0.202510685 0.208076835 0.212966084 0.217681766 0.222829342 0.22779879 0.232735038 0.237258598 0.242442235 0.247373343 0.252806306 0.258234501 0.263115048 0.268791407 0.273881197 0.278999448 0.284727097 0.29014647 0.295361847 0.301095247 0.306586981 0.311918139 0.317995548 0.324559033 0.330470681 0.336687207 0.342802346 0.34860909 0.355228215 0.360590935 0.367768288 0.374105453 0.380965471 0.388039827 0.393666923 0.400380909 0.407553852 0.414546967 0.422114134 0.428957105 0.437015593 0.446041942 0.454760849 0.463259161 0.473324299 0.482545614 0.493251383 0.503174782 0.513214469 0.523605824 0.537121058 0.550676048 0.56338799 0.577880383 0.596434355 0.613938928 0.635568619 0.657089472 0.684998214 0.71510905 0.764331758 0.826447427 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.100093596 0.119821429 0.134018868 0.147220045 0.15883939 0.168328643 0.177598387 0.186826363 0.19539988 0.202570587 0.210025489 0.217629582 0.224246174 0.230887741 0.237647235 0.244094133 0.250781178 0.257606417 0.263798773 0.269813955 0.276011944 0.282110929 0.288142323 0.293790162 0.299937189 0.305644929 0.31032297 0.315637946 0.320973605 0.326491475 0.331972092 0.338010669 0.343872041 0.349328995 0.354317844 0.358565748 0.364522994 0.370042741 0.374980479 0.380066454 0.385305703 0.390768766 0.395880699 0.400699228 0.404784918 0.40881592 0.413080484 0.417068899 0.421375543 0.425328255 0.429211766 0.433287323 0.437512279 0.441610277 0.446085989 0.450866014 0.455468237 0.459830046 0.464244157 0.469005674 0.473579377 0.477314055 0.482643664 0.487424374 0.491909206 0.496843636 0.501863837 0.507580519 0.512631238 0.518290758 0.524554968 0.530980885 0.53765893 0.543807328 0.550146341 0.556768417 0.562960088 0.570241213 0.577611446 0.585079432 0.592373967 0.600075781 0.607684255 0.618004918 0.628237069 0.638184667 0.649345875 0.660372376 0.67201674 0.682691336 0.695793271 0.707759142 0.721505761 0.736033916 0.752114058 0.771327734 0.791556239 0.816904664 0.855010867 0.896242678 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0150032 21.6067982 22.4590149 23.2426949 23.7933273 24.3542767 24.9539299 25.4144325 25.8813992 26.3409233 26.8187046 27.2066116 27.6135197 28.0153847 28.4437866 28.8346405 29.1961327 29.5801888 29.9423523 30.3343029 30.6437244 30.9863129 31.3377705 31.7340355 32.0973663 32.4044838 32.7469254 33.1402969 33.4924469 33.8165283 34.2519989 34.5734329 34.9803848 35.3096008 35.6897507 36.081543 36.4708328 36.8791351 37.2434158 37.6464691 38.0318832 38.4064178 38.8025665 39.2036743 39.6157227 40.0353889 40.4680443 40.8928032 41.31427 41.7594147 42.1944427 42.6097488 42.9817238 43.3682632 43.856884 44.3099403 44.7936707 45.2879791 45.7761765 46.284462 46.7420425 47.2133331 47.6815948 48.1968994 48.7112885 49.2190857 49.7373581 50.2767639 50.859314 51.4113083 52.0357399 52.6498642 53.2292023 53.8238297 54.5031929 55.1776199 55.8159714 56.5939255 57.3044128 58.1143875 58.9581566 59.8348312 60.7370071 61.682766 62.6333923 63.7871475 64.6631317 65.8907471 67.0843964 68.6345215 70.1919861 71.7268524 73.7587357 76.1831818 78.5167694 81.4673309 85.569191 89.03965 95.2885284 106.759567 272.009979 ------------------------------ Transdef: Tab for variable 14 10.0093269 10.7367353 11.2543011 11.5721989 11.910511 12.2930193 12.5264282 12.8377705 13.1927719 13.5147591 13.7976265 14.1122246 14.4009237 14.7048435 15.0033512 15.308712 15.5885258 15.9008379 16.1646347 16.460453 16.7410316 17.0329132 17.3772068 17.7224617 18.0707073 18.2927494 18.6423645 18.9195213 19.2519722 19.6463966 19.9542027 20.2586899 20.5648212 20.8591518 21.1652489 21.4949684 21.751749 22.0576134 22.3205833 22.6149178 22.9680023 23.282774 23.5883484 23.8792763 24.2111683 24.529356 24.8533592 25.1660805 25.4816132 25.7160721 26.0128593 26.3064537 26.5894508 26.9086227 27.2209835 27.472332 27.7777214 28.0755081 28.3435211 28.637886 28.9449921 29.281414 29.5961933 29.9482536 30.2656631 30.6035728 30.9497776 31.276083 31.6140289 32.0014572 32.364212 32.7125092 33.0676346 33.4008102 33.6906204 34.0541 34.4784393 34.9082031 35.324749 35.7484589 36.196743 36.7019882 37.2316437 37.7832413 38.3713684 38.9905777 39.6208916 40.213295 40.9207001 41.6420288 42.5820122 43.4832687 44.4574051 45.7061806 47.2481079 48.8923225 51.1834793 54.2728271 58.4756432 65.52388 137.41864 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 67.2 53.8 56.4 31.7 50.9 65.2 57.5 65.8 -26.4 -15.2 -27.9 25.4 34.1 2 67.2 100.0 70.4 64.3 37.7 70.1 94.8 77.4 92.7 -42.8 -23.7 -39.7 42.1 42.6 3 53.8 70.4 100.0 53.4 15.5 40.0 72.8 59.7 76.6 -14.6 -25.3 -44.7 70.4 35.5 4 56.4 64.3 53.4 100.0 18.0 39.7 65.5 55.8 69.5 -13.9 -29.1 -51.1 32.2 76.2 5 31.7 37.7 15.5 18.0 100.0 84.2 11.8 59.2 57.3 23.3 -7.9 -11.1 2.6 8.4 6 50.9 70.1 40.0 39.7 84.2 100.0 50.7 80.5 79.6 -7.2 -15.5 -24.8 19.3 24.2 7 65.2 94.8 72.8 65.5 11.8 50.7 100.0 69.7 82.4 -51.1 -22.5 -39.2 45.9 44.8 8 57.5 77.4 59.7 55.8 59.2 80.5 69.7 100.0 84.8 -10.8 -23.1 -37.0 35.4 37.4 9 65.8 92.7 76.6 69.5 57.3 79.6 82.4 84.8 100.0 -19.8 -26.6 -45.2 47.3 47.2 10 -26.4 -42.8 -14.6 -13.9 23.3 -7.2 -51.1 -10.8 -19.8 100.0 0.9 4.1 -6.1 -7.7 11 -15.2 -23.7 -25.3 -29.1 -7.9 -15.5 -22.5 -23.1 -26.6 0.9 100.0 59.4 -11.6 -19.1 12 -27.9 -39.7 -44.7 -51.1 -11.1 -24.8 -39.2 -37.0 -45.2 4.1 59.4 100.0 -21.3 -28.9 13 25.4 42.1 70.4 32.2 2.6 19.3 45.9 35.4 47.3 -6.1 -11.6 -21.3 100.0 53.7 14 34.1 42.6 35.5 76.2 8.4 24.2 44.8 37.4 47.2 -7.7 -19.1 -28.9 53.7 100.0 TOTAL CORRELATION TO TARGET (diagonal) 172.081224 TOTAL CORRELATION OF ALL VARIABLES 73.8534997 ROUND 1: MAX CORR ( 73.8528981) AFTER KILLING INPUT VARIABLE 8 CONTR 0.298091897 ROUND 2: MAX CORR ( 73.8497056) AFTER KILLING INPUT VARIABLE 6 CONTR 0.686682704 ROUND 3: MAX CORR ( 73.8446713) AFTER KILLING INPUT VARIABLE 11 CONTR 0.862290182 ROUND 4: MAX CORR ( 73.8385218) AFTER KILLING INPUT VARIABLE 14 CONTR 0.952982485 ROUND 5: MAX CORR ( 73.8256809) AFTER KILLING INPUT VARIABLE 2 CONTR 1.377002 ROUND 6: MAX CORR ( 73.5303325) AFTER KILLING INPUT VARIABLE 12 CONTR 6.59707255 ROUND 7: MAX CORR ( 73.2083823) AFTER KILLING INPUT VARIABLE 10 CONTR 6.87332255 ROUND 8: MAX CORR ( 72.5477057) AFTER KILLING INPUT VARIABLE 13 CONTR 9.81313556 ROUND 9: MAX CORR ( 71.3958779) AFTER KILLING INPUT VARIABLE 3 CONTR 12.8762659 ROUND 10: MAX CORR ( 71.145737) AFTER KILLING INPUT VARIABLE 9 CONTR 5.9712219 ROUND 11: MAX CORR ( 69.5591582) AFTER KILLING INPUT VARIABLE 4 CONTR 14.9411983 ROUND 12: MAX CORR ( 65.1949166) AFTER KILLING INPUT VARIABLE 5 CONTR 24.2507593 LAST REMAINING VARIABLE: 7 total correlation to target: 73.8534997 % total significance: 147.58349 sigma correlations of single variables to target: variable 2: 67.2334016 % , in sigma: 134.354365 variable 3: 53.8325307 % , in sigma: 107.575034 variable 4: 56.4130183 % , in sigma: 112.731694 variable 5: 31.7461552 % , in sigma: 63.4392195 variable 6: 50.9465471 % , in sigma: 101.807893 variable 7: 65.1949166 % , in sigma: 130.280804 variable 8: 57.5040105 % , in sigma: 114.911854 variable 9: 65.8024974 % , in sigma: 131.494949 variable 10: -26.4477816 % , in sigma: 52.851333 variable 11: -15.1845519 % , in sigma: 30.3437099 variable 12: -27.8777154 % , in sigma: 55.7088092 variable 13: 25.4465088 % , in sigma: 50.8504619 variable 14: 34.1478234 % , in sigma: 68.2385394 variables sorted by significance: 1 most relevant variable 7 corr 65.1949158 , in sigma: 130.280802 2 most relevant variable 5 corr 24.2507591 , in sigma: 48.4609623 3 most relevant variable 4 corr 14.9411983 , in sigma: 29.8574097 4 most relevant variable 9 corr 5.97122192 , in sigma: 11.9324578 5 most relevant variable 3 corr 12.8762655 , in sigma: 25.7309973 6 most relevant variable 13 corr 9.81313515 , in sigma: 19.6098592 7 most relevant variable 10 corr 6.87332249 , in sigma: 13.7351503 8 most relevant variable 12 corr 6.5970726 , in sigma: 13.1831125 9 most relevant variable 2 corr 1.377002 , in sigma: 2.75170116 10 most relevant variable 14 corr 0.952982485 , in sigma: 1.90437124 11 most relevant variable 11 corr 0.862290204 , in sigma: 1.72313835 12 most relevant variable 6 corr 0.686682701 , in sigma: 1.37221702 13 most relevant variable 8 corr 0.298091888 , in sigma: 0.595685261 global correlations between input variables: variable 2: 99.219969 % variable 3: 93.7041669 % variable 4: 92.6768246 % variable 5: 95.1950252 % variable 6: 94.8676036 % variable 7: 98.8531538 % variable 8: 90.9008288 % variable 9: 98.8111382 % variable 10: 71.7387731 % variable 11: 60.0817917 % variable 12: 72.2185146 % variable 13: 87.5258612 % variable 14: 89.7746129 % significance loss when removing single variables: variable 2: corr = 1.1994979 % , sigma = 2.3969898 variable 3: corr = 14.9134343 % , sigma = 29.801928 variable 4: corr = 13.9375444 % , sigma = 27.8517803 variable 5: corr = 15.6997963 % , sigma = 31.3733369 variable 6: corr = 0.525782994 % , sigma = 1.05068669 variable 7: corr = 8.43459255 % , sigma = 16.8550794 variable 8: corr = 0.298091897 % , sigma = 0.595685277 variable 9: corr = 10.102939 % , sigma = 20.1889822 variable 10: corr = 6.22957855 % , sigma = 12.448739 variable 11: corr = 0.848199111 % , sigma = 1.69497973 variable 12: corr = 5.1983428 % , sigma = 10.3879921 variable 13: corr = 6.60209851 % , sigma = 13.1931559 variable 14: corr = 0.863666795 % , sigma = 1.72588923 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 19.9570827 sigma out 15 active outputs RANK 2 NODE 9 --> 15.1362743 sigma out 15 active outputs RANK 3 NODE 7 --> 15.1211271 sigma out 15 active outputs RANK 4 NODE 6 --> 15.0545063 sigma out 15 active outputs RANK 5 NODE 4 --> 13.9798679 sigma out 15 active outputs RANK 6 NODE 3 --> 13.4507875 sigma out 15 active outputs RANK 7 NODE 2 --> 13.2072649 sigma out 15 active outputs RANK 8 NODE 8 --> 11.6323957 sigma out 15 active outputs RANK 9 NODE 1 --> 5.2240448 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 22.6796207 sigma in 9act. ( 23.2539253 sig out 1act.) RANK 2 NODE 14 --> 21.4584332 sigma in 9act. ( 22.2525482 sig out 1act.) RANK 3 NODE 11 --> 13.3072882 sigma in 9act. ( 14.20156 sig out 1act.) RANK 4 NODE 7 --> 12.3746605 sigma in 9act. ( 13.7536497 sig out 1act.) RANK 5 NODE 3 --> 11.8603582 sigma in 9act. ( 12.243412 sig out 1act.) RANK 6 NODE 15 --> 11.8367596 sigma in 9act. ( 12.8596745 sig out 1act.) RANK 7 NODE 4 --> 8.88026428 sigma in 9act. ( 6.37656355 sig out 1act.) RANK 8 NODE 10 --> 6.98254299 sigma in 9act. ( 7.25708389 sig out 1act.) RANK 9 NODE 12 --> 4.73938179 sigma in 9act. ( 9.47320843 sig out 1act.) RANK 10 NODE 2 --> 4.1311574 sigma in 9act. ( 3.6097393 sig out 1act.) RANK 11 NODE 8 --> 3.81886172 sigma in 9act. ( 2.67062187 sig out 1act.) RANK 12 NODE 1 --> 3.34325147 sigma in 9act. ( 2.72815609 sig out 1act.) RANK 13 NODE 5 --> 2.74940252 sigma in 9act. ( 2.14858246 sig out 1act.) RANK 14 NODE 13 --> 2.54364228 sigma in 9act. ( 4.29341078 sig out 1act.) RANK 15 NODE 9 --> 1.8214817 sigma in 9act. ( 2.84918737 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 23.2539253 sigma out 1act.( 22.6796207 sig in 9act.) RANK 2 NODE 14 --> 22.2525482 sigma out 1act.( 21.4584332 sig in 9act.) RANK 3 NODE 11 --> 14.20156 sigma out 1act.( 13.3072882 sig in 9act.) RANK 4 NODE 7 --> 13.7536497 sigma out 1act.( 12.3746605 sig in 9act.) RANK 5 NODE 15 --> 12.8596745 sigma out 1act.( 11.8367596 sig in 9act.) RANK 6 NODE 3 --> 12.243412 sigma out 1act.( 11.8603582 sig in 9act.) RANK 7 NODE 12 --> 9.47320843 sigma out 1act.( 4.73938179 sig in 9act.) RANK 8 NODE 10 --> 7.25708389 sigma out 1act.( 6.98254299 sig in 9act.) RANK 9 NODE 4 --> 6.37656355 sigma out 1act.( 8.88026428 sig in 9act.) RANK 10 NODE 13 --> 4.29341078 sigma out 1act.( 2.54364228 sig in 9act.) RANK 11 NODE 2 --> 3.6097393 sigma out 1act.( 4.1311574 sig in 9act.) RANK 12 NODE 9 --> 2.84918737 sigma out 1act.( 1.8214817 sig in 9act.) RANK 13 NODE 1 --> 2.72815609 sigma out 1act.( 3.34325147 sig in 9act.) RANK 14 NODE 8 --> 2.67062187 sigma out 1act.( 3.81886172 sig in 9act.) RANK 15 NODE 5 --> 2.14858246 sigma out 1act.( 2.74940252 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 44.5407791 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 23.6875286 sigma out 15 active outputs RANK 2 NODE 5 --> 19.9903755 sigma out 15 active outputs RANK 3 NODE 9 --> 15.4348936 sigma out 15 active outputs RANK 4 NODE 3 --> 15.3312559 sigma out 15 active outputs RANK 5 NODE 7 --> 14.1914835 sigma out 15 active outputs RANK 6 NODE 6 --> 14.0782547 sigma out 15 active outputs RANK 7 NODE 4 --> 13.1638117 sigma out 15 active outputs RANK 8 NODE 8 --> 11.7029247 sigma out 15 active outputs RANK 9 NODE 1 --> 10.4234524 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 20.3281727 sigma in 9act. ( 20.9995461 sig out 1act.) RANK 2 NODE 14 --> 18.7643433 sigma in 9act. ( 19.3092079 sig out 1act.) RANK 3 NODE 12 --> 14.5393877 sigma in 9act. ( 12.8999538 sig out 1act.) RANK 4 NODE 11 --> 14.4919863 sigma in 9act. ( 13.4920969 sig out 1act.) RANK 5 NODE 7 --> 14.1202793 sigma in 9act. ( 13.0512762 sig out 1act.) RANK 6 NODE 15 --> 12.8246117 sigma in 9act. ( 11.4784107 sig out 1act.) RANK 7 NODE 13 --> 11.755434 sigma in 9act. ( 6.0665493 sig out 1act.) RANK 8 NODE 9 --> 11.3662415 sigma in 9act. ( 6.41953182 sig out 1act.) RANK 9 NODE 3 --> 11.2684879 sigma in 9act. ( 10.6853981 sig out 1act.) RANK 10 NODE 10 --> 10.3321133 sigma in 9act. ( 8.15638161 sig out 1act.) RANK 11 NODE 2 --> 7.7321682 sigma in 9act. ( 3.63908267 sig out 1act.) RANK 12 NODE 4 --> 6.638834 sigma in 9act. ( 4.92092848 sig out 1act.) RANK 13 NODE 5 --> 6.54053593 sigma in 9act. ( 2.50258994 sig out 1act.) RANK 14 NODE 1 --> 5.83188486 sigma in 9act. ( 3.15176821 sig out 1act.) RANK 15 NODE 8 --> 4.48587132 sigma in 9act. ( 2.45656252 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 20.9995461 sigma out 1act.( 20.3281727 sig in 9act.) RANK 2 NODE 14 --> 19.3092079 sigma out 1act.( 18.7643433 sig in 9act.) RANK 3 NODE 11 --> 13.4920969 sigma out 1act.( 14.4919863 sig in 9act.) RANK 4 NODE 7 --> 13.0512762 sigma out 1act.( 14.1202793 sig in 9act.) RANK 5 NODE 12 --> 12.8999538 sigma out 1act.( 14.5393877 sig in 9act.) RANK 6 NODE 15 --> 11.4784107 sigma out 1act.( 12.8246117 sig in 9act.) RANK 7 NODE 3 --> 10.6853981 sigma out 1act.( 11.2684879 sig in 9act.) RANK 8 NODE 10 --> 8.15638161 sigma out 1act.( 10.3321133 sig in 9act.) RANK 9 NODE 9 --> 6.41953182 sigma out 1act.( 11.3662415 sig in 9act.) RANK 10 NODE 13 --> 6.0665493 sigma out 1act.( 11.755434 sig in 9act.) RANK 11 NODE 4 --> 4.92092848 sigma out 1act.( 6.638834 sig in 9act.) RANK 12 NODE 2 --> 3.63908267 sigma out 1act.( 7.7321682 sig in 9act.) RANK 13 NODE 1 --> 3.15176821 sigma out 1act.( 5.83188486 sig in 9act.) RANK 14 NODE 5 --> 2.50258994 sigma out 1act.( 6.54053593 sig in 9act.) RANK 15 NODE 8 --> 2.45656252 sigma out 1act.( 4.48587132 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 42.2228508 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.42824313 *** contribution from regularisation: 0.00396546489 *** contribution from error: -0.432208598 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.488411158 *** contribution from regularisation: 0.00177902612 *** contribution from error: -0.490190178 *********************************************** -----------------> Test sample ENTER BFGS code START -48454.4448 0.748376667 0.0377992541 EXIT FROM BFGS code FG_START 0. 0.748376667 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.510966301 *** contribution from regularisation: 0.00177509896 *** contribution from error: -0.512741387 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -50681.7271 0.748376667 70.9855957 EXIT FROM BFGS code FG_LNSRCH 0. 0.757061124 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.557329834 *** contribution from regularisation: 0.00269618467 *** contribution from error: -0.56002599 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55280.4305 0.757061124 154.398697 EXIT FROM BFGS code NEW_X -55280.4305 0.757061124 154.398697 ENTER BFGS code NEW_X -55280.4305 0.757061124 154.398697 EXIT FROM BFGS code FG_LNSRCH 0. 0.777186394 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.560325325 *** contribution from regularisation: 0.00271674083 *** contribution from error: -0.563042045 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55577.5484 0.777186394 104.35054 EXIT FROM BFGS code NEW_X -55577.5484 0.777186394 104.35054 ENTER BFGS code NEW_X -55577.5484 0.777186394 104.35054 EXIT FROM BFGS code FG_LNSRCH 0. 0.821414351 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.56428206 *** contribution from regularisation: 0.00263348198 *** contribution from error: -0.566915512 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55970.0101 0.821414351 12.1847563 EXIT FROM BFGS code NEW_X -55970.0101 0.821414351 12.1847563 ENTER BFGS code NEW_X -55970.0101 0.821414351 12.1847563 EXIT FROM BFGS code FG_LNSRCH 0. 0.831096888 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.564825714 *** contribution from regularisation: 0.00247569941 *** contribution from error: -0.567301393 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56023.9308 0.831096888 -37.2516022 EXIT FROM BFGS code NEW_X -56023.9308 0.831096888 -37.2516022 ENTER BFGS code NEW_X -56023.9308 0.831096888 -37.2516022 EXIT FROM BFGS code FG_LNSRCH 0. 0.819923043 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.564994574 *** contribution from regularisation: 0.00246762973 *** contribution from error: -0.567462206 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56040.6795 0.819923043 -18.8876686 EXIT FROM BFGS code NEW_X -56040.6795 0.819923043 -18.8876686 ENTER BFGS code NEW_X -56040.6795 0.819923043 -18.8876686 EXIT FROM BFGS code FG_LNSRCH 0. 0.791648448 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.565341175 *** contribution from regularisation: 0.00237158942 *** contribution from error: -0.567712784 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56075.0587 0.791648448 3.38860035 EXIT FROM BFGS code NEW_X -56075.0587 0.791648448 3.38860035 ENTER BFGS code NEW_X -56075.0587 0.791648448 3.38860035 EXIT FROM BFGS code FG_LNSRCH 0. 0.729863882 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 39.242733 sigma out 15 active outputs RANK 2 NODE 1 --> 22.0963058 sigma out 15 active outputs RANK 3 NODE 3 --> 19.0325584 sigma out 15 active outputs RANK 4 NODE 5 --> 14.4903584 sigma out 15 active outputs RANK 5 NODE 9 --> 12.7748032 sigma out 15 active outputs RANK 6 NODE 7 --> 12.7381287 sigma out 15 active outputs RANK 7 NODE 4 --> 10.4983473 sigma out 15 active outputs RANK 8 NODE 8 --> 10.3678827 sigma out 15 active outputs RANK 9 NODE 6 --> 9.69109821 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 9 --> 28.2055244 sigma in 9act. ( 23.0592499 sig out 1act.) RANK 2 NODE 12 --> 27.399456 sigma in 9act. ( 21.5302448 sig out 1act.) RANK 3 NODE 10 --> 19.403183 sigma in 9act. ( 15.3423557 sig out 1act.) RANK 4 NODE 13 --> 18.2373371 sigma in 9act. ( 14.0305748 sig out 1act.) RANK 5 NODE 14 --> 12.3646002 sigma in 9act. ( 10.7312222 sig out 1act.) RANK 6 NODE 11 --> 12.2527447 sigma in 9act. ( 10.2475519 sig out 1act.) RANK 7 NODE 7 --> 11.5869207 sigma in 9act. ( 10.4887629 sig out 1act.) RANK 8 NODE 3 --> 11.2132816 sigma in 9act. ( 10.7129164 sig out 1act.) RANK 9 NODE 5 --> 10.3967562 sigma in 9act. ( 9.04428577 sig out 1act.) RANK 10 NODE 2 --> 8.98443222 sigma in 9act. ( 7.08076525 sig out 1act.) RANK 11 NODE 1 --> 8.61261845 sigma in 9act. ( 8.07310104 sig out 1act.) RANK 12 NODE 6 --> 7.94851017 sigma in 9act. ( 7.27850723 sig out 1act.) RANK 13 NODE 15 --> 7.17643309 sigma in 9act. ( 5.33695459 sig out 1act.) RANK 14 NODE 8 --> 5.72704124 sigma in 9act. ( 5.06653738 sig out 1act.) RANK 15 NODE 4 --> 2.94734502 sigma in 9act. ( 0.232569754 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 23.0592499 sigma out 1act.( 28.2055244 sig in 9act.) RANK 2 NODE 12 --> 21.5302448 sigma out 1act.( 27.399456 sig in 9act.) RANK 3 NODE 10 --> 15.3423557 sigma out 1act.( 19.403183 sig in 9act.) RANK 4 NODE 13 --> 14.0305748 sigma out 1act.( 18.2373371 sig in 9act.) RANK 5 NODE 14 --> 10.7312222 sigma out 1act.( 12.3646002 sig in 9act.) RANK 6 NODE 3 --> 10.7129164 sigma out 1act.( 11.2132816 sig in 9act.) RANK 7 NODE 7 --> 10.4887629 sigma out 1act.( 11.5869207 sig in 9act.) RANK 8 NODE 11 --> 10.2475519 sigma out 1act.( 12.2527447 sig in 9act.) RANK 9 NODE 5 --> 9.04428577 sigma out 1act.( 10.3967562 sig in 9act.) RANK 10 NODE 1 --> 8.07310104 sigma out 1act.( 8.61261845 sig in 9act.) RANK 11 NODE 6 --> 7.27850723 sigma out 1act.( 7.94851017 sig in 9act.) RANK 12 NODE 2 --> 7.08076525 sigma out 1act.( 8.98443222 sig in 9act.) RANK 13 NODE 15 --> 5.33695459 sigma out 1act.( 7.17643309 sig in 9act.) RANK 14 NODE 8 --> 5.06653738 sigma out 1act.( 5.72704124 sig in 9act.) RANK 15 NODE 4 --> 0.232569754 sigma out 1act.( 2.94734502 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 46.6558952 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.565819442 *** contribution from regularisation: 0.00229807035 *** contribution from error: -0.568117499 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56122.4977 0.729863882 20.9081478 EXIT FROM BFGS code NEW_X -56122.4977 0.729863882 20.9081478 ENTER BFGS code NEW_X -56122.4977 0.729863882 20.9081478 EXIT FROM BFGS code FG_LNSRCH 0. 0.621029258 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.566516876 *** contribution from regularisation: 0.00227550883 *** contribution from error: -0.568792403 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56191.6766 0.621029258 15.4268808 EXIT FROM BFGS code NEW_X -56191.6766 0.621029258 15.4268808 ENTER BFGS code NEW_X -56191.6766 0.621029258 15.4268808 EXIT FROM BFGS code FG_LNSRCH 0. 0.461568445 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.566558301 *** contribution from regularisation: 0.00265107141 *** contribution from error: -0.569209397 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56195.7819 0.461568445 -11.7726011 EXIT FROM BFGS code FG_LNSRCH 0. 0.545264602 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.567157984 *** contribution from regularisation: 0.00223959214 *** contribution from error: -0.569397569 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56255.2655 0.545264602 5.08646345 EXIT FROM BFGS code NEW_X -56255.2655 0.545264602 5.08646345 ENTER BFGS code NEW_X -56255.2655 0.545264602 5.08646345 EXIT FROM BFGS code FG_LNSRCH 0. 0.526968956 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.567103505 *** contribution from regularisation: 0.0024429895 *** contribution from error: -0.569546521 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56249.8653 0.526968956 -9.67975044 EXIT FROM BFGS code FG_LNSRCH 0. 0.54120791 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.567042112 *** contribution from regularisation: 0.002412464 *** contribution from error: -0.569454551 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56243.7746 0.54120791 2.00550628 EXIT FROM BFGS code FG_LNSRCH 0. 0.545046628 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.566988647 *** contribution from regularisation: 0.00241215108 *** contribution from error: -0.569400787 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56238.4699 0.545046628 5.10504198 EXIT FROM BFGS code FG_LNSRCH 0. 0.545264065 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.56698817 *** contribution from regularisation: 0.00240943185 *** contribution from error: -0.569397628 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56238.4199 0.545264065 5.23363209 EXIT FROM BFGS code FG_LNSRCH 0. 0.545264602 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.566978455 *** contribution from regularisation: 0.00241912086 *** contribution from error: -0.569397569 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56237.4584 0.545264602 5.28482914 EXIT FROM BFGS code FG_LNSRCH 0. 0.545264602 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.566994309 *** contribution from regularisation: 0.00240328093 *** contribution from error: -0.569397569 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56239.0295 0.545264602 5.21317005 EXIT FROM BFGS code FG_LNSRCH 0. 0.545264602 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 42.1597939 sigma out 15 active outputs RANK 2 NODE 1 --> 25.8203392 sigma out 15 active outputs RANK 3 NODE 5 --> 20.0646915 sigma out 15 active outputs RANK 4 NODE 7 --> 18.6135483 sigma out 15 active outputs RANK 5 NODE 3 --> 17.4811821 sigma out 15 active outputs RANK 6 NODE 9 --> 14.1988449 sigma out 15 active outputs RANK 7 NODE 8 --> 13.0677938 sigma out 15 active outputs RANK 8 NODE 4 --> 11.9259529 sigma out 15 active outputs RANK 9 NODE 6 --> 8.19095898 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 35.1404648 sigma in 9act. ( 29.6406612 sig out 1act.) RANK 2 NODE 9 --> 34.6047401 sigma in 9act. ( 32.2054672 sig out 1act.) RANK 3 NODE 10 --> 21.2544651 sigma in 9act. ( 18.2522964 sig out 1act.) RANK 4 NODE 13 --> 14.8202343 sigma in 9act. ( 11.5976667 sig out 1act.) RANK 5 NODE 7 --> 13.3444099 sigma in 9act. ( 12.7157078 sig out 1act.) RANK 6 NODE 1 --> 12.4987011 sigma in 9act. ( 12.6354427 sig out 1act.) RANK 7 NODE 5 --> 12.4389791 sigma in 9act. ( 11.5655222 sig out 1act.) RANK 8 NODE 11 --> 12.2503395 sigma in 9act. ( 12.2776937 sig out 1act.) RANK 9 NODE 14 --> 9.31241035 sigma in 9act. ( 7.16805792 sig out 1act.) RANK 10 NODE 3 --> 8.95418739 sigma in 9act. ( 8.15314102 sig out 1act.) RANK 11 NODE 8 --> 7.37407112 sigma in 9act. ( 7.43953609 sig out 1act.) RANK 12 NODE 15 --> 6.48561573 sigma in 9act. ( 4.44312906 sig out 1act.) RANK 13 NODE 2 --> 6.34395933 sigma in 9act. ( 4.43488646 sig out 1act.) RANK 14 NODE 6 --> 4.79008341 sigma in 9act. ( 2.56382108 sig out 1act.) RANK 15 NODE 4 --> 3.33607984 sigma in 9act. ( 2.57590842 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 32.2054672 sigma out 1act.( 34.6047401 sig in 9act.) RANK 2 NODE 12 --> 29.6406612 sigma out 1act.( 35.1404648 sig in 9act.) RANK 3 NODE 10 --> 18.2522964 sigma out 1act.( 21.2544651 sig in 9act.) RANK 4 NODE 7 --> 12.7157078 sigma out 1act.( 13.3444099 sig in 9act.) RANK 5 NODE 1 --> 12.6354427 sigma out 1act.( 12.4987011 sig in 9act.) RANK 6 NODE 11 --> 12.2776937 sigma out 1act.( 12.2503395 sig in 9act.) RANK 7 NODE 13 --> 11.5976667 sigma out 1act.( 14.8202343 sig in 9act.) RANK 8 NODE 5 --> 11.5655222 sigma out 1act.( 12.4389791 sig in 9act.) RANK 9 NODE 3 --> 8.15314102 sigma out 1act.( 8.95418739 sig in 9act.) RANK 10 NODE 8 --> 7.43953609 sigma out 1act.( 7.37407112 sig in 9act.) RANK 11 NODE 14 --> 7.16805792 sigma out 1act.( 9.31241035 sig in 9act.) RANK 12 NODE 15 --> 4.44312906 sigma out 1act.( 6.48561573 sig in 9act.) RANK 13 NODE 2 --> 4.43488646 sigma out 1act.( 6.34395933 sig in 9act.) RANK 14 NODE 4 --> 2.57590842 sigma out 1act.( 3.33607984 sig in 9act.) RANK 15 NODE 6 --> 2.56382108 sigma out 1act.( 4.79008341 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 56.7016678 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.566969454 *** contribution from regularisation: 0.00242812093 *** contribution from error: -0.569397569 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -56236.5657 0.545264602 5.38568974 EXIT FROM BFGS code NEW_X -56236.5657 0.545264602 5.38568974 ENTER BFGS code NEW_X -56236.5657 0.545264602 5.38568974 EXIT FROM BFGS code CONVERGENC -56236.5657 0.545264602 5.38568974 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 64.1664963 sigma out 15 active outputs RANK 2 NODE 1 --> 40.2868805 sigma out 15 active outputs RANK 3 NODE 5 --> 30.664835 sigma out 15 active outputs RANK 4 NODE 7 --> 28.7240524 sigma out 15 active outputs RANK 5 NODE 3 --> 26.9137001 sigma out 15 active outputs RANK 6 NODE 9 --> 21.1271172 sigma out 15 active outputs RANK 7 NODE 8 --> 19.8204021 sigma out 15 active outputs RANK 8 NODE 4 --> 18.3587112 sigma out 15 active outputs RANK 9 NODE 6 --> 12.349143 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 12 --> 54.602562 sigma in 9act. ( 46.197113 sig out 1act.) RANK 2 NODE 9 --> 53.5849037 sigma in 9act. ( 50.4456139 sig out 1act.) RANK 3 NODE 10 --> 33.0432091 sigma in 9act. ( 28.0649052 sig out 1act.) RANK 4 NODE 13 --> 22.0730953 sigma in 9act. ( 18.0420284 sig out 1act.) RANK 5 NODE 7 --> 20.1170959 sigma in 9act. ( 20.131628 sig out 1act.) RANK 6 NODE 1 --> 19.0446243 sigma in 9act. ( 20.2662048 sig out 1act.) RANK 7 NODE 5 --> 19.0158272 sigma in 9act. ( 18.0492344 sig out 1act.) RANK 8 NODE 11 --> 18.6155834 sigma in 9act. ( 19.3336849 sig out 1act.) RANK 9 NODE 14 --> 13.3622856 sigma in 9act. ( 10.9621019 sig out 1act.) RANK 10 NODE 3 --> 12.1899328 sigma in 9act. ( 12.7645884 sig out 1act.) RANK 11 NODE 8 --> 11.1055832 sigma in 9act. ( 11.7603035 sig out 1act.) RANK 12 NODE 2 --> 8.87773418 sigma in 9act. ( 6.91128445 sig out 1act.) RANK 13 NODE 15 --> 8.36972237 sigma in 9act. ( 6.92714357 sig out 1act.) RANK 14 NODE 6 --> 5.7197566 sigma in 9act. ( 3.96554947 sig out 1act.) RANK 15 NODE 4 --> 4.40628338 sigma in 9act. ( 3.91415191 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 50.4456139 sigma out 1act.( 53.5849037 sig in 9act.) RANK 2 NODE 12 --> 46.197113 sigma out 1act.( 54.602562 sig in 9act.) RANK 3 NODE 10 --> 28.0649052 sigma out 1act.( 33.0432091 sig in 9act.) RANK 4 NODE 1 --> 20.2662048 sigma out 1act.( 19.0446243 sig in 9act.) RANK 5 NODE 7 --> 20.131628 sigma out 1act.( 20.1170959 sig in 9act.) RANK 6 NODE 11 --> 19.3336849 sigma out 1act.( 18.6155834 sig in 9act.) RANK 7 NODE 5 --> 18.0492344 sigma out 1act.( 19.0158272 sig in 9act.) RANK 8 NODE 13 --> 18.0420284 sigma out 1act.( 22.0730953 sig in 9act.) RANK 9 NODE 3 --> 12.7645884 sigma out 1act.( 12.1899328 sig in 9act.) RANK 10 NODE 8 --> 11.7603035 sigma out 1act.( 11.1055832 sig in 9act.) RANK 11 NODE 14 --> 10.9621019 sigma out 1act.( 13.3622856 sig in 9act.) RANK 12 NODE 15 --> 6.92714357 sigma out 1act.( 8.36972237 sig in 9act.) RANK 13 NODE 2 --> 6.91128445 sigma out 1act.( 8.87773418 sig in 9act.) RANK 14 NODE 6 --> 3.96554947 sigma out 1act.( 5.7197566 sig in 9act.) RANK 15 NODE 4 --> 3.91415191 sigma out 1act.( 4.40628338 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 88.6332855 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.566999555 *** contribution from regularisation: 0.00239803805 *** contribution from error: -0.569397569 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 26367 Closing output file done