NNInput NNInputs_175.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 184538 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 47106 nbkg = 137432 Bkg Entries: 137432 Sig Entries: 47106 Chosen entries: 47106 Signal fraction: 1 Background fraction: 0.342759 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 137432 Actual Signal Entries: 47106 Entries to split: 47106 Test with : 23553 Train with : 23553 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 47106 for Signal Prepared event 0 for Signal with 47106 events ====Entry 0 Variable Ht : 241.352 Variable LepAPt : 26.6709 Variable LepBPt : 20.757 Variable MetSigLeptonsJets : 8.7004 Variable MetSpec : 102.516 Variable SumEtLeptonsJets : 138.836 Variable VSumJetLeptonsPt : 95.4385 Variable addEt : 149.944 Variable dPhiLepSumMet : 1.91756 Variable dPhiLeptons : 0.237715 Variable dRLeptons : 0.435475 Variable lep1_E : 34.2866 Variable lep2_E : 22.2255 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2175 Ht = 241.352 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 26.6709 LepAPt = 26.6709 LepBEt = 20.7574 LepBPt = 20.757 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 102.516 MetDelPhi = 1.78381 MetSig = 7.13205 MetSigLeptonsJets = 8.7004 MetSpec = 102.516 Mjj = 0 MostCentralJetEta = 1.70124 MtllMet = 156.27 Njets = 1 SB = 0 SumEt = 206.61 SumEtJets = 0 SumEtLeptonsJets = 138.836 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 95.4385 addEt = 149.944 dPhiLepSumMet = 1.91756 dPhiLeptons = 0.237715 dRLeptons = 0.435475 diltype = 54 dimass = 10.2815 event = 116 jet1_Et = 91.408 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.2866 lep2_E = 22.2255 rand = 0.999742 run = 236503 weight = 2.5946e-06 ===Show End Prepared event 10000 for Signal with 47106 events Prepared event 20000 for Signal with 47106 events Prepared event 30000 for Signal with 47106 events Prepared event 40000 for Signal with 47106 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 137432 for Background Prepared event 0 for Background with 137432 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.335153 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 137432 events Prepared event 20000 for Background with 137432 events Prepared event 30000 for Background with 137432 events Prepared event 40000 for Background with 137432 events Prepared event 50000 for Background with 137432 events Prepared event 60000 for Background with 137432 events Prepared event 70000 for Background with 137432 events Prepared event 80000 for Background with 137432 events Prepared event 90000 for Background with 137432 events Prepared event 100000 for Background with 137432 events Prepared event 110000 for Background with 137432 events Prepared event 120000 for Background with 137432 events Prepared event 130000 for Background with 137432 events Warning: found 4485 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 184538 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4485 negative weights. Signal fraction: 63.2946472 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0048981 63.7850189 66.0369568 67.4761581 68.7144775 70.0095367 70.9446106 71.6664429 72.60495 73.5961151 74.4047623 75.1652374 75.8884583 76.6536102 77.3039093 78.1009674 78.8828659 79.6474457 80.3980713 81.0086288 81.66745 82.5562439 83.1997223 83.9381561 85.2162018 86.2884979 87.4635696 88.7679672 90.0492249 91.6522675 93.0417328 94.821167 96.4992218 98.3323135 99.9116364 101.541519 103.049141 104.94664 106.337814 108.269768 110.183434 112.092804 113.782608 115.566879 117.610367 119.630905 120.967499 122.888947 124.768105 126.539223 128.234894 129.919159 131.729599 133.254578 134.676102 136.253174 137.795135 139.480896 140.999863 142.53334 144.028351 145.470612 147.015274 148.484009 149.961227 151.354019 152.910553 154.385468 155.948364 157.321106 158.842194 160.346313 162.049927 163.864319 165.614868 167.377548 169.37381 171.294006 173.496628 175.643051 177.971329 180.551086 183.340912 185.799652 188.634979 191.805359 195.006531 198.416199 202.062531 206.063583 210.917145 216.517792 222.497833 229.539108 237.452301 247.043152 258.315704 274.565338 295.88562 337.679138 954.337463 ------------------------------ Transdef: Tab for variable 3 20.0032291 20.4427319 20.7868004 21.1305885 21.4280128 21.6830482 21.9891243 22.2240372 22.5093307 22.7450104 22.9741039 23.2050152 23.4283295 23.6383629 23.902916 24.1528511 24.4133377 24.6382046 24.8843956 25.1325874 25.3400116 25.5663376 25.7659092 26.0058327 26.2592201 26.4863892 26.7064018 26.9787941 27.2296352 27.4944878 27.7368736 27.9814262 28.2592049 28.515625 28.7505302 29.0579262 29.28335 29.5892868 29.8416424 30.1519852 30.4893227 30.8045597 31.1222229 31.4629002 31.7528419 32.0132828 32.33424 32.6998253 33.0108032 33.3101349 33.643898 33.9648056 34.3250961 34.6794853 35.0685501 35.4479713 35.7998734 36.1491852 36.5352249 36.8997345 37.3005371 37.6411667 38.0309448 38.4317169 38.8256264 39.170784 39.5207672 39.9253311 40.3634911 40.8308334 41.2765579 41.717247 42.1731644 42.6613617 43.1181641 43.6291313 44.1388016 44.6572227 45.2449265 45.8354454 46.3628845 46.9823914 47.6556854 48.2839737 48.9850464 49.6583672 50.4373894 51.1902008 52.0282822 52.9298973 53.8645248 54.8933907 56.1368256 57.3958282 58.9717331 60.964325 63.1696625 66.2032776 71.0850677 80.8510361 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1424522 10.285676 10.394146 10.5286789 10.6630936 10.797184 10.947875 11.0911484 11.2435207 11.3841448 11.5035706 11.6962881 11.8421822 12.0082073 12.1897697 12.3335409 12.5121269 12.7093315 12.844243 13.0139236 13.2292194 13.4166889 13.6025162 13.7851143 13.9571953 14.1444054 14.3732643 14.6039257 14.8449183 15.057436 15.2549496 15.4582653 15.707056 15.9560804 16.2207451 16.4626884 16.71912 16.9306259 17.1747704 17.4547043 17.7465363 18.0158558 18.3105278 18.6441441 18.9390182 19.1991692 19.515625 19.8207092 20.1416473 20.3729935 20.6417484 20.9161453 21.1695194 21.45047 21.7114944 21.9638577 22.1644554 22.4579391 22.7299957 22.9844589 23.2724533 23.5343323 23.8442783 24.1433544 24.4472313 24.7523308 25.0525169 25.3294716 25.6260223 25.9308052 26.2297401 26.5370293 26.831543 27.1401577 27.4832764 27.8134727 28.0976696 28.4064732 28.7411728 29.0967331 29.4654484 29.8361855 30.2288628 30.5900154 31.0095901 31.4418411 31.9090004 32.4082336 32.9230194 33.5000572 34.1126938 34.7798996 35.540741 36.3512421 37.3699188 38.756897 40.6649055 43.2126389 48.1972771 113.634285 ------------------------------ Transdef: Tab for variable 5 0.86520052 2.68895435 3.13663721 3.4439826 3.72731543 3.94932365 4.10952282 4.24429083 4.37530518 4.51077604 4.62107468 4.71772146 4.82745075 4.91918755 5.00607872 5.07120132 5.14508724 5.21276522 5.2737875 5.33435297 5.3980751 5.4578476 5.5137825 5.55897617 5.61141634 5.66942358 5.72599792 5.7760725 5.8289237 5.87665558 5.92952538 5.97944069 6.02163601 6.07416344 6.11395645 6.16806507 6.21380901 6.25596619 6.29783392 6.34605122 6.39737797 6.44973469 6.49350214 6.53973866 6.58908176 6.63867188 6.68532658 6.73103571 6.78058863 6.82867098 6.87418938 6.92170715 6.96825171 7.01667643 7.06581306 7.12185001 7.17705917 7.22701693 7.28664303 7.33813667 7.39571667 7.44939613 7.49278069 7.55034113 7.61298323 7.66758728 7.73179674 7.79374886 7.85286808 7.92087793 7.98011303 8.04105759 8.09515762 8.15912056 8.22253036 8.27836132 8.34304333 8.41040611 8.47909832 8.53973675 8.60069847 8.67182541 8.73615551 8.80361176 8.8843298 8.95598793 9.04232407 9.12400436 9.21559334 9.30267525 9.40296268 9.50280285 9.62930679 9.77871609 9.93040276 10.1068621 10.3379288 10.6745358 11.1371794 11.9540606 18.1303024 ------------------------------ Transdef: Tab for variable 6 15.0069656 21.4458313 25.45644 26.6554375 27.6441479 28.6743431 29.5522728 30.4114952 31.182045 31.8138695 32.3267288 32.8796616 33.4358597 33.8929596 34.3697319 34.8429184 35.3120995 35.7627182 36.1920547 36.602829 37.0063629 37.4794731 37.8497963 38.2441406 38.6579895 39.0608444 39.5045242 39.8660202 40.2456436 40.6220551 41.0446548 41.4838028 41.9929199 42.4658432 42.872654 43.3230553 43.8116608 44.3806992 44.7989883 45.3951797 46.0355301 46.7488937 47.4869003 48.1517944 48.882782 49.453022 50.1546288 50.8191147 51.7652893 52.6290474 53.4345741 54.1761589 55.0468674 55.7993851 56.6312523 57.2909966 58.115509 58.6805496 59.5492477 60.3975143 61.2151642 62.0996017 62.9442368 63.7980804 64.6483002 65.4582062 66.223999 67.0366745 67.8182373 68.5730133 69.3625107 70.1434174 70.9665527 71.7515717 72.5038986 73.266922 74.0210876 74.8148956 75.6388168 76.4821548 77.295372 78.1016693 79.0201416 80.0030975 80.8816833 81.8593597 82.7773056 83.9322357 85.2568665 86.6729813 88.2067642 89.8419189 91.7518082 94.1962128 96.9400635 100.567886 104.323822 109.7995 117.923904 132.358063 269.818756 ------------------------------ Transdef: Tab for variable 7 30.1648712 32.5952454 33.7800217 34.5784073 35.2796478 35.7752647 36.264328 36.7347984 37.1370277 37.5932426 37.9981651 38.3034058 38.6223145 38.9460983 39.2702408 39.5998154 39.9366379 40.2290268 40.5724869 41.0172958 41.4502144 41.9021759 42.3125305 42.775322 43.2863693 43.9422607 44.6453552 45.1821976 45.8530083 46.7723618 47.831749 48.725975 49.6614761 50.7512283 51.841259 52.7053909 53.6836395 54.7987022 55.9326591 57.0165291 57.9680405 59.0387726 60.0515976 61.019989 61.6858292 62.6380539 63.5799637 64.5236664 65.4197235 66.2806549 67.2523117 68.1609039 69.0607071 69.9234085 70.7846832 71.6356506 72.465332 73.2347107 74.1616745 75.0160065 75.8614807 76.7354431 77.5377655 78.5499878 79.4278412 80.4807053 81.6399384 82.6705017 83.7925491 85.0748901 86.4131927 87.8626251 89.4120331 90.8828354 92.4112396 93.8594208 95.601181 97.3820496 99.3843689 101.203796 103.065842 105.310776 107.432014 109.762146 112.152122 114.627396 117.373657 120.35231 123.636292 127.132111 131.17955 135.728882 140.471466 145.84314 152.194901 160.073608 169.800415 183.390625 202.343384 234.414978 601.433411 ------------------------------ Transdef: Tab for variable 8 3.10723281 25.7800999 29.3197937 31.0800209 32.1653824 33.0283356 33.7522202 34.2653542 34.6655884 35.1233368 35.5569458 35.9632339 36.3204498 36.6019402 36.9267807 37.2432938 37.5958595 37.8703957 38.1320877 38.4358978 38.7354088 39.0109863 39.2804337 39.5608101 39.8348083 40.1788864 40.6174774 41.0321541 41.3535728 41.7676811 42.1647186 42.5806046 43.0720673 43.6705704 44.110527 44.5505104 45.1286392 45.74683 46.420639 47.0552406 47.7731819 48.4543152 49.1151657 49.7732506 50.4268036 51.1381912 51.8604126 52.6051712 53.3806381 54.1662598 54.9779587 55.7125702 56.542202 57.2292099 57.9803772 58.74189 59.4639206 60.1721725 60.8796997 61.385788 62.132019 62.8738861 63.6130066 64.4286957 65.0905762 65.7982864 66.4958801 67.2165375 67.990593 68.6750793 69.33535 70.0531769 70.783432 71.4791718 72.1749573 72.8680878 73.6380615 74.2835007 75.0428772 75.8158417 76.5977173 77.4347382 78.2520218 79.0293274 80.1072388 81.021492 82.0176468 83.0654755 84.296257 85.6981506 87.3264008 88.9783173 91.003952 93.0998611 95.9233398 99.6748047 104.204353 110.095818 119.748787 136.194855 374.426086 ------------------------------ Transdef: Tab for variable 9 48.8581314 63.2014923 65.398674 66.9754715 68.1417542 69.1759644 70.2430878 71.0649872 71.7733307 72.68367 73.5509949 74.3192749 75.0247879 75.5545273 76.2516479 76.8890839 77.4692535 78.1009674 78.7557602 79.4458923 80.0308075 80.7645264 81.300827 81.9527435 82.5562439 83.1961212 83.7591324 84.7780914 85.7527466 86.5710754 87.4660568 88.5627594 89.3535767 90.6509247 91.7663345 93.0086365 94.4461899 95.9184418 97.3285217 98.8507767 100.268417 101.633385 102.92981 104.647949 106.11335 107.57354 109.147797 110.485336 112.176285 113.689102 115.106995 116.60083 117.898468 119.383911 120.306664 121.684616 123.083099 124.471443 125.870102 127.192703 128.538605 129.826599 131.164749 132.55722 133.848541 135.095703 136.337006 137.467728 138.744003 139.960663 141.120087 142.314224 143.55629 144.769226 145.807632 146.957199 148.021011 149.069748 150.215851 151.32373 152.520599 153.659714 154.814148 156.103241 157.283691 158.502853 159.862152 161.172424 162.663513 164.22934 165.712585 167.471405 169.257263 171.347427 173.902161 176.942001 180.818481 186.751099 195.861313 217.841965 493.485443 ------------------------------ Transdef: Tab for variable 10 0.00602381537 1.1106689 1.4298948 1.63932014 1.8011291 1.9127233 2.01117468 2.09161973 2.16830826 2.23267746 2.28830194 2.3375082 2.38053083 2.42262411 2.45841765 2.48997211 2.52280235 2.5469203 2.57585239 2.60149527 2.6222949 2.64588451 2.6684885 2.69106936 2.71087766 2.72808433 2.74672055 2.76415443 2.77827454 2.79357147 2.80864263 2.82264185 2.83339882 2.84387994 2.85454988 2.86411047 2.87438917 2.88446951 2.89453983 2.90236545 2.91145563 2.91868019 2.92635489 2.93420982 2.94160604 2.94862652 2.95525002 2.96201825 2.96742463 2.97358203 2.97950649 2.98455834 2.98918176 2.99427176 2.99973631 3.00406504 3.00868654 3.01369858 3.01783538 3.02261782 3.02671432 3.03042984 3.03476763 3.03840828 3.04209304 3.04535317 3.04915929 3.05266166 3.05629873 3.0597086 3.06299877 3.06656623 3.06997204 3.0732255 3.0764389 3.07934093 3.08200455 3.08489847 3.08788943 3.0906477 3.09344864 3.09602976 3.09894133 3.10161018 3.10387897 3.10589027 3.10856557 3.11054897 3.11311913 3.11571264 3.11823225 3.12063408 3.12313271 3.12580061 3.12817907 3.13043976 3.1318984 3.13448906 3.13660479 3.13899469 3.1415863 ------------------------------ Transdef: Tab for variable 11 7.9870224E-06 0.00518098474 0.011274578 0.0179163814 0.023580078 0.0284945965 0.0351686478 0.0419034958 0.0487957001 0.0563078299 0.0618440174 0.0685017705 0.0759780407 0.0830224678 0.0898207724 0.0970789194 0.103598356 0.108251959 0.114738464 0.12049675 0.127022266 0.133294761 0.140253782 0.14591682 0.151998818 0.157821238 0.163616568 0.16929388 0.175246119 0.180242449 0.184969857 0.189989269 0.195328712 0.200707793 0.206185251 0.21118319 0.216587067 0.222394705 0.22757256 0.23218596 0.237391233 0.242941812 0.248276651 0.253533483 0.25909853 0.263867378 0.268867671 0.273959696 0.278902829 0.2838943 0.288689733 0.294103861 0.299624443 0.305078864 0.310432673 0.316091537 0.322384357 0.327709556 0.33327049 0.339251757 0.345699251 0.350578427 0.356348753 0.362259984 0.368114591 0.374774575 0.380405366 0.385743737 0.390569925 0.397220492 0.403627515 0.410367131 0.41714704 0.423206359 0.429620147 0.437033087 0.443050086 0.450266361 0.458477974 0.465931892 0.473145008 0.480274916 0.490435123 0.500184774 0.508873224 0.518998504 0.530196667 0.541552663 0.555497706 0.56915015 0.581657648 0.59663415 0.613411784 0.63191843 0.649009466 0.6681813 0.697302878 0.724881113 0.76978308 0.833765447 1.13430727 ------------------------------ Transdef: Tab for variable 12 0.101366282 0.164967582 0.183216959 0.198275805 0.209045738 0.218595937 0.227787659 0.235864311 0.243900344 0.251755714 0.258900464 0.266357839 0.27306667 0.279957354 0.285904527 0.292276382 0.298503757 0.304730594 0.309308708 0.315287203 0.320703447 0.325935781 0.331291586 0.33685112 0.342593014 0.347138703 0.351585537 0.35631156 0.361866653 0.367373437 0.372478306 0.376977384 0.382309109 0.387313217 0.392155707 0.397179663 0.400995493 0.404707223 0.408800602 0.412698269 0.416233778 0.42006135 0.423508823 0.427103937 0.430642486 0.434634477 0.437923789 0.441794306 0.44578284 0.449570596 0.454192281 0.457933545 0.461422563 0.465423226 0.469602615 0.473596931 0.47653836 0.480389535 0.485136807 0.48945272 0.494167924 0.499192387 0.503562927 0.508641005 0.513632894 0.519377351 0.524846673 0.529698372 0.535980463 0.541257322 0.547636628 0.553565681 0.559278846 0.565526128 0.57164216 0.57893163 0.585602343 0.59283638 0.598953128 0.605809808 0.614321351 0.621811569 0.629857123 0.637893677 0.647538543 0.657091618 0.665000081 0.674302936 0.683157146 0.695542574 0.706087708 0.717056513 0.730865061 0.746778905 0.762752652 0.780237675 0.800041556 0.824916124 0.855596066 0.900168538 1.13770998 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.7146225 22.6064281 23.4132614 24.0083084 24.6219273 25.1999893 25.7497349 26.2533569 26.810276 27.2139854 27.6366272 28.1246643 28.5672417 28.9693909 29.3739376 29.7036819 30.0936413 30.4578438 30.8379803 31.1084061 31.5337009 31.8921356 32.3186493 32.6409225 33.0699539 33.4085846 33.7989807 34.2082977 34.5441284 34.9394226 35.2849808 35.6644058 36.0492439 36.331665 36.7987785 37.2143059 37.6319885 37.9927292 38.3956604 38.7995529 39.2001152 39.5930862 39.9834671 40.4586945 40.8725204 41.3045616 41.7435989 42.1902542 42.6280365 43.0302277 43.4947929 43.9410362 44.4155273 44.8958893 45.3847656 45.9051971 46.4208908 46.8794823 47.358326 47.8342819 48.3218384 48.8077087 49.345829 49.8465347 50.4484634 51.0438614 51.5987396 52.1877365 52.7900314 53.3671188 53.9605827 54.5391693 55.1664734 55.8989601 56.611969 57.31987 58.0154419 58.7017365 59.5155716 60.2392502 61.1046371 62.0096588 62.9921112 64.0449219 65.0172119 66.2037048 67.2582855 68.5623627 69.9268646 71.3647003 73.2656937 75.0435181 77.210968 79.931778 83.0456924 86.7171326 89.8754883 95.2476654 107.846756 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.7811069 11.2472019 11.6372585 12.0866909 12.4918365 12.902626 13.2535744 13.6089954 13.886858 14.2405453 14.5623779 14.9149513 15.2865334 15.5820465 15.8649158 16.2349033 16.5595436 16.8406563 17.1348972 17.5099258 17.8053741 18.0974846 18.3962555 18.6918831 18.9954758 19.3321552 19.6900749 20.0184326 20.3368797 20.6152344 20.9236965 21.2499199 21.5883331 21.8514271 22.1114464 22.3706551 22.6662998 23.0156307 23.3062878 23.5814571 23.8904877 24.1911793 24.4860191 24.8067684 25.091423 25.3850956 25.6238976 25.9058266 26.1721153 26.4602299 26.758831 27.0582657 27.3149834 27.5985451 27.8970108 28.1590576 28.4326859 28.747139 29.0694885 29.392189 29.7033348 30.0233154 30.3550339 30.6693287 31.0150852 31.3435669 31.6788082 32.019268 32.3755798 32.7125092 33.0769844 33.4207153 33.6615562 34.0575943 34.4272995 34.8007507 35.2252808 35.628849 36.0894279 36.5106201 37.0172272 37.5434494 38.081131 38.6680107 39.261898 39.9616089 40.6317368 41.3867645 42.1382141 43.0516167 44.0532837 45.1524734 46.3878708 47.7591629 49.382328 51.994503 54.6921082 58.9791336 65.3103943 137.41864 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 66.1 52.3 55.1 31.2 49.8 63.9 56.6 64.6 -25.1 -21.6 -43.9 20.9 30.2 2 66.1 100.0 70.3 64.4 36.9 69.2 94.8 77.0 92.4 -42.2 -29.8 -56.7 38.9 39.5 3 52.3 70.3 100.0 53.2 15.0 39.6 72.5 59.2 76.5 -13.9 -33.0 -63.4 67.7 32.7 4 55.1 64.4 53.2 100.0 17.8 39.5 65.2 55.3 69.5 -12.8 -33.9 -67.6 28.8 74.1 5 31.2 36.9 15.0 17.8 100.0 84.3 10.8 59.6 57.0 25.2 -10.3 -14.7 0.8 6.7 6 49.8 69.2 39.6 39.5 84.3 100.0 49.4 80.4 79.3 -5.0 -19.2 -33.9 16.8 21.7 7 63.9 94.8 72.5 65.2 10.8 49.4 100.0 68.7 81.9 -51.1 -28.7 -57.0 42.4 41.5 8 56.6 77.0 59.2 55.3 59.6 80.4 68.7 100.0 84.8 -9.7 -27.9 -49.7 32.1 34.4 9 64.6 92.4 76.5 69.5 57.0 79.3 81.9 84.8 100.0 -18.5 -33.0 -62.5 44.3 44.3 10 -25.1 -42.2 -13.9 -12.8 25.2 -5.0 -51.1 -9.7 -18.5 100.0 2.8 9.4 -5.6 -6.0 11 -21.6 -29.8 -33.0 -33.9 -10.3 -19.2 -28.7 -27.9 -33.0 2.8 100.0 55.2 -18.0 -24.1 12 -43.9 -56.7 -63.4 -67.6 -14.7 -33.9 -57.0 -49.7 -62.5 9.4 55.2 100.0 -36.6 -44.1 13 20.9 38.9 67.7 28.8 0.8 16.8 42.4 32.1 44.3 -5.6 -18.0 -36.6 100.0 51.5 14 30.2 39.5 32.7 74.1 6.7 21.7 41.5 34.4 44.3 -6.0 -24.1 -44.1 51.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 171.535232 TOTAL CORRELATION OF ALL VARIABLES 72.3186094 ROUND 1: MAX CORR ( 72.3183189) AFTER KILLING INPUT VARIABLE 8 CONTR 0.20497755 ROUND 2: MAX CORR ( 72.3156296) AFTER KILLING INPUT VARIABLE 14 CONTR 0.623675969 ROUND 3: MAX CORR ( 72.3102238) AFTER KILLING INPUT VARIABLE 6 CONTR 0.884197327 ROUND 4: MAX CORR ( 72.3037561) AFTER KILLING INPUT VARIABLE 2 CONTR 0.96712506 ROUND 5: MAX CORR ( 72.2924854) AFTER KILLING INPUT VARIABLE 11 CONTR 1.27659649 ROUND 6: MAX CORR ( 72.2552483) AFTER KILLING INPUT VARIABLE 12 CONTR 2.32002824 ROUND 7: MAX CORR ( 71.9543978) AFTER KILLING INPUT VARIABLE 10 CONTR 6.58677039 ROUND 8: MAX CORR ( 71.1903961) AFTER KILLING INPUT VARIABLE 13 CONTR 10.4576706 ROUND 9: MAX CORR ( 70.136668) AFTER KILLING INPUT VARIABLE 3 CONTR 12.2032901 ROUND 10: MAX CORR ( 69.8787192) AFTER KILLING INPUT VARIABLE 9 CONTR 6.00972585 ROUND 11: MAX CORR ( 68.3810676) AFTER KILLING INPUT VARIABLE 4 CONTR 14.3897533 ROUND 12: MAX CORR ( 63.8555463) AFTER KILLING INPUT VARIABLE 5 CONTR 24.4630254 LAST REMAINING VARIABLE: 7 total correlation to target: 72.3186094 % total significance: 139.90716 sigma correlations of single variables to target: variable 2: 66.0782113 % , in sigma: 127.834522 variable 3: 52.324458 % , in sigma: 101.226591 variable 4: 55.0832385 % , in sigma: 106.563712 variable 5: 31.2117339 % , in sigma: 60.3820383 variable 6: 49.8327643 % , in sigma: 96.406175 variable 7: 63.8555463 % , in sigma: 123.534567 variable 8: 56.6356333 % , in sigma: 109.566966 variable 9: 64.5853091 % , in sigma: 124.946362 variable 10: -25.1354358 % , in sigma: 48.6268674 variable 11: -21.6259823 % , in sigma: 41.8374992 variable 12: -43.8709961 % , in sigma: 84.872573 variable 13: 20.8768884 % , in sigma: 40.3883065 variable 14: 30.2017735 % , in sigma: 58.4281748 variables sorted by significance: 1 most relevant variable 7 corr 63.855545 , in sigma: 123.534565 2 most relevant variable 5 corr 24.463026 , in sigma: 47.3260275 3 most relevant variable 4 corr 14.3897533 , in sigma: 27.8383329 4 most relevant variable 9 corr 6.00972605 , in sigma: 11.626381 5 most relevant variable 3 corr 12.20329 , in sigma: 23.6084136 6 most relevant variable 13 corr 10.4576702 , in sigma: 20.2313478 7 most relevant variable 10 corr 6.58677053 , in sigma: 12.7427279 8 most relevant variable 12 corr 2.32002831 , in sigma: 4.48831322 9 most relevant variable 11 corr 1.27659655 , in sigma: 2.46969623 10 most relevant variable 2 corr 0.967125058 , in sigma: 1.8709945 11 most relevant variable 6 corr 0.884197354 , in sigma: 1.71056304 12 most relevant variable 14 corr 0.623675942 , in sigma: 1.20655984 13 most relevant variable 8 corr 0.204977557 , in sigma: 0.396548386 global correlations between input variables: variable 2: 99.2120739 % variable 3: 93.7210185 % variable 4: 92.734854 % variable 5: 95.1708975 % variable 6: 94.7175225 % variable 7: 98.8321796 % variable 8: 90.6774615 % variable 9: 98.8117631 % variable 10: 72.3332875 % variable 11: 56.2172162 % variable 12: 80.6345477 % variable 13: 86.332518 % variable 14: 88.7019125 % significance loss when removing single variables: variable 2: corr = 1.01026406 % , sigma = 1.95445097 variable 3: corr = 14.071662 % , sigma = 27.2229552 variable 4: corr = 12.6711236 % , sigma = 24.5134818 variable 5: corr = 15.8232524 % , sigma = 30.6115717 variable 6: corr = 0.892368736 % , sigma = 1.72637135 variable 7: corr = 8.54711571 % , sigma = 16.5352002 variable 8: corr = 0.20497755 % , sigma = 0.396548372 variable 9: corr = 9.78765907 % , sigma = 18.9351481 variable 10: corr = 6.3101336 % , sigma = 12.2075477 variable 11: corr = 1.276822 % , sigma = 2.47013239 variable 12: corr = 1.58792811 % , sigma = 3.07199646 variable 13: corr = 6.84717573 % , sigma = 13.2465062 variable 14: corr = 0.6255384 % , sigma = 1.21016294 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 40.435421 sigma out 15 active outputs RANK 2 NODE 8 --> 26.992897 sigma out 15 active outputs RANK 3 NODE 9 --> 26.4396706 sigma out 15 active outputs RANK 4 NODE 2 --> 25.1515713 sigma out 15 active outputs RANK 5 NODE 1 --> 24.9201107 sigma out 15 active outputs RANK 6 NODE 3 --> 21.8612175 sigma out 15 active outputs RANK 7 NODE 4 --> 19.8199959 sigma out 15 active outputs RANK 8 NODE 7 --> 15.8773327 sigma out 15 active outputs RANK 9 NODE 6 --> 11.5748043 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 60.2358437 sigma in 9act. ( 59.7100716 sig out 1act.) RANK 2 NODE 2 --> 17.0259342 sigma in 9act. ( 23.0908127 sig out 1act.) RANK 3 NODE 13 --> 15.9439354 sigma in 9act. ( 14.0401134 sig out 1act.) RANK 4 NODE 14 --> 15.7031851 sigma in 9act. ( 16.7044563 sig out 1act.) RANK 5 NODE 1 --> 14.6952324 sigma in 9act. ( 14.6568985 sig out 1act.) RANK 6 NODE 3 --> 14.3921099 sigma in 9act. ( 16.5904255 sig out 1act.) RANK 7 NODE 11 --> 14.3324814 sigma in 9act. ( 14.4713125 sig out 1act.) RANK 8 NODE 8 --> 11.9139032 sigma in 9act. ( 13.0258541 sig out 1act.) RANK 9 NODE 15 --> 10.6375341 sigma in 9act. ( 10.6225462 sig out 1act.) RANK 10 NODE 9 --> 9.17029667 sigma in 9act. ( 10.668395 sig out 1act.) RANK 11 NODE 6 --> 8.11367416 sigma in 9act. ( 3.80359483 sig out 1act.) RANK 12 NODE 12 --> 6.20869637 sigma in 9act. ( 7.82586622 sig out 1act.) RANK 13 NODE 5 --> 6.20696688 sigma in 9act. ( 8.0218153 sig out 1act.) RANK 14 NODE 10 --> 6.06186771 sigma in 9act. ( 4.08302259 sig out 1act.) RANK 15 NODE 7 --> 2.59510493 sigma in 9act. ( 1.92982388 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 59.7100716 sigma out 1act.( 60.2358437 sig in 9act.) RANK 2 NODE 2 --> 23.0908127 sigma out 1act.( 17.0259342 sig in 9act.) RANK 3 NODE 14 --> 16.7044563 sigma out 1act.( 15.7031851 sig in 9act.) RANK 4 NODE 3 --> 16.5904255 sigma out 1act.( 14.3921099 sig in 9act.) RANK 5 NODE 1 --> 14.6568985 sigma out 1act.( 14.6952324 sig in 9act.) RANK 6 NODE 11 --> 14.4713125 sigma out 1act.( 14.3324814 sig in 9act.) RANK 7 NODE 13 --> 14.0401134 sigma out 1act.( 15.9439354 sig in 9act.) RANK 8 NODE 8 --> 13.0258541 sigma out 1act.( 11.9139032 sig in 9act.) RANK 9 NODE 9 --> 10.668395 sigma out 1act.( 9.17029667 sig in 9act.) RANK 10 NODE 15 --> 10.6225462 sigma out 1act.( 10.6375341 sig in 9act.) RANK 11 NODE 5 --> 8.0218153 sigma out 1act.( 6.20696688 sig in 9act.) RANK 12 NODE 12 --> 7.82586622 sigma out 1act.( 6.20869637 sig in 9act.) RANK 13 NODE 10 --> 4.08302259 sigma out 1act.( 6.06186771 sig in 9act.) RANK 14 NODE 6 --> 3.80359483 sigma out 1act.( 8.11367416 sig in 9act.) RANK 15 NODE 7 --> 1.92982388 sigma out 1act.( 2.59510493 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 76.3603973 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 5 --> 39.5710449 sigma out 15 active outputs RANK 2 NODE 2 --> 26.8728752 sigma out 15 active outputs RANK 3 NODE 9 --> 26.4252319 sigma out 15 active outputs RANK 4 NODE 1 --> 26.2769794 sigma out 15 active outputs RANK 5 NODE 8 --> 26.1570816 sigma out 15 active outputs RANK 6 NODE 4 --> 20.9268074 sigma out 15 active outputs RANK 7 NODE 3 --> 20.6119404 sigma out 15 active outputs RANK 8 NODE 7 --> 16.9004784 sigma out 15 active outputs RANK 9 NODE 6 --> 12.4873772 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 58.1508255 sigma in 9act. ( 55.7953835 sig out 1act.) RANK 2 NODE 2 --> 24.6444664 sigma in 9act. ( 21.7177391 sig out 1act.) RANK 3 NODE 14 --> 15.6822071 sigma in 9act. ( 15.745657 sig out 1act.) RANK 4 NODE 3 --> 15.2078457 sigma in 9act. ( 15.4314404 sig out 1act.) RANK 5 NODE 11 --> 13.9310932 sigma in 9act. ( 13.3810987 sig out 1act.) RANK 6 NODE 8 --> 12.8595991 sigma in 9act. ( 11.9407415 sig out 1act.) RANK 7 NODE 9 --> 12.812582 sigma in 9act. ( 10.500514 sig out 1act.) RANK 8 NODE 1 --> 12.467186 sigma in 9act. ( 12.7649117 sig out 1act.) RANK 9 NODE 13 --> 11.3877363 sigma in 9act. ( 10.6049156 sig out 1act.) RANK 10 NODE 5 --> 9.87875652 sigma in 9act. ( 8.10978031 sig out 1act.) RANK 11 NODE 12 --> 9.74319458 sigma in 9act. ( 7.55714369 sig out 1act.) RANK 12 NODE 15 --> 9.13104725 sigma in 9act. ( 9.25869179 sig out 1act.) RANK 13 NODE 6 --> 7.93152428 sigma in 9act. ( 2.77843094 sig out 1act.) RANK 14 NODE 10 --> 5.27625179 sigma in 9act. ( 3.10481048 sig out 1act.) RANK 15 NODE 7 --> 4.88754559 sigma in 9act. ( 2.11371136 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 55.7953835 sigma out 1act.( 58.1508255 sig in 9act.) RANK 2 NODE 2 --> 21.7177391 sigma out 1act.( 24.6444664 sig in 9act.) RANK 3 NODE 14 --> 15.745657 sigma out 1act.( 15.6822071 sig in 9act.) RANK 4 NODE 3 --> 15.4314404 sigma out 1act.( 15.2078457 sig in 9act.) RANK 5 NODE 11 --> 13.3810987 sigma out 1act.( 13.9310932 sig in 9act.) RANK 6 NODE 1 --> 12.7649117 sigma out 1act.( 12.467186 sig in 9act.) RANK 7 NODE 8 --> 11.9407415 sigma out 1act.( 12.8595991 sig in 9act.) RANK 8 NODE 13 --> 10.6049156 sigma out 1act.( 11.3877363 sig in 9act.) RANK 9 NODE 9 --> 10.500514 sigma out 1act.( 12.812582 sig in 9act.) RANK 10 NODE 15 --> 9.25869179 sigma out 1act.( 9.13104725 sig in 9act.) RANK 11 NODE 5 --> 8.10978031 sigma out 1act.( 9.87875652 sig in 9act.) RANK 12 NODE 12 --> 7.55714369 sigma out 1act.( 9.74319458 sig in 9act.) RANK 13 NODE 10 --> 3.10481048 sigma out 1act.( 5.27625179 sig in 9act.) RANK 14 NODE 6 --> 2.77843094 sigma out 1act.( 7.93152428 sig in 9act.) RANK 15 NODE 7 --> 2.11371136 sigma out 1act.( 4.88754559 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 70.7712708 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.43601945 *** contribution from regularisation: 0.00329626189 *** contribution from error: -0.439315706 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.480594337 *** contribution from regularisation: 0.00235517533 *** contribution from error: -0.482949525 *********************************************** -----------------> Test sample ENTER BFGS code START -44353.1855 -0.99557656 -0.28265354 EXIT FROM BFGS code FG_START 0. -0.99557656 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.505261421 *** contribution from regularisation: 0.0021384994 *** contribution from error: -0.507399917 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -46619.9686 -0.99557656 41.1194649 EXIT FROM BFGS code FG_LNSRCH 0. -0.988103986 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.549258947 *** contribution from regularisation: 0.00260811206 *** contribution from error: -0.551867068 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50679.5716 -0.988103986 126.404724 EXIT FROM BFGS code NEW_X -50679.5716 -0.988103986 126.404724 ENTER BFGS code NEW_X -50679.5716 -0.988103986 126.404724 EXIT FROM BFGS code FG_LNSRCH 0. -0.948843777 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.555031478 *** contribution from regularisation: 0.00280458434 *** contribution from error: -0.557836056 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51212.2013 -0.948843777 -45.2982483 EXIT FROM BFGS code NEW_X -51212.2013 -0.948843777 -45.2982483 ENTER BFGS code NEW_X -51212.2013 -0.948843777 -45.2982483 EXIT FROM BFGS code FG_LNSRCH 0. -0.961212456 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.555821538 *** contribution from regularisation: 0.00262240926 *** contribution from error: -0.558443964 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51285.0972 -0.961212456 33.1475716 EXIT FROM BFGS code NEW_X -51285.0972 -0.961212456 33.1475716 ENTER BFGS code NEW_X -51285.0972 -0.961212456 33.1475716 EXIT FROM BFGS code FG_LNSRCH 0. -0.955772817 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.556152642 *** contribution from regularisation: 0.00248366618 *** contribution from error: -0.558636308 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51315.65 -0.955772817 10.1931858 EXIT FROM BFGS code NEW_X -51315.65 -0.955772817 10.1931858 ENTER BFGS code NEW_X -51315.65 -0.955772817 10.1931858 EXIT FROM BFGS code FG_LNSRCH 0. -0.948699415 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.556424499 *** contribution from regularisation: 0.00245113228 *** contribution from error: -0.55887562 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51340.7308 -0.948699415 -6.55674887 EXIT FROM BFGS code NEW_X -51340.7308 -0.948699415 -6.55674887 ENTER BFGS code NEW_X -51340.7308 -0.948699415 -6.55674887 EXIT FROM BFGS code FG_LNSRCH 0. -0.934350491 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.556846976 *** contribution from regularisation: 0.00238503632 *** contribution from error: -0.559231997 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51379.7114 -0.934350491 -26.8183784 EXIT FROM BFGS code NEW_X -51379.7114 -0.934350491 -26.8183784 ENTER BFGS code NEW_X -51379.7114 -0.934350491 -26.8183784 EXIT FROM BFGS code FG_LNSRCH 0. -0.906536043 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 39.6841927 sigma out 15 active outputs RANK 2 NODE 1 --> 32.2942886 sigma out 15 active outputs RANK 3 NODE 7 --> 19.0281734 sigma out 15 active outputs RANK 4 NODE 3 --> 18.3167915 sigma out 15 active outputs RANK 5 NODE 4 --> 16.5175419 sigma out 15 active outputs RANK 6 NODE 9 --> 15.6563826 sigma out 15 active outputs RANK 7 NODE 8 --> 14.3024111 sigma out 15 active outputs RANK 8 NODE 5 --> 13.4197645 sigma out 15 active outputs RANK 9 NODE 6 --> 11.5777969 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 34.3674011 sigma in 9act. ( 25.6823616 sig out 1act.) RANK 2 NODE 2 --> 32.3923531 sigma in 9act. ( 25.5998478 sig out 1act.) RANK 3 NODE 9 --> 25.6415157 sigma in 9act. ( 27.0622234 sig out 1act.) RANK 4 NODE 5 --> 23.1710644 sigma in 9act. ( 20.8447609 sig out 1act.) RANK 5 NODE 12 --> 17.3747215 sigma in 9act. ( 13.7109137 sig out 1act.) RANK 6 NODE 1 --> 11.4257355 sigma in 9act. ( 11.8352156 sig out 1act.) RANK 7 NODE 7 --> 11.2663717 sigma in 9act. ( 10.7595968 sig out 1act.) RANK 8 NODE 14 --> 10.6706724 sigma in 9act. ( 10.0696096 sig out 1act.) RANK 9 NODE 3 --> 10.3115253 sigma in 9act. ( 9.2836237 sig out 1act.) RANK 10 NODE 15 --> 6.72167158 sigma in 9act. ( 6.0530591 sig out 1act.) RANK 11 NODE 8 --> 6.45895433 sigma in 9act. ( 4.485219 sig out 1act.) RANK 12 NODE 11 --> 5.0621438 sigma in 9act. ( 3.22413087 sig out 1act.) RANK 13 NODE 6 --> 4.63452244 sigma in 9act. ( 1.65568721 sig out 1act.) RANK 14 NODE 13 --> 2.62881613 sigma in 9act. ( 1.98490322 sig out 1act.) RANK 15 NODE 10 --> 2.59731579 sigma in 9act. ( 0.716910422 sig out 1act.) sorted by output significance RANK 1 NODE 9 --> 27.0622234 sigma out 1act.( 25.6415157 sig in 9act.) RANK 2 NODE 4 --> 25.6823616 sigma out 1act.( 34.3674011 sig in 9act.) RANK 3 NODE 2 --> 25.5998478 sigma out 1act.( 32.3923531 sig in 9act.) RANK 4 NODE 5 --> 20.8447609 sigma out 1act.( 23.1710644 sig in 9act.) RANK 5 NODE 12 --> 13.7109137 sigma out 1act.( 17.3747215 sig in 9act.) RANK 6 NODE 1 --> 11.8352156 sigma out 1act.( 11.4257355 sig in 9act.) RANK 7 NODE 7 --> 10.7595968 sigma out 1act.( 11.2663717 sig in 9act.) RANK 8 NODE 14 --> 10.0696096 sigma out 1act.( 10.6706724 sig in 9act.) RANK 9 NODE 3 --> 9.2836237 sigma out 1act.( 10.3115253 sig in 9act.) RANK 10 NODE 15 --> 6.0530591 sigma out 1act.( 6.72167158 sig in 9act.) RANK 11 NODE 8 --> 4.485219 sigma out 1act.( 6.45895433 sig in 9act.) RANK 12 NODE 11 --> 3.22413087 sigma out 1act.( 5.0621438 sig in 9act.) RANK 13 NODE 13 --> 1.98490322 sigma out 1act.( 2.62881613 sig in 9act.) RANK 14 NODE 6 --> 1.65568721 sigma out 1act.( 4.63452244 sig in 9act.) RANK 15 NODE 10 --> 0.716910422 sigma out 1act.( 2.59731579 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 56.4585152 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.557611704 *** contribution from regularisation: 0.00229816302 *** contribution from error: -0.55990988 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51450.2738 -0.906536043 -44.9265518 EXIT FROM BFGS code NEW_X -51450.2738 -0.906536043 -44.9265518 ENTER BFGS code NEW_X -51450.2738 -0.906536043 -44.9265518 EXIT FROM BFGS code FG_LNSRCH 0. -0.906252444 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.556187153 *** contribution from regularisation: 0.0024810757 *** contribution from error: -0.558668256 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51318.8345 -0.906252444 123.550995 EXIT FROM BFGS code FG_LNSRCH 0. -0.90646708 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.55804038 *** contribution from regularisation: 0.00215615868 *** contribution from error: -0.560196519 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51489.8279 -0.90646708 2.92976522 EXIT FROM BFGS code NEW_X -51489.8279 -0.90646708 2.92976522 ENTER BFGS code NEW_X -51489.8279 -0.90646708 2.92976522 EXIT FROM BFGS code FG_LNSRCH 0. -0.890449822 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.558214307 *** contribution from regularisation: 0.00239784527 *** contribution from error: -0.560612142 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51505.8767 -0.890449822 6.79342604 EXIT FROM BFGS code NEW_X -51505.8767 -0.890449822 6.79342604 ENTER BFGS code NEW_X -51505.8767 -0.890449822 6.79342604 EXIT FROM BFGS code FG_LNSRCH 0. -0.887576878 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.558441281 *** contribution from regularisation: 0.00225962931 *** contribution from error: -0.560700893 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51526.8171 -0.887576878 52.7005615 EXIT FROM BFGS code NEW_X -51526.8171 -0.887576878 52.7005615 ENTER BFGS code NEW_X -51526.8171 -0.887576878 52.7005615 EXIT FROM BFGS code FG_LNSRCH 0. -0.875593305 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.558535457 *** contribution from regularisation: 0.00228171749 *** contribution from error: -0.560817182 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51535.5094 -0.875593305 34.0146103 EXIT FROM BFGS code NEW_X -51535.5094 -0.875593305 34.0146103 ENTER BFGS code NEW_X -51535.5094 -0.875593305 34.0146103 EXIT FROM BFGS code FG_LNSRCH 0. -0.812522233 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.558998883 *** contribution from regularisation: 0.00225283694 *** contribution from error: -0.5612517 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51578.2653 -0.812522233 -28.6409149 EXIT FROM BFGS code NEW_X -51578.2653 -0.812522233 -28.6409149 ENTER BFGS code NEW_X -51578.2653 -0.812522233 -28.6409149 EXIT FROM BFGS code FG_LNSRCH 0. -0.763262331 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.559261143 *** contribution from regularisation: 0.00233202893 *** contribution from error: -0.561593175 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51602.4654 -0.763262331 -53.1719437 EXIT FROM BFGS code NEW_X -51602.4654 -0.763262331 -53.1719437 ENTER BFGS code NEW_X -51602.4654 -0.763262331 -53.1719437 EXIT FROM BFGS code FG_LNSRCH 0. -0.693675697 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.559629321 *** contribution from regularisation: 0.00235244795 *** contribution from error: -0.561981797 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51636.4369 -0.693675697 -18.3680153 EXIT FROM BFGS code NEW_X -51636.4369 -0.693675697 -18.3680153 ENTER BFGS code NEW_X -51636.4369 -0.693675697 -18.3680153 EXIT FROM BFGS code FG_LNSRCH 0. -0.667622924 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.55976361 *** contribution from regularisation: 0.00241207611 *** contribution from error: -0.562175691 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51648.8273 -0.667622924 4.76029301 EXIT FROM BFGS code NEW_X -51648.8273 -0.667622924 4.76029301 ENTER BFGS code NEW_X -51648.8273 -0.667622924 4.76029301 EXIT FROM BFGS code FG_LNSRCH 0. -0.687212288 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 50.2502632 sigma out 15 active outputs RANK 2 NODE 7 --> 34.3582382 sigma out 15 active outputs RANK 3 NODE 1 --> 33.3097267 sigma out 15 active outputs RANK 4 NODE 8 --> 28.1921787 sigma out 15 active outputs RANK 5 NODE 4 --> 21.441431 sigma out 15 active outputs RANK 6 NODE 3 --> 20.4974041 sigma out 15 active outputs RANK 7 NODE 5 --> 15.8493204 sigma out 15 active outputs RANK 8 NODE 9 --> 13.9078379 sigma out 15 active outputs RANK 9 NODE 6 --> 12.2944813 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 54.1994705 sigma in 9act. ( 56.7214127 sig out 1act.) RANK 2 NODE 9 --> 37.0403557 sigma in 9act. ( 38.4026489 sig out 1act.) RANK 3 NODE 2 --> 31.3042831 sigma in 9act. ( 26.8924503 sig out 1act.) RANK 4 NODE 4 --> 22.7994099 sigma in 9act. ( 23.8806267 sig out 1act.) RANK 5 NODE 1 --> 22.4121323 sigma in 9act. ( 22.9635353 sig out 1act.) RANK 6 NODE 12 --> 17.238245 sigma in 9act. ( 15.4689236 sig out 1act.) RANK 7 NODE 7 --> 14.7419548 sigma in 9act. ( 15.6576185 sig out 1act.) RANK 8 NODE 14 --> 10.8467398 sigma in 9act. ( 10.5827236 sig out 1act.) RANK 9 NODE 15 --> 8.57641602 sigma in 9act. ( 9.25803757 sig out 1act.) RANK 10 NODE 3 --> 7.03994799 sigma in 9act. ( 5.18473196 sig out 1act.) RANK 11 NODE 8 --> 2.61255622 sigma in 9act. ( 1.4539386 sig out 1act.) RANK 12 NODE 13 --> 2.21999574 sigma in 9act. ( 1.84025562 sig out 1act.) RANK 13 NODE 11 --> 1.82315671 sigma in 9act. ( 0.833374023 sig out 1act.) RANK 14 NODE 6 --> 1.6252116 sigma in 9act. ( 0.735702276 sig out 1act.) RANK 15 NODE 10 --> 0.980516315 sigma in 9act. ( 0.2426541 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 56.7214127 sigma out 1act.( 54.1994705 sig in 9act.) RANK 2 NODE 9 --> 38.4026489 sigma out 1act.( 37.0403557 sig in 9act.) RANK 3 NODE 2 --> 26.8924503 sigma out 1act.( 31.3042831 sig in 9act.) RANK 4 NODE 4 --> 23.8806267 sigma out 1act.( 22.7994099 sig in 9act.) RANK 5 NODE 1 --> 22.9635353 sigma out 1act.( 22.4121323 sig in 9act.) RANK 6 NODE 7 --> 15.6576185 sigma out 1act.( 14.7419548 sig in 9act.) RANK 7 NODE 12 --> 15.4689236 sigma out 1act.( 17.238245 sig in 9act.) RANK 8 NODE 14 --> 10.5827236 sigma out 1act.( 10.8467398 sig in 9act.) RANK 9 NODE 15 --> 9.25803757 sigma out 1act.( 8.57641602 sig in 9act.) RANK 10 NODE 3 --> 5.18473196 sigma out 1act.( 7.03994799 sig in 9act.) RANK 11 NODE 13 --> 1.84025562 sigma out 1act.( 2.21999574 sig in 9act.) RANK 12 NODE 8 --> 1.4539386 sigma out 1act.( 2.61255622 sig in 9act.) RANK 13 NODE 11 --> 0.833374023 sigma out 1act.( 1.82315671 sig in 9act.) RANK 14 NODE 6 --> 0.735702276 sigma out 1act.( 1.6252116 sig in 9act.) RANK 15 NODE 10 --> 0.2426541 sigma out 1act.( 0.980516315 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 85.021904 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.559844315 *** contribution from regularisation: 0.00237053097 *** contribution from error: -0.562214851 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51656.273 -0.687212288 15.4648304 EXIT FROM BFGS code NEW_X -51656.273 -0.687212288 15.4648304 ENTER BFGS code NEW_X -51656.273 -0.687212288 15.4648304 EXIT FROM BFGS code FG_LNSRCH 0. -0.681423545 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.559888542 *** contribution from regularisation: 0.00235235901 *** contribution from error: -0.562240899 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51660.3583 -0.681423545 6.5909524 EXIT FROM BFGS code NEW_X -51660.3583 -0.681423545 6.5909524 ENTER BFGS code NEW_X -51660.3583 -0.681423545 6.5909524 EXIT FROM BFGS code FG_LNSRCH 0. -0.659802735 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.559954047 *** contribution from regularisation: 0.00229889364 *** contribution from error: -0.562252939 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51666.401 -0.659802735 11.2846899 EXIT FROM BFGS code NEW_X -51666.401 -0.659802735 11.2846899 ENTER BFGS code NEW_X -51666.401 -0.659802735 11.2846899 EXIT FROM BFGS code FG_LNSRCH 0. -0.630236983 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.559964299 *** contribution from regularisation: 0.00226468989 *** contribution from error: -0.562228978 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51667.3486 -0.630236983 -8.69876957 EXIT FROM BFGS code NEW_X -51667.3486 -0.630236983 -8.69876957 ENTER BFGS code NEW_X -51667.3486 -0.630236983 -8.69876957 EXIT FROM BFGS code FG_LNSRCH 0. -0.605401576 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.559821725 *** contribution from regularisation: 0.00219717505 *** contribution from error: -0.562018871 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51654.1892 -0.605401576 94.5793915 EXIT FROM BFGS code FG_LNSRCH 0. -0.624270976 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.559737802 *** contribution from regularisation: 0.00250270986 *** contribution from error: -0.562240541 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51646.4467 -0.624270976 13.3162766 EXIT FROM BFGS code FG_LNSRCH 0. -0.629985809 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.559846342 *** contribution from regularisation: 0.00238411012 *** contribution from error: -0.562230468 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51656.4636 -0.629985809 -8.06414127 EXIT FROM BFGS code FG_LNSRCH 0. -0.63023597 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.559858918 *** contribution from regularisation: 0.00237010326 *** contribution from error: -0.562229037 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51657.6228 -0.63023597 -9.00737 EXIT FROM BFGS code FG_LNSRCH 0. -0.630236983 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.5598647 *** contribution from regularisation: 0.00236432441 *** contribution from error: -0.562229037 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51658.1554 -0.630236983 -9.07901955 EXIT FROM BFGS code FG_LNSRCH 0. -0.630236983 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.559869528 *** contribution from regularisation: 0.00235951436 *** contribution from error: -0.562229037 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51658.5992 -0.630236983 -9.13262939 EXIT FROM BFGS code FG_LNSRCH 0. -0.630236983 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 50.2049789 sigma out 15 active outputs RANK 2 NODE 7 --> 32.172039 sigma out 15 active outputs RANK 3 NODE 1 --> 31.7456989 sigma out 15 active outputs RANK 4 NODE 8 --> 27.0464516 sigma out 15 active outputs RANK 5 NODE 4 --> 20.7868385 sigma out 15 active outputs RANK 6 NODE 3 --> 20.4410172 sigma out 15 active outputs RANK 7 NODE 5 --> 16.8739166 sigma out 15 active outputs RANK 8 NODE 6 --> 11.5159035 sigma out 15 active outputs RANK 9 NODE 9 --> 11.3852463 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 54.7184868 sigma in 9act. ( 58.301857 sig out 1act.) RANK 2 NODE 9 --> 34.6393929 sigma in 9act. ( 35.0797348 sig out 1act.) RANK 3 NODE 2 --> 29.6231804 sigma in 9act. ( 26.836935 sig out 1act.) RANK 4 NODE 1 --> 21.6022034 sigma in 9act. ( 23.0801449 sig out 1act.) RANK 5 NODE 4 --> 20.9174747 sigma in 9act. ( 20.7910919 sig out 1act.) RANK 6 NODE 12 --> 16.0458508 sigma in 9act. ( 15.3203154 sig out 1act.) RANK 7 NODE 7 --> 14.921237 sigma in 9act. ( 16.2959175 sig out 1act.) RANK 8 NODE 14 --> 10.7802582 sigma in 9act. ( 10.1681147 sig out 1act.) RANK 9 NODE 15 --> 8.02783871 sigma in 9act. ( 9.23203945 sig out 1act.) RANK 10 NODE 3 --> 6.30310249 sigma in 9act. ( 4.73233271 sig out 1act.) RANK 11 NODE 8 --> 2.39645243 sigma in 9act. ( 1.47867692 sig out 1act.) RANK 12 NODE 13 --> 2.08400321 sigma in 9act. ( 1.89587855 sig out 1act.) RANK 13 NODE 11 --> 1.52773988 sigma in 9act. ( 0.472082585 sig out 1act.) RANK 14 NODE 6 --> 1.52325845 sigma in 9act. ( 0.700097501 sig out 1act.) RANK 15 NODE 10 --> 0.89740169 sigma in 9act. ( 0.204803646 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 58.301857 sigma out 1act.( 54.7184868 sig in 9act.) RANK 2 NODE 9 --> 35.0797348 sigma out 1act.( 34.6393929 sig in 9act.) RANK 3 NODE 2 --> 26.836935 sigma out 1act.( 29.6231804 sig in 9act.) RANK 4 NODE 1 --> 23.0801449 sigma out 1act.( 21.6022034 sig in 9act.) RANK 5 NODE 4 --> 20.7910919 sigma out 1act.( 20.9174747 sig in 9act.) RANK 6 NODE 7 --> 16.2959175 sigma out 1act.( 14.921237 sig in 9act.) RANK 7 NODE 12 --> 15.3203154 sigma out 1act.( 16.0458508 sig in 9act.) RANK 8 NODE 14 --> 10.1681147 sigma out 1act.( 10.7802582 sig in 9act.) RANK 9 NODE 15 --> 9.23203945 sigma out 1act.( 8.02783871 sig in 9act.) RANK 10 NODE 3 --> 4.73233271 sigma out 1act.( 6.30310249 sig in 9act.) RANK 11 NODE 13 --> 1.89587855 sigma out 1act.( 2.08400321 sig in 9act.) RANK 12 NODE 8 --> 1.47867692 sigma out 1act.( 2.39645243 sig in 9act.) RANK 13 NODE 6 --> 0.700097501 sigma out 1act.( 1.52325845 sig in 9act.) RANK 14 NODE 11 --> 0.472082585 sigma out 1act.( 1.52773988 sig in 9act.) RANK 15 NODE 10 --> 0.204803646 sigma out 1act.( 0.89740169 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 83.8611908 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.559875429 *** contribution from regularisation: 0.00235358835 *** contribution from error: -0.562229037 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51659.146 -0.630236983 -9.21318626 EXIT FROM BFGS code FG_LNSRCH 0. -0.630236983 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.559880495 *** contribution from regularisation: 0.00234852638 *** contribution from error: -0.562229037 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51659.6131 -0.630236983 -9.17952538 EXIT FROM BFGS code NEW_X -51659.6131 -0.630236983 -9.17952538 ENTER BFGS code NEW_X -51659.6131 -0.630236983 -9.17952538 EXIT FROM BFGS code CONVERGENC -51659.6131 -0.630236983 -9.17952538 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 78.6407928 sigma out 15 active outputs RANK 2 NODE 7 --> 51.2008514 sigma out 15 active outputs RANK 3 NODE 1 --> 50.2601089 sigma out 15 active outputs RANK 4 NODE 8 --> 42.8520851 sigma out 15 active outputs RANK 5 NODE 3 --> 33.0705757 sigma out 15 active outputs RANK 6 NODE 4 --> 32.3364372 sigma out 15 active outputs RANK 7 NODE 5 --> 26.6094723 sigma out 15 active outputs RANK 8 NODE 9 --> 18.4739799 sigma out 15 active outputs RANK 9 NODE 6 --> 18.4212742 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 5 --> 86.4482574 sigma in 9act. ( 93.8966599 sig out 1act.) RANK 2 NODE 9 --> 54.5835724 sigma in 9act. ( 56.6497917 sig out 1act.) RANK 3 NODE 2 --> 46.8968163 sigma in 9act. ( 42.2350235 sig out 1act.) RANK 4 NODE 1 --> 34.7154198 sigma in 9act. ( 37.2168694 sig out 1act.) RANK 5 NODE 4 --> 33.3196106 sigma in 9act. ( 33.1855507 sig out 1act.) RANK 6 NODE 12 --> 24.959753 sigma in 9act. ( 24.21451 sig out 1act.) RANK 7 NODE 7 --> 23.4533844 sigma in 9act. ( 26.3300781 sig out 1act.) RANK 8 NODE 14 --> 16.8819218 sigma in 9act. ( 16.3906116 sig out 1act.) RANK 9 NODE 15 --> 12.514185 sigma in 9act. ( 14.9249191 sig out 1act.) RANK 10 NODE 3 --> 9.46411419 sigma in 9act. ( 7.6999054 sig out 1act.) RANK 11 NODE 8 --> 3.14937282 sigma in 9act. ( 2.36695647 sig out 1act.) RANK 12 NODE 13 --> 2.86617613 sigma in 9act. ( 3.02861309 sig out 1act.) RANK 13 NODE 6 --> 1.7456435 sigma in 9act. ( 1.09614432 sig out 1act.) RANK 14 NODE 11 --> 1.63737118 sigma in 9act. ( 0.737467408 sig out 1act.) RANK 15 NODE 10 --> 0.928676009 sigma in 9act. ( 0.31101796 sig out 1act.) sorted by output significance RANK 1 NODE 5 --> 93.8966599 sigma out 1act.( 86.4482574 sig in 9act.) RANK 2 NODE 9 --> 56.6497917 sigma out 1act.( 54.5835724 sig in 9act.) RANK 3 NODE 2 --> 42.2350235 sigma out 1act.( 46.8968163 sig in 9act.) RANK 4 NODE 1 --> 37.2168694 sigma out 1act.( 34.7154198 sig in 9act.) RANK 5 NODE 4 --> 33.1855507 sigma out 1act.( 33.3196106 sig in 9act.) RANK 6 NODE 7 --> 26.3300781 sigma out 1act.( 23.4533844 sig in 9act.) RANK 7 NODE 12 --> 24.21451 sigma out 1act.( 24.959753 sig in 9act.) RANK 8 NODE 14 --> 16.3906116 sigma out 1act.( 16.8819218 sig in 9act.) RANK 9 NODE 15 --> 14.9249191 sigma out 1act.( 12.514185 sig in 9act.) RANK 10 NODE 3 --> 7.6999054 sigma out 1act.( 9.46411419 sig in 9act.) RANK 11 NODE 13 --> 3.02861309 sigma out 1act.( 2.86617613 sig in 9act.) RANK 12 NODE 8 --> 2.36695647 sigma out 1act.( 3.14937282 sig in 9act.) RANK 13 NODE 6 --> 1.09614432 sigma out 1act.( 1.7456435 sig in 9act.) RANK 14 NODE 11 --> 0.737467408 sigma out 1act.( 1.63737118 sig in 9act.) RANK 15 NODE 10 --> 0.31101796 sigma out 1act.( 0.928676009 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 134.695511 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.559864759 *** contribution from regularisation: 0.00236425595 *** contribution from error: -0.562229037 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27724 Closing output file done