NNInput NNInputs_115.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 197033 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 48691 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 48691 Chosen entries: 48691 Signal fraction: 1 Background fraction: 0.328235 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 48691 Entries to split: 48691 Test with : 24345 Train with : 24345 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 48691 for Signal Prepared event 0 for Signal with 48691 events ====Entry 0 Variable Ht : 147.2 Variable LepAPt : 33.8436 Variable LepBPt : 16.8195 Variable MetSigLeptonsJets : 7.93922 Variable MetSpec : 69.8321 Variable SumEtLeptonsJets : 77.3669 Variable VSumJetLeptonsPt : 74.5437 Variable addEt : 120.496 Variable dPhiLepSumMet : 2.77597 Variable dPhiLeptons : 0.349396 Variable dRLeptons : 0.409585 Variable lep1_E : 34.748 Variable lep2_E : 16.8224 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2115 Ht = 147.2 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.8439 LepAPt = 33.8436 LepBEt = 16.82 LepBPt = 16.8195 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 69.8321 MetDelPhi = 2.54203 MetSig = 5.42558 MetSigLeptonsJets = 7.93922 MetSpec = 69.8321 Mjj = 0 MostCentralJetEta = -1.25048 MtllMet = 121.128 Njets = 1 SB = 0 SumEt = 165.661 SumEtJets = 0 SumEtLeptonsJets = 77.3669 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 74.5437 addEt = 120.496 dPhiLepSumMet = 2.77597 dPhiLeptons = 0.349396 dRLeptons = 0.409585 diltype = 17 dimass = 9.74565 event = 4187 jet1_Et = 26.7039 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.748 lep2_E = 16.8224 rand = 0.999742 run = 237705 weight = 5.90147e-07 ===Show End Prepared event 10000 for Signal with 48691 events Prepared event 20000 for Signal with 48691 events Prepared event 30000 for Signal with 48691 events Prepared event 40000 for Signal with 48691 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.296491 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4729 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 197033 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4729 negative weights. Signal fraction: 62.5770149 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0046387 63.0413132 65.3478394 66.7623291 68.0144043 68.8894424 69.918808 70.6541214 71.3599472 72.2764435 72.9602432 73.7263794 74.3864288 74.9968567 75.5656891 76.2559204 76.8127747 77.3610611 77.9821701 78.4835358 79.0383606 79.6810913 80.2017212 80.7749786 81.2574921 81.9889908 82.5562439 83.2039108 83.820816 84.6229095 85.3408051 86.1996231 86.9869843 87.7969666 88.6593475 89.4842834 90.482605 91.4472733 92.2628479 93.1037521 93.8782043 94.6561432 95.4719238 96.3553696 97.3251953 98.1951523 99.0517426 99.7624664 100.586502 101.402817 102.131279 102.970627 103.872528 104.540161 105.455162 106.320282 107.112419 107.99958 108.770493 109.66008 110.55867 111.58075 112.621506 113.570084 114.714264 115.827278 117.183784 118.687531 119.833618 121.438599 123.009766 124.757301 126.600479 128.329865 129.941498 131.857056 133.828979 135.920013 138.047562 140.234879 142.38089 144.753372 147.035233 149.471786 152.378677 155.295425 158.565643 161.611145 164.68074 169.39212 174.001221 179.569366 185.631042 192.197327 200.389587 211.131561 224.025558 241.185547 266.811523 308.26712 871.385864 ------------------------------ Transdef: Tab for variable 3 20.0005035 20.2841568 20.526907 20.7847099 20.9943123 21.1983414 21.4303818 21.6581688 21.8818436 22.0701752 22.2509727 22.4482174 22.618639 22.8086433 23.0018444 23.1883736 23.3376541 23.5165787 23.7311478 23.9125938 24.1251373 24.3275528 24.509594 24.693634 24.8811111 25.0729523 25.2355347 25.4267883 25.6095886 25.8049393 26.0138531 26.1989174 26.3962879 26.5914574 26.8004684 27.0117683 27.1986275 27.3854103 27.6061211 27.7878838 27.9878349 28.1862984 28.3859749 28.6032181 28.8311577 29.0510941 29.2700768 29.5146122 29.7444801 29.9760704 30.1916733 30.4316616 30.6346645 30.8610802 31.1405373 31.3709202 31.6198063 31.8551331 32.1141129 32.3791618 32.6583023 32.8960953 33.1583252 33.4517059 33.7581367 34.0166283 34.2988739 34.6134415 34.9358597 35.2625961 35.6187515 35.9407501 36.3121986 36.6456528 36.9636383 37.3346863 37.67453 38.1229019 38.5548134 39.0174141 39.3598633 39.8867531 40.4001808 41.0059052 41.6126404 42.1981812 42.9629364 43.8075562 44.6981125 45.5950356 46.6003113 47.710434 49.0308609 50.7023735 52.5983658 55.0277023 57.8973999 61.6741333 67.4081421 78.861351 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0004082 10.0908585 10.1834087 10.2760077 10.3504581 10.4317207 10.5017519 10.5876503 10.681098 10.7668018 10.8545914 10.9491577 11.0440216 11.1340599 11.233654 11.3476229 11.434309 11.5158844 11.6080379 11.7293262 11.8479023 11.934598 12.0392656 12.1404667 12.2378082 12.3279285 12.4624615 12.571949 12.6886339 12.7910128 12.8848839 12.996521 13.1100464 13.2299709 13.3588619 13.4724913 13.5884171 13.692028 13.7981281 13.9017258 14.0124187 14.1420536 14.2657642 14.3824339 14.5084572 14.6434774 14.7785683 14.9249773 15.0654669 15.1951847 15.3338823 15.4555044 15.5926628 15.7420635 15.8627796 16.0124664 16.1738052 16.3265762 16.4897251 16.6394424 16.7850037 16.9498558 17.1137543 17.2984314 17.478857 17.6503716 17.8421535 18.019453 18.2035904 18.3958549 18.5959015 18.8200436 19.0334435 19.2497482 19.4861546 19.7335892 19.9618969 20.1981773 20.3527088 20.5995502 20.8319969 21.0974159 21.3466721 21.6340332 21.8930206 22.1227703 22.463707 22.843647 23.2183876 23.6488152 24.0816288 24.5802746 25.1703987 25.834013 26.5618439 27.4861259 28.497467 30.0091858 32.4074745 37.070118 101.485252 ------------------------------ Transdef: Tab for variable 5 0.97587049 2.27958536 2.69049311 2.96989107 3.21274614 3.3993609 3.59189582 3.76565623 3.92055607 4.05432606 4.14897919 4.24139404 4.32589626 4.40881729 4.50952911 4.58076668 4.64795256 4.7229948 4.79136992 4.85345221 4.92572832 4.9933095 5.05104113 5.10849953 5.15501451 5.21006966 5.26895428 5.32536173 5.3735404 5.4205513 5.46659184 5.50938892 5.54504395 5.58829403 5.62810421 5.66622639 5.70624542 5.74586868 5.7849617 5.82807064 5.86719799 5.90979099 5.94497013 5.9786787 6.01296473 6.05010271 6.09262657 6.1238308 6.16142702 6.19754744 6.23426199 6.26600456 6.30083942 6.33705044 6.37486172 6.41211224 6.44820213 6.48433352 6.52100182 6.55439281 6.59435368 6.63565159 6.67294121 6.71575356 6.75004673 6.78373241 6.82323647 6.85907221 6.89613104 6.94038868 6.97954655 7.01966667 7.05925465 7.1063323 7.15743971 7.1989336 7.234478 7.28128815 7.32722664 7.37633562 7.42794132 7.47949505 7.51887512 7.5700922 7.62222385 7.68701315 7.75593376 7.82938385 7.90440369 7.99388027 8.07356071 8.16910267 8.27696991 8.40435982 8.51756954 8.68846703 8.88297653 9.15538597 9.50119686 10.1742086 19.2163315 ------------------------------ Transdef: Tab for variable 6 15.0050735 19.1966286 23.3614731 25.5925179 26.425087 27.2839775 28.0044479 28.7456818 29.3962784 30.0240364 30.6814098 31.1767807 31.7373924 32.2364655 32.679245 33.1307144 33.4721565 33.8895264 34.3173599 34.6800804 34.9940796 35.356308 35.7041283 36.0134888 36.3248405 36.6125031 36.9040947 37.1944618 37.5139313 37.8192406 38.0759659 38.3767395 38.6712646 38.9272575 39.2538261 39.5677185 39.866539 40.1478882 40.4249725 40.699646 40.9943848 41.2999344 41.6285477 41.9460602 42.2312584 42.574234 42.8862076 43.1485748 43.5061111 43.8415909 44.2014008 44.5225563 44.9321442 45.3509483 45.7261963 46.0659027 46.4670982 46.8485641 47.1993484 47.5626411 47.921524 48.2374191 48.6679077 49.0320244 49.4312515 49.7950439 50.2019157 50.5536156 50.925087 51.3600616 51.826088 52.2714844 52.7348175 53.2218323 53.700592 54.1615982 54.6336594 55.172493 55.6608887 56.24823 56.8183708 57.3412933 57.9863586 58.5359077 59.2219238 60.0197716 60.929348 61.7814407 62.900322 64.0168457 65.2148895 66.6993866 68.3795242 70.1771851 72.5294342 75.0805664 78.2306824 82.3412018 88.2332611 99.2847595 259.730835 ------------------------------ Transdef: Tab for variable 7 30.1877575 32.4342499 33.3528671 34.0176544 34.6438065 35.1258774 35.5423279 35.9515152 36.3470955 36.7211227 37.0452805 37.361908 37.6728897 38.0078506 38.2407074 38.5312347 38.7923813 39.0983582 39.3694458 39.6824265 39.9674149 40.2267838 40.5351562 40.841095 41.1443787 41.4563217 41.8011856 42.1255531 42.4665222 42.8356972 43.1729889 43.5963554 44.0486526 44.544014 44.9130859 45.3417435 45.7996178 46.2782669 46.7960548 47.2338715 47.7812805 48.2717628 48.7594566 49.2611694 49.7513962 50.3025703 50.8717232 51.4222565 51.9500504 52.5030823 53.0567398 53.5969887 54.191864 54.8019257 55.4257202 56.056015 56.7575302 57.5197067 58.3639565 59.2037888 60.2038193 61.0040283 61.8141479 62.8283653 63.8835068 65.1196899 66.3526611 67.7157593 68.9098358 70.1840057 71.3453445 72.6862869 73.9850769 75.4115906 76.7704773 78.2635193 79.725975 81.3912277 82.9685669 84.7721634 86.8465729 89.0069122 91.2344666 93.576088 96.1570053 98.8392639 101.723434 104.857391 108.233963 111.628784 115.69902 120.471893 126.202988 132.371582 139.085754 147.027649 157.440842 171.24353 191.810837 225.182434 509.450317 ------------------------------ Transdef: Tab for variable 8 1.89548922 21.2704201 25.9106293 28.5125618 30.0868301 31.2293205 32.1027946 32.6609268 33.1912155 33.6417999 34.013588 34.3733292 34.7268867 35.0460892 35.3681107 35.6313019 35.9650269 36.2535782 36.5250816 36.7592201 37.0206985 37.2527771 37.4863739 37.7102051 37.9763374 38.1794891 38.4362793 38.6591415 38.8804398 39.1263847 39.3363876 39.5875397 39.8073997 40.0634079 40.3374443 40.6083946 40.8874435 41.1748886 41.4087601 41.6955414 41.9780045 42.2598419 42.5418587 42.8611183 43.1111755 43.4319 43.7712555 44.090786 44.3787193 44.7164459 45.0540543 45.3805351 45.7758827 46.1696053 46.5441742 46.888092 47.285347 47.6518555 48.0200195 48.3307648 48.7022476 49.0551834 49.4001427 49.7907257 50.161705 50.5472717 50.9314651 51.3044891 51.6972961 52.1232986 52.5474739 52.9824295 53.4366302 53.8448181 54.2854996 54.7432861 55.2863235 55.8606186 56.4312286 57.0272751 57.6808014 58.3214684 59.0998497 59.9346542 60.7755432 61.4580078 62.442543 63.4802818 64.7077789 66.0562897 67.6664124 69.2956924 71.2098312 73.2543945 75.5017853 78.5875092 81.7590561 86.3943481 94.0069122 108.087936 363.523895 ------------------------------ Transdef: Tab for variable 9 49.6214828 62.585701 64.5156708 66.0641479 67.1522064 68.2414398 68.9414062 69.873291 70.5177917 71.1668243 71.898819 72.6134949 73.2077332 73.8466263 74.4091949 74.971283 75.4708557 75.9877472 76.5316315 76.9956131 77.4450226 77.9376602 78.391243 78.8291016 79.3517532 79.7858887 80.2512207 80.7288513 81.1640625 81.6985321 82.2394409 82.7016144 83.2592468 83.7439041 84.292572 84.8564301 85.4671478 86.1378937 86.690033 87.2433014 87.8644104 88.5438156 89.1300049 89.7319717 90.415863 91.1309814 91.6981735 92.4073944 93.0561218 93.6361237 94.2843323 94.896698 95.5362091 96.147644 96.7980118 97.497818 98.1018829 98.6723175 99.2771149 99.8601532 100.491425 101.096466 101.698837 102.324669 102.936172 103.555817 104.204391 104.820808 105.464653 106.091797 106.703354 107.326508 107.983475 108.586029 109.172134 109.885162 110.549362 111.243469 112.01889 112.807785 113.68972 114.529739 115.344772 116.227982 117.168991 118.259506 119.486023 120.570511 122.188629 123.989418 125.903419 128.350525 131.203125 134.462448 138.392426 142.877151 148.648529 156.302307 166.555374 188.231415 455.029266 ------------------------------ Transdef: Tab for variable 10 0.0266503803 0.834330201 1.1169107 1.31505167 1.46705317 1.59147775 1.6903373 1.78605235 1.86976385 1.93879366 2.01174355 2.07548046 2.13575745 2.18833256 2.24034309 2.28527761 2.3292973 2.37202978 2.41439629 2.45035505 2.48452759 2.51615334 2.54669094 2.57722473 2.6052773 2.62994123 2.65537572 2.67735744 2.70144606 2.72133541 2.74231791 2.76037073 2.77758288 2.79400587 2.80759859 2.82246113 2.83516932 2.84670782 2.85727787 2.86720133 2.877913 2.8886013 2.89797783 2.90756345 2.91620159 2.92594862 2.93348432 2.94204926 2.94948792 2.95495224 2.96178293 2.96728826 2.97343063 2.9785614 2.9845717 2.98941755 2.99381733 2.99796414 3.00282478 3.00787187 3.01268458 3.01761293 3.02254391 3.02705479 3.03151774 3.03553534 3.03948545 3.043118 3.04673624 3.05043459 3.05454111 3.05821681 3.06206441 3.06553698 3.06863451 3.07167482 3.07458401 3.0775423 3.08103466 3.08425474 3.08759212 3.09069276 3.09379196 3.09657359 3.09974241 3.10252023 3.10517597 3.10844207 3.11088133 3.11337996 3.1159153 3.11901116 3.12171221 3.12456512 3.12702847 3.12936354 3.13146973 3.13392591 3.13635087 3.1390543 3.14159131 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.0054243803 0.0102815768 0.0171133541 0.023580078 0.0297713876 0.037751317 0.0452120304 0.0524691343 0.0586076975 0.066105485 0.0743304864 0.0806500912 0.0883036852 0.0961767435 0.102367625 0.108079851 0.113472641 0.119560689 0.126059547 0.131635189 0.13771823 0.144393563 0.150811791 0.157254234 0.162819386 0.168621898 0.174856424 0.181204438 0.186374784 0.192223415 0.198126793 0.205114484 0.210533082 0.216693401 0.222927272 0.229690284 0.235099912 0.241366118 0.248536497 0.254992247 0.261265337 0.26636368 0.273347408 0.279617965 0.2851547 0.291787684 0.297860622 0.304093361 0.310458601 0.316454113 0.323464096 0.330018878 0.33608669 0.342614412 0.349816054 0.356270194 0.362500072 0.369254827 0.376757026 0.383514881 0.389417917 0.396069407 0.40240702 0.410072625 0.415733457 0.422766417 0.428526908 0.435659826 0.441931963 0.449098289 0.455523372 0.462358594 0.470085025 0.476066232 0.483595371 0.491358519 0.498970091 0.507325172 0.516075253 0.523790121 0.533784747 0.543479085 0.552623034 0.561625361 0.570909739 0.580717266 0.592095494 0.603099287 0.615226865 0.626330376 0.639793992 0.652872741 0.666110039 0.68515873 0.705623269 0.727611065 0.756507874 0.794997811 0.859106541 1.12033129 ------------------------------ Transdef: Tab for variable 12 0.100083143 0.128049165 0.148066133 0.163644999 0.178349122 0.192975283 0.204027131 0.216015816 0.227863908 0.239303052 0.249653012 0.259906709 0.269388616 0.279298425 0.287826687 0.298130572 0.306726098 0.315573335 0.324393898 0.333133042 0.342021227 0.349930853 0.355839729 0.364544272 0.37234962 0.379869342 0.38719058 0.394370914 0.400208503 0.40592885 0.411851168 0.417253852 0.422527015 0.427347869 0.432878077 0.437559098 0.442514777 0.446980715 0.452200025 0.457208633 0.461478323 0.465791285 0.470463127 0.474882334 0.477942735 0.482380509 0.487092614 0.491117358 0.495308518 0.499664247 0.504004955 0.50855267 0.512877524 0.517669857 0.522016585 0.527172446 0.531846881 0.536595941 0.541180968 0.546585917 0.551844358 0.556312323 0.560732484 0.565407634 0.569527268 0.574533582 0.580174327 0.585183501 0.590512395 0.595527887 0.600982666 0.606161058 0.611967504 0.61844337 0.624269962 0.629857123 0.636023164 0.642770767 0.649093628 0.655801654 0.661636055 0.667594612 0.674993634 0.681756198 0.689211905 0.696720719 0.703498721 0.71318531 0.720602274 0.729464173 0.739437461 0.749730825 0.761312962 0.772778511 0.787979722 0.804297686 0.822881639 0.846238196 0.877039909 0.917940378 1.13469779 ------------------------------ Transdef: Tab for variable 13 20.0121021 21.2262535 21.9606171 22.5113316 23.0906296 23.5374947 24.0107861 24.4234715 24.8295288 25.2000999 25.575695 25.9390144 26.3242168 26.6811199 27.0461044 27.3411789 27.6616669 27.9661598 28.2830429 28.6120586 28.8963814 29.1978588 29.450161 29.738924 30.0561981 30.3806305 30.6010342 30.8661537 31.1165981 31.4231453 31.7344742 32.0162888 32.3108139 32.5584221 32.8474274 33.1620674 33.4571075 33.7662277 34.0824203 34.34478 34.5634727 34.8796997 35.1500664 35.4458237 35.7520714 36.0838585 36.4011536 36.7385025 37.0793304 37.4384537 37.7876968 38.1301575 38.4733505 38.8135223 39.1853561 39.5480309 39.8926582 40.3330803 40.7961845 41.273819 41.6997223 42.1613731 42.6280365 43.1154022 43.5487747 44.0366211 44.5427208 45.1152954 45.6932602 46.3108711 46.832592 47.4611664 48.0904465 48.7578773 49.4129639 50.186306 50.80439 51.5562744 52.367836 53.2553711 54.2036819 55.0884247 56.0913849 57.2510529 58.3871536 59.6151123 60.7506104 62.2772751 63.912796 65.6638565 67.4764557 69.716568 72.1411819 74.9537506 77.9860535 81.7723999 85.9738846 89.9112396 96.2604675 108.821129 313.966675 ------------------------------ Transdef: Tab for variable 14 10.006053 10.5336819 10.779314 11.0219851 11.3045216 11.5219517 11.7108555 11.9075871 12.1118603 12.3027859 12.4708004 12.6752605 12.8545074 13.0429001 13.2283325 13.4196978 13.5978146 13.7745504 13.900651 14.0849295 14.2583933 14.4397974 14.6069756 14.7929897 14.9616842 15.1172791 15.2866001 15.4671478 15.6424103 15.8110809 15.9851284 16.152792 16.3347836 16.5070839 16.6606808 16.8336296 17.0005417 17.1868477 17.3823433 17.5875168 17.7369156 17.923687 18.1141357 18.2765465 18.483654 18.6670074 18.8465729 19.0356865 19.2154789 19.4413185 19.6484604 19.8439636 20.0613785 20.2827702 20.5143147 20.7142086 20.9457817 21.1896152 21.4534092 21.6891842 21.9106102 22.1734123 22.3946419 22.6475029 22.9392052 23.1927223 23.4436302 23.7061481 23.9807091 24.2823372 24.583004 24.8997841 25.1976414 25.5271931 25.7912445 26.0981903 26.463253 26.9201679 27.3201885 27.7457752 28.2021236 28.6591721 29.1180363 29.7025661 30.3095589 30.9530449 31.5744877 32.2503662 33.0008202 33.6487045 34.5199127 35.5998344 36.7967072 38.1869278 39.8434219 41.2308617 43.224205 46.2702789 50.0053215 56.897419 124.551949 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 52.5 38.7 22.7 1.6 26.6 51.5 33.7 46.7 -31.5 -1.9 -6.3 11.1 -2.6 2 52.5 100.0 64.0 44.3 8.9 53.9 93.8 60.1 89.5 -51.5 -15.7 -26.8 35.5 18.4 3 38.7 64.0 100.0 21.7 -11.3 21.6 67.7 44.7 69.9 -20.8 -15.0 -30.2 67.8 5.3 4 22.7 44.3 21.7 100.0 -5.9 15.7 46.8 31.9 48.4 -13.5 -21.7 -36.3 10.9 69.6 5 1.6 8.9 -11.3 -5.9 100.0 78.2 -19.1 39.7 37.1 34.5 0.9 3.8 -14.5 -8.7 6 26.6 53.9 21.6 15.7 78.2 100.0 30.9 68.4 70.9 -0.3 -6.5 -9.8 5.6 1.6 7 51.5 93.8 67.7 46.8 -19.1 30.9 100.0 54.0 76.9 -57.8 -14.7 -27.0 40.4 22.0 8 33.7 60.1 44.7 31.9 39.7 68.4 54.0 100.0 72.8 -7.7 -14.3 -22.0 24.1 13.8 9 46.7 89.5 69.9 48.4 37.1 70.9 76.9 72.8 100.0 -25.4 -18.2 -32.1 40.2 22.0 10 -31.5 -51.5 -20.8 -13.5 34.5 -0.3 -57.8 -7.7 -25.4 100.0 3.2 5.9 -9.1 -3.1 11 -1.9 -15.7 -15.0 -21.7 0.9 -6.5 -14.7 -14.3 -18.2 3.2 100.0 59.7 -5.3 -12.5 12 -6.3 -26.8 -30.2 -36.3 3.8 -9.8 -27.0 -22.0 -32.1 5.9 59.7 100.0 -11.6 -14.6 13 11.1 35.5 67.8 10.9 -14.5 5.6 40.4 24.1 40.2 -9.1 -5.3 -11.6 100.0 37.6 14 -2.6 18.4 5.3 69.6 -8.7 1.6 22.0 13.8 22.0 -3.1 -12.5 -14.6 37.6 100.0 TOTAL CORRELATION TO TARGET (diagonal) 112.325764 TOTAL CORRELATION OF ALL VARIABLES 57.8318614 ROUND 1: MAX CORR ( 57.8305837) AFTER KILLING INPUT VARIABLE 6 CONTR 0.384432595 ROUND 2: MAX CORR ( 57.825867) AFTER KILLING INPUT VARIABLE 11 CONTR 0.738589027 ROUND 3: MAX CORR ( 57.7721373) AFTER KILLING INPUT VARIABLE 9 CONTR 2.492196 ROUND 4: MAX CORR ( 57.7337592) AFTER KILLING INPUT VARIABLE 8 CONTR 2.10544562 ROUND 5: MAX CORR ( 57.6687) AFTER KILLING INPUT VARIABLE 2 CONTR 2.74007266 ROUND 6: MAX CORR ( 57.361978) AFTER KILLING INPUT VARIABLE 13 CONTR 5.93990146 ROUND 7: MAX CORR ( 56.9357886) AFTER KILLING INPUT VARIABLE 10 CONTR 6.97943448 ROUND 8: MAX CORR ( 56.5752278) AFTER KILLING INPUT VARIABLE 3 CONTR 6.39747 ROUND 9: MAX CORR ( 55.7041696) AFTER KILLING INPUT VARIABLE 5 CONTR 9.88948347 ROUND 10: MAX CORR ( 54.6994249) AFTER KILLING INPUT VARIABLE 12 CONTR 10.5322093 ROUND 11: MAX CORR ( 53.4942572) AFTER KILLING INPUT VARIABLE 4 CONTR 11.4189109 ROUND 12: MAX CORR ( 51.5407343) AFTER KILLING INPUT VARIABLE 14 CONTR 14.324394 LAST REMAINING VARIABLE: 7 total correlation to target: 57.8318614 % total significance: 114.498466 sigma correlations of single variables to target: variable 2: 52.5023817 % , in sigma: 103.94689 variable 3: 38.6524377 % , in sigma: 76.5260653 variable 4: 22.7205276 % , in sigma: 44.9832581 variable 5: 1.59792377 % , in sigma: 3.16365089 variable 6: 26.6380311 % , in sigma: 52.7393311 variable 7: 51.5407343 % , in sigma: 102.042972 variable 8: 33.6846132 % , in sigma: 66.6905134 variable 9: 46.7178126 % , in sigma: 92.4943055 variable 10: -31.4925502 % , in sigma: 62.3505553 variable 11: -1.90641002 % , in sigma: 3.77440768 variable 12: -6.2670784 % , in sigma: 12.4078811 variable 13: 11.0887643 % , in sigma: 21.9541005 variable 14: -2.62662145 % , in sigma: 5.20031897 variables sorted by significance: 1 most relevant variable 7 corr 51.5407333 , in sigma: 102.04297 2 most relevant variable 14 corr 14.3243942 , in sigma: 28.3601655 3 most relevant variable 4 corr 11.418911 , in sigma: 22.6077417 4 most relevant variable 12 corr 10.5322094 , in sigma: 20.8522047 5 most relevant variable 5 corr 9.88948345 , in sigma: 19.5797032 6 most relevant variable 3 corr 6.39747 , in sigma: 12.666037 7 most relevant variable 10 corr 6.97943449 , in sigma: 13.81824 8 most relevant variable 13 corr 5.93990135 , in sigma: 11.7601193 9 most relevant variable 2 corr 2.74007273 , in sigma: 5.42493558 10 most relevant variable 8 corr 2.10544562 , in sigma: 4.16846851 11 most relevant variable 9 corr 2.49219608 , in sigma: 4.93417678 12 most relevant variable 11 corr 0.738589048 , in sigma: 1.46229623 13 most relevant variable 6 corr 0.384432584 , in sigma: 0.761119216 global correlations between input variables: variable 2: 98.9513544 % variable 3: 93.7467414 % variable 4: 89.4303807 % variable 5: 94.5787633 % variable 6: 92.7911033 % variable 7: 98.4828984 % variable 8: 83.8887256 % variable 9: 98.592621 % variable 10: 72.284949 % variable 11: 60.5324032 % variable 12: 67.9553092 % variable 13: 85.431414 % variable 14: 86.5055084 % significance loss when removing single variables: variable 2: corr = 4.01995824 % , sigma = 7.95891814 variable 3: corr = 8.92791451 % , sigma = 17.67594 variable 4: corr = 9.34027603 % , sigma = 18.4923543 variable 5: corr = 2.78019399 % , sigma = 5.50436971 variable 6: corr = 0.384432595 % , sigma = 0.761119237 variable 7: corr = 2.74680484 % , sigma = 5.43826416 variable 8: corr = 2.57303338 % , sigma = 5.09422258 variable 9: corr = 2.54727094 % , sigma = 5.04321679 variable 10: corr = 6.00227329 % , sigma = 11.8836065 variable 11: corr = 0.730755673 % , sigma = 1.44678731 variable 12: corr = 9.36870167 % , sigma = 18.5486329 variable 13: corr = 5.86735192 % , sigma = 11.6164822 variable 14: corr = 8.90560155 % , sigma = 17.6317637 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 29.8676949 sigma out 15 active outputs RANK 2 NODE 1 --> 22.7171307 sigma out 15 active outputs RANK 3 NODE 11 --> 16.1367836 sigma out 15 active outputs RANK 4 NODE 6 --> 15.8768415 sigma out 15 active outputs RANK 5 NODE 3 --> 15.2272444 sigma out 15 active outputs RANK 6 NODE 7 --> 13.7800245 sigma out 15 active outputs RANK 7 NODE 8 --> 11.397212 sigma out 15 active outputs RANK 8 NODE 4 --> 11.3678246 sigma out 15 active outputs RANK 9 NODE 12 --> 11.3436375 sigma out 15 active outputs RANK 10 NODE 9 --> 9.75710487 sigma out 15 active outputs RANK 11 NODE 2 --> 9.39121342 sigma out 15 active outputs RANK 12 NODE 5 --> 7.27672625 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 37.3697014 sigma in 12act. ( 33.7628899 sig out 1act.) RANK 2 NODE 1 --> 21.6691875 sigma in 12act. ( 23.1084499 sig out 1act.) RANK 3 NODE 5 --> 19.1017437 sigma in 12act. ( 19.4677505 sig out 1act.) RANK 4 NODE 14 --> 14.1861935 sigma in 12act. ( 14.1203938 sig out 1act.) RANK 5 NODE 2 --> 9.98813915 sigma in 12act. ( 12.9036922 sig out 1act.) RANK 6 NODE 12 --> 9.08814716 sigma in 12act. ( 9.63485432 sig out 1act.) RANK 7 NODE 4 --> 9.05126667 sigma in 12act. ( 9.3031044 sig out 1act.) RANK 8 NODE 15 --> 9.03691578 sigma in 12act. ( 8.840518 sig out 1act.) RANK 9 NODE 9 --> 7.48534203 sigma in 12act. ( 6.48961735 sig out 1act.) RANK 10 NODE 3 --> 7.31605339 sigma in 12act. ( 7.40285349 sig out 1act.) RANK 11 NODE 10 --> 6.66130018 sigma in 12act. ( 4.14540672 sig out 1act.) RANK 12 NODE 6 --> 4.36158848 sigma in 12act. ( 4.55414772 sig out 1act.) RANK 13 NODE 13 --> 3.55096221 sigma in 12act. ( 4.18097639 sig out 1act.) RANK 14 NODE 8 --> 1.36210132 sigma in 12act. ( 0.450200677 sig out 1act.) RANK 15 NODE 7 --> 0.993170798 sigma in 12act. ( 0.265032709 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 33.7628899 sigma out 1act.( 37.3697014 sig in 12act.) RANK 2 NODE 1 --> 23.1084499 sigma out 1act.( 21.6691875 sig in 12act.) RANK 3 NODE 5 --> 19.4677505 sigma out 1act.( 19.1017437 sig in 12act.) RANK 4 NODE 14 --> 14.1203938 sigma out 1act.( 14.1861935 sig in 12act.) RANK 5 NODE 2 --> 12.9036922 sigma out 1act.( 9.98813915 sig in 12act.) RANK 6 NODE 12 --> 9.63485432 sigma out 1act.( 9.08814716 sig in 12act.) RANK 7 NODE 4 --> 9.3031044 sigma out 1act.( 9.05126667 sig in 12act.) RANK 8 NODE 15 --> 8.840518 sigma out 1act.( 9.03691578 sig in 12act.) RANK 9 NODE 3 --> 7.40285349 sigma out 1act.( 7.31605339 sig in 12act.) RANK 10 NODE 9 --> 6.48961735 sigma out 1act.( 7.48534203 sig in 12act.) RANK 11 NODE 6 --> 4.55414772 sigma out 1act.( 4.36158848 sig in 12act.) RANK 12 NODE 13 --> 4.18097639 sigma out 1act.( 3.55096221 sig in 12act.) RANK 13 NODE 10 --> 4.14540672 sigma out 1act.( 6.66130018 sig in 12act.) RANK 14 NODE 8 --> 0.450200677 sigma out 1act.( 1.36210132 sig in 12act.) RANK 15 NODE 7 --> 0.265032709 sigma out 1act.( 0.993170798 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 53.1878319 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 33.4649544 sigma out 15 active outputs RANK 2 NODE 1 --> 24.3657341 sigma out 15 active outputs RANK 3 NODE 6 --> 16.9587078 sigma out 15 active outputs RANK 4 NODE 7 --> 16.3902435 sigma out 15 active outputs RANK 5 NODE 11 --> 16.2488937 sigma out 15 active outputs RANK 6 NODE 3 --> 15.5316849 sigma out 15 active outputs RANK 7 NODE 8 --> 13.7965937 sigma out 15 active outputs RANK 8 NODE 12 --> 12.4486055 sigma out 15 active outputs RANK 9 NODE 4 --> 11.8318701 sigma out 15 active outputs RANK 10 NODE 2 --> 10.3658953 sigma out 15 active outputs RANK 11 NODE 9 --> 10.2105484 sigma out 15 active outputs RANK 12 NODE 5 --> 8.40016842 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 11 --> 37.9911652 sigma in 12act. ( 33.9626312 sig out 1act.) RANK 2 NODE 1 --> 20.906601 sigma in 12act. ( 21.7633724 sig out 1act.) RANK 3 NODE 5 --> 19.8098335 sigma in 12act. ( 19.0873146 sig out 1act.) RANK 4 NODE 14 --> 15.8249617 sigma in 12act. ( 14.0746536 sig out 1act.) RANK 5 NODE 2 --> 15.1478281 sigma in 12act. ( 13.2857628 sig out 1act.) RANK 6 NODE 12 --> 12.818058 sigma in 12act. ( 9.54858208 sig out 1act.) RANK 7 NODE 15 --> 10.3330154 sigma in 12act. ( 8.06962681 sig out 1act.) RANK 8 NODE 4 --> 9.87648296 sigma in 12act. ( 8.88381577 sig out 1act.) RANK 9 NODE 3 --> 9.55809879 sigma in 12act. ( 7.06520605 sig out 1act.) RANK 10 NODE 13 --> 8.75390434 sigma in 12act. ( 5.16385317 sig out 1act.) RANK 11 NODE 10 --> 8.55885506 sigma in 12act. ( 3.31565714 sig out 1act.) RANK 12 NODE 9 --> 8.38228416 sigma in 12act. ( 5.80343485 sig out 1act.) RANK 13 NODE 6 --> 7.83715296 sigma in 12act. ( 5.01858664 sig out 1act.) RANK 14 NODE 7 --> 5.45673943 sigma in 12act. ( 0.80135721 sig out 1act.) RANK 15 NODE 8 --> 4.31464672 sigma in 12act. ( 0.478693128 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 33.9626312 sigma out 1act.( 37.9911652 sig in 12act.) RANK 2 NODE 1 --> 21.7633724 sigma out 1act.( 20.906601 sig in 12act.) RANK 3 NODE 5 --> 19.0873146 sigma out 1act.( 19.8098335 sig in 12act.) RANK 4 NODE 14 --> 14.0746536 sigma out 1act.( 15.8249617 sig in 12act.) RANK 5 NODE 2 --> 13.2857628 sigma out 1act.( 15.1478281 sig in 12act.) RANK 6 NODE 12 --> 9.54858208 sigma out 1act.( 12.818058 sig in 12act.) RANK 7 NODE 4 --> 8.88381577 sigma out 1act.( 9.87648296 sig in 12act.) RANK 8 NODE 15 --> 8.06962681 sigma out 1act.( 10.3330154 sig in 12act.) RANK 9 NODE 3 --> 7.06520605 sigma out 1act.( 9.55809879 sig in 12act.) RANK 10 NODE 9 --> 5.80343485 sigma out 1act.( 8.38228416 sig in 12act.) RANK 11 NODE 13 --> 5.16385317 sigma out 1act.( 8.75390434 sig in 12act.) RANK 12 NODE 6 --> 5.01858664 sigma out 1act.( 7.83715296 sig in 12act.) RANK 13 NODE 10 --> 3.31565714 sigma out 1act.( 8.55885506 sig in 12act.) RANK 14 NODE 7 --> 0.80135721 sigma out 1act.( 5.45673943 sig in 12act.) RANK 15 NODE 8 --> 0.478693128 sigma out 1act.( 4.31464672 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 52.4267845 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.445305526 *** contribution from regularisation: 0.00367451319 *** contribution from error: -0.448980033 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.475536197 *** contribution from regularisation: 0.00227444246 *** contribution from error: -0.477810651 *********************************************** -----------------> Test sample ENTER BFGS code START -46857.7751 -0.611795306 -0.164052278 EXIT FROM BFGS code FG_START 0. -0.611795306 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.491880715 *** contribution from regularisation: 0.00215122337 *** contribution from error: -0.494031936 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -48458.1204 -0.611795306 -67.1387711 EXIT FROM BFGS code FG_LNSRCH 0. -0.633518577 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.503341019 *** contribution from regularisation: 0.00278425822 *** contribution from error: -0.506125271 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49587.1463 -0.633518577 30.1583405 EXIT FROM BFGS code NEW_X -49587.1463 -0.633518577 30.1583405 ENTER BFGS code NEW_X -49587.1463 -0.633518577 30.1583405 EXIT FROM BFGS code FG_LNSRCH 0. -0.628151238 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.506950438 *** contribution from regularisation: 0.00269756489 *** contribution from error: -0.509648025 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49942.7289 -0.628151238 11.9728928 EXIT FROM BFGS code NEW_X -49942.7289 -0.628151238 11.9728928 ENTER BFGS code NEW_X -49942.7289 -0.628151238 11.9728928 EXIT FROM BFGS code FG_LNSRCH 0. -0.625605464 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.507116497 *** contribution from regularisation: 0.00275790552 *** contribution from error: -0.509874403 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49959.0911 -0.625605464 27.2814045 EXIT FROM BFGS code NEW_X -49959.0911 -0.625605464 27.2814045 ENTER BFGS code NEW_X -49959.0911 -0.625605464 27.2814045 EXIT FROM BFGS code FG_LNSRCH 0. -0.612940788 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.507220685 *** contribution from regularisation: 0.00279896031 *** contribution from error: -0.51001966 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49969.3508 -0.612940788 34.9230423 EXIT FROM BFGS code NEW_X -49969.3508 -0.612940788 34.9230423 ENTER BFGS code NEW_X -49969.3508 -0.612940788 34.9230423 EXIT FROM BFGS code FG_LNSRCH 0. -0.590748429 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.50752306 *** contribution from regularisation: 0.00272412854 *** contribution from error: -0.510247171 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -49999.1396 -0.590748429 33.1621056 EXIT FROM BFGS code NEW_X -49999.1396 -0.590748429 33.1621056 ENTER BFGS code NEW_X -49999.1396 -0.590748429 33.1621056 EXIT FROM BFGS code FG_LNSRCH 0. -0.385006428 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.50910604 *** contribution from regularisation: 0.00261654425 *** contribution from error: -0.511722565 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50155.0881 -0.385006428 -81.8144989 EXIT FROM BFGS code NEW_X -50155.0881 -0.385006428 -81.8144989 ENTER BFGS code NEW_X -50155.0881 -0.385006428 -81.8144989 EXIT FROM BFGS code FG_LNSRCH 0. -0.342835963 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 39.297863 sigma out 15 active outputs RANK 2 NODE 6 --> 23.7990017 sigma out 15 active outputs RANK 3 NODE 1 --> 22.5062504 sigma out 15 active outputs RANK 4 NODE 3 --> 20.4808979 sigma out 15 active outputs RANK 5 NODE 9 --> 15.9003487 sigma out 15 active outputs RANK 6 NODE 12 --> 15.2909603 sigma out 15 active outputs RANK 7 NODE 7 --> 13.8640242 sigma out 15 active outputs RANK 8 NODE 11 --> 11.7844505 sigma out 15 active outputs RANK 9 NODE 4 --> 10.7011747 sigma out 15 active outputs RANK 10 NODE 2 --> 9.29719067 sigma out 15 active outputs RANK 11 NODE 5 --> 9.03697777 sigma out 15 active outputs RANK 12 NODE 8 --> 8.39484406 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 39.7066498 sigma in 12act. ( 48.4423065 sig out 1act.) RANK 2 NODE 11 --> 25.9326572 sigma in 12act. ( 25.5882626 sig out 1act.) RANK 3 NODE 14 --> 20.6693592 sigma in 12act. ( 21.170887 sig out 1act.) RANK 4 NODE 5 --> 18.1944294 sigma in 12act. ( 17.9821892 sig out 1act.) RANK 5 NODE 6 --> 15.9230728 sigma in 12act. ( 15.7732868 sig out 1act.) RANK 6 NODE 13 --> 15.4578953 sigma in 12act. ( 15.6462135 sig out 1act.) RANK 7 NODE 4 --> 13.5027418 sigma in 12act. ( 12.754302 sig out 1act.) RANK 8 NODE 1 --> 11.3668861 sigma in 12act. ( 10.2746506 sig out 1act.) RANK 9 NODE 9 --> 11.2172422 sigma in 12act. ( 10.9771786 sig out 1act.) RANK 10 NODE 7 --> 9.85500431 sigma in 12act. ( 8.08630466 sig out 1act.) RANK 11 NODE 12 --> 9.36092091 sigma in 12act. ( 7.43538046 sig out 1act.) RANK 12 NODE 3 --> 6.69124079 sigma in 12act. ( 5.03600693 sig out 1act.) RANK 13 NODE 15 --> 4.22277641 sigma in 12act. ( 1.9235642 sig out 1act.) RANK 14 NODE 10 --> 3.82967377 sigma in 12act. ( 0.246834397 sig out 1act.) RANK 15 NODE 8 --> 2.87719774 sigma in 12act. ( 1.17717326 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 48.4423065 sigma out 1act.( 39.7066498 sig in 12act.) RANK 2 NODE 11 --> 25.5882626 sigma out 1act.( 25.9326572 sig in 12act.) RANK 3 NODE 14 --> 21.170887 sigma out 1act.( 20.6693592 sig in 12act.) RANK 4 NODE 5 --> 17.9821892 sigma out 1act.( 18.1944294 sig in 12act.) RANK 5 NODE 6 --> 15.7732868 sigma out 1act.( 15.9230728 sig in 12act.) RANK 6 NODE 13 --> 15.6462135 sigma out 1act.( 15.4578953 sig in 12act.) RANK 7 NODE 4 --> 12.754302 sigma out 1act.( 13.5027418 sig in 12act.) RANK 8 NODE 9 --> 10.9771786 sigma out 1act.( 11.2172422 sig in 12act.) RANK 9 NODE 1 --> 10.2746506 sigma out 1act.( 11.3668861 sig in 12act.) RANK 10 NODE 7 --> 8.08630466 sigma out 1act.( 9.85500431 sig in 12act.) RANK 11 NODE 12 --> 7.43538046 sigma out 1act.( 9.36092091 sig in 12act.) RANK 12 NODE 3 --> 5.03600693 sigma out 1act.( 6.69124079 sig in 12act.) RANK 13 NODE 15 --> 1.9235642 sigma out 1act.( 4.22277641 sig in 12act.) RANK 14 NODE 8 --> 1.17717326 sigma out 1act.( 2.87719774 sig in 12act.) RANK 15 NODE 10 --> 0.246834397 sigma out 1act.( 3.82967377 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 69.3289566 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.510882497 *** contribution from regularisation: 0.00294676935 *** contribution from error: -0.513829291 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -50330.0973 -0.342835963 -48.0031433 EXIT FROM BFGS code NEW_X -50330.0973 -0.342835963 -48.0031433 ENTER BFGS code NEW_X -50330.0973 -0.342835963 -48.0031433 EXIT FROM BFGS code FG_LNSRCH 0. -0.147519439 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.512051284 *** contribution from regularisation: 0.00432267832 *** contribution from error: -0.516373992 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50445.2414 -0.147519439 -222.838181 EXIT FROM BFGS code FG_LNSRCH 0. -0.243856505 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.514302373 *** contribution from regularisation: 0.00210413034 *** contribution from error: -0.516406476 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50667.01 -0.243856505 -98.2409515 EXIT FROM BFGS code NEW_X -50667.01 -0.243856505 -98.2409515 ENTER BFGS code NEW_X -50667.01 -0.243856505 -98.2409515 EXIT FROM BFGS code FG_LNSRCH 0. -0.327843815 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.513541758 *** contribution from regularisation: 0.00319171161 *** contribution from error: -0.516733468 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50592.0796 -0.327843815 119.291763 EXIT FROM BFGS code FG_LNSRCH 0. -0.268583775 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.514433146 *** contribution from regularisation: 0.00266197603 *** contribution from error: -0.517095149 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50679.8958 -0.268583775 -34.704792 EXIT FROM BFGS code NEW_X -50679.8958 -0.268583775 -34.704792 ENTER BFGS code NEW_X -50679.8958 -0.268583775 -34.704792 EXIT FROM BFGS code FG_LNSRCH 0. -0.282025039 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.514836848 *** contribution from regularisation: 0.00305907242 *** contribution from error: -0.517895937 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50719.669 -0.282025039 -44.613884 EXIT FROM BFGS code NEW_X -50719.669 -0.282025039 -44.613884 ENTER BFGS code NEW_X -50719.669 -0.282025039 -44.613884 EXIT FROM BFGS code FG_LNSRCH 0. -0.336136192 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.515658915 *** contribution from regularisation: 0.00293578045 *** contribution from error: -0.518594682 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50800.6519 -0.336136192 51.3470268 EXIT FROM BFGS code NEW_X -50800.6519 -0.336136192 51.3470268 ENTER BFGS code NEW_X -50800.6519 -0.336136192 51.3470268 EXIT FROM BFGS code FG_LNSRCH 0. -0.394519627 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.516587079 *** contribution from regularisation: 0.00294219493 *** contribution from error: -0.519529283 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50892.0927 -0.394519627 128.700378 EXIT FROM BFGS code NEW_X -50892.0927 -0.394519627 128.700378 ENTER BFGS code NEW_X -50892.0927 -0.394519627 128.700378 EXIT FROM BFGS code FG_LNSRCH 0. -0.383804291 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.517126024 *** contribution from regularisation: 0.00292651472 *** contribution from error: -0.520052552 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -50945.1886 -0.383804291 -235.730743 EXIT FROM BFGS code NEW_X -50945.1886 -0.383804291 -235.730743 ENTER BFGS code NEW_X -50945.1886 -0.383804291 -235.730743 EXIT FROM BFGS code FG_LNSRCH 0. -0.413377255 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.517899871 *** contribution from regularisation: 0.00273881457 *** contribution from error: -0.520638704 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51021.4209 -0.413377255 113.589554 EXIT FROM BFGS code NEW_X -51021.4209 -0.413377255 113.589554 ENTER BFGS code NEW_X -51021.4209 -0.413377255 113.589554 EXIT FROM BFGS code FG_LNSRCH 0. -0.382828951 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 68.2513809 sigma out 15 active outputs RANK 2 NODE 6 --> 51.4860077 sigma out 15 active outputs RANK 3 NODE 1 --> 26.4659119 sigma out 15 active outputs RANK 4 NODE 3 --> 25.2098141 sigma out 15 active outputs RANK 5 NODE 9 --> 21.1176605 sigma out 15 active outputs RANK 6 NODE 11 --> 19.1342201 sigma out 15 active outputs RANK 7 NODE 12 --> 17.8578815 sigma out 15 active outputs RANK 8 NODE 7 --> 15.441371 sigma out 15 active outputs RANK 9 NODE 4 --> 13.8315086 sigma out 15 active outputs RANK 10 NODE 5 --> 11.8590698 sigma out 15 active outputs RANK 11 NODE 8 --> 11.0706215 sigma out 15 active outputs RANK 12 NODE 2 --> 7.33397007 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 85.4082031 sigma in 12act. ( 109.107346 sig out 1act.) RANK 2 NODE 14 --> 26.5406704 sigma in 12act. ( 30.7853527 sig out 1act.) RANK 3 NODE 5 --> 20.8907661 sigma in 12act. ( 22.6516571 sig out 1act.) RANK 4 NODE 4 --> 20.4944096 sigma in 12act. ( 23.5387764 sig out 1act.) RANK 5 NODE 11 --> 19.7974262 sigma in 12act. ( 19.3857651 sig out 1act.) RANK 6 NODE 6 --> 19.6959305 sigma in 12act. ( 20.4092674 sig out 1act.) RANK 7 NODE 9 --> 18.9375019 sigma in 12act. ( 21.0223446 sig out 1act.) RANK 8 NODE 13 --> 16.4631634 sigma in 12act. ( 17.885004 sig out 1act.) RANK 9 NODE 7 --> 11.5359793 sigma in 12act. ( 11.8396759 sig out 1act.) RANK 10 NODE 1 --> 7.74048233 sigma in 12act. ( 5.34116077 sig out 1act.) RANK 11 NODE 12 --> 6.42162228 sigma in 12act. ( 5.49773216 sig out 1act.) RANK 12 NODE 3 --> 3.64873052 sigma in 12act. ( 0.303200603 sig out 1act.) RANK 13 NODE 15 --> 2.1875515 sigma in 12act. ( 1.30006909 sig out 1act.) RANK 14 NODE 8 --> 1.88375413 sigma in 12act. ( 1.12074971 sig out 1act.) RANK 15 NODE 10 --> 1.38636839 sigma in 12act. ( 0.500071049 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 109.107346 sigma out 1act.( 85.4082031 sig in 12act.) RANK 2 NODE 14 --> 30.7853527 sigma out 1act.( 26.5406704 sig in 12act.) RANK 3 NODE 4 --> 23.5387764 sigma out 1act.( 20.4944096 sig in 12act.) RANK 4 NODE 5 --> 22.6516571 sigma out 1act.( 20.8907661 sig in 12act.) RANK 5 NODE 9 --> 21.0223446 sigma out 1act.( 18.9375019 sig in 12act.) RANK 6 NODE 6 --> 20.4092674 sigma out 1act.( 19.6959305 sig in 12act.) RANK 7 NODE 11 --> 19.3857651 sigma out 1act.( 19.7974262 sig in 12act.) RANK 8 NODE 13 --> 17.885004 sigma out 1act.( 16.4631634 sig in 12act.) RANK 9 NODE 7 --> 11.8396759 sigma out 1act.( 11.5359793 sig in 12act.) RANK 10 NODE 12 --> 5.49773216 sigma out 1act.( 6.42162228 sig in 12act.) RANK 11 NODE 1 --> 5.34116077 sigma out 1act.( 7.74048233 sig in 12act.) RANK 12 NODE 15 --> 1.30006909 sigma out 1act.( 2.1875515 sig in 12act.) RANK 13 NODE 8 --> 1.12074971 sigma out 1act.( 1.88375413 sig in 12act.) RANK 14 NODE 10 --> 0.500071049 sigma out 1act.( 1.38636839 sig in 12act.) RANK 15 NODE 3 --> 0.303200603 sigma out 1act.( 3.64873052 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 125.202621 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.517976165 *** contribution from regularisation: 0.00274619577 *** contribution from error: -0.520722389 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51028.9425 -0.382828951 24.9800091 EXIT FROM BFGS code NEW_X -51028.9425 -0.382828951 24.9800091 ENTER BFGS code NEW_X -51028.9425 -0.382828951 24.9800091 EXIT FROM BFGS code FG_LNSRCH 0. -0.356049508 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.518283844 *** contribution from regularisation: 0.00272424216 *** contribution from error: -0.521008074 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51059.2493 -0.356049508 -35.5623589 EXIT FROM BFGS code NEW_X -51059.2493 -0.356049508 -35.5623589 ENTER BFGS code NEW_X -51059.2493 -0.356049508 -35.5623589 EXIT FROM BFGS code FG_LNSRCH 0. -0.316190302 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.518641233 *** contribution from regularisation: 0.00273254258 *** contribution from error: -0.521373749 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51094.4569 -0.316190302 -224.377975 EXIT FROM BFGS code NEW_X -51094.4569 -0.316190302 -224.377975 ENTER BFGS code NEW_X -51094.4569 -0.316190302 -224.377975 EXIT FROM BFGS code FG_LNSRCH 0. -0.363678813 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.518799722 *** contribution from regularisation: 0.00297766738 *** contribution from error: -0.521777391 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51110.074 -0.363678813 -102.279518 EXIT FROM BFGS code NEW_X -51110.074 -0.363678813 -102.279518 ENTER BFGS code NEW_X -51110.074 -0.363678813 -102.279518 EXIT FROM BFGS code FG_LNSRCH 0. -0.405488253 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.519129753 *** contribution from regularisation: 0.00300742779 *** contribution from error: -0.522137165 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51142.5875 -0.405488253 -19.7250519 EXIT FROM BFGS code NEW_X -51142.5875 -0.405488253 -19.7250519 ENTER BFGS code NEW_X -51142.5875 -0.405488253 -19.7250519 EXIT FROM BFGS code FG_LNSRCH 0. -0.482903212 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.519543111 *** contribution from regularisation: 0.00310492702 *** contribution from error: -0.522648036 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51183.3103 -0.482903212 22.9282398 EXIT FROM BFGS code NEW_X -51183.3103 -0.482903212 22.9282398 ENTER BFGS code NEW_X -51183.3103 -0.482903212 22.9282398 EXIT FROM BFGS code FG_LNSRCH 0. -0.530684233 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.519878685 *** contribution from regularisation: 0.00312143029 *** contribution from error: -0.523000121 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51216.3672 -0.530684233 56.8338966 EXIT FROM BFGS code NEW_X -51216.3672 -0.530684233 56.8338966 ENTER BFGS code NEW_X -51216.3672 -0.530684233 56.8338966 EXIT FROM BFGS code FG_LNSRCH 0. -0.568805456 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.520239353 *** contribution from regularisation: 0.00314059085 *** contribution from error: -0.523379922 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51251.9028 -0.568805456 32.8123589 EXIT FROM BFGS code NEW_X -51251.9028 -0.568805456 32.8123589 ENTER BFGS code NEW_X -51251.9028 -0.568805456 32.8123589 EXIT FROM BFGS code FG_LNSRCH 0. -0.549449325 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.520536184 *** contribution from regularisation: 0.00307870517 *** contribution from error: -0.523614883 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51281.1452 -0.549449325 73.3414154 EXIT FROM BFGS code NEW_X -51281.1452 -0.549449325 73.3414154 ENTER BFGS code NEW_X -51281.1452 -0.549449325 73.3414154 EXIT FROM BFGS code FG_LNSRCH 0. -0.502166986 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.520607352 *** contribution from regularisation: 0.00304306322 *** contribution from error: -0.523650408 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51288.151 -0.502166986 3.2285161 EXIT FROM BFGS code NEW_X -51288.151 -0.502166986 3.2285161 ENTER BFGS code NEW_X -51288.151 -0.502166986 3.2285161 EXIT FROM BFGS code FG_LNSRCH 0. -0.47014755 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 91.0644913 sigma out 15 active outputs RANK 2 NODE 6 --> 67.6071091 sigma out 15 active outputs RANK 3 NODE 1 --> 41.9514503 sigma out 15 active outputs RANK 4 NODE 12 --> 31.6102047 sigma out 15 active outputs RANK 5 NODE 11 --> 23.4099312 sigma out 15 active outputs RANK 6 NODE 3 --> 23.1945896 sigma out 15 active outputs RANK 7 NODE 5 --> 21.4285583 sigma out 15 active outputs RANK 8 NODE 8 --> 20.7186298 sigma out 15 active outputs RANK 9 NODE 9 --> 17.4024315 sigma out 15 active outputs RANK 10 NODE 4 --> 16.8872166 sigma out 15 active outputs RANK 11 NODE 7 --> 16.4557304 sigma out 15 active outputs RANK 12 NODE 2 --> 11.8315935 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 113.782379 sigma in 12act. ( 130.852417 sig out 1act.) RANK 2 NODE 9 --> 38.9946976 sigma in 12act. ( 39.3302116 sig out 1act.) RANK 3 NODE 6 --> 31.9957619 sigma in 12act. ( 33.4293823 sig out 1act.) RANK 4 NODE 5 --> 29.528347 sigma in 12act. ( 32.5543251 sig out 1act.) RANK 5 NODE 14 --> 28.8209877 sigma in 12act. ( 32.4284973 sig out 1act.) RANK 6 NODE 4 --> 25.8738518 sigma in 12act. ( 29.2091122 sig out 1act.) RANK 7 NODE 11 --> 17.4900608 sigma in 12act. ( 16.6207619 sig out 1act.) RANK 8 NODE 13 --> 14.3541269 sigma in 12act. ( 13.7863197 sig out 1act.) RANK 9 NODE 7 --> 11.7696705 sigma in 12act. ( 12.2589512 sig out 1act.) RANK 10 NODE 1 --> 6.2964735 sigma in 12act. ( 4.61090517 sig out 1act.) RANK 11 NODE 12 --> 4.71331072 sigma in 12act. ( 3.68319559 sig out 1act.) RANK 12 NODE 15 --> 2.98452926 sigma in 12act. ( 2.72505498 sig out 1act.) RANK 13 NODE 3 --> 2.63534617 sigma in 12act. ( 1.26313388 sig out 1act.) RANK 14 NODE 8 --> 1.93185937 sigma in 12act. ( 1.54857779 sig out 1act.) RANK 15 NODE 10 --> 1.07878971 sigma in 12act. ( 0.628457963 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 130.852417 sigma out 1act.( 113.782379 sig in 12act.) RANK 2 NODE 9 --> 39.3302116 sigma out 1act.( 38.9946976 sig in 12act.) RANK 3 NODE 6 --> 33.4293823 sigma out 1act.( 31.9957619 sig in 12act.) RANK 4 NODE 5 --> 32.5543251 sigma out 1act.( 29.528347 sig in 12act.) RANK 5 NODE 14 --> 32.4284973 sigma out 1act.( 28.8209877 sig in 12act.) RANK 6 NODE 4 --> 29.2091122 sigma out 1act.( 25.8738518 sig in 12act.) RANK 7 NODE 11 --> 16.6207619 sigma out 1act.( 17.4900608 sig in 12act.) RANK 8 NODE 13 --> 13.7863197 sigma out 1act.( 14.3541269 sig in 12act.) RANK 9 NODE 7 --> 12.2589512 sigma out 1act.( 11.7696705 sig in 12act.) RANK 10 NODE 1 --> 4.61090517 sigma out 1act.( 6.2964735 sig in 12act.) RANK 11 NODE 12 --> 3.68319559 sigma out 1act.( 4.71331072 sig in 12act.) RANK 12 NODE 15 --> 2.72505498 sigma out 1act.( 2.98452926 sig in 12act.) RANK 13 NODE 8 --> 1.54857779 sigma out 1act.( 1.93185937 sig in 12act.) RANK 14 NODE 3 --> 1.26313388 sigma out 1act.( 2.63534617 sig in 12act.) RANK 15 NODE 10 --> 0.628457963 sigma out 1act.( 1.07878971 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 153.018112 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.520612538 *** contribution from regularisation: 0.00303715211 *** contribution from error: -0.523649693 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51288.666 -0.47014755 100.757477 EXIT FROM BFGS code NEW_X -51288.666 -0.47014755 100.757477 ENTER BFGS code NEW_X -51288.666 -0.47014755 100.757477 EXIT FROM BFGS code FG_LNSRCH 0. -0.4511756 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.520676017 *** contribution from regularisation: 0.0030712462 *** contribution from error: -0.523747265 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51294.9212 -0.4511756 44.3365059 EXIT FROM BFGS code NEW_X -51294.9212 -0.4511756 44.3365059 ENTER BFGS code NEW_X -51294.9212 -0.4511756 44.3365059 EXIT FROM BFGS code FG_LNSRCH 0. -0.378828913 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.520995021 *** contribution from regularisation: 0.00299163675 *** contribution from error: -0.523986638 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51326.3476 -0.378828913 -71.5671387 EXIT FROM BFGS code NEW_X -51326.3476 -0.378828913 -71.5671387 ENTER BFGS code NEW_X -51326.3476 -0.378828913 -71.5671387 EXIT FROM BFGS code FG_LNSRCH 0. -0.322146356 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.521032751 *** contribution from regularisation: 0.00304741459 *** contribution from error: -0.524080157 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51330.0615 -0.322146356 -134.012207 EXIT FROM BFGS code NEW_X -51330.0615 -0.322146356 -134.012207 ENTER BFGS code NEW_X -51330.0615 -0.322146356 -134.012207 EXIT FROM BFGS code FG_LNSRCH 0. -0.273542136 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.520923495 *** contribution from regularisation: 0.00305060856 *** contribution from error: -0.523974121 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51319.3019 -0.273542136 -17.6389065 EXIT FROM BFGS code FG_LNSRCH 0. -0.305407465 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.52090168 *** contribution from regularisation: 0.00325805601 *** contribution from error: -0.524159729 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51317.1525 -0.305407465 -92.01931 EXIT FROM BFGS code FG_LNSRCH 0. -0.320262641 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.520937383 *** contribution from regularisation: 0.00315578026 *** contribution from error: -0.524093151 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51320.6669 -0.320262641 -129.268753 EXIT FROM BFGS code FG_LNSRCH 0. -0.322097093 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.520966113 *** contribution from regularisation: 0.00311456178 *** contribution from error: -0.524080694 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51323.4966 -0.322097093 -134.005356 EXIT FROM BFGS code FG_LNSRCH 0. -0.322146297 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.520935416 *** contribution from regularisation: 0.00314474222 *** contribution from error: -0.524080157 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51320.4732 -0.322146297 -134.219208 EXIT FROM BFGS code FG_LNSRCH 0. -0.322146356 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.520944953 *** contribution from regularisation: 0.00313518965 *** contribution from error: -0.524080157 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51321.4142 -0.322146356 -134.281647 EXIT FROM BFGS code FG_LNSRCH 0. -0.322146356 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 91.3682861 sigma out 15 active outputs RANK 2 NODE 6 --> 69.1249466 sigma out 15 active outputs RANK 3 NODE 1 --> 46.698494 sigma out 15 active outputs RANK 4 NODE 12 --> 35.2363052 sigma out 15 active outputs RANK 5 NODE 5 --> 24.927433 sigma out 15 active outputs RANK 6 NODE 3 --> 24.6545029 sigma out 15 active outputs RANK 7 NODE 11 --> 23.3173885 sigma out 15 active outputs RANK 8 NODE 9 --> 21.9038506 sigma out 15 active outputs RANK 9 NODE 8 --> 21.4487648 sigma out 15 active outputs RANK 10 NODE 4 --> 20.3404293 sigma out 15 active outputs RANK 11 NODE 7 --> 19.6188736 sigma out 15 active outputs RANK 12 NODE 2 --> 13.0376701 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 111.269402 sigma in 12act. ( 131.463745 sig out 1act.) RANK 2 NODE 9 --> 49.2884636 sigma in 12act. ( 48.7800026 sig out 1act.) RANK 3 NODE 5 --> 36.8963394 sigma in 12act. ( 38.889576 sig out 1act.) RANK 4 NODE 6 --> 35.5548515 sigma in 12act. ( 37.5694656 sig out 1act.) RANK 5 NODE 14 --> 32.5907135 sigma in 12act. ( 36.3913422 sig out 1act.) RANK 6 NODE 4 --> 29.676239 sigma in 12act. ( 31.3244381 sig out 1act.) RANK 7 NODE 11 --> 19.2847557 sigma in 12act. ( 18.3817406 sig out 1act.) RANK 8 NODE 13 --> 15.3530798 sigma in 12act. ( 14.252593 sig out 1act.) RANK 9 NODE 7 --> 12.4395933 sigma in 12act. ( 12.8618288 sig out 1act.) RANK 10 NODE 1 --> 6.59355402 sigma in 12act. ( 5.13770485 sig out 1act.) RANK 11 NODE 12 --> 5.07083797 sigma in 12act. ( 4.20356131 sig out 1act.) RANK 12 NODE 15 --> 3.13259482 sigma in 12act. ( 2.82013297 sig out 1act.) RANK 13 NODE 3 --> 2.28311229 sigma in 12act. ( 0.880364418 sig out 1act.) RANK 14 NODE 8 --> 1.99864376 sigma in 12act. ( 1.61480188 sig out 1act.) RANK 15 NODE 10 --> 1.00425172 sigma in 12act. ( 0.558098257 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 131.463745 sigma out 1act.( 111.269402 sig in 12act.) RANK 2 NODE 9 --> 48.7800026 sigma out 1act.( 49.2884636 sig in 12act.) RANK 3 NODE 5 --> 38.889576 sigma out 1act.( 36.8963394 sig in 12act.) RANK 4 NODE 6 --> 37.5694656 sigma out 1act.( 35.5548515 sig in 12act.) RANK 5 NODE 14 --> 36.3913422 sigma out 1act.( 32.5907135 sig in 12act.) RANK 6 NODE 4 --> 31.3244381 sigma out 1act.( 29.676239 sig in 12act.) RANK 7 NODE 11 --> 18.3817406 sigma out 1act.( 19.2847557 sig in 12act.) RANK 8 NODE 13 --> 14.252593 sigma out 1act.( 15.3530798 sig in 12act.) RANK 9 NODE 7 --> 12.8618288 sigma out 1act.( 12.4395933 sig in 12act.) RANK 10 NODE 1 --> 5.13770485 sigma out 1act.( 6.59355402 sig in 12act.) RANK 11 NODE 12 --> 4.20356131 sigma out 1act.( 5.07083797 sig in 12act.) RANK 12 NODE 15 --> 2.82013297 sigma out 1act.( 3.13259482 sig in 12act.) RANK 13 NODE 8 --> 1.61480188 sigma out 1act.( 1.99864376 sig in 12act.) RANK 14 NODE 3 --> 0.880364418 sigma out 1act.( 2.28311229 sig in 12act.) RANK 15 NODE 10 --> 0.558098257 sigma out 1act.( 1.00425172 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 160.167984 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.520949483 *** contribution from regularisation: 0.00313068135 *** contribution from error: -0.524080157 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -51321.8583 -0.322146356 -134.286072 EXIT FROM BFGS code FG_LNSRCH 0. -0.322146356 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.520932257 *** contribution from regularisation: 0.00314786984 *** contribution from error: -0.524080098 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -51320.165 -0.322146356 -134.367828 EXIT FROM BFGS code NEW_X -51320.165 -0.322146356 -134.367828 ENTER BFGS code NEW_X -51320.165 -0.322146356 -134.367828 EXIT FROM BFGS code CONVERGENC -51320.165 -0.322146356 -134.367828 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 10 --> 136.43013 sigma out 15 active outputs RANK 2 NODE 6 --> 101.958702 sigma out 15 active outputs RANK 3 NODE 1 --> 71.1838684 sigma out 15 active outputs RANK 4 NODE 12 --> 54.1202316 sigma out 15 active outputs RANK 5 NODE 5 --> 38.1630974 sigma out 15 active outputs RANK 6 NODE 3 --> 37.6422501 sigma out 15 active outputs RANK 7 NODE 11 --> 35.3311386 sigma out 15 active outputs RANK 8 NODE 8 --> 34.1167145 sigma out 15 active outputs RANK 9 NODE 9 --> 33.4728813 sigma out 15 active outputs RANK 10 NODE 4 --> 30.9731274 sigma out 15 active outputs RANK 11 NODE 7 --> 28.9202137 sigma out 15 active outputs RANK 12 NODE 2 --> 19.1608505 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 165.642776 sigma in 12act. ( 204.978989 sig out 1act.) RANK 2 NODE 9 --> 75.1204224 sigma in 12act. ( 75.7848129 sig out 1act.) RANK 3 NODE 5 --> 55.6860313 sigma in 12act. ( 61.2961235 sig out 1act.) RANK 4 NODE 6 --> 54.9956436 sigma in 12act. ( 57.69244 sig out 1act.) RANK 5 NODE 14 --> 49.6105156 sigma in 12act. ( 56.0671997 sig out 1act.) RANK 6 NODE 4 --> 44.9357834 sigma in 12act. ( 49.1777 sig out 1act.) RANK 7 NODE 11 --> 29.3160667 sigma in 12act. ( 28.2999001 sig out 1act.) RANK 8 NODE 13 --> 22.5443592 sigma in 12act. ( 22.2182198 sig out 1act.) RANK 9 NODE 7 --> 18.8040829 sigma in 12act. ( 19.7622337 sig out 1act.) RANK 10 NODE 1 --> 9.05628109 sigma in 12act. ( 7.93583727 sig out 1act.) RANK 11 NODE 12 --> 7.04883814 sigma in 12act. ( 6.50256252 sig out 1act.) RANK 12 NODE 15 --> 4.44065046 sigma in 12act. ( 4.29752636 sig out 1act.) RANK 13 NODE 8 --> 2.66400552 sigma in 12act. ( 2.44386387 sig out 1act.) RANK 14 NODE 3 --> 2.47629309 sigma in 12act. ( 1.35125244 sig out 1act.) RANK 15 NODE 10 --> 1.17072415 sigma in 12act. ( 0.84461993 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 204.978989 sigma out 1act.( 165.642776 sig in 12act.) RANK 2 NODE 9 --> 75.7848129 sigma out 1act.( 75.1204224 sig in 12act.) RANK 3 NODE 5 --> 61.2961235 sigma out 1act.( 55.6860313 sig in 12act.) RANK 4 NODE 6 --> 57.69244 sigma out 1act.( 54.9956436 sig in 12act.) RANK 5 NODE 14 --> 56.0671997 sigma out 1act.( 49.6105156 sig in 12act.) RANK 6 NODE 4 --> 49.1777 sigma out 1act.( 44.9357834 sig in 12act.) RANK 7 NODE 11 --> 28.2999001 sigma out 1act.( 29.3160667 sig in 12act.) RANK 8 NODE 13 --> 22.2182198 sigma out 1act.( 22.5443592 sig in 12act.) RANK 9 NODE 7 --> 19.7622337 sigma out 1act.( 18.8040829 sig in 12act.) RANK 10 NODE 1 --> 7.93583727 sigma out 1act.( 9.05628109 sig in 12act.) RANK 11 NODE 12 --> 6.50256252 sigma out 1act.( 7.04883814 sig in 12act.) RANK 12 NODE 15 --> 4.29752636 sigma out 1act.( 4.44065046 sig in 12act.) RANK 13 NODE 8 --> 2.44386387 sigma out 1act.( 2.66400552 sig in 12act.) RANK 14 NODE 3 --> 1.35125244 sigma out 1act.( 2.47629309 sig in 12act.) RANK 15 NODE 10 --> 0.84461993 sigma out 1act.( 1.17072415 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 249.4487 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.520959973 *** contribution from regularisation: 0.00312018022 *** contribution from error: -0.524080157 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 31601 Closing output file done