NNInput NNInputs_130.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 183002 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 46666 nbkg = 136336 Bkg Entries: 136336 Sig Entries: 46666 Chosen entries: 46666 Signal fraction: 1 Background fraction: 0.342287 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 136336 Actual Signal Entries: 46666 Entries to split: 46666 Test with : 23333 Train with : 23333 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 46666 for Signal Prepared event 0 for Signal with 46666 events ====Entry 0 Variable Ht : 151.435 Variable LepAPt : 41.3573 Variable LepBPt : 14.9662 Variable MetSigLeptonsJets : 5.83672 Variable MetSpec : 56.7846 Variable SumEtLeptonsJets : 94.6508 Variable VSumJetLeptonsPt : 42.3463 Variable addEt : 113.108 Variable dPhiLepSumMet : 2.38762 Variable dPhiLeptons : 0.421366 Variable dRLeptons : 0.581604 Variable lep1_E : 44.5356 Variable lep2_E : 14.9672 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2130 Ht = 151.435 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 41.3573 LepAPt = 41.3573 LepBEt = 14.9662 LepBPt = 14.9662 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 56.7846 MetDelPhi = 1.62286 MetSig = 5.01275 MetSigLeptonsJets = 5.83672 MetSpec = 56.7846 Mjj = 0 MostCentralJetEta = 2.41678 MtllMet = 115.132 Njets = 1 SB = 0 SumEt = 128.324 SumEtJets = 0 SumEtLeptonsJets = 94.6508 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 42.3463 addEt = 113.108 dPhiLepSumMet = 2.38762 dPhiLeptons = 0.421366 dRLeptons = 0.581604 diltype = 55 dimass = 14.4601 event = 2096 jet1_Et = 38.3273 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 44.5356 lep2_E = 14.9672 rand = 0.999742 run = 195245 weight = 2.27324e-06 ===Show End Prepared event 10000 for Signal with 46666 events Prepared event 20000 for Signal with 46666 events Prepared event 30000 for Signal with 46666 events Prepared event 40000 for Signal with 46666 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 136336 for Background Prepared event 0 for Background with 136336 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.341023 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 136336 events Prepared event 20000 for Background with 136336 events Prepared event 30000 for Background with 136336 events Prepared event 40000 for Background with 136336 events Prepared event 50000 for Background with 136336 events Prepared event 60000 for Background with 136336 events Prepared event 70000 for Background with 136336 events Prepared event 80000 for Background with 136336 events Prepared event 90000 for Background with 136336 events Prepared event 100000 for Background with 136336 events Prepared event 110000 for Background with 136336 events Prepared event 120000 for Background with 136336 events Prepared event 130000 for Background with 136336 events Warning: found 4411 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 183002 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4411 negative weights. Signal fraction: 62.1004562 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 62.8020172 65.2080688 66.8336487 68.0682526 69.062561 70.1345062 71.0074463 71.7106552 72.6912079 73.5079498 74.2348633 74.9553604 75.6421661 76.4012146 76.9947052 77.5694733 78.2419586 78.8219299 79.4855118 80.0100098 80.6618958 81.1507111 81.7181702 82.4642639 83.1830368 83.7169571 84.5710831 85.4866028 86.4121399 87.4160156 88.3751068 89.2397995 90.3238525 91.4144516 92.2910767 93.1447601 94.1936951 95.3205109 96.4125443 97.5550003 98.537796 99.5937347 100.658813 101.633385 102.654175 103.705719 104.455582 105.551193 106.442017 107.484055 108.415039 109.372391 110.445679 111.400658 112.540085 113.527466 114.571152 115.639824 116.583038 117.666611 118.800705 119.906654 121.045761 122.159668 123.345581 124.540726 125.695984 126.98288 128.279907 129.818604 131.444183 132.926819 134.428467 136.130554 137.748795 139.659332 141.405823 143.461823 145.474609 147.53389 149.738434 152.090759 154.581696 157.177094 159.877319 163.214417 166.555847 170.009155 173.784302 178.163544 183.166718 188.659302 194.745224 202.16452 211.796432 224.353363 238.418182 264.218842 319.283081 803.330627 ------------------------------ Transdef: Tab for variable 3 20.0008526 20.3277855 20.6066074 20.9110317 21.1509533 21.4273968 21.6171722 21.8540649 22.0506477 22.2265511 22.4181938 22.6034451 22.7981205 22.9732857 23.1883488 23.3076401 23.4957085 23.6950779 23.9020748 24.1056824 24.3159409 24.494812 24.6920261 24.8794823 25.0855713 25.2590771 25.4561405 25.633007 25.8157825 26.0054855 26.1960258 26.401413 26.6086464 26.8064537 27.0269146 27.2049389 27.4148178 27.6140709 27.8000298 28.0006371 28.2030106 28.3957977 28.5763016 28.7924671 28.9673271 29.1389713 29.3789711 29.6176147 29.797802 30.0503349 30.2814045 30.4995003 30.7295227 30.9483356 31.1771049 31.4212685 31.6413822 31.8448601 32.0840569 32.2975616 32.5981064 32.8407745 33.1334381 33.4102211 33.6735611 33.8924332 34.1801262 34.476635 34.7775002 35.1123962 35.4342117 35.7709045 36.109726 36.502346 36.7998734 37.1656952 37.5640564 37.9706039 38.3888931 38.822052 39.3332634 39.8358459 40.3311768 40.8137703 41.1675377 41.7559547 42.3913803 43.0940781 43.827034 44.6846809 45.661972 46.6081772 47.6826973 48.9816208 50.5361328 52.1690598 54.6735382 57.9472084 62.5151367 70.4920654 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0002518 10.1168642 10.233654 10.3402405 10.4402418 10.5397425 10.6582155 10.7615499 10.8854122 10.989439 11.120821 11.2440214 11.3506641 11.4645519 11.5826759 11.7168941 11.8197727 11.9450197 12.090498 12.2112999 12.3160763 12.44524 12.5813255 12.7261753 12.8682175 13.0059452 13.1519966 13.2999172 13.4344788 13.5871181 13.7044058 13.8365211 13.9573717 14.1018391 14.2588806 14.4101906 14.5745792 14.7418833 14.8992815 15.0853853 15.2462654 15.3769226 15.5432262 15.6936493 15.8717995 16.0282497 16.2295837 16.3951416 16.5474854 16.7272091 16.8813057 17.0641899 17.2713318 17.4758873 17.656189 17.8583126 17.9862728 18.196003 18.4170151 18.6324081 18.8406258 19.0423088 19.2447186 19.4715157 19.7029953 19.9338417 20.1459694 20.2981949 20.4655075 20.6777 20.9028282 21.1319733 21.3442612 21.5730553 21.7941208 22.0246849 22.2812653 22.5710869 22.8372536 23.1135368 23.4314213 23.7254105 24.0198898 24.3326492 24.6402302 25.0650444 25.4548836 25.8932953 26.2556438 26.6980686 27.190155 27.7062607 28.2001724 28.8440323 29.6541595 30.4936562 31.5291939 32.9390106 35.0814362 39.2367325 70.1989212 ------------------------------ Transdef: Tab for variable 5 0.978936255 2.47719336 2.87953949 3.1609478 3.37296057 3.59256506 3.78015327 3.93674612 4.08123493 4.18326712 4.29413319 4.39478874 4.49438477 4.58582115 4.65170193 4.72938776 4.81126785 4.8852129 4.95513296 5.01352692 5.08427429 5.148839 5.20932674 5.26477623 5.32884693 5.37507725 5.43033314 5.46992588 5.52001095 5.54654408 5.58732319 5.63203192 5.68049812 5.72586155 5.76650667 5.81085682 5.85289764 5.8969202 5.93462372 5.97685719 6.01483345 6.05435467 6.10155392 6.13770533 6.17861795 6.21329212 6.25094032 6.27956629 6.31122589 6.35201836 6.39407492 6.43635559 6.47700977 6.51586151 6.55837011 6.60006046 6.6390729 6.67785072 6.71949387 6.75773954 6.79435825 6.83040619 6.87176323 6.90864563 6.95614243 6.9897933 7.03651142 7.07828426 7.1244421 7.16754723 7.20958138 7.25511885 7.29541111 7.34103966 7.39778566 7.44276476 7.49063969 7.53713036 7.58839417 7.63957405 7.69407558 7.75136518 7.8117466 7.86614418 7.92851734 7.99917316 8.07492161 8.14771175 8.21350384 8.29528809 8.39615822 8.50486755 8.61598206 8.73671818 8.87232304 9.05326366 9.28151131 9.53177834 9.9834156 10.9149857 18.5847588 ------------------------------ Transdef: Tab for variable 6 15.0048428 20.0977554 24.7196388 25.952198 26.8706856 27.5960808 28.3849926 29.0673218 29.7772617 30.4833736 31.0972366 31.637886 32.1511612 32.6405067 33.1129951 33.5730858 33.9886551 34.4568176 34.762413 35.1410675 35.5161552 35.8656235 36.1928787 36.5856018 36.9318275 37.2781296 37.6569748 38.0098801 38.3705978 38.6661224 38.97192 39.3238831 39.6856995 40.0332489 40.3409081 40.6322517 40.9518051 41.2738533 41.628521 42.0245399 42.4228363 42.7744331 43.0494308 43.3074226 43.7047806 43.9576263 44.3887024 44.8406677 45.3132706 45.7518692 46.1988373 46.6438217 47.0950089 47.5600548 48.059761 48.4680824 48.9526596 49.3572235 49.8619576 50.297699 50.7090988 51.1796265 51.7064323 52.2322311 52.739357 53.2418785 53.7442474 54.284977 54.7800217 55.3015289 55.7697792 56.3477631 56.8792038 57.3876495 57.939682 58.4595337 59.0317993 59.6382179 60.2114563 60.8442688 61.4829712 62.1928482 62.8959579 63.6553955 64.3855896 65.1712799 66.0084 66.9626389 68.0812378 69.3143616 70.5289764 72.0314789 73.7041702 75.7714386 77.2885437 80.0349808 82.9430771 86.9947357 92.8306274 103.34227 236.562576 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.6089554 33.575676 34.2771912 34.8852692 35.4159851 35.8718872 36.3411446 36.7678223 37.1561508 37.4676514 37.8693314 38.2199783 38.5354156 38.7725601 39.0801239 39.3451042 39.6190414 39.9059601 40.1844559 40.4776382 40.866745 41.2233658 41.5373116 41.8734055 42.2418365 42.6035194 42.9333038 43.3364449 43.8886337 44.4257812 44.8308182 45.3195114 45.8346977 46.3508759 46.9897079 47.6299477 48.2969742 48.8747749 49.384861 49.999073 50.6186447 51.2822685 51.9236221 52.5664291 53.1054382 53.7052879 54.3353271 54.9995193 55.6195221 56.2471886 56.8324165 57.4792786 58.1315842 58.7683411 59.413147 60.1028595 60.856945 61.3451843 62.1498947 62.8279037 63.6089058 64.4205017 65.3086166 66.2679062 67.3968277 68.5554199 69.6894989 70.7960892 72.1421051 73.3148804 74.5097504 76.0146484 77.3040543 78.7541199 80.2698441 81.8627396 83.457077 85.2268829 86.8806 88.8556137 90.708374 92.7134933 95.1757507 97.2808075 99.7910919 102.404678 105.246231 108.285973 112.101791 115.357735 119.538857 124.4086 129.434143 135.857391 143.67691 154.313171 167.091461 188.52182 226.877472 498.085754 ------------------------------ Transdef: Tab for variable 8 1.54187214 22.4064674 27.3554077 29.7216759 31.0375252 31.9650497 32.7012291 33.2583504 33.755043 34.1353302 34.5195312 34.9402008 35.2931747 35.6637306 35.9960022 36.3039856 36.6094742 36.8871689 37.1475182 37.4595108 37.7228928 37.9502831 38.2056656 38.4556961 38.6553345 38.8858299 39.1562347 39.3960953 39.6203232 39.8751869 40.1640739 40.5005226 40.8078728 41.0864868 41.3454704 41.6523094 41.9416122 42.2996216 42.619709 42.9700089 43.2818756 43.6705704 43.9810944 44.3209305 44.7175522 45.1468773 45.549118 46.023632 46.4621201 46.9052696 47.300354 47.7472572 48.124424 48.4740868 48.9262848 49.3421326 49.7641907 50.1971054 50.65802 51.0679588 51.5832748 52.0328674 52.5195084 52.9941483 53.3368607 53.7715607 54.2510757 54.7138062 55.1761398 55.674675 56.1806221 56.6554489 57.1481934 57.6706123 58.1536713 58.6859741 59.2158203 59.7754745 60.3550491 60.9875412 61.6670303 62.3193512 63.0319366 63.7981224 64.6227417 65.5131149 66.4881516 67.6048279 68.7887726 70.1328125 71.5122833 73.2412415 75.1443405 77.2828827 79.768219 82.9228745 86.8566437 91.8463135 100.097107 118.512589 318.173828 ------------------------------ Transdef: Tab for variable 9 48.699276 62.6756744 64.3771515 66.1338196 67.2894287 68.3171844 69.2158813 70.1208801 70.9871597 71.6112747 72.4043274 73.1246185 73.8104324 74.4026642 75.0760193 75.6673737 76.2189636 76.8127747 77.1932068 77.7927246 78.3258514 78.8234406 79.4075165 79.8437805 80.4094238 80.921669 81.3008423 81.8119202 82.4373398 83.0274353 83.4688568 84.0188141 84.7108383 85.4496307 86.2093658 86.7347717 87.4659119 88.2131042 88.9610138 89.6543655 90.4431763 91.1996155 91.9669495 92.769989 93.2621002 94.1310577 94.9771271 95.7880325 96.592041 97.5305328 98.3304062 99.090004 99.8635025 100.740387 101.530701 102.233025 103.064453 103.837112 104.643021 105.381271 106.196564 106.928886 107.724174 108.585304 109.333542 110.142303 110.905457 111.6577 112.458893 113.296112 114.096054 114.82299 115.631271 116.362976 117.107681 117.975929 118.805878 119.612885 120.44445 121.302559 122.128815 123.003082 123.932365 124.895782 125.831421 126.85421 127.994072 129.115234 130.497742 131.905533 133.276672 134.876923 136.91983 139.290695 142.362854 145.939194 150.491196 157.507309 168.861664 196.345428 424.390259 ------------------------------ Transdef: Tab for variable 10 0.0330989063 0.814223468 1.16238332 1.38503838 1.55694413 1.69829381 1.81245172 1.90982318 1.98993635 2.06240082 2.1310761 2.19002914 2.24153447 2.29215908 2.33804941 2.38054204 2.42056727 2.4551723 2.4870317 2.51808071 2.54671669 2.57478786 2.60150719 2.62495089 2.64951038 2.67252874 2.69378471 2.71558571 2.73183703 2.75142193 2.76814604 2.78172016 2.79706597 2.81195807 2.82655549 2.83990836 2.84980536 2.85987186 2.87154293 2.88096118 2.89091682 2.89866161 2.90835118 2.91693902 2.92498994 2.9326005 2.94085217 2.94817972 2.95425701 2.96021843 2.96659946 2.97285366 2.97829294 2.98396778 2.98864841 2.99351263 2.99771762 3.00286627 3.00757647 3.0129776 3.01691151 3.02175617 3.0260787 3.02987075 3.03402185 3.03777122 3.04187846 3.04549932 3.04919195 3.05306005 3.05688787 3.06004953 3.06374335 3.06675577 3.06992602 3.07292795 3.07582045 3.07910538 3.08205914 3.08473921 3.08798647 3.09132719 3.09421825 3.09708953 3.10029364 3.10281229 3.10524988 3.10809946 3.11093473 3.11366034 3.11633682 3.11890841 3.12142658 3.12406349 3.12706041 3.12926483 3.13178682 3.13414145 3.13646913 3.13882518 3.14158177 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00642538164 0.0109741688 0.0182230473 0.0260270834 0.0346168876 0.0435876846 0.0523794889 0.060836643 0.0683736801 0.0770335197 0.0853836536 0.0937088579 0.100982547 0.108751893 0.117016196 0.125736415 0.13402462 0.142778516 0.151169777 0.159049094 0.166243374 0.173644096 0.181236029 0.187922299 0.195529997 0.202242494 0.208395243 0.215067744 0.222249329 0.228827119 0.233604133 0.239573717 0.245443374 0.251514673 0.257258326 0.262273461 0.267048359 0.272865057 0.278847516 0.284097612 0.289882898 0.294876099 0.300673842 0.306943536 0.312131941 0.318505883 0.324238122 0.329874516 0.335614145 0.341425896 0.347341061 0.352170706 0.358325481 0.362981558 0.368641734 0.375110507 0.380233049 0.385923624 0.39058888 0.397067785 0.402633309 0.408805847 0.414444566 0.42030561 0.425745487 0.431669235 0.437483311 0.442422926 0.449082583 0.454833746 0.461010635 0.467371792 0.473642111 0.479607821 0.487605691 0.494963169 0.502279758 0.509559691 0.516750336 0.524279356 0.532510757 0.539795578 0.545418799 0.553888738 0.563670337 0.574362636 0.583191276 0.594325304 0.607203066 0.619173408 0.632780552 0.645845115 0.658692241 0.675553918 0.696680307 0.718529463 0.748372436 0.783427596 0.840530157 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.200001657 0.223459601 0.240215749 0.253720224 0.265395105 0.275318623 0.28521204 0.29513821 0.304281294 0.312601447 0.320712864 0.328549892 0.335652173 0.343015134 0.349873602 0.35582599 0.361652255 0.368783653 0.374986231 0.380693823 0.386680633 0.392148435 0.397993326 0.402607739 0.407109261 0.411912739 0.416664511 0.420622379 0.424487948 0.428665191 0.432390302 0.436669201 0.440193295 0.444158614 0.447807372 0.452345103 0.456699014 0.460462868 0.4642573 0.468124688 0.471461892 0.475468755 0.478971303 0.482891142 0.48668775 0.490419149 0.494178653 0.498056442 0.50203377 0.505880237 0.510084629 0.514059424 0.518230796 0.52254355 0.526419699 0.53029871 0.534493327 0.538932443 0.543636203 0.547429144 0.551844358 0.55572623 0.559659839 0.564474225 0.569010377 0.574023008 0.57871604 0.583749115 0.588152647 0.593391716 0.598235965 0.603510857 0.608765483 0.615356088 0.621237874 0.626655221 0.632798612 0.639216781 0.646148086 0.652125597 0.658771515 0.665769994 0.671873987 0.678419471 0.685122669 0.693015993 0.700621724 0.708912671 0.718280494 0.72817874 0.739191532 0.749534488 0.758648753 0.771970093 0.785044014 0.798833132 0.819031835 0.843068898 0.871649265 0.913068116 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.3966827 22.1673164 22.7222939 23.3211327 23.7569733 24.2014656 24.6533661 25.0894871 25.4293327 25.7958221 26.1807442 26.5563679 26.9234123 27.3047218 27.6027908 27.9695282 28.3412704 28.6742249 28.9774628 29.2765808 29.5638714 29.8587532 30.1461983 30.4393501 30.7087231 30.9851418 31.2644615 31.5597382 31.848793 32.1447525 32.3984413 32.665802 32.9866982 33.2836685 33.5671997 33.8431778 34.1811523 34.417675 34.7177887 35.0367622 35.3868942 35.6539116 35.977211 36.2161674 36.52005 36.8488541 37.1766167 37.475029 37.8114243 38.1517029 38.495163 38.8503647 39.2691765 39.6541748 40.0124359 40.4630508 40.85009 41.2433472 41.6145935 42.0396309 42.5204506 42.9993095 43.4347916 43.9066467 44.4277649 44.9637756 45.4881668 46.0716019 46.5294151 47.0935898 47.6747093 48.2868004 48.9528275 49.6464615 50.3354874 51.0468483 51.8510284 52.6372261 53.52034 54.5675507 55.5476913 56.5548134 57.5754471 58.5462112 59.6251373 60.8122177 62.0247688 63.5096664 65.1166763 66.9339066 68.2160339 70.4986191 72.9013062 76.0528107 79.3820953 82.9949875 87.5132446 93.1589813 103.917 232.066116 ------------------------------ Transdef: Tab for variable 14 10.0028534 10.6604033 11.0059166 11.3690929 11.6266785 11.9279823 12.1930733 12.4181366 12.6868343 12.9812355 13.231432 13.4827995 13.7077332 13.8916645 14.1471577 14.3660135 14.6237106 14.8447313 15.0751448 15.285059 15.5076809 15.7142162 15.9398632 16.1928635 16.4041405 16.6187 16.8117752 17.0304871 17.2814522 17.5476265 17.7687111 17.9627266 18.17169 18.3941727 18.6287766 18.8406258 19.0895233 19.289505 19.5252914 19.7672195 19.970253 20.188097 20.4466324 20.6366901 20.8519936 21.0883427 21.3115425 21.5316429 21.7392502 21.9527702 22.1807365 22.4044037 22.638237 22.8812599 23.1189995 23.3689594 23.6167755 23.8706284 24.1437035 24.4137459 24.6778221 24.9615879 25.2249069 25.5132713 25.7934113 26.0852242 26.4133644 26.7297516 27.0996132 27.3788834 27.6640263 27.9608955 28.1912422 28.5291214 28.8608551 29.2203941 29.5836067 30.0022869 30.4279327 30.8972931 31.3778458 31.8392181 32.4050064 32.9916916 33.5740471 34.175148 34.84655 35.5625 36.3862915 37.2639427 38.3095856 39.310318 40.1045837 41.2851181 42.9139404 44.4068527 46.6565208 49.2917328 53.7839508 60.4395828 122.221924 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 53.9 37.2 37.2 10.7 34.0 52.3 38.9 49.9 -27.1 -10.6 -24.3 4.8 7.8 2 53.9 100.0 62.0 50.4 21.5 60.8 94.3 67.1 90.1 -51.2 -20.0 -42.5 29.4 22.4 3 37.2 62.0 100.0 27.5 -2.8 25.2 65.2 46.7 68.1 -18.9 -21.9 -47.3 63.7 7.8 4 37.2 50.4 27.5 100.0 2.1 24.7 51.8 39.4 55.4 -13.8 -25.8 -53.2 8.3 68.6 5 10.7 21.5 -2.8 2.1 100.0 81.0 -6.2 47.7 47.8 25.9 -0.2 0.6 -9.1 -4.1 6 34.0 60.8 25.2 24.7 81.0 100.0 38.5 73.0 75.8 -5.4 -9.9 -19.0 5.8 7.5 7 52.3 94.3 65.2 51.8 -6.2 38.5 100.0 59.8 77.9 -58.1 -19.6 -43.4 33.7 24.7 8 38.9 67.1 46.7 39.4 47.7 73.0 59.8 100.0 78.2 -12.6 -18.3 -33.8 22.6 18.5 9 49.9 90.1 68.1 55.4 47.8 75.8 77.9 78.2 100.0 -25.7 -22.9 -48.2 34.4 26.8 10 -27.1 -51.2 -18.9 -13.8 25.9 -5.4 -58.1 -12.6 -25.7 100.0 4.0 10.5 -7.9 -4.9 11 -10.6 -20.0 -21.9 -25.8 -0.2 -9.9 -19.6 -18.3 -22.9 4.0 100.0 54.0 -9.9 -16.2 12 -24.3 -42.5 -47.3 -53.2 0.6 -19.0 -43.4 -33.8 -48.2 10.5 54.0 100.0 -22.4 -28.0 13 4.8 29.4 63.7 8.3 -9.1 5.8 33.7 22.6 34.4 -7.9 -9.9 -22.4 100.0 37.2 14 7.8 22.4 7.8 68.6 -4.1 7.5 24.7 18.5 26.8 -4.9 -16.2 -28.0 37.2 100.0 TOTAL CORRELATION TO TARGET (diagonal) 123.332335 TOTAL CORRELATION OF ALL VARIABLES 59.7978024 ROUND 1: MAX CORR ( 59.7970081) AFTER KILLING INPUT VARIABLE 11 CONTR 0.308217439 ROUND 2: MAX CORR ( 59.7836076) AFTER KILLING INPUT VARIABLE 7 CONTR 1.26587613 ROUND 3: MAX CORR ( 59.7209437) AFTER KILLING INPUT VARIABLE 8 CONTR 2.73653464 ROUND 4: MAX CORR ( 59.6381101) AFTER KILLING INPUT VARIABLE 5 CONTR 3.14434939 ROUND 5: MAX CORR ( 59.5754159) AFTER KILLING INPUT VARIABLE 10 CONTR 2.73386247 ROUND 6: MAX CORR ( 59.276711) AFTER KILLING INPUT VARIABLE 14 CONTR 5.95833113 ROUND 7: MAX CORR ( 58.9275172) AFTER KILLING INPUT VARIABLE 12 CONTR 6.42465422 ROUND 8: MAX CORR ( 58.2231753) AFTER KILLING INPUT VARIABLE 9 CONTR 9.08372968 ROUND 9: MAX CORR ( 58.1542505) AFTER KILLING INPUT VARIABLE 6 CONTR 2.83218805 ROUND 10: MAX CORR ( 57.1406095) AFTER KILLING INPUT VARIABLE 4 CONTR 10.8105316 ROUND 11: MAX CORR ( 55.1449486) AFTER KILLING INPUT VARIABLE 3 CONTR 14.9694324 ROUND 12: MAX CORR ( 53.9176725) AFTER KILLING INPUT VARIABLE 13 CONTR 11.5693535 LAST REMAINING VARIABLE: 2 total correlation to target: 59.7978024 % total significance: 116.265234 sigma correlations of single variables to target: variable 2: 53.9176725 % , in sigma: 104.832461 variable 3: 37.2326852 % , in sigma: 72.391738 variable 4: 37.159955 % , in sigma: 72.2503283 variable 5: 10.7205165 % , in sigma: 20.843966 variable 6: 34.0239179 % , in sigma: 66.1529121 variable 7: 52.2817346 % , in sigma: 101.651697 variable 8: 38.9325726 % , in sigma: 75.6968396 variable 9: 49.8973586 % , in sigma: 97.0157401 variable 10: -27.1443228 % , in sigma: 52.7768731 variable 11: -10.6031033 % , in sigma: 20.6156787 variable 12: -24.3371514 % , in sigma: 47.3188726 variable 13: 4.77429193 % , in sigma: 9.28268507 variable 14: 7.80100958 % , in sigma: 15.1675507 variables sorted by significance: 1 most relevant variable 2 corr 53.9176712 , in sigma: 104.832459 2 most relevant variable 13 corr 11.5693531 , in sigma: 22.4943641 3 most relevant variable 3 corr 14.9694328 , in sigma: 29.10516 4 most relevant variable 4 corr 10.8105316 , in sigma: 21.0189829 5 most relevant variable 6 corr 2.83218813 , in sigma: 5.50664074 6 most relevant variable 9 corr 9.08372974 , in sigma: 17.6615514 7 most relevant variable 12 corr 6.42465401 , in sigma: 12.4914942 8 most relevant variable 14 corr 5.95833111 , in sigma: 11.5848197 9 most relevant variable 10 corr 2.7338624 , in sigma: 5.31546542 10 most relevant variable 5 corr 3.14434934 , in sigma: 6.11357769 11 most relevant variable 8 corr 2.7365346 , in sigma: 5.32066099 12 most relevant variable 7 corr 1.26587617 , in sigma: 2.4612508 13 most relevant variable 11 corr 0.308217436 , in sigma: 0.59926905 global correlations between input variables: variable 2: 99.1350019 % variable 3: 93.4310203 % variable 4: 91.0663776 % variable 5: 95.0258242 % variable 6: 93.6293308 % variable 7: 98.6796921 % variable 8: 86.8666343 % variable 9: 98.8662534 % variable 10: 71.8511662 % variable 11: 55.0037275 % variable 12: 73.6106684 % variable 13: 84.2631653 % variable 14: 86.3144021 % significance loss when removing single variables: variable 2: corr = 6.08740809 % , sigma = 11.8357848 variable 3: corr = 13.3940842 % , sigma = 26.0421999 variable 4: corr = 14.8512377 % , sigma = 28.8753525 variable 5: corr = 3.81781864 % , sigma = 7.42300818 variable 6: corr = 5.00798593 % , sigma = 9.73705774 variable 7: corr = 1.2406379 % , sigma = 2.41217987 variable 8: corr = 1.75714833 % , sigma = 3.41643427 variable 9: corr = 7.76156153 % , sigma = 15.0908516 variable 10: corr = 3.32100582 % , sigma = 6.45705198 variable 11: corr = 0.308217439 % , sigma = 0.599269057 variable 12: corr = 5.49211364 % , sigma = 10.6783502 variable 13: corr = 8.23919829 % , sigma = 16.0195237 variable 14: corr = 5.88504034 % , sigma = 11.44232 Keep only 11 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 12 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 21.9830589 sigma out 15 active outputs RANK 2 NODE 3 --> 14.716363 sigma out 15 active outputs RANK 3 NODE 7 --> 14.3096352 sigma out 15 active outputs RANK 4 NODE 12 --> 13.7260399 sigma out 15 active outputs RANK 5 NODE 5 --> 12.9021749 sigma out 15 active outputs RANK 6 NODE 6 --> 12.3834505 sigma out 15 active outputs RANK 7 NODE 11 --> 11.3717394 sigma out 15 active outputs RANK 8 NODE 4 --> 11.0529423 sigma out 15 active outputs RANK 9 NODE 9 --> 9.64764309 sigma out 15 active outputs RANK 10 NODE 8 --> 9.14048862 sigma out 15 active outputs RANK 11 NODE 1 --> 7.50481558 sigma out 15 active outputs RANK 12 NODE 10 --> 7.17098093 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 26.9577274 sigma in 12act. ( 30.6005249 sig out 1act.) RANK 2 NODE 10 --> 19.0098515 sigma in 12act. ( 19.9554253 sig out 1act.) RANK 3 NODE 7 --> 13.1140032 sigma in 12act. ( 8.70137024 sig out 1act.) RANK 4 NODE 5 --> 12.540225 sigma in 12act. ( 14.6924477 sig out 1act.) RANK 5 NODE 9 --> 10.7160778 sigma in 12act. ( 10.863162 sig out 1act.) RANK 6 NODE 8 --> 9.92566299 sigma in 12act. ( 10.1352167 sig out 1act.) RANK 7 NODE 12 --> 9.79253864 sigma in 12act. ( 10.103159 sig out 1act.) RANK 8 NODE 1 --> 8.79447174 sigma in 12act. ( 10.9549236 sig out 1act.) RANK 9 NODE 15 --> 5.76574707 sigma in 12act. ( 6.5053544 sig out 1act.) RANK 10 NODE 11 --> 5.46687365 sigma in 12act. ( 5.53278494 sig out 1act.) RANK 11 NODE 3 --> 5.35524988 sigma in 12act. ( 6.32632732 sig out 1act.) RANK 12 NODE 4 --> 4.98575449 sigma in 12act. ( 5.61160707 sig out 1act.) RANK 13 NODE 2 --> 3.49751139 sigma in 12act. ( 5.33570147 sig out 1act.) RANK 14 NODE 14 --> 2.87065053 sigma in 12act. ( 2.34499002 sig out 1act.) RANK 15 NODE 13 --> 2.75845075 sigma in 12act. ( 2.81647468 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 30.6005249 sigma out 1act.( 26.9577274 sig in 12act.) RANK 2 NODE 10 --> 19.9554253 sigma out 1act.( 19.0098515 sig in 12act.) RANK 3 NODE 5 --> 14.6924477 sigma out 1act.( 12.540225 sig in 12act.) RANK 4 NODE 1 --> 10.9549236 sigma out 1act.( 8.79447174 sig in 12act.) RANK 5 NODE 9 --> 10.863162 sigma out 1act.( 10.7160778 sig in 12act.) RANK 6 NODE 8 --> 10.1352167 sigma out 1act.( 9.92566299 sig in 12act.) RANK 7 NODE 12 --> 10.103159 sigma out 1act.( 9.79253864 sig in 12act.) RANK 8 NODE 7 --> 8.70137024 sigma out 1act.( 13.1140032 sig in 12act.) RANK 9 NODE 15 --> 6.5053544 sigma out 1act.( 5.76574707 sig in 12act.) RANK 10 NODE 3 --> 6.32632732 sigma out 1act.( 5.35524988 sig in 12act.) RANK 11 NODE 4 --> 5.61160707 sigma out 1act.( 4.98575449 sig in 12act.) RANK 12 NODE 11 --> 5.53278494 sigma out 1act.( 5.46687365 sig in 12act.) RANK 13 NODE 2 --> 5.33570147 sigma out 1act.( 3.49751139 sig in 12act.) RANK 14 NODE 13 --> 2.81647468 sigma out 1act.( 2.75845075 sig in 12act.) RANK 15 NODE 14 --> 2.34499002 sigma out 1act.( 2.87065053 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 47.4905586 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 26.4398117 sigma out 15 active outputs RANK 2 NODE 3 --> 17.0344753 sigma out 15 active outputs RANK 3 NODE 7 --> 16.0661316 sigma out 15 active outputs RANK 4 NODE 12 --> 15.9801617 sigma out 15 active outputs RANK 5 NODE 5 --> 15.0842628 sigma out 15 active outputs RANK 6 NODE 11 --> 13.4841061 sigma out 15 active outputs RANK 7 NODE 4 --> 13.0685921 sigma out 15 active outputs RANK 8 NODE 6 --> 12.0201092 sigma out 15 active outputs RANK 9 NODE 1 --> 11.5145626 sigma out 15 active outputs RANK 10 NODE 8 --> 11.4063435 sigma out 15 active outputs RANK 11 NODE 9 --> 10.5667648 sigma out 15 active outputs RANK 12 NODE 10 --> 9.43565941 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 28.3679409 sigma in 12act. ( 30.6813183 sig out 1act.) RANK 2 NODE 10 --> 20.5320683 sigma in 12act. ( 19.1170311 sig out 1act.) RANK 3 NODE 5 --> 15.8768492 sigma in 12act. ( 14.6816845 sig out 1act.) RANK 4 NODE 1 --> 13.2414742 sigma in 12act. ( 11.910017 sig out 1act.) RANK 5 NODE 12 --> 12.575243 sigma in 12act. ( 10.0494995 sig out 1act.) RANK 6 NODE 9 --> 11.322053 sigma in 12act. ( 10.3970032 sig out 1act.) RANK 7 NODE 8 --> 11.2620039 sigma in 12act. ( 9.32862186 sig out 1act.) RANK 8 NODE 7 --> 11.0178289 sigma in 12act. ( 7.39599657 sig out 1act.) RANK 9 NODE 2 --> 10.7390203 sigma in 12act. ( 6.43957615 sig out 1act.) RANK 10 NODE 4 --> 8.8949461 sigma in 12act. ( 5.48595238 sig out 1act.) RANK 11 NODE 3 --> 8.21784782 sigma in 12act. ( 6.46286201 sig out 1act.) RANK 12 NODE 11 --> 8.00380898 sigma in 12act. ( 5.36757851 sig out 1act.) RANK 13 NODE 15 --> 7.97169209 sigma in 12act. ( 6.60738897 sig out 1act.) RANK 14 NODE 14 --> 7.83743191 sigma in 12act. ( 2.29818463 sig out 1act.) RANK 15 NODE 13 --> 7.17263746 sigma in 12act. ( 3.58348083 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 30.6813183 sigma out 1act.( 28.3679409 sig in 12act.) RANK 2 NODE 10 --> 19.1170311 sigma out 1act.( 20.5320683 sig in 12act.) RANK 3 NODE 5 --> 14.6816845 sigma out 1act.( 15.8768492 sig in 12act.) RANK 4 NODE 1 --> 11.910017 sigma out 1act.( 13.2414742 sig in 12act.) RANK 5 NODE 9 --> 10.3970032 sigma out 1act.( 11.322053 sig in 12act.) RANK 6 NODE 12 --> 10.0494995 sigma out 1act.( 12.575243 sig in 12act.) RANK 7 NODE 8 --> 9.32862186 sigma out 1act.( 11.2620039 sig in 12act.) RANK 8 NODE 7 --> 7.39599657 sigma out 1act.( 11.0178289 sig in 12act.) RANK 9 NODE 15 --> 6.60738897 sigma out 1act.( 7.97169209 sig in 12act.) RANK 10 NODE 3 --> 6.46286201 sigma out 1act.( 8.21784782 sig in 12act.) RANK 11 NODE 2 --> 6.43957615 sigma out 1act.( 10.7390203 sig in 12act.) RANK 12 NODE 4 --> 5.48595238 sigma out 1act.( 8.8949461 sig in 12act.) RANK 13 NODE 11 --> 5.36757851 sigma out 1act.( 8.00380898 sig in 12act.) RANK 14 NODE 13 --> 3.58348083 sigma out 1act.( 7.17263746 sig in 12act.) RANK 15 NODE 14 --> 2.29818463 sigma out 1act.( 7.83743191 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 47.1056519 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.434577674 *** contribution from regularisation: 0.0044097933 *** contribution from error: -0.438987464 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.466583848 *** contribution from regularisation: 0.00256715575 *** contribution from error: -0.46915099 *********************************************** -----------------> Test sample ENTER BFGS code START -42702.0393 0.0554139242 -0.264205068 EXIT FROM BFGS code FG_START 0. 0.0554139242 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.480261177 *** contribution from regularisation: 0.00247231848 *** contribution from error: -0.482733488 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -43944.3788 0.0554139242 111.672043 EXIT FROM BFGS code FG_LNSRCH 0. 0.0836923122 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.501865268 *** contribution from regularisation: 0.00339452946 *** contribution from error: -0.505259812 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45921.1754 0.0836923122 132.234619 EXIT FROM BFGS code NEW_X -45921.1754 0.0836923122 132.234619 ENTER BFGS code NEW_X -45921.1754 0.0836923122 132.234619 EXIT FROM BFGS code FG_LNSRCH 0. 0.106781825 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.504805684 *** contribution from regularisation: 0.00330447289 *** contribution from error: -0.508110166 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46190.2231 0.106781825 97.1515961 EXIT FROM BFGS code NEW_X -46190.2231 0.106781825 97.1515961 ENTER BFGS code NEW_X -46190.2231 0.106781825 97.1515961 EXIT FROM BFGS code FG_LNSRCH 0. 0.138515592 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.505804956 *** contribution from regularisation: 0.00323353847 *** contribution from error: -0.509038508 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46281.6589 0.138515592 65.1133194 EXIT FROM BFGS code NEW_X -46281.6589 0.138515592 65.1133194 ENTER BFGS code NEW_X -46281.6589 0.138515592 65.1133194 EXIT FROM BFGS code FG_LNSRCH 0. 0.197492421 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.506512523 *** contribution from regularisation: 0.00328033441 *** contribution from error: -0.509792864 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46346.401 0.197492421 4.33521557 EXIT FROM BFGS code NEW_X -46346.401 0.197492421 4.33521557 ENTER BFGS code NEW_X -46346.401 0.197492421 4.33521557 EXIT FROM BFGS code FG_LNSRCH 0. 0.227693766 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.507264733 *** contribution from regularisation: 0.00324063981 *** contribution from error: -0.510505378 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46415.2327 0.227693766 6.60493708 EXIT FROM BFGS code NEW_X -46415.2327 0.227693766 6.60493708 ENTER BFGS code NEW_X -46415.2327 0.227693766 6.60493708 EXIT FROM BFGS code FG_LNSRCH 0. 0.458693027 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.509995461 *** contribution from regularisation: 0.00339386356 *** contribution from error: -0.513389349 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46665.0972 0.458693027 -67.8490677 EXIT FROM BFGS code NEW_X -46665.0972 0.458693027 -67.8490677 ENTER BFGS code NEW_X -46665.0972 0.458693027 -67.8490677 EXIT FROM BFGS code FG_LNSRCH 0. 0.521239281 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 35.5682831 sigma out 15 active outputs RANK 2 NODE 10 --> 22.1960678 sigma out 15 active outputs RANK 3 NODE 6 --> 20.9301624 sigma out 15 active outputs RANK 4 NODE 3 --> 18.5767231 sigma out 15 active outputs RANK 5 NODE 8 --> 18.5102577 sigma out 15 active outputs RANK 6 NODE 4 --> 15.5784788 sigma out 15 active outputs RANK 7 NODE 11 --> 15.3638544 sigma out 15 active outputs RANK 8 NODE 1 --> 15.3360682 sigma out 15 active outputs RANK 9 NODE 9 --> 11.9159069 sigma out 15 active outputs RANK 10 NODE 5 --> 11.524724 sigma out 15 active outputs RANK 11 NODE 7 --> 9.08518505 sigma out 15 active outputs RANK 12 NODE 12 --> 9.03620338 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 31.1047306 sigma in 12act. ( 36.7921066 sig out 1act.) RANK 2 NODE 2 --> 25.8260002 sigma in 12act. ( 22.0459061 sig out 1act.) RANK 3 NODE 10 --> 23.2442856 sigma in 12act. ( 19.5838737 sig out 1act.) RANK 4 NODE 5 --> 23.1282463 sigma in 12act. ( 22.1506405 sig out 1act.) RANK 5 NODE 4 --> 15.7591581 sigma in 12act. ( 12.1893311 sig out 1act.) RANK 6 NODE 3 --> 14.4009171 sigma in 12act. ( 13.1864347 sig out 1act.) RANK 7 NODE 1 --> 13.6711445 sigma in 12act. ( 12.6638594 sig out 1act.) RANK 8 NODE 13 --> 13.3623104 sigma in 12act. ( 9.80086517 sig out 1act.) RANK 9 NODE 15 --> 12.1792669 sigma in 12act. ( 8.59654903 sig out 1act.) RANK 10 NODE 14 --> 12.122488 sigma in 12act. ( 12.2993412 sig out 1act.) RANK 11 NODE 11 --> 9.72666931 sigma in 12act. ( 8.7425909 sig out 1act.) RANK 12 NODE 12 --> 7.19760609 sigma in 12act. ( 5.00859213 sig out 1act.) RANK 13 NODE 7 --> 5.3635149 sigma in 12act. ( 3.40516973 sig out 1act.) RANK 14 NODE 8 --> 4.70127583 sigma in 12act. ( 3.6438508 sig out 1act.) RANK 15 NODE 9 --> 3.61077261 sigma in 12act. ( 0.40391773 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 36.7921066 sigma out 1act.( 31.1047306 sig in 12act.) RANK 2 NODE 5 --> 22.1506405 sigma out 1act.( 23.1282463 sig in 12act.) RANK 3 NODE 2 --> 22.0459061 sigma out 1act.( 25.8260002 sig in 12act.) RANK 4 NODE 10 --> 19.5838737 sigma out 1act.( 23.2442856 sig in 12act.) RANK 5 NODE 3 --> 13.1864347 sigma out 1act.( 14.4009171 sig in 12act.) RANK 6 NODE 1 --> 12.6638594 sigma out 1act.( 13.6711445 sig in 12act.) RANK 7 NODE 14 --> 12.2993412 sigma out 1act.( 12.122488 sig in 12act.) RANK 8 NODE 4 --> 12.1893311 sigma out 1act.( 15.7591581 sig in 12act.) RANK 9 NODE 13 --> 9.80086517 sigma out 1act.( 13.3623104 sig in 12act.) RANK 10 NODE 11 --> 8.7425909 sigma out 1act.( 9.72666931 sig in 12act.) RANK 11 NODE 15 --> 8.59654903 sigma out 1act.( 12.1792669 sig in 12act.) RANK 12 NODE 12 --> 5.00859213 sigma out 1act.( 7.19760609 sig in 12act.) RANK 13 NODE 8 --> 3.6438508 sigma out 1act.( 4.70127583 sig in 12act.) RANK 14 NODE 7 --> 3.40516973 sigma out 1act.( 5.3635149 sig in 12act.) RANK 15 NODE 9 --> 0.40391773 sigma out 1act.( 3.61077261 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 60.3695374 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.510048091 *** contribution from regularisation: 0.00342934346 *** contribution from error: -0.513477445 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -46669.9099 0.521239281 121.473351 EXIT FROM BFGS code FG_LNSRCH 0. 0.487852097 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.511090398 *** contribution from regularisation: 0.00302921073 *** contribution from error: -0.514119625 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46765.2811 0.487852097 24.7640724 EXIT FROM BFGS code NEW_X -46765.2811 0.487852097 24.7640724 ENTER BFGS code NEW_X -46765.2811 0.487852097 24.7640724 EXIT FROM BFGS code FG_LNSRCH 0. 0.510611176 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.511190832 *** contribution from regularisation: 0.00328743225 *** contribution from error: -0.514478266 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46774.4707 0.510611176 15.9726543 EXIT FROM BFGS code NEW_X -46774.4707 0.510611176 15.9726543 ENTER BFGS code NEW_X -46774.4707 0.510611176 15.9726543 EXIT FROM BFGS code FG_LNSRCH 0. 0.617165327 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.512485266 *** contribution from regularisation: 0.00356604112 *** contribution from error: -0.516051292 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46892.9124 0.617165327 -7.2759409 EXIT FROM BFGS code NEW_X -46892.9124 0.617165327 -7.2759409 ENTER BFGS code NEW_X -46892.9124 0.617165327 -7.2759409 EXIT FROM BFGS code FG_LNSRCH 0. 0.661538839 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.513899744 *** contribution from regularisation: 0.00360240904 *** contribution from error: -0.517502129 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47022.3402 0.661538839 -94.0567017 EXIT FROM BFGS code NEW_X -47022.3402 0.661538839 -94.0567017 ENTER BFGS code NEW_X -47022.3402 0.661538839 -94.0567017 EXIT FROM BFGS code FG_LNSRCH 0. 0.695250332 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.515620708 *** contribution from regularisation: 0.00405619806 *** contribution from error: -0.519676924 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47179.8116 0.695250332 -150.848877 EXIT FROM BFGS code NEW_X -47179.8116 0.695250332 -150.848877 ENTER BFGS code NEW_X -47179.8116 0.695250332 -150.848877 EXIT FROM BFGS code FG_LNSRCH 0. 0.604614377 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.516464293 *** contribution from regularisation: 0.00344576989 *** contribution from error: -0.519910038 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47256.999 0.604614377 34.8621063 EXIT FROM BFGS code NEW_X -47256.999 0.604614377 34.8621063 ENTER BFGS code NEW_X -47256.999 0.604614377 34.8621063 EXIT FROM BFGS code FG_LNSRCH 0. 0.592518568 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.516758919 *** contribution from regularisation: 0.00358902197 *** contribution from error: -0.520347953 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47283.9556 0.592518568 7.43232775 EXIT FROM BFGS code NEW_X -47283.9556 0.592518568 7.43232775 ENTER BFGS code NEW_X -47283.9556 0.592518568 7.43232775 EXIT FROM BFGS code FG_LNSRCH 0. 0.563364685 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.517072082 *** contribution from regularisation: 0.00358667341 *** contribution from error: -0.520658731 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47312.6107 0.563364685 -8.62568665 EXIT FROM BFGS code NEW_X -47312.6107 0.563364685 -8.62568665 ENTER BFGS code NEW_X -47312.6107 0.563364685 -8.62568665 EXIT FROM BFGS code FG_LNSRCH 0. 0.499945998 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.517521918 *** contribution from regularisation: 0.00357032474 *** contribution from error: -0.521092236 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47353.773 0.499945998 -30.4232197 EXIT FROM BFGS code NEW_X -47353.773 0.499945998 -30.4232197 ENTER BFGS code NEW_X -47353.773 0.499945998 -30.4232197 EXIT FROM BFGS code FG_LNSRCH 0. 0.440257996 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 54.6091309 sigma out 15 active outputs RANK 2 NODE 10 --> 35.6897736 sigma out 15 active outputs RANK 3 NODE 9 --> 26.026228 sigma out 15 active outputs RANK 4 NODE 8 --> 22.7447014 sigma out 15 active outputs RANK 5 NODE 6 --> 21.0114899 sigma out 15 active outputs RANK 6 NODE 3 --> 20.639677 sigma out 15 active outputs RANK 7 NODE 1 --> 19.4077244 sigma out 15 active outputs RANK 8 NODE 4 --> 18.0481567 sigma out 15 active outputs RANK 9 NODE 11 --> 15.9945459 sigma out 15 active outputs RANK 10 NODE 12 --> 14.18645 sigma out 15 active outputs RANK 11 NODE 5 --> 12.0639544 sigma out 15 active outputs RANK 12 NODE 7 --> 9.26110458 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 53.7289696 sigma in 12act. ( 82.3555145 sig out 1act.) RANK 2 NODE 5 --> 36.1669464 sigma in 12act. ( 42.577034 sig out 1act.) RANK 3 NODE 2 --> 28.7184715 sigma in 12act. ( 33.0179672 sig out 1act.) RANK 4 NODE 10 --> 26.3193626 sigma in 12act. ( 26.1992054 sig out 1act.) RANK 5 NODE 14 --> 25.7977638 sigma in 12act. ( 29.0065804 sig out 1act.) RANK 6 NODE 3 --> 18.9888191 sigma in 12act. ( 20.943821 sig out 1act.) RANK 7 NODE 1 --> 14.4929953 sigma in 12act. ( 14.4107676 sig out 1act.) RANK 8 NODE 13 --> 14.2570534 sigma in 12act. ( 13.4910984 sig out 1act.) RANK 9 NODE 11 --> 13.7672081 sigma in 12act. ( 14.2007761 sig out 1act.) RANK 10 NODE 15 --> 11.8819799 sigma in 12act. ( 10.7466211 sig out 1act.) RANK 11 NODE 4 --> 8.92587662 sigma in 12act. ( 6.22628689 sig out 1act.) RANK 12 NODE 7 --> 8.48642159 sigma in 12act. ( 8.62245083 sig out 1act.) RANK 13 NODE 8 --> 7.04664087 sigma in 12act. ( 7.50341082 sig out 1act.) RANK 14 NODE 12 --> 4.3398633 sigma in 12act. ( 2.92314196 sig out 1act.) RANK 15 NODE 9 --> 2.49975681 sigma in 12act. ( 1.31341326 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 82.3555145 sigma out 1act.( 53.7289696 sig in 12act.) RANK 2 NODE 5 --> 42.577034 sigma out 1act.( 36.1669464 sig in 12act.) RANK 3 NODE 2 --> 33.0179672 sigma out 1act.( 28.7184715 sig in 12act.) RANK 4 NODE 14 --> 29.0065804 sigma out 1act.( 25.7977638 sig in 12act.) RANK 5 NODE 10 --> 26.1992054 sigma out 1act.( 26.3193626 sig in 12act.) RANK 6 NODE 3 --> 20.943821 sigma out 1act.( 18.9888191 sig in 12act.) RANK 7 NODE 1 --> 14.4107676 sigma out 1act.( 14.4929953 sig in 12act.) RANK 8 NODE 11 --> 14.2007761 sigma out 1act.( 13.7672081 sig in 12act.) RANK 9 NODE 13 --> 13.4910984 sigma out 1act.( 14.2570534 sig in 12act.) RANK 10 NODE 15 --> 10.7466211 sigma out 1act.( 11.8819799 sig in 12act.) RANK 11 NODE 7 --> 8.62245083 sigma out 1act.( 8.48642159 sig in 12act.) RANK 12 NODE 8 --> 7.50341082 sigma out 1act.( 7.04664087 sig in 12act.) RANK 13 NODE 4 --> 6.22628689 sigma out 1act.( 8.92587662 sig in 12act.) RANK 14 NODE 12 --> 2.92314196 sigma out 1act.( 4.3398633 sig in 12act.) RANK 15 NODE 9 --> 1.31341326 sigma out 1act.( 2.49975681 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 111.974823 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.518006027 *** contribution from regularisation: 0.00354026421 *** contribution from error: -0.521546304 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47398.0706 0.440257996 -13.6809645 EXIT FROM BFGS code NEW_X -47398.0706 0.440257996 -13.6809645 ENTER BFGS code NEW_X -47398.0706 0.440257996 -13.6809645 EXIT FROM BFGS code FG_LNSRCH 0. 0.381405771 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.518263996 *** contribution from regularisation: 0.00353910797 *** contribution from error: -0.521803081 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47421.6734 0.381405771 39.62257 EXIT FROM BFGS code NEW_X -47421.6734 0.381405771 39.62257 ENTER BFGS code NEW_X -47421.6734 0.381405771 39.62257 EXIT FROM BFGS code FG_LNSRCH 0. 0.383118123 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.518469691 *** contribution from regularisation: 0.00359001965 *** contribution from error: -0.522059739 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47440.4962 0.383118123 36.7797279 EXIT FROM BFGS code NEW_X -47440.4962 0.383118123 36.7797279 ENTER BFGS code NEW_X -47440.4962 0.383118123 36.7797279 EXIT FROM BFGS code FG_LNSRCH 0. 0.398869425 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.518579304 *** contribution from regularisation: 0.00359654264 *** contribution from error: -0.522175848 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47450.5248 0.398869425 28.5445766 EXIT FROM BFGS code NEW_X -47450.5248 0.398869425 28.5445766 ENTER BFGS code NEW_X -47450.5248 0.398869425 28.5445766 EXIT FROM BFGS code FG_LNSRCH 0. 0.428525418 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.518826425 *** contribution from regularisation: 0.00358998356 *** contribution from error: -0.522416413 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47473.1346 0.428525418 6.37251568 EXIT FROM BFGS code NEW_X -47473.1346 0.428525418 6.37251568 ENTER BFGS code NEW_X -47473.1346 0.428525418 6.37251568 EXIT FROM BFGS code FG_LNSRCH 0. 0.476296335 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.518931329 *** contribution from regularisation: 0.00363415014 *** contribution from error: -0.522565484 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47482.7356 0.476296335 134.052048 EXIT FROM BFGS code NEW_X -47482.7356 0.476296335 134.052048 ENTER BFGS code NEW_X -47482.7356 0.476296335 134.052048 EXIT FROM BFGS code FG_LNSRCH 0. 0.501309276 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.519233644 *** contribution from regularisation: 0.00372930942 *** contribution from error: -0.522962928 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47510.3979 0.501309276 11.0737677 EXIT FROM BFGS code NEW_X -47510.3979 0.501309276 11.0737677 ENTER BFGS code NEW_X -47510.3979 0.501309276 11.0737677 EXIT FROM BFGS code FG_LNSRCH 0. 0.512066007 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.519453943 *** contribution from regularisation: 0.00373017741 *** contribution from error: -0.523184121 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47530.5552 0.512066007 -34.1301537 EXIT FROM BFGS code NEW_X -47530.5552 0.512066007 -34.1301537 ENTER BFGS code NEW_X -47530.5552 0.512066007 -34.1301537 EXIT FROM BFGS code FG_LNSRCH 0. 0.538110673 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.519811988 *** contribution from regularisation: 0.00376499607 *** contribution from error: -0.523576975 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47563.3143 0.538110673 -86.7544556 EXIT FROM BFGS code NEW_X -47563.3143 0.538110673 -86.7544556 ENTER BFGS code NEW_X -47563.3143 0.538110673 -86.7544556 EXIT FROM BFGS code FG_LNSRCH 0. 0.547177374 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.519975424 *** contribution from regularisation: 0.0038054774 *** contribution from error: -0.523780882 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47578.2729 0.547177374 -83.2640076 EXIT FROM BFGS code NEW_X -47578.2729 0.547177374 -83.2640076 ENTER BFGS code NEW_X -47578.2729 0.547177374 -83.2640076 EXIT FROM BFGS code FG_LNSRCH 0. 0.541795433 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 76.6615524 sigma out 15 active outputs RANK 2 NODE 10 --> 36.8330231 sigma out 15 active outputs RANK 3 NODE 8 --> 35.4278984 sigma out 15 active outputs RANK 4 NODE 9 --> 34.8189163 sigma out 15 active outputs RANK 5 NODE 1 --> 29.9170284 sigma out 15 active outputs RANK 6 NODE 6 --> 28.3742771 sigma out 15 active outputs RANK 7 NODE 7 --> 28.3084126 sigma out 15 active outputs RANK 8 NODE 4 --> 27.4701805 sigma out 15 active outputs RANK 9 NODE 3 --> 21.2986031 sigma out 15 active outputs RANK 10 NODE 12 --> 19.3135166 sigma out 15 active outputs RANK 11 NODE 11 --> 18.2746658 sigma out 15 active outputs RANK 12 NODE 5 --> 7.43457413 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 58.3646698 sigma in 12act. ( 97.336586 sig out 1act.) RANK 2 NODE 2 --> 53.2557526 sigma in 12act. ( 56.3290329 sig out 1act.) RANK 3 NODE 5 --> 48.1504898 sigma in 12act. ( 52.9243202 sig out 1act.) RANK 4 NODE 14 --> 46.914402 sigma in 12act. ( 54.1270905 sig out 1act.) RANK 5 NODE 10 --> 31.859417 sigma in 12act. ( 32.3019447 sig out 1act.) RANK 6 NODE 3 --> 30.7329121 sigma in 12act. ( 32.6637459 sig out 1act.) RANK 7 NODE 11 --> 19.0377274 sigma in 12act. ( 19.1647129 sig out 1act.) RANK 8 NODE 13 --> 17.321209 sigma in 12act. ( 17.3224983 sig out 1act.) RANK 9 NODE 7 --> 15.023428 sigma in 12act. ( 16.6681385 sig out 1act.) RANK 10 NODE 1 --> 13.6144238 sigma in 12act. ( 13.9964867 sig out 1act.) RANK 11 NODE 15 --> 12.67202 sigma in 12act. ( 12.3355885 sig out 1act.) RANK 12 NODE 8 --> 12.1626978 sigma in 12act. ( 13.7362385 sig out 1act.) RANK 13 NODE 4 --> 7.06086206 sigma in 12act. ( 5.43196964 sig out 1act.) RANK 14 NODE 12 --> 3.91643023 sigma in 12act. ( 3.45952654 sig out 1act.) RANK 15 NODE 9 --> 2.08472228 sigma in 12act. ( 1.36171949 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 97.336586 sigma out 1act.( 58.3646698 sig in 12act.) RANK 2 NODE 2 --> 56.3290329 sigma out 1act.( 53.2557526 sig in 12act.) RANK 3 NODE 14 --> 54.1270905 sigma out 1act.( 46.914402 sig in 12act.) RANK 4 NODE 5 --> 52.9243202 sigma out 1act.( 48.1504898 sig in 12act.) RANK 5 NODE 3 --> 32.6637459 sigma out 1act.( 30.7329121 sig in 12act.) RANK 6 NODE 10 --> 32.3019447 sigma out 1act.( 31.859417 sig in 12act.) RANK 7 NODE 11 --> 19.1647129 sigma out 1act.( 19.0377274 sig in 12act.) RANK 8 NODE 13 --> 17.3224983 sigma out 1act.( 17.321209 sig in 12act.) RANK 9 NODE 7 --> 16.6681385 sigma out 1act.( 15.023428 sig in 12act.) RANK 10 NODE 1 --> 13.9964867 sigma out 1act.( 13.6144238 sig in 12act.) RANK 11 NODE 8 --> 13.7362385 sigma out 1act.( 12.1626978 sig in 12act.) RANK 12 NODE 15 --> 12.3355885 sigma out 1act.( 12.67202 sig in 12act.) RANK 13 NODE 4 --> 5.43196964 sigma out 1act.( 7.06086206 sig in 12act.) RANK 14 NODE 12 --> 3.45952654 sigma out 1act.( 3.91643023 sig in 12act.) RANK 15 NODE 9 --> 1.36171949 sigma out 1act.( 2.08472228 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 148.370132 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.520150781 *** contribution from regularisation: 0.00380023778 *** contribution from error: -0.523950994 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47594.3165 0.541795433 26.3173466 EXIT FROM BFGS code NEW_X -47594.3165 0.541795433 26.3173466 ENTER BFGS code NEW_X -47594.3165 0.541795433 26.3173466 EXIT FROM BFGS code FG_LNSRCH 0. 0.534301937 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.520217836 *** contribution from regularisation: 0.00379079068 *** contribution from error: -0.524008632 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47600.4525 0.534301937 29.7507 EXIT FROM BFGS code NEW_X -47600.4525 0.534301937 29.7507 ENTER BFGS code NEW_X -47600.4525 0.534301937 29.7507 EXIT FROM BFGS code FG_LNSRCH 0. 0.526399553 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.520434856 *** contribution from regularisation: 0.00375724444 *** contribution from error: -0.524192095 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47620.3096 0.526399553 4.77700806 EXIT FROM BFGS code NEW_X -47620.3096 0.526399553 4.77700806 ENTER BFGS code NEW_X -47620.3096 0.526399553 4.77700806 EXIT FROM BFGS code FG_LNSRCH 0. 0.519276917 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.520403445 *** contribution from regularisation: 0.00377650699 *** contribution from error: -0.524179935 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47617.4361 0.519276917 75.9027176 EXIT FROM BFGS code FG_LNSRCH 0. 0.523579121 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.520370364 *** contribution from regularisation: 0.00389592419 *** contribution from error: -0.524266303 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47614.4111 0.523579121 29.9488792 EXIT FROM BFGS code FG_LNSRCH 0. 0.525979519 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.520353734 *** contribution from regularisation: 0.0038548829 *** contribution from error: -0.524208605 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47612.8849 0.525979519 8.32352352 EXIT FROM BFGS code FG_LNSRCH 0. 0.526386023 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.520364165 *** contribution from regularisation: 0.00382861448 *** contribution from error: -0.52419275 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47613.8441 0.526386023 5.0585146 EXIT FROM BFGS code FG_LNSRCH 0. 0.526399553 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.52036792 *** contribution from regularisation: 0.00382415066 *** contribution from error: -0.524192095 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47614.1877 0.526399553 4.8834486 EXIT FROM BFGS code FG_LNSRCH 0. 0.526399553 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.520359218 *** contribution from regularisation: 0.00383286388 *** contribution from error: -0.524192095 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47613.3903 0.526399553 4.93549919 EXIT FROM BFGS code FG_LNSRCH 0. 0.526399553 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.520365596 *** contribution from regularisation: 0.00382649293 *** contribution from error: -0.524192095 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47613.9733 0.526399553 5.01220608 EXIT FROM BFGS code FG_LNSRCH 0. 0.526399553 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 78.4078217 sigma out 15 active outputs RANK 2 NODE 8 --> 37.5137863 sigma out 15 active outputs RANK 3 NODE 10 --> 36.7909012 sigma out 15 active outputs RANK 4 NODE 9 --> 36.7559433 sigma out 15 active outputs RANK 5 NODE 1 --> 31.0620995 sigma out 15 active outputs RANK 6 NODE 7 --> 28.3378334 sigma out 15 active outputs RANK 7 NODE 6 --> 28.14921 sigma out 15 active outputs RANK 8 NODE 4 --> 26.5462856 sigma out 15 active outputs RANK 9 NODE 3 --> 22.1995716 sigma out 15 active outputs RANK 10 NODE 12 --> 19.8493004 sigma out 15 active outputs RANK 11 NODE 11 --> 19.4241505 sigma out 15 active outputs RANK 12 NODE 5 --> 8.75876427 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 59.8129082 sigma in 12act. ( 98.4082565 sig out 1act.) RANK 2 NODE 2 --> 54.6350899 sigma in 12act. ( 57.8737106 sig out 1act.) RANK 3 NODE 5 --> 49.1987915 sigma in 12act. ( 55.0376663 sig out 1act.) RANK 4 NODE 14 --> 48.0928268 sigma in 12act. ( 54.2927933 sig out 1act.) RANK 5 NODE 10 --> 32.8687744 sigma in 12act. ( 32.1213493 sig out 1act.) RANK 6 NODE 3 --> 31.2116737 sigma in 12act. ( 33.4526749 sig out 1act.) RANK 7 NODE 11 --> 19.815012 sigma in 12act. ( 19.3931217 sig out 1act.) RANK 8 NODE 13 --> 17.4100571 sigma in 12act. ( 17.207201 sig out 1act.) RANK 9 NODE 7 --> 15.5637188 sigma in 12act. ( 16.8466892 sig out 1act.) RANK 10 NODE 1 --> 13.789731 sigma in 12act. ( 14.4266119 sig out 1act.) RANK 11 NODE 15 --> 12.8038139 sigma in 12act. ( 12.2875757 sig out 1act.) RANK 12 NODE 8 --> 12.537487 sigma in 12act. ( 14.3068876 sig out 1act.) RANK 13 NODE 4 --> 6.82676315 sigma in 12act. ( 5.09923601 sig out 1act.) RANK 14 NODE 12 --> 3.78894019 sigma in 12act. ( 3.24864888 sig out 1act.) RANK 15 NODE 9 --> 2.16312838 sigma in 12act. ( 1.43240619 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 98.4082565 sigma out 1act.( 59.8129082 sig in 12act.) RANK 2 NODE 2 --> 57.8737106 sigma out 1act.( 54.6350899 sig in 12act.) RANK 3 NODE 5 --> 55.0376663 sigma out 1act.( 49.1987915 sig in 12act.) RANK 4 NODE 14 --> 54.2927933 sigma out 1act.( 48.0928268 sig in 12act.) RANK 5 NODE 3 --> 33.4526749 sigma out 1act.( 31.2116737 sig in 12act.) RANK 6 NODE 10 --> 32.1213493 sigma out 1act.( 32.8687744 sig in 12act.) RANK 7 NODE 11 --> 19.3931217 sigma out 1act.( 19.815012 sig in 12act.) RANK 8 NODE 13 --> 17.207201 sigma out 1act.( 17.4100571 sig in 12act.) RANK 9 NODE 7 --> 16.8466892 sigma out 1act.( 15.5637188 sig in 12act.) RANK 10 NODE 1 --> 14.4266119 sigma out 1act.( 13.789731 sig in 12act.) RANK 11 NODE 8 --> 14.3068876 sigma out 1act.( 12.537487 sig in 12act.) RANK 12 NODE 15 --> 12.2875757 sigma out 1act.( 12.8038139 sig in 12act.) RANK 13 NODE 4 --> 5.09923601 sigma out 1act.( 6.82676315 sig in 12act.) RANK 14 NODE 12 --> 3.24864888 sigma out 1act.( 3.78894019 sig in 12act.) RANK 15 NODE 9 --> 1.43240619 sigma out 1act.( 2.16312838 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 150.730453 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.520365715 *** contribution from regularisation: 0.00382639421 *** contribution from error: -0.524192095 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47613.9823 0.526399553 4.90629053 EXIT FROM BFGS code NEW_X -47613.9823 0.526399553 4.90629053 ENTER BFGS code NEW_X -47613.9823 0.526399553 4.90629053 EXIT FROM BFGS code CONVERGENC -47613.9823 0.526399553 4.90629053 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 119.46904 sigma out 15 active outputs RANK 2 NODE 8 --> 57.2775345 sigma out 15 active outputs RANK 3 NODE 9 --> 56.9792175 sigma out 15 active outputs RANK 4 NODE 10 --> 56.5705643 sigma out 15 active outputs RANK 5 NODE 1 --> 47.2944145 sigma out 15 active outputs RANK 6 NODE 7 --> 44.780014 sigma out 15 active outputs RANK 7 NODE 4 --> 42.254818 sigma out 15 active outputs RANK 8 NODE 6 --> 41.9759483 sigma out 15 active outputs RANK 9 NODE 3 --> 36.0457306 sigma out 15 active outputs RANK 10 NODE 12 --> 30.4185047 sigma out 15 active outputs RANK 11 NODE 11 --> 29.7815628 sigma out 15 active outputs RANK 12 NODE 5 --> 13.4575405 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 6 --> 92.0437012 sigma in 12act. ( 151.26474 sig out 1act.) RANK 2 NODE 2 --> 83.0148239 sigma in 12act. ( 90.7451553 sig out 1act.) RANK 3 NODE 5 --> 77.3694763 sigma in 12act. ( 85.4351196 sig out 1act.) RANK 4 NODE 14 --> 73.8901749 sigma in 12act. ( 84.8557129 sig out 1act.) RANK 5 NODE 10 --> 50.5101242 sigma in 12act. ( 51.0568733 sig out 1act.) RANK 6 NODE 3 --> 47.2195702 sigma in 12act. ( 51.8407326 sig out 1act.) RANK 7 NODE 11 --> 30.4291534 sigma in 12act. ( 30.5142021 sig out 1act.) RANK 8 NODE 13 --> 26.5677757 sigma in 12act. ( 27.0577412 sig out 1act.) RANK 9 NODE 7 --> 23.6565361 sigma in 12act. ( 26.3769646 sig out 1act.) RANK 10 NODE 1 --> 20.6068382 sigma in 12act. ( 22.2707195 sig out 1act.) RANK 11 NODE 15 --> 19.2839985 sigma in 12act. ( 19.3505363 sig out 1act.) RANK 12 NODE 8 --> 19.2489815 sigma in 12act. ( 22.2761116 sig out 1act.) RANK 13 NODE 4 --> 9.76440334 sigma in 12act. ( 8.11911774 sig out 1act.) RANK 14 NODE 12 --> 5.4880147 sigma in 12act. ( 5.15233135 sig out 1act.) RANK 15 NODE 9 --> 2.88877249 sigma in 12act. ( 2.18218589 sig out 1act.) sorted by output significance RANK 1 NODE 6 --> 151.26474 sigma out 1act.( 92.0437012 sig in 12act.) RANK 2 NODE 2 --> 90.7451553 sigma out 1act.( 83.0148239 sig in 12act.) RANK 3 NODE 5 --> 85.4351196 sigma out 1act.( 77.3694763 sig in 12act.) RANK 4 NODE 14 --> 84.8557129 sigma out 1act.( 73.8901749 sig in 12act.) RANK 5 NODE 3 --> 51.8407326 sigma out 1act.( 47.2195702 sig in 12act.) RANK 6 NODE 10 --> 51.0568733 sigma out 1act.( 50.5101242 sig in 12act.) RANK 7 NODE 11 --> 30.5142021 sigma out 1act.( 30.4291534 sig in 12act.) RANK 8 NODE 13 --> 27.0577412 sigma out 1act.( 26.5677757 sig in 12act.) RANK 9 NODE 7 --> 26.3769646 sigma out 1act.( 23.6565361 sig in 12act.) RANK 10 NODE 8 --> 22.2761116 sigma out 1act.( 19.2489815 sig in 12act.) RANK 11 NODE 1 --> 22.2707195 sigma out 1act.( 20.6068382 sig in 12act.) RANK 12 NODE 15 --> 19.3505363 sigma out 1act.( 19.2839985 sig in 12act.) RANK 13 NODE 4 --> 8.11911774 sigma out 1act.( 9.76440334 sig in 12act.) RANK 14 NODE 12 --> 5.15233135 sigma out 1act.( 5.4880147 sig in 12act.) RANK 15 NODE 9 --> 2.18218589 sigma out 1act.( 2.88877249 sig in 12act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 233.949753 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.520365477 *** contribution from regularisation: 0.00382661005 *** contribution from error: -0.524192095 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 31601 Closing output file done