NNInput NNInputs_115.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 182885 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 45453 nbkg = 137432 Bkg Entries: 137432 Sig Entries: 45453 Chosen entries: 45453 Signal fraction: 1 Background fraction: 0.330731 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 137432 Actual Signal Entries: 45453 Entries to split: 45453 Test with : 22726 Train with : 22726 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 45453 for Signal Prepared event 0 for Signal with 45453 events ====Entry 0 Variable Ht : 147.2 Variable LepAPt : 33.8436 Variable LepBPt : 16.8195 Variable MetSigLeptonsJets : 7.93922 Variable MetSpec : 69.8321 Variable SumEtLeptonsJets : 77.3669 Variable VSumJetLeptonsPt : 74.5437 Variable addEt : 120.496 Variable dPhiLepSumMet : 2.77597 Variable dPhiLeptons : 0.349396 Variable dRLeptons : 0.409585 Variable lep1_E : 34.748 Variable lep2_E : 16.8224 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2115 Ht = 147.2 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 33.8439 LepAPt = 33.8436 LepBEt = 16.82 LepBPt = 16.8195 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 69.8321 MetDelPhi = 2.54203 MetSig = 5.42558 MetSigLeptonsJets = 7.93922 MetSpec = 69.8321 Mjj = 0 MostCentralJetEta = -1.25048 MtllMet = 121.128 Njets = 1 SB = 0 SumEt = 165.661 SumEtJets = 0 SumEtLeptonsJets = 77.3669 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 74.5437 addEt = 120.496 dPhiLepSumMet = 2.77597 dPhiLeptons = 0.349396 dRLeptons = 0.409585 diltype = 17 dimass = 9.74565 event = 4187 jet1_Et = 26.7039 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 34.748 lep2_E = 16.8224 rand = 0.999742 run = 237705 weight = 5.90147e-07 ===Show End Prepared event 10000 for Signal with 45453 events Prepared event 20000 for Signal with 45453 events Prepared event 30000 for Signal with 45453 events Prepared event 40000 for Signal with 45453 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 137432 for Background Prepared event 0 for Background with 137432 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.326397 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 137432 events Prepared event 20000 for Background with 137432 events Prepared event 30000 for Background with 137432 events Prepared event 40000 for Background with 137432 events Prepared event 50000 for Background with 137432 events Prepared event 60000 for Background with 137432 events Prepared event 70000 for Background with 137432 events Prepared event 80000 for Background with 137432 events Prepared event 90000 for Background with 137432 events Prepared event 100000 for Background with 137432 events Prepared event 110000 for Background with 137432 events Prepared event 120000 for Background with 137432 events Prepared event 130000 for Background with 137432 events Warning: found 4533 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 182885 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4533 negative weights. Signal fraction: 62.3774757 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 62.9475479 65.1894836 66.7518311 67.7524414 68.7298889 69.8718262 70.6580276 71.3845215 72.2951508 73.0358887 73.8235931 74.4706421 75.177681 75.7594604 76.3869476 77.0084457 77.5573349 78.2102051 78.738327 79.3625641 80.0100098 80.6098557 81.1478882 81.669075 82.356781 83.0551453 83.6550751 84.5343933 85.2575989 86.0072784 86.7839508 87.4859543 88.449173 89.0808563 89.7966003 90.7345123 91.6164703 92.4073944 93.2023621 94.0393372 94.7667542 95.5635376 96.394043 97.309021 98.078064 99.05159 99.8254547 100.750641 101.551041 102.320435 103.148911 103.965424 104.582535 105.38446 106.302078 107.098862 108.03051 108.832016 109.782814 110.742912 111.795776 112.828079 113.977661 115.268173 116.464989 117.812325 119.319687 120.879013 122.426239 124.129211 125.934174 127.83149 129.484909 131.49617 133.379181 135.244675 137.225739 139.349701 141.293228 143.601471 145.973953 148.295609 151.239014 154.292191 157.425629 160.581635 164.128586 168.17746 172.700531 177.345917 182.802124 188.928619 196.151566 204.812988 216.744522 230.220856 249.40802 279.926086 328.671997 871.385864 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.2840118 20.58881 20.8561363 21.1134071 21.3154488 21.5064144 21.7172356 21.9358788 22.1397552 22.3399754 22.562439 22.7469902 22.9366951 23.1360035 23.2765198 23.4731827 23.6517601 23.8549595 24.0822029 24.3096046 24.5045624 24.704216 24.9038334 25.0920658 25.2591763 25.4585819 25.6541157 25.8256302 26.04422 26.2090454 26.4152527 26.6136284 26.8246422 27.0637417 27.229744 27.4329281 27.6332321 27.8247833 28.0205994 28.2248268 28.4388485 28.6411133 28.8381119 29.0529633 29.2689095 29.4784203 29.711132 29.9458714 30.1489487 30.4194565 30.6214294 30.8520889 31.1217537 31.3755798 31.5880051 31.8152809 32.0293808 32.2772141 32.5324402 32.7698288 33.0543747 33.3036385 33.6399193 33.9455185 34.1930161 34.5008316 34.8048019 35.145195 35.4495773 35.7582092 36.0888672 36.4507484 36.7729721 37.1328354 37.4916306 37.9051132 38.3371277 38.7852783 39.2620277 39.7109222 40.1179123 40.6547546 41.0144272 41.634613 42.375061 43.0208588 43.8467407 44.7170868 45.7197495 46.7713623 47.9132843 49.3522758 50.8810043 53.0310478 55.5754166 58.362587 61.9062119 68.0233612 79.563652 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.0942402 10.1904011 10.288538 10.3762484 10.4562912 10.5330219 10.6142349 10.7160492 10.7972002 10.8952522 10.9778748 11.0745506 11.1608496 11.2582817 11.3616829 11.4675713 11.5606365 11.6561508 11.7601948 11.86096 11.9643526 12.0675716 12.1700468 12.2652512 12.3560944 12.4759541 12.576273 12.6917744 12.8033237 12.9139385 13.028924 13.1598263 13.2929792 13.4161654 13.5328484 13.6507082 13.7705364 13.8747244 13.9773712 14.1010141 14.2246552 14.3393078 14.4695292 14.6110086 14.7542353 14.8993607 15.0333939 15.1884289 15.3058605 15.4382839 15.5685415 15.7199669 15.8629742 15.9842072 16.1465874 16.3162994 16.4485741 16.5917931 16.7386665 16.8876534 17.0605278 17.2354164 17.4366455 17.620285 17.7945633 17.9862728 18.1013603 18.2880669 18.4954224 18.7088814 18.9367256 19.1136169 19.3341942 19.5751266 19.8070488 20.0373325 20.2434883 20.4258347 20.6665077 20.9017525 21.1388512 21.405117 21.6884804 21.9662094 22.2984524 22.6173859 22.9912148 23.4000435 23.7905388 24.2249699 24.708847 25.3206062 25.9607048 26.7895203 27.7613373 28.7431526 30.2431374 32.570961 36.9256744 86.878418 ------------------------------ Transdef: Tab for variable 5 0.890665531 2.27823019 2.63827324 2.91996288 3.17109537 3.36443162 3.54414654 3.71227503 3.85187054 3.98059607 4.09594345 4.17872143 4.27664757 4.36427832 4.44150639 4.53737354 4.61849022 4.68403912 4.75638008 4.82206583 4.89526176 4.95289898 5.00920105 5.06290817 5.12136745 5.17066765 5.22719288 5.28319454 5.33203125 5.37767601 5.43028831 5.46939373 5.51754951 5.54003382 5.58520985 5.62599659 5.66767359 5.71491432 5.75354004 5.79548645 5.83653545 5.87828732 5.92080402 5.95580101 5.99433613 6.03297138 6.07477093 6.10972404 6.14853001 6.18934441 6.21929646 6.25644684 6.28267241 6.32257843 6.35947752 6.39790392 6.44228172 6.47895336 6.51356125 6.55072546 6.5919838 6.63023901 6.66758537 6.71001101 6.74674225 6.78890753 6.82963991 6.86766672 6.9051137 6.94855404 6.9793663 7.02288485 7.06225109 7.1021018 7.15028667 7.19147587 7.23644638 7.28511524 7.32889843 7.37682152 7.42142248 7.47254658 7.52372885 7.5790844 7.63893318 7.70242357 7.77238178 7.84180069 7.9157095 8.0020895 8.09084511 8.19278336 8.3058548 8.43954754 8.5834198 8.77442837 8.98187447 9.2942028 9.77495098 10.9483576 19.2163315 ------------------------------ Transdef: Tab for variable 6 15.0050735 18.9929237 22.8647614 25.3158302 26.1793861 27.0112534 27.7550659 28.5071373 29.1824989 29.7994652 30.4778671 30.9617081 31.4246273 31.8933868 32.3199463 32.7741737 33.2384338 33.5764465 34.0065765 34.3663406 34.7165413 35.0402679 35.3899612 35.7296638 36.0149078 36.3802795 36.720459 37.0793304 37.4110413 37.7431068 38.0545197 38.3853683 38.6915894 38.9839249 39.2919388 39.6021423 39.9000168 40.2049332 40.5099564 40.8489418 41.1488876 41.4938393 41.8244858 42.1451035 42.4503441 42.7614899 43.0171585 43.2277985 43.5753174 43.8514175 44.1034622 44.474205 44.8512535 45.242569 45.6419067 46.0163727 46.4333687 46.8077698 47.176918 47.48983 47.8618813 48.2089691 48.6531448 49.0177498 49.3974876 49.7635803 50.0934143 50.4990158 50.8805466 51.3205185 51.7485199 52.1848259 52.620697 53.1462631 53.6212044 54.0864182 54.6211166 55.1462097 55.647583 56.2196503 56.8545227 57.4192734 58.0817184 58.6877365 59.4868965 60.2311287 61.1716995 62.0684128 63.2095566 64.3692627 65.6684189 67.3249054 69.1527481 71.0063324 73.2982178 76.146698 78.2911377 83.1409454 89.3252029 100.890106 280.646332 ------------------------------ Transdef: Tab for variable 7 30.1229668 32.4671707 33.4496307 34.1728287 34.753376 35.2840958 35.6993141 36.1071739 36.5181465 36.9046936 37.2416916 37.5353394 37.8630219 38.2071686 38.535614 38.8114929 39.1314774 39.3816147 39.6994095 39.9444122 40.2267685 40.4718094 40.7742233 41.0730515 41.4337769 41.7579765 42.0816956 42.3999367 42.7463989 43.1518097 43.5566254 43.9978752 44.4537201 44.8441315 45.1753159 45.6283226 46.0787506 46.528389 47.0373535 47.4127197 47.9267273 48.3960724 48.8758469 49.3207741 49.7979088 50.3632164 50.8610535 51.3839645 51.9592743 52.4968414 53.0836258 53.6658211 54.3052444 54.8824615 55.4681549 56.1098976 56.7967033 57.5892715 58.4904442 59.4003525 60.4858017 61.274025 62.3375015 63.3402176 64.5223007 65.7498627 67.0930328 68.328537 69.6671371 71.0937805 72.4687958 73.7746124 75.1568146 76.7571106 78.2861786 79.8059464 81.4330292 82.9042358 84.7112122 86.6570892 88.6611176 90.7174988 93.0382004 95.8724365 98.7098236 101.201706 104.06459 107.338516 110.71447 114.638535 119.068626 124.305664 129.725739 135.78183 142.072998 151.149078 161.869415 177.137115 199.982056 243.555222 555.834167 ------------------------------ Transdef: Tab for variable 8 0.862621069 20.7031593 25.595726 28.2348557 29.9454823 30.9776268 31.9215775 32.5022964 33.0234528 33.5665588 33.9331779 34.3460236 34.7215614 35.0566559 35.4039383 35.6968155 36.0122757 36.2971802 36.5437393 36.8301315 37.0696564 37.3061066 37.5436478 37.7891769 38.0208511 38.2786331 38.5641174 38.791214 39.0139694 39.2525024 39.4545517 39.6714325 39.9205704 40.1934814 40.4670181 40.762249 41.0336304 41.2744141 41.5520172 41.872303 42.1679306 42.4827347 42.7730408 43.0729141 43.4021416 43.7051544 43.9822845 44.2807693 44.5536499 44.9021378 45.2006721 45.5354919 45.8746796 46.25383 46.6131477 46.9638443 47.3075485 47.6700554 48.0200195 48.260788 48.6247063 48.9248886 49.3345795 49.6913795 50.0523376 50.4317093 50.8403778 51.2542419 51.6898041 52.1233864 52.5294266 52.9652634 53.470726 53.8959274 54.3860512 54.8733826 55.3899002 55.9173355 56.5115585 57.1010437 57.7727203 58.4480247 59.1785622 60.013607 60.8750954 61.8158569 62.9274139 64.0964508 65.3532639 66.7634048 68.3521423 70.009285 71.9396515 74.1348267 76.5286789 79.705864 83.6681671 88.5935211 98.5620728 123.95388 363.523895 ------------------------------ Transdef: Tab for variable 9 48.8581314 62.5037575 64.263855 65.8914337 67.0580292 67.8725128 68.7644043 69.7026443 70.3419495 71.0333405 71.7624969 72.5345306 73.1616135 73.8257675 74.3980255 75.0085754 75.5285416 76.043335 76.624115 77.0650024 77.5697021 78.1152496 78.571167 79.1009979 79.6389923 80.1321259 80.6297684 81.0771484 81.5384216 82.0336609 82.5984192 83.195694 83.6898651 84.2970734 84.8205795 85.3446655 85.9893723 86.5941849 87.1197968 87.6910858 88.3902512 88.8356171 89.3778687 90.0776672 90.6753998 91.3215179 91.9527512 92.572258 93.1116638 93.705513 94.3638458 94.9368134 95.5233994 96.1567078 96.7774658 97.4407959 98.0748444 98.7855682 99.3854523 100.058167 100.758347 101.391525 101.908424 102.464676 103.028976 103.590164 104.226532 104.84269 105.437286 106.128433 106.73687 107.403671 108.040207 108.631821 109.343002 110.027527 110.680161 111.410965 112.127045 112.982361 113.812714 114.734787 115.584839 116.571457 117.613419 118.772987 120.064377 121.406647 123.14164 125.082611 127.210632 129.855667 132.704895 135.947754 140.431992 145.582062 151.011032 160.362122 174.698013 214.555847 582.80835 ------------------------------ Transdef: Tab for variable 10 0.00602381537 0.700278401 1.02849436 1.24203026 1.40026331 1.54137552 1.64050496 1.74579465 1.83540154 1.91339445 1.98049259 2.05459547 2.11141491 2.1661694 2.21904564 2.26273346 2.30826879 2.35188699 2.39260674 2.4339242 2.46628666 2.50034547 2.5340147 2.5641551 2.59109974 2.61569738 2.64185905 2.66717172 2.6914196 2.71164775 2.73249578 2.75325108 2.77096462 2.7864809 2.80198669 2.81824422 2.83174562 2.84393191 2.85347223 2.86534858 2.87610722 2.88574028 2.89505386 2.90434456 2.91445398 2.9217844 2.929353 2.93752766 2.94608974 2.95227671 2.9589324 2.96580124 2.97180176 2.97799754 2.98364806 2.98819304 2.99335432 2.99702978 3.00273681 3.00767136 3.01246405 3.01691556 3.02151775 3.02590895 3.03015637 3.03439212 3.0378232 3.04154778 3.0445509 3.04820514 3.05253625 3.05641294 3.05980444 3.06374002 3.06705141 3.07021856 3.07336378 3.0764389 3.07996798 3.08349276 3.08691549 3.08999872 3.09291625 3.09539366 3.09832239 3.10153246 3.10440183 3.10726523 3.11032057 3.11331773 3.1159327 3.11861277 3.12119055 3.12398815 3.12681341 3.12892246 3.13150573 3.13385868 3.13630152 3.13898778 3.14159131 ------------------------------ Transdef: Tab for variable 11 2.86871432E-06 0.00660272781 0.0110372296 0.0186218079 0.0253839493 0.0334373154 0.0416194201 0.0498318076 0.0591979027 0.0673736334 0.0761838853 0.0853341222 0.0934971571 0.101594448 0.110208705 0.118081927 0.12593767 0.133931756 0.142810643 0.151299894 0.159136295 0.166530252 0.173644543 0.181135148 0.188712001 0.195753098 0.203172326 0.210517645 0.217418849 0.224318862 0.230609506 0.236347258 0.243511021 0.250270367 0.25691855 0.262751877 0.269318372 0.276317954 0.282603264 0.289200604 0.295583308 0.301425159 0.307576448 0.313119471 0.319701552 0.32600069 0.332140446 0.337871134 0.343925953 0.349440306 0.355417073 0.360161573 0.366731763 0.373211384 0.379324794 0.385396004 0.389916897 0.395016789 0.400747925 0.407066733 0.413373947 0.419072986 0.425655514 0.432201743 0.438646793 0.445034146 0.450571448 0.456417441 0.462185383 0.468795478 0.474201024 0.479934812 0.48783505 0.495007277 0.50269568 0.510019481 0.517421722 0.523949623 0.531487465 0.539795578 0.545012951 0.552039981 0.560199857 0.568716764 0.577467799 0.586545229 0.596438169 0.605565488 0.615046263 0.625946045 0.637239635 0.65072298 0.664452255 0.679062366 0.697566271 0.71687746 0.741085172 0.775304317 0.811312675 0.869432628 1.1246134 ------------------------------ Transdef: Tab for variable 12 0.101936691 0.201482713 0.232484594 0.250900269 0.266747653 0.280899167 0.291806281 0.302297771 0.311520219 0.320847988 0.329863727 0.338506043 0.346903443 0.353225857 0.358676344 0.367246151 0.374409795 0.380829155 0.387416005 0.394076288 0.399720788 0.404879719 0.410440415 0.414686471 0.419247001 0.423639804 0.428007752 0.432717025 0.436909854 0.441553563 0.445787251 0.450118661 0.454966426 0.459244907 0.463549554 0.467631221 0.471736282 0.475767136 0.479899049 0.484216869 0.48859638 0.492248148 0.496774912 0.500604689 0.504789829 0.509098053 0.513201356 0.517897129 0.521873891 0.526024938 0.530608296 0.535126269 0.539576709 0.54431963 0.54742533 0.552117109 0.556558669 0.560387373 0.565052032 0.569948435 0.574415803 0.578863025 0.583400607 0.587540865 0.592074513 0.596828461 0.601875305 0.605693817 0.610457659 0.615599394 0.620310187 0.625350535 0.630563259 0.635652781 0.642035484 0.647565424 0.654485822 0.660407305 0.666107535 0.672307134 0.677169442 0.683110416 0.689647436 0.696723938 0.703037679 0.711193323 0.718461394 0.726151824 0.735739827 0.743167162 0.753587544 0.763572395 0.775624633 0.788252771 0.801761985 0.818349361 0.838573337 0.859319687 0.883577347 0.928084612 1.13539624 ------------------------------ Transdef: Tab for variable 13 20.0121021 21.3227863 22.0971603 22.6665478 23.2310925 23.7003708 24.1661148 24.6351929 25.0262489 25.346489 25.7396679 26.1720238 26.5961075 27.0187302 27.3301373 27.6479092 28.0176926 28.3383121 28.6451054 28.9568214 29.2830238 29.5801315 29.8565903 30.1441612 30.4617996 30.7324772 30.9808559 31.2479172 31.5101814 31.8480606 32.1844711 32.4334488 32.7182541 33.0330124 33.309021 33.6410904 34.0123863 34.3436623 34.5148163 34.8335419 35.1637192 35.4615974 35.8326569 36.1389465 36.4933701 36.8383636 37.1862869 37.4840431 37.8293076 38.1965866 38.5525169 38.9260979 39.296196 39.688652 40.0951614 40.4863892 40.9348221 41.3099136 41.7464523 42.2233887 42.6344757 43.0647125 43.4961548 43.9427185 44.4216156 44.9698334 45.5288239 46.1168823 46.6485443 47.2650909 47.8313904 48.4281769 49.1283722 49.8577309 50.5669785 51.2392082 52.0421448 52.8489151 53.69767 54.5188751 55.4289513 56.5515442 57.5766678 58.6456223 59.9680405 61.1820908 62.5645294 64.1443329 65.6800232 67.3451996 68.5368195 70.5867538 72.8585815 75.5560913 78.4190216 82.2339172 86.3297348 90.6540604 97.5907745 111.868271 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0089645 10.588232 10.8575869 11.0729237 11.3366642 11.5789413 11.7961254 12.0221205 12.250658 12.3951378 12.5758743 12.7640419 12.9432259 13.1535473 13.3448925 13.5420074 13.7289915 13.9092426 14.0959234 14.2580986 14.4513073 14.6072121 14.8039875 15.0005665 15.1900043 15.3815718 15.5529022 15.7161636 15.9169006 16.0964813 16.2854767 16.4607277 16.6119366 16.7812729 16.9511223 17.1384583 17.3280067 17.5443096 17.7187614 17.8817482 18.0562496 18.2540588 18.4590759 18.6571846 18.8217659 19.0343857 19.2142811 19.4316921 19.6684837 19.8742065 20.0664482 20.290451 20.4998016 20.7226257 20.9658375 21.1897392 21.4211311 21.6714973 21.8850937 22.1051102 22.3569107 22.5948772 22.8606377 23.1213531 23.3985558 23.6734428 23.9678535 24.2612228 24.5633926 24.910675 25.2331867 25.5455875 25.8283348 26.1287346 26.4767761 26.8985691 27.2585449 27.6640263 27.960804 28.3765259 28.8296452 29.281105 29.8926411 30.4604893 31.0855045 31.7163887 32.3835106 33.0943604 33.889595 34.7189713 35.741703 36.8228912 38.0179405 39.6221848 40.7288589 42.6278191 44.5634766 47.4930496 51.7078247 59.4936829 115.518631 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 49.8 37.1 21.8 -0.7 24.3 49.2 31.2 44.0 -29.8 -8.3 -18.4 6.8 -6.6 2 49.8 100.0 64.5 44.5 11.3 54.0 93.9 61.0 89.5 -52.6 -20.9 -42.5 33.8 16.7 3 37.1 64.5 100.0 22.4 -8.7 22.7 67.8 45.8 70.3 -20.8 -21.7 -47.4 64.8 3.5 4 21.8 44.5 22.4 100.0 -5.5 15.7 46.9 31.9 48.5 -13.7 -25.4 -50.3 10.1 67.9 5 -0.7 11.3 -8.7 -5.5 100.0 79.0 -16.2 41.8 39.3 31.2 2.4 6.4 -12.5 -7.4 6 24.3 54.0 22.7 15.7 79.0 100.0 31.4 68.7 71.2 -1.4 -7.9 -14.6 5.4 1.3 7 49.2 93.9 67.8 46.9 -16.2 31.4 100.0 55.0 77.0 -58.7 -20.6 -44.0 38.4 19.9 8 31.2 61.0 45.8 31.9 41.8 68.7 55.0 100.0 73.6 -9.9 -17.3 -31.5 23.8 12.9 9 44.0 89.5 70.3 48.5 39.3 71.2 77.0 73.6 100.0 -26.8 -23.0 -47.5 38.1 20.2 10 -29.8 -52.6 -20.8 -13.7 31.2 -1.4 -58.7 -9.9 -26.8 100.0 4.8 11.7 -9.5 -2.8 11 -8.3 -20.9 -21.7 -25.4 2.4 -7.9 -20.6 -17.3 -23.0 4.8 100.0 55.4 -11.8 -17.0 12 -18.4 -42.5 -47.4 -50.3 6.4 -14.6 -44.0 -31.5 -47.5 11.7 55.4 100.0 -25.8 -27.0 13 6.8 33.8 64.8 10.1 -12.5 5.4 38.4 23.8 38.1 -9.5 -11.8 -25.8 100.0 37.5 14 -6.6 16.7 3.5 67.9 -7.4 1.3 19.9 12.9 20.2 -2.8 -17.0 -27.0 37.5 100.0 TOTAL CORRELATION TO TARGET (diagonal) 107.827516 TOTAL CORRELATION OF ALL VARIABLES 55.5262468 ROUND 1: MAX CORR ( 55.5209821) AFTER KILLING INPUT VARIABLE 9 CONTR 0.764607873 ROUND 2: MAX CORR ( 55.5148105) AFTER KILLING INPUT VARIABLE 11 CONTR 0.827812261 ROUND 3: MAX CORR ( 55.5092265) AFTER KILLING INPUT VARIABLE 7 CONTR 0.78737561 ROUND 4: MAX CORR ( 55.4670639) AFTER KILLING INPUT VARIABLE 8 CONTR 2.16311132 ROUND 5: MAX CORR ( 55.3790845) AFTER KILLING INPUT VARIABLE 10 CONTR 3.12284783 ROUND 6: MAX CORR ( 55.1559331) AFTER KILLING INPUT VARIABLE 6 CONTR 4.9664915 ROUND 7: MAX CORR ( 54.8027574) AFTER KILLING INPUT VARIABLE 5 CONTR 6.23175273 ROUND 8: MAX CORR ( 54.4686465) AFTER KILLING INPUT VARIABLE 13 CONTR 6.04224822 ROUND 9: MAX CORR ( 54.0468554) AFTER KILLING INPUT VARIABLE 12 CONTR 6.76541763 ROUND 10: MAX CORR ( 53.7625241) AFTER KILLING INPUT VARIABLE 3 CONTR 5.53656743 ROUND 11: MAX CORR ( 52.0154514) AFTER KILLING INPUT VARIABLE 4 CONTR 13.594183 ROUND 12: MAX CORR ( 49.7839) AFTER KILLING INPUT VARIABLE 14 CONTR 15.0721759 LAST REMAINING VARIABLE: 2 total correlation to target: 55.5262468 % total significance: 106.329915 sigma correlations of single variables to target: variable 2: 49.7839 % , in sigma: 95.3336158 variable 3: 37.0555724 % , in sigma: 70.9595211 variable 4: 21.79408 % , in sigma: 41.7345457 variable 5: -0.7379183 % , in sigma: 1.41307571 variable 6: 24.3218788 % , in sigma: 46.5751508 variable 7: 49.1623238 % , in sigma: 94.1433291 variable 8: 31.1621495 % , in sigma: 59.6739184 variable 9: 43.9633573 % , in sigma: 84.1875749 variable 10: -29.8216366 % , in sigma: 57.1069049 variable 11: -8.31783337 % , in sigma: 15.9282244 variable 12: -18.4162192 % , in sigma: 35.2661155 variable 13: 6.83230871 % , in sigma: 13.0835208 variable 14: -6.55717086 % , in sigma: 12.556646 variables sorted by significance: 1 most relevant variable 2 corr 49.7839012 , in sigma: 95.3336181 2 most relevant variable 14 corr 15.072176 , in sigma: 28.8624442 3 most relevant variable 4 corr 13.594183 , in sigma: 26.0321633 4 most relevant variable 3 corr 5.53656721 , in sigma: 10.6022423 5 most relevant variable 12 corr 6.76541758 , in sigma: 12.9554278 6 most relevant variable 13 corr 6.04224825 , in sigma: 11.5705956 7 most relevant variable 5 corr 6.23175287 , in sigma: 11.9334872 8 most relevant variable 6 corr 4.9664917 , in sigma: 9.51057694 9 most relevant variable 10 corr 3.1228478 , in sigma: 5.9800934 10 most relevant variable 8 corr 2.16311121 , in sigma: 4.14224705 11 most relevant variable 7 corr 0.787375629 , in sigma: 1.50778396 12 most relevant variable 11 corr 0.827812254 , in sigma: 1.58521802 13 most relevant variable 9 corr 0.764607847 , in sigma: 1.46418482 global correlations between input variables: variable 2: 98.9508755 % variable 3: 93.5958913 % variable 4: 89.4287223 % variable 5: 94.0924248 % variable 6: 92.5128113 % variable 7: 98.4716181 % variable 8: 84.3608417 % variable 9: 98.5805166 % variable 10: 72.4063322 % variable 11: 56.5112688 % variable 12: 73.7396403 % variable 13: 83.9624787 % variable 14: 85.5988867 % significance loss when removing single variables: variable 2: corr = 3.55362233 % , sigma = 6.80500455 variable 3: corr = 6.04853495 % , sigma = 11.5826343 variable 4: corr = 7.99326322 % , sigma = 15.3066892 variable 5: corr = 4.34845299 % , sigma = 8.3270645 variable 6: corr = 3.79672176 % , sigma = 7.27052748 variable 7: corr = 1.01346735 % , sigma = 1.94073802 variable 8: corr = 1.21611104 % , sigma = 2.32879029 variable 9: corr = 0.764607873 % , sigma = 1.46418487 variable 10: corr = 3.16831306 % , sigma = 6.06715706 variable 11: corr = 0.864660965 % , sigma = 1.65578141 variable 12: corr = 6.45170551 % , sigma = 12.3546852 variable 13: corr = 6.29907269 % , sigma = 12.0624012 variable 14: corr = 10.4588104 % , sigma = 20.0280855 Keep only 10 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 11 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 27.8894672 sigma out 15 active outputs RANK 2 NODE 11 --> 22.3077183 sigma out 15 active outputs RANK 3 NODE 2 --> 21.6534843 sigma out 15 active outputs RANK 4 NODE 10 --> 19.1802902 sigma out 15 active outputs RANK 5 NODE 7 --> 18.1599693 sigma out 15 active outputs RANK 6 NODE 1 --> 16.5371685 sigma out 15 active outputs RANK 7 NODE 3 --> 15.3997355 sigma out 15 active outputs RANK 8 NODE 4 --> 15.0291557 sigma out 15 active outputs RANK 9 NODE 5 --> 14.9710197 sigma out 15 active outputs RANK 10 NODE 6 --> 14.1364756 sigma out 15 active outputs RANK 11 NODE 8 --> 11.9687643 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 35.0688248 sigma in 11act. ( 36.0551758 sig out 1act.) RANK 2 NODE 8 --> 20.0848598 sigma in 11act. ( 21.7243061 sig out 1act.) RANK 3 NODE 2 --> 19.3681049 sigma in 11act. ( 21.1788311 sig out 1act.) RANK 4 NODE 13 --> 19.3101902 sigma in 11act. ( 20.3802872 sig out 1act.) RANK 5 NODE 1 --> 18.8269329 sigma in 11act. ( 18.8639641 sig out 1act.) RANK 6 NODE 3 --> 17.7120895 sigma in 11act. ( 18.4926891 sig out 1act.) RANK 7 NODE 14 --> 14.3243113 sigma in 11act. ( 17.2667084 sig out 1act.) RANK 8 NODE 9 --> 11.430439 sigma in 11act. ( 12.6866808 sig out 1act.) RANK 9 NODE 5 --> 11.0827188 sigma in 11act. ( 12.0514355 sig out 1act.) RANK 10 NODE 15 --> 9.4943943 sigma in 11act. ( 9.02256012 sig out 1act.) RANK 11 NODE 11 --> 8.73962879 sigma in 11act. ( 9.51082516 sig out 1act.) RANK 12 NODE 12 --> 6.28704262 sigma in 11act. ( 8.09142971 sig out 1act.) RANK 13 NODE 6 --> 4.01152229 sigma in 11act. ( 3.80350018 sig out 1act.) RANK 14 NODE 7 --> 3.22854447 sigma in 11act. ( 5.70453739 sig out 1act.) RANK 15 NODE 10 --> 2.25582123 sigma in 11act. ( 3.44983912 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 36.0551758 sigma out 1act.( 35.0688248 sig in 11act.) RANK 2 NODE 8 --> 21.7243061 sigma out 1act.( 20.0848598 sig in 11act.) RANK 3 NODE 2 --> 21.1788311 sigma out 1act.( 19.3681049 sig in 11act.) RANK 4 NODE 13 --> 20.3802872 sigma out 1act.( 19.3101902 sig in 11act.) RANK 5 NODE 1 --> 18.8639641 sigma out 1act.( 18.8269329 sig in 11act.) RANK 6 NODE 3 --> 18.4926891 sigma out 1act.( 17.7120895 sig in 11act.) RANK 7 NODE 14 --> 17.2667084 sigma out 1act.( 14.3243113 sig in 11act.) RANK 8 NODE 9 --> 12.6866808 sigma out 1act.( 11.430439 sig in 11act.) RANK 9 NODE 5 --> 12.0514355 sigma out 1act.( 11.0827188 sig in 11act.) RANK 10 NODE 11 --> 9.51082516 sigma out 1act.( 8.73962879 sig in 11act.) RANK 11 NODE 15 --> 9.02256012 sigma out 1act.( 9.4943943 sig in 11act.) RANK 12 NODE 12 --> 8.09142971 sigma out 1act.( 6.28704262 sig in 11act.) RANK 13 NODE 7 --> 5.70453739 sigma out 1act.( 3.22854447 sig in 11act.) RANK 14 NODE 6 --> 3.80350018 sigma out 1act.( 4.01152229 sig in 11act.) RANK 15 NODE 10 --> 3.44983912 sigma out 1act.( 2.25582123 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 65.0708923 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 30.5297775 sigma out 15 active outputs RANK 2 NODE 11 --> 22.5703545 sigma out 15 active outputs RANK 3 NODE 2 --> 22.4534378 sigma out 15 active outputs RANK 4 NODE 7 --> 20.0672798 sigma out 15 active outputs RANK 5 NODE 10 --> 19.3129444 sigma out 15 active outputs RANK 6 NODE 1 --> 18.7512474 sigma out 15 active outputs RANK 7 NODE 5 --> 17.6708927 sigma out 15 active outputs RANK 8 NODE 3 --> 16.0982208 sigma out 15 active outputs RANK 9 NODE 4 --> 14.7009649 sigma out 15 active outputs RANK 10 NODE 6 --> 14.5656223 sigma out 15 active outputs RANK 11 NODE 8 --> 14.1303234 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 4 --> 29.76404 sigma in 11act. ( 32.7203979 sig out 1act.) RANK 2 NODE 2 --> 22.8728733 sigma in 11act. ( 20.8192043 sig out 1act.) RANK 3 NODE 8 --> 20.5630131 sigma in 11act. ( 20.8444576 sig out 1act.) RANK 4 NODE 14 --> 19.2422447 sigma in 11act. ( 18.1060486 sig out 1act.) RANK 5 NODE 13 --> 18.8565216 sigma in 11act. ( 19.0836506 sig out 1act.) RANK 6 NODE 1 --> 18.6398716 sigma in 11act. ( 17.9713535 sig out 1act.) RANK 7 NODE 3 --> 18.4638805 sigma in 11act. ( 17.0567646 sig out 1act.) RANK 8 NODE 9 --> 13.9185247 sigma in 11act. ( 12.5686102 sig out 1act.) RANK 9 NODE 5 --> 13.2685966 sigma in 11act. ( 11.51056 sig out 1act.) RANK 10 NODE 7 --> 12.9072151 sigma in 11act. ( 7.61585712 sig out 1act.) RANK 11 NODE 12 --> 11.8648195 sigma in 11act. ( 8.22666931 sig out 1act.) RANK 12 NODE 10 --> 11.5777674 sigma in 11act. ( 4.89656544 sig out 1act.) RANK 13 NODE 11 --> 10.9553041 sigma in 11act. ( 9.20593262 sig out 1act.) RANK 14 NODE 15 --> 8.91890812 sigma in 11act. ( 7.85994816 sig out 1act.) RANK 15 NODE 6 --> 3.92904449 sigma in 11act. ( 3.20356011 sig out 1act.) sorted by output significance RANK 1 NODE 4 --> 32.7203979 sigma out 1act.( 29.76404 sig in 11act.) RANK 2 NODE 8 --> 20.8444576 sigma out 1act.( 20.5630131 sig in 11act.) RANK 3 NODE 2 --> 20.8192043 sigma out 1act.( 22.8728733 sig in 11act.) RANK 4 NODE 13 --> 19.0836506 sigma out 1act.( 18.8565216 sig in 11act.) RANK 5 NODE 14 --> 18.1060486 sigma out 1act.( 19.2422447 sig in 11act.) RANK 6 NODE 1 --> 17.9713535 sigma out 1act.( 18.6398716 sig in 11act.) RANK 7 NODE 3 --> 17.0567646 sigma out 1act.( 18.4638805 sig in 11act.) RANK 8 NODE 9 --> 12.5686102 sigma out 1act.( 13.9185247 sig in 11act.) RANK 9 NODE 5 --> 11.51056 sigma out 1act.( 13.2685966 sig in 11act.) RANK 10 NODE 11 --> 9.20593262 sigma out 1act.( 10.9553041 sig in 11act.) RANK 11 NODE 12 --> 8.22666931 sigma out 1act.( 11.8648195 sig in 11act.) RANK 12 NODE 15 --> 7.85994816 sigma out 1act.( 8.91890812 sig in 11act.) RANK 13 NODE 7 --> 7.61585712 sigma out 1act.( 12.9072151 sig in 11act.) RANK 14 NODE 10 --> 4.89656544 sigma out 1act.( 11.5777674 sig in 11act.) RANK 15 NODE 6 --> 3.20356011 sigma out 1act.( 3.92904449 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 61.9788857 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.429610252 *** contribution from regularisation: 0.00452826219 *** contribution from error: -0.434138507 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.463828117 *** contribution from regularisation: 0.00300303195 *** contribution from error: -0.466831148 *********************************************** -----------------> Test sample ENTER BFGS code START -42422.5154 0.257532358 0.454488307 EXIT FROM BFGS code FG_START 0. 0.257532358 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.479773343 *** contribution from regularisation: 0.00263751904 *** contribution from error: -0.482410848 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -43871.4327 0.257532358 309.57547 EXIT FROM BFGS code FG_LNSRCH 0. 0.339256138 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.494005114 *** contribution from regularisation: 0.00323082833 *** contribution from error: -0.497235954 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45172.8168 0.339256138 -87.8025055 EXIT FROM BFGS code NEW_X -45172.8168 0.339256138 -87.8025055 ENTER BFGS code NEW_X -45172.8168 0.339256138 -87.8025055 EXIT FROM BFGS code FG_LNSRCH 0. 0.325005561 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.498584569 *** contribution from regularisation: 0.00311131915 *** contribution from error: -0.501695871 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45591.5696 0.325005561 5.00088739 EXIT FROM BFGS code NEW_X -45591.5696 0.325005561 5.00088739 ENTER BFGS code NEW_X -45591.5696 0.325005561 5.00088739 EXIT FROM BFGS code FG_LNSRCH 0. 0.327276707 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.499304861 *** contribution from regularisation: 0.00307144434 *** contribution from error: -0.502376318 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45657.4348 0.327276707 1.47449541 EXIT FROM BFGS code NEW_X -45657.4348 0.327276707 1.47449541 ENTER BFGS code NEW_X -45657.4348 0.327276707 1.47449541 EXIT FROM BFGS code FG_LNSRCH 0. 0.328899443 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.499779165 *** contribution from regularisation: 0.00315113971 *** contribution from error: -0.502930284 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45700.8057 0.328899443 -25.2199497 EXIT FROM BFGS code NEW_X -45700.8057 0.328899443 -25.2199497 ENTER BFGS code NEW_X -45700.8057 0.328899443 -25.2199497 EXIT FROM BFGS code FG_LNSRCH 0. 0.319549799 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.500554025 *** contribution from regularisation: 0.00297519192 *** contribution from error: -0.503529191 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45771.6623 0.319549799 -43.941906 EXIT FROM BFGS code NEW_X -45771.6623 0.319549799 -43.941906 ENTER BFGS code NEW_X -45771.6623 0.319549799 -43.941906 EXIT FROM BFGS code FG_LNSRCH 0. 0.128851771 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.493553221 *** contribution from regularisation: 0.00380675541 *** contribution from error: -0.497359991 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -45131.4936 0.128851771 -147.456604 EXIT FROM BFGS code FG_LNSRCH 0. 0.26113078 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 33.8481522 sigma out 15 active outputs RANK 2 NODE 1 --> 23.9693508 sigma out 15 active outputs RANK 3 NODE 5 --> 18.8614445 sigma out 15 active outputs RANK 4 NODE 10 --> 18.073904 sigma out 15 active outputs RANK 5 NODE 7 --> 15.5671005 sigma out 15 active outputs RANK 6 NODE 2 --> 14.3807821 sigma out 15 active outputs RANK 7 NODE 11 --> 12.5565033 sigma out 15 active outputs RANK 8 NODE 8 --> 12.3094645 sigma out 15 active outputs RANK 9 NODE 4 --> 10.471303 sigma out 15 active outputs RANK 10 NODE 6 --> 10.2953472 sigma out 15 active outputs RANK 11 NODE 3 --> 8.00364113 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 28.3928089 sigma in 11act. ( 32.6907349 sig out 1act.) RANK 2 NODE 7 --> 23.6800327 sigma in 11act. ( 21.3141594 sig out 1act.) RANK 3 NODE 14 --> 19.5569134 sigma in 11act. ( 17.4686871 sig out 1act.) RANK 4 NODE 2 --> 18.5464725 sigma in 11act. ( 14.6107817 sig out 1act.) RANK 5 NODE 1 --> 18.2408466 sigma in 11act. ( 17.7368946 sig out 1act.) RANK 6 NODE 13 --> 17.5623779 sigma in 11act. ( 17.8983574 sig out 1act.) RANK 7 NODE 4 --> 13.842186 sigma in 11act. ( 15.2991991 sig out 1act.) RANK 8 NODE 8 --> 13.1947947 sigma in 11act. ( 12.7896595 sig out 1act.) RANK 9 NODE 12 --> 10.1232128 sigma in 11act. ( 7.31495857 sig out 1act.) RANK 10 NODE 9 --> 9.35536194 sigma in 11act. ( 7.82538462 sig out 1act.) RANK 11 NODE 11 --> 8.71743393 sigma in 11act. ( 6.84307003 sig out 1act.) RANK 12 NODE 3 --> 5.13460875 sigma in 11act. ( 2.77728128 sig out 1act.) RANK 13 NODE 5 --> 4.61880493 sigma in 11act. ( 0.732059777 sig out 1act.) RANK 14 NODE 15 --> 4.24047422 sigma in 11act. ( 3.55114651 sig out 1act.) RANK 15 NODE 6 --> 2.96459842 sigma in 11act. ( 2.24027038 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 32.6907349 sigma out 1act.( 28.3928089 sig in 11act.) RANK 2 NODE 7 --> 21.3141594 sigma out 1act.( 23.6800327 sig in 11act.) RANK 3 NODE 13 --> 17.8983574 sigma out 1act.( 17.5623779 sig in 11act.) RANK 4 NODE 1 --> 17.7368946 sigma out 1act.( 18.2408466 sig in 11act.) RANK 5 NODE 14 --> 17.4686871 sigma out 1act.( 19.5569134 sig in 11act.) RANK 6 NODE 4 --> 15.2991991 sigma out 1act.( 13.842186 sig in 11act.) RANK 7 NODE 2 --> 14.6107817 sigma out 1act.( 18.5464725 sig in 11act.) RANK 8 NODE 8 --> 12.7896595 sigma out 1act.( 13.1947947 sig in 11act.) RANK 9 NODE 9 --> 7.82538462 sigma out 1act.( 9.35536194 sig in 11act.) RANK 10 NODE 12 --> 7.31495857 sigma out 1act.( 10.1232128 sig in 11act.) RANK 11 NODE 11 --> 6.84307003 sigma out 1act.( 8.71743393 sig in 11act.) RANK 12 NODE 15 --> 3.55114651 sigma out 1act.( 4.24047422 sig in 11act.) RANK 13 NODE 3 --> 2.77728128 sigma out 1act.( 5.13460875 sig in 11act.) RANK 14 NODE 6 --> 2.24027038 sigma out 1act.( 2.96459842 sig in 11act.) RANK 15 NODE 5 --> 0.732059777 sigma out 1act.( 4.61880493 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 57.1108475 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.503374696 *** contribution from regularisation: 0.00234345323 *** contribution from error: -0.505718172 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -46029.5877 0.26113078 -91.074379 EXIT FROM BFGS code NEW_X -46029.5877 0.26113078 -91.074379 ENTER BFGS code NEW_X -46029.5877 0.26113078 -91.074379 EXIT FROM BFGS code FG_LNSRCH 0. 0.131207824 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.504448831 *** contribution from regularisation: 0.00349218445 *** contribution from error: -0.507941008 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46127.8084 0.131207824 -90.1492386 EXIT FROM BFGS code NEW_X -46127.8084 0.131207824 -90.1492386 ENTER BFGS code NEW_X -46127.8084 0.131207824 -90.1492386 EXIT FROM BFGS code FG_LNSRCH 0. 0.0888638198 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.507490337 *** contribution from regularisation: 0.00307040568 *** contribution from error: -0.510560751 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46405.931 0.0888638198 -28.8541813 EXIT FROM BFGS code NEW_X -46405.931 0.0888638198 -28.8541813 ENTER BFGS code NEW_X -46405.931 0.0888638198 -28.8541813 EXIT FROM BFGS code FG_LNSRCH 0. 0.0589334145 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.508217514 *** contribution from regularisation: 0.0031649915 *** contribution from error: -0.51138252 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46472.4252 0.0589334145 16.4678326 EXIT FROM BFGS code NEW_X -46472.4252 0.0589334145 16.4678326 ENTER BFGS code NEW_X -46472.4252 0.0589334145 16.4678326 EXIT FROM BFGS code FG_LNSRCH 0. 0.043476712 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.509163678 *** contribution from regularisation: 0.00320839696 *** contribution from error: -0.512372077 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46558.9465 0.043476712 3.39773178 EXIT FROM BFGS code NEW_X -46558.9465 0.043476712 3.39773178 ENTER BFGS code NEW_X -46558.9465 0.043476712 3.39773178 EXIT FROM BFGS code FG_LNSRCH 0. 0.0252528358 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.509940922 *** contribution from regularisation: 0.00323111704 *** contribution from error: -0.51317203 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46630.0199 0.0252528358 50.5459099 EXIT FROM BFGS code NEW_X -46630.0199 0.0252528358 50.5459099 ENTER BFGS code NEW_X -46630.0199 0.0252528358 50.5459099 EXIT FROM BFGS code FG_LNSRCH 0. 0.0121636037 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.51128906 *** contribution from regularisation: 0.00340442779 *** contribution from error: -0.514693499 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46753.2943 0.0121636037 32.474884 EXIT FROM BFGS code NEW_X -46753.2943 0.0121636037 32.474884 ENTER BFGS code NEW_X -46753.2943 0.0121636037 32.474884 EXIT FROM BFGS code FG_LNSRCH 0. -0.00946886186 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.509637475 *** contribution from regularisation: 0.00359163177 *** contribution from error: -0.513229132 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46602.2712 -0.00946886186 24.8009567 EXIT FROM BFGS code FG_LNSRCH 0. 0.00689910259 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.51177913 *** contribution from regularisation: 0.00329491752 *** contribution from error: -0.515074074 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46798.1051 0.00689910259 27.4851646 EXIT FROM BFGS code NEW_X -46798.1051 0.00689910259 27.4851646 ENTER BFGS code NEW_X -46798.1051 0.00689910259 27.4851646 EXIT FROM BFGS code FG_LNSRCH 0. 0.00495753484 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.512048721 *** contribution from regularisation: 0.00346292043 *** contribution from error: -0.515511632 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46822.7565 0.00495753484 -0.439271957 EXIT FROM BFGS code NEW_X -46822.7565 0.00495753484 -0.439271957 ENTER BFGS code NEW_X -46822.7565 0.00495753484 -0.439271957 EXIT FROM BFGS code FG_LNSRCH 0. 0.00735363318 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 62.2660065 sigma out 15 active outputs RANK 2 NODE 4 --> 31.5797501 sigma out 15 active outputs RANK 3 NODE 1 --> 26.0393105 sigma out 15 active outputs RANK 4 NODE 7 --> 25.1977673 sigma out 15 active outputs RANK 5 NODE 5 --> 21.2887363 sigma out 15 active outputs RANK 6 NODE 2 --> 19.2233448 sigma out 15 active outputs RANK 7 NODE 10 --> 18.9180107 sigma out 15 active outputs RANK 8 NODE 11 --> 18.6023788 sigma out 15 active outputs RANK 9 NODE 6 --> 17.3369236 sigma out 15 active outputs RANK 10 NODE 8 --> 17.2210484 sigma out 15 active outputs RANK 11 NODE 3 --> 11.1384783 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 71.636673 sigma in 11act. ( 96.5376663 sig out 1act.) RANK 2 NODE 4 --> 25.7088223 sigma in 11act. ( 29.5834217 sig out 1act.) RANK 3 NODE 1 --> 23.9114151 sigma in 11act. ( 23.0444069 sig out 1act.) RANK 4 NODE 7 --> 23.5125561 sigma in 11act. ( 21.5520153 sig out 1act.) RANK 5 NODE 13 --> 18.3603573 sigma in 11act. ( 19.3256302 sig out 1act.) RANK 6 NODE 2 --> 15.22083 sigma in 11act. ( 16.3527527 sig out 1act.) RANK 7 NODE 8 --> 14.4924726 sigma in 11act. ( 15.2504644 sig out 1act.) RANK 8 NODE 9 --> 12.969368 sigma in 11act. ( 14.2726297 sig out 1act.) RANK 9 NODE 5 --> 10.8795843 sigma in 11act. ( 11.5364027 sig out 1act.) RANK 10 NODE 11 --> 10.7413607 sigma in 11act. ( 10.3903999 sig out 1act.) RANK 11 NODE 12 --> 10.3998299 sigma in 11act. ( 10.0267324 sig out 1act.) RANK 12 NODE 14 --> 9.90904045 sigma in 11act. ( 7.12155247 sig out 1act.) RANK 13 NODE 15 --> 9.34632969 sigma in 11act. ( 10.4289713 sig out 1act.) RANK 14 NODE 3 --> 4.91309881 sigma in 11act. ( 4.31148005 sig out 1act.) RANK 15 NODE 6 --> 4.38740301 sigma in 11act. ( 4.38059568 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 96.5376663 sigma out 1act.( 71.636673 sig in 11act.) RANK 2 NODE 4 --> 29.5834217 sigma out 1act.( 25.7088223 sig in 11act.) RANK 3 NODE 1 --> 23.0444069 sigma out 1act.( 23.9114151 sig in 11act.) RANK 4 NODE 7 --> 21.5520153 sigma out 1act.( 23.5125561 sig in 11act.) RANK 5 NODE 13 --> 19.3256302 sigma out 1act.( 18.3603573 sig in 11act.) RANK 6 NODE 2 --> 16.3527527 sigma out 1act.( 15.22083 sig in 11act.) RANK 7 NODE 8 --> 15.2504644 sigma out 1act.( 14.4924726 sig in 11act.) RANK 8 NODE 9 --> 14.2726297 sigma out 1act.( 12.969368 sig in 11act.) RANK 9 NODE 5 --> 11.5364027 sigma out 1act.( 10.8795843 sig in 11act.) RANK 10 NODE 15 --> 10.4289713 sigma out 1act.( 9.34632969 sig in 11act.) RANK 11 NODE 11 --> 10.3903999 sigma out 1act.( 10.7413607 sig in 11act.) RANK 12 NODE 12 --> 10.0267324 sigma out 1act.( 10.3998299 sig in 11act.) RANK 13 NODE 14 --> 7.12155247 sigma out 1act.( 9.90904045 sig in 11act.) RANK 14 NODE 6 --> 4.38059568 sigma out 1act.( 4.38740301 sig in 11act.) RANK 15 NODE 3 --> 4.31148005 sigma out 1act.( 4.91309881 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 113.164719 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.512235045 *** contribution from regularisation: 0.00336968969 *** contribution from error: -0.515604734 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -46839.7985 0.00735363318 -8.97475529 EXIT FROM BFGS code NEW_X -46839.7985 0.00735363318 -8.97475529 ENTER BFGS code NEW_X -46839.7985 0.00735363318 -8.97475529 EXIT FROM BFGS code FG_LNSRCH 0. 0.00571807474 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.512451828 *** contribution from regularisation: 0.00331050553 *** contribution from error: -0.515762329 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46859.6173 0.00571807474 6.13191843 EXIT FROM BFGS code NEW_X -46859.6173 0.00571807474 6.13191843 ENTER BFGS code NEW_X -46859.6173 0.00571807474 6.13191843 EXIT FROM BFGS code FG_LNSRCH 0. 0.014060339 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.512570024 *** contribution from regularisation: 0.00329381367 *** contribution from error: -0.515863836 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46870.4289 0.014060339 -87.5496902 EXIT FROM BFGS code NEW_X -46870.4289 0.014060339 -87.5496902 ENTER BFGS code NEW_X -46870.4289 0.014060339 -87.5496902 EXIT FROM BFGS code FG_LNSRCH 0. 0.00125372398 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.512745678 *** contribution from regularisation: 0.00348636322 *** contribution from error: -0.516232014 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46886.4926 0.00125372398 -14.2525854 EXIT FROM BFGS code NEW_X -46886.4926 0.00125372398 -14.2525854 ENTER BFGS code NEW_X -46886.4926 0.00125372398 -14.2525854 EXIT FROM BFGS code FG_LNSRCH 0. -0.00648786686 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.512915373 *** contribution from regularisation: 0.00349553465 *** contribution from error: -0.516410887 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46902.0062 -0.00648786686 13.5568867 EXIT FROM BFGS code NEW_X -46902.0062 -0.00648786686 13.5568867 ENTER BFGS code NEW_X -46902.0062 -0.00648786686 13.5568867 EXIT FROM BFGS code FG_LNSRCH 0. -0.0112029007 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.513046741 *** contribution from regularisation: 0.00351922121 *** contribution from error: -0.516565979 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46914.0212 -0.0112029007 6.5723567 EXIT FROM BFGS code NEW_X -46914.0212 -0.0112029007 6.5723567 ENTER BFGS code NEW_X -46914.0212 -0.0112029007 6.5723567 EXIT FROM BFGS code FG_LNSRCH 0. -0.0395813771 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.51347822 *** contribution from regularisation: 0.0035007298 *** contribution from error: -0.516978979 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46953.4743 -0.0395813771 28.9277 EXIT FROM BFGS code NEW_X -46953.4743 -0.0395813771 28.9277 ENTER BFGS code NEW_X -46953.4743 -0.0395813771 28.9277 EXIT FROM BFGS code FG_LNSRCH 0. -0.0570644997 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.513783276 *** contribution from regularisation: 0.00360949175 *** contribution from error: -0.517392755 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46981.3724 -0.0570644997 -12.6748657 EXIT FROM BFGS code NEW_X -46981.3724 -0.0570644997 -12.6748657 ENTER BFGS code NEW_X -46981.3724 -0.0570644997 -12.6748657 EXIT FROM BFGS code FG_LNSRCH 0. -0.0667298585 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.513983667 *** contribution from regularisation: 0.00362089556 *** contribution from error: -0.517604589 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -46999.6944 -0.0667298585 -16.357378 EXIT FROM BFGS code NEW_X -46999.6944 -0.0667298585 -16.357378 ENTER BFGS code NEW_X -46999.6944 -0.0667298585 -16.357378 EXIT FROM BFGS code FG_LNSRCH 0. -0.0761606917 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.514118969 *** contribution from regularisation: 0.00363161438 *** contribution from error: -0.517750561 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47012.0671 -0.0761606917 3.81624031 EXIT FROM BFGS code NEW_X -47012.0671 -0.0761606917 3.81624031 ENTER BFGS code NEW_X -47012.0671 -0.0761606917 3.81624031 EXIT FROM BFGS code FG_LNSRCH 0. -0.0857824758 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 85.1607361 sigma out 15 active outputs RANK 2 NODE 1 --> 43.4420013 sigma out 15 active outputs RANK 3 NODE 4 --> 42.437809 sigma out 15 active outputs RANK 4 NODE 7 --> 32.318367 sigma out 15 active outputs RANK 5 NODE 2 --> 31.7769222 sigma out 15 active outputs RANK 6 NODE 10 --> 26.1661625 sigma out 15 active outputs RANK 7 NODE 11 --> 26.1200829 sigma out 15 active outputs RANK 8 NODE 5 --> 25.8719082 sigma out 15 active outputs RANK 9 NODE 6 --> 25.1335316 sigma out 15 active outputs RANK 10 NODE 8 --> 20.9824142 sigma out 15 active outputs RANK 11 NODE 3 --> 20.4051189 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 92.7657623 sigma in 11act. ( 120.003281 sig out 1act.) RANK 2 NODE 7 --> 37.2417221 sigma in 11act. ( 37.6055183 sig out 1act.) RANK 3 NODE 1 --> 36.3899384 sigma in 11act. ( 33.9228058 sig out 1act.) RANK 4 NODE 4 --> 36.0511208 sigma in 11act. ( 42.3816719 sig out 1act.) RANK 5 NODE 8 --> 28.2820663 sigma in 11act. ( 30.0378799 sig out 1act.) RANK 6 NODE 11 --> 27.0253716 sigma in 11act. ( 26.2266598 sig out 1act.) RANK 7 NODE 9 --> 22.2608585 sigma in 11act. ( 25.1356125 sig out 1act.) RANK 8 NODE 15 --> 22.0049877 sigma in 11act. ( 25.0563641 sig out 1act.) RANK 9 NODE 5 --> 19.9373379 sigma in 11act. ( 25.0855083 sig out 1act.) RANK 10 NODE 12 --> 19.3684826 sigma in 11act. ( 19.9708996 sig out 1act.) RANK 11 NODE 2 --> 18.9618187 sigma in 11act. ( 21.5550137 sig out 1act.) RANK 12 NODE 6 --> 10.8424444 sigma in 11act. ( 12.1805477 sig out 1act.) RANK 13 NODE 13 --> 8.50290394 sigma in 11act. ( 8.03341675 sig out 1act.) RANK 14 NODE 3 --> 7.08449078 sigma in 11act. ( 7.19721842 sig out 1act.) RANK 15 NODE 14 --> 4.56018114 sigma in 11act. ( 3.38780308 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 120.003281 sigma out 1act.( 92.7657623 sig in 11act.) RANK 2 NODE 4 --> 42.3816719 sigma out 1act.( 36.0511208 sig in 11act.) RANK 3 NODE 7 --> 37.6055183 sigma out 1act.( 37.2417221 sig in 11act.) RANK 4 NODE 1 --> 33.9228058 sigma out 1act.( 36.3899384 sig in 11act.) RANK 5 NODE 8 --> 30.0378799 sigma out 1act.( 28.2820663 sig in 11act.) RANK 6 NODE 11 --> 26.2266598 sigma out 1act.( 27.0253716 sig in 11act.) RANK 7 NODE 9 --> 25.1356125 sigma out 1act.( 22.2608585 sig in 11act.) RANK 8 NODE 5 --> 25.0855083 sigma out 1act.( 19.9373379 sig in 11act.) RANK 9 NODE 15 --> 25.0563641 sigma out 1act.( 22.0049877 sig in 11act.) RANK 10 NODE 2 --> 21.5550137 sigma out 1act.( 18.9618187 sig in 11act.) RANK 11 NODE 12 --> 19.9708996 sigma out 1act.( 19.3684826 sig in 11act.) RANK 12 NODE 6 --> 12.1805477 sigma out 1act.( 10.8424444 sig in 11act.) RANK 13 NODE 13 --> 8.03341675 sigma out 1act.( 8.50290394 sig in 11act.) RANK 14 NODE 3 --> 7.19721842 sigma out 1act.( 7.08449078 sig in 11act.) RANK 15 NODE 14 --> 3.38780308 sigma out 1act.( 4.56018114 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 152.907074 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.514355481 *** contribution from regularisation: 0.00361336535 *** contribution from error: -0.517968833 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47033.6938 -0.0857824758 -17.6421242 EXIT FROM BFGS code NEW_X -47033.6938 -0.0857824758 -17.6421242 ENTER BFGS code NEW_X -47033.6938 -0.0857824758 -17.6421242 EXIT FROM BFGS code FG_LNSRCH 0. -0.105794594 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.514540911 *** contribution from regularisation: 0.00360795343 *** contribution from error: -0.518148839 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47050.6488 -0.105794594 85.3497238 EXIT FROM BFGS code NEW_X -47050.6488 -0.105794594 85.3497238 ENTER BFGS code NEW_X -47050.6488 -0.105794594 85.3497238 EXIT FROM BFGS code FG_LNSRCH 0. -0.102123551 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.514639795 *** contribution from regularisation: 0.00365588581 *** contribution from error: -0.518295705 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47059.6905 -0.102123551 -14.5874262 EXIT FROM BFGS code NEW_X -47059.6905 -0.102123551 -14.5874262 ENTER BFGS code NEW_X -47059.6905 -0.102123551 -14.5874262 EXIT FROM BFGS code FG_LNSRCH 0. -0.101598032 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.514667332 *** contribution from regularisation: 0.0036781719 *** contribution from error: -0.518345475 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47062.2116 -0.101598032 -1.12526822 EXIT FROM BFGS code NEW_X -47062.2116 -0.101598032 -1.12526822 ENTER BFGS code NEW_X -47062.2116 -0.101598032 -1.12526822 EXIT FROM BFGS code FG_LNSRCH 0. -0.101391748 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.514702141 *** contribution from regularisation: 0.00366219878 *** contribution from error: -0.51836437 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47065.3923 -0.101391748 9.63330841 EXIT FROM BFGS code NEW_X -47065.3923 -0.101391748 9.63330841 ENTER BFGS code NEW_X -47065.3923 -0.101391748 9.63330841 EXIT FROM BFGS code FG_LNSRCH 0. -0.0997275114 0. --------------------------------------------------- Iteration : 35 *********************************************** *** Learn Path 35 *** loss function: -0.514769614 *** contribution from regularisation: 0.00363145932 *** contribution from error: -0.518401086 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47071.5612 -0.0997275114 16.9199314 EXIT FROM BFGS code NEW_X -47071.5612 -0.0997275114 16.9199314 ENTER BFGS code NEW_X -47071.5612 -0.0997275114 16.9199314 EXIT FROM BFGS code FG_LNSRCH 0. -0.0971256644 0. --------------------------------------------------- Iteration : 36 *********************************************** *** Learn Path 36 *** loss function: -0.514854968 *** contribution from regularisation: 0.00358447619 *** contribution from error: -0.518439472 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47079.3685 -0.0971256644 34.6806297 EXIT FROM BFGS code NEW_X -47079.3685 -0.0971256644 34.6806297 ENTER BFGS code NEW_X -47079.3685 -0.0971256644 34.6806297 EXIT FROM BFGS code FG_LNSRCH 0. -0.0839830413 0. --------------------------------------------------- Iteration : 37 *********************************************** *** Learn Path 37 *** loss function: -0.514568985 *** contribution from regularisation: 0.00355059514 *** contribution from error: -0.518119574 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47053.2159 -0.0839830413 -149.712234 EXIT FROM BFGS code FG_LNSRCH 0. -0.0948180407 0. --------------------------------------------------- Iteration : 38 *********************************************** *** Learn Path 38 *** loss function: -0.514642596 *** contribution from regularisation: 0.00380877242 *** contribution from error: -0.518451393 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47059.95 -0.0948180407 2.74339342 EXIT FROM BFGS code FG_LNSRCH 0. -0.0970459357 0. --------------------------------------------------- Iteration : 39 *********************************************** *** Learn Path 39 *** loss function: -0.514746189 *** contribution from regularisation: 0.00369437109 *** contribution from error: -0.518440545 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47069.4201 -0.0970459357 33.6251335 EXIT FROM BFGS code FG_LNSRCH 0. -0.0971254483 0. --------------------------------------------------- Iteration : 40 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 86.7100906 sigma out 15 active outputs RANK 2 NODE 1 --> 44.6143379 sigma out 15 active outputs RANK 3 NODE 4 --> 42.9378929 sigma out 15 active outputs RANK 4 NODE 7 --> 35.7811813 sigma out 15 active outputs RANK 5 NODE 2 --> 34.6412773 sigma out 15 active outputs RANK 6 NODE 10 --> 30.2598038 sigma out 15 active outputs RANK 7 NODE 5 --> 29.1374435 sigma out 15 active outputs RANK 8 NODE 11 --> 28.8612862 sigma out 15 active outputs RANK 9 NODE 6 --> 26.414526 sigma out 15 active outputs RANK 10 NODE 3 --> 23.2856579 sigma out 15 active outputs RANK 11 NODE 8 --> 22.1307659 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 93.0631332 sigma in 11act. ( 121.640343 sig out 1act.) RANK 2 NODE 7 --> 41.687664 sigma in 11act. ( 42.2037354 sig out 1act.) RANK 3 NODE 1 --> 40.8971863 sigma in 11act. ( 38.428791 sig out 1act.) RANK 4 NODE 4 --> 36.5631409 sigma in 11act. ( 43.3773041 sig out 1act.) RANK 5 NODE 8 --> 31.9213619 sigma in 11act. ( 34.1088371 sig out 1act.) RANK 6 NODE 11 --> 29.7752895 sigma in 11act. ( 28.7207031 sig out 1act.) RANK 7 NODE 9 --> 24.6723804 sigma in 11act. ( 29.5119495 sig out 1act.) RANK 8 NODE 15 --> 23.9525852 sigma in 11act. ( 27.5570469 sig out 1act.) RANK 9 NODE 12 --> 21.9697723 sigma in 11act. ( 22.4779778 sig out 1act.) RANK 10 NODE 5 --> 21.6959229 sigma in 11act. ( 26.6913052 sig out 1act.) RANK 11 NODE 2 --> 20.7833405 sigma in 11act. ( 23.0220165 sig out 1act.) RANK 12 NODE 6 --> 11.1510162 sigma in 11act. ( 12.5129499 sig out 1act.) RANK 13 NODE 13 --> 8.5741415 sigma in 11act. ( 7.63544178 sig out 1act.) RANK 14 NODE 3 --> 7.93519306 sigma in 11act. ( 8.2345438 sig out 1act.) RANK 15 NODE 14 --> 4.26478004 sigma in 11act. ( 3.06919622 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 121.640343 sigma out 1act.( 93.0631332 sig in 11act.) RANK 2 NODE 4 --> 43.3773041 sigma out 1act.( 36.5631409 sig in 11act.) RANK 3 NODE 7 --> 42.2037354 sigma out 1act.( 41.687664 sig in 11act.) RANK 4 NODE 1 --> 38.428791 sigma out 1act.( 40.8971863 sig in 11act.) RANK 5 NODE 8 --> 34.1088371 sigma out 1act.( 31.9213619 sig in 11act.) RANK 6 NODE 9 --> 29.5119495 sigma out 1act.( 24.6723804 sig in 11act.) RANK 7 NODE 11 --> 28.7207031 sigma out 1act.( 29.7752895 sig in 11act.) RANK 8 NODE 15 --> 27.5570469 sigma out 1act.( 23.9525852 sig in 11act.) RANK 9 NODE 5 --> 26.6913052 sigma out 1act.( 21.6959229 sig in 11act.) RANK 10 NODE 2 --> 23.0220165 sigma out 1act.( 20.7833405 sig in 11act.) RANK 11 NODE 12 --> 22.4779778 sigma out 1act.( 21.9697723 sig in 11act.) RANK 12 NODE 6 --> 12.5129499 sigma out 1act.( 11.1510162 sig in 11act.) RANK 13 NODE 3 --> 8.2345438 sigma out 1act.( 7.93519306 sig in 11act.) RANK 14 NODE 13 --> 7.63544178 sigma out 1act.( 8.5741415 sig in 11act.) RANK 15 NODE 14 --> 3.06919622 sigma out 1act.( 4.26478004 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 159.982269 sigma in 15 active inputs *********************************************** *** Learn Path 40 *** loss function: -0.514760196 *** contribution from regularisation: 0.00367923919 *** contribution from error: -0.518439412 *********************************************** -----------------> Test sample Iteration No: 40 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -47070.7035 -0.0971254483 34.7327118 EXIT FROM BFGS code FG_LNSRCH 0. -0.0971256644 0. --------------------------------------------------- Iteration : 41 *********************************************** *** Learn Path 41 *** loss function: -0.514761567 *** contribution from regularisation: 0.0036778748 *** contribution from error: -0.518439412 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47070.8279 -0.0971256644 34.7486839 EXIT FROM BFGS code FG_LNSRCH 0. -0.0971256644 0. --------------------------------------------------- Iteration : 42 *********************************************** *** Learn Path 42 *** loss function: -0.514763832 *** contribution from regularisation: 0.00367563171 *** contribution from error: -0.518439472 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47071.033 -0.0971256644 34.7695618 EXIT FROM BFGS code FG_LNSRCH 0. -0.0971256644 0. --------------------------------------------------- Iteration : 43 *********************************************** *** Learn Path 43 *** loss function: -0.514756918 *** contribution from regularisation: 0.00368253165 *** contribution from error: -0.518439472 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -47070.4021 -0.0971256644 34.7684021 EXIT FROM BFGS code NEW_X -47070.4021 -0.0971256644 34.7684021 ENTER BFGS code NEW_X -47070.4021 -0.0971256644 34.7684021 EXIT FROM BFGS code CONVERGENC -47070.4021 -0.0971256644 34.7684021 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 9 --> 135.842941 sigma out 15 active outputs RANK 2 NODE 1 --> 69.7660904 sigma out 15 active outputs RANK 3 NODE 4 --> 66.7653656 sigma out 15 active outputs RANK 4 NODE 7 --> 55.5582237 sigma out 15 active outputs RANK 5 NODE 2 --> 54.5638618 sigma out 15 active outputs RANK 6 NODE 10 --> 47.175396 sigma out 15 active outputs RANK 7 NODE 5 --> 45.2200241 sigma out 15 active outputs RANK 8 NODE 11 --> 44.9831276 sigma out 15 active outputs RANK 9 NODE 6 --> 41.2645721 sigma out 15 active outputs RANK 10 NODE 3 --> 36.3220367 sigma out 15 active outputs RANK 11 NODE 8 --> 34.3338585 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 10 --> 146.123932 sigma in 11act. ( 190.463654 sig out 1act.) RANK 2 NODE 7 --> 64.6647644 sigma in 11act. ( 66.4155121 sig out 1act.) RANK 3 NODE 1 --> 64.0846024 sigma in 11act. ( 60.1842613 sig out 1act.) RANK 4 NODE 4 --> 56.9244041 sigma in 11act. ( 67.8089294 sig out 1act.) RANK 5 NODE 8 --> 49.6249428 sigma in 11act. ( 54.1277084 sig out 1act.) RANK 6 NODE 11 --> 46.4109764 sigma in 11act. ( 44.9830627 sig out 1act.) RANK 7 NODE 9 --> 38.4311829 sigma in 11act. ( 46.1569366 sig out 1act.) RANK 8 NODE 15 --> 37.252533 sigma in 11act. ( 43.339592 sig out 1act.) RANK 9 NODE 12 --> 33.9378242 sigma in 11act. ( 35.8283997 sig out 1act.) RANK 10 NODE 5 --> 33.6645813 sigma in 11act. ( 42.1250839 sig out 1act.) RANK 11 NODE 2 --> 32.3462524 sigma in 11act. ( 36.5892448 sig out 1act.) RANK 12 NODE 6 --> 17.1995907 sigma in 11act. ( 19.5792503 sig out 1act.) RANK 13 NODE 13 --> 12.7016888 sigma in 11act. ( 12.0079536 sig out 1act.) RANK 14 NODE 3 --> 12.2567511 sigma in 11act. ( 12.7764854 sig out 1act.) RANK 15 NODE 14 --> 5.98736572 sigma in 11act. ( 4.7396903 sig out 1act.) sorted by output significance RANK 1 NODE 10 --> 190.463654 sigma out 1act.( 146.123932 sig in 11act.) RANK 2 NODE 4 --> 67.8089294 sigma out 1act.( 56.9244041 sig in 11act.) RANK 3 NODE 7 --> 66.4155121 sigma out 1act.( 64.6647644 sig in 11act.) RANK 4 NODE 1 --> 60.1842613 sigma out 1act.( 64.0846024 sig in 11act.) RANK 5 NODE 8 --> 54.1277084 sigma out 1act.( 49.6249428 sig in 11act.) RANK 6 NODE 9 --> 46.1569366 sigma out 1act.( 38.4311829 sig in 11act.) RANK 7 NODE 11 --> 44.9830627 sigma out 1act.( 46.4109764 sig in 11act.) RANK 8 NODE 15 --> 43.339592 sigma out 1act.( 37.252533 sig in 11act.) RANK 9 NODE 5 --> 42.1250839 sigma out 1act.( 33.6645813 sig in 11act.) RANK 10 NODE 2 --> 36.5892448 sigma out 1act.( 32.3462524 sig in 11act.) RANK 11 NODE 12 --> 35.8283997 sigma out 1act.( 33.9378242 sig in 11act.) RANK 12 NODE 6 --> 19.5792503 sigma out 1act.( 17.1995907 sig in 11act.) RANK 13 NODE 3 --> 12.7764854 sigma out 1act.( 12.2567511 sig in 11act.) RANK 14 NODE 13 --> 12.0079536 sigma out 1act.( 12.7016888 sig in 11act.) RANK 15 NODE 14 --> 4.7396903 sigma out 1act.( 5.98736572 sig in 11act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 250.957962 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.514770329 *** contribution from regularisation: 0.00366913178 *** contribution from error: -0.518439472 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 30761 Closing output file done