NNInput NNInputs_170.root Options for steering Constraint : lep1_E<400&&lep2_E<400&& HiLoSbString : SB SbString : Target WeightString : TrainWeight EqualizeSB : 0 EvaluateVariables : 0 SetNBProcessingDefault : 1 UseNeuroBayes : 1 WeightEvents : 1 NBTreePrepEvPrint : 1 NBTreePrepReportInterval : 10000 NB_Iter : 250 NBZero999Tol : 0.001 **** List Parameters **** Method:H6AONN5MEMLP:MLP : !V:NCycles=250:HiddenLayers=N+1,N Value for FileString Not found Value for RandString Not found Value for DilTypeString Not found Determine File Parameters : Info: No file info in tree NNAna::CopyTree: entries= 204538 file= 0 options= lep1_E<400&&lep2_E<400&& SBRatio= 0 wt= 1 SorB = 2 NNAna::CopyTree: SigChoice: lep1_E<400&&lep2_E<400&&Target==1 BkgChoice: lep1_E<400&&lep2_E<400&&Target==0 Creating Signal tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==1 Creating Background tree for file: 0 weight: 1 SBRatio = 0 Using copy string: lep1_E<400&&lep2_E<400&&Target==0 NNAna::CopyTree: nsig = 56196 nbkg = 148342 Bkg Entries: 148342 Sig Entries: 56196 Chosen entries: 56196 Signal fraction: 1 Background fraction: 0.378827 Signal Tree Copy Condition: Background Tree Copy Condition: Actual Background Entries: 148342 Actual Signal Entries: 56196 Entries to split: 56196 Test with : 28098 Train with : 28098 ********************************************* * This product is licenced for educational * * and scientific use only. Commercial use * * is prohibited ! * ********************************************* Your number of nodes in the input layer is: 14 Your number of nodes in the hidden layer is: 15 Your number of nodes in the output layer is: 1 You want to do classification You want to use the global preprocessing flag 812 You want to use standard regularisation You use entropy as a loss function You want to use the BFGS algorithm You do not want to fix the shape You use 50 % of patterns for training Weight update after 200 events You want to speed up learning by a factor of 1. You want to limit the learning rate to 0.5 You want to run 250 iterations NeuroBayesTeacher::NB_DEF_DEBUG : setting debug level to 0 You are not allowed to change the debug flag. This is only permitted with a developers licence. NBTreeReportInterval = 10000 NBTreePrepEvPrint = 1 Start Set Inidividual Variable Preprocessing Not touching individual preprocessing for Ht ( 0 ) in Neurobayes Not touching individual preprocessing for LepAPt ( 1 ) in Neurobayes Not touching individual preprocessing for LepBPt ( 2 ) in Neurobayes Not touching individual preprocessing for MetSigLeptonsJets ( 3 ) in Neurobayes Not touching individual preprocessing for MetSpec ( 4 ) in Neurobayes Not touching individual preprocessing for SumEtLeptonsJets ( 5 ) in Neurobayes Not touching individual preprocessing for VSumJetLeptonsPt ( 6 ) in Neurobayes Not touching individual preprocessing for addEt ( 7 ) in Neurobayes Not touching individual preprocessing for dPhiLepSumMet ( 8 ) in Neurobayes Not touching individual preprocessing for dPhiLeptons ( 9 ) in Neurobayes Not touching individual preprocessing for dRLeptons ( 10 ) in Neurobayes Not touching individual preprocessing for lep1_E ( 11 ) in Neurobayes Not touching individual preprocessing for lep2_E ( 12 ) in Neurobayes End Set Inidividual Variable Preprocessing Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 56196 for Signal Prepared event 0 for Signal with 56196 events ====Entry 0 Variable Ht : 206.347 Variable LepAPt : 36.1308 Variable LepBPt : 29.2247 Variable MetSigLeptonsJets : 10.199 Variable MetSpec : 96.7965 Variable SumEtLeptonsJets : 102.892 Variable VSumJetLeptonsPt : 40.6877 Variable addEt : 168.81 Variable dPhiLepSumMet : 2.54625 Variable dPhiLeptons : 0.182576 Variable dRLeptons : 0.326 Variable lep1_E : 42.5211 Variable lep2_E : 30.6986 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 2170 Ht = 206.347 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 36.1308 LepAPt = 36.1308 LepBEt = 29.225 LepBPt = 29.2247 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 103.455 MetDelPhi = 1.21007 MetSig = 7.81518 MetSigLeptonsJets = 10.199 MetSpec = 96.7965 Mjj = 0 MostCentralJetEta = -1.03827 MtllMet = 173.786 Njets = 1 SB = 0 SumEt = 175.236 SumEtJets = 0 SumEtLeptonsJets = 102.892 Target = 1 TrainWeight = 1 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 40.6877 addEt = 168.81 dPhiLepSumMet = 2.54625 dPhiLeptons = 0.182576 dRLeptons = 0.326 diltype = 47 dimass = 10.613 event = 34 jet1_Et = 37.5368 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 42.5211 lep2_E = 30.6986 rand = 0.999742 run = 175066 weight = 3.57526e-06 ===Show End Prepared event 10000 for Signal with 56196 events Prepared event 20000 for Signal with 56196 events Prepared event 30000 for Signal with 56196 events Prepared event 40000 for Signal with 56196 events Prepared event 50000 for Signal with 56196 events Adding variable Ht To Neurobayes Adding variable LepAPt To Neurobayes Adding variable LepBPt To Neurobayes Adding variable MetSigLeptonsJets To Neurobayes Adding variable MetSpec To Neurobayes Adding variable SumEtLeptonsJets To Neurobayes Adding variable VSumJetLeptonsPt To Neurobayes Adding variable addEt To Neurobayes Adding variable dPhiLepSumMet To Neurobayes Adding variable dPhiLeptons To Neurobayes Adding variable dRLeptons To Neurobayes Adding variable lep1_E To Neurobayes Adding variable lep2_E To Neurobayes NNAna::PrepareNBTraining_: Nent= 148342 for Background Prepared event 0 for Background with 148342 events ====Entry 0 Variable Ht : 85.3408 Variable LepAPt : 31.1294 Variable LepBPt : 10.0664 Variable MetSigLeptonsJets : 6.87768 Variable MetSpec : 44.1437 Variable SumEtLeptonsJets : 41.1959 Variable VSumJetLeptonsPt : 41.0132 Variable addEt : 85.3408 Variable dPhiLepSumMet : 3.10536 Variable dPhiLeptons : 0.219342 Variable dRLeptons : 0.424454 Variable lep1_E : 32.3548 Variable lep2_E : 10.1027 ===Show Start ======> EVENT:0 DEtaJ1J2 = 0 DEtaJ1Lep1 = 0 DEtaJ1Lep2 = 0 DEtaJ2Lep1 = 0 DEtaJ2Lep2 = 0 DPhiJ1J2 = 0 DPhiJ1Lep1 = 0 DPhiJ1Lep2 = 0 DPhiJ2Lep1 = 0 DPhiJ2Lep2 = 0 DRJ1J2 = 0 DRJ1Lep1 = 0 DRJ1Lep2 = 0 DRJ2Lep1 = 0 DRJ2Lep2 = 0 DeltaRJet12 = 0 File = 1 Ht = 85.3408 IsMEBase = 0 LRHWW = 0 LRWW = 0 LRWg = 0 LRWj = 0 LRZZ = 0 LepAEt = 31.1297 LepAPt = 31.1294 LepBEt = 10.0674 LepBPt = 10.0664 LessCentralJetEta = 0 MJ1Lep1 = 0 MJ1Lep2 = 0 MJ2Lep1 = 0 MJ2Lep2 = 0 NN = 0 Met = 44.1437 MetDelPhi = 3.01191 MetSig = 3.74558 MetSigLeptonsJets = 6.87768 MetSpec = 44.1437 Mjj = 0 MostCentralJetEta = 0 MtllMet = 86.2332 Njets = 0 SB = 0 SumEt = 138.899 SumEtJets = 0 SumEtLeptonsJets = 41.1959 Target = 0 TrainWeight = 0.33833 VSum2JetLeptonsPt = 0 VSum2JetPt = 0 VSumJetLeptonsPt = 41.0132 addEt = 85.3408 dPhiLepSumMet = 3.10536 dPhiLeptons = 0.219342 dRLeptons = 0.424454 diltype = 17 dimass = 7.54723 event = 6717520 jet1_Et = 0 jet1_eta = 0 jet2_Et = 0 jet2_eta = 0 lep1_E = 32.3548 lep2_E = 10.1027 rand = 0.999742 run = 271566 weight = 0.00296168 ===Show End Prepared event 10000 for Background with 148342 events Prepared event 20000 for Background with 148342 events Prepared event 30000 for Background with 148342 events Prepared event 40000 for Background with 148342 events Prepared event 50000 for Background with 148342 events Prepared event 60000 for Background with 148342 events Prepared event 70000 for Background with 148342 events Prepared event 80000 for Background with 148342 events Prepared event 90000 for Background with 148342 events Prepared event 100000 for Background with 148342 events Prepared event 110000 for Background with 148342 events Prepared event 120000 for Background with 148342 events Prepared event 130000 for Background with 148342 events Prepared event 140000 for Background with 148342 events Warning: found 4782 negative weights. << hh tt >> << hh ii tt >> << hh tttttt >> << ppppp hhhhhh ii tt >> << pp pp hhh hh ii ----- tt >> << pp pp hh hh ii ----- tt >> << ppppp hh hh ii tt >> pp pp ////////////////////////////// pp \\\\\\\\\\\\\\\ Phi-T(R) NeuroBayes(R) Teacher Algorithms by Michael Feindt Implementation by Phi-T Project 2001-2003 Copyright Phi-T GmbH Version 20080312 Library compiled with: NB_MAXPATTERN= 1500000 NB_MAXNODE = 100 ----------------------------------- found 204538 samples to learn from preprocessing flags/parameters: global preprocessing flag: 812 individual preprocessing: now perform preprocessing *** called with option 12 *** This will do for you: *** input variable equalisation *** to Gaussian distribution with mean=0 and sigma=1 *** Then variables are decorrelated ************************************ Warning: found 4782 negative weights. Signal fraction: 62.9377708 % ------------------------------ Transdef: Tab for variable 1 -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. -1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. 1. ------------------------------ Transdef: Tab for variable 2 60.0019798 63.7129974 66.0681305 67.4084778 68.7010574 69.9360046 70.8095779 71.607399 72.5782089 73.3944397 74.1507568 74.8439865 75.4777985 76.149765 76.9266205 77.5144348 78.2015991 78.8042297 79.412323 80.0573425 80.775589 81.38974 82.1774139 82.7882538 83.7470627 84.7601776 85.9174652 87.0387421 88.402298 89.3933258 91.1138611 92.5439148 93.931778 95.4811554 97.2138367 99.0172119 100.435547 102.52047 104.119766 105.637398 107.492599 109.203339 111.06813 112.94693 114.904404 116.807365 118.768066 120.824738 122.71003 124.56044 126.335114 128.069946 129.640381 131.401871 133.081879 134.660614 136.307678 137.912354 139.572998 140.998993 142.578308 144.114029 145.588257 147.079498 148.513077 150.035278 151.452759 152.960419 154.401688 155.837494 157.430389 158.905701 160.593414 162.25528 164.001328 165.874817 167.672791 169.731491 171.839478 174.078308 176.570801 179.137878 181.766785 184.431946 187.601166 190.595001 193.798248 197.299545 201.097778 205.417755 209.78009 214.278244 220.098511 226.128342 233.374435 242.760452 253.523041 267.877686 288.757385 328.652344 1126.95667 ------------------------------ Transdef: Tab for variable 3 20.0000362 20.3525124 20.7331009 21.0556335 21.3263035 21.5755997 21.8437691 22.0704002 22.3441277 22.552742 22.7657356 22.9856091 23.2049751 23.3851776 23.6058826 23.8824463 24.1333008 24.3764935 24.6067848 24.8532963 25.0812359 25.2507019 25.5278397 25.7282524 25.9548321 26.1946678 26.4495354 26.6887646 26.9540672 27.1788368 27.427969 27.7041225 27.9416466 28.1619682 28.4280052 28.6727753 28.9203129 29.1389713 29.435318 29.6889915 29.9627151 30.2578049 30.5455608 30.8277206 31.1335087 31.4769917 31.7412415 31.9809132 32.272316 32.6231079 33.011673 33.3483887 33.7048111 34.0757828 34.4365005 34.807621 35.1673965 35.5087204 35.8459511 36.2111168 36.6037979 36.906105 37.2711105 37.6120071 37.9468346 38.3102951 38.693985 39.0949783 39.4971161 39.8568153 40.2753372 40.6457825 41.0602264 41.4706039 41.8933563 42.3280106 42.7792206 43.213665 43.6961136 44.1573257 44.6847076 45.1614952 45.7203598 46.2718735 46.8473778 47.4443321 48.092598 48.8228378 49.6162109 50.4330292 51.3472862 52.2602158 53.2412796 54.4148369 55.9774323 57.621273 59.8142624 62.6357956 66.8619537 75.5557098 228.385986 ------------------------------ Transdef: Tab for variable 4 10.0001202 10.1330338 10.2866383 10.3952589 10.5013695 10.6512318 10.7953424 10.9188156 11.0641518 11.2142582 11.3803883 11.5037651 11.6430492 11.8060064 11.9744549 12.1460552 12.2991505 12.4414635 12.6125526 12.7776318 12.9276276 13.1314621 13.3094063 13.4922104 13.6936731 13.8761253 14.0739975 14.2506571 14.4537477 14.6814728 14.8993111 15.1427412 15.3457146 15.5451298 15.8012714 16.0479088 16.355566 16.601223 16.8465881 17.107378 17.4023991 17.6890697 17.9550571 18.27211 18.5556908 18.8637791 19.1554375 19.4656258 19.7594852 20.0820999 20.2854805 20.5302467 20.8160057 21.1525612 21.4619274 21.7526093 22.08354 22.3849945 22.6882362 22.9900436 23.3133125 23.6501427 23.9765167 24.271347 24.5794792 24.950058 25.3138275 25.6383476 25.9727173 26.2944832 26.6206589 26.9709053 27.2970505 27.6411858 27.9720039 28.3129501 28.643898 28.9559097 29.3057995 29.6603355 30.0372429 30.3903465 30.7645016 31.1186409 31.5473633 31.9961319 32.4358368 32.9011192 33.3649864 33.9136276 34.4610214 35.0932579 35.7246704 36.4633713 37.2920456 38.3058472 39.6565552 41.5073318 44.1495438 49.4189224 119.066864 ------------------------------ Transdef: Tab for variable 5 0.926167309 2.73017335 3.20374727 3.53237486 3.82527065 4.05475521 4.18529415 4.3344698 4.46225786 4.58635521 4.68472099 4.78919601 4.87886286 4.97545052 5.05260038 5.13337135 5.20349598 5.27122402 5.32650471 5.37854099 5.435606 5.48949051 5.52544594 5.58045387 5.63279533 5.68281078 5.74649334 5.7960391 5.83674145 5.8857336 5.93108463 5.97761059 6.01889706 6.06711578 6.11018562 6.15747786 6.20844507 6.24873924 6.28189754 6.32982826 6.37769985 6.42832565 6.47702837 6.52027321 6.56109238 6.60802269 6.65411806 6.70253801 6.749856 6.79661846 6.84462261 6.89228344 6.94440126 6.99456596 7.04910803 7.10217714 7.16039944 7.20902586 7.25979805 7.32107544 7.38029099 7.4314785 7.49243259 7.54301786 7.60664129 7.65965748 7.71292353 7.77125025 7.83327389 7.8959322 7.95977831 8.01898956 8.07866096 8.13691139 8.19808388 8.26045513 8.32073879 8.38835335 8.44146061 8.50022888 8.56710243 8.63198853 8.70319366 8.77012634 8.84187031 8.91564274 8.99119186 9.07146835 9.15383911 9.24545097 9.35051727 9.45813751 9.58483315 9.70394516 9.8607235 10.054594 10.2791023 10.5704803 11.0311346 11.7913313 18.1545582 ------------------------------ Transdef: Tab for variable 6 15.004632 22.0886955 25.7989216 27.042942 28.0174789 28.9884377 29.8667526 30.7025642 31.3982544 32.0517883 32.6637115 33.2174911 33.657692 34.1337051 34.6254959 34.963623 35.3984566 35.8522491 36.2389336 36.5923615 37.0309906 37.4369164 37.8103981 38.1344986 38.4674416 38.8407478 39.2343597 39.656929 40.0638695 40.3972588 40.7446671 41.1408157 41.5743637 42.0703545 42.4995346 43.0507164 43.5153046 43.9575729 44.4689636 45.0258179 45.6561356 46.263649 46.8839798 47.5619507 48.2442856 48.998661 49.7123299 50.3749542 51.0568085 51.8744965 52.7413864 53.6376724 54.3996124 55.225853 56.0811348 56.8622856 57.6162643 58.4303551 59.3282852 60.1458511 61.0345955 61.773838 62.6291542 63.4464874 64.2664337 65.0338898 65.8035736 66.6001434 67.401207 68.2551575 69.0874634 69.8228149 70.6455688 71.43367 72.2131195 72.9964142 73.8170319 74.5836639 75.389328 76.1204224 76.9374084 77.7622223 78.64608 79.5015106 80.4446335 81.4228668 82.5363388 83.588974 84.8820877 86.1626587 87.4360352 89.1173706 91.2494965 93.6753998 96.2543945 99.4213715 103.212021 108.234619 115.545364 129.160568 320.548706 ------------------------------ Transdef: Tab for variable 7 30.1476021 32.6105118 33.7208977 34.4400444 35.0571289 35.5551605 36.0830688 36.5551605 36.9349442 37.3369675 37.666748 38.0191956 38.2922897 38.6282883 38.8952103 39.2233582 39.5671883 39.8590851 40.1962204 40.4662704 40.8697395 41.2458267 41.6697998 42.0801849 42.5439453 42.8949966 43.4319305 44.0789604 44.7810326 45.4275818 46.2376823 47.2427292 48.3099861 49.1713028 50.0601425 51.1970901 52.2441406 53.2950897 54.4737473 55.5071487 56.485878 57.5046997 58.5123596 59.480938 60.4872742 61.2965012 62.2844124 63.1667595 64.0240173 65.0053253 65.9260254 66.8387985 67.8053741 68.7149429 69.6424408 70.5337677 71.3483429 72.1520844 73.0152893 73.8781738 74.8034973 75.7154465 76.6176682 77.4565125 78.3838043 79.3219604 80.2795563 81.3810959 82.3831482 83.705307 85.0897675 86.5961685 88.0548096 89.617569 91.4322052 93.0938263 94.6862564 96.3986664 98.1001892 99.9369965 101.859695 103.80336 105.987915 108.181488 110.660606 113.36734 115.980438 119.05127 122.146515 125.439484 128.978043 133.169159 137.950775 143.688126 150.107254 157.781433 167.580734 179.954285 196.730865 226.87236 700.518188 ------------------------------ Transdef: Tab for variable 8 2.83339143 26.4163895 29.9132175 31.565506 32.5042191 33.170723 33.7761383 34.2385941 34.7135162 35.1062317 35.473381 35.8902893 36.1926651 36.5597076 36.8997993 37.1889801 37.473938 37.7625885 38.0318527 38.2583008 38.541256 38.8036575 39.1230011 39.3893394 39.631115 39.9353752 40.2446365 40.5878525 40.9936676 41.3293915 41.7422333 42.11129 42.5137329 42.906517 43.3956757 43.8390427 44.4097214 44.9515381 45.6839676 46.3180313 47.0717506 47.7835617 48.2735138 48.9700928 49.5984726 50.3257141 51.03965 51.7920914 52.5524139 53.3448029 54.1255035 54.9384079 55.723053 56.4489975 57.264183 57.9826393 58.6761169 59.3949814 60.144268 60.9303284 61.6787109 62.421524 63.1208038 63.8378601 64.5874252 65.2916641 65.9854431 66.7441559 67.4247589 68.1678772 68.9063416 69.5710297 70.2999878 70.9974213 71.7433014 72.4526978 73.2164917 73.9203033 74.7308655 75.47789 76.213974 76.9618454 77.7825165 78.5865097 79.4912491 80.3739548 81.3884735 82.451416 83.7646332 85.1425323 86.7362671 88.3167038 90.3436279 92.7782593 95.3778076 98.6227493 102.674286 108.4189 116.691551 130.994125 420.65448 ------------------------------ Transdef: Tab for variable 9 48.7445374 63.2972412 65.4554672 66.9764099 68.2095032 69.3033142 70.2686615 71.0074463 71.809967 72.7003326 73.3962097 74.0891266 74.6837845 75.2832184 75.8865662 76.5326614 77.0919037 77.6523285 78.2763062 78.7540131 79.3832092 79.8117447 80.47995 81.0414124 81.6844025 82.3073196 82.8989716 83.6877518 84.5402908 85.3290558 86.2735443 87.131073 88.1434479 89.1340866 90.1154785 91.3604889 92.661293 93.7806702 95.3584366 96.8295593 98.3040009 99.6289825 101.242027 102.801674 104.458389 105.798889 107.353333 108.849548 110.315735 111.821396 113.2649 114.766739 116.30336 117.746368 119.172836 120.614868 122.031387 123.511688 124.90799 126.240555 127.591751 128.908844 130.153076 131.544769 132.825439 134.068512 135.439178 136.690918 137.887054 139.097015 140.328171 141.559311 142.718796 143.87973 145.034088 146.199829 147.403076 148.455261 149.59549 150.690186 151.779358 152.963715 153.952606 155.089066 156.262726 157.432007 158.597824 159.906952 161.255325 162.576752 164.126175 165.791046 167.543991 169.474136 171.66925 174.301392 177.742737 182.622177 191.405289 210.911774 582.80835 ------------------------------ Transdef: Tab for variable 10 0.0356000625 1.18324149 1.47744143 1.67891133 1.83165896 1.95155382 2.04516792 2.12598276 2.19851208 2.25823975 2.3069911 2.35335445 2.39658809 2.43678427 2.46886873 2.50065899 2.53123808 2.55988693 2.58838511 2.61232662 2.63704777 2.66196179 2.68218231 2.70247698 2.72109222 2.73863745 2.75534296 2.77188444 2.78617334 2.80033112 2.81344557 2.82704115 2.84048676 2.85125232 2.86051607 2.87183189 2.88056564 2.89075899 2.89916921 2.90745306 2.91627789 2.9227531 2.9296093 2.93741465 2.94577718 2.95219064 2.95863342 2.96553159 2.97057271 2.97644615 2.98179173 2.98767233 2.99225807 2.99616551 3.00173616 3.00623989 3.01147437 3.01566362 3.01953506 3.02353144 3.02778172 3.0313015 3.03508949 3.03905272 3.04287338 3.04699278 3.05067873 3.05472326 3.05784535 3.0611639 3.0645628 3.06765032 3.07085729 3.07346845 3.07628536 3.07889032 3.08178616 3.08426666 3.08743286 3.09026289 3.09301996 3.09557295 3.09809685 3.1008625 3.10343218 3.10593843 3.10861206 3.11081505 3.11308193 3.11525869 3.11741519 3.11979294 3.12225389 3.12459135 3.12711906 3.12942266 3.13208628 3.13430905 3.13672543 3.13916302 3.14159226 ------------------------------ Transdef: Tab for variable 11 1.13248825E-05 0.00523220934 0.00926379301 0.0157860704 0.0217339993 0.0274968147 0.0326788239 0.0391895846 0.0454576015 0.0510438755 0.0574177504 0.0629648566 0.06882146 0.0749011189 0.0802783966 0.0860244036 0.0918307602 0.0968969464 0.102003455 0.107202351 0.11231637 0.116912484 0.122198045 0.127617598 0.133046985 0.137956232 0.143409595 0.148244202 0.153051317 0.15789184 0.163252473 0.168183818 0.173079491 0.178164124 0.183591008 0.188126445 0.193251565 0.19868207 0.20333755 0.20856069 0.21333161 0.218453228 0.223390222 0.228484154 0.23323822 0.23879692 0.243927002 0.249105692 0.254513919 0.260409236 0.265493929 0.270797849 0.276291609 0.28078258 0.285858989 0.291450679 0.296800733 0.302225113 0.307973772 0.31345892 0.319311619 0.325035095 0.331541002 0.336748838 0.342488915 0.348686695 0.355689287 0.360789895 0.367376328 0.37471801 0.381515503 0.388042867 0.393766463 0.400886655 0.407759398 0.414558887 0.421637893 0.428489685 0.436158597 0.444773674 0.453889549 0.462978601 0.472425461 0.481853724 0.492345095 0.503421545 0.514132202 0.524336696 0.53644371 0.550590992 0.563177347 0.577862263 0.594599605 0.611438036 0.634344876 0.65596801 0.685621679 0.713135839 0.759544611 0.821141064 1.1301049 ------------------------------ Transdef: Tab for variable 12 0.100025289 0.117808491 0.133923188 0.147011101 0.157713369 0.16693911 0.176349297 0.185538381 0.194068611 0.200525776 0.209086835 0.216555387 0.223907098 0.231040418 0.237970918 0.244319916 0.250177205 0.256461859 0.262809515 0.269068718 0.275052071 0.281232238 0.286998212 0.292619735 0.297656476 0.303013295 0.308447599 0.313417822 0.318889618 0.324339569 0.329709053 0.334649682 0.340131819 0.345938981 0.351264954 0.35582599 0.361310244 0.366859376 0.372285604 0.377304435 0.382621497 0.387688696 0.39288938 0.398222715 0.402500898 0.406772316 0.411122173 0.415451705 0.419794202 0.423745334 0.427503169 0.431570411 0.435951531 0.440029562 0.444632888 0.449020922 0.453672767 0.457726479 0.461652994 0.466634691 0.47144869 0.476191044 0.481324077 0.486392498 0.491445482 0.496978521 0.501856923 0.507875979 0.513074696 0.519114673 0.525621533 0.531913161 0.538453341 0.545810223 0.552649617 0.559207916 0.56554687 0.573629379 0.580575287 0.587666094 0.595293581 0.604038954 0.613009334 0.62200892 0.632805049 0.64194715 0.651829243 0.663203657 0.673964381 0.684528172 0.696725368 0.706838012 0.721135795 0.735676527 0.752395988 0.768552065 0.789970636 0.817253947 0.847474694 0.889201164 1.13414526 ------------------------------ Transdef: Tab for variable 13 20.0262547 21.5956211 22.4309883 23.2187729 23.7852535 24.3638153 24.9500217 25.3222847 25.7919159 26.267374 26.7989483 27.1694584 27.5288868 27.9753647 28.4236259 28.8234138 29.2003078 29.5799675 29.8966446 30.2313347 30.5668926 30.9158669 31.2562828 31.6558075 32.0213165 32.3841095 32.6860275 33.0802422 33.4763527 33.8499374 34.2777214 34.5169983 34.8770599 35.2330246 35.5994339 35.9774284 36.2509232 36.584343 37.0190315 37.4391251 37.8217926 38.1759872 38.5532379 38.8618622 39.2855606 39.651741 40.0147247 40.4448738 40.8659744 41.2715454 41.6494217 42.1143265 42.5976715 42.9277115 43.2698441 43.6747971 44.0572586 44.4958687 44.9541626 45.3749008 45.8695297 46.3410339 46.7717133 47.2047043 47.674942 48.151062 48.6565132 49.1539917 49.6400757 50.183754 50.6790962 51.2395935 51.8548927 52.4990005 53.1244469 53.7404251 54.3320274 54.9563293 55.5745773 56.3232117 57.0558243 57.8668671 58.6225624 59.5016251 60.3476639 61.4404221 62.4515457 63.620224 64.8451691 66.1976395 67.4818878 69.1422729 71.005249 72.9365005 75.4749146 78.2388535 82.1070328 86.6297455 93.2130051 104.723801 394.478912 ------------------------------ Transdef: Tab for variable 14 10.0086575 10.8319588 11.2896366 11.6264858 11.9540043 12.3047571 12.5477657 12.8838148 13.232501 13.5573225 13.8519936 14.0807858 14.3921413 14.6772003 15.0039978 15.3093815 15.6131382 15.938302 16.2328148 16.460043 16.7679482 17.0745277 17.3980656 17.729948 18.0041046 18.3014908 18.6380615 18.9824409 19.2595711 19.636013 19.945488 20.260231 20.6000824 20.9311714 21.2554321 21.592598 21.8945694 22.2099819 22.5386391 22.8743095 23.1860275 23.5276031 23.8195801 24.1475601 24.4805965 24.845623 25.1569138 25.5063915 25.7671719 26.090641 26.4340878 26.7437649 27.0986557 27.407156 27.7201576 28.0632095 28.390728 28.7042027 29.0677223 29.4122658 29.7303734 30.0688457 30.3489838 30.6982841 31.0483303 31.3764629 31.6723022 32.0280685 32.3887405 32.7587509 33.1273499 33.490284 33.8557816 34.2425156 34.6175003 35.0208664 35.4529152 35.8953743 36.3493423 36.7795944 37.2509651 37.7474365 38.2838669 38.8598213 39.4513779 39.9547348 40.6056747 41.3187714 42.0279846 42.9123573 43.7781906 44.6049118 45.7314262 47.0292435 48.5505638 50.2267685 52.2731743 54.950264 59.0092812 66.4852066 130.657516 COVARIANCE MATRIX (IN PERCENT) 0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 9.0 10.0 11.0 12.0 13.0 14.0 0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1.0 1 100.0 68.4 55.5 58.3 33.1 52.5 66.2 59.1 67.5 -25.1 -16.1 -28.9 26.7 37.6 2 68.4 100.0 70.2 66.1 37.1 70.3 94.9 77.1 92.6 -43.1 -24.0 -39.9 40.9 45.3 3 55.5 70.2 100.0 55.5 13.8 39.1 72.9 58.2 75.9 -15.9 -25.6 -45.1 69.1 37.7 4 58.3 66.1 55.5 100.0 19.6 41.8 67.0 57.4 72.0 -13.1 -29.3 -51.7 32.6 77.3 5 33.1 37.1 13.8 19.6 100.0 83.8 11.4 58.9 56.6 23.1 -7.8 -11.7 0.4 10.0 6 52.5 70.3 39.1 41.8 83.8 100.0 51.0 80.2 79.7 -8.1 -15.8 -25.3 17.5 26.4 7 66.2 94.9 72.9 67.0 11.4 51.0 100.0 69.5 82.4 -51.2 -22.9 -39.4 45.2 47.2 8 59.1 77.1 58.2 57.4 58.9 80.2 69.5 100.0 84.3 -11.2 -23.7 -36.9 33.3 39.7 9 67.5 92.6 75.9 72.0 56.6 79.7 82.4 84.3 100.0 -20.2 -27.0 -45.8 45.5 50.3 10 -25.1 -43.1 -15.9 -13.1 23.1 -8.1 -51.2 -11.2 -20.2 100.0 2.4 4.4 -7.8 -7.8 11 -16.1 -24.0 -25.6 -29.3 -7.8 -15.8 -22.9 -23.7 -27.0 2.4 100.0 59.4 -10.6 -19.0 12 -28.9 -39.9 -45.1 -51.7 -11.7 -25.3 -39.4 -36.9 -45.8 4.4 59.4 100.0 -20.9 -30.5 13 26.7 40.9 69.1 32.6 0.4 17.5 45.2 33.3 45.5 -7.8 -10.6 -20.9 100.0 54.4 14 37.6 45.3 37.7 77.3 10.0 26.4 47.2 39.7 50.3 -7.8 -19.0 -30.5 54.4 100.0 TOTAL CORRELATION TO TARGET (diagonal) 176.887518 TOTAL CORRELATION OF ALL VARIABLES 75.017156 ROUND 1: MAX CORR ( 75.0170527) AFTER KILLING INPUT VARIABLE 8 CONTR 0.124505111 ROUND 2: MAX CORR ( 75.0169377) AFTER KILLING INPUT VARIABLE 14 CONTR 0.131324187 ROUND 3: MAX CORR ( 75.0139072) AFTER KILLING INPUT VARIABLE 11 CONTR 0.674295497 ROUND 4: MAX CORR ( 75.0107016) AFTER KILLING INPUT VARIABLE 6 CONTR 0.693480222 ROUND 5: MAX CORR ( 75.0070136) AFTER KILLING INPUT VARIABLE 2 CONTR 0.743817467 ROUND 6: MAX CORR ( 74.8198086) AFTER KILLING INPUT VARIABLE 10 CONTR 5.29606696 ROUND 7: MAX CORR ( 74.5355023) AFTER KILLING INPUT VARIABLE 12 CONTR 6.51633846 ROUND 8: MAX CORR ( 74.0994145) AFTER KILLING INPUT VARIABLE 13 CONTR 8.05095493 ROUND 9: MAX CORR ( 72.8734011) AFTER KILLING INPUT VARIABLE 9 CONTR 13.4235107 ROUND 10: MAX CORR ( 72.5640863) AFTER KILLING INPUT VARIABLE 3 CONTR 6.70715768 ROUND 11: MAX CORR ( 71.0556496) AFTER KILLING INPUT VARIABLE 4 CONTR 14.7187391 ROUND 12: MAX CORR ( 66.2453824) AFTER KILLING INPUT VARIABLE 5 CONTR 25.6993121 LAST REMAINING VARIABLE: 7 total correlation to target: 75.017156 % total significance: 159.01739 sigma correlations of single variables to target: variable 2: 68.4243344 % , in sigma: 145.042276 variable 3: 55.4955582 % , in sigma: 117.636542 variable 4: 58.2552338 % , in sigma: 123.486356 variable 5: 33.0679683 % , in sigma: 70.0957258 variable 6: 52.5098503 % , in sigma: 111.307596 variable 7: 66.2453824 % , in sigma: 140.423449 variable 8: 59.0735481 % , in sigma: 125.220975 variable 9: 67.5036904 % , in sigma: 143.090744 variable 10: -25.0647801 % , in sigma: 53.1309918 variable 11: -16.1200412 % , in sigma: 34.1704085 variable 12: -28.8943356 % , in sigma: 61.2486806 variable 13: 26.7347078 % , in sigma: 56.670816 variable 14: 37.5565075 % , in sigma: 79.6102931 variables sorted by significance: 1 most relevant variable 7 corr 66.2453842 , in sigma: 140.423453 2 most relevant variable 5 corr 25.6993122 , in sigma: 54.4760393 3 most relevant variable 4 corr 14.7187395 , in sigma: 31.2000036 4 most relevant variable 3 corr 6.70715761 , in sigma: 14.2174771 5 most relevant variable 9 corr 13.4235106 , in sigma: 28.4544459 6 most relevant variable 13 corr 8.05095482 , in sigma: 17.0659871 7 most relevant variable 12 corr 6.51633835 , in sigma: 13.8129885 8 most relevant variable 10 corr 5.29606676 , in sigma: 11.2263215 9 most relevant variable 2 corr 0.743817449 , in sigma: 1.57670479 10 most relevant variable 6 corr 0.693480194 , in sigma: 1.47000254 11 most relevant variable 11 corr 0.674295485 , in sigma: 1.42933582 12 most relevant variable 14 corr 0.131324187 , in sigma: 0.278374048 13 most relevant variable 8 corr 0.12450511 , in sigma: 0.263919331 global correlations between input variables: variable 2: 99.1918227 % variable 3: 93.3442147 % variable 4: 93.1924123 % variable 5: 95.0026943 % variable 6: 94.893683 % variable 7: 98.8334487 % variable 8: 90.5088203 % variable 9: 98.7461932 % variable 10: 71.6560776 % variable 11: 60.054406 % variable 12: 72.0764455 % variable 13: 87.0751735 % variable 14: 90.1809289 % significance loss when removing single variables: variable 2: corr = 0.703264591 % , sigma = 1.49074299 variable 3: corr = 14.780038 % , sigma = 31.3299408 variable 4: corr = 12.9137148 % , sigma = 27.373808 variable 5: corr = 16.3329141 % , sigma = 34.6216452 variable 6: corr = 0.600498689 % , sigma = 1.27290528 variable 7: corr = 9.19000297 % , sigma = 19.480481 variable 8: corr = 0.124505111 % , sigma = 0.263919333 variable 9: corr = 10.152583 % , sigma = 21.5209072 variable 10: corr = 5.02324963 % , sigma = 10.6480182 variable 11: corr = 0.652979593 % , sigma = 1.38415152 variable 12: corr = 5.11298512 % , sigma = 10.8382347 variable 13: corr = 5.96359032 % , sigma = 12.6413026 variable 14: corr = 0.130397703 % , sigma = 0.276410138 Keep only 8 most significant input variables ------------------------------------- Teacher: actual network topology: Nodes(1) = 9 Nodes(2) = 15 Nodes(3) = 1 ------------------------------------- --------------------------------------------------- Iteration : 1 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 32.8388748 sigma out 15 active outputs RANK 2 NODE 6 --> 26.4012032 sigma out 15 active outputs RANK 3 NODE 5 --> 25.7403851 sigma out 15 active outputs RANK 4 NODE 2 --> 21.4910698 sigma out 15 active outputs RANK 5 NODE 4 --> 21.416914 sigma out 15 active outputs RANK 6 NODE 9 --> 20.8146973 sigma out 15 active outputs RANK 7 NODE 7 --> 18.7623367 sigma out 15 active outputs RANK 8 NODE 3 --> 18.5823879 sigma out 15 active outputs RANK 9 NODE 8 --> 18.3903179 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 41.2028465 sigma in 9act. ( 40.5633316 sig out 1act.) RANK 2 NODE 1 --> 27.0775814 sigma in 9act. ( 32.1263962 sig out 1act.) RANK 3 NODE 11 --> 20.0491314 sigma in 9act. ( 23.2670364 sig out 1act.) RANK 4 NODE 12 --> 19.0328426 sigma in 9act. ( 17.9026928 sig out 1act.) RANK 5 NODE 15 --> 17.0879078 sigma in 9act. ( 17.7966824 sig out 1act.) RANK 6 NODE 5 --> 16.8285484 sigma in 9act. ( 13.7785826 sig out 1act.) RANK 7 NODE 10 --> 15.0085335 sigma in 9act. ( 10.7171879 sig out 1act.) RANK 8 NODE 4 --> 14.9303589 sigma in 9act. ( 14.1979446 sig out 1act.) RANK 9 NODE 14 --> 13.986619 sigma in 9act. ( 14.9474287 sig out 1act.) RANK 10 NODE 13 --> 12.8329191 sigma in 9act. ( 9.71502209 sig out 1act.) RANK 11 NODE 8 --> 10.1563654 sigma in 9act. ( 11.6142073 sig out 1act.) RANK 12 NODE 9 --> 10.145216 sigma in 9act. ( 15.3663387 sig out 1act.) RANK 13 NODE 7 --> 5.94666195 sigma in 9act. ( 4.38253736 sig out 1act.) RANK 14 NODE 3 --> 2.25207949 sigma in 9act. ( 1.58947265 sig out 1act.) RANK 15 NODE 6 --> 1.42919385 sigma in 9act. ( 1.08392131 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 40.5633316 sigma out 1act.( 41.2028465 sig in 9act.) RANK 2 NODE 1 --> 32.1263962 sigma out 1act.( 27.0775814 sig in 9act.) RANK 3 NODE 11 --> 23.2670364 sigma out 1act.( 20.0491314 sig in 9act.) RANK 4 NODE 12 --> 17.9026928 sigma out 1act.( 19.0328426 sig in 9act.) RANK 5 NODE 15 --> 17.7966824 sigma out 1act.( 17.0879078 sig in 9act.) RANK 6 NODE 9 --> 15.3663387 sigma out 1act.( 10.145216 sig in 9act.) RANK 7 NODE 14 --> 14.9474287 sigma out 1act.( 13.986619 sig in 9act.) RANK 8 NODE 4 --> 14.1979446 sigma out 1act.( 14.9303589 sig in 9act.) RANK 9 NODE 5 --> 13.7785826 sigma out 1act.( 16.8285484 sig in 9act.) RANK 10 NODE 8 --> 11.6142073 sigma out 1act.( 10.1563654 sig in 9act.) RANK 11 NODE 10 --> 10.7171879 sigma out 1act.( 15.0085335 sig in 9act.) RANK 12 NODE 13 --> 9.71502209 sigma out 1act.( 12.8329191 sig in 9act.) RANK 13 NODE 7 --> 4.38253736 sigma out 1act.( 5.94666195 sig in 9act.) RANK 14 NODE 3 --> 1.58947265 sigma out 1act.( 2.25207949 sig in 9act.) RANK 15 NODE 6 --> 1.08392131 sigma out 1act.( 1.42919385 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 71.2326508 sigma in 15 active inputs SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 1 --> 31.5453453 sigma out 15 active outputs RANK 2 NODE 6 --> 26.166563 sigma out 15 active outputs RANK 3 NODE 5 --> 26.0495529 sigma out 15 active outputs RANK 4 NODE 2 --> 25.0586414 sigma out 15 active outputs RANK 5 NODE 4 --> 21.3854408 sigma out 15 active outputs RANK 6 NODE 7 --> 19.6599445 sigma out 15 active outputs RANK 7 NODE 3 --> 19.5003357 sigma out 15 active outputs RANK 8 NODE 9 --> 18.8566055 sigma out 15 active outputs RANK 9 NODE 8 --> 18.754631 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 39.8210983 sigma in 9act. ( 37.884697 sig out 1act.) RANK 2 NODE 1 --> 30.2279434 sigma in 9act. ( 29.4364719 sig out 1act.) RANK 3 NODE 11 --> 23.7266426 sigma in 9act. ( 22.3002186 sig out 1act.) RANK 4 NODE 15 --> 15.9212303 sigma in 9act. ( 16.3912888 sig out 1act.) RANK 5 NODE 12 --> 15.5988274 sigma in 9act. ( 16.0282955 sig out 1act.) RANK 6 NODE 9 --> 15.399065 sigma in 9act. ( 14.8795891 sig out 1act.) RANK 7 NODE 14 --> 15.3300972 sigma in 9act. ( 13.9058647 sig out 1act.) RANK 8 NODE 5 --> 14.8676291 sigma in 9act. ( 12.3603992 sig out 1act.) RANK 9 NODE 4 --> 14.0514364 sigma in 9act. ( 12.8852034 sig out 1act.) RANK 10 NODE 8 --> 11.7115612 sigma in 9act. ( 10.7668762 sig out 1act.) RANK 11 NODE 10 --> 10.9126368 sigma in 9act. ( 9.11079407 sig out 1act.) RANK 12 NODE 13 --> 10.5168447 sigma in 9act. ( 8.68029881 sig out 1act.) RANK 13 NODE 3 --> 7.17358351 sigma in 9act. ( 1.58807445 sig out 1act.) RANK 14 NODE 7 --> 5.73933268 sigma in 9act. ( 3.71002388 sig out 1act.) RANK 15 NODE 6 --> 4.07924843 sigma in 9act. ( 1.28035688 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 37.884697 sigma out 1act.( 39.8210983 sig in 9act.) RANK 2 NODE 1 --> 29.4364719 sigma out 1act.( 30.2279434 sig in 9act.) RANK 3 NODE 11 --> 22.3002186 sigma out 1act.( 23.7266426 sig in 9act.) RANK 4 NODE 15 --> 16.3912888 sigma out 1act.( 15.9212303 sig in 9act.) RANK 5 NODE 12 --> 16.0282955 sigma out 1act.( 15.5988274 sig in 9act.) RANK 6 NODE 9 --> 14.8795891 sigma out 1act.( 15.399065 sig in 9act.) RANK 7 NODE 14 --> 13.9058647 sigma out 1act.( 15.3300972 sig in 9act.) RANK 8 NODE 4 --> 12.8852034 sigma out 1act.( 14.0514364 sig in 9act.) RANK 9 NODE 5 --> 12.3603992 sigma out 1act.( 14.8676291 sig in 9act.) RANK 10 NODE 8 --> 10.7668762 sigma out 1act.( 11.7115612 sig in 9act.) RANK 11 NODE 10 --> 9.11079407 sigma out 1act.( 10.9126368 sig in 9act.) RANK 12 NODE 13 --> 8.68029881 sigma out 1act.( 10.5168447 sig in 9act.) RANK 13 NODE 7 --> 3.71002388 sigma out 1act.( 5.73933268 sig in 9act.) RANK 14 NODE 3 --> 1.58807445 sigma out 1act.( 7.17358351 sig in 9act.) RANK 15 NODE 6 --> 1.28035688 sigma out 1act.( 4.07924843 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 65.957756 sigma in 15 active inputs *********************************************** *** Learn Path 1 *** loss function: -0.433104187 *** contribution from regularisation: 0.00282806694 *** contribution from error: -0.435932249 *********************************************** -----------------> Test sample --------------------------------------------------- Iteration : 2 *********************************************** *** Learn Path 2 *** loss function: -0.470523834 *** contribution from regularisation: 0.00213797996 *** contribution from error: -0.472661823 *********************************************** -----------------> Test sample ENTER BFGS code START -48130.229 0.663130939 -1.24610269 EXIT FROM BFGS code FG_START 0. 0.663130939 0. --------------------------------------------------- Iteration : 3 *********************************************** *** Learn Path 3 *** loss function: -0.493128747 *** contribution from regularisation: 0.0019244029 *** contribution from error: -0.495053142 *********************************************** -----------------> Test sample ENTER BFGS code FG_START -50431.7826 0.663130939 150.51181 EXIT FROM BFGS code FG_LNSRCH 0. 0.684702516 0. --------------------------------------------------- Iteration : 4 *********************************************** *** Learn Path 4 *** loss function: -0.544013262 *** contribution from regularisation: 0.00244462444 *** contribution from error: -0.546457887 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -55635.6903 0.684702516 362.659088 EXIT FROM BFGS code NEW_X -55635.6903 0.684702516 362.659088 ENTER BFGS code NEW_X -55635.6903 0.684702516 362.659088 EXIT FROM BFGS code FG_LNSRCH 0. 0.790392458 0. --------------------------------------------------- Iteration : 5 *********************************************** *** Learn Path 5 *** loss function: -0.557133555 *** contribution from regularisation: 0.00292893848 *** contribution from error: -0.560062468 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -56977.4935 0.790392458 171.167679 EXIT FROM BFGS code NEW_X -56977.4935 0.790392458 171.167679 ENTER BFGS code NEW_X -56977.4935 0.790392458 171.167679 EXIT FROM BFGS code FG_LNSRCH 0. 0.84258616 0. --------------------------------------------------- Iteration : 6 *********************************************** *** Learn Path 6 *** loss function: -0.559048295 *** contribution from regularisation: 0.00256459718 *** contribution from error: -0.561612904 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57173.3109 0.84258616 -80.9333878 EXIT FROM BFGS code NEW_X -57173.3109 0.84258616 -80.9333878 ENTER BFGS code NEW_X -57173.3109 0.84258616 -80.9333878 EXIT FROM BFGS code FG_LNSRCH 0. 0.8343665 0. --------------------------------------------------- Iteration : 7 *********************************************** *** Learn Path 7 *** loss function: -0.559519291 *** contribution from regularisation: 0.00233655237 *** contribution from error: -0.561855853 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57221.4795 0.8343665 -4.91928577 EXIT FROM BFGS code NEW_X -57221.4795 0.8343665 -4.91928577 ENTER BFGS code NEW_X -57221.4795 0.8343665 -4.91928577 EXIT FROM BFGS code FG_LNSRCH 0. 0.835052907 0. --------------------------------------------------- Iteration : 8 *********************************************** *** Learn Path 8 *** loss function: -0.559680879 *** contribution from regularisation: 0.00230106199 *** contribution from error: -0.561981916 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57238.0064 0.835052907 10.7618265 EXIT FROM BFGS code NEW_X -57238.0064 0.835052907 10.7618265 ENTER BFGS code NEW_X -57238.0064 0.835052907 10.7618265 EXIT FROM BFGS code FG_LNSRCH 0. 0.834925175 0. --------------------------------------------------- Iteration : 9 *********************************************** *** Learn Path 9 *** loss function: -0.559818208 *** contribution from regularisation: 0.00228920463 *** contribution from error: -0.562107384 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57252.049 0.834925175 32.085041 EXIT FROM BFGS code NEW_X -57252.049 0.834925175 32.085041 ENTER BFGS code NEW_X -57252.049 0.834925175 32.085041 EXIT FROM BFGS code FG_LNSRCH 0. 0.852532268 0. --------------------------------------------------- Iteration : 10 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 47.5395584 sigma out 15 active outputs RANK 2 NODE 1 --> 33.0203705 sigma out 15 active outputs RANK 3 NODE 9 --> 25.0794621 sigma out 15 active outputs RANK 4 NODE 4 --> 24.634676 sigma out 15 active outputs RANK 5 NODE 3 --> 18.9765587 sigma out 15 active outputs RANK 6 NODE 7 --> 18.8279285 sigma out 15 active outputs RANK 7 NODE 8 --> 18.6604404 sigma out 15 active outputs RANK 8 NODE 6 --> 18.0783825 sigma out 15 active outputs RANK 9 NODE 5 --> 17.2375774 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 42.8787956 sigma in 9act. ( 34.7693596 sig out 1act.) RANK 2 NODE 1 --> 34.0493927 sigma in 9act. ( 26.7434959 sig out 1act.) RANK 3 NODE 9 --> 31.5324917 sigma in 9act. ( 32.2229004 sig out 1act.) RANK 4 NODE 11 --> 27.4471588 sigma in 9act. ( 27.5810623 sig out 1act.) RANK 5 NODE 15 --> 19.0820427 sigma in 9act. ( 15.6459398 sig out 1act.) RANK 6 NODE 14 --> 17.5390701 sigma in 9act. ( 14.7996597 sig out 1act.) RANK 7 NODE 4 --> 14.9464855 sigma in 9act. ( 14.6786575 sig out 1act.) RANK 8 NODE 8 --> 14.575387 sigma in 9act. ( 13.1007242 sig out 1act.) RANK 9 NODE 12 --> 11.0560808 sigma in 9act. ( 11.8307743 sig out 1act.) RANK 10 NODE 6 --> 10.0307951 sigma in 9act. ( 9.61842537 sig out 1act.) RANK 11 NODE 3 --> 8.45572186 sigma in 9act. ( 6.98003244 sig out 1act.) RANK 12 NODE 5 --> 6.60451365 sigma in 9act. ( 2.98648262 sig out 1act.) RANK 13 NODE 13 --> 6.29826355 sigma in 9act. ( 4.71668911 sig out 1act.) RANK 14 NODE 10 --> 5.11453533 sigma in 9act. ( 2.49026537 sig out 1act.) RANK 15 NODE 7 --> 3.99963546 sigma in 9act. ( 1.94975305 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 34.7693596 sigma out 1act.( 42.8787956 sig in 9act.) RANK 2 NODE 9 --> 32.2229004 sigma out 1act.( 31.5324917 sig in 9act.) RANK 3 NODE 11 --> 27.5810623 sigma out 1act.( 27.4471588 sig in 9act.) RANK 4 NODE 1 --> 26.7434959 sigma out 1act.( 34.0493927 sig in 9act.) RANK 5 NODE 15 --> 15.6459398 sigma out 1act.( 19.0820427 sig in 9act.) RANK 6 NODE 14 --> 14.7996597 sigma out 1act.( 17.5390701 sig in 9act.) RANK 7 NODE 4 --> 14.6786575 sigma out 1act.( 14.9464855 sig in 9act.) RANK 8 NODE 8 --> 13.1007242 sigma out 1act.( 14.575387 sig in 9act.) RANK 9 NODE 12 --> 11.8307743 sigma out 1act.( 11.0560808 sig in 9act.) RANK 10 NODE 6 --> 9.61842537 sigma out 1act.( 10.0307951 sig in 9act.) RANK 11 NODE 3 --> 6.98003244 sigma out 1act.( 8.45572186 sig in 9act.) RANK 12 NODE 13 --> 4.71668911 sigma out 1act.( 6.29826355 sig in 9act.) RANK 13 NODE 5 --> 2.98648262 sigma out 1act.( 6.60451365 sig in 9act.) RANK 14 NODE 10 --> 2.49026537 sigma out 1act.( 5.11453533 sig in 9act.) RANK 15 NODE 7 --> 1.94975305 sigma out 1act.( 3.99963546 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 69.9745789 sigma in 15 active inputs *********************************************** *** Learn Path 10 *** loss function: -0.560541213 *** contribution from regularisation: 0.00218411209 *** contribution from error: -0.562725306 *********************************************** -----------------> Test sample Iteration No: 10 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -57325.9899 0.852532268 13.8994999 EXIT FROM BFGS code NEW_X -57325.9899 0.852532268 13.8994999 ENTER BFGS code NEW_X -57325.9899 0.852532268 13.8994999 EXIT FROM BFGS code FG_LNSRCH 0. 0.84866333 0. --------------------------------------------------- Iteration : 11 *********************************************** *** Learn Path 11 *** loss function: -0.561076641 *** contribution from regularisation: 0.00219612848 *** contribution from error: -0.563272774 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57380.7448 0.84866333 163.486343 EXIT FROM BFGS code NEW_X -57380.7448 0.84866333 163.486343 ENTER BFGS code NEW_X -57380.7448 0.84866333 163.486343 EXIT FROM BFGS code FG_LNSRCH 0. 0.878772914 0. --------------------------------------------------- Iteration : 12 *********************************************** *** Learn Path 12 *** loss function: -0.561485112 *** contribution from regularisation: 0.00226019649 *** contribution from error: -0.56374532 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57422.5186 0.878772914 14.2719164 EXIT FROM BFGS code NEW_X -57422.5186 0.878772914 14.2719164 ENTER BFGS code NEW_X -57422.5186 0.878772914 14.2719164 EXIT FROM BFGS code FG_LNSRCH 0. 0.881914258 0. --------------------------------------------------- Iteration : 13 *********************************************** *** Learn Path 13 *** loss function: -0.561601102 *** contribution from regularisation: 0.00223943521 *** contribution from error: -0.563840508 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57434.3853 0.881914258 26.2846527 EXIT FROM BFGS code NEW_X -57434.3853 0.881914258 26.2846527 ENTER BFGS code NEW_X -57434.3853 0.881914258 26.2846527 EXIT FROM BFGS code FG_LNSRCH 0. 0.898468971 0. --------------------------------------------------- Iteration : 14 *********************************************** *** Learn Path 14 *** loss function: -0.561708093 *** contribution from regularisation: 0.00221671234 *** contribution from error: -0.563924789 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57445.3239 0.898468971 7.68198395 EXIT FROM BFGS code NEW_X -57445.3239 0.898468971 7.68198395 ENTER BFGS code NEW_X -57445.3239 0.898468971 7.68198395 EXIT FROM BFGS code FG_LNSRCH 0. 0.928245366 0. --------------------------------------------------- Iteration : 15 *********************************************** *** Learn Path 15 *** loss function: -0.561864376 *** contribution from regularisation: 0.00218831119 *** contribution from error: -0.564052701 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57461.3053 0.928245366 8.00547218 EXIT FROM BFGS code NEW_X -57461.3053 0.928245366 8.00547218 ENTER BFGS code NEW_X -57461.3053 0.928245366 8.00547218 EXIT FROM BFGS code FG_LNSRCH 0. 1.01959801 0. --------------------------------------------------- Iteration : 16 *********************************************** *** Learn Path 16 *** loss function: -0.562204778 *** contribution from regularisation: 0.0021414659 *** contribution from error: -0.564346254 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57496.1228 1.01959801 15.2403154 EXIT FROM BFGS code NEW_X -57496.1228 1.01959801 15.2403154 ENTER BFGS code NEW_X -57496.1228 1.01959801 15.2403154 EXIT FROM BFGS code FG_LNSRCH 0. 1.12314272 0. --------------------------------------------------- Iteration : 17 *********************************************** *** Learn Path 17 *** loss function: -0.562376082 *** contribution from regularisation: 0.00222368981 *** contribution from error: -0.564599752 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57513.6408 1.12314272 -113.414337 EXIT FROM BFGS code NEW_X -57513.6408 1.12314272 -113.414337 ENTER BFGS code NEW_X -57513.6408 1.12314272 -113.414337 EXIT FROM BFGS code FG_LNSRCH 0. 1.11596656 0. --------------------------------------------------- Iteration : 18 *********************************************** *** Learn Path 18 *** loss function: -0.5626477 *** contribution from regularisation: 0.00225557806 *** contribution from error: -0.564903259 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57541.4175 1.11596656 18.5822239 EXIT FROM BFGS code NEW_X -57541.4175 1.11596656 18.5822239 ENTER BFGS code NEW_X -57541.4175 1.11596656 18.5822239 EXIT FROM BFGS code FG_LNSRCH 0. 1.11739182 0. --------------------------------------------------- Iteration : 19 *********************************************** *** Learn Path 19 *** loss function: -0.562736511 *** contribution from regularisation: 0.00226355856 *** contribution from error: -0.565000057 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57550.5012 1.11739182 1.24841666 EXIT FROM BFGS code NEW_X -57550.5012 1.11739182 1.24841666 ENTER BFGS code NEW_X -57550.5012 1.11739182 1.24841666 EXIT FROM BFGS code FG_LNSRCH 0. 1.13050365 0. --------------------------------------------------- Iteration : 20 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 52.7623558 sigma out 15 active outputs RANK 2 NODE 1 --> 40.2743073 sigma out 15 active outputs RANK 3 NODE 4 --> 31.1579876 sigma out 15 active outputs RANK 4 NODE 7 --> 27.4239731 sigma out 15 active outputs RANK 5 NODE 9 --> 24.4840412 sigma out 15 active outputs RANK 6 NODE 3 --> 24.1917152 sigma out 15 active outputs RANK 7 NODE 8 --> 23.0145149 sigma out 15 active outputs RANK 8 NODE 6 --> 14.543891 sigma out 15 active outputs RANK 9 NODE 5 --> 12.7355108 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 57.0994644 sigma in 9act. ( 45.2372551 sig out 1act.) RANK 2 NODE 9 --> 40.9646263 sigma in 9act. ( 40.4139023 sig out 1act.) RANK 3 NODE 11 --> 39.0949287 sigma in 9act. ( 44.0149498 sig out 1act.) RANK 4 NODE 1 --> 23.6066666 sigma in 9act. ( 19.1851311 sig out 1act.) RANK 5 NODE 8 --> 17.9080772 sigma in 9act. ( 17.7061787 sig out 1act.) RANK 6 NODE 15 --> 16.1323738 sigma in 9act. ( 15.6207743 sig out 1act.) RANK 7 NODE 14 --> 12.6784763 sigma in 9act. ( 11.4916515 sig out 1act.) RANK 8 NODE 4 --> 12.3736019 sigma in 9act. ( 12.2780762 sig out 1act.) RANK 9 NODE 12 --> 10.6666651 sigma in 9act. ( 10.5987234 sig out 1act.) RANK 10 NODE 10 --> 9.07650185 sigma in 9act. ( 9.93669319 sig out 1act.) RANK 11 NODE 6 --> 6.27486324 sigma in 9act. ( 5.84522772 sig out 1act.) RANK 12 NODE 13 --> 5.17709446 sigma in 9act. ( 4.84769487 sig out 1act.) RANK 13 NODE 5 --> 4.09862423 sigma in 9act. ( 2.13281584 sig out 1act.) RANK 14 NODE 3 --> 3.60118628 sigma in 9act. ( 0.792566359 sig out 1act.) RANK 15 NODE 7 --> 2.41445637 sigma in 9act. ( 0.932231486 sig out 1act.) sorted by output significance RANK 1 NODE 2 --> 45.2372551 sigma out 1act.( 57.0994644 sig in 9act.) RANK 2 NODE 11 --> 44.0149498 sigma out 1act.( 39.0949287 sig in 9act.) RANK 3 NODE 9 --> 40.4139023 sigma out 1act.( 40.9646263 sig in 9act.) RANK 4 NODE 1 --> 19.1851311 sigma out 1act.( 23.6066666 sig in 9act.) RANK 5 NODE 8 --> 17.7061787 sigma out 1act.( 17.9080772 sig in 9act.) RANK 6 NODE 15 --> 15.6207743 sigma out 1act.( 16.1323738 sig in 9act.) RANK 7 NODE 4 --> 12.2780762 sigma out 1act.( 12.3736019 sig in 9act.) RANK 8 NODE 14 --> 11.4916515 sigma out 1act.( 12.6784763 sig in 9act.) RANK 9 NODE 12 --> 10.5987234 sigma out 1act.( 10.6666651 sig in 9act.) RANK 10 NODE 10 --> 9.93669319 sigma out 1act.( 9.07650185 sig in 9act.) RANK 11 NODE 6 --> 5.84522772 sigma out 1act.( 6.27486324 sig in 9act.) RANK 12 NODE 13 --> 4.84769487 sigma out 1act.( 5.17709446 sig in 9act.) RANK 13 NODE 5 --> 2.13281584 sigma out 1act.( 4.09862423 sig in 9act.) RANK 14 NODE 7 --> 0.932231486 sigma out 1act.( 2.41445637 sig in 9act.) RANK 15 NODE 3 --> 0.792566359 sigma out 1act.( 3.60118628 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 84.262619 sigma in 15 active inputs *********************************************** *** Learn Path 20 *** loss function: -0.562835693 *** contribution from regularisation: 0.00225161971 *** contribution from error: -0.565087318 *********************************************** -----------------> Test sample Iteration No: 20 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -57560.6417 1.13050365 -7.49282026 EXIT FROM BFGS code NEW_X -57560.6417 1.13050365 -7.49282026 ENTER BFGS code NEW_X -57560.6417 1.13050365 -7.49282026 EXIT FROM BFGS code FG_LNSRCH 0. 1.1768502 0. --------------------------------------------------- Iteration : 21 *********************************************** *** Learn Path 21 *** loss function: -0.563131273 *** contribution from regularisation: 0.00230285618 *** contribution from error: -0.565434158 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57590.871 1.1768502 -23.1460114 EXIT FROM BFGS code NEW_X -57590.871 1.1768502 -23.1460114 ENTER BFGS code NEW_X -57590.871 1.1768502 -23.1460114 EXIT FROM BFGS code FG_LNSRCH 0. 1.20442474 0. --------------------------------------------------- Iteration : 22 *********************************************** *** Learn Path 22 *** loss function: -0.563084483 *** contribution from regularisation: 0.00233853748 *** contribution from error: -0.565423012 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57586.0899 1.20442474 -25.1716824 EXIT FROM BFGS code FG_LNSRCH 0. 1.18975377 0. --------------------------------------------------- Iteration : 23 *********************************************** *** Learn Path 23 *** loss function: -0.563364208 *** contribution from regularisation: 0.00221528299 *** contribution from error: -0.565579474 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57614.6922 1.18975377 -25.314394 EXIT FROM BFGS code NEW_X -57614.6922 1.18975377 -25.314394 ENTER BFGS code NEW_X -57614.6922 1.18975377 -25.314394 EXIT FROM BFGS code FG_LNSRCH 0. 1.19350398 0. --------------------------------------------------- Iteration : 24 *********************************************** *** Learn Path 24 *** loss function: -0.563455701 *** contribution from regularisation: 0.00228078687 *** contribution from error: -0.565736473 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57624.0496 1.19350398 -27.9173336 EXIT FROM BFGS code NEW_X -57624.0496 1.19350398 -27.9173336 ENTER BFGS code NEW_X -57624.0496 1.19350398 -27.9173336 EXIT FROM BFGS code FG_LNSRCH 0. 1.17632067 0. --------------------------------------------------- Iteration : 25 *********************************************** *** Learn Path 25 *** loss function: -0.563541651 *** contribution from regularisation: 0.00222416222 *** contribution from error: -0.565765798 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57632.8404 1.17632067 -15.6924229 EXIT FROM BFGS code NEW_X -57632.8404 1.17632067 -15.6924229 ENTER BFGS code NEW_X -57632.8404 1.17632067 -15.6924229 EXIT FROM BFGS code FG_LNSRCH 0. 1.1577425 0. --------------------------------------------------- Iteration : 26 *********************************************** *** Learn Path 26 *** loss function: -0.563558042 *** contribution from regularisation: 0.00222635362 *** contribution from error: -0.565784395 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57634.5176 1.1577425 -3.38488364 EXIT FROM BFGS code NEW_X -57634.5176 1.1577425 -3.38488364 ENTER BFGS code NEW_X -57634.5176 1.1577425 -3.38488364 EXIT FROM BFGS code FG_LNSRCH 0. 1.11855686 0. --------------------------------------------------- Iteration : 27 *********************************************** *** Learn Path 27 *** loss function: -0.563629866 *** contribution from regularisation: 0.00217341236 *** contribution from error: -0.565803289 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57641.8651 1.11855686 -2.80497146 EXIT FROM BFGS code NEW_X -57641.8651 1.11855686 -2.80497146 ENTER BFGS code NEW_X -57641.8651 1.11855686 -2.80497146 EXIT FROM BFGS code FG_LNSRCH 0. 1.04290044 0. --------------------------------------------------- Iteration : 28 *********************************************** *** Learn Path 28 *** loss function: -0.563395739 *** contribution from regularisation: 0.00214108196 *** contribution from error: -0.565536797 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57617.92 1.04290044 128.616638 EXIT FROM BFGS code FG_LNSRCH 0. 1.10501993 0. --------------------------------------------------- Iteration : 29 *********************************************** *** Learn Path 29 *** loss function: -0.563412786 *** contribution from regularisation: 0.00239847857 *** contribution from error: -0.565811276 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57619.6601 1.10501993 23.3710327 EXIT FROM BFGS code FG_LNSRCH 0. 1.11813772 0. --------------------------------------------------- Iteration : 30 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 57.5878143 sigma out 15 active outputs RANK 2 NODE 1 --> 42.2136879 sigma out 15 active outputs RANK 3 NODE 4 --> 39.8030128 sigma out 15 active outputs RANK 4 NODE 7 --> 31.1953907 sigma out 15 active outputs RANK 5 NODE 8 --> 30.6474934 sigma out 15 active outputs RANK 6 NODE 3 --> 24.4052029 sigma out 15 active outputs RANK 7 NODE 9 --> 21.6687012 sigma out 15 active outputs RANK 8 NODE 5 --> 16.5028877 sigma out 15 active outputs RANK 9 NODE 6 --> 13.1384125 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 65.1318741 sigma in 9act. ( 53.8524361 sig out 1act.) RANK 2 NODE 11 --> 49.7786026 sigma in 9act. ( 54.8598747 sig out 1act.) RANK 3 NODE 9 --> 43.7660866 sigma in 9act. ( 44.5060692 sig out 1act.) RANK 4 NODE 8 --> 18.164381 sigma in 9act. ( 18.3006954 sig out 1act.) RANK 5 NODE 1 --> 17.0920105 sigma in 9act. ( 15.9066181 sig out 1act.) RANK 6 NODE 15 --> 15.0530577 sigma in 9act. ( 17.0115452 sig out 1act.) RANK 7 NODE 4 --> 12.6246624 sigma in 9act. ( 12.6805029 sig out 1act.) RANK 8 NODE 14 --> 12.5088253 sigma in 9act. ( 11.5500469 sig out 1act.) RANK 9 NODE 10 --> 11.3312378 sigma in 9act. ( 12.5564632 sig out 1act.) RANK 10 NODE 12 --> 9.2894659 sigma in 9act. ( 9.03354263 sig out 1act.) RANK 11 NODE 6 --> 6.9245224 sigma in 9act. ( 7.27756166 sig out 1act.) RANK 12 NODE 13 --> 5.2776742 sigma in 9act. ( 5.58425522 sig out 1act.) RANK 13 NODE 5 --> 2.58102369 sigma in 9act. ( 1.31714368 sig out 1act.) RANK 14 NODE 3 --> 2.36476374 sigma in 9act. ( 0.0677148998 sig out 1act.) RANK 15 NODE 7 --> 1.53133607 sigma in 9act. ( 0.486343414 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 54.8598747 sigma out 1act.( 49.7786026 sig in 9act.) RANK 2 NODE 2 --> 53.8524361 sigma out 1act.( 65.1318741 sig in 9act.) RANK 3 NODE 9 --> 44.5060692 sigma out 1act.( 43.7660866 sig in 9act.) RANK 4 NODE 8 --> 18.3006954 sigma out 1act.( 18.164381 sig in 9act.) RANK 5 NODE 15 --> 17.0115452 sigma out 1act.( 15.0530577 sig in 9act.) RANK 6 NODE 1 --> 15.9066181 sigma out 1act.( 17.0920105 sig in 9act.) RANK 7 NODE 4 --> 12.6805029 sigma out 1act.( 12.6246624 sig in 9act.) RANK 8 NODE 10 --> 12.5564632 sigma out 1act.( 11.3312378 sig in 9act.) RANK 9 NODE 14 --> 11.5500469 sigma out 1act.( 12.5088253 sig in 9act.) RANK 10 NODE 12 --> 9.03354263 sigma out 1act.( 9.2894659 sig in 9act.) RANK 11 NODE 6 --> 7.27756166 sigma out 1act.( 6.9245224 sig in 9act.) RANK 12 NODE 13 --> 5.58425522 sigma out 1act.( 5.2776742 sig in 9act.) RANK 13 NODE 5 --> 1.31714368 sigma out 1act.( 2.58102369 sig in 9act.) RANK 14 NODE 7 --> 0.486343414 sigma out 1act.( 1.53133607 sig in 9act.) RANK 15 NODE 3 --> 0.0677148998 sigma out 1act.( 2.36476374 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 96.8885956 sigma in 15 active inputs *********************************************** *** Learn Path 30 *** loss function: -0.56352067 *** contribution from regularisation: 0.00228329934 *** contribution from error: -0.565803945 *********************************************** -----------------> Test sample Iteration No: 30 ********************************************** ***** write out current network **** ***** to "rescue.nb" **** ********************************************** SAVING EXPERTISE TO rescue.nb ENTER BFGS code FG_LNSRCH -57630.6933 1.11813772 -1.57161605 EXIT FROM BFGS code FG_LNSRCH 0. 1.1185559 0. --------------------------------------------------- Iteration : 31 *********************************************** *** Learn Path 31 *** loss function: -0.563538969 *** contribution from regularisation: 0.00226433505 *** contribution from error: -0.565803289 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57632.5662 1.1185559 -2.35126066 EXIT FROM BFGS code FG_LNSRCH 0. 1.11855686 0. --------------------------------------------------- Iteration : 32 *********************************************** *** Learn Path 32 *** loss function: -0.563540757 *** contribution from regularisation: 0.00226257253 *** contribution from error: -0.565803349 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57632.7468 1.11855686 -2.28196669 EXIT FROM BFGS code FG_LNSRCH 0. 1.11855686 0. --------------------------------------------------- Iteration : 33 *********************************************** *** Learn Path 33 *** loss function: -0.563537896 *** contribution from regularisation: 0.0022654226 *** contribution from error: -0.565803289 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57632.4553 1.11855686 -2.31351542 EXIT FROM BFGS code FG_LNSRCH 0. 1.11855686 0. --------------------------------------------------- Iteration : 34 *********************************************** *** Learn Path 34 *** loss function: -0.563531995 *** contribution from regularisation: 0.00227130903 *** contribution from error: -0.565803289 *********************************************** -----------------> Test sample ENTER BFGS code FG_LNSRCH -57631.8533 1.11855686 -2.28289652 EXIT FROM BFGS code NEW_X -57631.8533 1.11855686 -2.28289652 ENTER BFGS code NEW_X -57631.8533 1.11855686 -2.28289652 EXIT FROM BFGS code CONVERGENC -57631.8533 1.11855686 -2.28289652 --------------------------------------------------- Iteration : 250 SIGNIFICANCE OF OUTPUTS IN LAYER 1 RANK 1 NODE 2 --> 85.7148285 sigma out 15 active outputs RANK 2 NODE 1 --> 64.1939316 sigma out 15 active outputs RANK 3 NODE 4 --> 59.8756371 sigma out 15 active outputs RANK 4 NODE 7 --> 46.620163 sigma out 15 active outputs RANK 5 NODE 8 --> 46.3554153 sigma out 15 active outputs RANK 6 NODE 3 --> 36.5058098 sigma out 15 active outputs RANK 7 NODE 9 --> 32.4626656 sigma out 15 active outputs RANK 8 NODE 5 --> 25.0051632 sigma out 15 active outputs RANK 9 NODE 6 --> 19.6619167 sigma out 15 active outputs SIGNIFICANCE OF INPUTS TO LAYER 2 sorted by input significance RANK 1 NODE 2 --> 98.6369324 sigma in 9act. ( 81.265976 sig out 1act.) RANK 2 NODE 11 --> 74.6057129 sigma in 9act. ( 82.7686539 sig out 1act.) RANK 3 NODE 9 --> 65.3490601 sigma in 9act. ( 67.9156723 sig out 1act.) RANK 4 NODE 8 --> 27.3026333 sigma in 9act. ( 27.1869583 sig out 1act.) RANK 5 NODE 1 --> 25.5535412 sigma in 9act. ( 24.1036682 sig out 1act.) RANK 6 NODE 15 --> 22.3949604 sigma in 9act. ( 25.847868 sig out 1act.) RANK 7 NODE 14 --> 18.3015137 sigma in 9act. ( 17.2807999 sig out 1act.) RANK 8 NODE 4 --> 18.2236958 sigma in 9act. ( 19.2164116 sig out 1act.) RANK 9 NODE 10 --> 16.9175034 sigma in 9act. ( 18.7771416 sig out 1act.) RANK 10 NODE 12 --> 13.2780333 sigma in 9act. ( 13.7788916 sig out 1act.) RANK 11 NODE 6 --> 10.0793743 sigma in 9act. ( 10.7936802 sig out 1act.) RANK 12 NODE 13 --> 7.73754215 sigma in 9act. ( 8.22665787 sig out 1act.) RANK 13 NODE 5 --> 2.94642138 sigma in 9act. ( 1.95875752 sig out 1act.) RANK 14 NODE 3 --> 2.35685325 sigma in 9act. ( 0.102669232 sig out 1act.) RANK 15 NODE 7 --> 1.62212598 sigma in 9act. ( 0.725559175 sig out 1act.) sorted by output significance RANK 1 NODE 11 --> 82.7686539 sigma out 1act.( 74.6057129 sig in 9act.) RANK 2 NODE 2 --> 81.265976 sigma out 1act.( 98.6369324 sig in 9act.) RANK 3 NODE 9 --> 67.9156723 sigma out 1act.( 65.3490601 sig in 9act.) RANK 4 NODE 8 --> 27.1869583 sigma out 1act.( 27.3026333 sig in 9act.) RANK 5 NODE 15 --> 25.847868 sigma out 1act.( 22.3949604 sig in 9act.) RANK 6 NODE 1 --> 24.1036682 sigma out 1act.( 25.5535412 sig in 9act.) RANK 7 NODE 4 --> 19.2164116 sigma out 1act.( 18.2236958 sig in 9act.) RANK 8 NODE 10 --> 18.7771416 sigma out 1act.( 16.9175034 sig in 9act.) RANK 9 NODE 14 --> 17.2807999 sigma out 1act.( 18.3015137 sig in 9act.) RANK 10 NODE 12 --> 13.7788916 sigma out 1act.( 13.2780333 sig in 9act.) RANK 11 NODE 6 --> 10.7936802 sigma out 1act.( 10.0793743 sig in 9act.) RANK 12 NODE 13 --> 8.22665787 sigma out 1act.( 7.73754215 sig in 9act.) RANK 13 NODE 5 --> 1.95875752 sigma out 1act.( 2.94642138 sig in 9act.) RANK 14 NODE 7 --> 0.725559175 sigma out 1act.( 1.62212598 sig in 9act.) RANK 15 NODE 3 --> 0.102669232 sigma out 1act.( 2.35685325 sig in 9act.) SIGNIFICANCE OF INPUTS TO LAYER 3 RANK 1 NODE 1 --> 146.473434 sigma in 15 active inputs *********************************************** *** Learn Path 250 *** loss function: -0.563534021 *** contribution from regularisation: 0.00226928294 *** contribution from error: -0.565803289 *********************************************** -----------------> Test sample END OF LEARNING , export EXPERTISE SAVING EXPERTISE TO expert.nb NB_AHISTOUT: storage space 27724 Closing output file done