I'm trying to let the code of the tutorial on LSTM in deeplearning.net run
(description: http://deeplearning.net/tutorial/lstm.html ; code:
https://github.com/lisa-lab/DeepLearningTutorials).
WITHOUT ANY MODIFICATION of the initial code, I get the following results:
- early stop after 62 epochs; the code run for 63 epochs, with 18.368222
sec/epochs
- best error: Train 0.421921921922 Valid 1.0 Test 1.0 (error is
1-accuracy, so the model obtains a 0% accuracy on validation and test set!)
I'm wondering if the code has any bugs, this results seem to be very
strange to me...
I'm very new to Theano so I can not understand where the problem is... I
would really appreciate any advice!
Monod
--------------------------------
Here some other results.
After 2 epochs:
('Train ', 0.97797797797797803, 'Valid ', 0.43809523809523809, 'Test ',
0.52200000000000002)
and after 5 epochs:
('Train ', 0.97597597597597596, 'Valid ', 1.0, 'Test ', 1.0)
After that, the performance remains more or less the same, and the cost
starts decreasing. I attach the results as printed on my Terminal.
--
---
You received this message because you are subscribed to the Google Groups
"theano-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
THEANO_FLAGS="floatX=float32" python lstm.py
model options {'max_epochs': 100, 'valid_batch_size': 64, 'lrate': 0.0001,
'use_dropout': True, 'dataset': 'imdb', 'batch_size': 16, 'noise_std': 0.0,
'encoder': 'lstm', 'reload_model': None, 'validFreq': 370, 'decay_c': 0.0,
'patience': 10, 'optimizer': <function adadelta at 0x1075b39d8>, 'n_words':
10000, 'saveFreq': 1110, 'test_size': 500, 'maxlen': 100, 'dispFreq': 10,
'dim_proj': 128, 'saveto': 'lstm_model.npz'}
Loading data
Building model
WARNING (theano.gof.compilelock): Overriding existing lock by dead process
'1113' (I am process '2394')
Optimization
1998 train examples
105 valid examples
500 test examples
Epoch 0 Update 10 Cost 0.7010279297828674
Epoch 0 Update 20 Cost 0.6881957054138184
Epoch 0 Update 30 Cost 0.6934430003166199
Epoch 0 Update 40 Cost 0.6935343146324158
Epoch 0 Update 50 Cost 0.6883326768875122
Epoch 0 Update 60 Cost 0.6713672876358032
Epoch 0 Update 70 Cost 0.6863096952438354
Epoch 0 Update 80 Cost 0.6868786215782166
Epoch 0 Update 90 Cost 0.6857496500015259
Epoch 0 Update 100 Cost 0.6999828219413757
Epoch 0 Update 110 Cost 0.7240233421325684
Epoch 0 Update 120 Cost 0.6395793557167053
Seen 1998 samples
Epoch 1 Update 130 Cost 0.6923786997795105
Epoch 1 Update 140 Cost 0.694979727268219
Epoch 1 Update 150 Cost 0.6667500138282776
Epoch 1 Update 160 Cost 0.6850765943527222
Epoch 1 Update 170 Cost 0.6546704769134521
Epoch 1 Update 180 Cost 0.6407663822174072
Epoch 1 Update 190 Cost 0.7130597233772278
Epoch 1 Update 200 Cost 0.7015913128852844
Epoch 1 Update 210 Cost 0.669854998588562
Epoch 1 Update 220 Cost 0.7386875748634338
Epoch 1 Update 230 Cost 0.6851205825805664
Epoch 1 Update 240 Cost 0.6655113697052002
Epoch 1 Update 250 Cost 0.6621078848838806
Seen 1998 samples
Epoch 2 Update 260 Cost 0.6484100818634033
Epoch 2 Update 270 Cost 0.6475663781166077
Epoch 2 Update 280 Cost 0.7391528487205505
Epoch 2 Update 290 Cost 0.6534780859947205
Epoch 2 Update 300 Cost 0.7040232419967651
Epoch 2 Update 310 Cost 0.6301140785217285
Epoch 2 Update 320 Cost 0.6916490197181702
Epoch 2 Update 330 Cost 0.6648445725440979
Epoch 2 Update 340 Cost 0.7902641296386719
Epoch 2 Update 350 Cost 0.6857262253761292
Epoch 2 Update 360 Cost 0.6680927872657776
Epoch 2 Update 370 Cost 0.6317341327667236
('Train ', 0.97797797797797803, 'Valid ', 0.43809523809523809, 'Test ',
0.52200000000000002)
Seen 1920 samples
Epoch 3 Update 380 Cost 0.6829317808151245
Epoch 3 Update 390 Cost 0.6684635281562805
Epoch 3 Update 400 Cost 0.6517256498336792
Epoch 3 Update 410 Cost 0.6433815956115723
Epoch 3 Update 420 Cost 0.6852694153785706
Epoch 3 Update 430 Cost 0.7032312750816345
Epoch 3 Update 440 Cost 0.6668676137924194
Epoch 3 Update 450 Cost 0.6268746256828308
Epoch 3 Update 460 Cost 0.6878096461296082
Epoch 3 Update 470 Cost 0.7377728819847107
Epoch 3 Update 480 Cost 0.6860870718955994
Epoch 3 Update 490 Cost 0.6506385803222656
Seen 1998 samples
Epoch 4 Update 500 Cost 0.7681543827056885
Epoch 4 Update 510 Cost 0.7506165504455566
Epoch 4 Update 520 Cost 0.6553727388381958
Epoch 4 Update 530 Cost 0.6836643218994141
Epoch 4 Update 540 Cost 0.6486623287200928
Epoch 4 Update 550 Cost 0.7192995548248291
Epoch 4 Update 560 Cost 0.6658636927604675
Epoch 4 Update 570 Cost 0.6475800275802612
Epoch 4 Update 580 Cost 0.7308979034423828
Epoch 4 Update 590 Cost 0.6270129084587097
Epoch 4 Update 600 Cost 0.6851385831832886
Epoch 4 Update 610 Cost 0.6500130295753479
Epoch 4 Update 620 Cost 0.6356260180473328
Seen 1998 samples
Epoch 5 Update 630 Cost 0.6833065152168274
Epoch 5 Update 640 Cost 0.738418698310852
Epoch 5 Update 650 Cost 0.7063696980476379
Epoch 5 Update 660 Cost 0.7578263878822327
Epoch 5 Update 670 Cost 0.6976179480552673
Epoch 5 Update 680 Cost 0.6493179798126221
Epoch 5 Update 690 Cost 0.6451326012611389
Epoch 5 Update 700 Cost 0.6672787666320801
Epoch 5 Update 710 Cost 0.6415010094642639
Epoch 5 Update 720 Cost 0.7478094696998596
Epoch 5 Update 730 Cost 0.644302487373352
Epoch 5 Update 740 Cost 0.6604061126708984
('Train ', 0.97597597597597596, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 6 Update 750 Cost 0.6829906702041626
Epoch 6 Update 760 Cost 0.630902886390686
Epoch 6 Update 770 Cost 0.6086430549621582
Epoch 6 Update 780 Cost 0.7192733287811279
Epoch 6 Update 790 Cost 0.6801216006278992
Epoch 6 Update 800 Cost 0.7301952242851257
Epoch 6 Update 810 Cost 0.727361798286438
Epoch 6 Update 820 Cost 0.6601577997207642
Epoch 6 Update 830 Cost 0.6267684698104858
Epoch 6 Update 840 Cost 0.6897655129432678
Epoch 6 Update 850 Cost 0.7264392375946045
Epoch 6 Update 860 Cost 0.6336546540260315
Seen 1998 samples
Epoch 7 Update 870 Cost 0.6474447846412659
Epoch 7 Update 880 Cost 0.6886566877365112
Epoch 7 Update 890 Cost 0.6289746761322021
Epoch 7 Update 900 Cost 0.6056869626045227
Epoch 7 Update 910 Cost 0.6605126261711121
Epoch 7 Update 920 Cost 0.7069494724273682
Epoch 7 Update 930 Cost 0.6998235583305359
Epoch 7 Update 940 Cost 0.7018632292747498
Epoch 7 Update 950 Cost 0.6696216464042664
Epoch 7 Update 960 Cost 0.6606739163398743
Epoch 7 Update 970 Cost 0.6913288831710815
Epoch 7 Update 980 Cost 0.6734050512313843
Epoch 7 Update 990 Cost 0.6820831298828125
Seen 1998 samples
Epoch 8 Update 1000 Cost 0.5708930492401123
Epoch 8 Update 1010 Cost 0.6566168665885925
Epoch 8 Update 1020 Cost 0.5866003632545471
Epoch 8 Update 1030 Cost 0.6617861390113831
Epoch 8 Update 1040 Cost 0.6726550459861755
Epoch 8 Update 1050 Cost 0.6225253343582153
Epoch 8 Update 1060 Cost 0.6547443270683289
Epoch 8 Update 1070 Cost 0.6499451398849487
Epoch 8 Update 1080 Cost 0.7620509266853333
Epoch 8 Update 1090 Cost 0.6163596510887146
Epoch 8 Update 1100 Cost 0.6631573438644409
Epoch 8 Update 1110 Cost 0.5112399458885193
Saving...
Done
('Train ', 0.97397397397397401, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 9 Update 1120 Cost 0.6179184913635254
Epoch 9 Update 1130 Cost 0.5567277669906616
Epoch 9 Update 1140 Cost 0.5807622671127319
Epoch 9 Update 1150 Cost 0.5074678659439087
Epoch 9 Update 1160 Cost 0.576436460018158
Epoch 9 Update 1170 Cost 0.42893001437187195
Epoch 9 Update 1180 Cost 0.3240252733230591
Epoch 9 Update 1190 Cost 0.45435357093811035
Epoch 9 Update 1200 Cost 0.46337762475013733
Epoch 9 Update 1210 Cost 0.41663283109664917
Epoch 9 Update 1220 Cost 0.5545867681503296
Epoch 9 Update 1230 Cost 0.6215294599533081
Seen 1998 samples
Epoch 10 Update 1240 Cost 0.5368068814277649
Epoch 10 Update 1250 Cost 0.6151906847953796
Epoch 10 Update 1260 Cost 0.7688871622085571
Epoch 10 Update 1270 Cost 0.657035231590271
Epoch 10 Update 1280 Cost 0.635221540927887
Epoch 10 Update 1290 Cost 0.5567347407341003
Epoch 10 Update 1300 Cost 0.5667229890823364
Epoch 10 Update 1310 Cost 0.6223788261413574
Epoch 10 Update 1320 Cost 0.3343941569328308
Epoch 10 Update 1330 Cost 0.48062101006507874
Epoch 10 Update 1340 Cost 0.4897792637348175
Epoch 10 Update 1350 Cost 0.4009484052658081
Epoch 10 Update 1360 Cost 0.5612658858299255
Seen 1998 samples
Epoch 11 Update 1370 Cost 0.5421799421310425
Epoch 11 Update 1380 Cost 0.3063349723815918
Epoch 11 Update 1390 Cost 0.25855112075805664
Epoch 11 Update 1400 Cost 0.15079353749752045
Epoch 11 Update 1410 Cost 0.3417370617389679
Epoch 11 Update 1420 Cost 0.6096119284629822
Epoch 11 Update 1430 Cost 0.37926673889160156
Epoch 11 Update 1440 Cost 0.27132993936538696
Epoch 11 Update 1450 Cost 0.505858302116394
Epoch 11 Update 1460 Cost 0.24084272980690002
Epoch 11 Update 1470 Cost 0.24780720472335815
Epoch 11 Update 1480 Cost 0.39223265647888184
('Train ', 0.968968968968969, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 12 Update 1490 Cost 0.11173157393932343
Epoch 12 Update 1500 Cost 0.3356725573539734
Epoch 12 Update 1510 Cost 0.1602410525083542
Epoch 12 Update 1520 Cost 0.3913167715072632
Epoch 12 Update 1530 Cost 0.15493200719356537
Epoch 12 Update 1540 Cost 0.1869320273399353
Epoch 12 Update 1550 Cost 0.19015361368656158
Epoch 12 Update 1560 Cost 0.2526356875896454
Epoch 12 Update 1570 Cost 0.4026847779750824
Epoch 12 Update 1580 Cost 0.26320046186447144
Epoch 12 Update 1590 Cost 0.31008899211883545
Epoch 12 Update 1600 Cost 0.20439298450946808
Seen 1998 samples
Epoch 13 Update 1610 Cost 0.17869049310684204
Epoch 13 Update 1620 Cost 0.24527952075004578
Epoch 13 Update 1630 Cost 0.3438732922077179
Epoch 13 Update 1640 Cost 0.24144236743450165
Epoch 13 Update 1650 Cost 0.11138693988323212
Epoch 13 Update 1660 Cost 0.493531733751297
Epoch 13 Update 1670 Cost 0.23780204355716705
Epoch 13 Update 1680 Cost 0.3063879609107971
Epoch 13 Update 1690 Cost 0.060397762805223465
Epoch 13 Update 1700 Cost 0.3295470178127289
Epoch 13 Update 1710 Cost 0.22397111356258392
Epoch 13 Update 1720 Cost 0.11543859541416168
Epoch 13 Update 1730 Cost 0.17622900009155273
Seen 1998 samples
Epoch 14 Update 1740 Cost 0.04820360988378525
Epoch 14 Update 1750 Cost 0.09317844361066818
Epoch 14 Update 1760 Cost 0.3521710932254791
Epoch 14 Update 1770 Cost 0.10078470408916473
Epoch 14 Update 1780 Cost 0.30369675159454346
Epoch 14 Update 1790 Cost 0.06399866938591003
Epoch 14 Update 1800 Cost 0.14146652817726135
Epoch 14 Update 1810 Cost 0.3063661754131317
Epoch 14 Update 1820 Cost 0.4495067596435547
Epoch 14 Update 1830 Cost 0.023750143125653267
Epoch 14 Update 1840 Cost 0.126418337225914
Epoch 14 Update 1850 Cost 0.1384606808423996
('Train ', 0.96296296296296302, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 15 Update 1860 Cost 0.158131405711174
Epoch 15 Update 1870 Cost 0.06897880136966705
Epoch 15 Update 1880 Cost 0.07300148904323578
Epoch 15 Update 1890 Cost 0.014402552507817745
Epoch 15 Update 1900 Cost 0.02970767579972744
Epoch 15 Update 1910 Cost 0.17831040918827057
Epoch 15 Update 1920 Cost 0.09460248053073883
Epoch 15 Update 1930 Cost 0.19490502774715424
Epoch 15 Update 1940 Cost 0.20669417083263397
Epoch 15 Update 1950 Cost 0.06417500227689743
Epoch 15 Update 1960 Cost 0.12911675870418549
Epoch 15 Update 1970 Cost 0.06683557480573654
Seen 1998 samples
Epoch 16 Update 1980 Cost 0.1692483127117157
Epoch 16 Update 1990 Cost 0.4810485541820526
Epoch 16 Update 2000 Cost 0.010361677967011929
Epoch 16 Update 2010 Cost 0.0355396494269371
Epoch 16 Update 2020 Cost 0.021396612748503685
Epoch 16 Update 2030 Cost 0.059298325330019
Epoch 16 Update 2040 Cost 0.07425009459257126
Epoch 16 Update 2050 Cost 0.08818969875574112
Epoch 16 Update 2060 Cost 0.2189452201128006
Epoch 16 Update 2070 Cost 0.021886060014367104
Epoch 16 Update 2080 Cost 0.021777654066681862
Epoch 16 Update 2090 Cost 0.06325393170118332
Epoch 16 Update 2100 Cost 0.2023351490497589
Seen 1998 samples
Epoch 17 Update 2110 Cost 0.3887234628200531
Epoch 17 Update 2120 Cost 0.07905793190002441
Epoch 17 Update 2130 Cost 0.016178585588932037
Epoch 17 Update 2140 Cost 0.16474051773548126
Epoch 17 Update 2150 Cost 0.023875685408711433
Epoch 17 Update 2160 Cost 0.05332176387310028
Epoch 17 Update 2170 Cost 0.018328139558434486
Epoch 17 Update 2180 Cost 0.01542073767632246
Epoch 17 Update 2190 Cost 0.6276781558990479
Epoch 17 Update 2200 Cost 0.050040747970342636
Epoch 17 Update 2210 Cost 0.010051509365439415
Epoch 17 Update 2220 Cost 0.058112118393182755
Saving...
Done
('Train ', 0.96246246246246248, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 18 Update 2230 Cost 0.03816660866141319
Epoch 18 Update 2240 Cost 0.1314203441143036
Epoch 18 Update 2250 Cost 0.0064184414222836494
Epoch 18 Update 2260 Cost 0.040258463472127914
Epoch 18 Update 2270 Cost 0.0038420963101089
Epoch 18 Update 2280 Cost 0.009110494516789913
Epoch 18 Update 2290 Cost 0.07993637025356293
Epoch 18 Update 2300 Cost 0.02251337096095085
Epoch 18 Update 2310 Cost 0.010183419100940228
Epoch 18 Update 2320 Cost 0.012899843044579029
Epoch 18 Update 2330 Cost 0.06603864580392838
Epoch 18 Update 2340 Cost 0.3464728891849518
Seen 1998 samples
Epoch 19 Update 2350 Cost 0.012285176664590836
Epoch 19 Update 2360 Cost 0.003917415160685778
Epoch 19 Update 2370 Cost 0.08966886252164841
Epoch 19 Update 2380 Cost 0.0023266985081136227
Epoch 19 Update 2390 Cost 1.684070110321045
Epoch 19 Update 2400 Cost 0.007668789941817522
Epoch 19 Update 2410 Cost 0.01749831810593605
Epoch 19 Update 2420 Cost 0.014242960140109062
Epoch 19 Update 2430 Cost 0.02965722046792507
Epoch 19 Update 2440 Cost 0.04456848278641701
Epoch 19 Update 2450 Cost 0.001934044063091278
Epoch 19 Update 2460 Cost 0.00873048696666956
Epoch 19 Update 2470 Cost 0.0063384282402694225
Seen 1998 samples
Epoch 20 Update 2480 Cost 0.0027291730511933565
Epoch 20 Update 2490 Cost 0.005528728477656841
Epoch 20 Update 2500 Cost 0.031136341392993927
Epoch 20 Update 2510 Cost 0.003956015687435865
Epoch 20 Update 2520 Cost 0.0024471196811646223
Epoch 20 Update 2530 Cost 0.0010379785671830177
Epoch 20 Update 2540 Cost 0.028663866221904755
Epoch 20 Update 2550 Cost 0.02864803746342659
Epoch 20 Update 2560 Cost 0.008624007925391197
Epoch 20 Update 2570 Cost 0.02188725396990776
Epoch 20 Update 2580 Cost 0.001784186577424407
Epoch 20 Update 2590 Cost 0.015428244136273861
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 21 Update 2600 Cost 0.005005196202546358
Epoch 21 Update 2610 Cost 0.0032753851264715195
Epoch 21 Update 2620 Cost 0.0025207900907844305
Epoch 21 Update 2630 Cost 0.00739527540281415
Epoch 21 Update 2640 Cost 0.7080523371696472
Epoch 21 Update 2650 Cost 0.0014608495403081179
Epoch 21 Update 2660 Cost 0.00136175483930856
Epoch 21 Update 2670 Cost 0.0027640743646770716
Epoch 21 Update 2680 Cost 0.06634580343961716
Epoch 21 Update 2690 Cost 0.02514594979584217
Epoch 21 Update 2700 Cost 0.009880654513835907
Epoch 21 Update 2710 Cost 0.012119402177631855
Seen 1998 samples
Epoch 22 Update 2720 Cost 0.0012020753929391503
Epoch 22 Update 2730 Cost 0.1646851748228073
Epoch 22 Update 2740 Cost 0.007236700505018234
Epoch 22 Update 2750 Cost 0.0017932929331436753
Epoch 22 Update 2760 Cost 0.0042511941865086555
Epoch 22 Update 2770 Cost 0.0014001609524711967
Epoch 22 Update 2780 Cost 0.008313515223562717
Epoch 22 Update 2790 Cost 0.04052192345261574
Epoch 22 Update 2800 Cost 0.02564511075615883
Epoch 22 Update 2810 Cost 0.0001822599588194862
Epoch 22 Update 2820 Cost 0.011649515479803085
Epoch 22 Update 2830 Cost 0.0007052610162645578
Epoch 22 Update 2840 Cost 0.005243530031293631
Seen 1998 samples
Epoch 23 Update 2850 Cost 0.0021032567601650953
Epoch 23 Update 2860 Cost 0.0010210057953372598
Epoch 23 Update 2870 Cost 0.009400792419910431
Epoch 23 Update 2880 Cost 0.0016273711808025837
Epoch 23 Update 2890 Cost 0.00017677490541245788
Epoch 23 Update 2900 Cost 0.014545178040862083
Epoch 23 Update 2910 Cost 0.0005485158762894571
Epoch 23 Update 2920 Cost 0.004133741371333599
Epoch 23 Update 2930 Cost 0.004918339196592569
Epoch 23 Update 2940 Cost 0.007136073894798756
Epoch 23 Update 2950 Cost 0.1158003881573677
Epoch 23 Update 2960 Cost 0.014717888087034225
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 24 Update 2970 Cost 0.006582573521882296
Epoch 24 Update 2980 Cost 0.0032673515379428864
Epoch 24 Update 2990 Cost 0.00013013491115998477
Epoch 24 Update 3000 Cost 0.0005575245013460517
Epoch 24 Update 3010 Cost 0.007153306622058153
Epoch 24 Update 3020 Cost 0.0014669254887849092
Epoch 24 Update 3030 Cost 0.00030108747887425125
Epoch 24 Update 3040 Cost 0.002148969564586878
Epoch 24 Update 3050 Cost 0.0008632834069430828
Epoch 24 Update 3060 Cost 0.034934598952531815
Epoch 24 Update 3070 Cost 0.002937032375484705
Epoch 24 Update 3080 Cost 0.0010129495058208704
Seen 1998 samples
Epoch 25 Update 3090 Cost 0.006091727875173092
Epoch 25 Update 3100 Cost 0.011157071217894554
Epoch 25 Update 3110 Cost 0.0021102281752973795
Epoch 25 Update 3120 Cost 0.008138070814311504
Epoch 25 Update 3130 Cost 0.0005121224676258862
Epoch 25 Update 3140 Cost 0.0019666850566864014
Epoch 25 Update 3150 Cost 0.0012464092578738928
Epoch 25 Update 3160 Cost 0.015999961644411087
Epoch 25 Update 3170 Cost 0.04351334273815155
Epoch 25 Update 3180 Cost 0.00021193601423874497
Epoch 25 Update 3190 Cost 0.0008423758554272354
Epoch 25 Update 3200 Cost 0.011286872439086437
Epoch 25 Update 3210 Cost 0.0020308312959969044
Seen 1998 samples
Epoch 26 Update 3220 Cost 0.02204160764813423
Epoch 26 Update 3230 Cost 0.00012092266115359962
Epoch 26 Update 3240 Cost 0.00877770408987999
Epoch 26 Update 3250 Cost 0.007401874754577875
Epoch 26 Update 3260 Cost 0.0021823584102094173
Epoch 26 Update 3270 Cost 0.00041885528480634093
Epoch 26 Update 3280 Cost 0.0001880535710370168
Epoch 26 Update 3290 Cost 0.0037813924718648195
Epoch 26 Update 3300 Cost 0.008608384057879448
Epoch 26 Update 3310 Cost 0.0005633322289213538
Epoch 26 Update 3320 Cost 0.0010285782627761364
Epoch 26 Update 3330 Cost 3.24637076118961e-05
Saving...
Done
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 27 Update 3340 Cost 0.0020287728402763605
Epoch 27 Update 3350 Cost 0.0014136704849079251
Epoch 27 Update 3360 Cost 0.013799339532852173
Epoch 27 Update 3370 Cost 0.0002697140153031796
Epoch 27 Update 3380 Cost 0.0004194981884211302
Epoch 27 Update 3390 Cost 0.3490208387374878
Epoch 27 Update 3400 Cost 0.05219344422221184
Epoch 27 Update 3410 Cost 0.001565662445500493
Epoch 27 Update 3420 Cost 0.00013523355301003903
Epoch 27 Update 3430 Cost 0.0007671238854527473
Epoch 27 Update 3440 Cost 0.0027180856559425592
Epoch 27 Update 3450 Cost 0.025092987343668938
Seen 1998 samples
Epoch 28 Update 3460 Cost 0.0003195049939677119
Epoch 28 Update 3470 Cost 0.005313067696988583
Epoch 28 Update 3480 Cost 1.3296003089635633e-05
Epoch 28 Update 3490 Cost 0.0017543474677950144
Epoch 28 Update 3500 Cost 0.00040265999268740416
Epoch 28 Update 3510 Cost 0.014211876317858696
Epoch 28 Update 3520 Cost 0.00017506808217149228
Epoch 28 Update 3530 Cost 0.0017211163649335504
Epoch 28 Update 3540 Cost 0.0006774297798983753
Epoch 28 Update 3550 Cost 5.3839194151805714e-05
Epoch 28 Update 3560 Cost 0.0007618653471581638
Epoch 28 Update 3570 Cost 0.00042076018871739507
Epoch 28 Update 3580 Cost 0.0006140697514638305
Seen 1998 samples
Epoch 29 Update 3590 Cost 0.00014377932529896498
Epoch 29 Update 3600 Cost 0.0027355607599020004
Epoch 29 Update 3610 Cost 0.0022660200484097004
Epoch 29 Update 3620 Cost 0.0012684802059084177
Epoch 29 Update 3630 Cost 0.00013033449067734182
Epoch 29 Update 3640 Cost 0.0008706728112883866
Epoch 29 Update 3650 Cost 0.0005525481537915766
Epoch 29 Update 3660 Cost 0.00028475679573602974
Epoch 29 Update 3670 Cost 0.07459058612585068
Epoch 29 Update 3680 Cost 0.003341560484841466
Epoch 29 Update 3690 Cost 0.0016191345639526844
Epoch 29 Update 3700 Cost 0.0009813796496018767
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 30 Update 3710 Cost 0.00021255860337987542
Epoch 30 Update 3720 Cost 0.00020765115914400667
Epoch 30 Update 3730 Cost 0.0005050486070103943
Epoch 30 Update 3740 Cost 0.00026309979148209095
Epoch 30 Update 3750 Cost 0.0005612623644992709
Epoch 30 Update 3760 Cost 0.002058959798887372
Epoch 30 Update 3770 Cost 0.000520671543199569
Epoch 30 Update 3780 Cost 0.000355338939698413
Epoch 30 Update 3790 Cost 0.00023973864153958857
Epoch 30 Update 3800 Cost 0.0008338256157003343
Epoch 30 Update 3810 Cost 0.0006300956592895091
Epoch 30 Update 3820 Cost 0.041097261011600494
Seen 1998 samples
Epoch 31 Update 3830 Cost 7.796897989464924e-05
Epoch 31 Update 3840 Cost 0.0007507213740609586
Epoch 31 Update 3850 Cost 0.000996727729216218
Epoch 31 Update 3860 Cost 0.0002391840098425746
Epoch 31 Update 3870 Cost 0.0006305930437520146
Epoch 31 Update 3880 Cost 0.00012772042828146368
Epoch 31 Update 3890 Cost 6.294464401435107e-05
Epoch 31 Update 3900 Cost 0.00036246859235689044
Epoch 31 Update 3910 Cost 0.00012054781836923212
Epoch 31 Update 3920 Cost 0.00469563202932477
Epoch 31 Update 3930 Cost 0.001826707855798304
Epoch 31 Update 3940 Cost 0.0008372424636036158
Epoch 31 Update 3950 Cost 0.0010290131904184818
Seen 1998 samples
Epoch 32 Update 3960 Cost 0.000978059135377407
Epoch 32 Update 3970 Cost 0.00018260155047755688
Epoch 32 Update 3980 Cost 0.0011474945349618793
Epoch 32 Update 3990 Cost 0.00030084745958447456
Epoch 32 Update 4000 Cost 0.0005002286634407938
Epoch 32 Update 4010 Cost 0.0008161694277077913
Epoch 32 Update 4020 Cost 0.0009966875659301877
Epoch 32 Update 4030 Cost 7.385408389382064e-05
Epoch 32 Update 4040 Cost 0.0006730408640578389
Epoch 32 Update 4050 Cost 0.0025301757268607616
Epoch 32 Update 4060 Cost 0.003411643672734499
Epoch 32 Update 4070 Cost 0.00011423180694691837
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 33 Update 4080 Cost 0.0021497115958482027
Epoch 33 Update 4090 Cost 0.0002082738355966285
Epoch 33 Update 4100 Cost 0.001239825040102005
Epoch 33 Update 4110 Cost 1.8765023924061097e-05
Epoch 33 Update 4120 Cost 1.9794300897046924e-05
Epoch 33 Update 4130 Cost 0.00028043327620252967
Epoch 33 Update 4140 Cost 0.000310950301354751
Epoch 33 Update 4150 Cost 0.00014476518845185637
Epoch 33 Update 4160 Cost 3.058034417335875e-05
Epoch 33 Update 4170 Cost 4.7428475227206945e-05
Epoch 33 Update 4180 Cost 0.00021646745153702796
Epoch 33 Update 4190 Cost 8.523371798219159e-05
Seen 1998 samples
Epoch 34 Update 4200 Cost 0.0005381057853810489
Epoch 34 Update 4210 Cost 5.5609678383916616e-05
Epoch 34 Update 4220 Cost 0.0003250682493671775
Epoch 34 Update 4230 Cost 9.203379886457697e-05
Epoch 34 Update 4240 Cost 2.201401184720453e-05
Epoch 34 Update 4250 Cost 0.00023872913152445108
Epoch 34 Update 4260 Cost 1.6615313143120147e-05
Epoch 34 Update 4270 Cost 0.0012655105674639344
Epoch 34 Update 4280 Cost 0.00019924990192521363
Epoch 34 Update 4290 Cost 2.0526978914858773e-05
Epoch 34 Update 4300 Cost 3.307871884317137e-05
Epoch 34 Update 4310 Cost 7.318561983993277e-05
Epoch 34 Update 4320 Cost 4.478843402466737e-05
Seen 1998 samples
Epoch 35 Update 4330 Cost 0.0009650315041653812
Epoch 35 Update 4340 Cost 0.0003468689101282507
Epoch 35 Update 4350 Cost 4.328852355683921e-06
Epoch 35 Update 4360 Cost 0.0004279170243535191
Epoch 35 Update 4370 Cost 0.0006950310198590159
Epoch 35 Update 4380 Cost 2.01584607566474e-05
Epoch 35 Update 4390 Cost 0.0005416375934146345
Epoch 35 Update 4400 Cost 0.00013389626110438257
Epoch 35 Update 4410 Cost 3.063429903704673e-05
Epoch 35 Update 4420 Cost 0.0006817193352617323
Epoch 35 Update 4430 Cost 1.0874690815398935e-05
Epoch 35 Update 4440 Cost 0.000536469102371484
Saving...
Done
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 36 Update 4450 Cost 0.000167072270414792
Epoch 36 Update 4460 Cost 0.0007001813501119614
Epoch 36 Update 4470 Cost 4.328270006226376e-05
Epoch 36 Update 4480 Cost 0.00012922764290124178
Epoch 36 Update 4490 Cost 2.916919811468688e-06
Epoch 36 Update 4500 Cost 3.7636898923665285e-05
Epoch 36 Update 4510 Cost 0.00036868464667350054
Epoch 36 Update 4520 Cost 9.369432518724352e-06
Epoch 36 Update 4530 Cost 8.96156852832064e-05
Epoch 36 Update 4540 Cost 1.547924694023095e-05
Epoch 36 Update 4550 Cost 0.0038837939500808716
Epoch 36 Update 4560 Cost 0.0003777177189476788
Seen 1998 samples
Epoch 37 Update 4570 Cost 3.6128974898019806e-05
Epoch 37 Update 4580 Cost 4.1421386413276196e-05
Epoch 37 Update 4590 Cost 1.8236367395729758e-05
Epoch 37 Update 4600 Cost 1.2745002095471136e-05
Epoch 37 Update 4610 Cost 4.887698651145911e-06
Epoch 37 Update 4620 Cost 0.00021322780230548233
Epoch 37 Update 4630 Cost 0.00010159515659324825
Epoch 37 Update 4640 Cost 0.001152968849055469
Epoch 37 Update 4650 Cost 6.744739948771894e-05
Epoch 37 Update 4660 Cost 0.0022935159504413605
Epoch 37 Update 4670 Cost 0.00020887468417640775
Epoch 37 Update 4680 Cost 0.00013378009316511452
Epoch 37 Update 4690 Cost 1.7831020159064792e-05
Seen 1998 samples
Epoch 38 Update 4700 Cost 8.381925908906851e-07
Epoch 38 Update 4710 Cost 0.0003686443960759789
Epoch 38 Update 4720 Cost 2.406685052847024e-05
Epoch 38 Update 4730 Cost 0.00018941414600703865
Epoch 38 Update 4740 Cost 4.999418251827592e-06
Epoch 38 Update 4750 Cost 6.342451524687931e-05
Epoch 38 Update 4760 Cost 7.331062806770205e-05
Epoch 38 Update 4770 Cost 1.9700390112120658e-05
Epoch 38 Update 4780 Cost 3.126063529634848e-05
Epoch 38 Update 4790 Cost 0.00019632687326520681
Epoch 38 Update 4800 Cost 7.526520494138822e-05
Epoch 38 Update 4810 Cost 7.82731658546254e-05
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 39 Update 4820 Cost 0.0002846271963790059
Epoch 39 Update 4830 Cost 0.000784306088462472
Epoch 39 Update 4840 Cost 2.0675502128142398e-06
Epoch 39 Update 4850 Cost 2.1600471882265992e-05
Epoch 39 Update 4860 Cost 8.32191071822308e-05
Epoch 39 Update 4870 Cost 7.839034515200183e-05
Epoch 39 Update 4880 Cost 0.00027204977232031524
Epoch 39 Update 4890 Cost 3.6922345316270366e-05
Epoch 39 Update 4900 Cost 4.201066985842772e-05
Epoch 39 Update 4910 Cost 0.00021360091341193765
Epoch 39 Update 4920 Cost 2.2115737010608427e-05
Epoch 39 Update 4930 Cost 2.332057192688808e-06
Seen 1998 samples
Epoch 40 Update 4940 Cost 3.810196358244866e-05
Epoch 40 Update 4950 Cost 3.427001865929924e-05
Epoch 40 Update 4960 Cost 5.608447827398777e-05
Epoch 40 Update 4970 Cost 2.6562109269434586e-05
Epoch 40 Update 4980 Cost 1.654857987887226e-05
Epoch 40 Update 4990 Cost 9.356318332720548e-05
Epoch 40 Update 5000 Cost 1.1902585356438067e-05
Epoch 40 Update 5010 Cost 5.111171049065888e-06
Epoch 40 Update 5020 Cost 2.606346970424056e-05
Epoch 40 Update 5030 Cost 0.0001151527976617217
Epoch 40 Update 5040 Cost 0.0013860942563042045
Epoch 40 Update 5050 Cost 8.457167859887704e-05
Epoch 40 Update 5060 Cost 7.293199359992286e-06
Seen 1998 samples
Epoch 41 Update 5070 Cost 2.4885127913876204e-06
Epoch 41 Update 5080 Cost 7.617253140779212e-05
Epoch 41 Update 5090 Cost 4.34327703260351e-05
Epoch 41 Update 5100 Cost 8.493842869938817e-06
Epoch 41 Update 5110 Cost 2.165509431506507e-05
Epoch 41 Update 5120 Cost 1.2987231457373127e-05
Epoch 41 Update 5130 Cost 4.059054117533378e-05
Epoch 41 Update 5140 Cost 8.62648812471889e-05
Epoch 41 Update 5150 Cost 1.3515618775272742e-05
Epoch 41 Update 5160 Cost 2.6754136342788115e-05
Epoch 41 Update 5170 Cost 0.00025667858426459134
Epoch 41 Update 5180 Cost 1.944675386766903e-05
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 42 Update 5190 Cost 3.641294824774377e-05
Epoch 42 Update 5200 Cost 3.837083113467088e-06
Epoch 42 Update 5210 Cost 7.604599522892386e-05
Epoch 42 Update 5220 Cost 7.360411109402776e-05
Epoch 42 Update 5230 Cost 5.8802754210773855e-05
Epoch 42 Update 5240 Cost 3.7190166040090844e-05
Epoch 42 Update 5250 Cost 1.5497259937546914e-06
Epoch 42 Update 5260 Cost 3.303769699414261e-05
Epoch 42 Update 5270 Cost 5.421540481620468e-05
Epoch 42 Update 5280 Cost 5.263944785838248e-06
Epoch 42 Update 5290 Cost 7.848785753594711e-05
Epoch 42 Update 5300 Cost 1.2926797126056044e-06
Seen 1998 samples
Epoch 43 Update 5310 Cost 0.00019309385970700532
Epoch 43 Update 5320 Cost 1.2901447917101905e-05
Epoch 43 Update 5330 Cost 1.7841599401435815e-05
Epoch 43 Update 5340 Cost 3.7291451008059084e-05
Epoch 43 Update 5350 Cost 9.410451639269013e-06
Epoch 43 Update 5360 Cost 0.00033247467945329845
Epoch 43 Update 5370 Cost 0.00048626880743540823
Epoch 43 Update 5380 Cost 0.000254884798778221
Epoch 43 Update 5390 Cost 1.6563997633056715e-05
Epoch 43 Update 5400 Cost 7.387818914139643e-05
Epoch 43 Update 5410 Cost 0.00016941949434112757
Epoch 43 Update 5420 Cost 1.3735986613028217e-05
Epoch 43 Update 5430 Cost 0.00024532873067073524
Seen 1998 samples
Epoch 44 Update 5440 Cost 0.00021327647846192122
Epoch 44 Update 5450 Cost 5.476236765389331e-06
Epoch 44 Update 5460 Cost 0.00021580846805591136
Epoch 44 Update 5470 Cost 3.911598014383344e-06
Epoch 44 Update 5480 Cost 0.00010143746476387605
Epoch 44 Update 5490 Cost 4.153741883783368e-06
Epoch 44 Update 5500 Cost 3.1553538519801805e-06
Epoch 44 Update 5510 Cost 1.18168818517006e-05
Epoch 44 Update 5520 Cost 2.7153977498528548e-05
Epoch 44 Update 5530 Cost 1.06359275378054e-05
Epoch 44 Update 5540 Cost 4.7311252160398e-07
Epoch 44 Update 5550 Cost 6.292204489000142e-06
Saving...
Done
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 45 Update 5560 Cost 1.987546420423314e-05
Epoch 45 Update 5570 Cost 0.00011009544687112793
Epoch 45 Update 5580 Cost 5.9598791267490014e-05
Epoch 45 Update 5590 Cost 2.700851609915844e-06
Epoch 45 Update 5600 Cost 6.044840483809821e-05
Epoch 45 Update 5610 Cost 1.3623969607579056e-05
Epoch 45 Update 5620 Cost 2.4764720365055837e-05
Epoch 45 Update 5630 Cost 9.483152825850993e-05
Epoch 45 Update 5640 Cost 6.172399298520759e-05
Epoch 45 Update 5650 Cost 4.306519713281887e-06
Epoch 45 Update 5660 Cost 2.047519046755042e-05
Epoch 45 Update 5670 Cost 3.640066643129103e-05
Seen 1998 samples
Epoch 46 Update 5680 Cost 2.3665490516577847e-05
Epoch 46 Update 5690 Cost 1.0900521374423988e-05
Epoch 46 Update 5700 Cost 8.19587967271218e-06
Epoch 46 Update 5710 Cost 2.54970454989234e-05
Epoch 46 Update 5720 Cost 3.8184962249943055e-06
Epoch 46 Update 5730 Cost 0.00019548815907910466
Epoch 46 Update 5740 Cost 3.5696277336683124e-05
Epoch 46 Update 5750 Cost 1.5792962585692294e-05
Epoch 46 Update 5760 Cost 3.118084805464605e-06
Epoch 46 Update 5770 Cost 2.1606693678677402e-07
Epoch 46 Update 5780 Cost 0.0009855778189375997
Epoch 46 Update 5790 Cost 9.328544365416747e-06
Epoch 46 Update 5800 Cost 1.2964314009877853e-05
Seen 1998 samples
Epoch 47 Update 5810 Cost 3.7029699342383537e-06
Epoch 47 Update 5820 Cost 3.658675268525258e-05
Epoch 47 Update 5830 Cost 5.401677753980039e-07
Epoch 47 Update 5840 Cost 1.791587783372961e-05
Epoch 47 Update 5850 Cost 3.418398409849033e-05
Epoch 47 Update 5860 Cost 6.649739134445554e-06
Epoch 47 Update 5870 Cost 1.1284269021416549e-05
Epoch 47 Update 5880 Cost 2.928285175585188e-05
Epoch 47 Update 5890 Cost 6.97389077686239e-06
Epoch 47 Update 5900 Cost 2.0861793927906547e-06
Epoch 47 Update 5910 Cost 0.0001005316516966559
Epoch 47 Update 5920 Cost 2.4115788619383238e-05
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 48 Update 5930 Cost 0.0001990367891266942
Epoch 48 Update 5940 Cost 2.153923560399562e-05
Epoch 48 Update 5950 Cost 0.00022328390332404524
Epoch 48 Update 5960 Cost 1.005852573143784e-05
Epoch 48 Update 5970 Cost 0.00024404909345321357
Epoch 48 Update 5980 Cost 9.931860404321924e-06
Epoch 48 Update 5990 Cost 2.097113429044839e-05
Epoch 48 Update 6000 Cost 4.917393425785122e-07
Epoch 48 Update 6010 Cost 2.637376201164443e-05
Epoch 48 Update 6020 Cost 4.647687092074193e-05
Epoch 48 Update 6030 Cost 1.5873938536969945e-05
Epoch 48 Update 6040 Cost 8.609465112385806e-06
Seen 1998 samples
Epoch 49 Update 6050 Cost 3.583758825698169e-06
Epoch 49 Update 6060 Cost 1.5349733075709082e-05
Epoch 49 Update 6070 Cost 1.6894931832212023e-05
Epoch 49 Update 6080 Cost 6.862185273348587e-06
Epoch 49 Update 6090 Cost 6.45238469587639e-06
Epoch 49 Update 6100 Cost 1.3336618849280057e-06
Epoch 49 Update 6110 Cost 1.101626821764512e-05
Epoch 49 Update 6120 Cost 1.6963422240223736e-05
Epoch 49 Update 6130 Cost 3.351627310621552e-05
Epoch 49 Update 6140 Cost 9.235453035216779e-06
Epoch 49 Update 6150 Cost 5.661527393385768e-05
Epoch 49 Update 6160 Cost 6.441143796109827e-06
Epoch 49 Update 6170 Cost 0.00013768728240393102
Seen 1998 samples
Epoch 50 Update 6180 Cost 0.0003597887116484344
Epoch 50 Update 6190 Cost 1.910174614749849e-05
Epoch 50 Update 6200 Cost 4.32443521276582e-05
Epoch 50 Update 6210 Cost 0.0001972657919395715
Epoch 50 Update 6220 Cost 1.8216765056422446e-06
Epoch 50 Update 6230 Cost 2.019116436713375e-06
Epoch 50 Update 6240 Cost 0.00020743644563481212
Epoch 50 Update 6250 Cost 2.250088073196821e-06
Epoch 50 Update 6260 Cost 2.8593554816325195e-05
Epoch 50 Update 6270 Cost 3.5614054922916694e-06
Epoch 50 Update 6280 Cost 2.105786552419886e-05
Epoch 50 Update 6290 Cost 1.2815050922654336e-06
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 51 Update 6300 Cost 3.896699581673602e-06
Epoch 51 Update 6310 Cost 5.03248957102187e-05
Epoch 51 Update 6320 Cost 3.5390505217947066e-05
Epoch 51 Update 6330 Cost 3.6769113194168312e-06
Epoch 51 Update 6340 Cost 2.9405458917608485e-05
Epoch 51 Update 6350 Cost 1.2584471733134706e-05
Epoch 51 Update 6360 Cost 0.00010767455387394875
Epoch 51 Update 6370 Cost 0.00037554942537099123
Epoch 51 Update 6380 Cost 7.931795698823407e-05
Epoch 51 Update 6390 Cost 5.081376457383158e-06
Epoch 51 Update 6400 Cost 0.0024536217097193003
Epoch 51 Update 6410 Cost 0.00014240408199839294
Seen 1998 samples
Epoch 52 Update 6420 Cost 9.734305058373138e-05
Epoch 52 Update 6430 Cost 1.8366572476224974e-05
Epoch 52 Update 6440 Cost 1.4677711988042574e-06
Epoch 52 Update 6450 Cost 0.0001144152192864567
Epoch 52 Update 6460 Cost 2.6972260457114317e-05
Epoch 52 Update 6470 Cost 1.0039927474281285e-05
Epoch 52 Update 6480 Cost 1.3020500773563981e-05
Epoch 52 Update 6490 Cost 0.0002815462357830256
Epoch 52 Update 6500 Cost 0.00016365876945201308
Epoch 52 Update 6510 Cost 0.0005019729724153876
Epoch 52 Update 6520 Cost 0.00012127720401622355
Epoch 52 Update 6530 Cost 6.83187463437207e-05
Epoch 52 Update 6540 Cost 1.8614880900713615e-05
Seen 1998 samples
Epoch 53 Update 6550 Cost 1.0818866030604113e-05
Epoch 53 Update 6560 Cost 0.0008463257690891623
Epoch 53 Update 6570 Cost 1.7511203623143956e-05
Epoch 53 Update 6580 Cost 4.026888927910477e-05
Epoch 53 Update 6590 Cost 1.702465738162573e-06
Epoch 53 Update 6600 Cost 9.362016135128215e-05
Epoch 53 Update 6610 Cost 0.00012236957263667136
Epoch 53 Update 6620 Cost 0.00022757398255635053
Epoch 53 Update 6630 Cost 9.486090129939839e-05
Epoch 53 Update 6640 Cost 4.270615681889467e-05
Epoch 53 Update 6650 Cost 1.0911714525718708e-05
Epoch 53 Update 6660 Cost 3.588397157727741e-05
Saving...
Done
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 54 Update 6670 Cost 2.5779143015824957e-06
Epoch 54 Update 6680 Cost 2.61889931607584e-06
Epoch 54 Update 6690 Cost 1.0036100320576224e-05
Epoch 54 Update 6700 Cost 4.4630319280258846e-06
Epoch 54 Update 6710 Cost 3.141076740575954e-05
Epoch 54 Update 6720 Cost 4.117965363548137e-05
Epoch 54 Update 6730 Cost 7.365191777353175e-06
Epoch 54 Update 6740 Cost 2.807699092954863e-05
Epoch 54 Update 6750 Cost 0.00020544466678984463
Epoch 54 Update 6760 Cost 8.39722270029597e-06
Epoch 54 Update 6770 Cost 1.9081669961451553e-05
Epoch 54 Update 6780 Cost 0.00035724457120522857
Seen 1998 samples
Epoch 55 Update 6790 Cost 3.2684933103155345e-05
Epoch 55 Update 6800 Cost 1.3751092410529964e-05
Epoch 55 Update 6810 Cost 4.26923725171946e-06
Epoch 55 Update 6820 Cost 7.936113252071664e-05
Epoch 55 Update 6830 Cost 2.2165670543472515e-06
Epoch 55 Update 6840 Cost 2.2535792595590465e-05
Epoch 55 Update 6850 Cost 3.684353714561439e-06
Epoch 55 Update 6860 Cost 0.00010563933028606698
Epoch 55 Update 6870 Cost 0.00013021344784647226
Epoch 55 Update 6880 Cost 0.0001867993123596534
Epoch 55 Update 6890 Cost 0.00010685992310754955
Epoch 55 Update 6900 Cost 3.180146813974716e-05
Epoch 55 Update 6910 Cost 4.509440259425901e-05
Seen 1998 samples
Epoch 56 Update 6920 Cost 3.48694015883666e-06
Epoch 56 Update 6930 Cost 4.217065907141659e-06
Epoch 56 Update 6940 Cost 4.4362841435940936e-05
Epoch 56 Update 6950 Cost 3.289084997959435e-05
Epoch 56 Update 6960 Cost 8.70319054229185e-05
Epoch 56 Update 6970 Cost 3.314344212412834e-05
Epoch 56 Update 6980 Cost 3.632217385529657e-06
Epoch 56 Update 6990 Cost 7.913593435660005e-05
Epoch 56 Update 7000 Cost 4.378633821033873e-05
Epoch 56 Update 7010 Cost 5.443270129035227e-05
Epoch 56 Update 7020 Cost 1.437968535356049e-06
Epoch 56 Update 7030 Cost 6.802637471992057e-06
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 57 Update 7040 Cost 1.796542164811399e-05
Epoch 57 Update 7050 Cost 8.494161738781258e-05
Epoch 57 Update 7060 Cost 0.0006323433481156826
Epoch 57 Update 7070 Cost 7.08197239873698e-06
Epoch 57 Update 7080 Cost 9.932056127581745e-05
Epoch 57 Update 7090 Cost 4.880231244897004e-06
Epoch 57 Update 7100 Cost 8.270318176073488e-06
Epoch 57 Update 7110 Cost 1.593468005012255e-05
Epoch 57 Update 7120 Cost 1.3385397323872894e-05
Epoch 57 Update 7130 Cost 2.952204340544995e-05
Epoch 57 Update 7140 Cost 7.744687172817066e-05
Epoch 57 Update 7150 Cost 2.1942064449831378e-06
Seen 1998 samples
Epoch 58 Update 7160 Cost 5.211756160861114e-06
Epoch 58 Update 7170 Cost 1.4689201634610072e-05
Epoch 58 Update 7180 Cost 9.708355719340034e-06
Epoch 58 Update 7190 Cost 4.56457091786433e-05
Epoch 58 Update 7200 Cost 3.482224929030053e-05
Epoch 58 Update 7210 Cost 4.4651849748333916e-05
Epoch 58 Update 7220 Cost 6.24761469225632e-06
Epoch 58 Update 7230 Cost 0.0001855979353422299
Epoch 58 Update 7240 Cost 3.401244612177834e-06
Epoch 58 Update 7250 Cost 1.122112553275656e-05
Epoch 58 Update 7260 Cost 1.0345464033889584e-05
Epoch 58 Update 7270 Cost 6.072230007703183e-07
Epoch 58 Update 7280 Cost 0.00019645981956273317
Seen 1998 samples
Epoch 59 Update 7290 Cost 2.4635457521071658e-05
Epoch 59 Update 7300 Cost 2.7554575353860855e-05
Epoch 59 Update 7310 Cost 2.896185287681874e-05
Epoch 59 Update 7320 Cost 5.394355866883416e-06
Epoch 59 Update 7330 Cost 2.8498702704382595e-06
Epoch 59 Update 7340 Cost 2.869189302145969e-05
Epoch 59 Update 7350 Cost 3.61189158866182e-05
Epoch 59 Update 7360 Cost 3.784960199482157e-06
Epoch 59 Update 7370 Cost 1.6242327092186315e-06
Epoch 59 Update 7380 Cost 7.454696606146172e-05
Epoch 59 Update 7390 Cost 2.9800507036270574e-05
Epoch 59 Update 7400 Cost 4.4204640289535746e-05
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Seen 1920 samples
Epoch 60 Update 7410 Cost 3.6061453556612832e-06
Epoch 60 Update 7420 Cost 5.468829385790741e-06
Epoch 60 Update 7430 Cost 4.201773117529228e-05
Epoch 60 Update 7440 Cost 1.7409882275387645e-05
Epoch 60 Update 7450 Cost 0.00105650769546628
Epoch 60 Update 7460 Cost 9.79817286861362e-06
Epoch 60 Update 7470 Cost 5.886042799829738e-06
Epoch 60 Update 7480 Cost 3.829643901553936e-06
Epoch 60 Update 7490 Cost 1.1280578291916754e-05
Epoch 60 Update 7500 Cost 3.5241705518274102e-06
Epoch 60 Update 7510 Cost 9.96333546936512e-05
Epoch 60 Update 7520 Cost 0.00022944189549889416
Seen 1998 samples
Epoch 61 Update 7530 Cost 0.00010503723751753569
Epoch 61 Update 7540 Cost 3.714138438226655e-05
Epoch 61 Update 7550 Cost 3.777476649702294e-06
Epoch 61 Update 7560 Cost 0.00010899154585786164
Epoch 61 Update 7570 Cost 4.470075509743765e-05
Epoch 61 Update 7580 Cost 4.0599108615424484e-05
Epoch 61 Update 7590 Cost 2.622645752126118e-06
Epoch 61 Update 7600 Cost 2.3461094315280207e-05
Epoch 61 Update 7610 Cost 3.6447956517804414e-05
Epoch 61 Update 7620 Cost 4.35494757766719e-06
Epoch 61 Update 7630 Cost 1.9149118088535033e-05
Epoch 61 Update 7640 Cost 4.716283910966013e-06
Epoch 61 Update 7650 Cost 3.0165361749823205e-05
Seen 1998 samples
Epoch 62 Update 7660 Cost 2.5709196052048355e-05
Epoch 62 Update 7670 Cost 2.29498964472441e-05
Epoch 62 Update 7680 Cost 6.79139429848874e-06
Epoch 62 Update 7690 Cost 1.8445060049998574e-05
Epoch 62 Update 7700 Cost 1.3475721061695367e-05
Epoch 62 Update 7710 Cost 0.0001570492167957127
Epoch 62 Update 7720 Cost 6.027614290360361e-06
Epoch 62 Update 7730 Cost 4.846696811000584e-06
Epoch 62 Update 7740 Cost 0.00016137627244461328
Epoch 62 Update 7750 Cost 5.381104347179644e-05
Epoch 62 Update 7760 Cost 0.00026019333745352924
Epoch 62 Update 7770 Cost 9.23908555705566e-06
Saving...
Done
('Train ', 0.96096096096096095, 'Valid ', 1.0, 'Test ', 1.0)
Early Stop!
Seen 1920 samples
Train 0.421921921922 Valid 1.0 Test 1.0
The code run for 63 epochs, with 18.368222 sec/epochs
