-
Notifications
You must be signed in to change notification settings - Fork 18
/
train_fea.log
6910 lines (6910 loc) · 465 KB
/
train_fea.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
nohup: ignoring input
INFO:root:start with arguments Namespace(batch_size=128, benchmark=0, data_nthreads=4, data_train='data/cifar10_train.rec', data_train_idx='', data_val='data/cifar10_val.rec', data_val_idx='', disp_batches=20, dtype='float32', gpus='0,1', image_shape='3,28,28', is_train=True, kv_store='device', load_epoch=None, lr=0.7, lr_factor=0.1, lr_step_epochs='10,100,200', max_random_aspect_ratio=0, max_random_h=36, max_random_l=50, max_random_rotate_angle=0, max_random_s=50, max_random_scale=1, max_random_shear_ratio=0, min_random_scale=1, model_prefix='models/mix_fea/mix', mom=0.9, monitor=0, network='resnet_mixup_fea', num_classes=10, num_epochs=300, num_examples=50000, num_layers=50, optimizer='sgd', pad_size=4, random_crop=1, random_mirror=1, rgb_mean='123.68,116.779,103.939', test_io=0, top_k=0, wd=0.0001)
{'alpha': '0.2', 'mix_rate': '0.7', 'batch_size': '128', 'num_classes': '10'}
{}
[05:44:06] src/io/iter_image_recordio_2.cc:169: ImageRecordIOParser2: data/cifar10_train.rec, use 4 threads for decoding..
[05:44:06] src/io/iter_image_recordio_2.cc:169: ImageRecordIOParser2: data/cifar10_val.rec, use 4 threads for decoding..
[05:44:07] src/operator/././cudnn_algoreg-inl.h:106: Running performance tests to find the best convolution algorithm, this can take a while... (setting env variable MXNET_CUDNN_AUTOTUNE_DEFAULT to 0 to disable)
INFO:root:Epoch[0] Batch [20] Speed: 1770.95 samples/sec Loss=2.343762
INFO:root:Epoch[0] Batch [40] Speed: 1835.59 samples/sec Loss=2.236490
INFO:root:Epoch[0] Batch [60] Speed: 1827.66 samples/sec Loss=2.136245
INFO:root:Epoch[0] Batch [80] Speed: 1957.18 samples/sec Loss=2.091228
INFO:root:Epoch[0] Batch [100] Speed: 2077.28 samples/sec Loss=2.030355
INFO:root:Epoch[0] Batch [120] Speed: 2020.27 samples/sec Loss=1.988913
INFO:root:Epoch[0] Batch [140] Speed: 1761.45 samples/sec Loss=1.961107
INFO:root:Epoch[0] Batch [160] Speed: 1820.56 samples/sec Loss=1.957460
INFO:root:Epoch[0] Batch [180] Speed: 1847.54 samples/sec Loss=1.937463
INFO:root:Epoch[0] Batch [200] Speed: 1837.63 samples/sec Loss=1.908317
INFO:root:Epoch[0] Batch [220] Speed: 1834.10 samples/sec Loss=1.842255
INFO:root:Epoch[0] Batch [240] Speed: 1829.81 samples/sec Loss=1.862105
INFO:root:Epoch[0] Batch [260] Speed: 1784.48 samples/sec Loss=1.830056
INFO:root:Epoch[0] Batch [280] Speed: 1671.49 samples/sec Loss=1.859446
INFO:root:Epoch[0] Batch [300] Speed: 1726.42 samples/sec Loss=1.858021
INFO:root:Epoch[0] Batch [320] Speed: 1719.33 samples/sec Loss=1.816435
INFO:root:Epoch[0] Batch [340] Speed: 1729.79 samples/sec Loss=1.823844
INFO:root:Epoch[0] Batch [360] Speed: 1713.68 samples/sec Loss=1.821892
INFO:root:Epoch[0] Batch [380] Speed: 1730.62 samples/sec Loss=1.797960
INFO:root:Epoch[0] Train-Loss=1.814163
INFO:root:Epoch[0] Time cost=27.899
INFO:root:Saved checkpoint to "models/mix_fea/mix-0001.params"
INFO:root:Epoch[0] Validation-Loss=1.663584
INFO:root:Epoch[1] Batch [20] Speed: 1732.56 samples/sec Loss=1.789325
INFO:root:Epoch[1] Batch [40] Speed: 1724.82 samples/sec Loss=1.755554
INFO:root:Epoch[1] Batch [60] Speed: 1731.00 samples/sec Loss=1.761036
INFO:root:Epoch[1] Batch [80] Speed: 1845.48 samples/sec Loss=1.767386
INFO:root:Epoch[1] Batch [100] Speed: 2081.26 samples/sec Loss=1.771848
INFO:root:Epoch[1] Batch [120] Speed: 2012.98 samples/sec Loss=1.742287
INFO:root:Epoch[1] Batch [140] Speed: 1655.78 samples/sec Loss=1.713545
INFO:root:Epoch[1] Batch [160] Speed: 1686.79 samples/sec Loss=1.716179
INFO:root:Epoch[1] Batch [180] Speed: 1747.66 samples/sec Loss=1.705458
INFO:root:Epoch[1] Batch [200] Speed: 1716.55 samples/sec Loss=1.718772
INFO:root:Epoch[1] Batch [220] Speed: 1730.56 samples/sec Loss=1.698553
INFO:root:Epoch[1] Batch [240] Speed: 1726.86 samples/sec Loss=1.662226
INFO:root:Epoch[1] Batch [260] Speed: 1722.53 samples/sec Loss=1.678044
INFO:root:Epoch[1] Batch [280] Speed: 1726.18 samples/sec Loss=1.653434
INFO:root:Epoch[1] Batch [300] Speed: 1732.01 samples/sec Loss=1.613130
INFO:root:Epoch[1] Batch [320] Speed: 1737.54 samples/sec Loss=1.658291
INFO:root:Epoch[1] Batch [340] Speed: 1720.77 samples/sec Loss=1.626982
INFO:root:Epoch[1] Batch [360] Speed: 1708.35 samples/sec Loss=1.574776
INFO:root:Epoch[1] Batch [380] Speed: 1693.09 samples/sec Loss=1.566136
INFO:root:Epoch[1] Train-Loss=1.588348
INFO:root:Epoch[1] Time cost=28.536
INFO:root:Saved checkpoint to "models/mix_fea/mix-0002.params"
INFO:root:Epoch[1] Validation-Loss=1.628338
INFO:root:Epoch[2] Batch [20] Speed: 1693.13 samples/sec Loss=1.572071
INFO:root:Epoch[2] Batch [40] Speed: 1703.11 samples/sec Loss=1.567600
INFO:root:Epoch[2] Batch [60] Speed: 1697.50 samples/sec Loss=1.528518
INFO:root:Epoch[2] Batch [80] Speed: 1840.62 samples/sec Loss=1.553827
INFO:root:Epoch[2] Batch [100] Speed: 2109.92 samples/sec Loss=1.493121
INFO:root:Epoch[2] Batch [120] Speed: 1965.79 samples/sec Loss=1.533187
INFO:root:Epoch[2] Batch [140] Speed: 1710.43 samples/sec Loss=1.540523
INFO:root:Epoch[2] Batch [160] Speed: 1739.03 samples/sec Loss=1.478615
INFO:root:Epoch[2] Batch [180] Speed: 1711.93 samples/sec Loss=1.462781
INFO:root:Epoch[2] Batch [200] Speed: 1727.32 samples/sec Loss=1.444950
INFO:root:Epoch[2] Batch [220] Speed: 1718.15 samples/sec Loss=1.450773
INFO:root:Epoch[2] Batch [240] Speed: 1716.27 samples/sec Loss=1.457410
INFO:root:Epoch[2] Batch [260] Speed: 1732.64 samples/sec Loss=1.474924
INFO:root:Epoch[2] Batch [280] Speed: 1685.66 samples/sec Loss=1.414900
INFO:root:Epoch[2] Batch [300] Speed: 1671.24 samples/sec Loss=1.403571
INFO:root:Epoch[2] Batch [320] Speed: 1735.18 samples/sec Loss=1.355397
INFO:root:Epoch[2] Batch [340] Speed: 1757.73 samples/sec Loss=1.365598
INFO:root:Epoch[2] Batch [360] Speed: 1736.19 samples/sec Loss=1.401138
INFO:root:Epoch[2] Batch [380] Speed: 1744.55 samples/sec Loss=1.374284
INFO:root:Epoch[2] Train-Loss=1.406922
INFO:root:Epoch[2] Time cost=28.454
INFO:root:Saved checkpoint to "models/mix_fea/mix-0003.params"
INFO:root:Epoch[2] Validation-Loss=1.329457
INFO:root:Epoch[3] Batch [20] Speed: 1717.29 samples/sec Loss=1.358391
INFO:root:Epoch[3] Batch [40] Speed: 1727.72 samples/sec Loss=1.360870
INFO:root:Epoch[3] Batch [60] Speed: 1697.66 samples/sec Loss=1.372742
INFO:root:Epoch[3] Batch [80] Speed: 1817.16 samples/sec Loss=1.357639
INFO:root:Epoch[3] Batch [100] Speed: 2103.71 samples/sec Loss=1.371536
INFO:root:Epoch[3] Batch [120] Speed: 1975.51 samples/sec Loss=1.363656
INFO:root:Epoch[3] Batch [140] Speed: 1692.52 samples/sec Loss=1.352137
INFO:root:Epoch[3] Batch [160] Speed: 1711.18 samples/sec Loss=1.351073
INFO:root:Epoch[3] Batch [180] Speed: 1686.23 samples/sec Loss=1.328471
INFO:root:Epoch[3] Batch [200] Speed: 1691.82 samples/sec Loss=1.326928
INFO:root:Epoch[3] Batch [220] Speed: 1695.22 samples/sec Loss=1.315431
INFO:root:Epoch[3] Batch [240] Speed: 1706.71 samples/sec Loss=1.305329
INFO:root:Epoch[3] Batch [260] Speed: 1702.84 samples/sec Loss=1.341025
INFO:root:Epoch[3] Batch [280] Speed: 1695.71 samples/sec Loss=1.282625
INFO:root:Epoch[3] Batch [300] Speed: 1692.73 samples/sec Loss=1.298455
INFO:root:Epoch[3] Batch [320] Speed: 1691.37 samples/sec Loss=1.297840
INFO:root:Epoch[3] Batch [340] Speed: 1690.92 samples/sec Loss=1.267965
INFO:root:Epoch[3] Batch [360] Speed: 1699.77 samples/sec Loss=1.265524
INFO:root:Epoch[3] Batch [380] Speed: 1701.44 samples/sec Loss=1.292522
INFO:root:Epoch[3] Train-Loss=1.267451
INFO:root:Epoch[3] Time cost=28.813
INFO:root:Saved checkpoint to "models/mix_fea/mix-0004.params"
INFO:root:Epoch[3] Validation-Loss=1.307800
INFO:root:Epoch[4] Batch [20] Speed: 1655.72 samples/sec Loss=1.256091
INFO:root:Epoch[4] Batch [40] Speed: 1622.81 samples/sec Loss=1.277936
INFO:root:Epoch[4] Batch [60] Speed: 1642.13 samples/sec Loss=1.288523
INFO:root:Epoch[4] Batch [80] Speed: 1809.02 samples/sec Loss=1.271783
INFO:root:Epoch[4] Batch [100] Speed: 2096.52 samples/sec Loss=1.270245
INFO:root:Epoch[4] Batch [120] Speed: 1960.39 samples/sec Loss=1.253617
INFO:root:Epoch[4] Batch [140] Speed: 1700.88 samples/sec Loss=1.256996
INFO:root:Epoch[4] Batch [160] Speed: 1701.07 samples/sec Loss=1.288684
INFO:root:Epoch[4] Batch [180] Speed: 1698.31 samples/sec Loss=1.210027
INFO:root:Epoch[4] Batch [200] Speed: 1677.13 samples/sec Loss=1.282250
INFO:root:Epoch[4] Batch [220] Speed: 1635.59 samples/sec Loss=1.272759
INFO:root:Epoch[4] Batch [240] Speed: 1699.41 samples/sec Loss=1.244583
INFO:root:Epoch[4] Batch [260] Speed: 1714.87 samples/sec Loss=1.243997
INFO:root:Epoch[4] Batch [280] Speed: 1735.62 samples/sec Loss=1.233206
INFO:root:Epoch[4] Batch [300] Speed: 1726.64 samples/sec Loss=1.228278
INFO:root:Epoch[4] Batch [320] Speed: 1722.81 samples/sec Loss=1.195656
INFO:root:Epoch[4] Batch [340] Speed: 1702.34 samples/sec Loss=1.135458
INFO:root:Epoch[4] Batch [360] Speed: 1733.61 samples/sec Loss=1.199901
INFO:root:Epoch[4] Batch [380] Speed: 1724.20 samples/sec Loss=1.186270
INFO:root:Epoch[4] Train-Loss=1.255643
INFO:root:Epoch[4] Time cost=28.933
INFO:root:Saved checkpoint to "models/mix_fea/mix-0005.params"
INFO:root:Epoch[4] Validation-Loss=1.397605
INFO:root:Epoch[5] Batch [20] Speed: 1706.02 samples/sec Loss=1.210364
INFO:root:Epoch[5] Batch [40] Speed: 1638.66 samples/sec Loss=1.183044
INFO:root:Epoch[5] Batch [60] Speed: 1713.75 samples/sec Loss=1.213618
INFO:root:Epoch[5] Batch [80] Speed: 1833.31 samples/sec Loss=1.224581
INFO:root:Epoch[5] Batch [100] Speed: 2102.54 samples/sec Loss=1.215364
INFO:root:Epoch[5] Batch [120] Speed: 1960.24 samples/sec Loss=1.217689
INFO:root:Epoch[5] Batch [140] Speed: 1698.37 samples/sec Loss=1.196760
INFO:root:Epoch[5] Batch [160] Speed: 1653.96 samples/sec Loss=1.170355
INFO:root:Epoch[5] Batch [180] Speed: 1659.30 samples/sec Loss=1.187735
INFO:root:Epoch[5] Batch [200] Speed: 1645.30 samples/sec Loss=1.176425
INFO:root:Epoch[5] Batch [220] Speed: 1709.14 samples/sec Loss=1.145345
INFO:root:Epoch[5] Batch [240] Speed: 1709.72 samples/sec Loss=1.148074
INFO:root:Epoch[5] Batch [260] Speed: 1726.91 samples/sec Loss=1.187569
INFO:root:Epoch[5] Batch [280] Speed: 1711.41 samples/sec Loss=1.188729
INFO:root:Epoch[5] Batch [300] Speed: 1705.28 samples/sec Loss=1.177353
INFO:root:Epoch[5] Batch [320] Speed: 1700.69 samples/sec Loss=1.165245
INFO:root:Epoch[5] Batch [340] Speed: 1694.24 samples/sec Loss=1.136585
INFO:root:Epoch[5] Batch [360] Speed: 1698.50 samples/sec Loss=1.175162
INFO:root:Epoch[5] Batch [380] Speed: 1698.47 samples/sec Loss=1.124631
INFO:root:Epoch[5] Train-Loss=1.113684
INFO:root:Epoch[5] Time cost=28.852
INFO:root:Saved checkpoint to "models/mix_fea/mix-0006.params"
INFO:root:Epoch[5] Validation-Loss=1.114968
INFO:root:Epoch[6] Batch [20] Speed: 1641.38 samples/sec Loss=1.117856
INFO:root:Epoch[6] Batch [40] Speed: 1696.15 samples/sec Loss=1.165106
INFO:root:Epoch[6] Batch [60] Speed: 1692.38 samples/sec Loss=1.102825
INFO:root:Epoch[6] Batch [80] Speed: 1827.08 samples/sec Loss=1.141392
INFO:root:Epoch[6] Batch [100] Speed: 2028.87 samples/sec Loss=1.104093
INFO:root:Epoch[6] Batch [120] Speed: 1954.00 samples/sec Loss=1.081454
INFO:root:Epoch[6] Batch [140] Speed: 1692.97 samples/sec Loss=1.128632
INFO:root:Epoch[6] Batch [160] Speed: 1704.51 samples/sec Loss=1.117763
INFO:root:Epoch[6] Batch [180] Speed: 1690.19 samples/sec Loss=1.094110
INFO:root:Epoch[6] Batch [200] Speed: 1687.35 samples/sec Loss=1.168363
INFO:root:Epoch[6] Batch [220] Speed: 1696.49 samples/sec Loss=1.164877
INFO:root:Epoch[6] Batch [240] Speed: 1695.59 samples/sec Loss=1.161910
INFO:root:Epoch[6] Batch [260] Speed: 1689.92 samples/sec Loss=1.078956
INFO:root:Epoch[6] Batch [280] Speed: 1705.16 samples/sec Loss=1.155961
INFO:root:Epoch[6] Batch [300] Speed: 1694.10 samples/sec Loss=1.128947
INFO:root:Epoch[6] Batch [320] Speed: 1692.42 samples/sec Loss=1.099283
INFO:root:Epoch[6] Batch [340] Speed: 1702.98 samples/sec Loss=1.115255
INFO:root:Epoch[6] Batch [360] Speed: 1688.19 samples/sec Loss=1.134724
INFO:root:Epoch[6] Batch [380] Speed: 1697.44 samples/sec Loss=1.148301
INFO:root:Epoch[6] Train-Loss=1.156310
INFO:root:Epoch[6] Time cost=28.978
INFO:root:Saved checkpoint to "models/mix_fea/mix-0007.params"
INFO:root:Epoch[6] Validation-Loss=1.228702
INFO:root:Epoch[7] Batch [20] Speed: 1698.24 samples/sec Loss=1.097730
INFO:root:Epoch[7] Batch [40] Speed: 1698.70 samples/sec Loss=1.056224
INFO:root:Epoch[7] Batch [60] Speed: 1684.88 samples/sec Loss=1.098985
INFO:root:Epoch[7] Batch [80] Speed: 1816.04 samples/sec Loss=1.096162
INFO:root:Epoch[7] Batch [100] Speed: 2064.21 samples/sec Loss=1.064839
INFO:root:Epoch[7] Batch [120] Speed: 1934.83 samples/sec Loss=1.121684
INFO:root:Epoch[7] Batch [140] Speed: 1658.81 samples/sec Loss=1.116548
INFO:root:Epoch[7] Batch [160] Speed: 1700.99 samples/sec Loss=1.095276
INFO:root:Epoch[7] Batch [180] Speed: 1695.14 samples/sec Loss=1.078747
INFO:root:Epoch[7] Batch [200] Speed: 1700.93 samples/sec Loss=1.132792
INFO:root:Epoch[7] Batch [220] Speed: 1676.43 samples/sec Loss=1.058790
INFO:root:Epoch[7] Batch [240] Speed: 1700.91 samples/sec Loss=1.055334
INFO:root:Epoch[7] Batch [260] Speed: 1713.68 samples/sec Loss=1.095871
INFO:root:Epoch[7] Batch [280] Speed: 1692.42 samples/sec Loss=1.049170
INFO:root:Epoch[7] Batch [300] Speed: 1709.45 samples/sec Loss=1.070121
INFO:root:Epoch[7] Batch [320] Speed: 1704.46 samples/sec Loss=1.078264
INFO:root:Epoch[7] Batch [340] Speed: 1732.39 samples/sec Loss=1.092844
INFO:root:Epoch[7] Batch [360] Speed: 1724.84 samples/sec Loss=1.075855
INFO:root:Epoch[7] Batch [380] Speed: 1732.97 samples/sec Loss=1.062566
INFO:root:Epoch[7] Train-Loss=1.055736
INFO:root:Epoch[7] Time cost=28.748
INFO:root:Saved checkpoint to "models/mix_fea/mix-0008.params"
INFO:root:Epoch[7] Validation-Loss=1.424190
INFO:root:Epoch[8] Batch [20] Speed: 1687.05 samples/sec Loss=1.106926
INFO:root:Epoch[8] Batch [40] Speed: 1691.38 samples/sec Loss=1.069327
INFO:root:Epoch[8] Batch [60] Speed: 1699.02 samples/sec Loss=1.070936
INFO:root:Epoch[8] Batch [80] Speed: 1810.41 samples/sec Loss=1.092758
INFO:root:Epoch[8] Batch [100] Speed: 2055.35 samples/sec Loss=1.044780
INFO:root:Epoch[8] Batch [120] Speed: 1897.11 samples/sec Loss=1.091097
INFO:root:Epoch[8] Batch [140] Speed: 1690.58 samples/sec Loss=1.107955
INFO:root:Epoch[8] Batch [160] Speed: 1692.18 samples/sec Loss=1.070157
INFO:root:Epoch[8] Batch [180] Speed: 1692.92 samples/sec Loss=1.087290
INFO:root:Epoch[8] Batch [200] Speed: 1699.44 samples/sec Loss=1.081660
INFO:root:Epoch[8] Batch [220] Speed: 1696.40 samples/sec Loss=1.116648
INFO:root:Epoch[8] Batch [240] Speed: 1692.82 samples/sec Loss=1.048615
INFO:root:Epoch[8] Batch [260] Speed: 1699.58 samples/sec Loss=1.124306
INFO:root:Epoch[8] Batch [280] Speed: 1663.98 samples/sec Loss=1.106719
INFO:root:Epoch[8] Batch [300] Speed: 1706.06 samples/sec Loss=1.062290
INFO:root:Epoch[8] Batch [320] Speed: 1698.47 samples/sec Loss=1.029455
INFO:root:Epoch[8] Batch [340] Speed: 1689.04 samples/sec Loss=1.009736
INFO:root:Epoch[8] Batch [360] Speed: 1694.63 samples/sec Loss=1.096832
INFO:root:Epoch[8] Batch [380] Speed: 1694.12 samples/sec Loss=1.016116
INFO:root:Epoch[8] Train-Loss=1.059698
INFO:root:Epoch[8] Time cost=29.029
INFO:root:Saved checkpoint to "models/mix_fea/mix-0009.params"
INFO:root:Epoch[8] Validation-Loss=1.190530
INFO:root:Epoch[9] Batch [20] Speed: 1696.51 samples/sec Loss=1.041414
INFO:root:Epoch[9] Batch [40] Speed: 1698.38 samples/sec Loss=1.018341
INFO:root:Epoch[9] Batch [60] Speed: 1671.98 samples/sec Loss=1.081899
INFO:root:Epoch[9] Batch [80] Speed: 1821.85 samples/sec Loss=1.056749
INFO:root:Epoch[9] Batch [100] Speed: 2105.93 samples/sec Loss=1.021416
INFO:root:Epoch[9] Batch [120] Speed: 1947.96 samples/sec Loss=1.022903
INFO:root:Epoch[9] Batch [140] Speed: 1686.96 samples/sec Loss=1.012934
INFO:root:Epoch[9] Batch [160] Speed: 1667.78 samples/sec Loss=1.080944
INFO:root:Epoch[9] Batch [180] Speed: 1678.24 samples/sec Loss=1.041309
INFO:root:Epoch[9] Batch [200] Speed: 1622.07 samples/sec Loss=1.067377
INFO:root:Epoch[9] Batch [220] Speed: 1644.79 samples/sec Loss=1.050574
INFO:root:Epoch[9] Batch [240] Speed: 1646.66 samples/sec Loss=1.022525
INFO:root:Epoch[9] Batch [260] Speed: 1703.36 samples/sec Loss=1.018470
INFO:root:Epoch[9] Batch [280] Speed: 1705.14 samples/sec Loss=1.014920
INFO:root:Epoch[9] Batch [300] Speed: 1707.20 samples/sec Loss=1.055259
INFO:root:Epoch[9] Batch [320] Speed: 1694.20 samples/sec Loss=1.017534
INFO:root:Epoch[9] Batch [340] Speed: 1678.88 samples/sec Loss=1.037989
INFO:root:Epoch[9] Batch [360] Speed: 1698.06 samples/sec Loss=1.048951
INFO:root:Epoch[9] Batch [380] Speed: 1691.38 samples/sec Loss=1.006561
INFO:root:Update[3901]: Change learning rate to 7.00000e-02
INFO:root:Epoch[9] Train-Loss=1.007071
INFO:root:Epoch[9] Time cost=29.103
INFO:root:Saved checkpoint to "models/mix_fea/mix-0010.params"
INFO:root:Epoch[9] Validation-Loss=0.999033
INFO:root:Epoch[10] Batch [20] Speed: 1625.80 samples/sec Loss=1.049373
INFO:root:Epoch[10] Batch [40] Speed: 1690.88 samples/sec Loss=0.984471
INFO:root:Epoch[10] Batch [60] Speed: 1683.02 samples/sec Loss=0.945941
INFO:root:Epoch[10] Batch [80] Speed: 1855.25 samples/sec Loss=0.904650
INFO:root:Epoch[10] Batch [100] Speed: 2040.36 samples/sec Loss=0.857622
INFO:root:Epoch[10] Batch [120] Speed: 1918.73 samples/sec Loss=0.890267
INFO:root:Epoch[10] Batch [140] Speed: 1692.96 samples/sec Loss=0.850651
INFO:root:Epoch[10] Batch [160] Speed: 1646.38 samples/sec Loss=0.880184
INFO:root:Epoch[10] Batch [180] Speed: 1628.85 samples/sec Loss=0.834081
INFO:root:Epoch[10] Batch [200] Speed: 1623.97 samples/sec Loss=0.878393
INFO:root:Epoch[10] Batch [220] Speed: 1656.95 samples/sec Loss=0.848156
INFO:root:Epoch[10] Batch [240] Speed: 1695.84 samples/sec Loss=0.815126
INFO:root:Epoch[10] Batch [260] Speed: 1701.82 samples/sec Loss=0.860064
INFO:root:Epoch[10] Batch [280] Speed: 1685.48 samples/sec Loss=0.853054
INFO:root:Epoch[10] Batch [300] Speed: 1683.82 samples/sec Loss=0.832596
INFO:root:Epoch[10] Batch [320] Speed: 1702.36 samples/sec Loss=0.846564
INFO:root:Epoch[10] Batch [340] Speed: 1690.26 samples/sec Loss=0.800001
INFO:root:Epoch[10] Batch [360] Speed: 1707.51 samples/sec Loss=0.843713
INFO:root:Epoch[10] Batch [380] Speed: 1696.37 samples/sec Loss=0.815813
INFO:root:Epoch[10] Train-Loss=0.827751
INFO:root:Epoch[10] Time cost=29.132
INFO:root:Saved checkpoint to "models/mix_fea/mix-0011.params"
INFO:root:Epoch[10] Validation-Loss=0.674889
INFO:root:Epoch[11] Batch [20] Speed: 1614.93 samples/sec Loss=0.820689
INFO:root:Epoch[11] Batch [40] Speed: 1642.33 samples/sec Loss=0.801192
INFO:root:Epoch[11] Batch [60] Speed: 1701.96 samples/sec Loss=0.842271
INFO:root:Epoch[11] Batch [80] Speed: 1832.69 samples/sec Loss=0.844751
INFO:root:Epoch[11] Batch [100] Speed: 2091.98 samples/sec Loss=0.812979
INFO:root:Epoch[11] Batch [120] Speed: 1859.43 samples/sec Loss=0.830348
INFO:root:Epoch[11] Batch [140] Speed: 1616.42 samples/sec Loss=0.831898
INFO:root:Epoch[11] Batch [160] Speed: 1614.41 samples/sec Loss=0.823166
INFO:root:Epoch[11] Batch [180] Speed: 1691.65 samples/sec Loss=0.800227
INFO:root:Epoch[11] Batch [200] Speed: 1701.87 samples/sec Loss=0.856146
INFO:root:Epoch[11] Batch [220] Speed: 1698.39 samples/sec Loss=0.796619
INFO:root:Epoch[11] Batch [240] Speed: 1697.68 samples/sec Loss=0.802682
INFO:root:Epoch[11] Batch [260] Speed: 1697.55 samples/sec Loss=0.821631
INFO:root:Epoch[11] Batch [280] Speed: 1689.38 samples/sec Loss=0.801617
INFO:root:Epoch[11] Batch [300] Speed: 1697.44 samples/sec Loss=0.780813
INFO:root:Epoch[11] Batch [320] Speed: 1699.56 samples/sec Loss=0.754134
INFO:root:Epoch[11] Batch [340] Speed: 1696.30 samples/sec Loss=0.797534
INFO:root:Epoch[11] Batch [360] Speed: 1699.91 samples/sec Loss=0.755851
INFO:root:Epoch[11] Batch [380] Speed: 1691.30 samples/sec Loss=0.788171
INFO:root:Epoch[11] Train-Loss=0.798170
INFO:root:Epoch[11] Time cost=29.201
INFO:root:Saved checkpoint to "models/mix_fea/mix-0012.params"
INFO:root:Epoch[11] Validation-Loss=0.655343
INFO:root:Epoch[12] Batch [20] Speed: 1626.24 samples/sec Loss=0.788339
INFO:root:Epoch[12] Batch [40] Speed: 1689.08 samples/sec Loss=0.805368
INFO:root:Epoch[12] Batch [60] Speed: 1668.02 samples/sec Loss=0.792790
INFO:root:Epoch[12] Batch [80] Speed: 1831.59 samples/sec Loss=0.813603
INFO:root:Epoch[12] Batch [100] Speed: 2091.43 samples/sec Loss=0.810499
INFO:root:Epoch[12] Batch [120] Speed: 1916.65 samples/sec Loss=0.752794
INFO:root:Epoch[12] Batch [140] Speed: 1690.35 samples/sec Loss=0.766606
INFO:root:Epoch[12] Batch [160] Speed: 1697.31 samples/sec Loss=0.799726
INFO:root:Epoch[12] Batch [180] Speed: 1696.03 samples/sec Loss=0.792690
INFO:root:Epoch[12] Batch [200] Speed: 1701.76 samples/sec Loss=0.856331
INFO:root:Epoch[12] Batch [220] Speed: 1698.62 samples/sec Loss=0.763333
INFO:root:Epoch[12] Batch [240] Speed: 1687.80 samples/sec Loss=0.802268
INFO:root:Epoch[12] Batch [260] Speed: 1674.65 samples/sec Loss=0.772864
INFO:root:Epoch[12] Batch [280] Speed: 1687.24 samples/sec Loss=0.762111
INFO:root:Epoch[12] Batch [300] Speed: 1684.65 samples/sec Loss=0.785172
INFO:root:Epoch[12] Batch [320] Speed: 1696.05 samples/sec Loss=0.754216
INFO:root:Epoch[12] Batch [340] Speed: 1701.00 samples/sec Loss=0.733581
INFO:root:Epoch[12] Batch [360] Speed: 1692.95 samples/sec Loss=0.740007
INFO:root:Epoch[12] Batch [380] Speed: 1697.05 samples/sec Loss=0.770990
INFO:root:Epoch[12] Train-Loss=0.783386
INFO:root:Epoch[12] Time cost=29.027
INFO:root:Saved checkpoint to "models/mix_fea/mix-0013.params"
INFO:root:Epoch[12] Validation-Loss=0.648220
INFO:root:Epoch[13] Batch [20] Speed: 1675.08 samples/sec Loss=0.764103
INFO:root:Epoch[13] Batch [40] Speed: 1696.65 samples/sec Loss=0.767436
INFO:root:Epoch[13] Batch [60] Speed: 1705.90 samples/sec Loss=0.786005
INFO:root:Epoch[13] Batch [80] Speed: 1822.93 samples/sec Loss=0.779882
INFO:root:Epoch[13] Batch [100] Speed: 2080.39 samples/sec Loss=0.769702
INFO:root:Epoch[13] Batch [120] Speed: 1949.97 samples/sec Loss=0.753283
INFO:root:Epoch[13] Batch [140] Speed: 1710.35 samples/sec Loss=0.790569
INFO:root:Epoch[13] Batch [160] Speed: 1724.77 samples/sec Loss=0.791628
INFO:root:Epoch[13] Batch [180] Speed: 1671.88 samples/sec Loss=0.787548
INFO:root:Epoch[13] Batch [200] Speed: 1720.19 samples/sec Loss=0.811107
INFO:root:Epoch[13] Batch [220] Speed: 1695.06 samples/sec Loss=0.795252
INFO:root:Epoch[13] Batch [240] Speed: 1690.89 samples/sec Loss=0.772809
INFO:root:Epoch[13] Batch [260] Speed: 1695.16 samples/sec Loss=0.756817
INFO:root:Epoch[13] Batch [280] Speed: 1697.09 samples/sec Loss=0.786422
INFO:root:Epoch[13] Batch [300] Speed: 1689.69 samples/sec Loss=0.762851
INFO:root:Epoch[13] Batch [320] Speed: 1697.50 samples/sec Loss=0.742196
INFO:root:Epoch[13] Batch [340] Speed: 1689.07 samples/sec Loss=0.762581
INFO:root:Epoch[13] Batch [360] Speed: 1697.83 samples/sec Loss=0.791941
INFO:root:Epoch[13] Batch [380] Speed: 1696.25 samples/sec Loss=0.756376
INFO:root:Epoch[13] Train-Loss=0.797623
INFO:root:Epoch[13] Time cost=28.813
INFO:root:Saved checkpoint to "models/mix_fea/mix-0014.params"
INFO:root:Epoch[13] Validation-Loss=0.639030
INFO:root:Epoch[14] Batch [20] Speed: 1693.42 samples/sec Loss=0.775607
INFO:root:Epoch[14] Batch [40] Speed: 1696.49 samples/sec Loss=0.758546
INFO:root:Epoch[14] Batch [60] Speed: 1694.31 samples/sec Loss=0.803566
INFO:root:Epoch[14] Batch [80] Speed: 1815.07 samples/sec Loss=0.792552
INFO:root:Epoch[14] Batch [100] Speed: 2042.79 samples/sec Loss=0.787184
INFO:root:Epoch[14] Batch [120] Speed: 1982.05 samples/sec Loss=0.762900
INFO:root:Epoch[14] Batch [140] Speed: 1649.84 samples/sec Loss=0.776056
INFO:root:Epoch[14] Batch [160] Speed: 1688.13 samples/sec Loss=0.769591
INFO:root:Epoch[14] Batch [180] Speed: 1697.38 samples/sec Loss=0.777960
INFO:root:Epoch[14] Batch [200] Speed: 1672.70 samples/sec Loss=0.772868
INFO:root:Epoch[14] Batch [220] Speed: 1696.94 samples/sec Loss=0.753191
INFO:root:Epoch[14] Batch [240] Speed: 1712.96 samples/sec Loss=0.742523
INFO:root:Epoch[14] Batch [260] Speed: 1615.05 samples/sec Loss=0.750750
INFO:root:Epoch[14] Batch [280] Speed: 1641.84 samples/sec Loss=0.728822
INFO:root:Epoch[14] Batch [300] Speed: 1711.76 samples/sec Loss=0.749570
INFO:root:Epoch[14] Batch [320] Speed: 1692.91 samples/sec Loss=0.736162
INFO:root:Epoch[14] Batch [340] Speed: 1697.74 samples/sec Loss=0.719189
INFO:root:Epoch[14] Batch [360] Speed: 1689.50 samples/sec Loss=0.739086
INFO:root:Epoch[14] Batch [380] Speed: 1693.42 samples/sec Loss=0.740452
INFO:root:Epoch[14] Train-Loss=0.789685
INFO:root:Epoch[14] Time cost=29.074
INFO:root:Saved checkpoint to "models/mix_fea/mix-0015.params"
INFO:root:Epoch[14] Validation-Loss=0.625337
INFO:root:Epoch[15] Batch [20] Speed: 1637.34 samples/sec Loss=0.758927
INFO:root:Epoch[15] Batch [40] Speed: 1665.46 samples/sec Loss=0.752880
INFO:root:Epoch[15] Batch [60] Speed: 1692.57 samples/sec Loss=0.776753
INFO:root:Epoch[15] Batch [80] Speed: 1819.33 samples/sec Loss=0.808012
INFO:root:Epoch[15] Batch [100] Speed: 2043.72 samples/sec Loss=0.764509
INFO:root:Epoch[15] Batch [120] Speed: 1941.79 samples/sec Loss=0.727940
INFO:root:Epoch[15] Batch [140] Speed: 1691.96 samples/sec Loss=0.730766
INFO:root:Epoch[15] Batch [160] Speed: 1691.41 samples/sec Loss=0.804400
INFO:root:Epoch[15] Batch [180] Speed: 1693.72 samples/sec Loss=0.739144
INFO:root:Epoch[15] Batch [200] Speed: 1682.70 samples/sec Loss=0.763643
INFO:root:Epoch[15] Batch [220] Speed: 1705.77 samples/sec Loss=0.730729
INFO:root:Epoch[15] Batch [240] Speed: 1702.14 samples/sec Loss=0.733182
INFO:root:Epoch[15] Batch [260] Speed: 1689.28 samples/sec Loss=0.746132
INFO:root:Epoch[15] Batch [280] Speed: 1682.01 samples/sec Loss=0.723854
INFO:root:Epoch[15] Batch [300] Speed: 1708.09 samples/sec Loss=0.756334
INFO:root:Epoch[15] Batch [320] Speed: 1678.98 samples/sec Loss=0.733023
INFO:root:Epoch[15] Batch [340] Speed: 1689.61 samples/sec Loss=0.741233
INFO:root:Epoch[15] Batch [360] Speed: 1704.40 samples/sec Loss=0.741051
INFO:root:Epoch[15] Batch [380] Speed: 1694.04 samples/sec Loss=0.753826
INFO:root:Epoch[15] Train-Loss=0.783302
INFO:root:Epoch[15] Time cost=28.965
INFO:root:Saved checkpoint to "models/mix_fea/mix-0016.params"
INFO:root:Epoch[15] Validation-Loss=0.659120
INFO:root:Epoch[16] Batch [20] Speed: 1695.86 samples/sec Loss=0.767110
INFO:root:Epoch[16] Batch [40] Speed: 1696.16 samples/sec Loss=0.723273
INFO:root:Epoch[16] Batch [60] Speed: 1691.35 samples/sec Loss=0.780921
INFO:root:Epoch[16] Batch [80] Speed: 1788.24 samples/sec Loss=0.773782
INFO:root:Epoch[16] Batch [100] Speed: 2067.14 samples/sec Loss=0.786181
INFO:root:Epoch[16] Batch [120] Speed: 2000.64 samples/sec Loss=0.719716
INFO:root:Epoch[16] Batch [140] Speed: 1690.01 samples/sec Loss=0.787285
INFO:root:Epoch[16] Batch [160] Speed: 1695.73 samples/sec Loss=0.709532
INFO:root:Epoch[16] Batch [180] Speed: 1705.21 samples/sec Loss=0.765173
INFO:root:Epoch[16] Batch [200] Speed: 1686.72 samples/sec Loss=0.777131
INFO:root:Epoch[16] Batch [220] Speed: 1690.99 samples/sec Loss=0.851625
INFO:root:Epoch[16] Batch [240] Speed: 1693.17 samples/sec Loss=0.813881
INFO:root:Epoch[16] Batch [260] Speed: 1691.83 samples/sec Loss=0.781065
INFO:root:Epoch[16] Batch [280] Speed: 1697.10 samples/sec Loss=0.734910
INFO:root:Epoch[16] Batch [300] Speed: 1696.95 samples/sec Loss=0.763062
INFO:root:Epoch[16] Batch [320] Speed: 1672.18 samples/sec Loss=0.735985
INFO:root:Epoch[16] Batch [340] Speed: 1618.04 samples/sec Loss=0.733593
INFO:root:Epoch[16] Batch [360] Speed: 1649.77 samples/sec Loss=0.749832
INFO:root:Epoch[16] Batch [380] Speed: 1696.18 samples/sec Loss=0.748307
INFO:root:Epoch[16] Train-Loss=0.756518
INFO:root:Epoch[16] Time cost=29.091
INFO:root:Saved checkpoint to "models/mix_fea/mix-0017.params"
INFO:root:Epoch[16] Validation-Loss=0.631677
INFO:root:Epoch[17] Batch [20] Speed: 1657.35 samples/sec Loss=0.743491
INFO:root:Epoch[17] Batch [40] Speed: 1714.73 samples/sec Loss=0.735191
INFO:root:Epoch[17] Batch [60] Speed: 1711.77 samples/sec Loss=0.759417
INFO:root:Epoch[17] Batch [80] Speed: 1853.42 samples/sec Loss=0.754945
INFO:root:Epoch[17] Batch [100] Speed: 2076.05 samples/sec Loss=0.750446
INFO:root:Epoch[17] Batch [120] Speed: 1923.45 samples/sec Loss=0.772489
INFO:root:Epoch[17] Batch [140] Speed: 1699.96 samples/sec Loss=0.737723
INFO:root:Epoch[17] Batch [160] Speed: 1687.77 samples/sec Loss=0.736202
INFO:root:Epoch[17] Batch [180] Speed: 1700.10 samples/sec Loss=0.730438
INFO:root:Epoch[17] Batch [200] Speed: 1685.59 samples/sec Loss=0.710522
INFO:root:Epoch[17] Batch [220] Speed: 1691.84 samples/sec Loss=0.745017
INFO:root:Epoch[17] Batch [240] Speed: 1707.61 samples/sec Loss=0.723250
INFO:root:Epoch[17] Batch [260] Speed: 1691.36 samples/sec Loss=0.730812
INFO:root:Epoch[17] Batch [280] Speed: 1685.76 samples/sec Loss=0.692039
INFO:root:Epoch[17] Batch [300] Speed: 1693.70 samples/sec Loss=0.733437
INFO:root:Epoch[17] Batch [320] Speed: 1702.28 samples/sec Loss=0.752127
INFO:root:Epoch[17] Batch [340] Speed: 1623.54 samples/sec Loss=0.727271
INFO:root:Epoch[17] Batch [360] Speed: 1681.04 samples/sec Loss=0.728669
INFO:root:Epoch[17] Batch [380] Speed: 1679.78 samples/sec Loss=0.772636
INFO:root:Epoch[17] Train-Loss=0.752886
INFO:root:Epoch[17] Time cost=28.999
INFO:root:Saved checkpoint to "models/mix_fea/mix-0018.params"
INFO:root:Epoch[17] Validation-Loss=0.662720
INFO:root:Epoch[18] Batch [20] Speed: 1697.44 samples/sec Loss=0.713888
INFO:root:Epoch[18] Batch [40] Speed: 1699.30 samples/sec Loss=0.719648
INFO:root:Epoch[18] Batch [60] Speed: 1695.54 samples/sec Loss=0.727141
INFO:root:Epoch[18] Batch [80] Speed: 1787.91 samples/sec Loss=0.715024
INFO:root:Epoch[18] Batch [100] Speed: 2054.18 samples/sec Loss=0.736031
INFO:root:Epoch[18] Batch [120] Speed: 1941.83 samples/sec Loss=0.724005
INFO:root:Epoch[18] Batch [140] Speed: 1702.77 samples/sec Loss=0.744496
INFO:root:Epoch[18] Batch [160] Speed: 1689.78 samples/sec Loss=0.729644
INFO:root:Epoch[18] Batch [180] Speed: 1698.22 samples/sec Loss=0.729391
INFO:root:Epoch[18] Batch [200] Speed: 1688.85 samples/sec Loss=0.740518
INFO:root:Epoch[18] Batch [220] Speed: 1674.11 samples/sec Loss=0.710808
INFO:root:Epoch[18] Batch [240] Speed: 1706.12 samples/sec Loss=0.707153
INFO:root:Epoch[18] Batch [260] Speed: 1627.29 samples/sec Loss=0.703426
INFO:root:Epoch[18] Batch [280] Speed: 1687.21 samples/sec Loss=0.693031
INFO:root:Epoch[18] Batch [300] Speed: 1699.63 samples/sec Loss=0.730502
INFO:root:Epoch[18] Batch [320] Speed: 1695.59 samples/sec Loss=0.705230
INFO:root:Epoch[18] Batch [340] Speed: 1697.99 samples/sec Loss=0.715043
INFO:root:Epoch[18] Batch [360] Speed: 1680.88 samples/sec Loss=0.689767
INFO:root:Epoch[18] Batch [380] Speed: 1699.09 samples/sec Loss=0.720224
INFO:root:Epoch[18] Train-Loss=0.732344
INFO:root:Epoch[18] Time cost=28.956
INFO:root:Saved checkpoint to "models/mix_fea/mix-0019.params"
INFO:root:Epoch[18] Validation-Loss=0.667745
INFO:root:Epoch[19] Batch [20] Speed: 1653.55 samples/sec Loss=0.694668
INFO:root:Epoch[19] Batch [40] Speed: 1641.35 samples/sec Loss=0.741075
INFO:root:Epoch[19] Batch [60] Speed: 1642.17 samples/sec Loss=0.730503
INFO:root:Epoch[19] Batch [80] Speed: 1820.20 samples/sec Loss=0.711226
INFO:root:Epoch[19] Batch [100] Speed: 2092.01 samples/sec Loss=0.746206
INFO:root:Epoch[19] Batch [120] Speed: 1957.09 samples/sec Loss=0.700596
INFO:root:Epoch[19] Batch [140] Speed: 1638.76 samples/sec Loss=0.715428
INFO:root:Epoch[19] Batch [160] Speed: 1628.17 samples/sec Loss=0.736596
INFO:root:Epoch[19] Batch [180] Speed: 1621.60 samples/sec Loss=0.754368
INFO:root:Epoch[19] Batch [200] Speed: 1661.32 samples/sec Loss=0.768532
INFO:root:Epoch[19] Batch [220] Speed: 1665.69 samples/sec Loss=0.694108
INFO:root:Epoch[19] Batch [240] Speed: 1708.53 samples/sec Loss=0.696240
INFO:root:Epoch[19] Batch [260] Speed: 1703.35 samples/sec Loss=0.720397
INFO:root:Epoch[19] Batch [280] Speed: 1712.63 samples/sec Loss=0.728303
INFO:root:Epoch[19] Batch [300] Speed: 1682.57 samples/sec Loss=0.703609
INFO:root:Epoch[19] Batch [320] Speed: 1696.76 samples/sec Loss=0.725788
INFO:root:Epoch[19] Batch [340] Speed: 1691.85 samples/sec Loss=0.699512
INFO:root:Epoch[19] Batch [360] Speed: 1702.57 samples/sec Loss=0.682553
INFO:root:Epoch[19] Batch [380] Speed: 1683.64 samples/sec Loss=0.683450
INFO:root:Epoch[19] Train-Loss=0.742961
INFO:root:Epoch[19] Time cost=29.248
INFO:root:Saved checkpoint to "models/mix_fea/mix-0020.params"
INFO:root:Epoch[19] Validation-Loss=0.626347
INFO:root:Epoch[20] Batch [20] Speed: 1692.65 samples/sec Loss=0.705663
INFO:root:Epoch[20] Batch [40] Speed: 1691.24 samples/sec Loss=0.702189
INFO:root:Epoch[20] Batch [60] Speed: 1691.91 samples/sec Loss=0.726146
INFO:root:Epoch[20] Batch [80] Speed: 1836.85 samples/sec Loss=0.716038
INFO:root:Epoch[20] Batch [100] Speed: 2067.35 samples/sec Loss=0.737173
INFO:root:Epoch[20] Batch [120] Speed: 1866.11 samples/sec Loss=0.727106
INFO:root:Epoch[20] Batch [140] Speed: 1643.73 samples/sec Loss=0.693911
INFO:root:Epoch[20] Batch [160] Speed: 1691.20 samples/sec Loss=0.724012
INFO:root:Epoch[20] Batch [180] Speed: 1698.55 samples/sec Loss=0.719589
INFO:root:Epoch[20] Batch [200] Speed: 1708.13 samples/sec Loss=0.747415
INFO:root:Epoch[20] Batch [220] Speed: 1709.13 samples/sec Loss=0.720259
INFO:root:Epoch[20] Batch [240] Speed: 1709.12 samples/sec Loss=0.706923
INFO:root:Epoch[20] Batch [260] Speed: 1699.35 samples/sec Loss=0.686078
INFO:root:Epoch[20] Batch [280] Speed: 1698.30 samples/sec Loss=0.731542
INFO:root:Epoch[20] Batch [300] Speed: 1686.61 samples/sec Loss=0.670887
INFO:root:Epoch[20] Batch [320] Speed: 1674.76 samples/sec Loss=0.686810
INFO:root:Epoch[20] Batch [340] Speed: 1719.25 samples/sec Loss=0.699454
INFO:root:Epoch[20] Batch [360] Speed: 1678.83 samples/sec Loss=0.714552
INFO:root:Epoch[20] Batch [380] Speed: 1691.62 samples/sec Loss=0.741672
INFO:root:Epoch[20] Train-Loss=0.739317
INFO:root:Epoch[20] Time cost=28.996
INFO:root:Saved checkpoint to "models/mix_fea/mix-0021.params"
INFO:root:Epoch[20] Validation-Loss=0.656672
INFO:root:Epoch[21] Batch [20] Speed: 1627.30 samples/sec Loss=0.695575
INFO:root:Epoch[21] Batch [40] Speed: 1625.50 samples/sec Loss=0.726868
INFO:root:Epoch[21] Batch [60] Speed: 1654.28 samples/sec Loss=0.677230
INFO:root:Epoch[21] Batch [80] Speed: 1874.50 samples/sec Loss=0.704510
INFO:root:Epoch[21] Batch [100] Speed: 2074.69 samples/sec Loss=0.722171
INFO:root:Epoch[21] Batch [120] Speed: 1926.14 samples/sec Loss=0.707476
INFO:root:Epoch[21] Batch [140] Speed: 1703.55 samples/sec Loss=0.708506
INFO:root:Epoch[21] Batch [160] Speed: 1656.04 samples/sec Loss=0.727059
INFO:root:Epoch[21] Batch [180] Speed: 1621.38 samples/sec Loss=0.692091
INFO:root:Epoch[21] Batch [200] Speed: 1617.12 samples/sec Loss=0.746019
INFO:root:Epoch[21] Batch [220] Speed: 1629.90 samples/sec Loss=0.686607
INFO:root:Epoch[21] Batch [240] Speed: 1667.20 samples/sec Loss=0.704334
INFO:root:Epoch[21] Batch [260] Speed: 1691.66 samples/sec Loss=0.694248
INFO:root:Epoch[21] Batch [280] Speed: 1702.56 samples/sec Loss=0.693097
INFO:root:Epoch[21] Batch [300] Speed: 1697.67 samples/sec Loss=0.659710
INFO:root:Epoch[21] Batch [320] Speed: 1678.70 samples/sec Loss=0.723238
INFO:root:Epoch[21] Batch [340] Speed: 1704.73 samples/sec Loss=0.690692
INFO:root:Epoch[21] Batch [360] Speed: 1709.06 samples/sec Loss=0.685605
INFO:root:Epoch[21] Batch [380] Speed: 1690.46 samples/sec Loss=0.695337
INFO:root:Epoch[21] Train-Loss=0.748976
INFO:root:Epoch[21] Time cost=29.216
INFO:root:Saved checkpoint to "models/mix_fea/mix-0022.params"
INFO:root:Epoch[21] Validation-Loss=0.596232
INFO:root:Epoch[22] Batch [20] Speed: 1678.05 samples/sec Loss=0.675384
INFO:root:Epoch[22] Batch [40] Speed: 1694.59 samples/sec Loss=0.740860
INFO:root:Epoch[22] Batch [60] Speed: 1708.90 samples/sec Loss=0.735282
INFO:root:Epoch[22] Batch [80] Speed: 1844.32 samples/sec Loss=0.706577
INFO:root:Epoch[22] Batch [100] Speed: 2059.55 samples/sec Loss=0.677651
INFO:root:Epoch[22] Batch [120] Speed: 1978.08 samples/sec Loss=0.707775
INFO:root:Epoch[22] Batch [140] Speed: 1719.15 samples/sec Loss=0.722023
INFO:root:Epoch[22] Batch [160] Speed: 1695.33 samples/sec Loss=0.700631
INFO:root:Epoch[22] Batch [180] Speed: 1695.77 samples/sec Loss=0.703315
INFO:root:Epoch[22] Batch [200] Speed: 1716.81 samples/sec Loss=0.743235
INFO:root:Epoch[22] Batch [220] Speed: 1664.25 samples/sec Loss=0.727042
INFO:root:Epoch[22] Batch [240] Speed: 1688.00 samples/sec Loss=0.703456
INFO:root:Epoch[22] Batch [260] Speed: 1688.19 samples/sec Loss=0.728383
INFO:root:Epoch[22] Batch [280] Speed: 1720.54 samples/sec Loss=0.725380
INFO:root:Epoch[22] Batch [300] Speed: 1617.75 samples/sec Loss=0.660810
INFO:root:Epoch[22] Batch [320] Speed: 1634.37 samples/sec Loss=0.684139
INFO:root:Epoch[22] Batch [340] Speed: 1703.37 samples/sec Loss=0.664144
INFO:root:Epoch[22] Batch [360] Speed: 1690.72 samples/sec Loss=0.685432
INFO:root:Epoch[22] Batch [380] Speed: 1700.32 samples/sec Loss=0.686117
INFO:root:Epoch[22] Train-Loss=0.685624
INFO:root:Epoch[22] Time cost=28.998
INFO:root:Saved checkpoint to "models/mix_fea/mix-0023.params"
INFO:root:Epoch[22] Validation-Loss=0.612604
INFO:root:Epoch[23] Batch [20] Speed: 1622.42 samples/sec Loss=0.661448
INFO:root:Epoch[23] Batch [40] Speed: 1640.24 samples/sec Loss=0.687903
INFO:root:Epoch[23] Batch [60] Speed: 1662.29 samples/sec Loss=0.683629
INFO:root:Epoch[23] Batch [80] Speed: 1861.77 samples/sec Loss=0.697054
INFO:root:Epoch[23] Batch [100] Speed: 2083.72 samples/sec Loss=0.699687
INFO:root:Epoch[23] Batch [120] Speed: 1928.66 samples/sec Loss=0.703735
INFO:root:Epoch[23] Batch [140] Speed: 1622.48 samples/sec Loss=0.682276
INFO:root:Epoch[23] Batch [160] Speed: 1708.10 samples/sec Loss=0.679596
INFO:root:Epoch[23] Batch [180] Speed: 1692.55 samples/sec Loss=0.669647
INFO:root:Epoch[23] Batch [200] Speed: 1681.01 samples/sec Loss=0.729389
INFO:root:Epoch[23] Batch [220] Speed: 1683.82 samples/sec Loss=0.709662
INFO:root:Epoch[23] Batch [240] Speed: 1714.44 samples/sec Loss=0.696654
INFO:root:Epoch[23] Batch [260] Speed: 1710.37 samples/sec Loss=0.710455
INFO:root:Epoch[23] Batch [280] Speed: 1699.61 samples/sec Loss=0.686959
INFO:root:Epoch[23] Batch [300] Speed: 1699.18 samples/sec Loss=0.724890
INFO:root:Epoch[23] Batch [320] Speed: 1685.10 samples/sec Loss=0.711691
INFO:root:Epoch[23] Batch [340] Speed: 1690.38 samples/sec Loss=0.681121
INFO:root:Epoch[23] Batch [360] Speed: 1694.12 samples/sec Loss=0.679860
INFO:root:Epoch[23] Batch [380] Speed: 1694.79 samples/sec Loss=0.685961
INFO:root:Epoch[23] Train-Loss=0.713983
INFO:root:Epoch[23] Time cost=29.012
INFO:root:Saved checkpoint to "models/mix_fea/mix-0024.params"
INFO:root:Epoch[23] Validation-Loss=0.631790
INFO:root:Epoch[24] Batch [20] Speed: 1658.95 samples/sec Loss=0.689453
INFO:root:Epoch[24] Batch [40] Speed: 1694.01 samples/sec Loss=0.697522
INFO:root:Epoch[24] Batch [60] Speed: 1698.35 samples/sec Loss=0.751796
INFO:root:Epoch[24] Batch [80] Speed: 1802.83 samples/sec Loss=0.716388
INFO:root:Epoch[24] Batch [100] Speed: 2057.48 samples/sec Loss=0.694875
INFO:root:Epoch[24] Batch [120] Speed: 1906.82 samples/sec Loss=0.650707
INFO:root:Epoch[24] Batch [140] Speed: 1632.18 samples/sec Loss=0.684041
INFO:root:Epoch[24] Batch [160] Speed: 1711.17 samples/sec Loss=0.698797
INFO:root:Epoch[24] Batch [180] Speed: 1691.25 samples/sec Loss=0.687494
INFO:root:Epoch[24] Batch [200] Speed: 1619.89 samples/sec Loss=0.694818
INFO:root:Epoch[24] Batch [220] Speed: 1622.58 samples/sec Loss=0.672738
INFO:root:Epoch[24] Batch [240] Speed: 1698.26 samples/sec Loss=0.634003
INFO:root:Epoch[24] Batch [260] Speed: 1694.03 samples/sec Loss=0.698426
INFO:root:Epoch[24] Batch [280] Speed: 1682.81 samples/sec Loss=0.689753
INFO:root:Epoch[24] Batch [300] Speed: 1696.57 samples/sec Loss=0.699961
INFO:root:Epoch[24] Batch [320] Speed: 1683.97 samples/sec Loss=0.668926
INFO:root:Epoch[24] Batch [340] Speed: 1648.40 samples/sec Loss=0.657455
INFO:root:Epoch[24] Batch [360] Speed: 1635.63 samples/sec Loss=0.671318
INFO:root:Epoch[24] Batch [380] Speed: 1630.70 samples/sec Loss=0.713570
INFO:root:Epoch[24] Train-Loss=0.654106
INFO:root:Epoch[24] Time cost=29.426
INFO:root:Saved checkpoint to "models/mix_fea/mix-0025.params"
INFO:root:Epoch[24] Validation-Loss=0.601206
INFO:root:Epoch[25] Batch [20] Speed: 1696.70 samples/sec Loss=0.680027
INFO:root:Epoch[25] Batch [40] Speed: 1706.29 samples/sec Loss=0.719482
INFO:root:Epoch[25] Batch [60] Speed: 1684.21 samples/sec Loss=0.681838
INFO:root:Epoch[25] Batch [80] Speed: 1782.69 samples/sec Loss=0.696510
INFO:root:Epoch[25] Batch [100] Speed: 2071.65 samples/sec Loss=0.664717
INFO:root:Epoch[25] Batch [120] Speed: 1968.32 samples/sec Loss=0.686726
INFO:root:Epoch[25] Batch [140] Speed: 1699.12 samples/sec Loss=0.714033
INFO:root:Epoch[25] Batch [160] Speed: 1681.09 samples/sec Loss=0.701867
INFO:root:Epoch[25] Batch [180] Speed: 1695.53 samples/sec Loss=0.692642
INFO:root:Epoch[25] Batch [200] Speed: 1705.85 samples/sec Loss=0.688273
INFO:root:Epoch[25] Batch [220] Speed: 1694.77 samples/sec Loss=0.700045
INFO:root:Epoch[25] Batch [240] Speed: 1689.59 samples/sec Loss=0.698230
INFO:root:Epoch[25] Batch [260] Speed: 1696.69 samples/sec Loss=0.741443
INFO:root:Epoch[25] Batch [280] Speed: 1685.46 samples/sec Loss=0.659109
INFO:root:Epoch[25] Batch [300] Speed: 1708.07 samples/sec Loss=0.677602
INFO:root:Epoch[25] Batch [320] Speed: 1705.39 samples/sec Loss=0.650724
INFO:root:Epoch[25] Batch [340] Speed: 1685.88 samples/sec Loss=0.661588
INFO:root:Epoch[25] Batch [360] Speed: 1676.91 samples/sec Loss=0.679268
INFO:root:Epoch[25] Batch [380] Speed: 1701.92 samples/sec Loss=0.671275
INFO:root:Epoch[25] Train-Loss=0.679022
INFO:root:Epoch[25] Time cost=28.940
INFO:root:Saved checkpoint to "models/mix_fea/mix-0026.params"
INFO:root:Epoch[25] Validation-Loss=0.624186
INFO:root:Epoch[26] Batch [20] Speed: 1624.22 samples/sec Loss=0.697031
INFO:root:Epoch[26] Batch [40] Speed: 1700.88 samples/sec Loss=0.646779
INFO:root:Epoch[26] Batch [60] Speed: 1691.73 samples/sec Loss=0.688437
INFO:root:Epoch[26] Batch [80] Speed: 1790.96 samples/sec Loss=0.688120
INFO:root:Epoch[26] Batch [100] Speed: 2101.13 samples/sec Loss=0.694783
INFO:root:Epoch[26] Batch [120] Speed: 2000.89 samples/sec Loss=0.692840
INFO:root:Epoch[26] Batch [140] Speed: 1625.74 samples/sec Loss=0.692411
INFO:root:Epoch[26] Batch [160] Speed: 1649.14 samples/sec Loss=0.665107
INFO:root:Epoch[26] Batch [180] Speed: 1709.47 samples/sec Loss=0.693563
INFO:root:Epoch[26] Batch [200] Speed: 1692.93 samples/sec Loss=0.713885
INFO:root:Epoch[26] Batch [220] Speed: 1692.81 samples/sec Loss=0.680432
INFO:root:Epoch[26] Batch [240] Speed: 1701.77 samples/sec Loss=0.644118
INFO:root:Epoch[26] Batch [260] Speed: 1693.70 samples/sec Loss=0.678251
INFO:root:Epoch[26] Batch [280] Speed: 1623.33 samples/sec Loss=0.677284
INFO:root:Epoch[26] Batch [300] Speed: 1652.99 samples/sec Loss=0.666286
INFO:root:Epoch[26] Batch [320] Speed: 1695.68 samples/sec Loss=0.705580
INFO:root:Epoch[26] Batch [340] Speed: 1699.38 samples/sec Loss=0.655937
INFO:root:Epoch[26] Batch [360] Speed: 1697.38 samples/sec Loss=0.673340
INFO:root:Epoch[26] Batch [380] Speed: 1691.28 samples/sec Loss=0.684378
INFO:root:Epoch[26] Train-Loss=0.727177
INFO:root:Epoch[26] Time cost=29.064
INFO:root:Saved checkpoint to "models/mix_fea/mix-0027.params"
INFO:root:Epoch[26] Validation-Loss=0.638573
INFO:root:Epoch[27] Batch [20] Speed: 1672.96 samples/sec Loss=0.667649
INFO:root:Epoch[27] Batch [40] Speed: 1699.57 samples/sec Loss=0.652997
INFO:root:Epoch[27] Batch [60] Speed: 1683.02 samples/sec Loss=0.667175
INFO:root:Epoch[27] Batch [80] Speed: 1768.80 samples/sec Loss=0.692402
INFO:root:Epoch[27] Batch [100] Speed: 2118.78 samples/sec Loss=0.671171
INFO:root:Epoch[27] Batch [120] Speed: 1950.51 samples/sec Loss=0.659268
INFO:root:Epoch[27] Batch [140] Speed: 1718.37 samples/sec Loss=0.683172
INFO:root:Epoch[27] Batch [160] Speed: 1678.95 samples/sec Loss=0.677900
INFO:root:Epoch[27] Batch [180] Speed: 1706.68 samples/sec Loss=0.689319
INFO:root:Epoch[27] Batch [200] Speed: 1687.32 samples/sec Loss=0.717881
INFO:root:Epoch[27] Batch [220] Speed: 1699.69 samples/sec Loss=0.682097
INFO:root:Epoch[27] Batch [240] Speed: 1689.38 samples/sec Loss=0.662905
INFO:root:Epoch[27] Batch [260] Speed: 1693.56 samples/sec Loss=0.669585
INFO:root:Epoch[27] Batch [280] Speed: 1700.86 samples/sec Loss=0.679386
INFO:root:Epoch[27] Batch [300] Speed: 1692.13 samples/sec Loss=0.703235
INFO:root:Epoch[27] Batch [320] Speed: 1693.36 samples/sec Loss=0.655816
INFO:root:Epoch[27] Batch [340] Speed: 1701.00 samples/sec Loss=0.670540
INFO:root:Epoch[27] Batch [360] Speed: 1687.17 samples/sec Loss=0.681602
INFO:root:Epoch[27] Batch [380] Speed: 1694.76 samples/sec Loss=0.682232
INFO:root:Epoch[27] Train-Loss=0.681773
INFO:root:Epoch[27] Time cost=28.939
INFO:root:Saved checkpoint to "models/mix_fea/mix-0028.params"
INFO:root:Epoch[27] Validation-Loss=0.608909
INFO:root:Epoch[28] Batch [20] Speed: 1696.57 samples/sec Loss=0.688234
INFO:root:Epoch[28] Batch [40] Speed: 1692.38 samples/sec Loss=0.679841
INFO:root:Epoch[28] Batch [60] Speed: 1672.99 samples/sec Loss=0.670005
INFO:root:Epoch[28] Batch [80] Speed: 1772.82 samples/sec Loss=0.677103
INFO:root:Epoch[28] Batch [100] Speed: 2054.61 samples/sec Loss=0.681597
INFO:root:Epoch[28] Batch [120] Speed: 1992.80 samples/sec Loss=0.700671
INFO:root:Epoch[28] Batch [140] Speed: 1685.42 samples/sec Loss=0.693509
INFO:root:Epoch[28] Batch [160] Speed: 1707.27 samples/sec Loss=0.645022
INFO:root:Epoch[28] Batch [180] Speed: 1693.19 samples/sec Loss=0.709963
INFO:root:Epoch[28] Batch [200] Speed: 1695.61 samples/sec Loss=0.663056
INFO:root:Epoch[28] Batch [220] Speed: 1691.53 samples/sec Loss=0.680190
INFO:root:Epoch[28] Batch [240] Speed: 1692.08 samples/sec Loss=0.669562
INFO:root:Epoch[28] Batch [260] Speed: 1695.38 samples/sec Loss=0.689996
INFO:root:Epoch[28] Batch [280] Speed: 1688.57 samples/sec Loss=0.640797
INFO:root:Epoch[28] Batch [300] Speed: 1692.13 samples/sec Loss=0.669658
INFO:root:Epoch[28] Batch [320] Speed: 1691.75 samples/sec Loss=0.658348
INFO:root:Epoch[28] Batch [340] Speed: 1693.39 samples/sec Loss=0.696295
INFO:root:Epoch[28] Batch [360] Speed: 1688.57 samples/sec Loss=0.661520
INFO:root:Epoch[28] Batch [380] Speed: 1695.75 samples/sec Loss=0.719091
INFO:root:Epoch[28] Train-Loss=0.655427
INFO:root:Epoch[28] Time cost=28.979
INFO:root:Saved checkpoint to "models/mix_fea/mix-0029.params"
INFO:root:Epoch[28] Validation-Loss=0.772119
INFO:root:Epoch[29] Batch [20] Speed: 1668.88 samples/sec Loss=0.700205
INFO:root:Epoch[29] Batch [40] Speed: 1688.92 samples/sec Loss=0.661703
INFO:root:Epoch[29] Batch [60] Speed: 1703.71 samples/sec Loss=0.639576
INFO:root:Epoch[29] Batch [80] Speed: 1796.65 samples/sec Loss=0.661166
INFO:root:Epoch[29] Batch [100] Speed: 2054.89 samples/sec Loss=0.660851
INFO:root:Epoch[29] Batch [120] Speed: 2027.84 samples/sec Loss=0.701477
INFO:root:Epoch[29] Batch [140] Speed: 1646.46 samples/sec Loss=0.683491
INFO:root:Epoch[29] Batch [160] Speed: 1632.92 samples/sec Loss=0.650140
INFO:root:Epoch[29] Batch [180] Speed: 1626.87 samples/sec Loss=0.669996
INFO:root:Epoch[29] Batch [200] Speed: 1664.56 samples/sec Loss=0.697929
INFO:root:Epoch[29] Batch [220] Speed: 1701.71 samples/sec Loss=0.630585
INFO:root:Epoch[29] Batch [240] Speed: 1694.30 samples/sec Loss=0.635482
INFO:root:Epoch[29] Batch [260] Speed: 1692.20 samples/sec Loss=0.662427
INFO:root:Epoch[29] Batch [280] Speed: 1701.04 samples/sec Loss=0.639233
INFO:root:Epoch[29] Batch [300] Speed: 1682.42 samples/sec Loss=0.658952
INFO:root:Epoch[29] Batch [320] Speed: 1693.11 samples/sec Loss=0.665498
INFO:root:Epoch[29] Batch [340] Speed: 1693.52 samples/sec Loss=0.685536
INFO:root:Epoch[29] Batch [360] Speed: 1684.29 samples/sec Loss=0.623076
INFO:root:Epoch[29] Batch [380] Speed: 1691.46 samples/sec Loss=0.696735
INFO:root:Epoch[29] Train-Loss=0.650868
INFO:root:Epoch[29] Time cost=29.046
INFO:root:Saved checkpoint to "models/mix_fea/mix-0030.params"
INFO:root:Epoch[29] Validation-Loss=0.622229
INFO:root:Epoch[30] Batch [20] Speed: 1630.04 samples/sec Loss=0.620051
INFO:root:Epoch[30] Batch [40] Speed: 1609.46 samples/sec Loss=0.643939
INFO:root:Epoch[30] Batch [60] Speed: 1711.80 samples/sec Loss=0.660487
INFO:root:Epoch[30] Batch [80] Speed: 1785.77 samples/sec Loss=0.678359
INFO:root:Epoch[30] Batch [100] Speed: 2085.51 samples/sec Loss=0.687786
INFO:root:Epoch[30] Batch [120] Speed: 2045.25 samples/sec Loss=0.708377
INFO:root:Epoch[30] Batch [140] Speed: 1625.22 samples/sec Loss=0.658957
INFO:root:Epoch[30] Batch [160] Speed: 1687.96 samples/sec Loss=0.681528
INFO:root:Epoch[30] Batch [180] Speed: 1695.36 samples/sec Loss=0.661897
INFO:root:Epoch[30] Batch [200] Speed: 1697.62 samples/sec Loss=0.714848
INFO:root:Epoch[30] Batch [220] Speed: 1685.86 samples/sec Loss=0.638463
INFO:root:Epoch[30] Batch [240] Speed: 1695.50 samples/sec Loss=0.661587
INFO:root:Epoch[30] Batch [260] Speed: 1689.01 samples/sec Loss=0.670346
INFO:root:Epoch[30] Batch [280] Speed: 1699.71 samples/sec Loss=0.685304
INFO:root:Epoch[30] Batch [300] Speed: 1685.01 samples/sec Loss=0.652445
INFO:root:Epoch[30] Batch [320] Speed: 1691.20 samples/sec Loss=0.693281
INFO:root:Epoch[30] Batch [340] Speed: 1693.01 samples/sec Loss=0.648428
INFO:root:Epoch[30] Batch [360] Speed: 1696.74 samples/sec Loss=0.667455
INFO:root:Epoch[30] Batch [380] Speed: 1693.14 samples/sec Loss=0.657181
INFO:root:Epoch[30] Train-Loss=0.658069
INFO:root:Epoch[30] Time cost=29.084
INFO:root:Saved checkpoint to "models/mix_fea/mix-0031.params"
INFO:root:Epoch[30] Validation-Loss=0.670734
INFO:root:Epoch[31] Batch [20] Speed: 1700.99 samples/sec Loss=0.679096
INFO:root:Epoch[31] Batch [40] Speed: 1676.72 samples/sec Loss=0.665641
INFO:root:Epoch[31] Batch [60] Speed: 1713.48 samples/sec Loss=0.643161
INFO:root:Epoch[31] Batch [80] Speed: 1720.66 samples/sec Loss=0.641013
INFO:root:Epoch[31] Batch [100] Speed: 2072.31 samples/sec Loss=0.648376
INFO:root:Epoch[31] Batch [120] Speed: 2046.67 samples/sec Loss=0.674061
INFO:root:Epoch[31] Batch [140] Speed: 1691.52 samples/sec Loss=0.665462
INFO:root:Epoch[31] Batch [160] Speed: 1687.89 samples/sec Loss=0.698083
INFO:root:Epoch[31] Batch [180] Speed: 1709.85 samples/sec Loss=0.643757
INFO:root:Epoch[31] Batch [200] Speed: 1688.52 samples/sec Loss=0.672625
INFO:root:Epoch[31] Batch [220] Speed: 1685.51 samples/sec Loss=0.662512
INFO:root:Epoch[31] Batch [240] Speed: 1695.99 samples/sec Loss=0.655898
INFO:root:Epoch[31] Batch [260] Speed: 1691.76 samples/sec Loss=0.627041
INFO:root:Epoch[31] Batch [280] Speed: 1690.40 samples/sec Loss=0.660882
INFO:root:Epoch[31] Batch [300] Speed: 1692.56 samples/sec Loss=0.663212
INFO:root:Epoch[31] Batch [320] Speed: 1689.79 samples/sec Loss=0.650548
INFO:root:Epoch[31] Batch [340] Speed: 1656.46 samples/sec Loss=0.650276
INFO:root:Epoch[31] Batch [360] Speed: 1679.89 samples/sec Loss=0.665664
INFO:root:Epoch[31] Batch [380] Speed: 1700.79 samples/sec Loss=0.670582
INFO:root:Epoch[31] Train-Loss=0.666934
INFO:root:Epoch[31] Time cost=28.923
INFO:root:Saved checkpoint to "models/mix_fea/mix-0032.params"
INFO:root:Epoch[31] Validation-Loss=0.591362
INFO:root:Epoch[32] Batch [20] Speed: 1619.93 samples/sec Loss=0.654936
INFO:root:Epoch[32] Batch [40] Speed: 1611.40 samples/sec Loss=0.642183
INFO:root:Epoch[32] Batch [60] Speed: 1689.26 samples/sec Loss=0.706942
INFO:root:Epoch[32] Batch [80] Speed: 1711.56 samples/sec Loss=0.643054
INFO:root:Epoch[32] Batch [100] Speed: 1908.10 samples/sec Loss=0.683075
INFO:root:Epoch[32] Batch [120] Speed: 1707.60 samples/sec Loss=0.661458
INFO:root:Epoch[32] Batch [140] Speed: 1130.55 samples/sec Loss=0.618599
INFO:root:Epoch[32] Batch [160] Speed: 1010.71 samples/sec Loss=0.668418
INFO:root:Epoch[32] Batch [180] Speed: 1011.19 samples/sec Loss=0.665050
INFO:root:Epoch[32] Batch [200] Speed: 1655.34 samples/sec Loss=0.691922
INFO:root:Epoch[32] Batch [220] Speed: 1700.23 samples/sec Loss=0.667956
INFO:root:Epoch[32] Batch [240] Speed: 1690.86 samples/sec Loss=0.646644
INFO:root:Epoch[32] Batch [260] Speed: 1699.32 samples/sec Loss=0.669793
INFO:root:Epoch[32] Batch [280] Speed: 1565.94 samples/sec Loss=0.686150
INFO:root:Epoch[32] Batch [300] Speed: 1689.80 samples/sec Loss=0.675533
INFO:root:Epoch[32] Batch [320] Speed: 1693.65 samples/sec Loss=0.670149
INFO:root:Epoch[32] Batch [340] Speed: 1696.75 samples/sec Loss=0.650204
INFO:root:Epoch[32] Batch [360] Speed: 1699.27 samples/sec Loss=0.649933
INFO:root:Epoch[32] Batch [380] Speed: 1693.61 samples/sec Loss=0.699751
INFO:root:Epoch[32] Train-Loss=0.683276
INFO:root:Epoch[32] Time cost=32.456
INFO:root:Saved checkpoint to "models/mix_fea/mix-0033.params"
INFO:root:Epoch[32] Validation-Loss=0.621694
INFO:root:Epoch[33] Batch [20] Speed: 1693.27 samples/sec Loss=0.641814
INFO:root:Epoch[33] Batch [40] Speed: 1694.28 samples/sec Loss=0.615453
INFO:root:Epoch[33] Batch [60] Speed: 1700.00 samples/sec Loss=0.680181
INFO:root:Epoch[33] Batch [80] Speed: 1764.62 samples/sec Loss=0.676643
INFO:root:Epoch[33] Batch [100] Speed: 2058.38 samples/sec Loss=0.669817
INFO:root:Epoch[33] Batch [120] Speed: 1930.22 samples/sec Loss=0.657667
INFO:root:Epoch[33] Batch [140] Speed: 1705.32 samples/sec Loss=0.678083
INFO:root:Epoch[33] Batch [160] Speed: 1687.49 samples/sec Loss=0.682331
INFO:root:Epoch[33] Batch [180] Speed: 1701.08 samples/sec Loss=0.669482
INFO:root:Epoch[33] Batch [200] Speed: 1702.32 samples/sec Loss=0.656716
INFO:root:Epoch[33] Batch [220] Speed: 1693.63 samples/sec Loss=0.685348
INFO:root:Epoch[33] Batch [240] Speed: 1697.50 samples/sec Loss=0.655514
INFO:root:Epoch[33] Batch [260] Speed: 1579.13 samples/sec Loss=0.655513
INFO:root:Epoch[33] Batch [280] Speed: 972.06 samples/sec Loss=0.684561
INFO:root:Epoch[33] Batch [300] Speed: 1576.50 samples/sec Loss=0.673750
INFO:root:Epoch[33] Batch [320] Speed: 1709.39 samples/sec Loss=0.611800
INFO:root:Epoch[33] Batch [340] Speed: 1709.92 samples/sec Loss=0.658903
INFO:root:Epoch[33] Batch [360] Speed: 1689.84 samples/sec Loss=0.635312
INFO:root:Epoch[33] Batch [380] Speed: 1692.57 samples/sec Loss=0.688668
INFO:root:Epoch[33] Train-Loss=0.624650
INFO:root:Epoch[33] Time cost=30.287
INFO:root:Saved checkpoint to "models/mix_fea/mix-0034.params"
INFO:root:Epoch[33] Validation-Loss=0.671861
INFO:root:Epoch[34] Batch [20] Speed: 1701.05 samples/sec Loss=0.648660
INFO:root:Epoch[34] Batch [40] Speed: 1697.93 samples/sec Loss=0.685181
INFO:root:Epoch[34] Batch [60] Speed: 1698.54 samples/sec Loss=0.689704
INFO:root:Epoch[34] Batch [80] Speed: 1774.87 samples/sec Loss=0.647753
INFO:root:Epoch[34] Batch [100] Speed: 2039.03 samples/sec Loss=0.659090
INFO:root:Epoch[34] Batch [120] Speed: 1973.62 samples/sec Loss=0.648026
INFO:root:Epoch[34] Batch [140] Speed: 1695.86 samples/sec Loss=0.624575
INFO:root:Epoch[34] Batch [160] Speed: 1706.04 samples/sec Loss=0.684811
INFO:root:Epoch[34] Batch [180] Speed: 1684.84 samples/sec Loss=0.658876
INFO:root:Epoch[34] Batch [200] Speed: 1693.34 samples/sec Loss=0.701267
INFO:root:Epoch[34] Batch [220] Speed: 1690.53 samples/sec Loss=0.650432
INFO:root:Epoch[34] Batch [240] Speed: 1690.62 samples/sec Loss=0.658806
INFO:root:Epoch[34] Batch [260] Speed: 1719.39 samples/sec Loss=0.652977
INFO:root:Epoch[34] Batch [280] Speed: 1664.93 samples/sec Loss=0.639646
INFO:root:Epoch[34] Batch [300] Speed: 1693.93 samples/sec Loss=0.655741
INFO:root:Epoch[34] Batch [320] Speed: 1692.62 samples/sec Loss=0.641260
INFO:root:Epoch[34] Batch [340] Speed: 1697.75 samples/sec Loss=0.614660
INFO:root:Epoch[34] Batch [360] Speed: 1688.85 samples/sec Loss=0.620759
INFO:root:Epoch[34] Batch [380] Speed: 1696.46 samples/sec Loss=0.608895
INFO:root:Epoch[34] Train-Loss=0.685577
INFO:root:Epoch[34] Time cost=28.879
INFO:root:Saved checkpoint to "models/mix_fea/mix-0035.params"
INFO:root:Epoch[34] Validation-Loss=0.560175
INFO:root:Epoch[35] Batch [20] Speed: 1634.86 samples/sec Loss=0.664646
INFO:root:Epoch[35] Batch [40] Speed: 1678.79 samples/sec Loss=0.644677
INFO:root:Epoch[35] Batch [60] Speed: 1695.50 samples/sec Loss=0.653910
INFO:root:Epoch[35] Batch [80] Speed: 1751.25 samples/sec Loss=0.662360
INFO:root:Epoch[35] Batch [100] Speed: 2088.24 samples/sec Loss=0.652740
INFO:root:Epoch[35] Batch [120] Speed: 1980.47 samples/sec Loss=0.617601
INFO:root:Epoch[35] Batch [140] Speed: 1713.45 samples/sec Loss=0.626720
INFO:root:Epoch[35] Batch [160] Speed: 1689.17 samples/sec Loss=0.613352
INFO:root:Epoch[35] Batch [180] Speed: 1695.71 samples/sec Loss=0.670124
INFO:root:Epoch[35] Batch [200] Speed: 1696.29 samples/sec Loss=0.666978
INFO:root:Epoch[35] Batch [220] Speed: 1689.82 samples/sec Loss=0.658070
INFO:root:Epoch[35] Batch [240] Speed: 1693.65 samples/sec Loss=0.639297
INFO:root:Epoch[35] Batch [260] Speed: 1693.96 samples/sec Loss=0.650341
INFO:root:Epoch[35] Batch [280] Speed: 1683.80 samples/sec Loss=0.640014
INFO:root:Epoch[35] Batch [300] Speed: 1689.96 samples/sec Loss=0.659351
INFO:root:Epoch[35] Batch [320] Speed: 1692.51 samples/sec Loss=0.640539
INFO:root:Epoch[35] Batch [340] Speed: 1631.16 samples/sec Loss=0.629481
INFO:root:Epoch[35] Batch [360] Speed: 1689.11 samples/sec Loss=0.648914
INFO:root:Epoch[35] Batch [380] Speed: 1707.43 samples/sec Loss=0.664212
INFO:root:Epoch[35] Train-Loss=0.635961
INFO:root:Epoch[35] Time cost=29.072
INFO:root:Saved checkpoint to "models/mix_fea/mix-0036.params"
INFO:root:Epoch[35] Validation-Loss=0.603857
INFO:root:Epoch[36] Batch [20] Speed: 1693.65 samples/sec Loss=0.615633
INFO:root:Epoch[36] Batch [40] Speed: 1688.99 samples/sec Loss=0.620969
INFO:root:Epoch[36] Batch [60] Speed: 1705.77 samples/sec Loss=0.680668
INFO:root:Epoch[36] Batch [80] Speed: 1716.18 samples/sec Loss=0.656802
INFO:root:Epoch[36] Batch [100] Speed: 2080.77 samples/sec Loss=0.681207
INFO:root:Epoch[36] Batch [120] Speed: 1808.92 samples/sec Loss=0.646634
INFO:root:Epoch[36] Batch [140] Speed: 947.26 samples/sec Loss=0.663062
INFO:root:Epoch[36] Batch [160] Speed: 1631.77 samples/sec Loss=0.640583
INFO:root:Epoch[36] Batch [180] Speed: 1644.99 samples/sec Loss=0.643419
INFO:root:Epoch[36] Batch [200] Speed: 1632.26 samples/sec Loss=0.634032
INFO:root:Epoch[36] Batch [220] Speed: 1621.81 samples/sec Loss=0.669367
INFO:root:Epoch[36] Batch [240] Speed: 1663.44 samples/sec Loss=0.626889
INFO:root:Epoch[36] Batch [260] Speed: 1625.68 samples/sec Loss=0.635538
INFO:root:Epoch[36] Batch [280] Speed: 1640.36 samples/sec Loss=0.650623
INFO:root:Epoch[36] Batch [300] Speed: 1696.96 samples/sec Loss=0.699159
INFO:root:Epoch[36] Batch [320] Speed: 1684.92 samples/sec Loss=0.627643
INFO:root:Epoch[36] Batch [340] Speed: 1702.36 samples/sec Loss=0.652412
INFO:root:Epoch[36] Batch [360] Speed: 1699.95 samples/sec Loss=0.638470
INFO:root:Epoch[36] Batch [380] Speed: 1688.56 samples/sec Loss=0.627759
INFO:root:Epoch[36] Train-Loss=0.629356
INFO:root:Epoch[36] Time cost=30.653
INFO:root:Saved checkpoint to "models/mix_fea/mix-0037.params"
INFO:root:Epoch[36] Validation-Loss=0.585199
INFO:root:Epoch[37] Batch [20] Speed: 1689.56 samples/sec Loss=0.633828
INFO:root:Epoch[37] Batch [40] Speed: 1694.43 samples/sec Loss=0.630011
INFO:root:Epoch[37] Batch [60] Speed: 1684.70 samples/sec Loss=0.686865
INFO:root:Epoch[37] Batch [80] Speed: 1777.21 samples/sec Loss=0.663329
INFO:root:Epoch[37] Batch [100] Speed: 2042.30 samples/sec Loss=0.676000
INFO:root:Epoch[37] Batch [120] Speed: 1973.20 samples/sec Loss=0.632485
INFO:root:Epoch[37] Batch [140] Speed: 1624.94 samples/sec Loss=0.666367
INFO:root:Epoch[37] Batch [160] Speed: 1674.15 samples/sec Loss=0.652736
INFO:root:Epoch[37] Batch [180] Speed: 1646.25 samples/sec Loss=0.632433
INFO:root:Epoch[37] Batch [200] Speed: 1666.78 samples/sec Loss=0.663944
INFO:root:Epoch[37] Batch [220] Speed: 1709.00 samples/sec Loss=0.628839
INFO:root:Epoch[37] Batch [240] Speed: 1705.83 samples/sec Loss=0.624960
INFO:root:Epoch[37] Batch [260] Speed: 1695.06 samples/sec Loss=0.638951
INFO:root:Epoch[37] Batch [280] Speed: 1692.30 samples/sec Loss=0.629458
INFO:root:Epoch[37] Batch [300] Speed: 1686.01 samples/sec Loss=0.637945
INFO:root:Epoch[37] Batch [320] Speed: 1697.21 samples/sec Loss=0.633140
INFO:root:Epoch[37] Batch [340] Speed: 1699.55 samples/sec Loss=0.629078
INFO:root:Epoch[37] Batch [360] Speed: 1685.16 samples/sec Loss=0.626740
INFO:root:Epoch[37] Batch [380] Speed: 1690.46 samples/sec Loss=0.651472
INFO:root:Epoch[37] Train-Loss=0.634195
INFO:root:Epoch[37] Time cost=29.035
INFO:root:Saved checkpoint to "models/mix_fea/mix-0038.params"
INFO:root:Epoch[37] Validation-Loss=0.575770
INFO:root:Epoch[38] Batch [20] Speed: 1649.15 samples/sec Loss=0.628563
INFO:root:Epoch[38] Batch [40] Speed: 1693.28 samples/sec Loss=0.642793
INFO:root:Epoch[38] Batch [60] Speed: 1692.93 samples/sec Loss=0.634806
INFO:root:Epoch[38] Batch [80] Speed: 1777.53 samples/sec Loss=0.622065
INFO:root:Epoch[38] Batch [100] Speed: 2065.89 samples/sec Loss=0.628496
INFO:root:Epoch[38] Batch [120] Speed: 2019.01 samples/sec Loss=0.640240
INFO:root:Epoch[38] Batch [140] Speed: 1700.02 samples/sec Loss=0.607806
INFO:root:Epoch[38] Batch [160] Speed: 1688.35 samples/sec Loss=0.660842
INFO:root:Epoch[38] Batch [180] Speed: 1700.83 samples/sec Loss=0.618810
INFO:root:Epoch[38] Batch [200] Speed: 1693.01 samples/sec Loss=0.662014
INFO:root:Epoch[38] Batch [220] Speed: 1685.88 samples/sec Loss=0.663317
INFO:root:Epoch[38] Batch [240] Speed: 1697.40 samples/sec Loss=0.698611
INFO:root:Epoch[38] Batch [260] Speed: 1695.53 samples/sec Loss=0.620561
INFO:root:Epoch[38] Batch [280] Speed: 1687.76 samples/sec Loss=0.655891
INFO:root:Epoch[38] Batch [300] Speed: 1695.70 samples/sec Loss=0.610284
INFO:root:Epoch[38] Batch [320] Speed: 1700.11 samples/sec Loss=0.642676
INFO:root:Epoch[38] Batch [340] Speed: 1691.54 samples/sec Loss=0.647688
INFO:root:Epoch[38] Batch [360] Speed: 1670.73 samples/sec Loss=0.628732
INFO:root:Epoch[38] Batch [380] Speed: 1685.89 samples/sec Loss=0.668084
INFO:root:Epoch[38] Train-Loss=0.585926
INFO:root:Epoch[38] Time cost=28.994
INFO:root:Saved checkpoint to "models/mix_fea/mix-0039.params"
INFO:root:Epoch[38] Validation-Loss=0.632528
INFO:root:Epoch[39] Batch [20] Speed: 1633.07 samples/sec Loss=0.601288
INFO:root:Epoch[39] Batch [40] Speed: 1720.00 samples/sec Loss=0.608668
INFO:root:Epoch[39] Batch [60] Speed: 1689.55 samples/sec Loss=0.644215
INFO:root:Epoch[39] Batch [80] Speed: 1700.66 samples/sec Loss=0.635053
INFO:root:Epoch[39] Batch [100] Speed: 2124.32 samples/sec Loss=0.650072
INFO:root:Epoch[39] Batch [120] Speed: 2072.38 samples/sec Loss=0.618076
INFO:root:Epoch[39] Batch [140] Speed: 1649.44 samples/sec Loss=0.612593
INFO:root:Epoch[39] Batch [160] Speed: 1624.18 samples/sec Loss=0.661955
INFO:root:Epoch[39] Batch [180] Speed: 1675.83 samples/sec Loss=0.655180
INFO:root:Epoch[39] Batch [200] Speed: 1696.68 samples/sec Loss=0.659025
INFO:root:Epoch[39] Batch [220] Speed: 1706.05 samples/sec Loss=0.597949
INFO:root:Epoch[39] Batch [240] Speed: 1701.71 samples/sec Loss=0.658198
INFO:root:Epoch[39] Batch [260] Speed: 1703.59 samples/sec Loss=0.635864
INFO:root:Epoch[39] Batch [280] Speed: 1707.11 samples/sec Loss=0.631622
INFO:root:Epoch[39] Batch [300] Speed: 1713.88 samples/sec Loss=0.640392
INFO:root:Epoch[39] Batch [320] Speed: 1726.46 samples/sec Loss=0.610609
INFO:root:Epoch[39] Batch [340] Speed: 1722.24 samples/sec Loss=0.654061
INFO:root:Epoch[39] Batch [360] Speed: 1735.04 samples/sec Loss=0.612599
INFO:root:Epoch[39] Batch [380] Speed: 1674.21 samples/sec Loss=0.620670
INFO:root:Epoch[39] Train-Loss=0.607503
INFO:root:Epoch[39] Time cost=28.869
INFO:root:Saved checkpoint to "models/mix_fea/mix-0040.params"
INFO:root:Epoch[39] Validation-Loss=0.577198
INFO:root:Epoch[40] Batch [20] Speed: 1678.60 samples/sec Loss=0.618073
INFO:root:Epoch[40] Batch [40] Speed: 1700.89 samples/sec Loss=0.599730
INFO:root:Epoch[40] Batch [60] Speed: 1692.07 samples/sec Loss=0.624513
INFO:root:Epoch[40] Batch [80] Speed: 1694.80 samples/sec Loss=0.640163
INFO:root:Epoch[40] Batch [100] Speed: 2087.11 samples/sec Loss=0.623890
INFO:root:Epoch[40] Batch [120] Speed: 2023.81 samples/sec Loss=0.644836
INFO:root:Epoch[40] Batch [140] Speed: 1699.11 samples/sec Loss=0.650221
INFO:root:Epoch[40] Batch [160] Speed: 1702.40 samples/sec Loss=0.649934
INFO:root:Epoch[40] Batch [180] Speed: 1692.17 samples/sec Loss=0.620472
INFO:root:Epoch[40] Batch [200] Speed: 1695.86 samples/sec Loss=0.669301
INFO:root:Epoch[40] Batch [220] Speed: 1692.27 samples/sec Loss=0.633995
INFO:root:Epoch[40] Batch [240] Speed: 1626.95 samples/sec Loss=0.654867
INFO:root:Epoch[40] Batch [260] Speed: 1620.22 samples/sec Loss=0.650856
INFO:root:Epoch[40] Batch [280] Speed: 1660.11 samples/sec Loss=0.630836
INFO:root:Epoch[40] Batch [300] Speed: 1694.56 samples/sec Loss=0.664852
INFO:root:Epoch[40] Batch [320] Speed: 1701.07 samples/sec Loss=0.644522
INFO:root:Epoch[40] Batch [340] Speed: 1690.79 samples/sec Loss=0.626397
INFO:root:Epoch[40] Batch [360] Speed: 1693.40 samples/sec Loss=0.625960
INFO:root:Epoch[40] Batch [380] Speed: 1686.67 samples/sec Loss=0.646228
INFO:root:Epoch[40] Train-Loss=0.607076
INFO:root:Epoch[40] Time cost=29.178
INFO:root:Saved checkpoint to "models/mix_fea/mix-0041.params"
INFO:root:Epoch[40] Validation-Loss=0.584727
INFO:root:Epoch[41] Batch [20] Speed: 1652.22 samples/sec Loss=0.651776
INFO:root:Epoch[41] Batch [40] Speed: 1685.01 samples/sec Loss=0.642098
INFO:root:Epoch[41] Batch [60] Speed: 1710.50 samples/sec Loss=0.662681
INFO:root:Epoch[41] Batch [80] Speed: 1716.71 samples/sec Loss=0.620609
INFO:root:Epoch[41] Batch [100] Speed: 2100.52 samples/sec Loss=0.675116
INFO:root:Epoch[41] Batch [120] Speed: 2061.51 samples/sec Loss=0.608422
INFO:root:Epoch[41] Batch [140] Speed: 1701.61 samples/sec Loss=0.608132
INFO:root:Epoch[41] Batch [160] Speed: 1701.30 samples/sec Loss=0.671514
INFO:root:Epoch[41] Batch [180] Speed: 1702.28 samples/sec Loss=0.655991
INFO:root:Epoch[41] Batch [200] Speed: 1694.01 samples/sec Loss=0.653243
INFO:root:Epoch[41] Batch [220] Speed: 1698.52 samples/sec Loss=0.637301
INFO:root:Epoch[41] Batch [240] Speed: 1699.19 samples/sec Loss=0.627167
INFO:root:Epoch[41] Batch [260] Speed: 1714.82 samples/sec Loss=0.649615
INFO:root:Epoch[41] Batch [280] Speed: 1705.28 samples/sec Loss=0.604399
INFO:root:Epoch[41] Batch [300] Speed: 1700.27 samples/sec Loss=0.625589
INFO:root:Epoch[41] Batch [320] Speed: 1702.21 samples/sec Loss=0.642787
INFO:root:Epoch[41] Batch [340] Speed: 1703.74 samples/sec Loss=0.600081
INFO:root:Epoch[41] Batch [360] Speed: 1700.30 samples/sec Loss=0.588613
INFO:root:Epoch[41] Batch [380] Speed: 1702.19 samples/sec Loss=0.614987
INFO:root:Epoch[41] Train-Loss=0.617591
INFO:root:Epoch[41] Time cost=28.859
INFO:root:Saved checkpoint to "models/mix_fea/mix-0042.params"
INFO:root:Epoch[41] Validation-Loss=0.625550
INFO:root:Epoch[42] Batch [20] Speed: 1645.68 samples/sec Loss=0.639825
INFO:root:Epoch[42] Batch [40] Speed: 1625.76 samples/sec Loss=0.629973
INFO:root:Epoch[42] Batch [60] Speed: 1670.34 samples/sec Loss=0.677126
INFO:root:Epoch[42] Batch [80] Speed: 1701.44 samples/sec Loss=0.645026
INFO:root:Epoch[42] Batch [100] Speed: 2123.31 samples/sec Loss=0.654755
INFO:root:Epoch[42] Batch [120] Speed: 2082.60 samples/sec Loss=0.655991
INFO:root:Epoch[42] Batch [140] Speed: 1643.57 samples/sec Loss=0.625530
INFO:root:Epoch[42] Batch [160] Speed: 1654.15 samples/sec Loss=0.605162
INFO:root:Epoch[42] Batch [180] Speed: 1646.38 samples/sec Loss=0.619623
INFO:root:Epoch[42] Batch [200] Speed: 1644.15 samples/sec Loss=0.627452
INFO:root:Epoch[42] Batch [220] Speed: 1675.81 samples/sec Loss=0.670020
INFO:root:Epoch[42] Batch [240] Speed: 1721.71 samples/sec Loss=0.626680
INFO:root:Epoch[42] Batch [260] Speed: 1738.29 samples/sec Loss=0.652081
INFO:root:Epoch[42] Batch [280] Speed: 1724.59 samples/sec Loss=0.628297
INFO:root:Epoch[42] Batch [300] Speed: 1730.91 samples/sec Loss=0.600674
INFO:root:Epoch[42] Batch [320] Speed: 1715.31 samples/sec Loss=0.642348
INFO:root:Epoch[42] Batch [340] Speed: 1733.01 samples/sec Loss=0.632057
INFO:root:Epoch[42] Batch [360] Speed: 1725.66 samples/sec Loss=0.615547
INFO:root:Epoch[42] Batch [380] Speed: 1719.85 samples/sec Loss=0.647450
INFO:root:Epoch[42] Train-Loss=0.646306
INFO:root:Epoch[42] Time cost=28.965
INFO:root:Saved checkpoint to "models/mix_fea/mix-0043.params"
INFO:root:Epoch[42] Validation-Loss=0.609528
INFO:root:Epoch[43] Batch [20] Speed: 1709.02 samples/sec Loss=0.665878
INFO:root:Epoch[43] Batch [40] Speed: 1692.52 samples/sec Loss=0.620843
INFO:root:Epoch[43] Batch [60] Speed: 1698.26 samples/sec Loss=0.636284