forked from FrankWork/fudan_mtl_reviews
-
Notifications
You must be signed in to change notification settings - Fork 3
/
log.txt
503 lines (472 loc) · 20.8 KB
/
log.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
$ mtl only
Epoch 0 loss 3.55 acc 0.51 0.5616 time 26.23
Epoch 1 loss 2.78 acc 0.53 0.6211 time 24.28
Epoch 2 loss 2.23 acc 0.54 0.6479 time 22.81
Epoch 3 loss 1.87 acc 0.56 0.6768 time 22.47
Epoch 4 loss 1.54 acc 0.57 0.6979 time 22.87
Epoch 5 loss 1.31 acc 0.59 0.7395 time 23.00
Epoch 6 loss 1.10 acc 0.62 0.7402 time 22.96
Epoch 7 loss 0.97 acc 0.62 0.7457 time 22.73
Epoch 8 loss 0.84 acc 0.65 0.7523 time 22.85
Epoch 9 loss 0.76 acc 0.66 0.7816 time 22.94
Epoch 10 loss 0.69 acc 0.68 0.7891 time 22.24
Epoch 11 loss 0.63 acc 0.70 0.7832 time 22.60
Epoch 12 loss 0.61 acc 0.71 0.7932 time 22.22
Epoch 13 loss 0.58 acc 0.73 0.7964 time 22.57
Epoch 14 loss 0.56 acc 0.74 0.7957 time 22.59
Epoch 15 loss 0.54 acc 0.75 0.8005 time 22.42
Epoch 16 loss 0.52 acc 0.75 0.8116 time 23.06
Epoch 17 loss 0.50 acc 0.77 0.8170 time 22.70
Epoch 18 loss 0.49 acc 0.78 0.8187 time 22.78
Epoch 19 loss 0.47 acc 0.79 0.8171 time 22.92
Epoch 20 loss 0.46 acc 0.79 0.8230 time 21.96
Epoch 21 loss 0.43 acc 0.81 0.8257 time 22.71
Epoch 22 loss 0.43 acc 0.81 0.8325 time 22.81
Epoch 23 loss 0.43 acc 0.81 0.8339 time 23.48
Epoch 24 loss 0.41 acc 0.82 0.8350 time 22.88
Epoch 25 loss 0.40 acc 0.83 0.8391 time 22.39
Epoch 26 loss 0.39 acc 0.84 0.8345 time 22.40
Epoch 27 loss 0.38 acc 0.84 0.8416 time 22.01
Epoch 28 loss 0.37 acc 0.85 0.8402 time 22.57
Epoch 29 loss 0.37 acc 0.85 0.8446 time 21.53
Done training, best_epoch: 29, best_acc: 0.8446
duration: 0.19 hours
restore
Epoch 0 loss 0.36 acc 0.85 0.8411 time 26.57
Epoch 1 loss 0.36 acc 0.86 0.8445 time 24.14
Epoch 2 loss 0.35 acc 0.86 0.8446 time 22.79
Epoch 3 loss 0.35 acc 0.86 0.8454 time 22.76
Epoch 4 loss 0.33 acc 0.87 0.8509 time 23.31
Epoch 5 loss 0.32 acc 0.88 0.8446 time 22.90
Epoch 6 loss 0.31 acc 0.88 0.8534 time 22.20
Epoch 7 loss 0.29 acc 0.89 0.8530 time 22.42
Epoch 8 loss 0.28 acc 0.89 0.8500 time 21.89
Epoch 9 loss 0.28 acc 0.89 0.8502 time 22.26
Epoch 10 loss 0.27 acc 0.89 0.8527 time 21.83
Epoch 11 loss 0.26 acc 0.90 0.8580 time 21.88
Epoch 12 loss 0.26 acc 0.91 0.8591 time 22.77
Epoch 13 loss 0.26 acc 0.90 0.8532 time 22.20
Epoch 14 loss 0.25 acc 0.91 0.8568 time 21.89
Epoch 15 loss 0.22 acc 0.92 0.8555 time 22.15
Epoch 16 loss 0.23 acc 0.92 0.8566 time 22.01
Epoch 17 loss 0.22 acc 0.92 0.8582 time 21.65
Epoch 18 loss 0.21 acc 0.92 0.8568 time 22.10
Epoch 19 loss 0.20 acc 0.92 0.8566 time 21.98
Epoch 20 loss 0.20 acc 0.93 0.8568 time 22.05
Epoch 21 loss 0.20 acc 0.93 0.8554 time 21.90
Epoch 22 loss 0.19 acc 0.93 0.8573 time 21.90
Epoch 23 loss 0.19 acc 0.93 0.8582 time 21.48
Epoch 24 loss 0.18 acc 0.94 0.8579 time 22.10
Epoch 25 loss 0.17 acc 0.94 0.8580 time 22.06
Epoch 26 loss 0.17 acc 0.94 0.8625 time 21.95
Epoch 27 loss 0.17 acc 0.94 0.8586 time 22.95
Epoch 28 loss 0.17 acc 0.94 0.8618 time 21.89
Epoch 29 loss 0.16 acc 0.94 0.8614 time 21.76
Done training, best_epoch: 26, best_acc: 0.8625
duration: 0.19 hours
acc 86.25 err 13.75
$ mtl + adv
Epoch 0 loss 7.71 acc 0.51 0.5600 time 34.96
Epoch 1 loss 14.40 acc 0.53 0.6445 time 32.56
Epoch 2 loss 18.94 acc 0.55 0.6679 time 31.18
Epoch 3 loss 19.05 acc 0.57 0.6991 time 30.66
Epoch 4 loss 16.30 acc 0.60 0.7307 time 30.87
Epoch 5 loss 13.35 acc 0.63 0.7630 time 30.25
Epoch 6 loss 10.86 acc 0.66 0.7773 time 30.20
Epoch 7 loss 8.90 acc 0.68 0.7823 time 30.26
Epoch 8 loss 7.45 acc 0.71 0.8007 time 30.54
Epoch 9 loss 6.49 acc 0.72 0.8125 time 30.62
Epoch 10 loss 5.78 acc 0.74 0.8162 time 30.79
Epoch 11 loss 5.13 acc 0.75 0.8200 time 30.43
Epoch 12 loss 4.51 acc 0.76 0.8257 time 30.78
Epoch 13 loss 4.12 acc 0.77 0.8300 time 30.72
Epoch 14 loss 3.91 acc 0.78 0.8282 time 30.61
Epoch 15 loss 3.66 acc 0.79 0.8404 time 29.86
Epoch 16 loss 3.55 acc 0.80 0.8366 time 30.60
Epoch 17 loss 3.44 acc 0.80 0.8382 time 29.54
Epoch 18 loss 3.30 acc 0.81 0.8439 time 29.66
Epoch 19 loss 3.33 acc 0.82 0.8416 time 30.68
Epoch 20 loss 3.33 acc 0.82 0.8416 time 29.69
Epoch 21 loss 3.29 acc 0.83 0.8473 time 29.50
Epoch 22 loss 3.24 acc 0.83 0.8504 time 30.88
Epoch 23 loss 3.31 acc 0.84 0.8461 time 30.54
Epoch 24 loss 3.18 acc 0.84 0.8505 time 29.44
Epoch 25 loss 3.23 acc 0.85 0.8554 time 30.42
Epoch 26 loss 3.19 acc 0.85 0.8555 time 30.37
Epoch 27 loss 3.22 acc 0.85 0.8582 time 30.36
Epoch 28 loss 3.23 acc 0.85 0.8525 time 30.76
Epoch 29 loss 3.15 acc 0.86 0.8566 time 29.96
Epoch 30 loss 3.21 acc 0.86 0.8566 time 29.46
Epoch 31 loss 3.27 acc 0.86 0.8623 time 29.89
Epoch 32 loss 3.28 acc 0.87 0.8614 time 30.68
Epoch 33 loss 3.15 acc 0.87 0.8588 time 29.63
Epoch 34 loss 3.11 acc 0.87 0.8648 time 29.65
Epoch 35 loss 3.09 acc 0.88 0.8591 time 30.82
Epoch 36 loss 3.16 acc 0.88 0.8625 time 29.94
Epoch 37 loss 3.15 acc 0.88 0.8613 time 29.92
Epoch 38 loss 3.10 acc 0.89 0.8639 time 29.94
Epoch 39 loss 3.13 acc 0.89 0.8637 time 29.76
Epoch 40 loss 3.01 acc 0.89 0.8718 time 29.77
Epoch 41 loss 3.03 acc 0.89 0.8650 time 30.77
Epoch 42 loss 3.01 acc 0.90 0.8661 time 29.70
Epoch 43 loss 2.99 acc 0.90 0.8630 time 29.62
Epoch 44 loss 2.98 acc 0.90 0.8641 time 29.83
Epoch 45 loss 3.02 acc 0.90 0.8650 time 29.68
Epoch 46 loss 2.93 acc 0.91 0.8666 time 29.85
Epoch 47 loss 2.93 acc 0.91 0.8654 time 29.33
Epoch 48 loss 3.01 acc 0.91 0.8721 time 29.70
Epoch 49 loss 2.92 acc 0.91 0.8668 time 30.43
Epoch 50 loss 2.78 acc 0.91 0.8698 time 29.97
Epoch 51 loss 2.89 acc 0.92 0.8668 time 29.96
Epoch 52 loss 2.82 acc 0.92 0.8686 time 29.66
Epoch 53 loss 2.82 acc 0.92 0.8705 time 29.84
Epoch 54 loss 2.83 acc 0.93 0.8652 time 29.63
Epoch 55 loss 2.68 acc 0.93 0.8714 time 29.71
Epoch 56 loss 2.81 acc 0.93 0.8682 time 29.64
Epoch 57 loss 2.78 acc 0.92 0.8689 time 29.94
Epoch 58 loss 2.71 acc 0.93 0.8711 time 29.70
Epoch 59 loss 2.78 acc 0.93 0.8684 time 29.97
Epoch 60 loss 2.74 acc 0.93 0.8682 time 29.83
Epoch 61 loss 2.64 acc 0.94 0.8632 time 29.58
Epoch 62 loss 2.71 acc 0.93 0.8691 time 29.87
Epoch 63 loss 2.76 acc 0.94 0.8700 time 29.75
Epoch 64 loss 2.75 acc 0.94 0.8657 time 29.63
Epoch 65 loss 2.79 acc 0.94 0.8693 time 29.43
Epoch 66 loss 2.63 acc 0.94 0.8677 time 29.22
Epoch 67 loss 2.69 acc 0.94 0.8671 time 29.69
Epoch 68 loss 2.71 acc 0.94 0.8677 time 29.55
Epoch 69 loss 2.68 acc 0.94 0.8684 time 29.83
Epoch 70 loss 2.62 acc 0.94 0.8657 time 29.73
Epoch 71 loss 2.57 acc 0.95 0.8657 time 29.46
Epoch 72 loss 2.68 acc 0.95 0.8638 time 29.58
acc 87.21 err 12.79
$ mtl + adv + diff
Epoch 0 loss 7.64 acc 0.51 0.5430 time 34.61
Epoch 1 loss 14.14 acc 0.52 0.6254 time 31.12
Epoch 2 loss 18.64 acc 0.55 0.6666 time 29.82
Epoch 3 loss 18.65 acc 0.58 0.7021 time 29.35
Epoch 4 loss 15.95 acc 0.61 0.7452 time 29.40
Epoch 5 loss 12.73 acc 0.63 0.7648 time 29.21
Epoch 6 loss 10.12 acc 0.66 0.7854 time 29.01
Epoch 7 loss 8.31 acc 0.69 0.7766 time 28.70
Epoch 8 loss 6.97 acc 0.71 0.8127 time 27.99
Epoch 9 loss 5.89 acc 0.73 0.8130 time 29.07
Epoch 10 loss 5.26 acc 0.74 0.8234 time 29.31
Epoch 11 loss 4.64 acc 0.76 0.8230 time 29.13
Epoch 12 loss 4.19 acc 0.76 0.8284 time 27.63
Epoch 13 loss 3.94 acc 0.77 0.8330 time 29.20
Epoch 14 loss 3.70 acc 0.78 0.8355 time 28.98
Epoch 15 loss 3.54 acc 0.80 0.8420 time 29.19
Epoch 16 loss 3.48 acc 0.80 0.8377 time 29.15
Epoch 17 loss 3.39 acc 0.81 0.8384 time 27.64
Epoch 18 loss 3.29 acc 0.81 0.8414 time 27.58
Epoch 19 loss 3.14 acc 0.81 0.8459 time 28.11
Epoch 20 loss 3.19 acc 0.82 0.8448 time 29.36
Epoch 21 loss 3.14 acc 0.82 0.8532 time 27.92
Epoch 22 loss 3.08 acc 0.83 0.8536 time 29.53
Epoch 23 loss 3.06 acc 0.84 0.8498 time 29.31
Epoch 24 loss 3.09 acc 0.84 0.8530 time 27.50
Epoch 25 loss 3.10 acc 0.84 0.8532 time 28.12
Epoch 26 loss 3.09 acc 0.84 0.8511 time 27.72
Epoch 27 loss 3.05 acc 0.85 0.8582 time 27.91
Epoch 28 loss 3.12 acc 0.86 0.8584 time 29.21
Epoch 29 loss 3.14 acc 0.86 0.8577 time 29.28
Epoch 30 loss 3.14 acc 0.86 0.8618 time 27.96
Epoch 31 loss 3.15 acc 0.86 0.8657 time 29.38
Epoch 32 loss 3.10 acc 0.87 0.8623 time 29.05
Epoch 33 loss 3.18 acc 0.87 0.8600 time 27.79
Epoch 34 loss 3.11 acc 0.88 0.8668 time 27.65
Epoch 35 loss 3.15 acc 0.88 0.8600 time 28.63
Epoch 36 loss 3.16 acc 0.88 0.8645 time 28.04
Epoch 37 loss 3.10 acc 0.88 0.8652 time 27.67
Epoch 38 loss 3.07 acc 0.89 0.8648 time 27.87
Epoch 39 loss 3.06 acc 0.88 0.8638 time 28.31
Epoch 40 loss 2.97 acc 0.89 0.8668 time 28.11
Epoch 41 loss 3.15 acc 0.89 0.8670 time 27.92
Epoch 42 loss 3.13 acc 0.90 0.8684 time 29.50
Epoch 43 loss 3.05 acc 0.90 0.8682 time 28.77
Epoch 44 loss 3.05 acc 0.90 0.8698 time 27.85
Epoch 45 loss 3.00 acc 0.90 0.8684 time 28.98
Epoch 46 loss 2.91 acc 0.90 0.8625 time 28.10
Epoch 47 loss 2.91 acc 0.90 0.8679 time 27.69
Epoch 48 loss 2.80 acc 0.91 0.8666 time 27.72
Epoch 49 loss 2.80 acc 0.92 0.8666 time 28.15
Epoch 50 loss 2.82 acc 0.92 0.8675 time 28.21
Epoch 51 loss 2.81 acc 0.92 0.8670 time 27.66
Epoch 52 loss 2.75 acc 0.92 0.8700 time 27.86
Epoch 53 loss 2.81 acc 0.92 0.8695 time 29.14
Epoch 54 loss 2.84 acc 0.92 0.8670 time 27.66
Epoch 55 loss 2.76 acc 0.92 0.8680 time 27.88
Epoch 56 loss 2.77 acc 0.93 0.8707 time 28.03
Epoch 57 loss 2.79 acc 0.93 0.8711 time 28.96
Epoch 58 loss 2.71 acc 0.93 0.8704 time 28.92
Epoch 59 loss 2.78 acc 0.93 0.8709 time 27.63
Epoch 60 loss 2.73 acc 0.93 0.8698 time 27.77
Epoch 61 loss 2.55 acc 0.93 0.8662 time 28.10
Epoch 62 loss 2.67 acc 0.94 0.8730 time 27.92
Epoch 63 loss 2.80 acc 0.94 0.8711 time 29.16
Epoch 64 loss 2.59 acc 0.94 0.8673 time 27.54
Epoch 65 loss 2.63 acc 0.94 0.8673 time 27.80
Epoch 66 loss 2.59 acc 0.94 0.8686 time 27.91
Epoch 67 loss 2.61 acc 0.94 0.8662 time 27.81
Epoch 68 loss 2.61 acc 0.94 0.8673 time 27.71
Epoch 69 loss 2.68 acc 0.94 0.8686 time 27.97
Epoch 70 loss 2.72 acc 0.95 0.8677 time 27.61
Epoch 71 loss 2.52 acc 0.95 0.8680 time 27.95
Epoch 72 loss 2.65 acc 0.95 0.8689 time 27.72
Epoch 73 loss 2.73 acc 0.95 0.8661 time 27.80
Epoch 74 loss 2.79 acc 0.95 0.8705 time 27.74
Epoch 75 loss 2.71 acc 0.95 0.8691 time 27.71
Epoch 76 loss 2.57 acc 0.95 0.8718 time 27.63
Epoch 77 loss 2.56 acc 0.96 0.8675 time 27.87
Epoch 78 loss 2.53 acc 0.95 0.8698 time 28.11
Epoch 79 loss 2.63 acc 0.96 0.8687 time 28.34
Epoch 80 loss 2.51 acc 0.96 0.8709 time 27.75
Epoch 81 loss 2.60 acc 0.96 0.8689 time 27.92
Epoch 82 loss 2.66 acc 0.96 0.8682 time 27.68
Epoch 83 loss 2.71 acc 0.96 0.8668 time 27.61
Epoch 84 loss 2.68 acc 0.96 0.8689 time 28.04
Epoch 85 loss 2.70 acc 0.96 0.8607 time 27.69
Epoch 86 loss 2.78 acc 0.97 0.8684 time 27.91
Epoch 87 loss 2.83 acc 0.96 0.8693 time 27.34
Epoch 88 loss 2.66 acc 0.96 0.8686 time 27.67
Epoch 89 loss 2.87 acc 0.96 0.8702 time 27.86
Epoch 90 loss 2.91 acc 0.96 0.8648 time 27.95
Epoch 91 loss 2.69 acc 0.96 0.8671 time 27.82
Epoch 92 loss 2.67 acc 0.96 0.8630 time 27.74
Epoch 93 loss 2.77 acc 0.96 0.8584 time 27.65
Epoch 94 loss 2.80 acc 0.96 0.8636 time 27.55
Epoch 95 loss 2.64 acc 0.96 0.8650 time 27.79
Epoch 96 loss 2.77 acc 0.97 0.8646 time 27.59
Epoch 97 loss 2.82 acc 0.97 0.8646 time 27.76
Epoch 98 loss 2.83 acc 0.97 0.8627 time 27.56
Epoch 99 loss 2.79 acc 0.97 0.8637 time 27.90
Done training, best_epoch: 62, best_acc: 0.8730
duration: 0.79 hours
acc 87.30 err 12.70
50d
mtl 13.75
mtl + adv 12.79
mtl + adv + diff 12.70
$ word_dim 300, no adv
Epoch 0 loss 1.48 acc 0.52 0.6007 time 45.15
Epoch 1 loss 1.18 acc 0.54 0.6920 time 44.73
Epoch 2 loss 1.01 acc 0.58 0.7079 time 41.56
Epoch 3 loss 0.88 acc 0.60 0.7211 time 41.60
Epoch 4 loss 0.79 acc 0.63 0.7482 time 41.54
Epoch 5 loss 0.73 acc 0.65 0.7725 time 41.23
Epoch 6 loss 0.66 acc 0.68 0.7734 time 40.66
Epoch 7 loss 0.63 acc 0.69 0.7950 time 40.59
Epoch 8 loss 0.59 acc 0.71 0.7962 time 40.56
Epoch 9 loss 0.55 acc 0.74 0.8170 time 41.21
Epoch 10 loss 0.53 acc 0.75 0.8100 time 42.24
Epoch 11 loss 0.50 acc 0.77 0.8237 time 39.62
Epoch 12 loss 0.48 acc 0.78 0.8213 time 43.00
Epoch 13 loss 0.46 acc 0.79 0.8216 time 38.09
Epoch 14 loss 0.45 acc 0.80 0.8311 time 37.81
Epoch 15 loss 0.43 acc 0.81 0.8320 time 40.70
Epoch 16 loss 0.42 acc 0.82 0.8361 time 40.07
Epoch 17 loss 0.40 acc 0.82 0.8380 time 41.90
Epoch 18 loss 0.38 acc 0.83 0.8450 time 41.45
Epoch 19 loss 0.37 acc 0.84 0.8434 time 41.52
Epoch 20 loss 0.36 acc 0.85 0.8471 time 38.21
Epoch 21 loss 0.35 acc 0.86 0.8534 time 43.42
Epoch 22 loss 0.34 acc 0.86 0.8484 time 42.39
Epoch 23 loss 0.33 acc 0.87 0.8532 time 38.26
Epoch 24 loss 0.31 acc 0.87 0.8525 time 40.09
Epoch 25 loss 0.30 acc 0.88 0.8527 time 38.44
Epoch 26 loss 0.29 acc 0.88 0.8548 time 37.13
Epoch 27 loss 0.28 acc 0.89 0.8554 time 40.65
Epoch 28 loss 0.27 acc 0.89 0.8588 time 40.41
Epoch 29 loss 0.27 acc 0.90 0.8596 time 42.80
Epoch 30 loss 0.26 acc 0.90 0.8605 time 42.74
Epoch 31 loss 0.25 acc 0.90 0.8586 time 43.80
Epoch 32 loss 0.24 acc 0.91 0.8629 time 38.16
Epoch 33 loss 0.23 acc 0.91 0.8625 time 42.89
Epoch 34 loss 0.23 acc 0.91 0.8648 time 38.10
Epoch 35 loss 0.21 acc 0.92 0.8655 time 41.07
Epoch 36 loss 0.21 acc 0.93 0.8661 time 44.78
Epoch 37 loss 0.21 acc 0.93 0.8636 time 44.58
Epoch 38 loss 0.20 acc 0.93 0.8671 time 37.70
Epoch 39 loss 0.19 acc 0.93 0.8614 time 41.84
Epoch 40 loss 0.18 acc 0.93 0.8679 time 38.29
Epoch 41 loss 0.18 acc 0.93 0.8675 time 39.54
Epoch 42 loss 0.17 acc 0.94 0.8643 time 36.58
Epoch 43 loss 0.17 acc 0.94 0.8663 time 35.79
Epoch 44 loss 0.16 acc 0.95 0.8661 time 35.88
Epoch 45 loss 0.16 acc 0.95 0.8680 time 35.97
Epoch 46 loss 0.16 acc 0.95 0.8668 time 42.32
Epoch 47 loss 0.15 acc 0.95 0.8641 time 38.97
Epoch 48 loss 0.15 acc 0.95 0.8671 time 38.84
Epoch 49 loss 0.15 acc 0.95 0.8677 time 37.84
Epoch 50 loss 0.14 acc 0.96 0.8645 time 37.09
Epoch 51 loss 0.14 acc 0.95 0.8638 time 35.45
Epoch 52 loss 0.14 acc 0.96 0.8675 time 35.31
Epoch 53 loss 0.13 acc 0.96 0.8664 time 35.08
Epoch 54 loss 0.12 acc 0.96 0.8670 time 36.38
Epoch 55 loss 0.12 acc 0.96 0.8661 time 36.76
Epoch 56 loss 0.12 acc 0.96 0.8677 time 38.78
Epoch 57 loss 0.12 acc 0.97 0.8648 time 38.90
Epoch 58 loss 0.12 acc 0.96 0.8643 time 39.92
Epoch 59 loss 0.12 acc 0.97 0.8661 time 40.00
Epoch 60 loss 0.11 acc 0.97 0.8664 time 40.15
Epoch 61 loss 0.11 acc 0.97 0.8657 time 38.66
Epoch 62 loss 0.11 acc 0.97 0.8646 time 39.22
Epoch 63 loss 0.10 acc 0.97 0.8652 time 37.65
Epoch 64 loss 0.10 acc 0.97 0.8686 time 35.36
Epoch 65 loss 0.10 acc 0.97 0.8659 time 38.76
Epoch 66 loss 0.09 acc 0.97 0.8684 time 37.78
Epoch 67 loss 0.10 acc 0.97 0.8700 time 34.83
Epoch 68 loss 0.09 acc 0.97 0.8650 time 39.82
Epoch 69 loss 0.09 acc 0.98 0.8663 time 37.55
Epoch 70 loss 0.09 acc 0.97 0.8671 time 37.37
Epoch 71 loss 0.09 acc 0.98 0.8704 time 37.48
Epoch 72 loss 0.08 acc 0.98 0.8671 time 39.48
Epoch 73 loss 0.09 acc 0.98 0.8698 time 37.28
Epoch 74 loss 0.09 acc 0.98 0.8684 time 37.28
Epoch 75 loss 0.08 acc 0.98 0.8663 time 37.44
Epoch 76 loss 0.08 acc 0.98 0.8686 time 37.14
Epoch 77 loss 0.08 acc 0.98 0.8695 time 37.48
Epoch 78 loss 0.08 acc 0.98 0.8675 time 37.33
Epoch 79 loss 0.08 acc 0.98 0.8675 time 37.69
Epoch 80 loss 0.08 acc 0.98 0.8700 time 37.62
Epoch 81 loss 0.08 acc 0.98 0.8638 time 37.44
Epoch 82 loss 0.07 acc 0.98 0.8689 time 37.54
Epoch 83 loss 0.07 acc 0.98 0.8673 time 37.97
Epoch 84 loss 0.07 acc 0.98 0.8675 time 37.88
Epoch 85 loss 0.07 acc 0.98 0.8695 time 37.04
Epoch 86 loss 0.07 acc 0.98 0.8700 time 37.29
Epoch 87 loss 0.07 acc 0.98 0.8663 time 37.43
Epoch 88 loss 0.07 acc 0.98 0.8707 time 35.70
Epoch 89 loss 0.07 acc 0.98 0.8668 time 39.22
Epoch 90 loss 0.07 acc 0.98 0.8682 time 35.51
Epoch 91 loss 0.07 acc 0.98 0.8675 time 35.59
Epoch 92 loss 0.07 acc 0.98 0.8671 time 36.45
Epoch 93 loss 0.07 acc 0.99 0.8657 time 37.20
Epoch 94 loss 0.07 acc 0.98 0.8689 time 37.10
Epoch 95 loss 0.07 acc 0.98 0.8664 time 37.09
Epoch 96 loss 0.07 acc 0.98 0.8675 time 37.16
Epoch 97 loss 0.06 acc 0.99 0.8654 time 37.24
Epoch 98 loss 0.06 acc 0.99 0.8688 time 37.00
Epoch 99 loss 0.06 acc 0.99 0.8673 time 36.81
Done training, best_epoch: 88, best_acc: 0.8707
duration: 1.08 hours
$ word_dim 300, adv
Epoch 0 loss 4.17 acc 0.52 0.6384 time 71.92
Epoch 1 loss 6.35 acc 0.57 0.7273 time 77.71
Epoch 2 loss 6.08 acc 0.63 0.7782 time 73.95
Epoch 3 loss 6.20 acc 0.69 0.8055 time 73.20
Epoch 4 loss 7.83 acc 0.72 0.8179 time 71.70
Epoch 5 loss 9.96 acc 0.75 0.8271 time 71.98
Epoch 6 loss 12.50 acc 0.77 0.8427 time 71.21
Epoch 7 loss 15.56 acc 0.79 0.8398 time 72.73
Epoch 8 loss 18.99 acc 0.80 0.8409 time 64.95
Epoch 9 loss 22.65 acc 0.81 0.8509 time 65.62
Epoch 10 loss 26.59 acc 0.81 0.8571 time 61.04
Epoch 11 loss 30.75 acc 0.83 0.8554 time 65.96
Epoch 12 loss 35.07 acc 0.83 0.8502 time 62.32
Epoch 13 loss 39.64 acc 0.84 0.8648 time 62.82
Epoch 14 loss 44.38 acc 0.84 0.8616 time 73.21
Epoch 15 loss 49.34 acc 0.85 0.8589 time 63.09
Epoch 16 loss 54.44 acc 0.85 0.8664 time 64.61
Epoch 17 loss 59.65 acc 0.87 0.8677 time 67.66
Epoch 18 loss 65.09 acc 0.86 0.8654 time 71.74
Epoch 19 loss 70.68 acc 0.86 0.8654 time 62.87
Epoch 20 loss 76.42 acc 0.86 0.8730 time 62.97
Epoch 21 loss 82.26 acc 0.87 0.8693 time 72.11
Epoch 22 loss 88.19 acc 0.87 0.8745 time 65.15
Epoch 23 loss 94.25 acc 0.88 0.8746 time 70.87
Epoch 24 loss 100.40 acc 0.88 0.8746 time 71.71
Epoch 25 loss 106.60 acc 0.88 0.8759 time 63.52
Epoch 26 loss 112.80 acc 0.89 0.8670 time 73.53
Epoch 27 loss 118.95 acc 0.89 0.8705 time 65.49
Epoch 28 loss 125.18 acc 0.89 0.8727 time 63.59
Epoch 29 loss 131.46 acc 0.89 0.8766 time 63.97
Epoch 30 loss 137.72 acc 0.90 0.8766 time 71.51
Epoch 31 loss 143.98 acc 0.90 0.8714 time 62.54
Epoch 32 loss 150.13 acc 0.90 0.8766 time 61.29
Epoch 33 loss 156.25 acc 0.91 0.8766 time 66.92
Epoch 34 loss 162.18 acc 0.91 0.8827 time 61.79
Epoch 35 loss 167.97 acc 0.91 0.8723 time 67.85
Epoch 36 loss 173.56 acc 0.92 0.8746 time 65.60
Epoch 37 loss 178.97 acc 0.92 0.8782 time 63.73
Epoch 38 loss 184.21 acc 0.92 0.8784 time 63.22
Epoch 39 loss 189.16 acc 0.92 0.8786 time 63.75
Epoch 40 loss 193.89 acc 0.93 0.8766 time 63.67
Epoch 41 loss 198.37 acc 0.93 0.8770 time 63.86
Epoch 42 loss 202.53 acc 0.93 0.8764 time 66.12
Epoch 43 loss 206.48 acc 0.93 0.8759 time 64.66
Epoch 44 loss 210.38 acc 0.93 0.8764 time 63.01
Epoch 45 loss 214.36 acc 0.93 0.8764 time 63.69
Epoch 46 loss 218.37 acc 0.94 0.8761 time 63.74
Epoch 47 loss 222.50 acc 0.94 0.8784 time 66.24
Epoch 48 loss 226.65 acc 0.94 0.8754 time 64.52
Epoch 49 loss 230.78 acc 0.94 0.8761 time 63.06
Epoch 50 loss 235.17 acc 0.94 0.8721 time 62.95
Epoch 51 loss 239.55 acc 0.94 0.8754 time 63.86
Epoch 52 loss 243.94 acc 0.94 0.8759 time 64.31
Epoch 53 loss 248.27 acc 0.94 0.8734 time 65.40
Epoch 54 loss 252.64 acc 0.94 0.8757 time 64.03
Epoch 55 loss 257.00 acc 0.95 0.8782 time 63.66
Epoch 56 loss 261.51 acc 0.95 0.8748 time 61.75
Epoch 57 loss 265.99 acc 0.95 0.8741 time 61.23
Epoch 58 loss 270.68 acc 0.95 0.8798 time 60.73
Epoch 59 loss 275.16 acc 0.95 0.8830 time 60.21
Epoch 60 loss 279.90 acc 0.96 0.8809 time 67.21
Epoch 61 loss 284.44 acc 0.96 0.8773 time 63.94
Epoch 62 loss 289.05 acc 0.96 0.8773 time 64.64
Epoch 63 loss 294.10 acc 0.96 0.8730 time 64.42
Epoch 64 loss 298.66 acc 0.96 0.8757 time 63.98
Epoch 65 loss 303.35 acc 0.96 0.8761 time 63.49
Epoch 66 loss 308.53 acc 0.96 0.8789 time 62.17
Epoch 67 loss 313.08 acc 0.97 0.8805 time 64.05
Epoch 68 loss 317.71 acc 0.96 0.8746 time 63.28
Epoch 69 loss 323.19 acc 0.96 0.8805 time 63.39
Epoch 70 loss 328.75 acc 0.96 0.8811 time 63.13
Epoch 71 loss 333.23 acc 0.96 0.8791 time 63.01
Epoch 72 loss 337.84 acc 0.96 0.8782 time 64.11
Epoch 73 loss 343.04 acc 0.96 0.8779 time 64.08
Epoch 74 loss 348.90 acc 0.97 0.8795 time 64.64
Epoch 75 loss 354.26 acc 0.97 0.8788 time 63.54
Epoch 76 loss 358.34 acc 0.97 0.8811 time 63.67
Epoch 77 loss 362.36 acc 0.97 0.8771 time 64.52
Epoch 78 loss 367.45 acc 0.97 0.8807 time 63.48
Epoch 79 loss 373.06 acc 0.97 0.8745 time 63.74
Epoch 80 loss 379.11 acc 0.97 0.8784 time 63.13
Epoch 81 loss 384.60 acc 0.97 0.8773 time 61.59
Epoch 82 loss 389.33 acc 0.97 0.8782 time 60.35
Epoch 83 loss 393.64 acc 0.97 0.8748 time 62.91
Epoch 84 loss 398.29 acc 0.97 0.8798 time 61.27
Epoch 85 loss 403.68 acc 0.97 0.8771 time 65.00
Epoch 86 loss 409.47 acc 0.97 0.8738 time 63.24
Epoch 87 loss 415.02 acc 0.97 0.8761 time 63.77
Epoch 88 loss 420.27 acc 0.97 0.8739 time 63.61
Epoch 89 loss 424.81 acc 0.98 0.8752 time 64.59
Epoch 90 loss 429.16 acc 0.97 0.8759 time 63.81
Epoch 91 loss 433.43 acc 0.98 0.8780 time 63.37
Epoch 92 loss 437.45 acc 0.98 0.8741 time 63.58
Epoch 93 loss 441.53 acc 0.98 0.8771 time 63.41
Epoch 94 loss 445.69 acc 0.98 0.8762 time 64.05
Epoch 95 loss 449.42 acc 0.98 0.8787 time 63.53
Epoch 96 loss 453.18 acc 0.98 0.8789 time 63.73
Epoch 97 loss 456.89 acc 0.98 0.8804 time 63.90
Epoch 98 loss 460.41 acc 0.98 0.8793 time 64.28
Epoch 99 loss 463.07 acc 0.98 0.8791 time 64.56
Done training, best_epoch: 59, best_acc: 0.8830
duration: 1.81 hours
dataset cnn+share embedding mtl+adv+diff
apparel 14.00 13.00 -1.00
baby 13.25 10.00 -3.25
books 12.25 12.50 +0.25
camera_photo 10.00 08.75 -1.25
electronics 14.50 14.00 -0.5
health_personal_care 12.00 10.50 -1.5
imdb 14.00 15.50 +1.5
kitchen_housewares 13.75 11.75 -2.0
magazines 08.25 07.50 -0.75
music 17.00 17.75 +0.75
software 11.25 08.00 -3.25
sports_outdoors 15.75 11.25 -4.5
toys_games 12.50 11.75 -0.75
video 12.50 11.50 -1.0
mean 12.93 11.70 -1.23