How to reproduce experimental results #769
Unanswered
ReCodeLife
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have trained on a server and obtained a checkpoint. However, when I tried to reproduce the results on my local machine, I found a significant difference in accuracy. So, I attempted to reproduce the effect with a minimal experiment.
When training on my local machine
I achieved an accuracy/top1 of 88.4281.
#some output 09/19 14:13:28 - mmengine - INFO - Exp name: mae-right-p16_linear-8xb128-coslr-90e_style_20230919_140433 09/19 14:13:28 - mmengine - INFO - Saving checkpoint at 1 epochs 09/19 14:13:36 - mmengine - INFO - Epoch(val) [1][100/633] eta: 0:00:36 time: 0.0563 data_time: 0.0004 memory: 2750 09/19 14:13:43 - mmengine - INFO - Epoch(val) [1][200/633] eta: 0:00:28 time: 0.0630 data_time: 0.0004 memory: 1701 09/19 14:13:49 - mmengine - INFO - Epoch(val) [1][300/633] eta: 0:00:21 time: 0.0750 data_time: 0.0138 memory: 1701 09/19 14:13:55 - mmengine - INFO - Epoch(val) [1][400/633] eta: 0:00:14 time: 0.0648 data_time: 0.0050 memory: 1701 09/19 14:14:01 - mmengine - INFO - Epoch(val) [1][500/633] eta: 0:00:08 time: 0.0565 data_time: 0.0003 memory: 1701 09/19 14:14:08 - mmengine - INFO - Epoch(val) [1][600/633] eta: 0:00:02 time: 0.0596 data_time: 0.0003 memory: 1701 09/19 14:14:09 - mmengine - INFO - Epoch(val) [1][633/633] accuracy/top1: 88.4281 09/19 14:14:11 - mmengine - INFO - The best checkpoint with 88.4281 accuracy/top1 at 1 epoch is saved to best_accuracy/top1_epoch_1.pth.
But when I use test code multiple times
I have always obtained an accuracy/top1 of 88.4722.
Although the change is small, it does present different results. Is this reasonable, or did I make a mistake?
Beta Was this translation helpful? Give feedback.
All reactions