You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
PyTorch FP16 models require GPU to generate artifacts. We are seeing a CUDA out of memory error when generating models with large batch size. These include:
BERT_LARGE_FP16 batches 512, 1024, 1240.
RESNET_FP16 batch 2048.
The text was updated successfully, but these errors were encountered:
PyTorch FP16 models require GPU to generate artifacts. We are seeing a
CUDA out of memory
error when generating models with large batch size. These include:The text was updated successfully, but these errors were encountered: