This repository has been archived by the owner on Nov 17, 2023. It is now read-only.
How to set MXNET_CUDNN_AUTOTUNE_DEFAULT=0 in Sagemaker #20522
Unanswered
MikkelWorkF
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi
We are using AWS Sagemaker to run our training, and are moving taking the step to GPU.
This messages comes up sometimes
Running performance tests to find the best convolution algorithm, this can take a while... (set the environment variable MXNET_CUDNN_AUTOTUNE_DEFAULT to 0 to disable)
And it stalls for hours. How do I disable this in Sagemaker? It is not possible to just set environment variables.
Thank you.
Beta Was this translation helpful? Give feedback.
All reactions