We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AMDMIGraphX/src/targets/gpu/kernels/include/migraphx/kernels/layernorm.hpp
Line 61 in 7460ac3
x^2/n can cause accuracy issues when using lower precision i.e. fp16.
x^2/n
Internally it can use higher precision for accumulation.
The text was updated successfully, but these errors were encountered:
So #2883 will upgrade large reduce_means to use float by default and #2853 will update the x^2/n calculation to be float as well.
Sorry, something went wrong.
No branches or pull requests
AMDMIGraphX/src/targets/gpu/kernels/include/migraphx/kernels/layernorm.hpp
Line 61 in 7460ac3
x^2/n
can cause accuracy issues when using lower precision i.e. fp16.Internally it can use higher precision for accumulation.
The text was updated successfully, but these errors were encountered: