Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rnn.py中梯度检查中的epsilon无论取什么值,算出来的梯度都是一样的 #47

Open
nuaawh opened this issue Apr 2, 2019 · 1 comment

Comments

@nuaawh
Copy link

nuaawh commented Apr 2, 2019

rnn.py中梯度检查中的epsilon无论取什么值,算出来的梯度都是一样的

@qsa-fox
Copy link

qsa-fox commented May 1, 2020

这是因为所有地激活函数都是IdentityActivator,意味着没有任何非线性结构,所以算输出值和权重成线性关系,因此无论epsilon取什么值,算出来地梯度都是一样的。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants