Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A naive question about updating parameters in DDPG. #46

Open
HiddenBeginner opened this issue Mar 4, 2021 · 0 comments
Open

A naive question about updating parameters in DDPG. #46

HiddenBeginner opened this issue Mar 4, 2021 · 0 comments

Comments

@HiddenBeginner
Copy link

HiddenBeginner commented Mar 4, 2021

Hi, first of all, thanks for your awesome codes. This is not about any technical issue, but about the algorithm of the DDPG code.

As far as I know, the DDPG method can exploit online parameter update due to the TD learning. But, in your code, the parameters are updated after an episode is over.

I would like to ask you if there are some theoretical background behind this parameter update interval?

Thank you in advance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant