Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About num_steps #28

Open
cjdjr opened this issue Dec 3, 2020 · 1 comment
Open

About num_steps #28

cjdjr opened this issue Dec 3, 2020 · 1 comment

Comments

@cjdjr
Copy link

cjdjr commented Dec 3, 2020

I am confused about the function _get_parallel_step_context() in nets/attention_model.py#L367.
What does num_steps mean? Could you please explain it in detail?
Thanks! o( ̄▽ ̄)ブ

@wouterkool
Copy link
Owner

Hi,

See also #29. The reason that there is a steps dimension is that this can be used to evaluate the model on a given tour in a single forward pass, which is much more efficient than one step at the time. This could be useful for, e.g., supervised training (teacher forcing) or things like experience replay. This code is a leftover of some early experiments in that direction which I thought may still be useful to somebody.

Wouter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants