Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

polish(mark): add hybrid action space support to ActionNoiseWrapper #829

Merged
merged 3 commits into from
Sep 20, 2024

Conversation

MarkHolmstrom
Copy link
Contributor

Description

Previously, target policy smoothing could not be used in the TD3 algorithm with hybrid action spaces due to the action object being a dictionary composed of an action_type tensor, an action_args tensor, and a logit tensor instead of the expected action object being the action_type tensor. The PR adds checks for the nested dictionary and adds noise only to the action_args tensor corresponding to the continuous action.

Related Issue

#789

TODO

Check List

  • merge the latest version source branch/repo, and resolve all the conflicts
  • pass style check
  • pass all the tests

Add hybrid action space support to action noise wrapper.
@puyuan1996 puyuan1996 added the enhancement New feature or request label Sep 13, 2024
@puyuan1996 puyuan1996 changed the title Add Hybrid Action Space Support to Action Noise Wrapper polish(mark): add hybrid action space support to ActionNoiseWrapper Sep 18, 2024
@PaParaZz1 PaParaZz1 merged commit 6ae1396 into opendilab:main Sep 20, 2024
12 of 15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants