Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RL-baseline] Model v5 #42

Open
wants to merge 28 commits into
base: RL-with-baseline
Choose a base branch
from
Open

[RL-baseline] Model v5 #42

wants to merge 28 commits into from

Conversation

ziritrion
Copy link
Collaborator

The policy network for model v5 is completely redesigned. It features 6 convolutional layers rather than 3, and it drops the pooling layers because the convolutions already take care of reducing the dimensionality of the input. It also features 2 fully connected layers right after the convolutions, and both the actor head and critic head feature 2 fully connected layers as well.

This model is based on the model featured in this example . This code is meant for PPO, but since it managed to train successfully without significantly modifying the environment state, we took it as a base to see how it would work for REINFORCE with Baseline.

xeviknal and others added 27 commits March 11, 2021 18:30
…-wo-rl into RL-baseline-new-model

Trying to solve conflicts
@ziritrion ziritrion changed the base branch from main to RL-with-baseline April 2, 2021 09:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants