Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Bin Relocation FWBW example #12

Merged
merged 10 commits into from
Jan 28, 2024
Merged

Add Bin Relocation FWBW example #12

merged 10 commits into from
Jan 28, 2024

Conversation

Leo428
Copy link
Collaborator

@Leo428 Leo428 commented Jan 26, 2024

Hi guys, this PR adds the following code:

  1. gym env and wrapper for franka bin relocation forward and backward task
  2. add trainer support for multi learner nodes support for forward backward training
  3. add recording scripts for training demos and images used for training the binary classifier (which only uses front camera images to classify)
  4. add training and eval scripts for running RL with binary classifier
  5. add BC training and eval scripts, as well as BC demo collection script

Thank you for the review!

Copy link
Member

@youliangtan youliangtan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Drop in some comments. otherwise gtg

examples/async_bin_relocation_fwbw_drq/record_bc_demos.py Outdated Show resolved Hide resolved
examples/async_bin_relocation_fwbw_drq/record_demo.py Outdated Show resolved Hide resolved
serl_robot_infra/franka_env/envs/wrappers.py Show resolved Hide resolved
)

checkpoints.save_checkpoint(
f"/home/undergrad/code/serl_dev/examples/async_bin_relocation_fwbw_drq/{FLAGS.classifier_name}_classifier_ckpt",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is okay to hardcode for now, but at least make the path configurable as DEFINE_string() flag

@Leo428
Copy link
Collaborator Author

Leo428 commented Jan 28, 2024

@youliangtan, I addressed the comments above in the new commits and replies. Thank you so much for reviewing!

@youliangtan youliangtan merged commit c2cce4a into main Jan 28, 2024
1 check passed
@youliangtan youliangtan deleted the fwbw branch January 28, 2024 12:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants