Benchmark code from the following paper:
R. Hoque, L.Y. Chen, S. Sharma, K. Dharmarajan, B. Thananjeyan, P. Abbeel, K. Goldberg. Fleet-DAgger: Interactive Robot Fleet Learning with Scalable Human Supervision. Conference on Robot Learning (CoRL), 2022.
First install Python dependencies in a virtual environment by running . install.sh.
To run the IFLB you will need to install Isaac Gym. Download Isaac Gym 1.0rc3 from https://developer.nvidia.com/isaac-gym (you may need to send a request but it should be quickly approved) and read the installation instructions in the docs to pip install into the virtual environment. You will need NVIDIA driver version >= 470.
Then clone NVIDIA IsaacGymEnvs from https://github.com/NVIDIA-Omniverse/IsaacGymEnvs and pip install it into the virtual environment.
We provide demos (and expert model checkpoints) for you already. If desired, you can re-generate task demos by running
python -m main @scripts/args_isaacgym_demos.txt --env_name [ENV_NAME]
followed by
python scripts/extract_demos.py [RAW_DATA_FILE]
where RAW_DATA_FILE is raw_data.pkl in the log directory generated by the experiment above.
After moving the generated task demo file to the appropriate location in env/assets/isaacgym/demos/task/[ENV_NAME].pkl, you can generate constraint demos by running
python -m main @scripts/args_isaacgym_constraints.txt --env_name [ENV_NAME]
followed by
python scripts/extract_constraints.py [RAW_DATA_FILE]
and moving the output pickle file to the correct location in env/assets/isaacgym/demos/constraint.
Run the following scripts from this directory to run the IFL algorithms from the paper, or make your own scripts modeled after these.
. scripts/CUR.sh
. scripts/ensembledagger.sh
. scripts/thriftydagger.sh
. scripts/random.sh
. scripts/BC.sh
All experiment logs should be saved in logs/ (or wherever you set the logdir to be). You can organize this into subfolders, e.g., with mkdir humanoid && mv *Humanoid_* humanoid/. Then you can run python plotting/plot.py logs/humanoid [KEY], where KEY is cumulative_successes, cumulative_viols (hard resets), cumulative_idle_time, cumulative_successes cumulative_human_actions (ROHE), or something else.