Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] GenDGRL #1773

Merged
merged 14 commits into from
Jan 16, 2024

amend

600d9f4
Select commit
Loading
Failed to load commit list.
Merged

[Feature] GenDGRL #1773

amend
600d9f4
Select commit
Loading
Failed to load commit list.
PyTorch Bot / Dr.CI completed Jan 16, 2024 in 0s

Dr.CI classification results

{"FAILED":[],"FLAKY":[{"workflowId":7540464299,"id":20525097544,"runnerName":"i-0b8198e31f411973c","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-cpu (3.9) / linux-job","jobName":"tests-cpu (3.9) / linux-job","conclusion":"failure","completed_at":"2024-01-16T11:24:00Z","html_url":"https://github.com/pytorch/rl/actions/runs/7540464299/job/20525097544","head_branch":"gendgrl","pr_number":1773,"head_sha":"600d9f4b72952a1f27947ec017a6de27ddd8d9be","failure_captures":["test/test_libs.py::TestGym::test_vecenvs_env[CartPole-v1]"],"failure_lines":["FAILED test/test_libs.py::TestGym::test_vecenvs_env[CartPole-v1] - AssertionError: Entries in next tensordict do not match entries in root tensordict after reset : tensor([False, True, False, False, False, False, True, False])"],"failure_context":["+ python .github/unittest/helpers/coverage_run_parallel.py -m pytest test --instafail --durations 200 -vv --capture no --ignore test/test_rlhf.py --ignore test/test_distributed.py --timeout=120","+ '[' cpu '!=' cpu ']'","+ pytest test/smoke_test_deps.py -v --durations 200 -k 'test_gym or test_dm_control_pixels or test_dm_control or test_tb'","+ pytest test/smoke_test.py -v --durations 200","+ BATCHED_PIPE_TIMEOUT=60","+ export BATCHED_PIPE_TIMEOUT=60","+ MAX_IDLE_COUNT=100","+ export MAX_IDLE_COUNT=100","+ CKPT_BACKEND=torch","+ export CKPT_BACKEND=torch","+ MKL_THREADING_LAYER=GNU","+ export MKL_THREADING_LAYER=GNU"],"time":"2024-01-16T11:24:04.708753Z"},{"workflowId":7540464299,"id":20525098238,"runnerName":"i-02fb344a42ddb193e","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-gpu (3.8, 12.1) / linux-job","jobName":"tests-gpu (3.8, 12.1) / linux-job","conclusion":"failure","completed_at":"2024-01-16T11:32:23Z","html_url":"https://github.com/pytorch/rl/actions/runs/7540464299/job/20525098238","head_branch":"gendgrl","pr_number":1773,"head_sha":"600d9f4b72952a1f27947ec017a6de27ddd8d9be","failure_captures":["test/test_libs.py::TestGym::test_vecenvs_env[CartPole-v1]"],"failure_lines":["FAILED test/test_libs.py::TestGym::test_vecenvs_env[CartPole-v1] - AssertionError: Entries in next tensordict do not match entries in root tensordict after reset : tensor([ True, False, False, False, True, False, False, False])"],"failure_context":["+ python .github/unittest/helpers/coverage_run_parallel.py -m pytest test --instafail --durations 200 -vv --capture no --ignore test/test_rlhf.py --timeout=120","+ '[' cu121 '!=' cpu ']'","+ pytest test/smoke_test_deps.py -v --durations 200 -k 'test_gym or test_dm_control_pixels or test_dm_control or test_tb'","+ pytest test/smoke_test.py -v --durations 200","+ BATCHED_PIPE_TIMEOUT=60","+ export BATCHED_PIPE_TIMEOUT=60","+ MAX_IDLE_COUNT=100","+ export MAX_IDLE_COUNT=100","+ CKPT_BACKEND=torch","+ export CKPT_BACKEND=torch","+ MKL_THREADING_LAYER=GNU","+ export MKL_THREADING_LAYER=GNU"],"time":"2024-01-16T11:32:28.297837Z"},{"workflowId":7540464309,"id":20525094150,"runnerName":"i-0ea9eb20ef5cc4b29","authorEmail":"[email protected]","name":"Unit-tests on Windows / unittests-cpu / windows-job","jobName":"unittests-cpu / windows-job","conclusion":"failure","completed_at":"2024-01-16T11:11:26Z","html_url":"https://github.com/pytorch/rl/actions/runs/7540464309/job/20525094150","head_branch":"gendgrl","pr_number":1773,"head_sha":"600d9f4b72952a1f27947ec017a6de27ddd8d9be","failure_captures":["The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128"],"failure_lines":["##[error]The process 'C:\Program Files\Git\cmd\git.exe' failed with exit code 128"],"failure_context":[],"time":"2024-01-16T11:20:45.335240Z"}],"BROKEN_TRUNK":[{"workflowId":7540464304,"id":20525095376,"runnerName":"i-0c6eaac02bc90e3d5","authorEmail":"[email protected]","name":"Habitat Tests on Linux / tests (3.9, 11.6) / linux-job","jobName":"tests (3.9, 11.6) / linux-job","conclusion":"failure","completed_at":"2024-01-16T11:03:34Z","html_url":"https://github.com/pytorch/rl/actions/runs/7540464304/job/20525095376","head_branch":"gendgrl","pr_number":1773,"head_sha":"600d9f4b72952a1f27947ec017a6de27ddd8d9be","failure_captures":["test/test_libs.py::TestHabitat::test_habitat_render[False-HabitatPick-v0]"],"failure_lines":["FAILED test/test_libs.py::TestHabitat::test_habitat_render[False-HabitatPick-v0] - AssertionError: ESP_CHECK failed: Renderer was not created with a background render thread, cannot do async drawing"],"failure_context":["+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/run_test.sh","+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/install.sh","+ bash /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/setup_env.sh","+ cp /pytorch/rl/.github/unittest/linux_libs/scripts_habitat/10_nvidia.json /usr/share/glvnd/egl_vendor.d/10_nvidia.json","+ this_dir=/pytorch/rl/.github/unittest/linux_libs/scripts_habitat","++ pwd","++ cd .github/unittest/linux_libs/scripts_habitat","+++ dirname .github/unittest/linux_libs/scripts_habitat/run_all.sh","+ apt-get dist-upgrade -y","+ apt-get install -y g++ gcc","+ apt-get install -y libglvnd0 libgl1 libglx0 libegl1 libgles2","+ apt-get install -y libglfw3 libgl1-mesa-glx libosmesa6 libglew-dev"],"time":"2024-01-16T11:03:38.392638Z"},{"workflowId":7540464299,"id":20525099580,"runnerName":"i-037132c83d8fdc32c","authorEmail":"[email protected]","name":"Unit-tests on Linux / tests-stable-gpu (3.8, 11.8) / linux-job","jobName":"tests-stable-gpu (3.8, 11.8) / linux-job","conclusion":"failure","completed_at":"2024-01-16T11:30:38Z","html_url":"https://github.com/pytorch/rl/actions/runs/7540464299/job/20525099580","head_branch":"gendgrl","pr_number":1773,"head_sha":"600d9f4b72952a1f27947ec017a6de27ddd8d9be","failure_captures":["test/test_rb.py::TestStorages::test_storage_state_dict[torchsnapshot-False-memmap-memmap]"],"failure_lines":["FAILED test/test_rb.py::TestStorages::test_storage_state_dict[torchsnapshot-False-memmap-memmap] - ImportError: torchsnapshot not found, but the backend points to this library. Consider installing torchsnapshot or choose another backend (available backends: ['torch', 'torchsnapshot'])"],"failure_context":["+ python .github/unittest/helpers/coverage_run_parallel.py -m pytest test --instafail --durations 200 -vv --capture no --ignore test/test_rlhf.py --timeout=120","+ '[' cu118 '!=' cpu ']'","+ pytest test/smoke_test_deps.py -v --durations 200 -k 'test_gym or test_dm_control_pixels or test_dm_control or test_tb'","+ pytest test/smoke_test.py -v --durations 200","+ BATCHED_PIPE_TIMEOUT=60","+ export BATCHED_PIPE_TIMEOUT=60","+ MAX_IDLE_COUNT=100","+ export MAX_IDLE_COUNT=100","+ CKPT_BACKEND=torch","+ export CKPT_BACKEND=torch","+ MKL_THREADING_LAYER=GNU","+ export MKL_THREADING_LAYER=GNU"],"time":"2024-01-16T11:32:34.851252Z"}],"UNSTABLE":[]}