Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RayOutOfMemoryError: More than 95% of the memory on node xxx is used #2

Open
AptX395 opened this issue Jun 15, 2022 · 1 comment
Open

RayOutOfMemoryError: More than 95% of the memory on node xxx is used #2

AptX395 opened this issue Jun 15, 2022 · 1 comment

Comments

@AptX395
Copy link

AptX395 commented Jun 15, 2022 •
edited
Loading

Hello, thank you so much for the reproduction code!

I have encountered RayOutOfMemoryError when running the code. To address this issue, I have tried set num_agents from the default of 16 to 8 and 4 respectively, but this address remains unsolved. I don't know if the other parameters (such as num_rollout and num_arms) should be changed together.

My machine is a Linux server with 128GB of RAM and 4 2080-Ti GPUs. Could you please show me how to configure the parameters appropriately?

Looking forward to your reply, thanks!
@AptX395
Copy link
Author

AptX395 commented Jun 16, 2022

I have tried setting num_agents, num_rollout, and num_arms to 2, 1, and 4, respectively. The RayOutOfMemoryError still remains. Why does the memory usage keep rising?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@AptX395