New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

about replay buffer #22

Open

Mickeyyyang opened this issue Mar 22, 2022 · 1 comment

Mickeyyyang commented Mar 22, 2022

请问训练过程中的经验数据是在电脑硬盘还是存在内存？存在内存的话如果状态空间中有图像是不是很容易就存满了。
---入门rl新人求解

Owner

TianhongDai commented Mar 22, 2022 •

edited

Loading

请问训练过程中的经验数据是在电脑硬盘还是存在内存？存在内存的话如果状态空间中有图像是不是很容易就存满了。 ---入门rl新人求解

是存在内存上的；确实，如果状态空间有图像的话就很容易存满。如果必须得存图像的话，你可以尝试将图像信息存成uint8格式，尽量降低内存。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment