Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CUDA out of memory #12

Open
AvadaBlablabla opened this issue Sep 28, 2022 · 1 comment
Open

CUDA out of memory #12

AvadaBlablabla opened this issue Sep 28, 2022 · 1 comment

Comments

@AvadaBlablabla
Copy link

Hello,

first thank for your fork, I've just tried it and it work nicely, the generated pictures were very nice.

My problem is that cuda run out of memory after just one prompt.

I tried "PYTORCH_CUDA_ALLOC_CONF=max_split_size_mb:128" but it doesn't seems to solve the problem.
I think it is missing a memory reset or something, because stopping and starting again the UI allows for it to work again (for just one prompt).
I'm just guessing because I know nothing about python or cuda (and pretty much anything about coding).

Until now I've been using https://github.com/basujindal/stable-diffusion , this fork work great for me.

Ps: I'm running it in a conda environment, could that be a limiting factor for my memory ?

@victordibia
Copy link
Owner

Thanks for the feedback.
There is a chance I should be attempting to flush memory after each generation.
I will look into this.
Conda shold not be a factor.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants