--medvram equivalent? #1120
Unanswered
catboxanon
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Is there an equivalent to
--medvram
, like the Stable Diffusion web UI? https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/OptimizationsThe gist of the implementation is that whatever is not being used is offloaded/cached to system RAM. This also means in an idle state, VRAM should theoretically be completely empty. This of course would add more latency when you do want to run inference, but an example use case of what this does allow for is a convenience of being able to do something like running a LLM and LDM sequentially without OOM issues.
Beta Was this translation helpful? Give feedback.
All reactions