Want to use --theme dark --always-high-vram --attention-split #150

kengun2077 · 2024-06-21T09:20:11Z

kengun2077
Jun 21, 2024

Want to use
entry_with_update.py --theme dark --always-high-vram --attention-split

runew0lf · 2024-06-21T09:22:26Z

runew0lf
Jun 21, 2024
Maintainer

good for you, this isnt fooocus or auto1111

4 replies

kengun2077 Jul 29, 2024
Author

Dear, after trying and failing again and again, RuinedFooocus can use Colab HIGH_VRAM when adding some code to the files webui.py and launch.py

!python /content/RuinedFooocus/entry_with_update.py --highvram --share --cuda-malloc --cuda-device 0

The file webui.py add some code

import comfy.model_management as model_management
from comfy.cli_args import args

def get_parser():
parser = argparse.ArgumentParser()
parser.add_argument("--cpu", action="store_true", help="To use the CPU for everything (slow).")
parser.add_argument("--highvram", action="store_true")
parser.add_argument("--use-pytorch-cross-attention", action="store_true", help="Use the new pytorch 2.0 cross attention function.")
parser.add_argument("--cuda-malloc", action="store_true", help="Enable cudaMallocAsync (enabled by default for torch 2.0 and up).")
parser.add_argument("--cuda-device", type=int, default=None, metavar="DEVICE_ID", help="Set the id of the cuda device this instance will use.")
parser.add_argument("--port", type=int, default=None, help="Set the listen port.")

The file launch.py add some code

import argparse
import gradio as gr

def clear_comfy_args():
argv = sys.argv
sys.argv = [sys.argv[0]]
import comfy.cli_args
sys.argv = argv
parser = argparse.ArgumentParser('launch.py', parents=[comfy.cli_args.parser], conflict_handler='resolve')
parser.add_argument("--cpu", action="store_true", help="To use the CPU for everything (slow).")
parser.add_argument("--share", action='store_true', help="Set whether to share on Gradio.")
parser.add_argument("--highvram", action="store_true")
parser.add_argument("--use-pytorch-cross-attention", action="store_true", help="Use the new pytorch 2.0 cross attention function.")
parser.add_argument("--port", type=int, default=None, help="Set the listen port.")
parser.add_argument("--share", action='store_true', help="Set whether to share on Gradio.")
parser.add_argument("--listen", type=str, default=None, metavar="IP", nargs="?", const="0.0.0.0", help="Set the listen interface.")
parser.add_argument("--cuda-malloc", action="store_true", help="Enable cudaMallocAsync (enabled by default for torch 2.0 and up).")
parser.add_argument("--cuda-device", type=int, default=None, metavar="DEVICE_ID", help="Set the id of the cuda device this instance will use.")
comfy.cli_args.args = parser.parse_args()