Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CogvideoX 1.5 IV2 error with sageattention ,please help #343

Open
madisonross1128 opened this issue Jan 5, 2025 · 2 comments
Open

CogvideoX 1.5 IV2 error with sageattention ,please help #343

madisonross1128 opened this issue Jan 5, 2025 · 2 comments

Comments

@madisonross1128
Copy link

Python version: 3.12.7 ,pytorch version: 2.5.1+cu124 ,triton version: 3.1.0

!!! Exception during processing !!! All tensors must have the same dtype.
Traceback (most recent call last):
File "Q:\ComfyUI_windows_portable\ComfyUI\execution.py", line 328, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\execution.py", line 203, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "Q:\ComfyUI_windows_portable\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-cogvideoxwrapper\nodes.py", line 722, in process
latents = model["pipe"](
^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\utils_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-cogvideoxwrapper\pipeline_cogvideox.py", line 778, in call
noise_pred = self.transformer(
^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-cogvideoxwrapper\custom_cogvideox_transformer_3d.py", line 666, in forward
hidden_states, encoder_hidden_states = block(
^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-cogvideoxwrapper\custom_cogvideox_transformer_3d.py", line 323, in forward
attn_hidden_states, attn_encoder_hidden_states = self.attn1(
^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\diffusers\models\attention_processor.py", line 588, in forward
return self.processor(
^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-cogvideoxwrapper\custom_cogvideox_transformer_3d.py", line 170, in call
hidden_states = self.attn_func(query, key, value, attn_mask=attention_mask, is_causal=False)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch_dynamo\eval_frame.py", line 632, in _fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\ComfyUI\custom_nodes\comfyui-cogvideoxwrapper\custom_cogvideox_transformer_3d.py", line 66, in func
return sageattn(q, k, v, is_causal=is_causal, attn_mask=attn_mask)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "Q:\ComfyUI_windows_portable\python_embeded\Lib\site-packages\sageattention\core.py", line 79, in sageattn
assert q.dtype == k.dtype == v.dtype, "All tensors must have the same dtype."
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: All tensors must have the same dtype.

@kijai
Copy link
Owner

kijai commented Jan 5, 2025

What version of sageattention are you using?

@madisonross1128
Copy link
Author

madisonross1128 commented Jan 6, 2025

thanks for replying, its "sageattention-2.0.1-py3.12-win-amd64.egg" ,i follow this guide "https://old.reddit.com/r/StableDiffusion/comments/1h7hunp/how_to_run_hunyuanvideo_on_a_single_24gb_vram_card/" to install it , i didn't try it on the hunyuanvideo though , thought it works on cogvideox the same right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants