Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(cpu_offload.py): support selective layers' activation cpu offload async #391

Open
wants to merge 7 commits into
base: develop
Choose a base branch
from
Prev Previous commit
Next Next commit
feat(comm/attn_offload.py): fix ci lint err
huangting4201 committed Dec 3, 2024

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
commit 230d81dcceb297db4d0d7050349ebbe9c9e92ba9
1 change: 0 additions & 1 deletion internlm/core/parallel/comm/attn_offload.py
Original file line number Diff line number Diff line change
@@ -1,6 +1,5 @@
import torch

from internlm.core.context import global_context as gpc
from internlm.utils.common import get_current_device

global_attn_offload = None
Loading