Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

What are the python and pytorch version? (can not find custom_fwd and custom_bwd in torch.amp，can be found in torch.cuda.amp) #9

Open
yuedajiong opened this issue Jan 10, 2025 · 1 comment
Open

What are the python and pytorch version? (can not find custom_fwd and custom_bwd in torch.amp，can be found in torch.cuda.amp) #9

yuedajiong opened this issue Jan 10, 2025 · 1 comment

Comments

@yuedajiong
Copy link

yuedajiong commented Jan 10, 2025 •
edited
Loading

  1. can not find custom_fwd and custom_bwd in torch.amp，can be found in torch.cuda.amp
    OK: pytorch 2.5.1
    NO: pytorch 2.2.2

  2. low vram
    torch.autocast(device_type=device, dtype=torch.bfloat16)
    this means that our GPU must support bfloat16, otherwise, the VRAM maybe more than 20G.
@jammm
Copy link
Collaborator

jammm commented Jan 10, 2025 •
edited
Loading

pytorch 2.4 and above I believe.

@yuedajiong yuedajiong changed the title What are the python and pytorch version? (can not find custom_fw and custom_bw in torch.amp，can be found in torch.cuda.amp) What are the python and pytorch version? (can not find custom_fwd and custom_bwd in torch.amp，can be found in torch.cuda.amp) Jan 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jammm @yuedajiong