Skip to content

Commit

Permalink
Update freezing encoder mem engagement
Browse files Browse the repository at this point in the history
  • Loading branch information
anwai98 committed Dec 22, 2024
1 parent be3bdb6 commit d8df10b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion finetuning/livecell_finetuning.py
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ def finetune_livecell(args):

# NOTE: memory req. for all vit_b models (compared on A100 80GB)
# vit_b
# freeze_encoder: ~ GB
# freeze_encoder: ~ 33.89 GB
# QLoRA: ~48.54 GB
# LoRA: ~48.62 GB
# FFT: ~49.56 GB
Expand Down

0 comments on commit d8df10b

Please sign in to comment.