Skip to content

Issues: Lightning-AI/litgpt

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

241 Open 575 Closed
241 Open 575 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

self.proj in CausalSelfAttention too large if config.n_query_groups < config.n_head? question Further information is requested
#1890 opened Dec 25, 2024 by mseeger
1
I've been Verifying settings while fine-tuning the dataset... After a long time, the cursor kept flashing question Further information is requested
#1887 opened Dec 24, 2024 by PiaoGengHan
1
Slow download from HuggingFace Hub (capped at 10.5 MB/s) bug Something isn't working
#1886 opened Dec 23, 2024 by Andrei-Aksionov
Overwrite system prompt on load/generate enhancement New feature or request
#1879 opened Dec 21, 2024 by twsl
Exporting LoRA to HF format without merging question Further information is requested
#1878 opened Dec 20, 2024 by M1TR
2
Fine-Tuning Chat Model with Domain-Specific Data for custom dataset question Further information is requested
#1877 opened Dec 18, 2024 by anantgupta129
failure converting pretrained litgpt checkpoints to HF format: a reproducible example bug Something isn't working
#1871 opened Dec 12, 2024 by 2533245542
Are there any plans to support multimodal and reinforcement learning? question Further information is requested
#1869 opened Dec 11, 2024 by dz1iang
1
Loading checkpoint before fabric.setup(model) gets abnormal loss when using fabric.init_module() question Further information is requested
#1868 opened Dec 10, 2024 by kobenaxie
1
Improvements of KVCache and refactoring of subclasses of classes in model.py enhancement New feature or request
#1867 opened Dec 10, 2024 by mseeger
1
OpenCoder Series enhancement New feature or request
#1858 opened Dec 7, 2024 by ysjprojects
Convert HF checkpoint to litgpt format question Further information is requested
#1854 opened Dec 5, 2024 by GhostXu11
2
writing throughput question Further information is requested
#1852 opened Dec 3, 2024 by sadrafh
How to convert and use huggingface checkpoint in litgpt ? question Further information is requested
#1850 opened Dec 3, 2024 by manshmaurya
Load an AWQ model via python API question Further information is requested
#1849 opened Dec 3, 2024 by GhostXu11
2
Issues Converting lit_model.pth to Huggingface Format Using convert_from_litgpt question Further information is requested
#1847 opened Dec 2, 2024 by Kidand
7
Adding Meta's MobileLLM enhancement New feature or request
#1846 opened Nov 30, 2024 by palmex
Show a warning if there is no enough VRAM for the selected model enhancement New feature or request
#1842 opened Nov 29, 2024 by Andrei-Aksionov
Show a warning if there is no enough space to download weights enhancement New feature or request
#1841 opened Nov 29, 2024 by Andrei-Aksionov
Finetune LLM model for Classification task question Further information is requested
#1839 opened Nov 27, 2024 by Mustehsen-AI
Pretraining an OLMo model on the SlimPajama dataset question Further information is requested
#1837 opened Nov 26, 2024 by aflah02
16
Performance degradation on multi-node pretrain question Further information is requested
#1836 opened Nov 25, 2024 by HaebinShin
How to disable hf_transfer? question Further information is requested
#1835 opened Nov 22, 2024 by vabatista
1
Multi-gpu training with slurm times out bug Something isn't working
#1832 opened Nov 19, 2024 by nightingal3
6
pretraining multi jobs question Further information is requested
#1831 opened Nov 18, 2024 by sadrafh
ProTip! Exclude everything labeled bug with -label:bug.