Skip to content

Issues: huggingface/trl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

81 Open 1,087 Closed
81 Open 1,087 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

OOM when unwrap_model_for_generation
#2250 opened Oct 18, 2024 by hlnchen
2 of 4 tasks
Usage of padding_free ❓ question Seeking clarification or more information
#2242 opened Oct 16, 2024 by zwhe99
1
Add model merging callback ✨ enhancement New feature or request 🧒 good second issue Good for contributors with basic project familiarity
#2241 opened Oct 16, 2024 by lewtun
2
examples/scripts/kto.py does not work 🐛 bug Something isn't working 🏋 KTO Related to KTO
#2238 opened Oct 15, 2024 by reihig-ut
2 of 4 tasks
1
@qgallouedec
1
log_reports.py Inefficiencies in Processing Log Files ✨ enhancement New feature or request
#2237 opened Oct 15, 2024 by Mefisto04
2 of 4 tasks
2
online DPO evaluation 🐛 bug Something isn't working 🏋 Online DPO Related to Online DPO
#2228 opened Oct 14, 2024 by woshizouguo
1 of 4 tasks
1
1
[Trainer] Changing the dataset dynamically during training 🏋 DPO Related to DPO ❓ question Seeking clarification or more information
#2227 opened Oct 14, 2024 by ilyasoulk
1
[GKD] 0 loss 🐛 bug Something isn't working 🏋 GKD Related to GKD
#2217 opened Oct 10, 2024 by nivibilla
2 of 4 tasks
3
[GKD] mismatch in tensors when stacking log probs 🐛 bug Something isn't working 🏋 GKD Related to GKD
#2215 opened Oct 10, 2024 by nivibilla
2 of 4 tasks
@kashif
3
Indefinite waiting time while training using reward_modeling.py 🐛 bug Something isn't working 🏋 Reward Related to Reward modelling
#2212 opened Oct 10, 2024 by himanshushukla12
2 of 4 tasks
3
RuntimeError: probability tensor contains either inf, nan or element < 0 🐛 bug Something isn't working 📱 cli Related to the Command-line interface
#2205 opened Oct 9, 2024 by himanshushukla12
2 of 4 tasks
1
1
Has anyone face with problems that DPO rewards accuracy stuck at 0.5 and the loss stuck at 0.6 to 0.8? 🏋 DPO Related to DPO ⏳ needs more info Additional information or clarification is required to proceed
#2194 opened Oct 7, 2024 by Thewillman
5
A bug when SFT mistral-7B using DataCollatorForCompletionOnlyLM 🏋 SFT Related to SFT
#2192 opened Oct 7, 2024 by smartliuhw
2 of 4 tasks
6
Does AutoModelForCausalLMWithValueHead get abandoned in PPOv2Trainer ? 🐛 bug Something isn't working
#2188 opened Oct 6, 2024 by Sino-Huang
2 of 4 tasks
add support for closed source model for Generalized Knowledge Distillation Trainer ✨ enhancement New feature or request 🏋 GKD Related to GKD ⏳ needs more info Additional information or clarification is required to proceed
#2179 opened Oct 5, 2024 by imrankh46
@kashif
3
Drop GPT2 in our test in favour of a more recent instruct model 👶 good first issue Good for newcomers
#2177 opened Oct 4, 2024 by qgallouedec
6
Gradient accumulation yields worse results than the equivalent batch size ⏳ needs more info Additional information or clarification is required to proceed ❓ question Seeking clarification or more information
#2175 opened Oct 4, 2024 by benjamin-marie
1
20
[CGPO] Add support for Constrained Generative Policy Optimization ✨ enhancement New feature or request
#2156 opened Oct 2, 2024 by gaetanlop
3 tasks
@gaetanlop
2
Handling of "auto" in deepspeed config causes crash under Zero3 🐛 bug Something isn't working 🚀 deepspeed Related to deepspeed 🏋 DPO Related to DPO 🙋 help wanted Open invitation for community members to contribute
#2154 opened Oct 2, 2024 by Ben-Schneider-code
2 of 4 tasks
1
1
SFTTrainer Raises NotImplementedError with IterableDataset 🐛 bug Something isn't working
#2138 opened Sep 27, 2024 by research-boy
2 of 4 tasks
4
Use unittest's methods for the tests ✨ enhancement New feature or request 👶 good first issue Good for newcomers
#2137 opened Sep 27, 2024 by qgallouedec
@qgallouedec
[SFT VLM] Add support for Molmo models 🧒 good second issue Good for contributors with basic project familiarity 🏋 SFT Related to SFT 👁️ VLM Related to Visual Language Models
#2136 opened Sep 27, 2024 by lewtun
1
@sergiopaniego
15
SFT_vlm script is missing the chat template 🐛 bug Something isn't working 🏋 SFT Related to SFT 👁️ VLM Related to Visual Language Models
#2135 opened Sep 27, 2024 by edbeeching
@edbeeching
1
[RewardTrainer] Change print_rich_table parameters during Reward Model training 🏋 Reward Related to Reward modelling
#2121 opened Sep 25, 2024 by rmovva
2
[Data] Implement dataset mixer for combining datasets in training ✨ enhancement New feature or request
#2112 opened Sep 24, 2024 by lewtun
1
1
ProTip! What’s not been updated in a month: updated:<2024-09-18.