New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support ORPO/DPO Liger losses (and LigerORPOTrainer) #2141

Open

5 tasks done

ccdv-ai opened this issue Dec 6, 2024 · 0 comments

Open

5 tasks done

Support ORPO/DPO Liger losses (and LigerORPOTrainer) #2141

ccdv-ai opened this issue Dec 6, 2024 · 0 comments

Assignees

Labels

enhancement wip

ccdv-ai commented Dec 6, 2024

⚠️ Please check that this feature request hasn't been suggested before.

I searched previous Ideas in Discussions didn't find any similar feature requests.
I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

Liger added support for various RL losses that significantly reduce memory.
RL liger losses: linkedin/Liger-Kernel#371
Support LigerORPOTrainer: linkedin/Liger-Kernel#429

✔️ Solution

N/A

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

My issue title is concise, descriptive, and in title casing.
I have searched the existing issues to make sure this feature has not been requested yet.
I have provided enough information for the maintainers to understand and evaluate this request.

ccdv-ai added the enhancement label

NanoCode012 self-assigned this

NanoCode012 added the wip label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment