Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[epic] OLMoE support #66

Closed
5 tasks
tscholak opened this issue Nov 25, 2024 · 1 comment
Closed
5 tasks

[epic] OLMoE support #66

tscholak opened this issue Nov 25, 2024 · 1 comment

Comments

@tscholak
Copy link
Collaborator

tscholak commented Nov 25, 2024 •
edited by sohamparikh
Loading

Tasks
Preview Give feedback
  1. [feat] Support triton cross-entropy for larger vocabularies #52
    enhancement
  2. [bug] Sparse copy runs out of shared memory with many experts #56
    bug
    jlamypoirier
  3. [feat] OLMoE hf converter #61
    enhancement
    sohamparikh
  4. [feat] QK-Norm #82
    enhancement
  5. [feat] Option to disable top-k routing weights normalization #83
    enhancement
@tscholak tscholak changed the title [epic] OLMoE [epic] OLMoE support Nov 25, 2024
@tscholak
Copy link
Collaborator Author

tscholak commented Jan 7, 2025

we're not going to work with OLMoE in the near future. closing

@tscholak tscholak closed this as completed Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tscholak