Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for llama 3.2 1b it and 3.2 3b it #68

Open
bsudharsan-amalgam opened this issue Oct 12, 2024 · 3 comments
Open

Add support for llama 3.2 1b it and 3.2 3b it #68

bsudharsan-amalgam opened this issue Oct 12, 2024 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@bsudharsan-amalgam
Copy link

These models are amazing and ideally suited for picovoice llm. Would be good to get this in picovoice format or a transform code that can convert these models in hf in 4 bit to the picovoice format. Thanks so much!

@ErisMik ErisMik self-assigned this Oct 15, 2024
@ErisMik
Copy link
Contributor

ErisMik commented Oct 15, 2024

Hello @bsudharsan-amalgam , we will consider adding llama 3.2 models to our roadmap but unfortunately I don't have any estimates for when it will be finished.

@bsudharsan-amalgam
Copy link
Author

Thanks @ErisMik

Is there a converter code or so that safetensor files or gguf files for 1b can be converted and tested? Kindly let me know if there's something we can do to help in interim. Thanks again for the excellent engine!

@ErisMik
Copy link
Contributor

ErisMik commented Oct 15, 2024

Sorry, we don't have any way for you to convert from another format to the Picovoice format at this time.

@kenarsa kenarsa added the enhancement New feature or request label Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants