Models for testing inference / sampling #6970
danemadsen
started this conversation in
General
Replies: 1 comment 3 replies
-
You can use tinyllamas: https://github.com/ggerganov/llama.cpp/tree/master/examples/convert-llama2c-to-ggml |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I see there's a number of models for testing tokenization here However i would like a model for testing out my implementation of llama.cpp into my front end. Is anyone aware of such a model?
basically any model that would work with simple.cpp and is relatively small (less than 100mb so GIT LFS isn't needed)
Beta Was this translation helpful? Give feedback.
All reactions