Why is Llama-3_1-Nemotron-51B-Instruct not GGUF'able? #10024

Unanswered

ymcki asked this question in Q&A

ymcki
Oct 23, 2024

Isn't it also has the same architecture as 70B?

https://huggingface.co/bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF/discussions/1

Replies: 0 comments

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment