[MODEL REQUEST] Codestral-22B

[EwoutH]

Codestral is a very capable model for programming, it can complete coding functions, write tests, and complete any partial code using a fill-in-the-middle mechanism.

Details of model being requested

• Model name: Codestral-22B
• Source repo link: https://huggingface.co/mistralai/Codestral-22B-v0.1
• Release blog: https://mistral.ai/news/codestral/
• Model use case: Codestral is an open-weight generative AI model explicitly designed for code generation tasks. It helps developers write and interact with code through a shared instruction and completion API endpoint. As it masters code and English, it can be used to design advanced AI applications for software developers.

Since the model is quite large, I would suggest adding quantized versions. A lot of quants are available here.

I think these two would be most suitable:

Filename	Quant type	File Size	Description
Codestral-22B-v0.1-Q6_K.gguf	Q6_K	18.25GB	Very high quality, near perfect, recommended.
Codestral-22B-v0.1-IQ4_XS.gguf	IQ4_XS	11.93GB	Decent quality, smaller than Q4_K_S with similar performance, recommended.

[mestrona-3]

Hi @EwoutH, thank you for the feature request and details! I've added it to our list of requested models.