Skip to content

Issues: EricLBuehler/mistral.rs

Model Wishlist
#156 opened Apr 16, 2024 by EricLBuehler
Open 82
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

65 Open 175 Closed
65 Open 175 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

UQFF File Not Generated When Using Metal Features bug Something isn't working
#810 opened Sep 30, 2024 by solaoi
Molmo support new feature New feature or request
#809 opened Sep 30, 2024 by win4r
Llama 3.2 Vision 11B on Mac: Error "thread '<unnamed>' panicked at mistralrs-core/src/sampler.rs" while inferring image bug Something isn't working models Additions to model or architectures triaged This error has been reproduced or otherwise triaged.
#808 opened Sep 30, 2024 by mathav95raj
2
Llama 3.2 on macOS: "Metal contiguous affine I64 not implemented" bug Something isn't working triaged This error has been reproduced or otherwise triaged.
#807 opened Sep 30, 2024 by ChristianWeyer
9
Return finish_reason as an Enum - with wrapped stopping word/sequence/tok new feature New feature or request
#800 opened Sep 27, 2024 by ShelbyJenkins
Add kernel support for AArch64 specific GGUF files, i.e. Q4_0_*_* new feature New feature or request
#799 opened Sep 27, 2024 by smpurkis
example grammar is failed bug Something isn't working
#797 opened Sep 27, 2024 by higumachan
1
Phi-3.5-vision-Instruct muliples images loading new feature New feature or request
#795 opened Sep 25, 2024 by Aveline67
4
Additional math kernel support? new feature New feature or request
#794 opened Sep 25, 2024 by dylanetaft
RequestMessage with tool_calls in Assistant message. bug Something isn't working
#793 opened Sep 25, 2024 by Jeadie
2
404 error when loading Phi3-small-8k-instruct bug Something isn't working
#789 opened Sep 23, 2024 by rlouf
CUDA_ERROR_ILLEGAL_ADDRESS when running Llama3 and Llama3.1
#783 opened Sep 20, 2024 by ShelbyJenkins
4
How to deploy mistralrs on Android for large model inference? new feature New feature or request
#779 opened Sep 17, 2024 by sopaco
1
Running in the MacBook M2 Pro Metal mode is too slow, and it becomes incredibly slow when the issue is slightly more complex. bug Something isn't working
#774 opened Sep 15, 2024 by sopaco
v0.3.0 missing binaries bug Something isn't working
#764 opened Sep 10, 2024 by aretrace
1
Slow CUDA inference speed optimization
#763 opened Sep 8, 2024 by ShelbyJenkins
2
metal phi3 --dtype bf16 "Function 'cast_f32_bf16' does not exist bug Something isn't working
#761 opened Sep 7, 2024 by jk2K
1
AICI -> llguidance? new feature New feature or request
#754 opened Sep 6, 2024 by mmoskal
CUDA out of memory with a presumed "full" offload to CPU bug Something isn't working
#751 opened Sep 4, 2024 by av
blocking_recv hangs after first iteration in loop bug Something isn't working
#750 opened Sep 4, 2024 by solaoi
Text generation: Implement beam search new feature New feature or request
#746 opened Sep 3, 2024 by ChristianWeyer
Prebuilt binary for python bindings new feature New feature or request
#744 opened Sep 3, 2024 by mert-kurttutan
2
Support for Gemma2 models in GGUF format new feature New feature or request
#722 opened Aug 28, 2024 by solaoi
Cuda error when running gemma2 bug Something isn't working
#715 opened Aug 27, 2024 by gqf2008
Enable multiple CPU from arguments new feature New feature or request
#680 opened Aug 13, 2024 by lij55
6
ProTip! Updated in the last three days: updated:>2024-09-29.