InftyAI

All

13 repositories

llmaz
Public
☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
kubernetes huggingface llm modelscope llamacpp vllm llm-inference text-generation-inference ollama sglang
Go
•
Apache License 2.0
•11•53•32•0•Updated Jan 27, 2025Jan 27, 2025
scheduler-plugins
Public
Scheduler plugins designed for smart scheduling with llmaz.
Go
•1•3•0•1•Updated Jan 27, 2025Jan 27, 2025
website
Public
Website and Blogs.
blog website
HTML
•
MIT License
•1•1•1•0•Updated Jan 26, 2025Jan 26, 2025
Awesome-LLMOps
Public
🎉 An awesome & curated list of best LLMOps tools.
awesome
9•36•0•0•Updated Jan 25, 2025Jan 25, 2025
Manta
Public
💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯
kubernetes distributed-systems cache p2p-network llm
Go
•
Apache License 2.0
•2•20•14•1•Updated Dec 6, 2024Dec 6, 2024
llmboard
Public
ChatUI for LLMs on llmaz.
dashboard llm llmops
Python
•
Apache License 2.0
•5•3•1•0•Updated Nov 18, 2024Nov 18, 2024
omnistore
Public
🎯 An unified python client to communicate with various kinds of object-store providers.
python oss s3 gcs minio object-store
Python
•
MIT License
•2•2•3•0•Updated Nov 11, 2024Nov 11, 2024
.github
Public
1•0•0•0•Updated Oct 23, 2024Oct 23, 2024
community
Public
The InftyAI community.
Apache License 2.0
•1•0•0•0•Updated Oct 23, 2024Oct 23, 2024
template-repo
Public
A template repo.
Apache License 2.0
•1•0•0•0•Updated Sep 18, 2024Sep 18, 2024
llmaz-helm
Public
Helm installation for llmaz.
inference helm-chart llm llmops llmaz
Smarty
•1•0•1•0•Updated Sep 11, 2024Sep 11, 2024
llmlite
Public
🌵 A library helps to communicate with all kinds of LLMs consistently.
llmops
Python
•
MIT License
•2•15•18•0•Updated Jul 5, 2024Jul 5, 2024
PR-Copilot
Public
Your AI pair programmer 🤖️ specialized in code review, code summary and even code completion. 🧑‍💻🐛
Python
•
MIT License
•3•2•2•0•Updated Jun 29, 2024Jun 29, 2024