From d69599d14aae20fcd4b591cb88a5672dc9c6bcce Mon Sep 17 00:00:00 2001 From: Hugues Chocart Date: Thu, 19 Sep 2024 19:35:01 +0100 Subject: [PATCH] Update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index cd1afe7..5a61bfb 100644 --- a/README.md +++ b/README.md @@ -257,6 +257,7 @@ If you're interested in the field of LLM, you may find the above list of milesto ## LLM Deployment > Reference: [llm-inference-solutions](https://github.com/mani-kantap/llm-inference-solutions) +- [Lunary](https://github.com/lunary-ai/lunary) - Open-source Observability, Prompt Management & Analytics for LLMs. - [SGLang](https://github.com/sgl-project/sglang) - SGLang is a fast serving framework for large language models and vision language models. - [vLLM](https://github.com/vllm-project/vllm) - A high-throughput and memory-efficient inference and serving engine for LLMs. - [TGI](https://huggingface.co/docs/text-generation-inference/en/index) - a toolkit for deploying and serving Large Language Models (LLMs).