Chatbot

References...

Models

https://huggingface.co/MaziyarPanahi/Calme-7B-Instruct-v0.9 https://huggingface.co/MaziyarPanahi/Calme-7B-Instruct-v0.9-GGUF https://huggingface.co/MaziyarPanahi/zephykor-ko-beta-7b-chang-Mistral-7B-Instruct-v0.2-slerp https://huggingface.co/MaziyarPanahi/zephykor-ko-beta-7b-chang-Mistral-7B-Instruct-v0.2-slerp-GGUF

LangChain - llama-cpp-python

https://python.langchain.com/docs/integrations/llms/llamacpp/ https://python.langchain.com/docs/expression_language/interface/#stream

Gradio

https://www.gradio.app/docs/chatbot

Gradio - chatbot streaming

https://huggingface.co/spaces/ysharma/ChatGLM-6b_Gradio_Streaming/blob/f0afe4d535b33ff680b2c2797a45efe1bd129c54/app.py#L21

OpenAI - python main

https://github.com/openai/openai-python/tree/main

Huggingface OpenLLM Leaderboard

https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard