Skip to content

Latest commit

 

History

History
13 lines (8 loc) · 1.19 KB

README.md

File metadata and controls

13 lines (8 loc) · 1.19 KB

LLM on AWS SageMaker Examples

A standard SageMaker notebook instance should be sufficient to run below demos. e.g. "ml.t3.medium"

  • chatglm2-langchain-vetordb_deploy.ipynb is an example for deploying THUDM/chatglm2-6b with vectorDB Chroma and LangChain on AWS SageMaker Platform, targeting at building private query-answer system powered by vectorDB and LLM.

  • baichuan13b-langchain-vetordb_deploy.ipynb is an example for deploying baichuan-inc/Baichuan-13B-Chat with vectorDB Chroma and LangChain(ducument processing only) on AWS SageMaker Platform, targeting at building private query-answer system powered by vectorDB and LLM.

  • chatglm3-streaming-deploy.ipynb is a streaming outputs example deployed on SageMaker.

  • bedrock-langchain-vectordb.ipynb is an example for combining bedrock-claude with vectorDB for llm+RAG usecase.

  • bedrock-knowledgebase-streamlit.ipynb is an example for combining bedrock-claude, KnowledgeBase and Streamlit for llm+RAG usecase.

Stay tuned ...