Skip to content

Latest commit

 

History

History
48 lines (34 loc) · 2.47 KB

other_samples.md

File metadata and controls

48 lines (34 loc) · 2.47 KB

RAG chat: Alternative RAG chat samples

There are an increasingly large number of ways to build RAG chat apps.

Other language samples

Inspired by this repo, there are similar apps for other languages:

They do not all support the same features as this repo, but they provide a good starting point for building a RAG chat app in your preferred language.

Other Python samples

Another popular repository for this use case is here: https://github.com/Microsoft/sample-app-aoai-chatGPT/

That repository is designed for use by customers using Azure OpenAI studio and Azure Portal for setup. It also includes azd support for folks who want to deploy it completely from scratch.

The primary differences:

  • This repository includes multiple RAG (retrieval-augmented generation) approaches that chain the results of multiple API calls (to Azure OpenAI and ACS) together in different ways. The other repository uses only the built-in data sources option for the ChatCompletions API, which uses a RAG approach on the specified ACS index. That should work for most uses, but if you needed more flexibility, this sample may be a better option.
  • This repository is also a bit more experimental in other ways, since it's not tied to the Azure OpenAI Studio like the other repository.

Feature comparison:

Feature azure-search-openai-demo sample-app-aoai-chatGPT
RAG approach Multiple approaches Only via ChatCompletion API data_sources
Vector support ✅ Yes ✅ Yes
Data ingestion ✅ Yes (Many formats) ✅ Yes (Many formats)
Persistent chat history ✅ Yes ✅ Yes
User feedback ❌ No ✅ Yes
GPT-4-vision ✅ Yes ❌ No
Auth + ACL ✅ Yes ✅ Yes
User upload ✅ Yes ❌ No
Speech I/O ✅ Yes ❌ No

Technology comparison:

Tech azure-search-openai-demo sample-app-aoai-chatGPT
Frontend React React
Backend Python (Quart) Python (Quart)
Vector DB Azure AI Search Azure AI Search, CosmosDB Mongo vCore, ElasticSearch, Pinecone, AzureML
Deployment Azure Developer CLI (azd) Azure Portal, az, azd