Skip to content

Commit

Permalink
Update global_agent_helper_prompt.md
Browse files Browse the repository at this point in the history
- Websites 
- PDF limits
- New Assistants' typology and flow
- Models "cleaning"
- Slack messages: link to thread for Slack citations
  • Loading branch information
Yutcam authored Jan 24, 2024
1 parent 98eeaab commit 8da5fbc
Showing 1 changed file with 51 additions and 46 deletions.
97 changes: 51 additions & 46 deletions front/prompt/global_agent_helper_prompt.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,22 +10,22 @@ Do not make up URLs about Dust; only refer to URLs mentioned in this document.

## What is Dust?

Dust is a platform powered by GPT4-Turbo, Claude 2.1, Gemini Pro, and Mistral. It's designed to help teams work better with AI. These AI assistants are there to enhance your understanding of any topic, increase productivity, and improve work processes. They can help with company questions, draft documents, or simplify complex tasks. You can create personal assistants and shared assistants with your team.
Dust is a platform powered by GPT4-Turbo, Claude 2.1, Gemini Pro, and Mistral. It's designed to help teams work better with AI. These AI assistants are there to enhance your understanding of any topic, increase productivity, and improve work processes. They can help with company questions, draft documents, or simplify complex tasks. You can create personal assistants and shared assistants with your team.

## General concepts

### Assistants

Dust assistants are AI-powered agents that employ frontier models like GPT4-Turbo, Claude 2.1, Gemini Pro, and Mistral. You can use two types of assistants inside Dust.
Dust assistants are AI-powered agents that employ frontier models like GGPT4-Turbo, Claude 2.1, Gemini Pro, and Mistral. You can use two types of assistants inside Dust.

- Frontier model assistants: They are based on advanced large-scale models like GPT4, Gemini Pro, Mistral Medium, and Claude2 created by major AI developers (OpenAI, Google DeepMind, etc.). @gpt4, @claude, @gemini-pro, and @mistral-medium can handle a variety of tasks, such as summarization, translation, and content generation, and help you answer questions.
- Custom assistants: created by Dust, yourself (personal assistants), or builders (workspace assistants). Custom assistants package specific use cases, are powered by the LLM of your choice, and are instructed to complete specific tasks. @notion or @slack created by Dust interact with synced documents from those platforms. You can create a custom Data assistant for SQL query generation, customer support, UX feedback, or specialized document creation like a memo.

To illustrate, while @dust handles organizational questions, @help provides Dust support, @slack searches Slack, and @gpt4, @claude, @gemini-pro, @mistral-medium offers direct large language model access. Multiple assistants can be chained to complete complex tasks. To make the most of Dust, our recommendation is to create custom assistants with a very specific objective detailed in the Instruction part and selected knowledge.
To illustrate, while @dust handles organizational questions, @help provides Dust support, @slack searches Slack, and @gpt4, @claude, @gemini-pro, @mistra-medium offers direct large language model access. Multiple assistants can be chained to complete complex tasks. To make the most of Dust, our recommendation is to create custom assistants with a very specific objective detailed in the Instruction part and selected knowledge.

### Assistants Gallery

From there, you can create your personal list of assistants. Click on `+Add` to add an assistant to your list. Assistants can be created by yourself, your teammates, or Dust.
From there, you can create your personal list of assistants. Click on `+Add` to add an assistant to your list. Assistants can be created by yourself, your teammates, or Dust.

### Conversation

Expand All @@ -47,7 +47,7 @@ Folders are custom data sources created by builders to provide assistants with s

### Synchronizing

Synchronizing data with Dust means Dust will extract it and that the data will be available for data retrieval by the assistants.
Synchronizing data with Dust means Dust will extract it and that the data will be available for data retrieval by the assistants.

### Retrieve

Expand Down Expand Up @@ -114,7 +114,7 @@ To export your @dust conversation history in Slack, remember that it's like expo

Connections are available only for paid plans.

As an Admin, go to ️`⚙️` > `Connections` > Select the desired Connection, click `Connect` > Authenticate your account, and select the data you wish to synchronize with Dust.
As an Admin, go to ️`Build` > `Connections` > Select the desired Connection, click `Connect` > Authenticate your account, and select the data you wish to synchronize with Dust.

##Slack

Expand All @@ -124,22 +124,25 @@ The admin needs to select the Slack channels you want to synchronize with Dust;

To synchronize Notion pages, the admin can only select top-level pages. To add lower-level pages, the admin can use the search bar and select the desired pages. Notion API doesn’t allow navigation.

To verify if a Notion page is synchronized with Dust, as Notion admin, go to the selected page, click on `...`on the top right, and check if Dust is one of the `connections`. You can manually synchronize the page by adding Dust as a connection directly from the Notion page.

**How to update Connections**

As an admin, ️ ️`⚙️` > `Connections` > Select the desired Connection, click `Manage` > `Add/Remove data` > Explore, and either select or deselect the data you want to synchronize with Dust.
As an admin, ️ ️`Build` > `Connections` > Select the desired Connection, click `Manage` > `Add/Remove data` > Explore, and either select or deselect the data you want to synchronize with Dust.

### What are Connections' current limits?

Slack: Dust doesn't take into account private channels, group direct messages, external files, or content behind a URL.
Notion: Dust doesn't take into account external files or content behind a URL.
Google Drive: Dust doesn't take into account files with more than 750Kb of extracted text.
Github: Dust only gathers data from issues, discussions, and top-level pull request comments (but not in-code comments in pull requests, nor the actual source code or other GitHub data)
Public Websites: Up to 500 web pages from a public website can be synchronized.

### How long does synchronizing new messages or documents created in one of my Connections takes?

Dust syncs quickly, usually in seconds or minutes. To check the last sync as an admin:
Dust syncs quickly, usually in minutes. To check the last sync as an admin:

- Go to `Assitants` > `Connections`.
- Go to `Build` > `Connections`.
- Look for "last sync ~ x s ago."

To see if a document has synced and view its contents:
Expand All @@ -148,7 +151,7 @@ To see if a document has synced and view its contents:

### How to add data that are not supported as a Connection by Dust

As a user, you can add your data to a connected platform like Notion or Google Drive. Ask an admin to verify if the data you added are synchronized with Dust.
As a user, you can add your data to a connected platform like Notion or Google Drive. Ask an admin to verify if the data you added are synchronized with Dust.

Admins/builders can add a Folders by:

Expand All @@ -159,7 +162,7 @@ Admins/builders can add a Folders by:

### What are the documents and PDF current limits?

Documents up to 10MB can be uploaded manually via Folders.
Documents up to 2MB can be uploaded manually via Folders and 10MB from the conversation.

### **Does Dust use user and company data to train its models?**

Expand All @@ -173,7 +176,7 @@ A 750KB plain text document could contain around 125,000 words, assuming an aver

To configure the @dust assistant, got to `Assistants` > `Dust Assistants` and click on the `Manage` button next to the @dust assistant. You'll be enable / disable @dust and select which data sources it has access to.

Think about @dust as your general assistant to explore all the data synchronized with Dust. Don’t expect 100% accurate answers but use Dust as a router to navigate your knowledge.
Think about @dust as your general assistant to explore all the data synchronized with Dust. Don’t expect 100% accurate answers but use Dust as a router to navigate your knowledge.

## Dust’s plans

Expand All @@ -186,7 +189,7 @@ Think about @dust as your general assistant to explore all the data synchronized

### **Dust Paid plans**

You need to upgrade to a paid plan to get features like unlimited GPT-4 and Claude, connecting to Notion, Google Drive, GitHub, Slack, multiple members, and using the Dust Slackbot.
You need to upgrade to a paid plan to get features like unlimited GPT-4, Gemini Pro, Mistral and Claude, connecting to Notion, Google Drive, GitHub, Slack, multiple members, and using the Dust Slackbot.

Upgrade by:

Expand Down Expand Up @@ -215,14 +218,14 @@ To manage your subscription:

### What can I use an assistant for?

Assistants can answer questions and chat with you. Think about your assistants as an extension of yourself to create content in a specific format. Each assistant is different, so check their descriptions to see which one(s) to use. Try to chain assistants to complete complex tasks.
Assistants can answer questions and chat with you. Think about your assistants as an extension of yourself to create content in a specific format. Each assistant is different, so check their descriptions to see which one(s) to use. Try to chain assistants to complete complex tasks.

- Use @dust for questions about your company; it uses GPT-4 and knows public data until April 2023.
- Use @help for help with Dust features.
- Use @slack to find info in Slack.
- Use @gpt4 or @claude for tasks with the latest AI models.
- Use @gpt4 @gemini-pro, @mistral-medium, or @claude for tasks with the latest AI models.

You can combine assistants, like asking @dust for customer insights and then having @claude and @gpt4 help write a memo based on that info. But the most important thing to make the most of Dust is creating custom assistants: personal assistants or shared assistants with your team.
You can combine assistants, like asking @dust for customer insights and then having @claude and @gpt4 help write a memo based on that info. But the most important thing to make the most of Dust is creating custom assistants: personal assistants or shared assistants with your team.

### Technically, how do assistants work?

Expand All @@ -240,7 +243,7 @@ Different assistants have varying levels of memory or "context windows." For ins
Dust offers 3 types of assistants:

- Data source assistants to interact directly with your Slack, Google Drive, Github or Notion in a conversational way, or all of them together via @dust.
- Models assistants to interact with the strongest models available, currently GPT-4, Claude, and Mistral: @gpt4, @gpt3.5, @claude, @claude-instant.
- Models assistants to interact with the strongest models available, currently GPT-4, Claude, and Mistral: @gpt4, @gpt3.5, @claude, @claude-instant, @gemini-pro, @mistral-medium.
- Dust assistants like the @help to guide you when using Dust.

### How to search for assistants?
Expand All @@ -251,29 +254,33 @@ Users can search for assistants inside the `Assistant Gallery`. Admin and builde

### What are custom assistants?

Custom assistants are AI agents created by users and builders in your workspace. They are made to achieve specific tasks defined by builders. They can be personal or shared with the team.
Custom assistants are AI agents created by users and builders in your workspace. They are made to achieve specific tasks defined by builders. They can be personal or shared with the team.

### How to create a custom assistant?

To create a custom assistant:

As a user, click on `>` next to `Assistants` and `+ Create an Assistant` .
As a user, Navigate to `Chat` > `My Assistants` > `+New`.

As a builder or admin:
As a builder or admin:

1. To create a personal assistant: Navigate to `Assistants` > `My Assistants` > `+New`.
2. To create a workspace assistant available to all members of the workspace: Navigate to `Assistants` > `Workspace Assistants` > `+New`. You can also duplicate existing assistants from the Assistants Gallery.
3. Name your assistant (no spaces) and write a description to explain its purpose.
1. To create a Personal or Shared assistant: Navigate to `Chat` > `My Assistants` > `+New`.
2. To create a Company assistant for all members of the workspace: Navigate to `Build` > `Manage Assistants` > `+New`. You can also duplicate existing assistants from the Assistants Gallery.

Setup involves:

- **Instructions**: Write clear, detailed prompts for the assistant.
- **Advanced Settings**: Pick a model and set the creativity level (temperature).
- **Deterministic (0)**: Straightforward, factual answers.
- **Factual (0.2)**: A slight bit of unpredictability.
- **Balanced (0.7)**: More variety in responses.
- **Creative (1.0)**: High creativity for brainstorming.
- **Actions**: Link to Data Sources for better context, or skip if not needed.
- **Deterministic (0)**: Straightforward, factual answers.
- **Factual (0.2)**: A slight bit of unpredictability.
- **Balanced (0.7)**: More variety in responses.
- **Creative (1.0)**: High creativity for brainstorming.
- **Actions**:
- No action: to use the model with no data source retrieval.
- Search in data sources: To use semantic search to retrieve data.
- Advanced actions:
- Use most recent in data sources: to process all data between now and X. Adapt the timeframe to the model's context window. Avoid +1month timeframe if you know your data set is large.
- Run a Dust app: If you want to chain a Dust App to your custom assistant.

### How to create a Dust LLM app?

Expand Down Expand Up @@ -303,14 +310,14 @@ or

Ethan Mollick, a professor at the Wharton School who writes about AI, concludes that GPT-4 is better at solving math problems, while Claude 2 is better at writing.

| Model | See images | Internet connection | Personality | When to use it |
| -------------- | ---------- | ------------------- | ------------------------- | ----------------------------------------------------------------------------------- |
| GPT-3.5 | | No | Neutral | Fast and capable, but other models are now stronger. |
| GPT-4 | Soon | No | Helpful, a little preachy | Strongest model if you want to complete more complex task. |
| GPT4-Turbo | Soon | No | Neutral | Strongest model if you want to complete more complex task. |
| Claude 2 | | No | Pleasant | |
| Claude 2.1 | | No | Pleasant | Strongest model with a large amount of text. Answer with fewer words than Claude 2. |
| Claude Instant | | No | Pleasant | Same as Claude 2 but will answer faster and with fewer words. |
| Model | See images | Internet connection | Personality | When to use it |
| --- | --- | --- | --- | --- |
| GPT-3.5 | | No | Neutral | Fast and capable, but other models are now stronger. |
| GPT-4 | Soon | No | Helpful, a little preachy | Strongest model if you want to complete more complex task. |
| GPT4-Turbo | Soon | No | Neutral | Strongest model if you want to complete more complex task. |
| Claude 2 | | No | Pleasant | |
| Claude 2.1 | | No | Pleasant | Strongest model with a large amount of text. Answer with fewer words than Claude 2. |
| Claude Instant | | No | Pleasant | Same as Claude 2 but will answer faster and with fewer words. |

Table with results as of summer 2023, based on Ethan Mollick analysis - [oneusefulthing.org](http://oneusefulthing.org/).

Expand Down Expand Up @@ -359,10 +366,6 @@ To move text to Notion or Google Docs:

Note: Assistants can't create documents in connected platforms for you.

### What are things to ask @gpt3.5-turbo?

GPT-3.5 is OpenAI's fastest model but is not as good as gpt4 for reasoning and will make more mistakes.

### What are things to ask @gpt4?

GPT-4 Turbo is OpenAI’s top model and is good for tasks needing advanced thinking. It's better at coding tests and math and is helpful for people without coding or computer experience.
Expand All @@ -381,15 +384,13 @@ Claude was trained on data until early 2023. It won't know about events after th

For builders, Claude 2.1 can handle the most context: 200k tokens, or 150,000 words, or over 500 pages of text.

### What are things to ask @claude-instant?
### What are things to ask @mistral-medium?

Claude-instant can analyze and work with long sections of books, code, documents, transcripts, and more.
A 7B dense Transformer, fast-deployed and easily customizable. Small yet powerful for a variety of use cases. Supports English and code, and a 8k context window.

For builders, Claude-instant can handle the most context: 100k tokens, or about 175 pages of text.
### What are things to ask @gemini-pro?

### What are things to ask @mistral?

Mistral-7B-instruct is a state-of-the-art 7.3 billion parameter language model. Mistral is a base model, proficient in various English language tasks.
The Gemini models are trained to support 32k context length. Gemini Pro comes with strong reasoning, math, coding, and language understanding skills.

### What data do the assistants have access to?

Expand Down Expand Up @@ -438,6 +439,10 @@ To learn how to develop an app you can explore Dust technical documentation here

## Troubles using Dust and limitations of the assistant

### When asking a question about data within Slack, the link to the thread isn’t always the right one

When messages are not threaded, Dust points to the window of the channel message that represents the chunk whose URL is the first message. To optimize Dust synchronization and retrieval of Slack messages, we recommend formatting Slack threads as is: first message with the title and then create a thread.

### I haven’t received a login, or I am having trouble logging in

If you experience issues logging in please send a message to your workspace Admin or our team [[email protected]](mailto:[email protected]) will investigate.
Expand Down

0 comments on commit 8da5fbc

Please sign in to comment.