Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip vectorization and use the full document #917

Open
Azzeo opened this issue Apr 4, 2024 · 0 comments
Open

Skip vectorization and use the full document #917

Azzeo opened this issue Apr 4, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@Azzeo
Copy link

Azzeo commented Apr 4, 2024

It would be great if there was an option for CC to directly use an uploaded document (and basically add the whole document as-is in the prompt). With the advent of models allowing for a bigger context size, a RAG solution is not always the best solution for every problem anymore (for example, finding a needle in a haystack problem, or directly translating or quoting within the document as well as being less reliant on how good the embeddings model is). The current solution, by copy-pasting entire documents is not very clean and user-unfriendly.

I see two possible solutions (feel free to correct me)

  1. When uploading, give the option to vectorise it, or directly add it to the prompt
  2. When the user intent is to perform a specific task for an entire document or group of documents that were previously uploaded, the entire raw content of the document(s) should be added to the prompt. I am not aware if SK offers any of this functionality, but it would be great to see to see some kind of solution for this.
@glahaye glahaye added the enhancement New feature or request label Jun 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants