Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RAGAtouille cpu only installation #233

Open
tacacs1101-debug opened this issue Jul 17, 2024 · 1 comment
Open

RAGAtouille cpu only installation #233

tacacs1101-debug opened this issue Jul 17, 2024 · 1 comment

Comments

@tacacs1101-debug
Copy link

The current ragatouille installation quite heavy right now. For those who only wants to use it on cpu have to unnecessarily install nvidia-cuda based modules. For a production application, where I have to only load and infer from index on cpu doesn't need to install cuda based modules.
Is there a way currently to install only cpu based libraries in ragatouille.

@abdelkareemkobo
Copy link

for the current version, it really depends on the GPU (cuda) for the training and searching building a cpu version for the current code is not that easy, and not wanted for now.
You may after train your version of Colbert use with fastembed to get best of them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants