Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Chore/56 option to include large unused dependencies #60

Merged

Conversation

saattrupdan
Copy link
Collaborator

@saattrupdan saattrupdan commented Aug 16, 2024

Changed

  • Changed default embedder in RagSystem to OpenAIEmbedder from E5Embedder.

Added

  • Added new e5 and cpu extras, where e5 installs the sentence-transformers
    dependency required for the E5Embedder, and you can add cpu to install the
    CPU-version of torch to save disk space (note that this is not available on MacOS,
    however).
  • Added new from_config class methods to RagSystem and Demo to create instances
    from a configuration file (YAML or JSON). See the readme for more information.
  • Added new ragger-demo and ragger-compile command line interfaces to run the demo
    and compile the RAG system, respectively. Compilation is useful in cases where you
    want to ensure that all components have everything downloaded and installed before
    use. Both of these take a single --config-file argument to specify a configuration
    file. See the readme for more information.

This closes #56.

@saattrupdan saattrupdan self-assigned this Aug 16, 2024
@saattrupdan saattrupdan merged commit cdbaf0e into staging Aug 21, 2024
2 checks passed
@saattrupdan saattrupdan deleted the chore/56-option-to-include-large-unused-dependencies branch August 21, 2024 11:13
@Alkarex Alkarex linked an issue Aug 21, 2024 that may be closed by this pull request
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Option to exclude (large) unused dependencies
1 participant