Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add new RAG pipeline project #97

Merged
merged 35 commits into from
Apr 9, 2024
Merged

Add new RAG pipeline project #97

merged 35 commits into from
Apr 9, 2024

Commits on Mar 25, 2024

  1. first commit, new llm project

    @strickvl
    strickvl committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    02fc428 View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2024

  1. add indexing functionality

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    603c597 View commit details
    Browse the repository at this point in the history

  2. finish basic pipeline functionality

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    05b488b View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'origin/main' into feature/new-rag-pipeline

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    aedc529 View commit details
    Browse the repository at this point in the history

  4. update llm_utils and format

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    9c50f80 View commit details
    Browse the repository at this point in the history

  5. refactored the url scraper + utils

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    c85da66 View commit details
    Browse the repository at this point in the history

  6. refactoring part 2

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    362c572 View commit details
    Browse the repository at this point in the history

  7. fix DB update functionality

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    998d593 View commit details
    Browse the repository at this point in the history

  8. add option to switch out the llm within the CLI

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    35cf8c4 View commit details
    Browse the repository at this point in the history

  9. use litellm and drop garbage logs

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    80e8286 View commit details
    Browse the repository at this point in the history

  10. formatting

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    d19ce77 View commit details
    Browse the repository at this point in the history

  11. remove unused title + url

    @strickvl
    strickvl committed Mar 26, 2024
    Configuration menu
    Copy the full SHA
    74bf3a8 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. rip out langchain completely

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    642209b View commit details
    Browse the repository at this point in the history

  2. error handling and debug statements

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    d4dd39d View commit details
    Browse the repository at this point in the history

  3. add code inspo acknowledgements

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    9f7cd9e View commit details
    Browse the repository at this point in the history

  4. add and update docstrings

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    8964005 View commit details
    Browse the repository at this point in the history

  5. remove unused code and use zenml urls

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    7ec4393 View commit details
    Browse the repository at this point in the history

  6. use smaller embedding model

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    aad2972 View commit details
    Browse the repository at this point in the history

  7. update the dimensionality to match the new embedding model

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    cc320fc View commit details
    Browse the repository at this point in the history

  8. no cache for embeddings generation

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    830de9f View commit details
    Browse the repository at this point in the history

  9. fix constant

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    0c7cd69 View commit details
    Browse the repository at this point in the history

  10. visualise embeddings

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    fb8a2ea View commit details
    Browse the repository at this point in the history

  11. tiny tweaks to params

    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    5341331 View commit details
    Browse the repository at this point in the history

  12. Merge branch 'feature/new-rag-pipeline' of github.com:zenml-io/zenml-… 

    …projects into feature/new-rag-pipeline
    @strickvl
    strickvl committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    18580d1 View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. add images

    @strickvl
    strickvl committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    4ed2552 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. update pipeline code to abstract out DB creds

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    66824d8 View commit details
    Browse the repository at this point in the history

  2. add images

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    a70f50b View commit details
    Browse the repository at this point in the history

  3. final README updates

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    0705761 View commit details
    Browse the repository at this point in the history

  4. add RAG pipeline image

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    b6c487d View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into feature/new-rag-pipeline

    @strickvl
    strickvl authored Apr 8, 2024
    Configuration menu
    Copy the full SHA
    5806d2d View commit details
    Browse the repository at this point in the history

  6. formatting

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    a11e4f4 View commit details
    Browse the repository at this point in the history

  7. add super simple RAG pipeline

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    3897798 View commit details
    Browse the repository at this point in the history

  8. even more basic RAG

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    6ba2874 View commit details
    Browse the repository at this point in the history

  9. add a third irrelevant question

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    0662ec5 View commit details
    Browse the repository at this point in the history

  10. Refactor preprocess_text and answer_question functions

    @strickvl
    strickvl committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    6f342a5 View commit details
    Browse the repository at this point in the history