Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Part 4 (Final) - Introduce Main RAG Service API and its tests #603

Merged
merged 50 commits into from
Oct 23, 2024
Merged

feat: Part 4 (Final) - Introduce Main RAG Service API and its tests #603

merged 50 commits into from
Oct 23, 2024

Commits on Sep 17, 2024

  1. feat: Add RAGEngine CRD

    @Fei-Guo
    Fei-Guo committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    d369d85 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Merge branch 'main' of https://github.com/Azure/kaito into Ishaan/RAG

    @ishaansehgal99
    ishaansehgal99 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    7740def View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. feat: New RAG Service 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    47c1ce6 View commit details
    Browse the repository at this point in the history

  2. feat: New RAG Service 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    c8bfa18 View commit details
    Browse the repository at this point in the history

  3. fix: Use local index object 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    a28a8d5 View commit details
    Browse the repository at this point in the history

  4. fix: Load Index 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    63ef83d View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. fix: Add ChromaDB VectorStore 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    ff03456 View commit details
    Browse the repository at this point in the history

  2. fix: Add TODOs and comments 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    d02391a View commit details
    Browse the repository at this point in the history

  3. fix: Add function for getting embedding dim 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    d82897d View commit details
    Browse the repository at this point in the history

  4. fix: Updates faiss store to handle multiple indices and dynamically g… 

    …et embedding dim

Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    cd9cbab View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. feat: Add requirements 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    33669fc View commit details
    Browse the repository at this point in the history

  2. feat: fix typos, syntax errors and bugs

    @ishaansehgal99
    ishaansehgal99 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    7165ccf View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. fix: Bugs fixed for managing embeddings 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    7f39939 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. feat: Use a global SimpleIndexStore and seperate StorageContexts 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    1e07beb View commit details
    Browse the repository at this point in the history

  2. feat: Add the load and list indexing functions 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    746c156 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. feat: Remove chromadb from PR 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    3a83f26 View commit details
    Browse the repository at this point in the history

  2. feat: Add CustomLLM Inference 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    cb80f3e View commit details
    Browse the repository at this point in the history

  3. fix: Introduce Custom LLM class and top_k query 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    a0d1186 View commit details
    Browse the repository at this point in the history

  4. fix: Update tests to handle faiss delete not implemented yet 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    4c66387 View commit details
    Browse the repository at this point in the history

  5. fix: Update tests to handle refresh documents 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    35b5113 View commit details
    Browse the repository at this point in the history

  6. fix: Update tests for loading and persisting data 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    742485e View commit details
    Browse the repository at this point in the history

  7. Merge branch 'main' into Ishaan/RAG

    @ishaansehgal99
    ishaansehgal99 authored Oct 2, 2024
    Configuration menu
    Copy the full SHA
    ba03cdd View commit details
    Browse the repository at this point in the history

  8. fix: Update tests for loading index 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    51c7035 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. feat: Move to ragengine folder and remove unneeded CRUD operations (r… 

    …efresh, update, delete)
    @ishaansehgal99
    ishaansehgal99 committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    6e7b827 View commit details
    Browse the repository at this point in the history

  2. fix: Update to include rag unit tests 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 3, 2024
    Configuration menu
    Copy the full SHA
    aaaa21b View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. fix: Update persisting and loading logic 

    Signed-off-by: ishaansehgal99 <[email protected]>
    @ishaansehgal99
    ishaansehgal99 committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    be9d6ed View commit details
    Browse the repository at this point in the history

Commits on Oct 7, 2024

  1. feat: Custom params for llm

    @ishaansehgal99
    ishaansehgal99 committed Oct 7, 2024
    Configuration menu
    Copy the full SHA
    cf24953 View commit details
    Browse the repository at this point in the history

Commits on Oct 8, 2024

  1. Merge branch 'main' into Ishaan/RAG

    @ishaansehgal99
    ishaansehgal99 authored Oct 8, 2024
    Configuration menu
    Copy the full SHA
    eeef54a View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2024

  1. feat: massive update, improvements all across service and enhanced un… 

    …it testing
    @ishaansehgal99
    ishaansehgal99 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    eff5b37 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/Azure/kaito into Ishaan/RAG

    @ishaansehgal99
    ishaansehgal99 committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    83ab9a3 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. fix: Slight fix no need to parse inference result

    @ishaansehgal99
    ishaansehgal99 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    9f52ee8 View commit details
    Browse the repository at this point in the history

  2. nit

    @ishaansehgal99
    ishaansehgal99 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    a232d67 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into Ishaan/RAG

    @ishaansehgal99
    ishaansehgal99 authored Oct 11, 2024
    Configuration menu
    Copy the full SHA
    cee740b View commit details
    Browse the repository at this point in the history

  4. nit

    @ishaansehgal99
    ishaansehgal99 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    afb8606 View commit details
    Browse the repository at this point in the history

  5. fix: remove unused files

    @ishaansehgal99
    ishaansehgal99 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    2455dfd View commit details
    Browse the repository at this point in the history

  6. fix: Example of live test

    @ishaansehgal99
    ishaansehgal99 committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    d32169f View commit details
    Browse the repository at this point in the history

Commits on Oct 21, 2024

  1. Merge branch 'main' of https://github.com/Azure/kaito into Ishaan/RAG

    @ishaansehgal99
    ishaansehgal99 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    5520950 View commit details
    Browse the repository at this point in the history

  2. Update endpoints and remove old class

    @ishaansehgal99
    ishaansehgal99 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    42f288b View commit details
    Browse the repository at this point in the history

  3. pytest fix target

    @ishaansehgal99
    ishaansehgal99 committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    e652935 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. feat: Updated UTs, models and API

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    7748420 View commit details
    Browse the repository at this point in the history

  2. feat: Updated UTs, models and API

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    1b0a7a0 View commit details
    Browse the repository at this point in the history

  3. feat: Updated UTs, models and API

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    1c34fb0 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into Ishaan/RAG

    @ishaansehgal99
    ishaansehgal99 authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    3cba796 View commit details
    Browse the repository at this point in the history

  5. feat: Updated UTs, models and API

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    bc94669 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'Ishaan/RAG' of https://github.com/Azure/kaito into Isha… 

    …an/RAG
    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    7390aa4 View commit details
    Browse the repository at this point in the history

  7. feat: Updated UTs, models and API

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    bc076bd View commit details
    Browse the repository at this point in the history

  8. feat: Updated UTs, models and API

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    f93669b View commit details
    Browse the repository at this point in the history

  9. approx

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    a5dd527 View commit details
    Browse the repository at this point in the history

  10. fix: add ut dependency

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    1000732 View commit details
    Browse the repository at this point in the history

  11. fix: renamed

    @ishaansehgal99
    ishaansehgal99 committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    3d6a623 View commit details
    Browse the repository at this point in the history