Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support ingestion from multiple directories #16

Merged
merged 14 commits into from
Oct 27, 2023
Merged

Support ingestion from multiple directories #16

merged 14 commits into from
Oct 27, 2023

Commits on Oct 6, 2023

  1. Accept multiple directories

    @apoorva918
    apoorva918 committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    03e00ce View commit details
    Browse the repository at this point in the history

Commits on Oct 10, 2023

  1. support multiple directories in raw file ingestion

    @apoorva918
    apoorva918 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    2b831bb View commit details
    Browse the repository at this point in the history

  2. support multiple directories in parquet ingestion

    @apoorva918
    apoorva918 committed Oct 10, 2023
    Configuration menu
    Copy the full SHA
    6d426dc View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. Added separate class FileUtils

    @apoorva918
    apoorva918 committed Oct 13, 2023
    Configuration menu
    Copy the full SHA
    8031bc3 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Merge branch 'stability-improvements' into task-multiple-directories

    @apoorva918
    apoorva918 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    230d23a View commit details
    Browse the repository at this point in the history

  2. Fix code for FileUtils class

    @apoorva918
    apoorva918 committed Oct 18, 2023
    Configuration menu
    Copy the full SHA
    e73bd74 View commit details
    Browse the repository at this point in the history

Commits on Oct 19, 2023

  1. Add unit tests for rawfile

    @apoorva918
    apoorva918 committed Oct 19, 2023
    Configuration menu
    Copy the full SHA
    90b6a82 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2023

  1. Add unit tests for parquet file

    @apoorva918
    apoorva918 committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    31a6340 View commit details
    Browse the repository at this point in the history

  2. code cleanup

    @apoorva918
    apoorva918 committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    20799f2 View commit details
    Browse the repository at this point in the history

  3. fix process task delay parameter

    @apoorva918
    apoorva918 committed Oct 23, 2023
    Configuration menu
    Copy the full SHA
    46cc036 View commit details
    Browse the repository at this point in the history

Commits on Oct 24, 2023

  1. fix rawfile extension

    @apoorva918
    apoorva918 committed Oct 24, 2023
    Configuration menu
    Copy the full SHA
    f8e9acb View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2023

  1. fix rawfile tests

    @apoorva918
    apoorva918 committed Oct 25, 2023
    Configuration menu
    Copy the full SHA
    fe0881d View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. fix parquet file test

    @apoorva918
    apoorva918 committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    9f6df50 View commit details
    Browse the repository at this point in the history

  2. code cleanup and refactoring

    @apoorva918
    apoorva918 committed Oct 26, 2023
    Configuration menu
    Copy the full SHA
    e0df75c View commit details
    Browse the repository at this point in the history