Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ingest intl csvs #83

Open
wants to merge 16 commits into
base: main
Choose a base branch
from
Open

Ingest intl csvs #83

wants to merge 16 commits into from

Commits on Nov 19, 2020

  1. Add logic and tests to improve separation between API and worldbase data

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    acc8611 View commit details
    Browse the repository at this point in the history

  2. Add blank=True to company source fields

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    5957bd0 View commit details
    Browse the repository at this point in the history

  3. Modify the WB ingest process so that we can import UK and Intl format… 

    … CSV files
    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    dd4b490 View commit details
    Browse the repository at this point in the history

  4. Add national id numbers and mappings

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    ddd06f4 View commit details
    Browse the repository at this point in the history

  5. handle unmapped reg numbers appropriately

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    dbe0059 View commit details
    Browse the repository at this point in the history

  6. continue processing if csv column count is wrong

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    7f8cf6e View commit details
    Browse the repository at this point in the history

  7. Add interrim ingest logging output and check ingest timestamp

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    f3e1237 View commit details
    Browse the repository at this point in the history

  8. Add gunicorn worker timeout

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    a5624d6 View commit details
    Browse the repository at this point in the history

  9. fixup! Add logic and tests to improve separation between API and worl… 

    …dbase data
    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    b8ea296 View commit details
    Browse the repository at this point in the history

  10. Add db indexes for company timestamp fields

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    a5693c5 View commit details
    Browse the repository at this point in the history

  11. Add missing APM vars to pytest.ini

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    72e7ba9 View commit details
    Browse the repository at this point in the history

  12. Bump codecov

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    6a732e4 View commit details
    Browse the repository at this point in the history

  13. Disable APM when running tests

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    98dde0f View commit details
    Browse the repository at this point in the history

  14. Fix pytest bug on py 3.8

    @lgarvey
    lgarvey committed Nov 19, 2020
    Configuration menu
    Copy the full SHA
    987a9f1 View commit details
    Browse the repository at this point in the history

Commits on Dec 8, 2020

  1. Add extra tests

    @lgarvey
    lgarvey committed Dec 8, 2020
    Configuration menu
    Copy the full SHA
    377be24 View commit details
    Browse the repository at this point in the history

  2. add blank=True to date fields

    @lgarvey
    lgarvey committed Dec 8, 2020
    Configuration menu
    Copy the full SHA
    91135b5 View commit details
    Browse the repository at this point in the history