Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(datasets): Replace geopandas.GeoJSONDataset with geopandas.GenericDataset #812

Open
wants to merge 29 commits into
base: main
Choose a base branch
from
Open

feat(datasets): Replace geopandas.GeoJSONDataset with geopandas.GenericDataset #812

wants to merge 29 commits into from

Commits on Aug 22, 2024

  1. ci: Fix pandas.DeltaTableDataset tests (kedro-org#811) 

    Fix deltatable tests

Signed-off-by: Ankita Katiyar <[email protected]>
Signed-off-by: Harm Matthias Harms <[email protected]>
    @ankatiyar @harm-matthias-harms
    ankatiyar authored and harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    f63d517 View commit details
    Browse the repository at this point in the history

  2. feat(datasets): Add geopandas ParquetDataset 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    bb20cf8 View commit details
    Browse the repository at this point in the history

  3. Add release notes 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    6026742 View commit details
    Browse the repository at this point in the history

  4. Add parquet dataset to docs 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    d54c181 View commit details
    Browse the repository at this point in the history

  5. Fix typo in tests 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    3fc3af4 View commit details
    Browse the repository at this point in the history

  6. Fix pylint type 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    94d02e7 View commit details
    Browse the repository at this point in the history

  7. Discard changes to kedro-datasets/docs/source/api/kedro_datasets.rst 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    fe5c31d View commit details
    Browse the repository at this point in the history

  8. Discard changes to kedro-datasets/kedro_datasets/geopandas/__init__.py 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    032f259 View commit details
    Browse the repository at this point in the history

  9. Extend geojson dataset to support more file types 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    15fa4ba View commit details
    Browse the repository at this point in the history

  10. Discard changes to kedro-datasets/tests/pandas/test_deltatable_datase… 

    …t.py

Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    04fd6f8 View commit details
    Browse the repository at this point in the history

  11. Update RELEASE.md 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    04ff6a2 View commit details
    Browse the repository at this point in the history

  12. Add test for unsupported file format 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    a8dbb0c View commit details
    Browse the repository at this point in the history

  13. Merge branch 'main' into feature/add_geopandas_parquet_dataset

    @harm-matthias-harms
    harm-matthias-harms committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    9d3ff7f View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Cleanup GeoJSONDataset 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    7106376 View commit details
    Browse the repository at this point in the history

  2. Fix lint 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    e4d69e9 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into feature/add_geopandas_parquet_dataset

    @harm-matthias-harms
    harm-matthias-harms committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    72be3c8 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Merge branch 'main' into feature/add_geopandas_parquet_dataset

    @harm-matthias-harms
    harm-matthias-harms committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    2b58924 View commit details
    Browse the repository at this point in the history

  2. Replace GeoJSONDataset by GenericDataset 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1335db1 View commit details
    Browse the repository at this point in the history

  3. Update pyproject.toml 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b743845 View commit details
    Browse the repository at this point in the history

  4. Update RELEASE.md 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1e540f4 View commit details
    Browse the repository at this point in the history

  5. Use new default fs args 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e84ac93 View commit details
    Browse the repository at this point in the history

Commits on Sep 10, 2024

  1. Merge branch 'main' into feature/add_geopandas_parquet_dataset

    @harm-matthias-harms
    harm-matthias-harms committed Sep 10, 2024
    Configuration menu
    Copy the full SHA
    9e88c5e View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. Fix pattern in test 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    0fd94c8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into feature/add_geopandas_parquet_dataset

    @harm-matthias-harms
    harm-matthias-harms committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    da204fa View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Use fiona for python < 3.11 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    6b2a225 View commit details
    Browse the repository at this point in the history

  2. Install fiona dependency for python < 3.11 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    db1b446 View commit details
    Browse the repository at this point in the history

  3. Revert fiona test 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    f1bda0e View commit details
    Browse the repository at this point in the history

  4. Use fiona because pyogrio doesnt support fsspec 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    0dab99f View commit details
    Browse the repository at this point in the history

  5. Format file 

    Signed-off-by: Harm Matthias Harms <[email protected]>
    @harm-matthias-harms
    harm-matthias-harms committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    978ad6c View commit details
    Browse the repository at this point in the history