Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lazy loading #76

Open
rafaqz opened this issue Nov 22, 2022 · 0 comments
Open

Lazy loading #76

rafaqz opened this issue Nov 22, 2022 · 0 comments

Comments

@rafaqz
Copy link
Member

rafaqz commented Nov 22, 2022

A key advantage of using native julia code instead of GDAL is we can do everything lazily.

Recently using GeoJSON.jl with Rasters.jl I found it effortlessly handled rasterizing 3GB files that crashed GDAL. The same should be true of this package (it likely already is in some cases, but we can make it a lot more so).

I've spoken with @visr abouit lazy loading here, but making this issue to track implementation.

The idea would be to eagerly load shape metadata like bounds and type, and lazily load the point vectors.

(And although this is an old format disciplines like ecology are totally dependent on it, often with multi-GB files)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant