geopandas to ibis.memtable

[ozgurkalan]

Hi,

I've tried geopandas to parquet and read parquet in ibis. Geometry is displayed as binary column.

Is there a good way to manage GeoJSON files?

[cpcloud]

Hi @ozgurkalan!

We don't currently have way to manage GeoJSON files with any local backends at the moment e.g., DuckDB, DataFusion, etc.

Are you interested in using this feature on a particular backend?

Also would be interested to hear about your use case. Are you interested in being able to do general geospatial analysis with any local engine?

[ozgurkalan]

Hi @cpcloud ,

I have integrated almost all my working processes with ibis. Geopandas is not a must but would be great if we had.

I have a geojson file, I am reading districts from the file and rest of the data is related to these districts in tables.
I thought GIS abilities of ductDB would be interesting.

Maybe reading geojson into DuckDB and having ibis handling wrangling can be interesting. What would you recommend?

Bests. Özgür.

[cpcloud]

As of https://github.com/ibis-project/ibis/releases/tag/7.2.0 (pip install ibis-framework==7.2.0) we have the ability read GeoJSON using DuckDB:

In [35]: from ibis.interactive import *

In [36]: con = ibis.duckdb.connect()

In [37]: t = con.read_geo("ci/ibis-testing-data/geojson/zones.geojson")

In [38]: t[["zone", "geom"]]
Out[38]:
┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃ zone                                                                               ┃ geom                                                                             ┃
┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┩
│ string                                                                             │ geospatial:geometry                                                              │
├────────────────────────────────────────────────────────────────────────────────────┼──────────────────────────────────────────────────────────────────────────────────┤
│ Newark Airport                                                                     │ <POLYGON ((933100.918 192536.086, 933091.011 192572.175, 933088.585 192604.9...> │
│ Jamaica Bay                                                                        │ <MULTIPOLYGON (((1033269.244 172126.008, 1033439.643 170883.946, 1033473.265...> │
│ Allerton/Pelham Gardens                                                            │ <POLYGON ((1026308.77 256767.698, 1026495.593 256638.616, 1026567.23 256589....> │
│ Alphabet City                                                                      │ <POLYGON ((992073.467 203714.076, 992068.667 203711.502, 992061.716 203711.7...> │
│ Arden Heights                                                                      │ <POLYGON ((935843.31 144283.336, 936046.565 144173.418, 936387.922 143967.75...> │
│ Arrochar/Fort Wadsworth                                                            │ <POLYGON ((966568.747 158679.855, 966615.256 158662.292, 966524.882 158822.2...> │
│ Astoria                                                                            │ <POLYGON ((1010804.218 218919.641, 1011049.165 218914.083, 1011117.534 21891...> │
│ Astoria Park                                                                       │ <POLYGON ((1005482.276 221686.466, 1005304.898 221499.117, 1004958.187 22174...> │
│ Auburndale                                                                         │ <POLYGON ((1043803.993 216615.925, 1043849.708 216473.163, 1043900.798 21633...> │
│ Baisley Park                                                                       │ <POLYGON ((1044355.072 190734.321, 1044612.122 190156.818, 1044849.742 19026...> │
│ …                                                                                  │ …                                                                                │
└────────────────────────────────────────────────────────────────────────────────────┴──────────────────────────────────────────────────────────────────────────────────┘

[ozgurkalan]

awesome 👍🏽