Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✏️ Edit URLs to shapefiles from UNOSAT #138

Merged
merged 8 commits into from
Apr 12, 2024
Merged

Conversation

weiji14
Copy link
Owner

@weiji14 weiji14 commented Feb 2, 2024

Old CERN link under https://unosat-maps.web.cern.ch/ID/ seems to be unavailable. Need new links

TODO:

Patches #62 and #31

@weiji14 weiji14 added the documentation Improvements or additions to documentation label Feb 2, 2024
@weiji14 weiji14 added this to the 0.7.0 milestone Feb 2, 2024
@weiji14 weiji14 self-assigned this Feb 2, 2024
@weiji14 weiji14 changed the title ✏️ Edit URL to Mount Talakmau landslide shapefile ✏️ Edit URLs to shapefiles from UNOSAT Feb 2, 2024
@weiji14
Copy link
Owner Author

weiji14 commented Feb 2, 2024

Getting �[0;31mDataSourceError�[0m: '/vsizip/vsicurl/https://unosat-maps.web.cern.ch/MY/FL20191217MYS/FL20191217MYS_SHP.zip/ST1_20191215_WaterExtent_Johor_AOI2.shp' does not exist in the file system, and is not recognized as a supported dataset name. This exception is thrown by __iter__ of PyogrioReaderIterDataPipe(kwargs={}, source_datapipe=IterableWrapperIterDataPipe) at https://readthedocs.org/projects/zen3geo/builds/23317987/. Can't seem to figure out where that shapefile went, maybe wait for a bit to see if it pops up again 🙏

Edit: Can't find the Johor shapefile anymore, so switching to a new area over Northern Kelantan Malaysia (see commit 558190d)

The link to the 20191215 Johor flood water shapefile is no longer available, so switching to 20170104 flood shapefile over the Narathiwat Province in Thailand and Northern Kelantan State in Malaysia. Using an internet archive link this time instead of the UNOSAT link, not only to future-proof against future link rot, but also because the server hosting https://unosat.org/static/unosat_filesystem/2460/FL20170106THA_SHP.zip does not support range requests. Increased chip size from 128x128 to 512x512 to reduce number of batches.
Minor changes to the bounding box coordinates of the returned STAC item.
Updated actions/checkout and actions/setup-python to silence deprecated warning on Node.js 16 (see https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/).
The UNOSAT link doesn't support range requests, resulting in a `DataSourceError: Range downloading not supported by this server!` error. Using the Internet Archive's permalink instead.
The latest dask=2024.4.1 version installed via readthedocs has a bug with `import datashader` raising `ModuleNotFoundError: No module named 'dask_expr'`. Xref holoviz/datashader#1319
The less than sign at c24338a didn't work on the readthedocs build.
@weiji14 weiji14 merged commit a260f8f into main Apr 12, 2024
4 checks passed
@weiji14 weiji14 deleted the doc/mt-talakmau-link branch April 12, 2024 06:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant