Skip to content

Commit

Permalink
Document stac-geoparquet and sentinel-2-l2a workflow creation (#304)
Browse files Browse the repository at this point in the history
* Document how stac-geoparquet workflow was created

* sentinel-2 too

* Bump version

* Increase chunk length
  • Loading branch information
Tom Augspurger authored Jun 17, 2024
1 parent fb2f7de commit 6e8a0a3
Show file tree
Hide file tree
Showing 3 changed files with 11 additions and 3 deletions.
2 changes: 1 addition & 1 deletion datasets/sentinel-2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,5 +19,5 @@ az acr build -r {the registry} --subscription {the subscription} -t pctasks-sent
Created with

```
pctasks dataset process-items --is-update-workflow sentinel-2-l2a-update -d datasets/sentinel-2/dataset.yaml
pctasks dataset process-items --is-update-workflow sentinel-2-l2a-update -d datasets/sentinel-2/dataset.yaml -u
```
2 changes: 1 addition & 1 deletion datasets/sentinel-2/dataset.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,6 @@ collections:
# But we start at depth=2 thanks to the split, so we use a depth of 5 here.
min_depth: 5
max_depth: 5
chunk_length: 5000
chunk_length: 20000
chunk_storage:
uri: blob://sentinel2l2a01/sentinel2-l2-info/pctasks-chunks/
10 changes: 9 additions & 1 deletion datasets/stac-geoparquet/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,4 +19,12 @@ This requires the following permissions
By default, this workflow will generate geoparquet assets for all collections.
If you want to select a subset of collections, you can use either:
1. `extra_skip`: This will skip certain collections
1. `collections`: This will only generate geoparquet for the specified collection(s).
1. `collections`: This will only generate geoparquet for the specified collection(s).

## Updates

The workflow used for updates was registered with

```
pctasks workflow update datasets/workflows/stac-geoparquet.yaml
```

0 comments on commit 6e8a0a3

Please sign in to comment.