Skip to content

Commit

Permalink
Updated datasets 2024-05-24 UTC
Browse files Browse the repository at this point in the history
  • Loading branch information
actions-user committed May 24, 2024
1 parent a739db4 commit 0e9de77
Show file tree
Hide file tree
Showing 6 changed files with 1,770 additions and 1,490 deletions.
2,727 changes: 1,464 additions & 1,263 deletions aws_open_datasets.json

Large diffs are not rendered by default.

447 changes: 227 additions & 220 deletions aws_open_datasets.tsv

Large diffs are not rendered by default.

6 changes: 6 additions & 0 deletions datasets/cmas-data-warehouse.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -72,6 +72,12 @@ Resources:
Type: S3 Bucket
Explore:
- '[Browse Bucket](https://2019platform.s3.amazonaws.com/index.html)'
- Description: 2018v2 Modeling Platform
ARN: arn:aws:s3:::2018v2platform
Region: us-east-1
Type: S3 Bucket
Explore:
- '[Browse Bucket](https://2018v2platform.s3.amazonaws.com/index.html)'
- Description: 2016v3 Modeling Platform
ARN: arn:aws:s3:::2016v3platform
Region: us-east-1
Expand Down
36 changes: 29 additions & 7 deletions datasets/dataforgood-fb-forests.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
Name: High Resolution Canopy Height Maps by WRI and Meta
Description: |
Canopy Height maps for a selection of regions. Created using machine learning models on high-resolution worldwide Maxar satellite imagery.
Documentation: "[Project overview](https://dataforgood.facebook.com/dfg/docs)"
Global and regional Canopy Height Maps (CHM). Created using machine learning models on high-resolution worldwide Maxar satellite imagery.
Documentation: https://github.com/facebookresearch/HighResCanopyHeight
Contact: [email protected]
ManagedBy: "[Meta](https://dataforgood.fb.com/)"
UpdateFrequency: TBD
Expand All @@ -20,22 +20,44 @@ Tags:
License: |
https://creativecommons.org/licenses/by/4.0/
Citation:
Meta and World Resources Institude (WRI) - 2023. High Resolution
Meta and World Resources Institude (WRI) - 2024. High Resolution
Canopy Height Maps (CHM). Source imagery for CHM © 2016 [Maxar](https://www.maxar.com/products/imagery-basemaps).
Accessed DAY MONTH YEAR.
Resources:
- Description: Cloud-optimized GeoTIFF files and Geojson files with observation date
ARN: arn:aws:s3:::dataforgood-fb-data/forests/v1/
- Description: Global Canopy Height maps. GeoTIFF files and Geojson files with observation date
ARN: arn:aws:s3:::dataforgood-fb-data/forests/v1/alsgedi_global_v6_float/
Region: us-east-1
Type: S3 Bucket
Type: S3 Bucket
- Description: California Canopy Height maps. GeoTIFF files and Geojson files with observation date
ARN: arn:aws:s3:::dataforgood-fb-data/forests/v1/California/
Region: us-east-1
Type: S3 Bucket
- Description: Sao Paulo Canopy Height maps. GeoTIFF files and Geojson files with observation date
ARN: arn:aws:s3:::dataforgood-fb-data/forests/v1/sao_paulo/
Region: us-east-1
Type: S3 Bucket
- Description: Sub Saharan Africa Height maps. GeoTIFF files and Geojson files with observation date
ARN: arn:aws:s3:::dataforgood-fb-data/forests/v1/subsaharan_africa/
Region: us-east-1
Type: S3 Bucket
- Description: Model weights
ARN: arn:aws:s3:::dataforgood-fb-data/forests/v1/models/
Region: us-east-1
Type: S3 Bucket
DataAtWork:
Tutorials:
Tools & Applications:
- Title: Global Canopy Height on Earth Engine
URL: https://meta-forest-monitoring-okw37.projects.earthengine.app/view/canopyheight
AuthorName: Meta and WRI
Publications:
- Title: "Using Artificial Intelligence to Map the Earth’s Forests"
URL: https://sustainability.fb.com/blog/2024/04/22/using-artificial-intelligence-to-map-the-earths-forests/
AuthorName: Jamie Tolan, Camille Couprie, John Brandt, Justine Spore, Tobias Tiecke, Tracy Johns and Patrick Nease
- Title: "Every tree counts: Large-scale mapping of canopy height at the resolution of individual trees"
URL: https://research.facebook.com/blog/2023/4/every-tree-counts-large-scale-mapping-of-canopy-height-at-the-resolution-of-individual-trees/
AuthorName: Jamie Tolan, Camille Couprie, and Tracy Johns
- Title: Sub-meter resolution canopy height maps using self-supervised learning and a vision transformer trained on Aerial and GEDI Lidar
URL: https://doi.org/10.48550/arXiv.2304.07213
URL: https://www.sciencedirect.com/science/article/pii/S003442572300439X
AuthorName: Jamie Tolan, Hung-I Yang, Ben Nosarzewski, Guillaume Couairon, Huy Vo, John Brandt, Justine Spore, Sayantan Majumdar, Daniel Haziza, Janaki Vamaraju, Theo Moutakanni, Piotr Bojanowski, Tracy Johns, Brian White, Tobias Tiecke, Camille Couprie

6 changes: 6 additions & 0 deletions datasets/noaa-eri.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,3 +34,9 @@ DataAtWork:
- Title: Using Emergency and Pre-Event Imagery
URL: https://github.com/NOAA-Big-Data-Program/bdp-data-docs/blob/main/NGS/NOAA_ER_Pre_Event_Data.pdf
AuthorName: Jon Sellars
- Title: ERI notebook using SageMaker Studio Lab (SMSL)
URL: https://gitlab.cicsnc.org/workshop-development/eri_notebook
NotebookURL: https://gitlab.cicsnc.org/workshop-development/eri_notebook/-/blob/main/ERI_aws.ipynb
AuthorName: Mya Sears
Services:
- SageMaker Studio Lab
38 changes: 38 additions & 0 deletions datasets/troxel2024.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
Name: 'OpenUniverse Matched Rubin and Roman Simulations: Data Preview (Troxel et al. 2024)'
Description: 'This release consists of simulated data products designed to mimic observations of the same region of the sky as seen by two astronomical facilities: the Nancy Grace Roman Telescope and the Vera C. Rubin Observatory.'
Documentation: https://irsa.ipac.caltech.edu/data/theory/Troxel2024/
Contact: https://irsa.ipac.caltech.edu/docs/help_desk.html
ManagedBy: "NASA/IPAC Infrared Science Archive ([IRSA](https://irsa.ipac.caltech.edu)) at Caltech"
UpdateFrequency: The Troxel 2024 dataset has been finalized and will not be updated.
Tags:
- aws-pds
- astronomy
- imaging
- object detection
- parquet
- satellite imagery
- simulations
- survey
License: https://irsa.ipac.caltech.edu/data_use_terms.html
Citation: "If you use the Troxel 2024 dataset, please follow the [IRSA acknowledgement guidelines](https://irsa.ipac.caltech.edu/ack.html)."
Resources:
- Description: 'The simulated Roman data products include truth files listing the basic physical properties of the simulated astronomical objects; truth images that include the appropriate bandpass and PSF but limited sources of noise; calibrated images that include relevant backgrounds and major sources of noise; and coadded images created using the IMCOM software.'
ARN: arn:aws:s3:::nasa-irsa-simulations/troxel2024/roman/
Region: us-east-1
Type: S3 Bucket
RequesterPays: False
AccountRequired: False
- Description: 'The simulated Rubin data products include raw pixel data, calibrated exposures, coadds of the calibrated exposures, and catalogs of photometry measured from the simulated images.'
ARN: arn:aws:s3:::nasa-irsa-simulations/troxel2024/rubin/
Region: us-east-1
Type: S3 Bucket
RequesterPays: False
AccountRequired: False
DataAtWork:
Tutorials:
- Title: Notebook Tutorials
URL: https://irsa.ipac.caltech.edu/docs/notebooks/
AuthorName: Caltech/IPAC-IRSA
AuthorURL: https://irsa.ipac.caltech.edu
ADXCategories:
- Public Sector Data

0 comments on commit 0e9de77

Please sign in to comment.