Updated datasets 2023-09-09 UTC

opengeos · Sep 9, 2023 · ec4cc11 · ec4cc11
1 parent 809c34e
commit ec4cc11
Show file tree

Hide file tree

Showing 9 changed files with 399 additions and 74 deletions.
diff --git a/aws_open_datasets.json b/aws_open_datasets.json
diff --git a/aws_open_datasets.tsv b/aws_open_datasets.tsv
diff --git a/datasets/nasa-heasarc.yaml b/datasets/nasa-heasarc.yaml
@@ -4,7 +4,7 @@ Description: |
   <br/><br/>
   This is a relatively modest total data volume but contains significant complexity and heterogeneity among the different missions. Data provided here are stored in the Flexible Image Transport System ([FITS](https://heasarc.gsfc.nasa.gov/docs/heasarc/fits.html)) format common in astronomy. Higher level products are further defined to be consistent between missions following [data model standards](https://heasarc.gsfc.nasa.gov/docs/heasarc/ofwg/ofwg_recomm.html) agreed by the community and maintained by the HEASARC. Analysis of these data may require software also provided by HEASARC, the [HEASoft package](https://heasarc.gsfc.nasa.gov/docs/software/lheasoft/), consisting of tools generic to all FITS data, generic to all HEASARC-compliant data, and/or specific to individual missions as appropriate. Some missions provide standard science-ready data products, while others provide low-level data types and software to generate science-ready products from them. See the links for each mission for more information on how to use the data.
   <br/><br/>
-  The [The HEASARC Website](https://heasarc.gsfc.nasa.gov/) also has archive browsing tools where you can query for observations corresponding to temporal and spatial constraints among others. These tools will ultimately point to files located on the archive by giving a URL beginning with the path https://heasarc.gsfc.nasa.gov/FTP/. The data that are provided in the ODR follow the same structure, so when our tools give an https access URL, a user can simply swap in s3://nasa-heasarc/ for the first part of that URL and get a cloud URI. Note also that some selections have been made to what has been copied to the ODR, while the HEASARC archive itself remains the definitive and legacy source for the complete datasets.
+  The [HEASARC Website](https://heasarc.gsfc.nasa.gov/) also has archive browsing tools where you can query for observations corresponding to temporal and spatial constraints among others. These tools will ultimately point to files located on the archive by giving a URL beginning with the path https://heasarc.gsfc.nasa.gov/FTP/. The data that are provided in the ODR follow the same structure, so when our tools give an https access URL, a user can simply swap in s3://nasa-heasarc/ for the first part of that URL and get a cloud URI. Note also that some selections have been made to what has been copied to the ODR, while the HEASARC archive itself remains the definitive and legacy source for the complete datasets.
   <br/><br/>
   The HEASARC also provides user support, both generic and mission-specific, through a set of email helpdesks available through the website's [Feedback page](https://heasarc.gsfc.nasa.gov/cgi-bin/Feedback).
 
@@ -32,7 +32,7 @@ Resources:
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [ASCA Mission](https://heasarc.gsfc.nasa.gov/docs/asca/asca.html) Data Archive. More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/halosat/halosat.html). Total size of 0.35 GB.
+ - Description: The [ASCA Mission](https://heasarc.gsfc.nasa.gov/docs/asca/asca.html) Data Archive. More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/halosat/halosat.html). Total size of 1.3 TB.
    ARN: arn:aws:s3:::nasa-heasarc/asca/data/rev2
    Region: us-east-1
    Type: S3 Bucket
@@ -42,7 +42,12 @@ Resources:
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [Compton Mission](https://heasarc.gsfc.nasa.gov/docs/cgro/cgro.html). More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/cgro/). Total size of 0.2 TB. 
+ - Description: "[Chandra Mission](https://heasarc.gsfc.nasa.gov/docs/chandra/chandra.html) Data Archive supported by the [Chandra X-ray Observatory](https://chandra.harvard.edu/) and the [Chandra X-ray Center](https://cxc.harvard.edu/) in addition to the HEASARC.  Total size > 3.7 TB."
+   ARN: arn:aws:s3:::nasa-heasarc/chandra/data/byobsid
+   Region: us-east-1
+   Type: S3 Bucket
+
+ - Description: The [Compton Mission](https://heasarc.gsfc.nasa.gov/docs/cgro/cgro.html). More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/cgro/). Total size of 207 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/compton/data
    Region: us-east-1
    Type: S3 Bucket
@@ -67,62 +72,87 @@ Resources:
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [The EXOSAT Observatory](https://heasarc.gsfc.nasa.gov/docs/exosat/exosat.html) Data Archive. Total size 3 GB. 
+ - Description: The [The EXOSAT Observatory](https://heasarc.gsfc.nasa.gov/docs/exosat/exosat.html) Data Archive. Total size 80 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/exosat/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [Ginga Mission](https://heasarc.gsfc.nasa.gov/docs/ginga/ginga.html) Data Archive. Total size 18 GB. 
+ - Description: "[Fermi](https://heasarc.gsfc.nasa.gov/docs/heasarc/missions/fermi.html) LAT weekly Data Products as well as GBM bursts and triggers.  (The full mission data are archived at HEASARC, though only the most generically useful subset of them are provided here.)  Total size 2.3 TB."
+   ARN: arn:aws:s3:::heasarc-public/fermi/data/
+   Region: us-east-1
+   Type: S3 Bucket
+
+ - Description: The [Ginga Mission](https://heasarc.gsfc.nasa.gov/docs/ginga/ginga.html) Data Archive. Total size 19 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/ginga/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [HaloSat Mission](https://heasarc.gsfc.nasa.gov/docs/halosat/halosat.html) Data Archive.  More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/halosat/halosat.html). Total size 2.5 GB. 
+ - Description: The [HaloSat Mission](https://heasarc.gsfc.nasa.gov/docs/halosat/halosat.html) Data Archive.  More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/halosat/halosat.html). Total size 3.5 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/halosat/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [HEAO-1](https://heasarc.gsfc.nasa.gov/docs/heao1/heao1.html) Mission Data Archive. Total size 7 GB. 
+ - Description: The [HEAO-1](https://heasarc.gsfc.nasa.gov/docs/heao1/heao1.html) Mission Data Archive. Total size 8.4 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/heao1/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [HETE-2](https://heasarc.gsfc.nasa.gov/docs/hete2/hete2.html) Mission Data Archive. Total size 39 GB. 
+ - Description: The [HETE-2](https://heasarc.gsfc.nasa.gov/docs/hete2/hete2.html) Mission Data Archive. Total size 287 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/hete2/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [Hitomi Mission](https://heasarc.gsfc.nasa.gov/docs/hitomi/index.html) Data Archive. Total size 50 GB. 
+ - Description: The [Hitomi Mission](https://heasarc.gsfc.nasa.gov/docs/hitomi/index.html) Data Archive. Total size 115 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/hitomi/data/
    Region: us-east-1
    Type: S3 Bucket
 
+ - Description: The [NICER Mission](https://heasarc.gsfc.nasa.gov/docs/heasarc/missions/nicer.html) Data Archive.  For more information, see the [NICER Science Center](https://heasarc.gsfc.nasa.gov/docs/nicer/). Total size > 17 TB.
+   ARN: arn:aws:s3:::heasarc-public/nicer/data/obs/
+   Region: us-east-1
+   Type: S3 Bucket
+
+ - Description: The [NuSTAR Mission](https://heasarc.gsfc.nasa.gov/docs/heasarc/missions/nustar.html) Data Archive.  For more information, see the NuSTAR pages [at HEASARC](https://heasarc.gsfc.nasa.gov/docs/nustar/) or [at CalTech](https://www.nustar.caltech.edu/).  Total size > 3 TB.
+   ARN: arn:aws:s3:::heasarc-public/nustar/data/obs/
+   Region: us-east-1
+   Type: S3 Bucket
+
  - Description: The [OSO-8 Mission](https://heasarc.gsfc.nasa.gov/docs/oso8/oso8.html) Data Archive. Total size 5 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/oso8/data/gcxse/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [ROSAT Mission](https://heasarc.gsfc.nasa.gov/docs/rosat/rosat.html) Data Archive.  For more information, see the website of the [ROSAT Guest Observer Facility](https://heasarc.gsfc.nasa.gov/docs/rosat/rosgof.html). Total size 4 GB. 
+ - Description: The [ROSAT Mission](https://heasarc.gsfc.nasa.gov/docs/rosat/rosat.html) Data Archive.  For more information, see the website of the [ROSAT Guest Observer Facility](https://heasarc.gsfc.nasa.gov/docs/rosat/rosgof.html). Total size 209 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/rosat/data/
    Region: us-east-1
    Type: S3 Bucket
 
+ - Description: The [RXTE Mission](https://heasarc.gsfc.nasa.gov/docs/xte/rxte.html) Data Archive. For more information, see the website of [the RXTE Guest Observer Facility](https://heasarc.gsfc.nasa.gov/docs/xte/xte_1st.html). Total size 5.4 TB. 
+   ARN: arn:aws:s3:::nasa-heasarc/xte/data/archive/
+   Region: us-east-1
+   Type: S3 Bucket
+
  - Description: The [SAS-2 Mission](https://heasarc.gsfc.nasa.gov/docs/sas2/sas2.html) Data Archive. Total size  < 1 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/sas2/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [BeppoSAX Mission](https://heasarc.gsfc.nasa.gov/docs/sax/sax.html) Data Archive.  More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/sax/saxgof.html). Total size 175 GB. 
+ - Description: The [BeppoSAX Mission](https://heasarc.gsfc.nasa.gov/docs/sax/sax.html) Data Archive.  More information available at [the mission support website](https://heasarc.gsfc.nasa.gov/docs/sax/saxgof.html). Total size 293 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/sax/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [Suzaku Mission](https://heasarc.gsfc.nasa.gov/docs/astroe/astroe2.html) Data Archive.  For more information, see the website of the [Suzaku/Astro-E2 Guest Observer Facility](https://heasarc.gsfc.nasa.gov/docs/suzaku/astroegof.html). Total size 4.6 TB. 
+ - Description: The [Suzaku Mission](https://heasarc.gsfc.nasa.gov/docs/astroe/astroe2.html) Data Archive.  For more information, see the website of the [Suzaku/Astro-E2 Guest Observer Facility](https://heasarc.gsfc.nasa.gov/docs/suzaku/astroegof.html). Total size 5.4 TB. 
    ARN: arn:aws:s3:::nasa-heasarc/suzaku/data/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [VELA 5B Mission](https://heasarc.gsfc.nasa.gov/docs/vela5b/vela5b.html) Data Archive.  Total size 5 GB. 
+ - Description: "[Swift Mission](https://heasarc.gsfc.nasa.gov/docs/heasarc/missions/swift.html) Data Archive. For more information, see the website of the [Swift Science Center](http://swift.gsfc.nasa.gov/). Total size > 12 TB."
+   ARN: arn:aws:s3:::nasa-heasarc/swift/data/obs/
+   Region: us-east-1
+   Type: S3 Bucket
+
+ - Description: The [VELA 5B Mission](https://heasarc.gsfc.nasa.gov/docs/vela5b/vela5b.html) Data Archive.  Total size < 1 GB. 
    ARN: arn:aws:s3:::nasa-heasarc/vela5b/data/
    Region: us-east-1
    Type: S3 Bucket
@@ -132,13 +162,13 @@ Resources:
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [XQC Mission](https://heasarc.gsfc.nasa.gov/docs/rockets/xqc.html) Data Archive.  Total size < 1 GB. 
-   ARN: arn:aws:s3:::nasa-heasarc/xqc/data/spectra/
+ - Description: "[XMM-Newton  Mission](https://heasarc.gsfc.nasa.gov/docs/xmm/xmm.html) Data Archive.  For more information, see the website of [the XMM-Newton Guest Observer Facility](https://heasarc.gsfc.nasa.gov/docs/xmm/xmmgof.html).  Total size > 10 TB."
+   ARN: arn:aws:s3:::nasa-heasarc/xmm/data/rev0/
    Region: us-east-1
    Type: S3 Bucket
 
- - Description: The [Rossi XTE Mission](https://heasarc.gsfc.nasa.gov/docs/xte/rxte.html) Data Archive. For more information, see the website of [the RXTE Guest Observer Facility](https://heasarc.gsfc.nasa.gov/docs/xte/xte_1st.html). Total size 2.6 TB. 
-   ARN: arn:aws:s3:::nasa-heasarc/xte/data/archive/
+ - Description: The [XQC Mission](https://heasarc.gsfc.nasa.gov/docs/rockets/xqc.html) Data Archive.  Total size < 1 GB. 
+   ARN: arn:aws:s3:::nasa-heasarc/xqc/data/spectra/
    Region: us-east-1
    Type: S3 Bucket
 
@@ -158,5 +188,3 @@ DataAtWork:
      URL: https://heasarc.gsfc.nasa.gov/docs/heasarc/biblio/pubs/
      AuthorName: Various; curated by HEASARC
      AuthorURL: https://heasarc.gsfc.nasa.gov/
-
-
diff --git a/datasets/nasa-lambda.yaml b/datasets/nasa-lambda.yaml
@@ -47,7 +47,7 @@ Resources:
 DataAtWork:
   Tutorials:
     - Title: HEASARC/LAMBDA cloud access
-      URL:  https://heasarcdev.gsfc.nasa.gov/docs/archive/cloud/cloud.html
+      URL:  https://heasarc.gsfc.nasa.gov/docs/archive/cloud.html
       AuthorName: NASA/HEASARC
       AuthorURL: https://heasarc.gsfc.nasa.gov/
   Tools & Applications:

diff --git a/datasets/nasa-usgs-lunar-orbiter-laser-altimeter.yaml b/datasets/nasa-usgs-lunar-orbiter-laser-altimeter.yaml
@@ -0,0 +1,45 @@
+Name: NASA / USGS Lunar Orbiter Laser Altimeter Cloud Optimized Point Cloud 
+Description: |
+  The lunar orbiter laser altimeter (LOLA) has collected and released almost 7 billion individual laser altimeter returns from the lunar surface. This dataset includes individual altimetry returns scraped from the Planetary Data System (PDS) LOLA Reduced Data Record (RDR) Query Tool, V2.0. Data are organized in 15˚ x 15˚ (longitude/latitude) sections, compressed and encoded into the Cloud Optimized Point Cloud (COPC) file format, and collected into a Spatio-Temporal Asset Catalog (STAC) collection for query and analysis. The data are in latitude, longitude, and radius (X, Y, Z) format with the proper IAU 2015 30100 well-known text projection string. These data are in the -180 to 180, center longitude 0 domain. Users of this data set are encouraged to use the Point Data Abstract Library (PDAL) STAC driver to query at the collection level or the COPC driver to query individual COPC tiles within the dataset. Queries of these data using bounding boxes, buffered points, or other geometries should use the -180 to 180 longitude domain (converting from 0-360, clone 180 as needed).
+Documentation: https://stac.astrogeology.usgs.gov/docs/data/moon/lola/
+Contact: https://answers.usgs.gov/
+ManagedBy: "[NASA](https://www.nasa.gov)"
+UpdateFrequency: Intermittent as new LOLA RDR data are released and processing capabilities become available.
+Tags:
+  - aws-pds
+  - planetary
+  - elevation
+  - lidar
+  - stac
+License: "[CC0 1.0](https://creativecommons.org/publicdomain/zero/1.0/)"
+Citation: https://doi.org/10.5066/P9V5JIWH
+Resources:
+  - Description: Lunar Orbiter Laser Altimeter (LOLA) Reduced Data Record (RDR) point cloud in Cloud Optimized Point Cloud (COPC) format.
+    ARN: arn:aws:s3:::astrogeo-ard/moon/lro/lola/
+    Region: us-west-2
+    Type: S3 Bucket
+    Explore:
+      - '[STAC Catalog](https://stac.astrogeology.usgs.gov/browser-dev/#/api/collections/lunar_orbiter_laser_altimeter)'
+DataAtWork:
+  Tutorials:
+    - Title: "Discovering and Downloading Data via the Command Line"
+      URL: https://stac.astrogeology.usgs.gov/docs/tutorials/cli/
+      AuthorName: J. Laura
+      AuthorURL: https://astrogeology.usgs.gov
+    - Title: "Discovering and Downloading Data with Python"
+      URL: https://stac.astrogeology.usgs.gov/docs/tutorials/basicpython/
+      AuthorName: J. Laura
+      AuthorURL: https://astrogeology.usgs.gov
+    - Title: "Querying for Data in an ROI and Loading it into QGIS"
+      URL: https://stac.astrogeology.usgs.gov/docs/examples/to_qgis/
+      AuthorName: J. Laura
+      AuthorURL: https://astrogeology.usgs.gov
+  Tools & Applications:
+    - Title: PySTAC Client
+      URL: https://github.com/stac-utils/pystac-client
+      AuthorName: PySTAC-Client Contributors
+      AuthorURL: https://github.com/stac-utils/pystac-client/graphs/contributors
+    - Title: Point Data Abstraction Library (PDAL)
+      URL: https://pdal.io/
+      AuthorName: PDAL Contributors
+      AuthorURL: https://github.com/PDAL/PDAL
diff --git a/datasets/noaa-gmgsi.yaml b/datasets/noaa-gmgsi.yaml
@@ -1,6 +1,6 @@
 Name: NOAA Global Mosaic of Geostationary Satellite Imagery (GMGSI)
 Description: |
-  NOAA/NESDIS Global Mosaic of Geostationary Satellite Imagery (GMGSI) visible (VIS), shortwave infrared (SIR), longwave infrared (LIR) imagery, and water vaport imagery (WV) are composited from data from several geostationary satellites orbiting the globe, including the GOES-East and GOES-West Satellites operated by U.S. NOAA/NESDIS, the Meteosat-11 and Meteosat-8 satellites from theMeteosat Second Generation (MSG) series of satellites operated by European Organization for the Exploitation of Meteorological Satellites (EUMETSAT), and the Himawari-8 satellite operated by the Japan Meteorological Agency (JMA). GOES-East is positioned at 75 deg W longitude over the equator. GOES-West is located at 137.2 deg W longitude over the equator. Both satellites cover an area from the eastern Atlantic Ocean to the central Pacific Ocean region. The Meteosat-11 satellite is located at 0 deg E longitude to cover Europe and Africa regions. The Meteosat-8 satellite is located at 41.5 deg E longitude to cover the Indian Ocean region. The Himawari-8 satellite is located at 140.7 deg E longitude to cover the Asia-Oceania region. The visible imagery indicates cloud cover and ice and snow cover. The shortwave, or mid-infrared, indicates cloud cover and fog at night. The longwave, or thermal infrared, depicts cloud cover and land/sea temperature patterns. The water vapor imagery indicates the amount of water vapor contained in the mid to upper levels of the troposphere, with the darker grays indicating drier air and the brighter grays/whites indicating more saturated air. GMGSI composite images have an approximate 8 km (5 mile) horizontal resolution and are updated every hour.
+  NOAA/NESDIS Global Mosaic of Geostationary Satellite Imagery (GMGSI) visible (VIS), shortwave infrared (SIR), longwave infrared (LIR) imagery, and water vapor imagery (WV) are composited from data from several geostationary satellites orbiting the globe, including the GOES-East and GOES-West Satellites operated by U.S. NOAA/NESDIS, the Meteosat-10 and Meteosat-9 satellites from theMeteosat Second Generation (MSG) series of satellites operated by European Organization for the Exploitation of Meteorological Satellites (EUMETSAT), and the Himawari-9 satellite operated by the Japan Meteorological Agency (JMA). GOES-East is positioned at 75 deg W longitude over the equator. GOES-West is located at 137.2 deg W longitude over the equator. Both satellites cover an area from the eastern Atlantic Ocean to the central Pacific Ocean region. The Meteosat-10 satellite is located at 0 deg E longitude to cover Europe and Africa regions. The Meteosat-9 satellite is located at 45.5 deg E longitude to cover the Indian Ocean region. The Himawari-9 satellite is located at 140.7 deg E longitude to cover the Asia-Oceania region. The visible imagery indicates cloud cover and ice and snow cover. The shortwave, or mid-infrared, indicates cloud cover and fog at night. The longwave, or thermal infrared, depicts cloud cover and land/sea temperature patterns. The water vapor imagery indicates the amount of water vapor contained in the mid to upper levels of the troposphere, with the darker grays indicating drier air and the brighter grays/whites indicating more saturated air. GMGSI composite images have an approximate 8 km (5 mile) horizontal resolution and are updated every hour.
 Documentation: "[https://www.ospo.noaa.gov/Operations/GOES/index.html](https://www.ospo.noaa.gov/Operations/GOES/index.html); [https://www.ospo.noaa.gov/Products/imagery/index.html](https://www.ospo.noaa.gov/Products/imagery/index.html)"
 Contact: |
   For any questions regarding data delivery or any general questions regarding the NOAA Open Data Dissemination (NODD) Program, email the NODD Team at [email protected]. For general questions or feedback about the data, please submit inquiries through the NOAA Office of Coast Survey (OCS) ASSIST Tool at https://www.nauticalcharts.noaa.gov/customer-service/assist/.