Error when trying to open CMIP6-GLADE datastore

[PaulScemama]

Hi!

I'm trying to access the CMIP6-GLADE datastore via the url in the FAQ. However, when I run

cat = intake.open_esm_datasource("/glade/collections/cmip/catalog/intake-esm-datastore/catalogs/glade-cmip6.json")

I get

---------------------------------------------------------------------------
ValidationError                           Traceback (most recent call last)


ValidationError: 5 validation errors for Init
records
  field required (type=value_error.missing)
variable_column_name
  field required (type=value_error.missing)
path_column_name
  field required (type=value_error.missing)
data_format
  field required (type=value_error.missing)
format_column_name
  field required (type=value_error.missing)

Any idea what I'm doing wrong?

[andersy005]

@PaulScemama,

use open_esm_datastore() instead of open_esm_datasource()

cat = intake.open_esm_datastore("/glade/collections/cmip/catalog/intake-esm-datastore/catalogs/glade-cmip6.json")

[PaulScemama]

Ah yes I missed that thank you. Now I'm getting

FileNotFoundError: [Errno 2] No such file or directory: '[/glade/collections/cmip/catalog/intake-esm-datastore/catalogs/glade-cmip6.json]

Do I need to download the .json? If so, where do I find it? Thanks!

[andersy005]

you bet!

Do I need to download the .json? If so, where do I find it?

are you running this from your local computer? if so, this will not work. That file is only accessible if you have access to NCAR's GLADE filesystem.

[PaulScemama]

Yes I am on my local computer. That makes sense! Do you have any idea what the best way would be for me to access CMIP6 files with this library? I'm new to climate data. Is there a centralized place where I can request data access or pull CMIP6 data from? No worries if you don't have the answers :). Thanks again!

[andersy005]

the data are available in both google cloud and aws. so, you should be able to access them from your local computer without needing to download them.

# for Google Cloud:
cat = intake.open_esm_datastore("https://storage.googleapis.com/cmip6/pangeo-cmip6.json")

# for AWS S3:
cat = intake.open_esm_datastore("https://cmip6-pds.s3.amazonaws.com/pangeo-cmip6.json")

for more information, check this website https://pangeo-data.github.io/pangeo-cmip6-cloud/index.html and repository: https://github.com/pangeo-data/pangeo-cmip6-cloud