workflow // write ACCESS-ESM1.5 variable as zarr collection

[Thomas-Moore-Creative]

ACDtools workflow

• write ACCESS-ESM1.5 variable as zarr collection to /scratch/es60/ard/models/ACCESS-ESM15/ARD
• from NetCDF path lists found with intake catalogs
• including chunking xarray_kwargs on load
• prototype in notebook
• write as batch script

[Thomas-Moore-Creative]

• setup config for this task
• remove and save the multidimensional lat and lon coordinates

[Thomas-Moore-Creative]

Have prototype, config-driven workflow for piControl working and have generated primary ( T, O2, U, V, chl ) zarr collections.

[Thomas-Moore-Creative]

KeyError: 'vertices_latitude'

KeyError                                  Traceback (most recent call last)
[/g/data/hh5/public/apps/miniconda3/envs/analysis3-24.04/lib/python3.10/site-packages/xarray/core/dataset.py](https://are.nci.org.au/g/data/hh5/public/apps/miniconda3/envs/analysis3-24.04/lib/python3.10/site-packages/xarray/core/dataset.py) in ?(self, names)
   1437                 variables[name] = self._variables[name]
   1438             except KeyError:
-> 1439                 ref_name, var_name, var = _get_virtual_variable(
   1440                     self._variables, name, self.sizes

KeyError: 'vertices_latitude'

During handling of the above exception, another exception occurred:

KeyError                                  Traceback (most recent call last)
<timed exec> in ?()

[/g/data/es60/users/thomas_moore/code/ACDtools/ACDtools/ard.py](https://are.nci.org.au/g/data/es60/users/thomas_moore/code/ACDtools/ACDtools/ard.py) in ?(ds, save_coords_dir, coords_name, variable_name)
    264 def save_n_drop_multidim_lat_lon(ds, save_coords_dir, coords_name='ACCESS-ESM1.5', variable_name='var_name_unknown'):
--> 265     coords = ds[['latitude', 'longitude','vertices_latitude','vertices_longitude']]

[Thomas-Moore-Creative]

Have prototype working for SSP experiments that require the megamem node. Not batched yet. Have run ssp126 and now running ssp370 in notebook mode.