Add MPI-IO collective reads of NetCDF-4 files#1405

Closed

dkokron wants to merge 20 commits intoNOAA-GFDL:mainfrom dkokron:fms.ParallelStartup

+165-57

Commits on Aug 8, 2023

Initial working proof-of-concept to enable MPI-IO collective optimizations within NetCDF. This has been tested on Cactus using the RRFS application with up to 24 ensemble members.

Dan Kokron
authored and
Dan Kokron
committed

Commits on Oct 2, 2023

Merge branch 'NOAA-GFDL:main' into fms.ParallelStartup
dkokron
authored
Use mpp_comm_private instead of MPI_COMM_WORLD for parallel IO

Dan Kokron
authored and
Dan Kokron
committed
Merge branch 'fms.ParallelStartup' of github.com:dkokron/FMS into fms.ParallelStartup

Dan Kokron
authored and
Dan Kokron
committed

Commits on Nov 7, 2023

Mods to allow user control of collective reads from input.nml. Default behavior is unchanged, user has to activate collective reads

Dan Kokron
authored and
Dan Kokron
committed

Commits on Nov 8, 2023

Remove debugging prints per Rusty Benson

Dan Kokron
authored and
Dan Kokron
committed

Commits on Nov 10, 2023

Revert makeing mpp_comm_private public. Use the new function call mpp_get_current_pelist_comm to gain access to the appropriate communicator

Dan Kokron
authored and
Dan Kokron
committed
Add function mpp_get_current_pelist_comm to allow user access to the communicator associated with the current pelist

Dan Kokron
authored and
Dan Kokron
committed

Commits on Nov 27, 2023

Remove file test functionality

Dan Kokron
authored and
Dan Kokron
committed
Add tile communicator get and set utilities

Dan Kokron
authored and
Dan Kokron
committed
Remove references to is_reader

Dan Kokron
authored and
Dan Kokron
committed

Commits on Nov 28, 2023

Add fallback to parallel-independent if parallel-collective fails. Print fallback notice

Dan Kokron
authored and
Dan Kokron
committed
Improve fallback notice slightly

Dan Kokron
authored and
Dan Kokron
committed

Commits on Nov 29, 2023

Revert all changes to netcdf_io_init

Dan Kokron
authored and
Dan Kokron
committed
i index not needed anymore

Dan Kokron
authored and
Dan Kokron
committed
minor formatting change

Dan Kokron
authored and
Dan Kokron
committed
Update proposed replacement for MPI_Comm_split

Dan Kokron
authored and
Dan Kokron
committed

Commits on Dec 19, 2023

Move collective code path from under is_root control

Dan Kokron
authored and
Dan Kokron
committed

Commits on Dec 26, 2023

Add non-functional prototypes for opening NetCDF files for write

Dan Kokron
authored and
Dan Kokron
committed

Commits on Mar 4, 2024

Save in preparation for merge. May not need these in the final pull-request

Dan Kokron
authored and
Dan Kokron
committed