Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could we use MPI Cartesian Communicators? #90

Open
pbartholomew08 opened this issue May 14, 2024 · 2 comments
Open

Could we use MPI Cartesian Communicators? #90

pbartholomew08 opened this issue May 14, 2024 · 2 comments

Comments

@pbartholomew08
Copy link
Member

tdsops_t contains information about where in the parallel decomposition it is. This is very similar to the MPI_CartComm and it may be beneficial to make use of this.

@semi-h
Copy link
Member

semi-h commented May 20, 2024

We may want to use nccl in CUDA backend and rccl for AMD and I guess they don't have a CartComm like support, I cound't find anything online. Also, with the iterative solver I think we'll be able to run cases that doesn't really a good fit for CartComm. For example a backward facing step, where there is no mesh and no ranks in that gap part. A custom communicator is still an option here and I think at least nccl supports it, but not sure if its any better than current approach.

@Nanoseb
Copy link
Collaborator

Nanoseb commented Jul 11, 2024

side benefit(/drawback) of #113, cartesian comm from 2decomp will be used for the OMP backend when using FFTs

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants