Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lustre group lock API #702

Open
adammoody opened this issue Dec 23, 2021 · 0 comments
Open

Lustre group lock API #702

adammoody opened this issue Dec 23, 2021 · 0 comments

Comments

@adammoody
Copy link
Collaborator

In Lustre, there is a way to declare that a set of processes all share a single write lock over the whole file. Processes are then responsible for ensuring that they don't step on each other when writing. One has to use close/sync to push data. One also has to write data on page boundaries. More details can be found here:

https://jira.whamcloud.com/browse/LU-15391

I have a simple test case that uses this API to test performance, though I need to update it based on the discussion in the noted ticket.

It is worth investigating how much performance one can get with this Lustre API call. If significant, then Lustre might also benefit from MPIX_File_fence. For example, when using collective I/O, the MPI library could acquire a group lock and gather data to be written on page boundaries on behalf of the user via collective buffering.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants