Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

change default job backend to Slurm + deprecate support for using GC3Pie as job backend #4565

Open
boegel opened this issue Jun 19, 2024 · 3 comments
Labels
change EasyBuild-5.0-blocker Blocker for EasyBuild 5.0 EasyBuild-5.0 EasyBuild 5.0
Milestone

Comments

@boegel
Copy link
Member

boegel commented Jun 19, 2024

No description provided.

@boegel boegel added change EasyBuild-5.0 EasyBuild 5.0 EasyBuild-5.0-blocker Blocker for EasyBuild 5.0 labels Jun 19, 2024
@boegel boegel added this to the 5.0 milestone Jun 19, 2024
@gkaf89
Copy link

gkaf89 commented Jul 19, 2024

It seems that the current implementation of the Slurm backend does not support the experimental easystack feature.

When compiling easystacks compilation jobs are resubmitted without dependencies on previous entries of the easystack. Consider for instance the easystack file:

easyconfigs:
  - foss-2024.05.eb
  - HDF5-1.14.3-gompi-2023b.eb

Jobs for GCCcore are created for both foss-2024.05.eb and HDF5-1.14.3-gompi-2023b.eb, and there is no dependency that prevents the job for HDF5-1.14.3-gompi-2023b.eb to start after the job for foss-2024.05.eb.

I am mentioning the issue here because easystacks seem like a good use case for parallel compilation jobs.

@ocaisa
Copy link
Member

ocaisa commented Jul 19, 2024

@gkaf89 I looked into that in #4558 (comment) but I would need to find time to implement

@boegel
Copy link
Member Author

boegel commented Jul 31, 2024

@gkaf89 That's correct, the integration of easystack files and --job is far from optimal, but that's orthogonal to which job backend is being used (so better to continue that discussion in #4558, indeed)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
change EasyBuild-5.0-blocker Blocker for EasyBuild 5.0 EasyBuild-5.0 EasyBuild 5.0
Projects
Status: Changed default
Development

No branches or pull requests

3 participants