-
Notifications
You must be signed in to change notification settings - Fork 0
meeting 2023 12 08
Bob Dröge edited this page Dec 8, 2023
·
1 revision
- date & time: Fri 8 Dec 2023 - 14:00 CET (13:00 UTC)
- (every first Thursday of the month)
- venue: (online, see mail for meeting link, or ask in Slack)
- agenda:
- Quick introduction by new people
- EESSI-related meetings and events in last month
- Progress update per EESSI layer (incl. build-and-deploy bot + test suite)
- Update on new EESSI production repository software.eessi.io
- Update on EESSI NVIDIA GPU support
- Update on EESSI test suite
- Infrastructure and monitoring
- EESSI support portal
- AWS/Azure sponsorship update
- Update on MultiXscale EuroHPC project
- Upcoming/recent events: “Best Practices for CernVM-FS in HPC” tutorial + talks on EESSI/MultiXscale
- Q&A
(by Bob)
- Jan van Haarst - HPC @ University of Wageningen
(see slides)
(see slides)
- The S3-backed sync server has been used for the tutorial, and this worked well
- For robustness it may still be good to install the
cvmfs-config-eessipackage, as it removes the dependency on the/cvmfs/cvmfs-config.cern.chrepo (which could be unavailable, e.g. when the local proxy doesn't allow access to it) - To make the ingestion process easier, we could make one big tarball with all contents (for all CPU targets), or a tarball of tarballs? To be discussed in a bot meeting.
(see slides)
- Few security updates have been applied to the new repo
- They have not been applied to the pilot repo (yet)
- Add big fat warning to the pilot init scripts that users should switch to the new repo
- We can keep the repo around for experimenting
- Restart security CI
- It can run on a Stratum or some other machine
- It should send a notification to some admins, e.g. via email
(see slides)
- Many PRs have been merged in order to adapt the build process for the new repository, and build software for this new repo
- Due to the new toolchain, some new issues are popping up
- More work on NVIDIA GPUs in the coming weeks
- Has to be in place for MultiXscale by the end of the year
- Placeholder page in the documentation: eessi.io/docs/gpu
(see slides)
- Version 0.2.0 of the bot supports running tests right after software has been built
- Would be useful if the tests can be run in a different container/cloud, to make sure they also work in a different environment
(see slides)
- Pilot repository is frozen, work is being moved to new
software.eessi.iorepository
(see slides)
- LHAPDF and Rivet require a toolchain bump, PRs have been opened in the EasyBuild GitHub repository
(see slides)
- Needed in conjunction with the bot for MultiXscale
- It is versioned and can still be changed, latest version will apply
(see slides)
- Documentation should still be updated for the new production repository
- Add a big red banner with a warning that the pilot repository should not be used anymore
(see slides)
- Documentation has to be updated when everything is in place
- eessi.io/docs/gpu
(see slides)
(see slides)
- One fulltime person for providing EESSI support
- If you need help in any way, open an issue
(see slides)
(see slides)
- There will be an HPC devroom at FOSDEM
- No submission on EESSI, next year is probably a better timing
- A talk about the bot could perhaps be interesting
- Next meeting will be on January 4th
- Move to January 11th? Let's ask on Slack
- EasyBuild User Meeting will probably be in April in Sweden, may be combined with EESSI
- Three EESSI-related ISC tutorials will be submitted (deadline today!) on using EESSI, CVMFS, Magic Castle
- Maybe the EasyBuild/EESSI user meeting can be co-located with ISC (e.g. on May 17)?