Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow defining lmod hooks in host injections #316

Merged

Conversation

trz42
Copy link
Collaborator

@trz42 trz42 commented Apr 11, 2024

PR to sync NESSI with EESSI (PR 525).

Need to build and ingest tarballs. Also serves as a test if upload from eX3 is improved.

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Instance AWS-MC-NESSI is configured to build:

  • arch x86_64/generic for repo nessi-2022.11-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/skylake_avx512 for repo nessi-2022.11-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
  • arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2022.11-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Instance eX3-NESSI is configured to build:

  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Instance Fram-NESSI is configured to build:

  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/broadwell for repo nessi-2023.06-cl
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Instance Saga-NESSI is configured to build:

  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-cl
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/skylake_avx512 for repo nessi-2023.06-swl-deb11
  • arch x86_64/intel/broadwell for repo nessi-2023.06-cl
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb10
  • arch x86_64/intel/broadwell for repo nessi-2023.06-swl-deb11
  • arch x86_64/generic for repo nessi-2023.06-cl
  • arch x86_64/generic for repo nessi-2023.06-swl-deb10
  • arch x86_64/generic for repo nessi-2023.06-swl-deb11

@trz42
Copy link
Collaborator Author

trz42 commented Apr 11, 2024

bot: build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell
bot: build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake
bot: build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2
bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Updates by the bot instance AWS-MC-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Updates by the bot instance Saga-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Updates by the bot instance eX3-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

    • no jobs were submitted
  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

Updates by the bot instance Fram-NESSI (click for details)
  • received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42

    • expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
  • received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42

    • expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
  • received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb11 arch:aarch64/generic from trz42

    • expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
  • received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42

    • expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
  • handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:

  • handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:

    • no jobs were submitted
  • handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb11 architecture:aarch64/generic resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:

    • no jobs were submitted
  • handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:

    • no jobs were submitted

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_316/5765486

date job status comment
Apr 11 19:47:37 UTC 2024 submitted job id 5765486 awaits release by job manager
Apr 11 19:48:04 UTC 2024 released job awaits launch by Slurm scheduler
Apr 11 19:49:05 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-5765486.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-broadwell-1712864900.tar.gzsize: 0 MiB (2671 bytes)
entries: 1
modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/broadwell/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/broadwell
.lmod/SitePackage.lua
Apr 11 19:49:05 UTC 2024 test result (no tests yet)
Apr 11 19:56:47 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712864900.tar.gz to S3 bucket succeeded
Apr 11 20:03:55 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-broadwell-1712864900.tar.gz to S3 bucket succeeded
Apr 11 08:11:48 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712864900.tar.gz downloaded to Stratum-0
Apr 11 08:12:01 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/124 to approve ingest
Apr 11 08:17:48 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712864900.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/124
Apr 11 08:20:40 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-intel-broadwell-1712864900.tar.gz successfully ingested at 2023.06/software/linux/x86_64/intel/broadwell/.lmod/SitePackage.lua

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.04/pr_316/168880

date job status comment
Apr 11 07:47:38 PM UTC 2024 submitted job id 168880 awaits release by job manager
Apr 11 07:48:40 PM UTC 2024 released job awaits launch by Slurm scheduler
Apr 11 07:49:41 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-168880.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1712864960.tar.gzsize: 0 MiB (2676 bytes)
entries: 1
modules under 2023.06/software/linux/aarch64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/aarch64/generic/software
no software packages in tarball
other under 2023.06/software/linux/aarch64/generic
.lmod/SitePackage.lua
Apr 11 07:49:41 PM UTC 2024 test result (no tests yet)
Apr 11 07:56:33 PM UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712864960.tar.gz to S3 bucket failed
Apr 11 08:06:31 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1712864960.tar.gz to S3 bucket succeeded
Apr 11 08:11:41 PM UTC 2024 staged tarball eessi-2023.06-software-linux-aarch64-generic-1712864960.tar.gz downloaded to Stratum-0
Apr 11 08:11:54 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/121 to approve ingest
Apr 11 08:17:41 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-aarch64-generic-1712864960.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/121
Apr 11 08:18:21 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-aarch64-generic-1712864960.tar.gz successfully ingested at 2023.06/software/linux/aarch64/generic/.lmod/SitePackage.lua

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_316/9308

date job status comment
Apr 11 19:47:39 UTC 2024 submitted job id 9308 awaits release by job manager
Apr 11 19:48:41 UTC 2024 released job awaits launch by Slurm scheduler
Apr 11 19:53:45 UTC 2024 running job 9308 is running
Apr 11 19:54:48 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9308.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1712865256.tar.gzsize: 0 MiB (2658 bytes)
entries: 1
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/SitePackage.lua
Apr 11 19:54:48 UTC 2024 test result (no tests yet)
Apr 11 19:56:39 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712865256.tar.gz to S3 bucket succeeded
Apr 11 20:04:00 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-amd-zen2-1712865256.tar.gz to S3 bucket succeeded
Apr 11 08:11:43 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712865256.tar.gz downloaded to Stratum-0
Apr 11 08:11:56 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/122 to approve ingest
Apr 11 08:17:43 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712865256.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/122
Apr 11 08:19:05 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-amd-zen2-1712865256.tar.gz successfully ingested at 2023.06/software/linux/x86_64/amd/zen2/.lmod/SitePackage.lua

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.04/pr_316/9309

date job status comment
Apr 11 19:47:43 UTC 2024 submitted job id 9309 awaits release by job manager
Apr 11 19:48:43 UTC 2024 released job awaits launch by Slurm scheduler
Apr 11 19:53:47 UTC 2024 running job 9309 is running
Apr 11 19:54:49 UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-9309.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-generic-1712865257.tar.gzsize: 0 MiB (2664 bytes)
entries: 1
modules under 2023.06/software/linux/x86_64/generic/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/generic/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/generic
.lmod/SitePackage.lua
Apr 11 19:54:49 UTC 2024 test result (no tests yet)
Apr 11 19:56:59 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712865257.tar.gz to S3 bucket succeeded
Apr 11 20:04:19 UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-generic-1712865257.tar.gz to S3 bucket succeeded
Apr 11 08:11:45 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-generic-1712865257.tar.gz downloaded to Stratum-0
Apr 11 08:11:59 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/123 to approve ingest
Apr 11 08:17:46 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-generic-1712865257.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/123
Apr 11 08:20:08 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-generic-1712865257.tar.gz successfully ingested at 2023.06/software/linux/x86_64/generic/.lmod/SitePackage.lua

@nessi-bot
Copy link

nessi-bot bot commented Apr 11, 2024

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.04/pr_316/11155899

date job status comment
Apr 11 07:48:12 PM UTC 2024 submitted job id 11155899 awaits release by job manager
Apr 11 07:48:42 PM UTC 2024 released job awaits launch by Slurm scheduler
Apr 11 07:49:44 PM UTC 2024 running job 11155899 is running
Apr 11 07:50:45 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-11155899.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712864982.tar.gzsize: 0 MiB (2675 bytes)
entries: 1
modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/intel/skylake_avx512
.lmod/SitePackage.lua
Apr 11 07:50:45 PM UTC 2024 test result (no tests yet)
Apr 11 07:56:47 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712864982.tar.gz to S3 bucket succeeded
Apr 11 08:04:01 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712864982.tar.gz to S3 bucket succeeded
Apr 11 08:11:50 PM UTC 2024 staged tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712864982.tar.gz downloaded to Stratum-0
Apr 11 08:12:05 PM UTC 2024 pr_opened merge PR https://github.com/NorESSI/2024-staging/pull/125 to approve ingest
Apr 11 08:17:51 PM UTC 2024 approved 👍 tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712864982.tar.gz approved, see PR https://github.com/NorESSI/2024-staging/pull/125
Apr 11 08:21:07 PM UTC 2024 ingested 🎉 tarball eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1712864982.tar.gz successfully ingested at 2023.06/software/linux/x86_64/intel/skylake_avx512/.lmod/SitePackage.lua

@trz42
Copy link
Collaborator Author

trz42 commented Apr 11, 2024

Checklist before starting deployment (setting bot:deploy label):

  • Check if the SPDX license identifier is provided
    • just updates an internal script
  • Check whether builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
  • Check if the PR is up-to-date with the target branch nessi.no-2023.06 in the repository (if not what are the differences)
  • Assess if all requested changes are sound (checking files changed on GitHub.com)
  • Verify that all easyconfig/s being built are included with the EB version used (if not why not)
    • no easyconfig has been used
  • Review changes (if any) needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)

@trz42
Copy link
Collaborator Author

trz42 commented Apr 11, 2024

Target architectures

  • x86_64-intel-broadwell
  • x86_64-intel-skylake_avx512
  • x86_64-amd-zen2
  • x86_64-generic
  • aarch64-generic

Checklist for deployment/ingestion

  • at least one tarball for each architecture has been uploaded
    • first upload attempt from eX3 failed because the metadata file was created on the frontend node under /tmp; after changing the location to a shared location it now works (better than before)
  • at least one tarball for each architecture has been staged
  • for each staged tarball was a PR for approval/rejection opened
  • for each architecture one and only one tarball has been approved
  • for each architecture one and only one tarball was ingested
  • all tests in the CI have succeeded (rerun failed tests ~ 10 mins after last ingest)
    • only one known to fail test failed; ok to ignore for now
  • has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)
command & log

command

cd /cvmfs/pilot.nessi.no/versions/2023.06/software/linux ; \
ls -l \
      x86_64/{generic,amd/zen2,intel/[bsc]*}/.lmod/SitePackage.lua \
      aarch64/generic/.lmod/SitePackage.lua

log

-rw-r--r-- 1 cvmfs cvmfs 8141 Apr 11 21:49 aarch64/generic/.lmod/SitePackage.lua
-rw-rw-r-- 1 cvmfs cvmfs 8141 Apr 11 21:54 x86_64/amd/zen2/.lmod/SitePackage.lua
-rw-rw-r-- 1 cvmfs cvmfs 8141 Apr 11 21:54 x86_64/generic/.lmod/SitePackage.lua
-rw-rw-r-- 1 cvmfs cvmfs 8141 Apr 11 21:48 x86_64/intel/broadwell/.lmod/SitePackage.lua
-rw-rw-r-- 1 cvmfs cvmfs 8141 Apr 11 21:49 x86_64/intel/skylake_avx512/.lmod/SitePackage.lua 

Copy link

@poksumdo poksumdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good.

@poksumdo poksumdo merged commit 544d211 into NorESSI:nessi.no-2023.06 Apr 11, 2024
25 of 26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants