{2023.06}[foss/2023a] librosa v0.10.1 #391

trz42 · 2024-06-04T11:53:00Z

Adds librosa/0.10.1-foss-2023a which is a dependency of PyTorch-bundle-... (see #387).

This requires some changes which we may need to adjust once they have been reviewed by EESSI:

a new script scripts/extra/install_custom_ctypes.sh that installs a modified ctypes package which fixes some issue that certain shared libraries cannot be loaded

test sequence: FAILURE

module load Python/3.11.3
module load OpenMPI/4.1.5
python3 -c "from ctypes.util import find_library; from ctypes import CDLL; print(find_library('mpi')); CDLL(find_library('mpi'))"

test sequence: SUCCESS

module load Python/3.11.3
module load OpenMPI/4.1.5
tmpdir=$(mktemp -d)
wget -q -O - https://github.com/NorESSI/custom_ctypes/archive/refs/heads/main.tar.gz | tar xvzf - --strip-components=1 -C ${tmpdir}
export EBPYTHONPREFIXES=${tmpdir}
python3 -c "from ctypes.util import find_library; from ctypes import CDLL; print(find_library('mpi')); CDLL(find_library('mpi'))"

scripting to use the new install script and to add it to CVMFS
two new hooks in eb_hooks.py:
- to let the sanity check python -c "import soundfile" succeed (by pointing EBPYTHONPREFIXES to the installation of the custom ctypes library under host_injections)
- to set EBPYTHONPREFIXES in the module for librosa

SPDX license identifier: ISC License ... The ISC license is functionally equivalent to the BSD 2-Clause and MIT licenses

Missing packages:

- copies the script to a new location on CVMFS scripts/extra - calls script in EESSI-install-software.sh - script itself installs custom ctypes library under host_injections

nessi-bot · 2024-06-04T11:53:04Z

Instance AWS-MC-NESSI is configured to build for:

architectures: x86_64/generic, x86_64/intel/skylake_avx512, x86_64/amd/zen2, aarch64/generic
repositories: nessi-2023.06-swl-deb11, nessi-2023.06-cl, nessi-2023.06-swl-deb10

nessi-bot · 2024-06-04T11:53:04Z

Instance Fram-NESSI is configured to build for:

architectures: x86_64/generic, x86_64/intel/broadwell
repositories: nessi-2023.06-swl-deb10, nessi-2023.06-cl, nessi-2023.06-swl-deb11

nessi-bot · 2024-06-04T11:53:05Z

Instance Saga-NESSI is configured to build for:

architectures: x86_64/intel/skylake_avx512, x86_64/intel/broadwell, x86_64/generic
repositories: nessi-2023.06-cl, nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11

nessi-bot · 2024-06-04T11:53:09Z

Instance eX3-NESSI is configured to build for:

architectures: x86_64/amd/zen2, aarch64/generic
repositories: nessi-2023.06-cl, nessi-2023.06-swl-deb10, nessi-2023.06-swl-deb11

trz42 · 2024-06-04T11:53:40Z

Initial test build...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

nessi-bot · 2024-06-04T11:53:43Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 12044, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)

nessi-bot · 2024-06-04T11:53:43Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T11:53:43Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T11:53:43Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T11:53:47Z

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.06/pr_391/12044

date	job status	comment
Jun 04 11:53:46 UTC 2024	submitted	job id `12044` awaits release by job manager
Jun 04 11:54:02 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 04 11:55:04 UTC 2024	running	job `12044` is running
Jun 04 12:52:27 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-12044.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1717504884.tar.gz` size: 137 MiB (144657684 bytes) entries: 3995 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/init/easybuild/eb_hooks.py` `2023.06/scripts/extra/install_custom_ctypes.sh`
Jun 04 12:52:27 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-12044.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-06-04T12:23:27Z

Rerun after fixing location of utils.sh...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

nessi-bot · 2024-06-04T12:23:29Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 12045, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)

nessi-bot · 2024-06-04T12:23:29Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T12:23:29Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T12:23:29Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T12:23:33Z

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.06/pr_391/12045

date	job status	comment
Jun 04 12:23:32 UTC 2024	submitted	job id `12045` awaits release by job manager
Jun 04 12:24:36 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 04 12:30:45 UTC 2024	running	job `12045` is running
Jun 04 13:17:54 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-12045.out` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1717506455.tar.gz` size: 137 MiB (144664568 bytes) entries: 3995 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/init/easybuild/eb_hooks.py` `2023.06/scripts/extra/install_custom_ctypes.sh`
Jun 04 13:17:54 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-12045.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-06-04T13:24:13Z

Rerun again...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

nessi-bot · 2024-06-04T13:24:15Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 12046, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)

nessi-bot · 2024-06-04T13:24:16Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T13:24:16Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T13:24:16Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T13:24:19Z

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.06/pr_391/12046

date	job status	comment
Jun 04 13:24:18 UTC 2024	submitted	job id `12046` awaits release by job manager
Jun 04 13:24:57 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 04 13:26:00 UTC 2024	running	job `12046` is running
Jun 04 14:12:51 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-12046.out` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1717509745.tar.gz` size: 137 MiB (144663624 bytes) entries: 3995 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/init/easybuild/eb_hooks.py` `2023.06/scripts/extra/install_custom_ctypes.sh`
Jun 04 14:12:51 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-12046.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

nessi-bot · 2024-06-04T17:30:14Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb10 arch:aarch64/generic from trz42
- expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- submitted job 11730912, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)
handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic resulted in:
- no jobs were submitted
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T17:30:18Z

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.06/pr_391/5811903

date	job status	comment
Jun 04 17:30:17 UTC 2024	submitted	job id `5811903` awaits release by job manager
Jun 04 17:30:50 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 04 17:31:53 UTC 2024	running	job `5811903` is running
Jun 04 18:16:04 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-5811903.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-broadwell-1717524533.tar.gz` size: 137 MiB (144474772 bytes) entries: 3995 modules under 2023.06/software/linux/x86_64/intel/broadwell/modules/all `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/intel/broadwell/software `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/intel/broadwell `2023.06/init/easybuild/eb_hooks.py` `2023.06/scripts/extra/install_custom_ctypes.sh`
Jun 04 18:16:05 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-5811903.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

nessi-bot · 2024-06-04T17:30:19Z

New job on instance AWS-MC-NESSI for architecture x86_64-generic for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.06/pr_391/12050

date	job status	comment
Jun 04 17:30:18 UTC 2024	submitted	job id `12050` awaits release by job manager
Jun 04 17:30:57 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 04 17:37:00 UTC 2024	running	job `12050` is running
Jun 04 18:24:06 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-12050.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-generic-1717524960.tar.gz` size: 136 MiB (142931210 bytes) entries: 3995 modules under 2023.06/software/linux/x86_64/generic/modules/all `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/generic/software `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/generic `2023.06/init/easybuild/eb_hooks.py` `2023.06/scripts/extra/install_custom_ctypes.sh`
Jun 04 18:24:06 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-12050.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

nessi-bot · 2024-06-04T17:30:29Z

New job on instance Saga-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi-2023.06-swl-deb11 in job dir /cluster/projects/nn9992k/pilot.nessi.no/jobs/2024.06/pr_391/11730912

date	job status	comment
Jun 04 05:30:28 PM UTC 2024	submitted	job id `11730912` awaits release by job manager
Jun 04 05:31:28 PM UTC 2024	released	job awaits launch by Slurm scheduler
Jun 04 05:32:31 PM UTC 2024	running	job `11730912` is running
Jun 04 06:35:15 PM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-11730912.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-intel-skylake_avx512-1717525355.tar.gz` size: 136 MiB (143623427 bytes) entries: 3995 modules under 2023.06/software/linux/x86_64/intel/skylake_avx512/modules/all `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/intel/skylake_avx512/software `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/intel/skylake_avx512 `2023.06/init/easybuild/eb_hooks.py` `2023.06/scripts/extra/install_custom_ctypes.sh`
Jun 04 06:35:15 PM UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-11730912.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

nessi-bot · 2024-06-04T17:30:29Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:Fram-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/broadwell from trz42
- expanded format: build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell
received bot command build inst:Saga-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/intel/skylake from trz42
- expanded format: build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake
received bot command build inst:eX3-NESSI repo:nessi-2023.06-swl-deb10 arch:aarch64/generic from trz42
- expanded format: build instance:eX3-NESSI repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic
received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:x86_64/generic from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic
handling command build instance:Fram-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/broadwell resulted in:
- no jobs were submitted
handling command build instance:Saga-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/intel/skylake resulted in:
- no jobs were submitted
handling command build instance:eX3-NESSI repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic resulted in:
- submitted job 216606, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:x86_64/generic resulted in:
- no jobs were submitted

nessi-bot · 2024-06-04T17:30:37Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi-2023.06-swl-deb10 in job dir /home/thomarob/pilot.nessi.no/jobs/2024.06/pr_391/216606

date	job status	comment
Jun 04 05:30:36 PM UTC 2024	submitted	job id `216606` awaits release by job manager
Jun 04 05:31:21 PM UTC 2024	released	job awaits launch by Slurm scheduler
Jun 04 05:32:26 PM UTC 2024	running	job `216606` is running
Jun 04 06:25:03 PM UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-216606.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-aarch64-generic-1717524844.tar.gz` size: 128 MiB (134848683 bytes) entries: 3995 modules under 2023.06/software/linux/aarch64/generic/modules/all `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/aarch64/generic/software `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/aarch64/generic `2023.06/init/easybuild/eb_hooks.py` `2023.06/scripts/extra/install_custom_ctypes.sh`
Jun 04 06:25:03 PM UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-216606.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-06-05T19:16:19Z

Rebuild after reworked internals and changed installation location...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

nessi-bot · 2024-06-05T19:16:22Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 12102, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)

nessi-bot · 2024-06-05T19:16:22Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T19:16:22Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T19:16:25Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T19:16:26Z

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.06/pr_391/12102

date	job status	comment
Jun 05 19:16:25 UTC 2024	submitted	job id `12102` awaits release by job manager
Jun 05 19:16:43 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 05 19:22:46 UTC 2024	running	job `12102` is running
Jun 05 20:10:11 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-12102.out` ❌ found message matching `ERROR:` ❌ found message matching `FAILED:` ❌ found message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
Jun 05 20:10:11 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-12102.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-06-05T19:53:40Z

One more time after fixing some bugs...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

nessi-bot · 2024-06-05T19:53:42Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 12103, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)

nessi-bot · 2024-06-05T19:53:42Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T19:53:43Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T19:53:43Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T19:53:46Z

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.06/pr_391/12103

date	job status	comment
Jun 05 19:53:45 UTC 2024	submitted	job id `12103` awaits release by job manager
Jun 05 19:54:31 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 05 19:59:41 UTC 2024	running	job `12103` is running
Jun 05 20:47:29 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-12103.out` ❌ found message matching `ERROR:` ❌ found message matching `FAILED:` ❌ found message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1717619774.tar.gz` size: 132 MiB (139413649 bytes) entries: 3760 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/init/easybuild/eb_hooks.py`
Jun 05 20:47:29 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-12103.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

trz42 · 2024-06-05T20:36:05Z

Never ending story...

bot: build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2

nessi-bot · 2024-06-05T20:36:08Z

Updates by the bot instance Saga-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T20:36:08Z

Updates by the bot instance Fram-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

nessi-bot · 2024-06-05T20:36:09Z

Updates by the bot instance AWS-MC-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- submitted job 12104, for details & status see {2023.06}[foss/2023a] librosa v0.10.1 #391 (comment)

nessi-bot · 2024-06-05T20:36:13Z

New job on instance AWS-MC-NESSI for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /project/def-nessi/SHARED/jobs/2024.06/pr_391/12104

date	job status	comment
Jun 05 20:36:12 UTC 2024	submitted	job id `12104` awaits release by job manager
Jun 05 20:36:57 UTC 2024	released	job awaits launch by Slurm scheduler
Jun 05 20:38:02 UTC 2024	running	job `12104` is running
Jun 05 21:25:30 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-12104.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1717622065.tar.gz` size: 138 MiB (145186216 bytes) entries: 4500 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `custom_ctypes/1.2.lua` `librosa/0.10.1-foss-2023a.lua` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite.lua` `numba/0.58.1-foss-2023a.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `custom_ctypes/1.2` `librosa/0.10.1-foss-2023a` `LLVM/14.0.6-GCCcore-12.3.0-llvmlite` `numba/0.58.1-foss-2023a` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/init/easybuild/eb_hooks.py`
Jun 05 21:25:30 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 4/4 test case(s) from 4 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-12104.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

nessi-bot · 2024-06-05T20:36:14Z

Updates by the bot instance eX3-NESSI (click for details)

received bot command build inst:AWS-MC-NESSI repo:nessi-2023.06-swl-deb11 arch:zen2 from trz42
- expanded format: build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2
handling command build instance:AWS-MC-NESSI repository:nessi-2023.06-swl-deb11 architecture:zen2 resulted in:
- no jobs were submitted

trz42 · 2024-06-28T11:53:45Z

Can be closed.

truib added 3 commits June 4, 2024 12:55

add hooks for fixing sanitycheck and augmenting modluafooter

01dfde9

script to install custom ctypes

8a6b283

- copies the script to a new location on CVMFS scripts/extra - calls script in EESSI-install-software.sh - script itself installs custom ctypes library under host_injections

{2023.06}[foss/2023a] librosa v0.10.1

a9eda01

trz42 added the NESSI/2023.06 label Jun 4, 2024

trz42 mentioned this pull request Jun 4, 2024

{2023.06}[2023a] PyTorch-Bundle v2.1.2 EESSI/software-layer#585

Open

fix location of utils.sh

e222519

add a bit debug output

b28c28e

replace tree with ls

0839b68

trz42 mentioned this pull request Jun 4, 2024

{2023.06}[foss/2023a] PyTorch-bundle 2.1.2 with CUDA/12.1.1 #387

Open

use .eb file, easystack file and standard location for custom_ctypes

8514bd4

fix bug in call extra install script

532e774

make sure env var is defined

6f63976

trz42 closed this Jun 28, 2024

{2023.06}[foss/2023a] librosa v0.10.1 #391

{2023.06}[foss/2023a] librosa v0.10.1 #391

Conversation

trz42 commented Jun 4, 2024

nessi-bot bot commented Jun 4, 2024

nessi-bot bot commented Jun 4, 2024

nessi-bot bot commented Jun 4, 2024

nessi-bot bot commented Jun 4, 2024

trz42 commented Jun 4, 2024

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

trz42 commented Jun 4, 2024

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

trz42 commented Jun 4, 2024

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

nessi-bot bot commented Jun 4, 2024 • edited Loading

trz42 commented Jun 5, 2024

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

trz42 commented Jun 5, 2024

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

trz42 commented Jun 5, 2024

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

nessi-bot bot commented Jun 5, 2024 • edited Loading

trz42 commented Jun 28, 2024

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 4, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading

nessi-bot bot commented Jun 5, 2024 •

edited

Loading