Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test check result #1

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open

Test check result #1

wants to merge 28 commits into from

Conversation

poksumdo
Copy link

@poksumdo poksumdo commented Apr 9, 2023

PR to test if bot/check-result.sh script works.

truib added 24 commits April 3, 2023 11:24
@truib
added helper scripts and improved bot/build.sh
b8c1b8e 
- scripts/utils.sh is borrowed from software-layer. it includes various functions
  to be used with other scripts in this repo.
- scripts/cfg_files.sh is borrowed from software-layer. it provides functions to
  read a file that contains information about a job.
- changes to bot/build.sh:
  - added header, author, license
  - added assumptions
  - added set -e
  - source the above helper scripts
  - read job.cfg file
  - set core settings if needed: HTTP_PROXY, HTTPS_PROXY, LOCAL_TMP, LOAD_MODULES
  - expand LOCAL_TMP into STORAGE
  - load modules
  - obtain cpu_target_arch from job.cfg setting
  - bump eessi_version to 2023.04
  - calling install_compatibility_layer.sh: remove fixed local container, add
    storage option
@truib
updates to install_compatibility_layer.sh
d742027 
- add arguments for resuming, retaining tmp and more verbose output
- extended and reformatted usage information
- source helper script scripts/utils.sh
- add support to resume a previous run given its temporary directory
- determine container runtime (singularity or apptainer)
- define env vars for both singularity and apptainer
- unset PKG_CONFIG_PATH before running ansible script
- only tar temporary directory if --retain-tmp option is given
- add message for how to resume a previous run
@truib
add default version + create own /tmp + fix id for tgz
882e6b5
@truib
use version and repository from job.cfg or default + some cleanup
0dfcf90
@truib
bump version to 2023.04
73af988
@truib
replace community.general.portage with calling emerge in shell
cfc0604
@truib
add tasks to install and deselect build dependencies + use emerge to …
486257e 
…remove them
@truib
use emerge to install package set (don't rebuild though and only inst…
c4034a7 
…all if list not empty)
@truib
provide missing profile for arm64 + make sure bash is used for bootst…
6037645 
…rapping tasks (because pipefail is needed)
@truib
replacing community.general.portage with emerge (noreplace false is d…
1db0017 
…efault)
@truib
ensure ReFrame tests are working
f816a83 
- added some debugging
- remove any existing virtualenv
- make sure ReFrame is installed
- left some more example debugging (could be cleaned up)
@truib
attempt to fix Ansible lint issues
0a5f11c
@truib
attempt to fix Ansible lint issues, part 2
a756141
@truib
attempt to fix Ansible lint issues, part 3
3173d4c
@truib
attempt to fix Ansible lint issues, part 4
ae8ea3d
@truib
attempt to fix Ansible lint issues, part 5
2648ddf
@truib
fix typo
f92e956
@truib
add arg to retain eessi_tmpdir + improved messages
6b2cf67
@truib
add missing APPTAINER_BIND
61997e1
@truib
a few fixes + removing commented out code
016509a
@truib
reverted removal of community.general.portage
7bfa90d 
added

```ansible
  vars:
   ansible_python_interpreter: "{{ gentoo_prefix_path }}/usr/bin/python3"
```

to all tasks using communit.general.portage
@truib
test commit from March 13
8f5f5fa
@truib
initial version of script to check result of building compat layer
1cc55a0
@truib
generate output for successful job
937eb6d
@poksumdo
Copy link
Author

poksumdo commented Apr 9, 2023

bot: showconfig

@trz42
Copy link
Owner

trz42 commented Apr 9, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: showconfig

@eessi-bot-devel-trz42
Copy link

Instance CitC-commander is configured to build:

  • arch x86_64/generic for repo nessi.no-2022.11
  • arch x86_64/generic for repo nessi.no-2023.04
  • arch x86_64/generic for repo eessi-2023.04
  • arch x86_64/amd/zen2 for repo nessi.no-2022.11
  • arch x86_64/intel/skylake_avx512 for repo nessi.no-2022.11
  • arch x86_64/intel/cascadelake for repo nessi.no-2022.11
  • arch aarch64/generic for repo nessi.no-2022.11
  • arch aarch64/generic for repo nessi.no-2023.04
  • arch aarch64/generic for repo eessi-2023.04

@trz42
Copy link
Owner

trz42 commented Apr 9, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build a:aarch64 r:eessi-2023.04

  • received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
  • handling build resulted in: created jobs: 4538

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
edited
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4538

date job status comment
Apr 09 10:19:55 PM UTC 2023 submitted job id 4538 awaits release by job manager
Apr 09 10:22:12 PM UTC 2023 released job awaits launch by Slurm scheduler

@trz42
Copy link
Owner

trz42 commented Apr 9, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build a:aarch64 r:eessi-2023.04

  • received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
  • handling build resulted in: created jobs: 4539

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
edited
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4539

date job status comment
Apr 09 10:33:41 PM UTC 2023 submitted job id 4539 awaits release by job manager
Apr 09 10:34:10 PM UTC 2023 released job awaits launch by Slurm scheduler

@trz42
Copy link
Owner

trz42 commented Apr 9, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build a:aarch64 r:eessi-2023.04

  • received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
  • handling build resulted in: created jobs: 4540

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
edited by trz42
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4540

date job status comment
Apr 09 11:06:09 PM UTC 2023 submitted job id 4540 awaits release by job manager
Apr 09 11:06:38 PM UTC 2023 released job awaits launch by Slurm scheduler
Apr 09 11:09:40 PM UTC 2023 finished
😁 SUCCESS click triangle for detailsDetails:
  • no task failed
  • found tarball(s)
Artefacts:
  • eessi-2023.04-compat-linux-aarch64-1681081752.tar.gz

@trz42
Copy link
Owner

trz42 commented Apr 9, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build a:aarch64 r:eessi-2023.04

  • received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
  • handling build resulted in: created jobs: 4541

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
edited
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4541

date job status comment
Apr 09 11:16:44 PM UTC 2023 submitted job id 4541 awaits release by job manager
Apr 09 11:17:19 PM UTC 2023 released job awaits launch by Slurm scheduler
Apr 09 11:18:20 PM UTC 2023 finished
😁 SUCCESS click triangle for detailsDetails:
  • no task failed
  • found tarball(s)
Artefacts:
  • eessi-2023.04-compat-linux-aarch64-1681082238.tar.gz

@trz42
Copy link
Owner

trz42 commented Apr 9, 2023 •
edited by eessi-bot-devel-trz42 bot
Loading

bot: build a:aarch64 r:eessi-2023.04

  • received bot command build a:aarch64 r:eessi-2023.04 from trz42 (expanded command format: build architecture:aarch64 repository:eessi-2023.04)
  • handling build resulted in: created jobs: 4542

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
edited
Loading

New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4542

date job status comment
Apr 09 11:25:19 PM UTC 2023 submitted job id 4542 awaits release by job manager
Apr 09 11:25:24 PM UTC 2023 released job awaits launch by Slurm scheduler
Apr 09 11:26:25 PM UTC 2023 finished
😢 FAILURE click triangle for detailsDetails:
  • some task(s) failed
  • no tarball found
Artefacts:

    @trz42
    Copy link
    Owner

    trz42 commented Apr 9, 2023 •
    edited by eessi-bot-devel-trz42 bot
    Loading

    bot: build r:nessi.no-2023.04 a:aarch64
    bot: build r:nessi.no-2023.04 a:x86_64
    bot: build r:eessi a:aarch64
    bot: build r:eessi-2023.04 a:x86_64

    • received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
    • received bot command build r:nessi.no-2023.04 a:x86_64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:x86_64)
    • received bot command build r:eessi a:aarch64 from trz42 (expanded command format: build repository:eessi architecture:aarch64)
    • received bot command build r:eessi-2023.04 a:x86_64 from trz42 (expanded command format: build repository:eessi-2023.04 architecture:x86_64)
    • handling build resulted in: created jobs: 4543
    • handling build resulted in: created jobs: 4544
    • handling build resulted in: created jobs: 4545
    • handling build resulted in: created jobs: 4546

    @eessi-bot-devel-trz42
    Copy link

    eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
    edited
    Loading

    New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4543

    date job status comment
    Apr 09 11:37:48 PM UTC 2023 submitted job id 4543 awaits release by job manager
    Apr 09 11:38:39 PM UTC 2023 released job awaits launch by Slurm scheduler
    Apr 09 11:41:42 PM UTC 2023 finished
    😢 FAILURE click triangle for detailsDetails:
    • some task(s) failed
    • no tarball found
    Artefacts:

      @eessi-bot-devel-trz42
      Copy link

      eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
      edited
      Loading

      New job on instance CitC-commander for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4544

      date job status comment
      Apr 09 11:38:00 PM UTC 2023 submitted job id 4544 awaits release by job manager
      Apr 09 11:38:36 PM UTC 2023 released job awaits launch by Slurm scheduler
      Apr 09 11:42:46 PM UTC 2023 finished
      😢 FAILURE click triangle for detailsDetails:
      • some task(s) failed
      • no tarball found
      Artefacts:

        @eessi-bot-devel-trz42
        Copy link

        eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
        edited
        Loading

        New job on instance CitC-commander for architecture aarch64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4545

        date job status comment
        Apr 09 11:38:12 PM UTC 2023 submitted job id 4545 awaits release by job manager
        Apr 09 11:38:33 PM UTC 2023 released job awaits launch by Slurm scheduler
        Apr 09 11:41:40 PM UTC 2023 finished
        😢 FAILURE click triangle for detailsDetails:
        • some task(s) failed
        • found tarball(s)
        Artefacts:
        • eessi-2023.04-compat-linux-aarch64-1681083674.tar.gz

        @eessi-bot-devel-trz42
        Copy link

        eessi-bot-devel-trz42 bot commented Apr 9, 2023 •
        edited
        Loading

        New job on instance CitC-commander for architecture x86_64-generic for repository eessi-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4546

        date job status comment
        Apr 09 11:38:23 PM UTC 2023 submitted job id 4546 awaits release by job manager
        Apr 09 11:38:31 PM UTC 2023 released job awaits launch by Slurm scheduler
        Apr 09 11:42:44 PM UTC 2023 finished
        😁 SUCCESS click triangle for detailsDetails:
        • no task failed
        • found tarball(s)
        Artefacts:
        • eessi-2023.04-compat-linux-x86_64-1681083704.tar.gz

        @trz42
        Copy link
        Owner

        trz42 commented Apr 10, 2023 •
        edited by eessi-bot-devel-trz42 bot
        Loading

        bot: build r:nessi.no-2023.04 a:aarch64

        • received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
        • handling build resulted in: created jobs: 4547

        @eessi-bot-devel-trz42
        Copy link

        eessi-bot-devel-trz42 bot commented Apr 10, 2023 •
        edited by trz42
        Loading

        New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4547

        date job status comment
        Apr 10 02:20:28 PM UTC 2023 submitted job id 4547 awaits release by job manager
        Apr 10 02:21:07 PM UTC 2023 released job awaits launch by Slurm scheduler
        Apr 10 02:24:08 PM UTC 2023 finished
        🤷 UNKNOWN click triangle for detailsDetails:
        • Did not find bot/check-result.sh script in '/mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/event_ceebde90-d7aa-11ed-80d8-6976250524d7/run_000/linux_aarch64_generic/nessi.no-2023.04'. Check job manually.
        Artefacts:
        • no artefacts reported

        @trz42
        Copy link
        Owner

        trz42 commented Apr 10, 2023 •
        edited by eessi-bot-devel-trz42 bot
        Loading

        bot: build r:nessi.no-2023.04 a:aarch64

        • received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
        • handling build resulted in: created jobs: 4548

        @eessi-bot-devel-trz42
        Copy link

        eessi-bot-devel-trz42 bot commented Apr 10, 2023 •
        edited
        Loading

        New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4548

        date job status comment
        Apr 10 02:37:22 PM UTC 2023 submitted job id 4548 awaits release by job manager
        Apr 10 02:37:34 PM UTC 2023 released job awaits launch by Slurm scheduler

        @trz42
        Copy link
        Owner

        trz42 commented Apr 10, 2023 •
        edited by eessi-bot-devel-trz42 bot
        Loading

        bot: build r:nessi.no-2023.04 a:aarch64

        • received bot command build r:nessi.no-2023.04 a:aarch64 from trz42 (expanded command format: build repository:nessi.no-2023.04 architecture:aarch64)
        • handling build resulted in: created jobs: 4549

        @eessi-bot-devel-trz42
        Copy link

        eessi-bot-devel-trz42 bot commented Apr 10, 2023 •
        edited
        Loading

        New job on instance CitC-commander for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/trz42/pilot.nessi/bot-rebuild/jobs/2023.04/pr_1/4549

        date job status comment
        Apr 10 02:51:46 PM UTC 2023 submitted job id 4549 awaits release by job manager
        Apr 10 02:52:39 PM UTC 2023 released job awaits launch by Slurm scheduler
        Apr 10 02:55:41 PM UTC 2023 finished
        🤷 UNKNOWN (click triangle for detailed information)Details:
        • Did not find bot/check-result.sh script in job's work directory.
        • Check job manually.
        Artefacts:
        • no artefacts were found/reported

        poksumdo pushed a commit to poksumdo/compatibility-layer that referenced this pull request Jun 8, 2023
        @trz42
        Merge pull request trz42#1 from trz42/eessi-2022.10
        3ec3042 
        Initial package set for EESSI 2022.10
        Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
        Reviewers
        No reviews
        Assignees
        No one assigned
        Labels
        None yet
        Projects
        None yet
        Milestone
        No milestone
        Development

        Successfully merging this pull request may close these issues.
        3 participants
        @poksumdo @trz42 @truib