-
Notifications
You must be signed in to change notification settings - Fork 47
spack‐stack‐1.8.0 release documentation
Note. A link to post-release updates will be provided here when needed.
Ready-to-use spack-stack 1.8.0 installations are available on the following, fully supported platforms. This version supports JEDI-Skylab, various UFS and related applications (UFS Weather Model, EMC Global Workflow, GSI, UFS Short Range Weather Application), and several NEPTUNE applications. Amazon Web Services AMI are available in the US East 1 or 2 regions.
| Organization | System | Compilers | Maintainers |
|---|---|---|---|
| HPC platforms | |||
| MSU | Hercules | GCC, Intel | EPIC / JCSDA |
| MSU | Orion | GCC, Intel | EPIC / JCSDA |
| NASA | Discover SCU16 | GCC, Intel | JCSDA |
| NASA | Discover SCU17 | GCC, Intel | JCSDA |
| NCAR-Wyoming | Derecho | GCC, Intel | EPIC / JCSDA |
| NOAA (NCEP) | Acorn | Intel | NOAA-EMC |
| NOAA (RDHPCS) | Gaea C5 | Intel | EPIC / NOAA-EMC |
| NOAA (RDHPCS) | Gaea C6 | Intel | EPIC / NOAA-EMC |
| NOAA (RDHPCS) | Hera | GCC, Intel | EPIC / NOAA-EMC |
| NOAA (RDHPCS) | Jet | GCC, Intel | EPIC / NOAA-EMC |
| U.S. Navy (HPCMP) | Narwhal | GCC, Intel, oneAPI | NRL |
| U.S. Navy (HPCMP) | Nautilus | GCC, Intel, oneAPI | NRL |
| Univ. of Wisconsin | S4 | Intel | JCSDA |
| Cloud platforms | |||
| Amazon Web Services | AMI Red Hat 8 | GCC | JCSDA |
| Amazon Web Services | Parallelcluster JCSDA | GCC, Intel | JCSDA |
| NOAA (RDHPCS) | RDHPCS Parallel Works | Intel | EPIC / JCSDA |
To use one of the above installations via the system default environment module system, follow the instructions in the individual sections below. For questions or problems, please consult the known issues (MISSING LINK TO KNOWN ISSUES BELOW), the currently open GitHub issues, and the GitHub discussions first.
The following is a list of supplemental or "add-on" environments that are maintained through spack-stack. These environments are provided on a subset of the tier 1 platforms. To use them, replace ue-COMPILER-VERSION in the instructions below with the add-on environment name.
| Environment name | Description | Platforms |
|---|---|---|
| gsi-addon-* | Supports GSI and related applications | |
| ne-* | Supports NRL's NEPTUNE atmospheric model with xNRL | Nautilus, Narwhal |
| ufswm-* | Supports UFS Weather Model with WCOSS2 package versions |
For general instructions for installing add-on environments that make use of the installations available on tier-1 platforms, see https://spack-stack.readthedocs.io/en/latest/AddingTestPackages.html.
The add-on environment for GSI is maintained under the gsi-addon-dev template.
The NEPTUNE standalone environment is not a chained environment and is installed independently from the standard unified environment. To install this environment, simply replace unified-dev in the spack stack create env call with neptune-dev, for example:
spack stack create env --name=ne-oneapi-2024.2.1 --site=nautilus --compiler=oneapi --template=neptune-dev
The ufs-weather-model-static template is installed on several systems as a standalone (non-chained) environment that attempts to follow the package versions available on WCOSS2.
The following is required for using spack to build and run software with any of the compilers below.
module purge
For Intel (classic):
module use /apps/contrib/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.9.0/install/modulefiles/Core
module load stack-intel/2021.9.0
module load stack-intel-oneapi-mpi/2021.9.0
module load stack-python/3.11.7
# Needed to ensure the spack-stack built udunits package gets loaded
# instead of the spack-managed udunits package.
export LMOD_TMOD_FIND_FIRST=yes
module use /apps/contrib/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.9.0/install/modulefiles/intel/2021.9.0
For GNU:
module use /apps/contrib/spack-stack/spack-stack-1.8.0/envs/ue-gcc-12.2.0/install/modulefiles/Core
module load stack-gcc/12.2.0
module load stack-openmpi/4.1.4
module load stack-python/3.11.7
# Needed to ensure the spack-stack built udunits package gets loaded
# instead of the spack-managed udunits package.
export LMOD_TMOD_FIND_FIRST=yes
module use /apps/contrib/spack-stack/spack-stack-1.8.0/envs/ue-gcc-12.2.0/install/modulefiles/gcc/12.2.0
The following is required for using spack to build and run software with any of the compilers below.
module purge
For Intel (classic):
module use /apps/contrib/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.9.0/install/modulefiles/Core
module load stack-intel/2021.9.0
module load stack-intel-oneapi-mpi/2021.9.0
module load stack-python/3.11.7
For GNU:
module use /apps/contrib/spack-stack/spack-stack-1.8.0/envs/ue-gcc-12.2.0/install/modulefiles/Core
module load stack-gcc/12.2.0
module load stack-openmpi/4.1.4
module load stack-python/3.11.7
The following is required for using spack to build and run software with any of the compilers below.
module purge
module use /discover/swdev/gmao_SIteam/modulefiles-SLES12
module use /discover/swdev/jcsda/spack-stack/scu16/modulefiles
module load miniconda/3.9.7
For Intel:
module use /gpfsm/dswdev/jcsda/spack-stack/scu16/spack-stack-1.8.0/envs/ue-intel-2021.6.0/install/modulefiles/Core
module load stack-intel/2021.6.0
module load stack-intel-oneapi-mpi/2021.6.0
module load stack-python/3.11.7
For GNU:
module use /gpfsm/dswdev/jcsda/spack-stack/scu16/spack-stack-1.8.0/envs/ue-gcc-12.1.0/install/modulefiles/Core
module load stack-gcc/12.1.0
module load stack-openmpi/4.1.3
module load stack-python/3.11.7
The following is required for using spack to build and run software with any of the compilers below.
module purge
module use /discover/swdev/gmao_SIteam/modulefiles-SLES15
module use /discover/swdev/jcsda/spack-stack/scu17/modulefiles
For Intel:
module use /gpfsm/dswdev/jcsda/spack-stack/scu17/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-intel-oneapi-mpi/2021.10.0
module load stack-python/3.11.7
For GNU:
module use /gpfsm/dswdev/jcsda/spack-stack/scu17/spack-stack-1.8.0/envs/ue-gcc-12.3.0/install/modulefiles/Core
module load stack-gcc/12.3.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7
The following is required for using spack to build and run software with Intel. Don't use module purge on Narwhal!
module unload PrgEnv-cray
module load PrgEnv-intel/8.3.3
module unload intel
module load intel-classic/2023.2.0
module unload cray-mpich
module unload craype-network-ofi
module load craype-network-ucx
module load cray-mpich-ucx/8.1.21
module load libfabric/1.12.1.2.2.1
module unload cray-libsci
module load cray-libsci/23.05.1.4
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-cray-mpich/8.1.21
module load stack-python/3.11.7
Experimental and for NEPTUNE standalone environment (ne-) without Python packages only: The following is required for using spack to build and run software with Intel oneAPI. Don't use module purge on Narwhal!
module unload PrgEnv-cray
module load PrgEnv-intel/8.3.3
module unload intel
module use /p/app/projects/NEPTUNE/spack-stack/oneapi-2024.2.1/modulefiles
module load tbb/2021.13
module load compiler-rt/2024.2.1
module load compiler/2024.2.1
module load ifort/2024.2.1
module unload cray-mpich
module unload craype-network-ofi
module load craype-network-ucx
module load cray-mpich-ucx/8.1.21
module load libfabric/1.12.1.2.2.1
module unload cray-libsci
module load cray-libsci/23.05.1.4
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ne-oneapi-2024.2.1-no-python/install/modulefiles/Core
module load stack-oneapi/2024.2.1
module load stack-cray-mpich/8.1.21
The following is required for using spack to build and run software with GNU. Don't use module purge on Narwhal!
module unload PrgEnv-cray
module load PrgEnv-gnu/8.3.3
module unload gcc
module load gcc/10.3.0
module unload cray-mpich
module unload craype-network-ofi
module load craype-network-ucx
module load cray-mpich-ucx/8.1.21
module load libfabric/1.12.1.2.2.1
module unload cray-libsci
module load cray-libsci/23.05.1.4
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-gcc-10.3.0/install/modulefiles/Core
module load stack-gcc/10.3.0
module load stack-cray-mpich/8.1.21
module load stack-python/3.11.7
The following is required for using spack to build and run software with any of the compilers below.
module purge
For Intel classic:
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.5.0/install/modulefiles/Core
module load stack-intel/2021.5.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7
For GNU:
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-gcc-12.2.1/install/modulefiles/Core
module load stack-gcc/12.2.1
module load stack-openmpi/5.0.1
module load stack-python/3.11.7
For Intel oneAPI (LLVM compilers with ifort instead of ifx):
module use /p/app/projects/NEPTUNE/spack-stack/oneapi-2024.2.1/modulefiles
module use /p/app/projects/NEPTUNE/spack-stack/spack-stack-1.8.0/envs/ue-oneapi-2024.2.1/install/modulefiles/Core
module load stack-oneapi/2024.2.1
module load stack-intel-oneapi-mpi/2021.13
module load stack-python/3.11.7
The following is required for using spack to build and run software with any of the compilers below.
module purge
# ignore that the sticky module ncarenv/... is not unloaded
export LMOD_TMOD_FIND_FIRST=yes
module load ncarenv/23.09
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/modulefiles
For Intel (classic):
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-cray-mpich/8.1.25
module load stack-python/3.11.7
For GNU:
module use /glade/work/epicufsrt/contrib/spack-stack/derecho/spack-stack-1.8.0/envs/ue-gcc-12.2.0/install/modulefiles/Core
module load stack-gcc/12.2.0
module load stack-cray-mpich/8.1.25
module load stack-python/3.11.7
MISSING
The following is required for using spack to build and run software with the compiler below.
module purge
For Intel (classic):
module use /contrib/spack-stack-rocky8/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-intel-oneapi-mpi/2021.10.0
module load stack-python/3.11.7
The following is required for using spack to build and run software with the compiler below. Don't use module purge on Gaea - C5!
For Intel classic:
module use /ncrc/proj/epic/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2023.2.0
module load stack-cray-mpich/8.1.28
module load stack-python/3.11.7
The following is required for using spack to build and run software with the compiler below. Don't use module purge on Gaea - C6!
For Intel classic:
module use /ncrc/proj/epic/spack-stack/c6/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2023.2.0
module load stack-cray-mpich/8.1.29
module load stack-python/3.11.7
The following is required for using spack to build and run software with any of the compilers below.
module purge
For Intel (classic):
module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.5.0/install/modulefiles/Core
module load stack-intel/2021.5.0
module load stack-intel-oneapi-mpi/2021.5.1
module load stack-python/3.11.7
For GNU:
module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-gcc-9.2.0/install/modulefiles/Core
module load stack-gcc/9.2.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7
The following is required for using spack to build and run software with any of the compilers below.
module purge
For Intel (classic):
module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.5.0/install/modulefiles/Core
module load stack-intel/2021.5.0
module load stack-intel-oneapi-mpi/2021.5.1
module load stack-python/3.11.7
For GNU:
module use /contrib/spack-stack/spack-stack-1.8.0/envs/ue-gcc-9.2.0/install/modulefiles/Core
module load stack-gcc/9.2.0
module load stack-openmpi/4.1.6
module load stack-python/3.11.7
When installing packages with spack-stack, to avoid a bug with Spack resource caching, avoid the system Python (3.6) and use:
module load gcc/10.3.0 python/3.11.7
before running setup.sh ($SPACK_PYTHON should point to a Python executable other than the one in /usr/bin).
The following is required for using spack to build and run software with any of the compilers below. For Intel (classic):
module purge
module use /data/prod/jedi/spack-stack/spack-stack-1.8.0/envs/ue-intel-2021.10.0/install/modulefiles/Core
module load stack-intel/2021.10.0
module load stack-intel-oneapi-mpi/2021.10.0
module load stack-python/3.11.7
MISSING
MISSING
None at this time.