Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Turn on orchestrated dace:cpu on acoustics substep translate test #2

Merged
merged 5 commits into from
Feb 8, 2024
Merged

Turn on orchestrated dace:cpu on acoustics substep translate test #2

Changes from 4 commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
779215b
Turn on orchestrated dace:cpu on full dycore translate test
FlorianDeconinck Feb 7, 2024
670e105
Missing untar cmd
FlorianDeconinck Feb 7, 2024
99ad196
Revert back to 3.8.12
FlorianDeconinck Feb 7, 2024
993be8f
Limit FV to a rank 0 to speed up test
FlorianDeconinck Feb 7, 2024
1ba1075
Flip for Acoustics loop to reduce utest time
FlorianDeconinck Feb 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 31 additions & 8 deletions .github/workflows/translate.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ jobs:
runs-on: ubuntu-latest
strategy:
matrix:
python: [3.11.7]
python: [3.8.12]
steps:
- name: Checkout repository
uses: actions/[email protected]
Expand All @@ -25,19 +25,15 @@ jobs:
run: |
python -m pip install --upgrade pip setuptools wheel
pip install .[ndsl,test]
- name: Download data
- name: Prepare test_data
run: |
mkdir -p test_data
- name: Numpy FvTp2d
run: |
cd test_data
wget https://portal.nccs.nasa.gov/datashare/astg/smt/pace-regression-data/8.1.3_c12_6_ranks_standard.FvTp2d.tar.gz
tar -xzvf 8.1.3_c12_6_ranks_standard.FvTp2d.tar.gz
wget https://portal.nccs.nasa.gov/datashare/astg/smt/pace-regression-data/8.1.3_c12_6_ranks_standard.D_SW.tar.gz
tar -xzvf 8.1.3_c12_6_ranks_standard.D_SW.tar.gz
wget https://portal.nccs.nasa.gov/datashare/astg/smt/pace-regression-data/8.1.3_c12_6_ranks_standard.Remapping.tar.gz
tar -xzvf 8.1.3_c12_6_ranks_standard.Remapping.tar.gz
cd -
- name: Numpy FvTp2d
run: |
pytest \
-v -s --data_path=./test_data/8.1.3/c12_6ranks_standard/dycore \
--backend=numpy \
Expand All @@ -46,6 +42,10 @@ jobs:
./tests/savepoint
- name: Numpy D_SW
run: |
cd test_data
wget https://portal.nccs.nasa.gov/datashare/astg/smt/pace-regression-data/8.1.3_c12_6_ranks_standard.D_SW.tar.gz
tar -xzvf 8.1.3_c12_6_ranks_standard.D_SW.tar.gz
cd -
pytest \
-v -s --data_path=./test_data/8.1.3/c12_6ranks_standard/dycore \
--backend=numpy \
Expand All @@ -54,9 +54,32 @@ jobs:
./tests/savepoint
- name: Numpy Remapping
run: |
cd test_data
wget https://portal.nccs.nasa.gov/datashare/astg/smt/pace-regression-data/8.1.3_c12_6_ranks_standard.Remapping.tar.gz
tar -xzvf 8.1.3_c12_6_ranks_standard.Remapping.tar.gz
cd -
pytest \
-v -s --data_path=./test_data/8.1.3/c12_6ranks_standard/dycore \
--backend=numpy \
--which_modules=Remapping \
--threshold_overrides_file=./tests/savepoint/translate/overrides/standard.yaml \
./tests/savepoint
- name: Orchestrated dace:cpu FVDynamics
run: |
cd test_data
wget https://portal.nccs.nasa.gov/datashare/astg/smt/pace-regression-data/8.1.3_c12_6_ranks_standard.FVDynamics.tar.gz
tar -xzvf 8.1.3_c12_6_ranks_standard.FVDynamics.tar.gz
cd -
export FV3_DACEMODE=BuildAndRun
export PACE_FLOAT_PRECISION=64
export PACE_TEST_N_THRESHOLD_SAMPLES=0
export OMP_NUM_THREADS=1
export PACE_LOGLEVEL=Debug
mpirun -mca orte_abort_on_non_zero_status 1 -np 6 --oversubscribe pytest \
-v -s --data_path=./test_data/8.1.3/c12_6ranks_standard/dycore \
--backend=dace:cpu \
-m parallel \
--which_rank=0 \
--which_modules=FVDynamics \
--threshold_overrides_file=./tests/savepoint/translate/overrides/standard.yaml \
./tests/savepoint
Loading