Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add evaluation, multimodal, native tests to run-readme-pr-mps.yml #1410

Open
wants to merge 8 commits into
base: main
Choose a base branch
from
87 changes: 84 additions & 3 deletions .github/workflows/run-readme-pr-mps.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ jobs:
uses: pytorch/test-infra/.github/workflows/macos_job.yml@main
with:
runner: macos-m1-14
timeout-minutes: 50
timeout: 120
script: |
conda create -y -n test-readme-mps-macos python=3.10.11 llvm-openmp
conda activate test-readme-mps-macos
Expand Down Expand Up @@ -63,7 +63,7 @@ jobs:
test-gguf-mps-macos:
uses: pytorch/test-infra/.github/workflows/macos_job.yml@main
with:
runner: macos-m1-14 # neeps MPS, was macos-m1-stable
runner: macos-m1-14 # needs MPS, was macos-m1-stable
script: |
set -x
conda create -y -n test-quantization-mps-macos python=3.10.11
Expand All @@ -90,7 +90,7 @@ jobs:
test-advanced-mps-macos:
uses: pytorch/test-infra/.github/workflows/macos_job.yml@main
with:
runner: macos-m1-14 # neeps MPS, was macos-m1-stable
runner: macos-m1-14 # needs MPS, was macos-m1-stable
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice typo fix, should we land it as separate PR?

script: |
set -x
conda create -y -n test-quantization-mps-macos python=3.10.11
Expand All @@ -113,3 +113,84 @@ jobs:
echo "tests complete"
echo "*******************************************"
echo "::endgroup::"

test-evaluation-mps-macos:
uses: pytorch/test-infra/.github/workflows/macos_job.yml@main
with:
runner: macos-m1-14 # needs MPS, was macos-m1-stable
script: |
set -x
conda create -y -n test-evaluation-mps-macos python=3.10.11
conda activate test-evaluation-mps-macos
# NS: Remove previous installation of torch first
# as this script does not isntall anything into conda env
# but rather system dep
pip3 uninstall -y torch || true
set -eou pipefail

echo "::group::Print machine info"
uname -a
sysctl machdep.cpu.brand_string
sysctl machdep.cpu.core_count
echo "::endgroup::"

.ci/scripts/run-docs evaluation

echo "::group::Completion"
echo "tests complete"
echo "*******************************************"
echo "::endgroup::"

test-multimodal-mps-macos:
uses: pytorch/test-infra/.github/workflows/macos_job.yml@main
with:
runner: macos-m1-14 # needs MPS, was macos-m1-stable
script: |
set -x
conda create -y -n test-multimodal-mps-macos python=3.10.11
conda activate test-multimodal-mps-macos
# NS: Remove previous installation of torch first
# as this script does not isntall anything into conda env
# but rather system dep
pip3 uninstall -y torch || true
set -eou pipefail

echo "::group::Print machine info"
uname -a
sysctl machdep.cpu.brand_string
sysctl machdep.cpu.core_count
echo "::endgroup::"

.ci/scripts/run-docs multimodal

echo "::group::Completion"
echo "tests complete"
echo "*******************************************"
echo "::endgroup::"

test-native-mps-macos:
uses: pytorch/test-infra/.github/workflows/macos_job.yml@main
with:
runner: macos-m1-14 # needs MPS, was macos-m1-stable
script: |
set -x
conda create -y -n test-native-mps-macos python=3.10.11
conda activate test-native-mps-macos
# NS: Remove previous installation of torch first
# as this script does not isntall anything into conda env
# but rather system dep
pip3 uninstall -y torch || true
set -eou pipefail

echo "::group::Print machine info"
uname -a
sysctl machdep.cpu.brand_string
sysctl machdep.cpu.core_count
echo "::endgroup::"

.ci/scripts/run-docs native

echo "::group::Completion"
echo "tests complete"
echo "*******************************************"
echo "::endgroup::"
Loading