Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pytorch][graviton] PT 2.2.1 CPU graviton inference release #3807

Merged
merged 18 commits into from
Apr 9, 2024

Conversation

sallyseok
Copy link
Contributor

@sallyseok sallyseok commented Apr 1, 2024

Description

  • Adding PyTorch 2.2.1 Graviton CPU Inference EC2/Sagemaker DLCs.
  • Updated torchserve version from 0.9.0 to 0.10.0
  • Updated SM toolkit version from 2.0.21 to 2.0.22
  • Replaced torchdata installation with upstream binary. It is deprecated so we didn't build torchdata, but torchtext still depends on it. Added explicit installation with the version for verbosity.

Tests run

  • All relevant tests (sanity, ec2, ecs, eks, sagemaker local, sagemaker remote) passing on d1ec4f9

Formatting

DLC image/dockerfile

Builds to Execute

Expand

Click the checkbox to enable a build to execute upon merge.

Note: By default, pipelines are set to "latest". Replace with major.minor framework version if you do not want "latest".

  • build_pytorch_training_latest
  • build_pytorch_inference_latest_graviton
  • build_tensorflow_training_latest
  • build_tensorflow_inference_latest

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@sallyseok sallyseok requested review from a team as code owners April 1, 2024 22:48
@aws-deep-learning-containers-ci aws-deep-learning-containers-ci bot added build Reflects file change in build folder pytorch Reflects file change in pytorch folder Size:S Determines the size of the PR labels Apr 1, 2024
@sallyseok sallyseok changed the title [pytorch][graviton] [pytorch][graviton] PT 2.2.1 CPU graviton inference release Apr 1, 2024
@sallyseok sallyseok enabled auto-merge (squash) April 5, 2024 23:01
@sallyseok sallyseok merged commit 5da1067 into aws:master Apr 9, 2024
27 checks passed
@aws-deep-learning-containers-ci

Started build_pytorch_inference_latest_graviton.

@sallyseok sallyseok deleted the pt-2.2-graviton branch June 11, 2024 02:34
evakravi pushed a commit to evakravi/deep-learning-containers that referenced this pull request Sep 5, 2024
* initial commit

* enable sm tests

* fix test config

* fix syntax bug

* new wheels with cpu tag

* fix urls

* update sm toolkit version, ignore pyopenssl cve

* add allowlist for sm and only run sanity test

* do build

* revert toml
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Reflects file change in build folder pytorch Reflects file change in pytorch folder Size:S Determines the size of the PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants