New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TPU support #282

Open

dylanbannon opened this issue Mar 3, 2020 · 1 comment

Labels

Contributor

dylanbannon commented Mar 3, 2020 •

edited

Loading

Is your feature request related to a problem? Please describe.
TPU support has been on our wishlist for a while. Let's not forget about it.

Describe the solution you'd like
Support of TPUs in Google Cloud for prediction.

Additional context
A more ambitious version of this was attempted a while ago in #90. There may be some useful information there.

dylanbannon added the enhancement label

dylanbannon mentioned this issue

added TPU functionality for training #90

Closed

8 tasks

Contributor

willgraf commented Dec 9, 2020

It sounds pretty straightforward to enable TPU in GKE.

It sounds like we need just a few changes:

Pass --enable-tpu to the gcloud container clusters create command.
Annotate the deployment with tf-version.cloud-tpus.google.com: "x.y" (where x.y is the TensorFlow version the models were trained on.
Add a resource limit to the deployment cloud-tpus.google.com/preemptible-v2: 8.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment