You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
"The `IPUConfig` object specifies how the model will be pipelined across the IPUs. \n",
"\n",
"For fine-tuning, we place the encoder on one IPU, and the decoder on a different IPU. We then create two replicas to use all four IPUs with data parallelism.\n",
"For fine-tuning, we place the encoder on two IPUs, and the decoder on two IPUs.\n",
"\n",
"For inference, the entire model is placed on one IPU, and replicated four times."