Are there tutorials using Distributed Training Libraries and Multibackend?

[ghsanti]

Hi!

I've been tinkering with keras tuner for learning purposes, but doing some searches I've found 2 libraries don't use gRPC.

One of them is Horovod, the other one is Ray, both are open source projects.

I wonder if you have tried any of these, or have any tutorials or thoughts on distributed training? I have used HPC setups with PBS but that's a different level of complexity.

Maybe you prefer gRPC for a specific reason?