ONNX Runtime on GPU of an Android System

[besartgrabanica]

Hello,

Is it possible to do the inference of a model on the GPU of an Android run system? The model has been designed using PyTorch.

Thanks in advance!

[lenisha]

@manashgoswami - could you pls take a look?

[guoyu-wang]

#6694 is tracking this,

We have the NNAPI execution provider which uses CPU/GPU/NPU for model execution on Android.
Please see NNAPI Execution Provider

[faxu]

Cross-posted here: #6694