Advantage/reasons of choosing backend for torch.compile: openvino vs. openvino_ts backend #23943
-
Per the link below, please explain when to select openvino vs. openvino_ts backend. https://docs.openvino.ai/2024/openvino-workflow/torch-compile.html |
Beta Was this translation helpful? Give feedback.
Answered by
siddhant-0707
Apr 9, 2024
Replies: 1 comment
-
Hey @js333031,
|
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
js333031
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hey @js333031,
torch.compile(model, backend='openvino')
tends to be faster in all cases. Moreoveropenvino_ts
will probably be removed in upcoming releases. You can learn whytorch.compile
which is equivalent tobackend='openvino'
is faster than torchscript here.