Survey on usage TVM based packages #3954
lexavtanke
started this conversation in
Design
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
There are two main inference engines for ml models in Autoware: TensorRT and Apache TVM.
From my perspective only TensorRT is mainly in use.
As for now there are some changes in TVM packages
These changes mainly do not affect current usage of the packages. But there is some proposal about updating tvm_utlity package which allows to dynamically load model during the inference. It will allow to use TVM models with more ease.
So I'm curious about how many people are interested in usage of the Apache TVM?
Because It make sense to do this change only if there is demand from the community.
Beta Was this translation helpful? Give feedback.
All reactions