You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Only if you know how. It's not an easy one. TensorRT-LLM is one of the most complicated stacks.
The example should show it end-to-end: how to build a model, and serve it.
Thank you @peterschmidt85 for giving me the heads up. Will give it a try and keep you posted on how it goes.
May I request you to point to any example on dstack which has similar set of task like
Thank you @peterschmidt85 for giving me the heads up. Will give it a try and keep you posted on how it goes. May I request you to point to any example on dstack which has similar set of task like
build the model
serve it
I would invite you to explore more what dstack is, how it works, and of course what TensorRT-LLM is and how it works.
No description provided.
The text was updated successfully, but these errors were encountered: