Local deployment (Docker, not Kubernetes/MiniKube)

[Phelan164]

I am new with modelmesh but so interested in this project.
Could we deploy modelmesh using Docker only without k8s cluster?
Thanks

[njhill]

Hi @Phelan164, the short answer is in theory yes (Model-mesh actually started out independently of Kubernetes), but it would require a fair amount of custom setup/configuration, especially if you want to use the built-in model server integration that we have as part of the wider modelmesh-serving framework.

I would strongly recommend using it on Kube via the controller (following quickstart here). You can install local/lightweight Kubernetes clusters using something like minikube or kind.

[Phelan164]

@njhill thanks for your suggestion.
Yes, I could work with modelmesh via controller and deploy into kubenetes cluster.
But just want to make very simple development env, so I want to setup modelmesh run in docker and directly interact with that via gRPC.
Related to "custom setup/configuration", could you share some basic guidelines ?
Thanks so much for your support