onnx inference server in docker container

huggingface demo

Copy the demo web from link

Thanks a lot to @CjangCjengh Thanks a lot to wetts

Only used for entertainment. Don't used for bussiness

quick start

To use other model and config
please use -v /path/to/dir:/app/.model to mount your model and config

export name=vits_onnx
docker stop $name
docker rm $name
docker run -d \
--name $name \
-p 7860:7860 \
ccdesue/vits_demo:onnx
# -v /path/to/dir:/app/.model

Helpful info

1. please read the source code to better understand
2. refer to the demo config.json to tail to your own model config
3. refer the dockerfile
4. to use gpu, please install onnxruntime-gpu

limitation

1. only test on japanese_cleaners2 and zh_ja_mixture_cleaners in config.json with raw vits

Reference

1. vits_export_discussion
2. other_vits_onnx
3. wetts
4. android_vits

license

GPLv2