feat: implement inference server by using vllm #3090
zhuangqhDeployment protection rules
Reviewers, timers, and other rules protecting deployments in this run
| Event | Environments |
|---|---|
zhuangqh
approved
|
unit-tests |