Artificial Intelligence Controller Interface for vLLM #104
Closed
Ksuriuri
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I made a simple implementation of controllable generation of large language models based on vLLM, enabling precise control over the model's output format through additional control information: Ksuriuri/SimpleAICI
The performance looks good to me, feel free to try it if you need😊
Beta Was this translation helpful? Give feedback.
All reactions