We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
47331c7
5x faster token validator - Parallelized lookahead - Cached decoding - Cached get vocab
dbe27f6
Initial release
pip install rellm==0.0.3