Skip to content

0.0.7post2
Compare
Choose a tag to compare
@bclavie bclavie released this 13 Feb 21:45
· 28 commits to main since this release
0.0.7post2
b7ae28a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Fixes & tweaks to the previous release:

  • Automatically adjust batch size on longer contexts (32 for 512 tokens, 16 for 1024, 8 for 2048, decreasing like this until a minimum of 1)
  • Apply dynamic max context length to reranking
Assets 2
Loading