Skip to content

v0.9.3
Compare
Choose a tag to compare
@OlivierDehaene OlivierDehaene released this 18 Jul 16:53
· 793 commits to main since this release
v0.9.3
5e6ddfd
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Highlights

  • server: add support for flash attention v2
  • server: add support for llamav2

Features

  • launcher: add debug logs
  • server: rework the quantization to support all models

Full Changelog: v0.9.2...v0.9.3

Assets 2
Loading