Skip to content

Releases: FFengIll/embedding.cpp

v0.2.1

21 Nov 04:17
Compare
Choose a tag to compare
  • upgrade gguf, ggml, tokenizers-cpp
  • refactor bert graph build (easy to read and modify)
  • new ggml api usage

v0.1.0

11 Oct 03:50
Compare
Choose a tag to compare

Though v0.1.0, it is a alpha version with features as bellow.

  • build with tokenizers-cpp (a cpp binding for rust code) for tokenizer
    • support token normalize
    • support CJK and so on
  • use gguf format
    • support special token
    • support eps