Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update llama2.c converter to read vocab and write models in GGUF format #2751

Merged
merged 8 commits into from
Aug 27, 2023
Merged

Update llama2.c converter to read vocab and write models in GGUF format #2751

merged 8 commits into from
Aug 27, 2023

Commits on Aug 23, 2023

  1. llama2.c: direct gguf output (WIP)

    @ochafik
    ochafik committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    5132130 View commit details
    Browse the repository at this point in the history

  2. Simplify vector building logic

    @ochafik
    ochafik committed Aug 23, 2023
    Configuration menu
    Copy the full SHA
    463e117 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2023

  1. llama2.c gguf conversion: fix token types in converter

    @ochafik
    ochafik committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    63174b8 View commit details
    Browse the repository at this point in the history

  2. llama2.c: support copying vocab from a llama gguf model file

    @ochafik
    ochafik committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    c88362d View commit details
    Browse the repository at this point in the history

  3. llama2.c: update default path for vocab model + readme

    @ochafik
    ochafik committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    df3b81a View commit details
    Browse the repository at this point in the history

  4. llama2.c: use defines for gguf keys

    @ochafik
    ochafik committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    20c4471 View commit details
    Browse the repository at this point in the history

  5. llama2.c: escape whitespaces w/ U+2581 in vocab converter the llama.c… 

    …pp way
    @ochafik
    ochafik committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    0722e58 View commit details
    Browse the repository at this point in the history

  6. llama2.c converter: cleanups + take n_ff from config

    @ochafik
    ochafik committed Aug 26, 2023
    Configuration menu
    Copy the full SHA
    c58792c View commit details
    Browse the repository at this point in the history