Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature][model] llama.cpp support new GGUF file format #567

Closed
2 tasks done
fangyinc opened this issue Sep 8, 2023 · 2 comments · Fixed by #649
Closed
2 tasks done

[Feature][model] llama.cpp support new GGUF file format #567

fangyinc opened this issue Sep 8, 2023 · 2 comments · Fixed by #649
Labels
enhancement New feature or request

Comments

@fangyinc
Copy link
Collaborator

fangyinc commented Sep 8, 2023

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

see: GGUF

Use case

No response

Related issues

No response

Feature Priority

Medium

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@fangyinc fangyinc added enhancement New feature or request Waiting for reply and removed Waiting for reply labels Sep 8, 2023
@paul-yangmy
Copy link

mark

@fangyinc fangyinc mentioned this issue Oct 3, 2023
Closed
15 tasks
@Ananderz
Copy link

Ananderz commented Oct 3, 2023

Could be fixed by implementing ctransformers

@fangyinc fangyinc mentioned this issue Oct 7, 2023
Merged
Aries-ckt added a commit that referenced this issue Oct 7, 2023
@Aries-ckt
feat(model): llama.cpp support new GGUF file format (#649)
f2427b1 
Close #567 
Close #644
Close #563

**Other**
- Fix raise Exception when stop DB-GPT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(model): llama.cpp support new GGUF file format fangyinc/DB-GPT
3 participants
@fangyinc @paul-yangmy @Ananderz