Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] master from mudler:master #152

Merged
merged 3 commits into from
Dec 25, 2024
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 44 additions & 0 deletions gallery/index.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -964,6 +964,21 @@
- filename: Llama-Chat-Summary-3.2-3B-Q4_K_M.gguf
sha256: ed1be20d2374aa6db9940923f41fa229bd7ebe13d41b1ff1ff18a6f87e99df79
uri: huggingface://bartowski/Llama-Chat-Summary-3.2-3B-GGUF/Llama-Chat-Summary-3.2-3B-Q4_K_M.gguf
- !!merge <<: *llama32
name: "fastllama-3.2-1b-instruct"
icon: https://huggingface.co/suayptalha/FastLlama-3.2-1B-Instruct/resolve/main/FastLlama.png
urls:
- https://huggingface.co/suayptalha/FastLlama-3.2-1B-Instruct
- https://huggingface.co/bartowski/FastLlama-3.2-1B-Instruct-GGUF
description: |
FastLlama is a highly optimized version of the Llama-3.2-1B-Instruct model. Designed for superior performance in constrained environments, it combines speed, compactness, and high accuracy. This version has been fine-tuned using the MetaMathQA-50k section of the HuggingFaceTB/smoltalk dataset to enhance its mathematical reasoning and problem-solving abilities.
overrides:
parameters:
model: FastLlama-3.2-1B-Instruct-Q4_K_M.gguf
files:
- filename: FastLlama-3.2-1B-Instruct-Q4_K_M.gguf
sha256: 3c0303e9560c441a9abdcd0e4c04c47e7f6b21277c1e8c00eed94fc656da0be9
uri: huggingface://bartowski/FastLlama-3.2-1B-Instruct-GGUF/FastLlama-3.2-1B-Instruct-Q4_K_M.gguf
- &qwen25
## Qwen2.5
name: "qwen2.5-14b-instruct"
Expand Down Expand Up @@ -4178,6 +4193,20 @@
- filename: orca_mini_v8_1_70b-Q4_K_M.gguf
sha256: 97627730b028d4d7a349ae0b8e219207163ec425e4e1c057e445b2a66b61fdfa
uri: huggingface://bartowski/orca_mini_v8_1_70b-GGUF/orca_mini_v8_1_70b-Q4_K_M.gguf
- !!merge <<: *llama31
name: "llama-3.1-8b-open-sft"
urls:
- https://huggingface.co/prithivMLmods/Llama-3.1-8B-Open-SFT
- https://huggingface.co/bartowski/Llama-3.1-8B-Open-SFT-GGUF
description: |
The Llama-3.1-8B-Open-SFT model is a fine-tuned version of meta-llama/Llama-3.1-8B-Instruct, designed for advanced text generation tasks, including conversational interactions, question answering, and chain-of-thought reasoning. This model leverages Supervised Fine-Tuning (SFT) using the O1-OPEN/OpenO1-SFT dataset to provide enhanced performance in context-sensitive and instruction-following tasks.
overrides:
parameters:
model: Llama-3.1-8B-Open-SFT-Q4_K_M.gguf
files:
- filename: Llama-3.1-8B-Open-SFT-Q4_K_M.gguf
sha256: ce75152763c48c5386fe59652cc921aae456da36ab82af3d9e2080f603f45132
uri: huggingface://bartowski/Llama-3.1-8B-Open-SFT-GGUF/Llama-3.1-8B-Open-SFT-Q4_K_M.gguf
- &deepseek
## Deepseek
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"
Expand Down Expand Up @@ -5068,6 +5097,21 @@
- filename: NaturalLM-7B-Instruct-Q4_K_M.gguf
sha256: 15b2f34116f690fea35790a9392b8a2190fe25827e370d426e88a2a543f4dcee
uri: huggingface://bartowski/NaturalLM-7B-Instruct-GGUF/NaturalLM-7B-Instruct-Q4_K_M.gguf
- !!merge <<: *mistral03
name: "dans-personalityengine-v1.1.0-12b"
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
urls:
- https://huggingface.co/PocketDoc/Dans-PersonalityEngine-V1.1.0-12b
- https://huggingface.co/bartowski/Dans-PersonalityEngine-V1.1.0-12b-GGUF
description: |
This model series is intended to be multifarious in its capabilities and should be quite capable at both co-writing and roleplay as well as find itself quite at home performing sentiment analysis or summarization as part of a pipeline. It has been trained on a wide array of one shot instructions, multi turn instructions, tool use, role playing scenarios, text adventure games, co-writing, and much more.
overrides:
parameters:
model: Dans-PersonalityEngine-V1.1.0-12b-Q4_K_M.gguf
files:
- filename: Dans-PersonalityEngine-V1.1.0-12b-Q4_K_M.gguf
sha256: a1afb9fddfa3f2847ed710cc374b4f17e63a75f7e10d8871cf83983c2f5415ab
uri: huggingface://bartowski/Dans-PersonalityEngine-V1.1.0-12b-GGUF/Dans-PersonalityEngine-V1.1.0-12b-Q4_K_M.gguf
- &mudler
### START mudler's LocalAI specific-models
url: "github:mudler/LocalAI/gallery/mudler.yaml@master"
Expand Down
Loading