Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Update README.md #281

Merged
merged 3 commits into from
Mar 5, 2024
Merged

feat: Update README.md #281

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
f2d3a33
feat: Update README.md
ishaansehgal99 Mar 5, 2024
121de6d
Update README.md
ishaansehgal99 Mar 5, 2024
6470cc5
Update README.md
ishaansehgal99 Mar 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 7 additions & 9 deletions presets/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,15 +1,13 @@
# Kaito Preset Configurations
The current supported model families with preset configurations are listed below.

|Model Family |
|----|
|[falcon](./models/falcon)|
|[llama2](./models/llama2)|
|[llama2chat](./models/llama2chat)|
|[mistral](./models/mistral)|
|[phi2](./models/phi)|


| Model Family | Compatible Kaito Versions |
|-----------------|---------------------------|
|[falcon](./models/falcon)| v0.0.1+|
|[llama2](./models/llama2)| v0.0.1+|
|[llama2chat](./models/llama2chat)| v0.0.1+|
|[mistral](./models/mistral)| v0.2.0+|
|[phi2](./models/phi)| v0.2.0+|

## Validation
Each preset model has its own hardware requirements in terms of GPU count and GPU memory defined in the respective `model.go` file. Kaito controller performs a validation check of whether the specified SKU and node count are sufficient to run the model or not. In case the provided SKU is not in the known list, the controller bypasses the validation check which means users need to ensure the model can run with the provided SKU.
Expand Down