Skip to content

Commit

Permalink
chore: reference container toolkit
Browse files Browse the repository at this point in the history
  • Loading branch information
av committed Aug 1, 2024
1 parent 5cee717 commit 259bc0d
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional ser
#### Requirements

- Docker
- _Optional_ [NVIDIA Container Toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#installation)
- git
- bash-compatible shell

Expand All @@ -19,6 +20,8 @@ git clone https://github.com/av/harbor.git && cd harbor

# Start default services
# Initial download of the docker images might take a while
# If you have container toolkit installed, GPU will
# be automatically used for supported services.
harbor up

# [Optional] open Webui in the browser
Expand Down

0 comments on commit 259bc0d

Please sign in to comment.