Skip to content

Commit

Permalink
chore: adding note for private models in quicktour doc
Browse files Browse the repository at this point in the history
  • Loading branch information
ariG23498 committed Sep 23, 2024
1 parent 9263817 commit 5b78abe
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions docs/source/quicktour.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,13 @@ docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data \
--model-id $model
```

<Tip>
If you’re looking to serve gated or private models, which provide
controlled access to sensitive or proprietary content, check out
[this guide](https://huggingface.co/docs/text-generation-inference/en/basic_tutorials/gated_model_access)
for detailed instructions.
</Tip>

### Supported hardware

TGI supports various hardware. Make sure to check the [Using TGI with Nvidia GPUs](./installation_nvidia), [Using TGI with AMD GPUs](./installation_amd), [Using TGI with Intel GPUs](./installation_intel), [Using TGI with Gaudi](./installation_gaudi), [Using TGI with Inferentia](./installation_inferentia) guides depending on which hardware you would like to deploy TGI on.
Expand Down

0 comments on commit 5b78abe

Please sign in to comment.