Skip to content

Commit

Permalink
FIxing the CI.
Browse files Browse the repository at this point in the history
  • Loading branch information
Narsil committed Aug 16, 2024
1 parent c7ab181 commit cb0a294
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
2 changes: 1 addition & 1 deletion docs/openapi.json
Original file line number Diff line number Diff line change
Expand Up @@ -2094,4 +2094,4 @@
"description": "Hugging Face Text Generation Inference API"
}
]
}
}
6 changes: 3 additions & 3 deletions docs/source/basic_tutorials/consuming_tgi.md
Original file line number Diff line number Diff line change
Expand Up @@ -88,7 +88,7 @@ There is also an async version of the client, `AsyncInferenceClient`, based on `

You can directly use the OpenAI [Python](https://github.com/openai/openai-python) or [JS](https://github.com/openai/openai-node) clients to interact with TGI.

Install the OpenAI Python package via pip.
Install the OpenAI Python package via pip.

```bash
pip install openai
Expand Down Expand Up @@ -145,7 +145,7 @@ def inference(message, history):
stream=True,
max_tokens=1024,
)

for chunk in output:
partial_message += chunk.choices[0].delta.content
yield partial_message
Expand Down Expand Up @@ -196,4 +196,4 @@ To serve both ChatUI and TGI in same environment, simply add your own endpoints
}
```

![ChatUI](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/chatui_screen.png)
![ChatUI](https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/chatui_screen.png)

0 comments on commit cb0a294

Please sign in to comment.