Skip to content

Commit

Permalink
Merge branch 'master' into rf-core-2a
Browse files Browse the repository at this point in the history
  • Loading branch information
dave-gray101 committed Feb 28, 2024
2 parents 4d40fc5 + ba672b5 commit bb86756
Show file tree
Hide file tree
Showing 3 changed files with 21 additions and 4 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ If you want to help and contribute, issues up for grabs: https://github.com/mudl
For a detailed step-by-step introduction, refer to the [Getting Started](https://localai.io/basics/getting_started/index.html) guide. For those in a hurry, here's a straightforward one-liner to launch a LocalAI instance with [phi-2](https://huggingface.co/microsoft/phi-2) using `docker`:

```
docker run -ti -p 8080:8080 localai/localai:v2.7.0-ffmpeg-core phi-2
docker run -ti -p 8080:8080 localai/localai:v2.9.0-ffmpeg-core phi-2
```

## 🚀 [Features](https://localai.io/features/)
Expand Down
20 changes: 20 additions & 0 deletions docs/content/docs/features/openai-functions.md
Original file line number Diff line number Diff line change
Expand Up @@ -80,6 +80,26 @@ When running the python script, be sure to:

## Advanced

### Parallel tools calls

This feature is experimental and has to be configured in the YAML of the model by enabling `function.parallel_calls`:

```yaml
name: gpt-3.5-turbo
parameters:
# Model file name
model: ggml-openllama.bin
top_p: 80
top_k: 0.9
temperature: 0.1

function:
# set to true to allow the model to call multiple functions in parallel
parallel_calls: true
```
### Use functions with grammar
It is possible to also specify the full function signature (for debugging, or to use with other clients).
The chat endpoint accepts the `grammar_json_functions` additional parameter which takes a JSON schema object.
Expand Down
3 changes: 0 additions & 3 deletions docs/content/docs/overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,6 +111,3 @@ This is a community project, a special thanks to our contributors! 🤗
<a href="https://github.com/go-skynet/LocalAI/graphs/contributors">
<img src="https://contrib.rocks/image?repo=go-skynet/LocalAI" />
</a>
<a href="https://github.com/go-skynet/LocalAI-website/graphs/contributors">
<img src="https://contrib.rocks/image?repo=go-skynet/LocalAI-website" />
</a>

0 comments on commit bb86756

Please sign in to comment.