Skip to content

Commit

Permalink
Switching to env variable LOCAL_MODEL and fixing the lower case varia…
Browse files Browse the repository at this point in the history
…ble name.
  • Loading branch information
Ziga Brencic committed Mar 28, 2024
1 parent 8afeb74 commit 4e7b072
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions docs/open_models.md
Original file line number Diff line number Diff line change
Expand Up @@ -98,13 +98,14 @@ Then in another terminal window set the following environment variables:
```bash
export OPENAI_API_BASE="http://localhost:8000/v1"
export OPENAI_API_KEY="sk-xxx"
export model_name="CodeLLama"
export MODEL_NAME="CodeLLama"
export LOCAL_MODEL=true
```

And run `gpt-engineer` with the following command:

```bash
gpte <project_dir> $model_name --lite --temperature 0.1
gpte <project_dir> $MODEL_NAME --lite --temperature 0.1
```

The `--lite` mode is needed for now since open models for some reason behave worse with too many instructions at the moment. Temperature is set to `0.1` to get consistent best possible results.
Expand Down

0 comments on commit 4e7b072

Please sign in to comment.