Skip to content

Commit

Permalink
Update phi-2-orange.yaml
Browse files Browse the repository at this point in the history
Signed-off-by: Ettore Di Giacinto <[email protected]>
  • Loading branch information
mudler authored Mar 31, 2024
1 parent 35290e1 commit 3c778b5
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions embedded/models/phi-2-orange.yaml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: phi-2-chat
name: phi-2-orange
mmap: true
parameters:
model: huggingface://l3utterfly/phi-2-orange-GGUF/phi-2-orange.Q6_K.gguf
Expand All @@ -25,6 +25,6 @@ description: |
usage: |
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "phi-2-chat",
"model": "phi-2-orange",
"messages": [{"role": "user", "content": "How are you doing?", "temperature": 0.1}]
}'

0 comments on commit 3c778b5

Please sign in to comment.