Skip to content

Commit

Permalink
Update phi-3-tutorial.md
Browse files Browse the repository at this point in the history
  • Loading branch information
kunal-vaishnavi authored Jan 5, 2025
1 parent 01bbab6 commit 2367e31
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions examples/python/phi-3-tutorial.md
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,7 @@ Are you on a Windows machine with GPU?

```bash
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
python phi3-qa.py -m directml\directml-int4-awq-block-128
python phi3-qa.py -m directml\directml-int4-awq-block-128 -e dml
```

Once the script has loaded the model, it will ask you for input in a loop, streaming the output as it is produced the model. For example:
Expand Down Expand Up @@ -109,7 +109,7 @@ Are you on a Windows machine with GPU?
```bash
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
python phi3-qa.py -m cuda/cuda-int4-rtn-block-32
python phi3-qa.py -m cuda/cuda-int4-rtn-block-32 -e cuda
```
Once the script has loaded the model, it will ask you for input in a loop, streaming the output as it is produced the model. For example:
Expand Down Expand Up @@ -142,7 +142,7 @@ Are you on a Windows machine with GPU?

```bash
curl https://raw.githubusercontent.com/microsoft/onnxruntime-genai/main/examples/python/phi3-qa.py -o phi3-qa.py
python phi3-qa.py -m cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4
python phi3-qa.py -m cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4 -p cpu
```

Once the script has loaded the model, it will ask you for input in a loop, streaming the output as it is produced the model. For example:
Expand Down

0 comments on commit 2367e31

Please sign in to comment.