Skip to content

Commit

Permalink
AOTI runner (#707)
Browse files Browse the repository at this point in the history
* AOTI runner

* remove torchtune
  • Loading branch information
mikekgfb authored and malfet committed Jul 17, 2024
1 parent db5f13a commit 2c02232
Showing 1 changed file with 0 additions and 2 deletions.
2 changes: 0 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -173,12 +173,10 @@ To build the runner binary on your Mac or Linux:
scripts/build_native.sh aoti
```

[skip default]: begin
Execute
```bash
cmake-out/aoti_run exportedModels/llama3.so -z `python3 torchchat.py where llama3`/tokenizer.model -l 3 -i "Once upon a time"
```
[skip default]: end

## Mobile Execution

Expand Down

0 comments on commit 2c02232

Please sign in to comment.