Skip to content

Commit

Permalink
[MIGraphX EP Support]Add rocm to transformers/benchmark.py script (mi…
Browse files Browse the repository at this point in the history
…crosoft#22299)

### Description
Add ROCm EP option to benchmark.py script when using int8 quantization.



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Without this change benchmarks with int8 quantization cannot be run with
ROCm execution provider.
  • Loading branch information
stsokolo authored Oct 8, 2024
1 parent 407c1ab commit efb8703
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion onnxruntime/python/tools/transformers/benchmark.py
Original file line number Diff line number Diff line change
Expand Up @@ -787,7 +787,7 @@ def main():
logger.error("fp16 is for GPU only")
return

if args.precision == Precision.INT8 and args.use_gpu and args.provider != "migraphx":
if args.precision == Precision.INT8 and args.use_gpu and args.provider not in ["migraphx", "rocm"]:
logger.error("int8 is for CPU only")
return

Expand Down

0 comments on commit efb8703

Please sign in to comment.