Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed MIGraphX+rocMLIR integration regarding fast tuning #2257

Merged
merged 2 commits into from
Sep 27, 2023

Conversation

ravil-mobile
Copy link
Contributor

@ravil-mobile ravil-mobile commented Sep 27, 2023

This change results in the following on Navi31 for resnet50:

FP32

$ MIGRAPHX_ENABLE_MLIR=1 ./bin/migraphx-driver  perf   --onnx /MIGraphXDeps/resnet50-v1-7.onnx

Batch size: 1
Rate: 376.146/sec
Total time: 2.65854ms
Total instructions time: 3.93917ms
Overhead time: 0.0387022ms, -1.28063ms
Overhead: 1%, -48%
$ MIGRAPHX_ENABLE_MLIR=0 ./bin/migraphx-driver  perf   --onnx /MIGraphXDeps/resnet50-v1-7.onnx
Batch size: 1
Rate: 331.604/sec
Total time: 3.01565ms
Total instructions time: 5.6571ms
Overhead time: 0.0618266ms, -2.64145ms
Overhead: 2%, -88%

FP16

$ MIGRAPHX_ENABLE_MLIR=1 ./bin/migraphx-driver  perf  --fp16  --onnx /MIGraphXDeps/resnet50-v1-7.onnx

Batch size: 1
Rate: 991.816/sec
Total time: 1.00825ms
Total instructions time: 2.14301ms
Overhead time: 0.040039ms, -1.13476ms
Overhead: 4%, -113%
$ MIGRAPHX_ENABLE_MLIR=0 ./bin/migraphx-driver  perf  --fp16  --onnx /MIGraphXDeps/resnet50-v1-7.onnx

Batch size: 1
Rate: 634.355/sec
Total time: 1.5764ms
Total instructions time: 4.17106ms
Overhead time: 0.0631878ms, -2.59465ms
Overhead: 4%, -165%

INT8

$ MIGRAPHX_ENABLE_MLIR=1 ./bin/migraphx-driver  perf  --int8  --onnx /MIGraphXDeps/resnet50-v1-7.onnx

Batch size: 1
Rate: 916.753/sec
Total time: 1.09081ms
Total instructions time: 2.62071ms
Overhead time: 0.0594211ms, -1.52991ms
Overhead: 5%, -140%
$ MIGRAPHX_ENABLE_MLIR=0 ./bin/migraphx-driver  perf  --int8  --onnx /MIGraphXDeps/resnet50-v1-7.onnx

Batch size: 1
Rate: 178.933/sec
Total time: 5.58869ms
Total instructions time: 9.6085ms
Overhead time: 0.0846503ms, -4.01981ms
Overhead: 2%, -72%

* removed trailing colon from the paramter config
@causten causten merged commit 75a7321 into develop Sep 27, 2023
14 of 15 checks passed
@causten causten deleted the ravil/mlir-integration-fix branch September 27, 2023 18:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants