Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bf16 Verify Onnx Tests #3627

Open
wants to merge 88 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
88 commits
Select commit Hold shift + click to select a range
c51c1ce
first pass at integrating generic float
richagadgil Oct 10, 2024
134b408
fix namespaces
richagadgil Oct 10, 2024
d4fa6eb
fix mantissa
richagadgil Oct 10, 2024
0b60841
refactor
richagadgil Oct 11, 2024
7a646f1
refactor
richagadgil Oct 11, 2024
ebe819b
add fp
richagadgil Oct 11, 2024
379a77a
fixed generic float class
richagadgil Oct 14, 2024
174384c
add fp32 test
richagadgil Oct 14, 2024
787b651
remove import
richagadgil Oct 14, 2024
1d1fa1c
update tests
richagadgil Oct 15, 2024
1791092
fp16 tests that work
richagadgil Oct 17, 2024
a2eb005
update tests
richagadgil Oct 18, 2024
ff8ffc7
updated fp16 and fp32 tests
richagadgil Oct 18, 2024
e36fd65
half tests
richagadgil Oct 22, 2024
9ac4e2a
underflow and overflow tests
richagadgil Oct 22, 2024
f05fd31
generate map
richagadgil Oct 22, 2024
cb4d92d
add more tests
richagadgil Oct 22, 2024
0cc1946
fix names
richagadgil Oct 22, 2024
85a761b
update tests
richagadgil Oct 23, 2024
65cf9ae
remove and
richagadgil Oct 24, 2024
fbabf54
disable warning
richagadgil Oct 24, 2024
549f5e6
fix tidy warning
richagadgil Oct 24, 2024
d302e5d
migraphx py fix
richagadgil Oct 25, 2024
8d475e3
add increments
richagadgil Oct 25, 2024
a0fd055
fix warnings
richagadgil Oct 25, 2024
41379fe
disable duplicate branch warning
richagadgil Oct 25, 2024
0c29c7b
add countzero_std
richagadgil Oct 28, 2024
4b012a8
ci error
richagadgil Oct 28, 2024
dbaa3a8
simplify countl
richagadgil Oct 28, 2024
b2bd2a0
fix ci
richagadgil Oct 28, 2024
6f328f0
src
richagadgil Oct 29, 2024
e6d9763
remove flag
richagadgil Oct 29, 2024
6538050
hide abi warning
richagadgil Oct 29, 2024
4e96d4d
revert changes
richagadgil Oct 29, 2024
ef11f1f
Merge branch 'develop' into generic_float
richagadgil Oct 29, 2024
e4a25bd
change half in tests
richagadgil Oct 29, 2024
3354c6e
Update generic_float.hpp
richagadgil Oct 29, 2024
6de079b
format
richagadgil Oct 29, 2024
7750874
Merge branch 'develop' into generic_float
richagadgil Oct 29, 2024
801f485
Merge branch 'develop' into generic_float
causten Oct 30, 2024
33e2c8d
fix bug
richagadgil Oct 30, 2024
9bb7198
Merge branch 'generic_float' of github.com:ROCm/AMDMIGraphX into gene…
richagadgil Oct 30, 2024
b3c345d
fix err
richagadgil Oct 30, 2024
03df6f9
edits
richagadgil Oct 31, 2024
ad817b2
tidy and format
richagadgil Oct 31, 2024
898417b
tidy etc
richagadgil Oct 31, 2024
aa5b9c9
gf
richagadgil Oct 31, 2024
6f72370
fix tidy errs
richagadgil Nov 1, 2024
0aab1a0
bf16 changes
richagadgil Nov 4, 2024
7b965c0
add flag to trace quantization passes (#3571)
shivadbhavsar Oct 30, 2024
5f5f13d
bf16
richagadgil Oct 30, 2024
d64b124
Update bf16.cpp
richagadgil Nov 1, 2024
a064eaa
Update bf16.hpp
richagadgil Nov 2, 2024
befbd9e
Update bf16.hpp
richagadgil Nov 2, 2024
08b9511
update files with working version
richagadgil Nov 4, 2024
b9d204e
Update bf16.cpp
richagadgil Nov 4, 2024
fb6df2d
Update generic_float.hpp
richagadgil Nov 4, 2024
bb78138
Merge branch 'develop' into bf16
richagadgil Nov 8, 2024
8e1f99e
add extra common type
richagadgil Nov 8, 2024
6192970
tidy
richagadgil Nov 8, 2024
c0d6bc4
Update bf16.hpp
richagadgil Nov 11, 2024
7bfc407
Update generic_float.hpp
richagadgil Nov 11, 2024
4cb96ad
Merge branch 'develop' into bf16
richagadgil Nov 11, 2024
ffd4ba2
remove imports
richagadgil Nov 12, 2024
8a10da3
Merge branch 'develop' into bf16
richagadgil Nov 12, 2024
1565a0e
ref tests
richagadgil Nov 13, 2024
e6d1155
migraphx_py fix
richagadgil Nov 13, 2024
867e960
fix test cae by index
richagadgil Nov 13, 2024
9852da5
add rocblas type
richagadgil Nov 13, 2024
bf50653
fix tgts err
richagadgil Nov 13, 2024
0ebd220
address changes
richagadgil Nov 18, 2024
043e322
Merge branch 'develop' into bf16
richagadgil Nov 18, 2024
1aae73f
start onnx verify test support
richagadgil Nov 18, 2024
cb3f77f
add parse
richagadgil Nov 18, 2024
26e492e
Merge branch 'develop' into bf16_verify_onnx
richagadgil Nov 22, 2024
b775dee
add mean test
richagadgil Nov 22, 2024
dc4c38d
mmvn_default_axes_bf16_test
richagadgil Nov 22, 2024
e7935e0
mvn tests
richagadgil Nov 22, 2024
02e3817
working tests
richagadgil Nov 23, 2024
6e87c99
fix softmax
richagadgil Nov 23, 2024
141bd27
remaining tests
richagadgil Nov 23, 2024
9d03a89
Merge branch 'develop' into bf16_verify_onnx
richagadgil Nov 25, 2024
f6354e4
Update negativeloglikelihoodloss_kd_all_reduction_weighted_test.cpp
richagadgil Dec 3, 2024
dc1c0a8
format
richagadgil Dec 3, 2024
c12150d
Merge branch 'bf16_verify_onnx' of github.com:ROCm/AMDMIGraphX into b…
richagadgil Dec 3, 2024
42881d8
remove gelu
richagadgil Dec 3, 2024
e982b5d
gelu
richagadgil Dec 3, 2024
69c6ebb
Merge branch 'develop' into bf16_verify_onnx
richagadgil Dec 16, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions src/onnx/onnx_parser.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -687,7 +687,7 @@ shape::type_t get_type(int dtype)
case 22: return shape::int8_type;
case 14:
case 15:
case 16:
case 16: return shape::bf16_type;
case 17:
case 19:
case 20:
Expand All @@ -700,7 +700,8 @@ shape::type_t get_type(int dtype)
bool is_type_float(shape::type_t dtype)
{
bool r = false;
if(dtype == shape::float_type or dtype == shape::double_type or dtype == shape::half_type)
if(dtype == shape::float_type or dtype == shape::double_type or dtype == shape::half_type or
dtype == shape::bf16_type)
{
r = true;
}
Expand Down
3 changes: 2 additions & 1 deletion src/onnx/parse_instancenorm.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,8 @@ namespace onnx {

struct parse_instancenorm : op_parser<parse_instancenorm>
{
std::set<shape::type_t> valid_types = {shape::float_type, shape::half_type, shape::double_type};
std::set<shape::type_t> valid_types = {
shape::float_type, shape::half_type, shape::double_type, shape::bf16_type};

std::vector<op_desc> operators() const { return {{"InstanceNormalization"}}; }

Expand Down
16 changes: 16 additions & 0 deletions test/onnx/add_bf16_test.onnx
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
 add_bf16_test:R

0
12"Addadd_bf16_testZ
0


Z
1


b
2


B
Expand Down
11 changes: 11 additions & 0 deletions test/onnx/eyelike_bf16_test.onnx
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
 eyelike_bf16_test:R

T1T2"EyeLikeeyelike_bf16_testZ
T1


b
T2


B
11 changes: 11 additions & 0 deletions test/onnx/gelu_default_bf16_test.onnx
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
 gelu_default_bf16_test:P

xy"Gelugelu_default_bf16_testZ
x


b
y


B
Binary file added test/onnx/gemm_bf16_test.onnx
Binary file not shown.
Loading
Loading