Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

A segmentation fault may accur in "__cudaPopCallConfiguration" in tf_opt.c #124

Open
gccn opened this issue May 14, 2021 · 3 comments · May be fixed by #142
Open

A segmentation fault may accur in "__cudaPopCallConfiguration" in tf_opt.c #124

gccn opened this issue May 14, 2021 · 3 comments · May be fixed by #142
Assignees
@yuhc
Labels
bug Something isn't working

Comments

@gccn
Copy link

gccn commented May 14, 2021

When I run tensenflow resnet50 benchmark on tf_opt, a segmemtation fault may accur in "__cudaPopCallConfiguration" function at some point.
@yuhc
Copy link
Member

yuhc commented May 14, 2021

Thanks for reporting this issue. We are refactoring CUDA specs (including tensorflow specs) in these days and I'll take a check on this problem.

@yuhc yuhc self-assigned this May 23, 2021
@yuhc yuhc added the bug Something isn't working label May 23, 2021
@yuhc
Copy link
Member

yuhc commented May 25, 2021

Could you share the resnet50 benchmark so that I can try to reproduce the error?

@gccn
Copy link
Author

gccn commented May 29, 2021

Could you share the resnet50 benchmark so that I can try to reproduce the error?

You can get it here.
https://github.com/tensorflow/benchmarks/tree/master/scripts/tf_cnn_benchmarks

@yuhc yuhc linked a pull request May 30, 2021 that will close this issue
Open
11 tasks
@yuhc yuhc linked a pull request May 30, 2021 that will close this issue
[WIP] Fix random crash when running TensorFlow resnet50 #142
Open
11 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yuhc yuhc

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[WIP] Fix random crash when running TensorFlow resnet50 yuhc/ava
2 participants
@yuhc @gccn