Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Monitor memory usage of TensorFlow models #2156

Closed
ndeepesh opened this issue Jun 21, 2023 · 5 comments
Closed

Monitor memory usage of TensorFlow models #2156

ndeepesh opened this issue Jun 21, 2023 · 5 comments
Assignees
Labels
stale This label marks the issue/pr stale - to be closed automatically if no activity stat:awaiting response type:feature

Comments

@ndeepesh
Copy link

ndeepesh commented Jun 21, 2023

We want to monitor memory usage of TensorFlow serving runtime on a per model basis. Currently we can get the memory used by Tensorflow completely but we dont have a way to get this information on a per model basis. We would like to have a solution that can work for both CPU and GPU memory

No alternatives are available that we know of

@singhniraj08
Copy link

@ndeepesh,

Similar Issue #1407 is already in progress. I will bump up the issue to the team and discuss on the implementation. Meanwhile, you can refer to similar thread in SO where an alternative is TF's Profiler being used for memory profiling if this helps.

Thank you!

@github-actions
Copy link

github-actions bot commented Jul 1, 2023

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

@github-actions github-actions bot added the stale This label marks the issue/pr stale - to be closed automatically if no activity label Jul 1, 2023
@github-actions
Copy link

github-actions bot commented Jul 9, 2023

This issue was closed due to lack of activity after being marked stale for past 7 days.

@github-actions github-actions bot closed this as completed Jul 9, 2023
@ndeepesh
Copy link
Author

Hi @singhniraj08
Apologies for not following up on this. We are primarily interested in CPU memory usage. The above two threads points to GPU memory usage

@singhniraj08
Copy link

@ndeepesh, I see new issue #2173 is created by you, Please track new issue for update. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale This label marks the issue/pr stale - to be closed automatically if no activity stat:awaiting response type:feature
Projects
None yet
Development

No branches or pull requests

2 participants