Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request #932

Open
AbdullahKazi500 opened this issue Sep 4, 2024 · 0 comments
Open

Feature Request #932

AbdullahKazi500 opened this issue Sep 4, 2024 · 0 comments

Comments

@AbdullahKazi500
Copy link

I would like to request a feature that tracks and displays memory usage during the execution of benchmarks within the Metriq benchmarking app. This feature would provide valuable insights into resource consumption, particularly in resource-constrained environments.
if we can Track the maximum memory usage (ru_maxrss) of the benchmarking process in real-time.
that can Provide the memory usage in MB as part of the benchmark's metadata.
and Include the option to visualize memory usage alongside other benchmark metrics.
Add memory usage as a parameter in existing plots, such as score vs. memory usage, to help users better understand the trade-offs.
This feature would be useful for comparing the efficiency of different backends, particularly in scenarios where memory constraints are critical.
It will also help in diagnosing memory-related bottlenecks and optimizing performance.
Ideally, the memory usage tracking should integrate seamlessly with existing features, such as plotting correlations between benchmark metrics and backend performances.
. Automating this process within Metriq would save time and provide a more comprehensive benchmarking experience

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant