Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Monitor job working directories #1390

Open
jlqfab opened this issue Jul 26, 2023 · 1 comment
Open

Monitor job working directories #1390

jlqfab opened this issue Jul 26, 2023 · 1 comment

Comments

@jlqfab
Copy link
Collaborator

jlqfab commented Jul 26, 2023

Some Galaxy jobs create a large amount of data in their working directories. Currently there is no way of monitoring this, instead it requires active investigation to find jobs that are filling the disk. This usually involves looking for jobs that run applications that have been known to create large outputs.
It would be advantageous if monitoring for processes that are chewing up disk space could be automated or turned into a simple gxadmin query that could be run to identify problem jobs. This would require a script that gets a list of running jobs and determines disk usage of their working directories. This will require the ability to access the disk being used and may involve connecting to a remote pulsar destination.

@jlqfab
Copy link
Collaborator Author

jlqfab commented Jul 26, 2023

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant