Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ingest Failsafe on low Space #155

Open
DiegoPino opened this issue Mar 16, 2023 · 1 comment
Open

Ingest Failsafe on low Space #155

DiegoPino opened this issue Mar 16, 2023 · 1 comment
Assignees
@DiegoPino
Labels
enhancement New feature or request File processing Everything is a file, even me. Ingest Setup Knobs and Levers you move while thinking about feelings and metadata and CSV files queue workers Ones taking the FI and doing the FO queue FIFO Reporting Errors, Logs, etc. UI Buttons and pixels
Milestone
0.5.0

Comments

@DiegoPino
Copy link
Member

DiegoPino commented Mar 16, 2023 •
edited
Loading

What?

So easy to run out of temporary space. While ingesting, Strawberry Runner Posprocessing, etc.

The idea is to build (need to plan) a process efficient config (threshold) driven failsafe that in case of low Space avoids further ingest to happen and Post Process (OCR, etc) to be generated.

This should include a global state that allows a queue to be bypassed until the system recovers (except of course Composter), a Log, an email message if possible and also more places where the Amount of file space can be seen (e.g in the Hydroponics Config)

@alliomeria will work on this
Also: this affects 3 modules. So not a little tiny thing!
@DiegoPino DiegoPino self-assigned this Mar 16, 2023
@DiegoPino DiegoPino added enhancement New feature or request UI Buttons and pixels Reporting Errors, Logs, etc. queue FIFO queue workers Ones taking the FI and doing the FO Ingest Setup Knobs and Levers you move while thinking about feelings and metadata and CSV files File processing Everything is a file, even me. labels Mar 16, 2023
@DiegoPino DiegoPino added this to the 0.5.0 milestone Mar 16, 2023
@alliomeria
Copy link
Contributor

Sounds great @DiegoPino! 🍓🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@DiegoPino DiegoPino

Labels
enhancement New feature or request File processing Everything is a file, even me. Ingest Setup Knobs and Levers you move while thinking about feelings and metadata and CSV files queue workers Ones taking the FI and doing the FO queue FIFO Reporting Errors, Logs, etc. UI Buttons and pixels
Projects
None yet
Milestone
0.5.0
Development

No branches or pull requests
2 participants
@DiegoPino @alliomeria