Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delayed clearing of event records from moved_events dictionary in a separate daemon thread #1075

Closed
wants to merge 1 commit into from

Conversation

ksiv
Copy link

@ksiv ksiv commented Oct 3, 2024

Added separate daemon thread to clean records from moved_events that are used for source_path acquisition with some delay for events not to get cleaned before they have a chance to be used as for source_path acquisition

Dict optimized to hold smaller object with only src_path and timestamp.
Unfortunately a thread breaks some pytest fixtures in place, so I added a "threaded" folder where such test could be moved as an example if this approach is to be accepted

This PR supposed to deal with #1041
And possibly partly with #587

…are used for source_path acquisition with some delay for events not to get cleaned before they have a chance to be used as moved_from.

Dict optimized to hold smaller object with only src_path and timestamp.
Unfortunately a thread breaks some pytest fixtures in place, so I added a "threaded" folder where such test could be moved as an example if this approach is to be accepted
@ksiv ksiv changed the title Added separate daemon thread to clean records from moved_events that … Delayed clearing of events records from moved_events dict in a separate daemon thread Oct 3, 2024
@ksiv ksiv changed the title Delayed clearing of events records from moved_events dict in a separate daemon thread Delayed clearing of event records from moved_events dictionary in a separate daemon thread Oct 3, 2024
@ksiv ksiv closed this Oct 5, 2024
@ksiv
Copy link
Author

ksiv commented Oct 5, 2024

I made a new one with non-demon thread

@ksiv ksiv mentioned this pull request Oct 7, 2024
@ksiv ksiv deleted the fix_moved_records_never_clean branch October 17, 2024 06:36
@ksiv ksiv restored the fix_moved_records_never_clean branch October 17, 2024 06:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant