Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Crawl Select Trees and Concurrency Improvements #117

Merged
merged 1 commit into from
Dec 18, 2023
Merged

Crawl Select Trees and Concurrency Improvements #117

merged 1 commit into from
Dec 18, 2023

Conversation

kespinola
Copy link
Collaborator

Changes

  • Use a pool of messengers instead of a channel for funneling all messages to a single messenger instance.
  • Interact with the db for a transaction in a worker thread instead of the main tree crawl thread.
  • Fix acquiring a messenger from the queue and returning it.
  • Add extra argument to pass a list of trees that should be crawled. If not set crawl all trees.

@kespinola
refactor(backfiller): select fixed list of trees to process. switch f…
936e52f 
…rom a queue channel to a pool. move db checks for inserting a transaction into transaction worker thread instead of tree thread allowing for concurrent saving of transactions.
@kespinola kespinola merged commit 1548bd9 into triton-build Dec 18, 2023
2 checks passed
@kespinola kespinola deleted the espi/select-trees branch December 18, 2023 14:27
linuskendall pushed a commit that referenced this pull request Dec 29, 2023
@kespinola @linuskendall
refactor(backfiller): select fixed list of trees to process. switch f…
0b33200 
…rom a queue channel to a pool. move db checks for inserting a transaction into transaction worker thread instead of tree thread allowing for concurrent saving of transactions. (#117)
linuskendall pushed a commit that referenced this pull request Jan 11, 2024
@kespinola @linuskendall
refactor(backfiller): select fixed list of trees to process. switch f…
8927c20 
…rom a queue channel to a pool. move db checks for inserting a transaction into transaction worker thread instead of tree thread allowing for concurrent saving of transactions. (#117)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@kespinola