Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Updater] Drop nats and re-do in BullMQ #4435

Open
ShootingStar91 opened this issue Mar 6, 2024 · 0 comments
Open

[Updater] Drop nats and re-do in BullMQ #4435

ShootingStar91 opened this issue Mar 6, 2024 · 0 comments
Labels
infra Infrastructure updater Updater

Comments

@ShootingStar91
Copy link
Member

ShootingStar91 commented Mar 6, 2024

Why?

  • The nats seems to drop connection between worker/scheduler sometimes and not regain it
  • This, or code bugs / debug attempts, can lead to situations where you have millions of student updates queued. These cannot currently be emptied in any other way than probably removing and returning the persistent volume via infra; not good
  • BullMQ would add easy ability to add a button for cleaning jobs in UI
  • Also would offer transparency: easy to show the currently running/queued jobs in UI Updater view, just like backend refresh jobs are done now
  • The redis "total scheduled" which doesnt even work correctly, could be removed
  • Means that nats-deployment could be removed as redis is already used in updater anyways. However, I'm not sure how it works in development mode where backend uses the same redis. You could separate the redises, or they might work through the same redis without problems
  • Code example is already in backend
@ShootingStar91 ShootingStar91 added updater Updater infra Infrastructure labels Mar 6, 2024
@ShootingStar91 ShootingStar91 changed the title Need a button for clearing updater job queue (NATS) [Updater] Drop nats and re-do in BullMQ Mar 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
infra Infrastructure updater Updater
Projects
Status: To do
Development

No branches or pull requests

1 participant