-
Notifications
You must be signed in to change notification settings - Fork 290
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Removing Beanstalk from teuthology #1650
base: main
Are you sure you want to change the base?
Removing Beanstalk from teuthology #1650
Commits on Oct 8, 2024
-
Remove usage of beanstalk from teuthology
The following changes support the removal of Beanstalk from Teuthology. In place of Beanstalk, we will now be using Paddles for queue management in Teuthology. This PR has the corresponding changes for the paddles PR: https://github.com/ceph/paddles/pull/94/files. The changes include: 1. Removing all beanstalk related code 2. Teuthology scheduler and dispatcher using Paddles queue for scheduling and dispatching jobs 3. Adding support for Paddles queue management 4. Additional functionality of being able to change the priority of Teuthology jobs in the queued state in the teuthology-queue command Signed-off-by: Aishwarya Mathuria <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 9d97b17 - Browse repository at this point
Copy the full SHA 9d97b17View commit details -
Modify teuthology worker unit test and fix flake8 errors
Previously the teuthology worker unit test used beanstalk, the test will be using Paddles now. Signed-off-by: Aishwarya Mathuria <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 99e5ca6 - Browse repository at this point
Copy the full SHA 99e5ca6View commit details -
Add retry for paddles calls and modify pause queue command
1. Add retry loop for the paddles calls. 2. Add run name as a parameter for updating priority of jobs in paddles. 3. Modify the pause queue command to run on server side with an optional pause duration parameter. Signed-off-by: Aishwarya Mathuria <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 72d4408 - Browse repository at this point
Copy the full SHA 72d4408View commit details -
Add new test cases for dispatcher and scheduler
Signed-off-by: Aishwarya Mathuria <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 0cf9a5e - Browse repository at this point
Copy the full SHA 0cf9a5eView commit details -
Add beanstalk as a possible queue backend for Teuthology Jobs along w…
…ith Paddles With the use of the --queue-backend argument the user can specify which backend(paddles/beanstalk) they would like to use for maintaining the teuthology Jobs queue. In order to avoid overlapping Job IDs, when a job is being scheduled in beanstalk it is also written to paddles which returns a unique ID. This is the ID teuthology will treat as the Job ID throughout the run of the job. To differentiate between the 2 queue backends, the teuthology-queue command has been split into teuthology-paddles-queue command and teuthology-beanstalk-queue command. Signed-off-by: Aishwarya Mathuria <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for e9122c6 - Browse repository at this point
Copy the full SHA e9122c6View commit details -
scripts/queue: common teuthology-queue command for paddles and beanst…
…alk queue Signed-off-by: Aishwarya Mathuria <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for 74bd369 - Browse repository at this point
Copy the full SHA 74bd369View commit details
Commits on Oct 9, 2024
-
teuthology/queue: Single command for queue operations
Makes the same teuthology-queue commands work regardless of the queue backend, Paddles or Beanstalk. Signed-off-by: Aishwarya Mathuria <[email protected]>
Configuration menu - View commit details
-
Copy full SHA for be34af2 - Browse repository at this point
Copy the full SHA be34af2View commit details