Perform Mon & OSD failure tests in Stretch cluster #9319
Conversation
mashetty330
force-pushed
the
st_other
branch
from
e3a105a to
60866b1
Compare
|
|
||
| request.addfinalizer(finalizer) | ||
|
|
||
|
|
There was a problem hiding this comment.
Please add all the relevant markers, polarion id, stretch cluster required, lso required etc..
| def test_single_mon_failures(self): | ||
| """ | ||
| Test mon failure with IO in the background | ||
|
|
There was a problem hiding this comment.
add the detailed steps
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj08
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.16
OCS VERSION: 4.16
tested against branch: master
Job UNSTABLE (some or all tests failed).
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj08
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.16
OCS VERSION: 4.16
tested against branch: master
Job UNSTABLE (some or all tests failed).
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj08
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.16
OCS VERSION: 4.16
tested against branch: master
Job UNSTABLE (some or all tests failed).
Signed-off-by: Mahesh Shetty <[email protected]>
Signed-off-by: Mahesh Shetty <[email protected]>
Signed-off-by: Mahesh Shetty <[email protected]>
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj08
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.16
OCS VERSION: 4.16
tested against branch: master
Job UNSTABLE (some or all tests failed).
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj08
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.16
OCS VERSION: 4.16
tested against branch: master
Signed-off-by: Mahesh Shetty <[email protected]>
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj08
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.16
OCS VERSION: 4.16
tested against branch: master
Job UNSTABLE (some or all tests failed).
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj08
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.16
OCS VERSION: 4.16
tested against branch: master
Job UNSTABLE (some or all tests failed).
|
|
||
| def finalizer(): | ||
| """ | ||
| Check for data loss, data corruption at the end of the tests |
There was a problem hiding this comment.
Instead of adding it in finalizer , we can make common function so that all can use in future.
There was a problem hiding this comment.
this is already available in common function in Stretchcluster class. Here i used finalizer in class scoped fixture because i want the check to happen when all the test executions are completed. Hence avoiding repetitve checks for each test execution
| logger.info( | ||
| "Some app pods are not running, so trying the work-around to make them `Running`" | ||
| ) | ||
| pods_not_running = get_not_running_pods( |
There was a problem hiding this comment.
Even pods are showing known errors mentioned in recover_workload_pods_post_recovery function, If some pods are not running then it could be due to issue as well with same reasons.
There was a problem hiding this comment.
didnt get you @avd-sagare
There was a problem hiding this comment.
I mean pods error message could be same as mentioned in recover_workload_pods_post_recovery functions but reason could be different.
There was a problem hiding this comment.
if the workaround works then the reason for the issue is same. if it doesn't then its different and in that case test will fail
| pods_not_running = get_not_running_pods( | ||
| namespace=constants.STRETCH_CLUSTER_NAMESPACE | ||
| ) | ||
| recover_workload_pods_post_recovery(sc_obj, pods_not_running) |
There was a problem hiding this comment.
Does this function handles if pod is failed with error which is not listed?
There was a problem hiding this comment.
yeah it would fail even after applying the workaround if pods are not running
|
|
||
| @turquoise_squad | ||
| @stretchcluster_required | ||
| @pytest.mark.usefixtures("setup_logwriter_workloads") |
There was a problem hiding this comment.
this is not a customer bug automation
Signed-off-by: Mahesh Shetty <[email protected]>
Signed-off-by: Mahesh Shetty <[email protected]>
There was a problem hiding this comment.
PR validation on existing cluster
Cluster Name: mashetty-stj16
Cluster Configuration:
PR Test Suite:
PR Test Path: tests/functional/disaster-recovery/sc_arbiter/test_mon_osd_failures.py
Additional Test Params:
OCP VERSION: 4.17
OCS VERSION: 4.17
tested against branch: master
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: Akarsha-rai, avd-sagare, mashetty330, PrasadDesala The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
) Signed-off-by: Mahesh Shetty <[email protected]>
No description provided.