Skip to content

Option to use Azure search with the chatbot (#1330) #3400

Option to use Azure search with the chatbot (#1330)

Option to use Azure search with the chatbot (#1330) #3400

Triggered via push October 17, 2024 11:12
Status Failure
Total duration 41m 25s
Artifacts 4
Matrix: system-tests
Fit to window
Zoom out
Zoom in

Annotations

6 errors, 10 warnings, and 2 notices
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback: system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L57
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback Error: Screenshot comparison failed: 62935 pixels (ratio 0.15 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/src/__screenshots__/quizzes/feedback/clickable-multiple-choice.spec.ts/clickable-multiple-choice-incorrect-answer-mobile-tall.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/quizzes-feedback-clickable-multiple-choice-quizzes-clickable-multiple-choice-feedback-chromium/clickable-multiple-choice-incorrect-answer-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/quizzes-feedback-clickable-multiple-choice-quizzes-clickable-multiple-choice-feedback-chromium/clickable-multiple-choice-incorrect-answer-mobile-tall-1-diff.png Call log: - page._expectScreenshot with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - 62935 pixels (ratio 0.15 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - captured a stable screenshot - 62935 pixels (ratio 0.15 of all image pixels) are different. 55 | await page.getByText(`This is an extra submit message from the teacher.`).waitFor() 56 | > 57 | await expectScreenshotsToMatchSnapshots({ | ^ 58 | screenshotTarget: page, 59 | headless, 60 | testInfo, at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts:57:44
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback: system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. Call log: - waiting for getByText('Submit') - locator resolved to <button disabled class="css-2q3icd">Submit</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #21 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #22 - waiting 500ms - waiting for element to be visible, enabled and stable -
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback: system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. Call log: - waiting for getByText('Submit') - locator resolved to <button disabled class="css-2q3icd">Submit</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #21 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #22 - waiting 500ms - waiting for element to be visible, enabled and stable -
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback: system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback Retry #3 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. Call log: - waiting for getByText('Submit') - locator resolved to <button disabled class="css-2q3icd">Submit</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #21 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #22 - waiting 500ms - waiting for element to be visible, enabled and stable -
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback: system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback Retry #4 ─────────────────────────────────────────────────────────────────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. Call log: - waiting for getByText('Submit') - locator resolved to <button disabled class="css-2q3icd">Submit</button> - attempting click action - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #1 - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #21 - waiting 500ms - waiting for element to be visible, enabled and stable - element is not enabled - retrying click action, attempt #22 - waiting 500ms - waiting for element to be visible, enabled and stable -
system-tests (2)
Process completed with exit code 1.
Slow Test: system-tests/[chromium] › course-modules/course-modules.spec.ts#L1
system-tests/[chromium] › course-modules/course-modules.spec.ts took 41.5s
Slow Test: system-tests/[chromium] › glossary.spec.ts#L1
system-tests/[chromium] › glossary.spec.ts took 39.5s
Slow Test: system-tests/[chromium] › exam-list.spec.ts#L1
system-tests/[chromium] › exam-list.spec.ts took 38.0s
Slow Test: system-tests/[chromium] › course-instance-management/course-instance-management.spec.ts#L1
system-tests/[chromium] › course-instance-management/course-instance-management.spec.ts took 34.3s
Slow Test: system-tests/[chromium] › history/history.spec.ts#L1
system-tests/[chromium] › history/history.spec.ts took 32.9s
Slow Test: system-tests/[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts#L1
system-tests/[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts took 1.4m
Slow Test: system-tests/[chromium] › proposed-edits/proposed-edits.spec.ts#L1
system-tests/[chromium] › proposed-edits/proposed-edits.spec.ts took 1.1m
Slow Test: system-tests/[chromium] › material-reference.spec.ts#L1
system-tests/[chromium] › material-reference.spec.ts took 57.2s
Slow Test: system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-column.spec.ts#L1
system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-column.spec.ts took 43.6s
Slow Test: system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-row.spec.ts#L1
system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-row.spec.ts took 42.5s
🎭 Playwright Run Summary
57 passed (6.8m)
🎭 Playwright Run Summary
1 failed [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback 56 passed (9.6m)

Artifacts

Produced during runtime
Name Size
playwright-html-report-2
374 KB
skaffold-build-output
945 Bytes
skaffold-images
347 MB
test-results-2
6.55 MB