Option to use Azure search with the chatbot (#1330) #3400
Annotations
6 errors, 10 warnings, and 2 notices
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback:
system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L57
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback
Error: Screenshot comparison failed:
62935 pixels (ratio 0.15 of all image pixels) are different.
Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/src/__screenshots__/quizzes/feedback/clickable-multiple-choice.spec.ts/clickable-multiple-choice-incorrect-answer-mobile-tall.png
Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/quizzes-feedback-clickable-multiple-choice-quizzes-clickable-multiple-choice-feedback-chromium/clickable-multiple-choice-incorrect-answer-mobile-tall-1-actual.png
Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/quizzes-feedback-clickable-multiple-choice-quizzes-clickable-multiple-choice-feedback-chromium/clickable-multiple-choice-incorrect-answer-mobile-tall-1-diff.png
Call log:
- page._expectScreenshot with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- 62935 pixels (ratio 0.15 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- waiting for fonts to load...
- fonts loaded
- captured a stable screenshot
- 62935 pixels (ratio 0.15 of all image pixels) are different.
55 | await page.getByText(`This is an extra submit message from the teacher.`).waitFor()
56 |
> 57 | await expectScreenshotsToMatchSnapshots({
| ^
58 | screenshotTarget: page,
59 | headless,
60 | testInfo,
at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts:57:44
|
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback:
system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: locator.click: Timeout 15000ms exceeded.
Call log:
- waiting for getByText('Submit')
- locator resolved to <button disabled class="css-2q3icd">Submit</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #22
- waiting 500ms
- waiting for element to be visible, enabled and stable
-
|
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback:
system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: locator.click: Timeout 15000ms exceeded.
Call log:
- waiting for getByText('Submit')
- locator resolved to <button disabled class="css-2q3icd">Submit</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #22
- waiting 500ms
- waiting for element to be visible, enabled and stable
-
|
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback:
system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback
Retry #3 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: locator.click: Timeout 15000ms exceeded.
Call log:
- waiting for getByText('Submit')
- locator resolved to <button disabled class="css-2q3icd">Submit</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #22
- waiting 500ms
- waiting for element to be visible, enabled and stable
-
|
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback:
system-tests/src/tests/quizzes/feedback/clickable-multiple-choice.spec.ts#L52
1) [chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback
Retry #4 ───────────────────────────────────────────────────────────────────────────────────────
TimeoutError: locator.click: Timeout 15000ms exceeded.
Call log:
- waiting for getByText('Submit')
- locator resolved to <button disabled class="css-2q3icd">Submit</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #21
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #22
- waiting 500ms
- waiting for element to be visible, enabled and stable
-
|
system-tests (2)
Process completed with exit code 1.
|
Slow Test:
system-tests/[chromium] › course-modules/course-modules.spec.ts#L1
system-tests/[chromium] › course-modules/course-modules.spec.ts took 41.5s
|
Slow Test:
system-tests/[chromium] › glossary.spec.ts#L1
system-tests/[chromium] › glossary.spec.ts took 39.5s
|
Slow Test:
system-tests/[chromium] › exam-list.spec.ts#L1
system-tests/[chromium] › exam-list.spec.ts took 38.0s
|
Slow Test:
system-tests/[chromium] › course-instance-management/course-instance-management.spec.ts#L1
system-tests/[chromium] › course-instance-management/course-instance-management.spec.ts took 34.3s
|
Slow Test:
system-tests/[chromium] › history/history.spec.ts#L1
system-tests/[chromium] › history/history.spec.ts took 32.9s
|
Slow Test:
system-tests/[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts#L1
system-tests/[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts took 1.4m
|
Slow Test:
system-tests/[chromium] › proposed-edits/proposed-edits.spec.ts#L1
system-tests/[chromium] › proposed-edits/proposed-edits.spec.ts took 1.1m
|
Slow Test:
system-tests/[chromium] › material-reference.spec.ts#L1
system-tests/[chromium] › material-reference.spec.ts took 57.2s
|
Slow Test:
system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-column.spec.ts#L1
system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-column.spec.ts took 43.6s
|
Slow Test:
system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-row.spec.ts#L1
system-tests/[chromium] › quizzes/widget/multiple-choice-course-material-widget-row.spec.ts took 42.5s
|
🎭 Playwright Run Summary
57 passed (6.8m)
|
🎭 Playwright Run Summary
1 failed
[chromium] › quizzes/feedback/clickable-multiple-choice.spec.ts:16:7 › quizzes clickable multiple-choice feedback
56 passed (9.6m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-html-report-2
|
374 KB |
|
skaffold-build-output
|
945 Bytes |
|
skaffold-images
|
347 MB |
|
test-results-2
|
6.55 MB |
|