Skip to content

langs API

langs API #2746

Triggered via pull request July 12, 2023 18:52
@HeliozoaHeliozoa
synchronize #1154
langs-api
Status Failure
Total duration 48m 40s
Artifacts 4
This run and associated checks have been archived and are scheduled for deletion. Learn more about checks retention

system-tests-and-deploy.yml

on: pull_request
Matrix: system-tests
Fit to window
Zoom out
Zoom in

Annotations

11 errors, 39 warnings, and 1 notice
[chromium] › add-regrading.test.ts:7:5 › test: system-tests/src/tests/add-regrading.test.ts#L9
1) [chromium] › add-regrading.test.ts:7:5 › test ───────────────────────────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for locator('text=New regrading') ============================================================ 7 | test("test", async ({ page }) => { 8 | await page.goto("http://project-331.local/manage/regradings") > 9 | await page.locator("text=New regrading").click() | ^ 10 | await page.locator('textarea[name="exerciseTaskSubmissionIds"]').click() 11 | await page.locator('textarea[name="exerciseTaskSubmissionIds"]').click() 12 | await page at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/add-regrading.test.ts:9:44
[chromium] › automatic-completion.spec.ts:10:5 › Registers automatic completion: system-tests/src/tests/automatic-completion.spec.ts#L70
2) [chromium] › automatic-completion.spec.ts:10:5 › Registers automatic completion ─────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for getByRole('link', { name: 'Manage course \'Automatic Completions\'' }) ============================================================ 68 | 69 | await Promise.all([ > 70 | page.getByRole("link", { name: "Manage course 'Automatic Completions'" }).click(), | ^ 71 | ]) 72 | await expect(page).toHaveURL( 73 | "http://project-331.local/manage/courses/b39b64f3-7718-4556-ac2b-333f3ed4096f", at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/automatic-completion.spec.ts:70:79
[chromium] › certificates/configure-certificate.test.ts:9:5 › test: system-tests/src/tests/certificates/configure-certificate.test.ts#L15
3) [chromium] › certificates/configure-certificate.test.ts:9:5 › test ──────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for getByRole('link', { name: 'Manage course \'Certificates\'' }) ============================================================ 13 | .getByRole("link", { name: "University of Helsinki, Department of Computer Science" }) 14 | .click() > 15 | await page.getByRole("link", { name: "Manage course 'Certificates'" }).click() | ^ 16 | await page.getByRole("tab", { name: "Course instances" }).click() 17 | await page.getByRole("link", { name: "Manage certificates (Default)" }).click() 18 | await expectScreenshotsToMatchSnapshots({ at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/certificates/configure-certificate.test.ts:15:74
[chromium] › certificates/generate-certificate.test.ts:10:5 › test: system-tests/src/utils/screenshot.ts#L339
4) [chromium] › certificates/generate-certificate.test.ts:10:5 › test › Expect screenshots to match snapshots "generated-certificate" Error: Screenshot comparison failed: 330 pixels (ratio 0.01 of all image pixels) are different. Call log: - expect.toHaveScreenshot(generated-certificate-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - 330 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - captured a stable screenshot - 330 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/certificates-generate-certificate-test-chromium/generated-certificate-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/certificates-generate-certificate-test-chromium/generated-certificate-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/certificates-generate-certificate-test-chromium/generated-certificate-mobile-tall-1-diff.png at ../utils/screenshot.ts:339 337 | await page.waitForTimeout(600) 338 | if (isPage(screenshotTarget)) { > 339 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 340 | } else { 341 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 342 | } at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:339:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:273:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:149:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:88:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/certificates/generate-certificate.test.ts:38:3
[chromium] › cms/converting-blocks.spec.ts:7:5 › Can convert blocks: system-tests/src/tests/cms/converting-blocks.spec.ts#L12
5) [chromium] › cms/converting-blocks.spec.ts:7:5 › Can convert blocks ─────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for getByRole('link', { name: 'Manage course \'Permission management\'' }) ============================================================ 10 | .getByRole("link", { name: "University of Helsinki, Department of Computer Science" }) 11 | .click() > 12 | await page.getByRole("link", { name: "Manage course 'Permission management'" }).click() | ^ 13 | await page.getByRole("tab", { name: "Pages" }).click() 14 | await page 15 | .locator(".css-1oaaogx > .css-noo2yn > .css-nyz7p3 > .css-1fytp2i-PrimaryButton") at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/cms/converting-blocks.spec.ts:12:83
[chromium] › cms/mediaUpload.spec.ts:29:7 › Uploading media as admin › test: system-tests/src/tests/cms/mediaUpload.spec.ts#L32
6) [chromium] › cms/mediaUpload.spec.ts:29:7 › Uploading media as admin › test ─────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for locator('[aria-label="Manage course \'Introduction to everything\'"] svg') ============================================================ 30 | await page.locator("text=University of Helsinki, Department of Computer Science").click() 31 | > 32 | await page.locator("[aria-label=\"Manage course 'Introduction to everything'\"] svg").click() | ^ 33 | 34 | await page.locator("text=Pages").click() 35 | at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/cms/mediaUpload.spec.ts:32:91
[chromium] › course-instance-management/add-completions.spec.ts:11:5 › test: system-tests/src/tests/course-instance-management/add-completions.spec.ts#L19
7) [chromium] › course-instance-management/add-completions.spec.ts:11:5 › test ─────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for locator('[aria-label="Manage course \\\'Manual Completions\\\'"] path') ============================================================ 17 | await expect(page).toHaveURL("http://project-331.local/org/uh-cs") 18 | > 19 | await page.locator("[aria-label=\"Manage course \\'Manual Completions\\'\"] path").click() | ^ 20 | await expect(page).toHaveURL( 21 | "http://project-331.local/manage/courses/34f4e7b7-9f55-48a7-95d7-3fc3e89553b5", 22 | ) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/course-instance-management/add-completions.spec.ts:19:86
[chromium] › course-instance-management/course-instance-management.spec.ts:10:5 › test: system-tests/src/tests/course-instance-management/course-instance-management.spec.ts#L20
8) [chromium] › course-instance-management/course-instance-management.spec.ts:10:5 › test ──────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for locator('[aria-label="Manage course \'Advanced course instance management\'"] svg') ============================================================ 18 | await await page 19 | .locator("[aria-label=\"Manage course 'Advanced course instance management'\"] svg") > 20 | .click() | ^ 21 | await expect(page).toHaveURL( 22 | "http://project-331.local/manage/courses/1e0c52c7-8cb9-4089-b1c3-c24fc0dd5ae4", 23 | ) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/course-instance-management/course-instance-management.spec.ts:20:6
[chromium] › course-list.spec.ts:10:5 › course list renders: system-tests/src/utils/screenshot.ts#L339
9) [chromium] › course-list.spec.ts:10:5 › course list renders › Expect screenshots to match snapshots "course-listing" Error: Screenshot comparison failed: 360 pixels (ratio 0.01 of all image pixels) are different. Call log: - expect.toHaveScreenshot(course-listing-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - 360 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - captured a stable screenshot - 360 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-list-course-list-renders-chromium/course-listing-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-list-course-list-renders-chromium/course-listing-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-list-course-list-renders-chromium/course-listing-mobile-tall-1-diff.png at ../utils/screenshot.ts:339 337 | await page.waitForTimeout(600) 338 | if (isPage(screenshotTarget)) { > 339 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 340 | } else { 341 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 342 | } at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:339:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:273:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:149:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:88:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/course-list.spec.ts:20:3
[chromium] › course-material/custom-iframe.spec.ts:10:5 › test: system-tests/src/tests/course-material/custom-iframe.spec.ts#L22
10) [chromium] › course-material/custom-iframe.spec.ts:10:5 › test ─────────────────────────────── TimeoutError: locator.click: Timeout 15000ms exceeded. =========================== logs =========================== waiting for getByRole('link', { name: 'Manage course \'Permission management\'' }) ============================================================ 20 | .getByRole("link", { name: "University of Helsinki, Department of Computer Science" }) 21 | .click() > 22 | await page.getByRole("link", { name: "Manage course 'Permission management'" }).click() | ^ 23 | await page.getByRole("tab", { name: "Pages" }).click() 24 | await page.getByRole("button", { name: "New page" }).nth(1).click() 25 | await page.getByLabel("Title *").click() at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/course-material/custom-iframe.spec.ts:22:83
system-tests (2)
The operation was canceled.
typecheck
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
build
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, yokawasa/[email protected], actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
build
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, yokawasa/[email protected], actions/download-artifact@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (1)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Slow Test: system-tests/[chromium] › draft.spec.ts#L1
system-tests/[chromium] › draft.spec.ts took 1.3m
Slow Test: system-tests/[chromium] › automatic-completion.spec.ts#L1
system-tests/[chromium] › automatic-completion.spec.ts took 42.2s
Slow Test: system-tests/[chromium] › feedback/feedback.spec.ts#L1
system-tests/[chromium] › feedback/feedback.spec.ts took 36.3s
Slow Test: system-tests/[chromium] › history/history.spec.ts#L1
system-tests/[chromium] › history/history.spec.ts took 30.2s
Slow Test: system-tests/[chromium] › glossary.spec.ts#L1
system-tests/[chromium] › glossary.spec.ts took 26.6s
system-tests (2)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, yokawasa/[email protected], actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
system-tests (2)
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
🎭 Playwright Run Summary
29 failed [chromium] › add-regrading.test.ts:7:5 › test ────────────────────────────────────────────────── [chromium] › automatic-completion.spec.ts:10:5 › Registers automatic completion ──────────────── [chromium] › certificates/configure-certificate.test.ts:9:5 › test ───────────────────────────── [chromium] › certificates/generate-certificate.test.ts:10:5 › test ───────────────────────────── [chromium] › cms/converting-blocks.spec.ts:7:5 › Can convert blocks ──────────────────────────── [chromium] › cms/mediaUpload.spec.ts:29:7 › Uploading media as admin › test ──────────────────── [chromium] › course-instance-management/add-completions.spec.ts:11:5 › test ──────────────────── [chromium] › course-instance-management/course-instance-management.spec.ts:10:5 › test ───────── [chromium] › course-list.spec.ts:10:5 › course list renders ──────────────────────────────────── [chromium] › course-material/custom-iframe.spec.ts:10:5 › test ───────────────────────────────── [chromium] › course-modules/course-modules.spec.ts:9:5 › Course modules test ─────────────────── [chromium] › creating-course-and-returning-an-exercise.spec.ts:14:5 › test ───────────────────── [chromium] › draft.spec.ts:44:7 › admin › can see draft course ───────────────────────────────── [chromium] › draft.spec.ts:54:7 › admin › can create a draft course and change it to a non-draft course [chromium] › draft.spec.ts:108:7 › Teacher › Can give students access to the draft course ────── [chromium] › draft.spec.ts:137:7 › Teacher › teacher gets permissions to new course when copying a course [chromium] › draft.spec.ts:162:7 › Teacher › teacher can copy course and grant users the same permissions as the original course [chromium] › exam-list.spec.ts:10:5 › exam list renders, can create exam ─────────────────────── [chromium] › exams/create-new-exam.spec.ts:7:5 › test ────────────────────────────────────────── [chromium] › exams/exam-instructions.spec.ts:8:5 › test ──────────────────────────────────────── [chromium] › exercise-list.spec.ts:9:5 › test ────────────────────────────────────────────────── [chromium] › exercise-service.spec.ts:19:5 › can add and delete exercise service ─────────────── [chromium] › feedback/feedback.spec.ts:15:5 › feedback test ──────────────────────────────────── [chromium] › glossary.spec.ts:10:5 › glossary test ───────────────────────────────────────────── [chromium] › gutenberg/spacer-not-breaking-editing.spec.ts:9:5 › Spacers should not break text editing under them, block inserter should not go on top of the typing caret [chromium] › history/history.spec.ts:16:5 › history test ─────────────────────────────────────── [chromium] › langs/langs.spec.ts:9:5 › get course instances ──────────────────────────────────── [chromium] › latex.spec.ts:12:5 › latex-block renders ────────────────────────────────────────── [chromium] › limited-tries.spec.ts:9:5 › Limited tries work ──────────────────────────────────── 18 passed (12.3m)

Artifacts

Produced during runtime
Name Size
playwright-html-report Expired
572 KB
skaffold-build-output Expired
3.13 KB
skaffold-images Expired
315 MB
test-results Expired
45.5 MB