1) [chromium] › course-instance-management/course-instance-management.spec.ts:10:5 › test › Expect screenshots to match snapshots "new-course-instance-form" Error: Screenshot comparison failed: 63690 pixels (ratio 0.15 of all image pixels) are different. Call log: - expect.toHaveScreenshot(new-course-instance-form-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - 63690 pixels (ratio 0.15 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - captured a stable screenshot - 63690 pixels (ratio 0.15 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-instance-management-course-instance-management-test-chromium/new-course-instance-form-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-instance-management-course-instance-management-test-chromium/new-course-instance-form-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-instance-management-course-instance-management-test-chromium/new-course-instance-form-mobile-tall-1-diff.png at ../utils/screenshot.ts:344 342 | await page.waitForTimeout(600) 343 | if (isPage(screenshotTarget)) { > 344 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 345 | } else { 346 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 347 | } at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:344:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:278:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:150:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:89:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/course-instance-management/course-instance-management.spec.ts:65:3

2) [chromium] › course-modules/course-modules.spec.ts:9:5 › Course modules test › Expect screenshots to match snapshots "initial-module-management-page" Error: Screenshot comparison failed: 130 pixels (ratio 0.01 of all image pixels) are different. Call log: - expect.toHaveScreenshot(initial-module-management-page-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - 130 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - captured a stable screenshot - 130 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-modules-course-modules-Course-modules-test-chromium/initial-module-management-page-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-modules-course-modules-Course-modules-test-chromium/initial-module-management-page-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/course-modules-course-modules-Course-modules-test-chromium/initial-module-management-page-mobile-tall-1-diff.png at ../utils/screenshot.ts:344 342 | await page.waitForTimeout(600) 343 | if (isPage(screenshotTarget)) { > 344 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 345 | } else { 346 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 347 | } at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:344:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:278:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:150:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:89:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/course-modules/course-modules.spec.ts:23:3

3) [chromium] › exam-list.spec.ts:10:5 › exam list renders, can create exam › Expect screenshots to match snapshots "create-exam-dialog" Error: Screenshot comparison failed: Expected an image 315px by 546px, received 359px by 546px. 1275 pixels (ratio 0.01 of all image pixels) are different. Call log: - expect.toHaveScreenshot(create-exam-dialog-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - waiting for locator('id=new-exam-dialog') - locator resolved to <div id="new-exam-dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for element to be visible and stable - element is visible and stable - Expected an image 315px by 546px, received 359px by 546px. 1275 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for locator('id=new-exam-dialog') - locator resolved to <div id="new-exam-dialog">…</div> - taking element screenshot - disabled all CSS animations - waiting for element to be visible and stable - element is visible and stable - captured a stable screenshot - Expected an image 315px by 546px, received 359px by 546px. 1275 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/exam-list-exam-list-renders-can-create-exam-chromium/create-exam-dialog-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/exam-list-exam-list-renders-can-create-exam-chromium/create-exam-dialog-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/exam-list-exam-list-renders-can-create-exam-chromium/create-exam-dialog-mobile-tall-1-diff.png at ../utils/screenshot.ts:346 344 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 345 | } else { > 346 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 347 | } 348 | } finally { 349 | testInfo.config.updateSnapshots = originalUpdateSnapshotsSetting at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:346:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:278:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:150:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:89:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/exam-list.spec.ts:34:3

4) [chromium] › exercise-service.spec.ts:19:5 › can add and delete exercise service › Expect screenshots to match snapshots "exercise-service-page" Error: Screenshot comparison failed: 17005 pixels (ratio 0.04 of all image pixels) are different. Call log: - expect.toHaveScreenshot(exercise-service-page-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - 17005 pixels (ratio 0.04 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - captured a stable screenshot - 17005 pixels (ratio 0.04 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/exercise-service-can-add-and-delete-exercise-service-chromium/exercise-service-page-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/exercise-service-can-add-and-delete-exercise-service-chromium/exercise-service-page-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/exercise-service-can-add-and-delete-exercise-service-chromium/exercise-service-page-mobile-tall-1-diff.png at ../utils/screenshot.ts:344 342 | await page.waitForTimeout(600) 343 | if (isPage(screenshotTarget)) { > 344 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 345 | } else { 346 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 347 | } at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:344:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:278:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:150:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:89:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/exercise-service.spec.ts:47:3

5) [chromium] › feedback/feedback.spec.ts:15:5 › feedback test › Expect screenshots to match snapshots "feedback-unread" Error: Screenshot comparison failed: 3180 pixels (ratio 0.01 of all image pixels) are different. Call log: - expect.toHaveScreenshot(feedback-unread-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - 3180 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - captured a stable screenshot - 3180 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/feedback-feedback-feedback-test-chromium/feedback-unread-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/feedback-feedback-feedback-test-chromium/feedback-unread-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/feedback-feedback-feedback-test-chromium/feedback-unread-mobile-tall-1-diff.png at ../utils/screenshot.ts:344 342 | await page.waitForTimeout(600) 343 | if (isPage(screenshotTarget)) { > 344 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 345 | } else { 346 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 347 | } at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:344:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:278:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:150:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:89:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/feedback/feedback.spec.ts:96:3

6) [chromium] › material-reference.spec.ts:10:5 › material reference tests › Expect screenshots to match snapshots "add-new-material-reference-dialog" Error: Screenshot comparison failed: 19416 pixels (ratio 0.05 of all image pixels) are different. Call log: - expect.toHaveScreenshot(add-new-material-reference-dialog-mobile-tall.png) with timeout 5000ms - verifying given screenshot expectation - taking page screenshot - disabled all CSS animations - 19416 pixels (ratio 0.05 of all image pixels) are different. - waiting 100ms before taking screenshot - taking page screenshot - disabled all CSS animations - captured a stable screenshot - 19416 pixels (ratio 0.05 of all image pixels) are different. Expected: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/material-reference-material-reference-tests-chromium/add-new-material-reference-dialog-mobile-tall-expected.png Received: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/material-reference-material-reference-tests-chromium/add-new-material-reference-dialog-mobile-tall-1-actual.png Diff: /home/runner/work/secret-project-331/secret-project-331/system-tests/test-results/material-reference-material-reference-tests-chromium/add-new-material-reference-dialog-mobile-tall-1-diff.png at ../utils/screenshot.ts:344 342 | await page.waitForTimeout(600) 343 | if (isPage(screenshotTarget)) { > 344 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) | ^ 345 | } else { 346 | await expect(screenshotTarget).toHaveScreenshot(screenshotName, screenshotOptions) 347 | } at takeScreenshotAndComparetoSnapshot (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:344:38) at snapshotWithViewPort (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:278:5) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:150:9 at expectScreenshotsToMatchSnapshots (/home/runner/work/secret-project-331/secret-project-331/system-tests/src/utils/screenshot.ts:89:3) at /home/runner/work/secret-project-331/secret-project-331/system-tests/src/tests/material-reference.spec.ts:35:3

Process completed with exit code 1.

The operation was canceled.

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, yokawasa/[email protected], actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, yokawasa/[email protected], actions/download-artifact@v2, actions/upload-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

system-tests/[chromium] › glossary.spec.ts took 44.1s

system-tests/[chromium] › history/history.spec.ts took 40.8s

system-tests/[chromium] › draft.spec.ts took 40.6s

system-tests/[chromium] › automatic-completion.spec.ts took 39.1s

system-tests/[chromium] › feedback/feedback.spec.ts took 33.0s

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, yokawasa/[email protected], actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/

The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/