test: updated screenshots #8606
mfranzkedefault.yml
on: pull_request
init
/
Init
22s
scan-secrets
/
TruffleHog
28s
lint
/
Lint
47s
Matrix: test-components / playwright-ct
Matrix: test-showcases / playwright-showcases
merge-reports
/
🎭 Merge Playwright Reports
2m 35s
deploy
/
Deploy
Annotations
19 errors, 5 warnings, and 1 notice
|
test-components / 🧪🎭 - react:4/4
Process completed with exit code 1.
|
|
test-components / 🧪🎭 - vue:2/4
Process completed with exit code 1.
|
|
test-components / 🧪🎭 - vue:4/4
Process completed with exit code 1.
|
|
test-components / 🧪🎭 - react:2/4
Process completed with exit code 1.
|
|
test-showcases / 🧪🎭 - angular:2/2
Process completed with exit code 1.
|
|
test-showcases / 🧪🎭 - react:1/2
Process completed with exit code 1.
|
|
test-showcases / 🧪🎭 - angular:1/2
Process completed with exit code 1.
|
|
test-showcases / 🧪🎭 - vue:1/2
Process completed with exit code 1.
|
|
checks-done
Process completed with exit code 1.
|
|
[webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
1) [webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot ────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1270px, received 1280px by 1162px.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- Expected an image 1280px by 1270px, received 1280px by 1162px.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- Expected an image 1280px by 1270px, received 1280px by 1162px.
Expected: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
1) [webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot ────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1270px, received 1280px by 1162px.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- Expected an image 1280px by 1270px, received 1280px by 1162px.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- Expected an image 1280px by 1270px, received 1280px by 1162px.
Expected: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
1) [webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot ────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1270px, received 1280px by 1162px.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- Expected an image 1280px by 1270px, received 1280px by 1162px.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- Expected an image 1280px by 1270px, received 1280px by 1162px.
Expected: /__w/mono/mono/showcases/react-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/react-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/react-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
1) [webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot ────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1270px, received 1280px by 1162px.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- Expected an image 1280px by 1270px, received 1280px by 1162px.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- Expected an image 1280px by 1270px, received 1280px by 1162px.
Expected: /__w/mono/mono/showcases/react-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/react-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/react-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
1) [webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot ────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1270px, received 1280px by 1162px.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- Expected an image 1280px by 1270px, received 1280px by 1162px.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- Expected an image 1280px by 1270px, received 1280px by 1162px.
Expected: /__w/mono/mono/showcases/vue-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/vue-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/vue-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
1) [webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot ────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
Expected an image 1280px by 1270px, received 1280px by 1162px.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- Expected an image 1280px by 1270px, received 1280px by 1162px.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- Expected an image 1280px by 1270px, received 1280px by 1162px.
Expected: /__w/mono/mono/showcases/vue-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/vue-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/vue-showcase/test-results/accordion-item-showcase-accordion-item-DBAccordionItem-should-match-screenshot-webkit-retry1/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBBadge › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
2) [webkit] › default.ts:13:4 › DBBadge › should match screenshot ────────────────────────────────
Error: Screenshot comparison failed:
1546 pixels (ratio 0.01 of all image pixels) are different.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 1546 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 1546 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBBadge › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
2) [webkit] › default.ts:13:4 › DBBadge › should match screenshot ────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1546 pixels (ratio 0.01 of all image pixels) are different.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 1546 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 1546 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/angular-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBBadge › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
2) [webkit] › default.ts:13:4 › DBBadge › should match screenshot ────────────────────────────────
Error: Screenshot comparison failed:
1546 pixels (ratio 0.01 of all image pixels) are different.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 1546 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 1546 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/showcases/react-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/react-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/react-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
[webkit] › default.ts:13:4 › DBBadge › should match screenshot:
../../../../../__w/mono/mono/showcases/e2e/default.ts#L40
2) [webkit] › default.ts:13:4 › DBBadge › should match screenshot ────────────────────────────────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Screenshot comparison failed:
1546 pixels (ratio 0.01 of all image pixels) are different.
Call log:
- expect.toHaveScreenshot(regular/neutral.png) with timeout 5000ms
- verifying given screenshot expectation
- taking page screenshot
- disabled all CSS animations
- 1546 pixels (ratio 0.01 of all image pixels) are different.
- waiting 100ms before taking screenshot
- taking page screenshot
- disabled all CSS animations
- captured a stable screenshot
- 1546 pixels (ratio 0.01 of all image pixels) are different.
Expected: /__w/mono/mono/showcases/react-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular/neutral-expected.png
Received: /__w/mono/mono/showcases/react-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular/neutral-actual.png
Diff: /__w/mono/mono/showcases/react-showcase/test-results/badge-showcase-badge-DBBadge-should-match-screenshot-webkit-retry1/regular/neutral-diff.png
38 | );
39 | await setScrollViewport(page, fixedHeight)();
> 40 | await expect(page).toHaveScreenshot(
| ^
41 | [tonality, `${color}.png`],
42 | config
43 | );
at /__w/mono/mono/showcases/e2e/default.ts:40:24
|
|
Slow Test:
[webkit] › default.ts#L1
[webkit] › default.ts took 1.7m
|
|
Slow Test:
[mobile_safari] › default.ts#L1
[mobile_safari] › default.ts took 56.6s
|
|
Slow Test:
[chromium] › default.ts#L1
[chromium] › default.ts took 45.6s
|
|
Slow Test:
[mobile_chrome] › default.ts#L1
[mobile_chrome] › default.ts took 36.1s
|
|
Slow Test:
[mobile_safari] › infotext/infotext.spec.tsx#L1
[mobile_safari] › infotext/infotext.spec.tsx took 16.3s
|
|
🎭 Playwright Run Summary
32 failed
[webkit] › default.ts:13:4 › DBAccordionItem › should match screenshot ─────────────────────────
[webkit] › default.ts:13:4 › DBBadge › should match screenshot ─────────────────────────────────
[webkit] › accordion/accordion.spec.tsx:23:6 › DBAccordion › should match screenshot ───────────
[webkit] › accordion-item/accordion-item.spec.tsx:16:6 › DBAccordionItem › should match screenshot
[webkit] › alert/alert.spec.tsx:20:6 › DBAlert › should match screenshot ───────────────────────
[webkit] › alert/alert.spec.tsx:28:3 › DBAlert › should match screenshot for variant critical ──
[webkit] › alert/alert.spec.tsx:28:3 › DBAlert › should match screenshot for variant informational
[webkit] › alert/alert.spec.tsx:28:3 › DBAlert › should match screenshot for variant warning ───
[webkit] › alert/alert.spec.tsx:28:3 › DBAlert › should match screenshot for variant successful
[webkit] › button/button.spec.tsx:28:7 › DBButton › should only have icon for variant outlined ─
[webkit] › button/button.spec.tsx:28:7 › DBButton › should only have icon for variant primary ──
[webkit] › button/button.spec.tsx:28:7 › DBButton › should only have icon for variant solid ────
[webkit] › button/button.spec.tsx:28:7 › DBButton › should only have icon for variant text ─────
[webkit] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant critical
[webkit] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant informational
[webkit] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant warning
[webkit] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant successful
[webkit] › select/select.spec.tsx:21:6 › DBSelect › should match screenshot ────────────────────
[mobile_safari] › accordion/accordion.spec.tsx:23:6 › DBAccordion › should match screenshot ────
[mobile_safari] › accordion-item/accordion-item.spec.tsx:16:6 › DBAccordionItem › should match screenshot
[mobile_safari] › alert/alert.spec.tsx:20:6 › DBAlert › should match screenshot ────────────────
[mobile_safari] › alert/alert.spec.tsx:28:3 › DBAlert › should match screenshot for variant critical
[mobile_safari] › alert/alert.spec.tsx:28:3 › DBAlert › should match screenshot for variant informational
[mobile_safari] › button/button.spec.tsx:28:7 › DBButton › should only have icon for variant outlined
[mobile_safari] › button/button.spec.tsx:28:7 › DBButton › should only have icon for variant solid
[mobile_safari] › button/button.spec.tsx:28:7 › DBButton › should only have icon for variant text
[mobile_safari] › infotext/infotext.spec.tsx:16:6 › DBInfotext › should match screenshot ───────
[mobile_safari] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant critical
[mobile_safari] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant informational
[mobile_safari] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant warning
[mobile_safari] › infotext/infotext.spec.tsx:24:7 › DBInfotext › should match screenshot for variant successful
[mobile_safari] › select/select.spec.tsx:21:6 › DBSelect › should match screenshot ─────────────
3 flaky
[webkit] › default.ts:13:4 › DBButton › should match screenshot ────────────────────────────────
[webkit] › infotext/infotext.spec.tsx:16:6 › DBInfotext › should match screenshot ──────────────
[mobile_safari] › default.ts:13:4 › DBAccordion › should match screenshot ──────────────────────
16 skipped
361 passed (59ms)
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
all-blob-reports
Expired
|
44.4 MB |
|
|
angular-showcase-playwright-results
Expired
|
3.5 MB |
|
|
db-ui-components-build
Expired
|
159 KB |
|
|
db-ui-foundations-build
Expired
|
35.1 KB |
|
|
db-ui-output
Expired
|
154 KB |
|
|
db-ui-outputs
Expired
|
2.12 MB |
|
|
db-ui-showcases
Expired
|
6.23 MB |
|
|
react-playwright-results
Expired
|
12.6 MB |
|
|
react-showcase-playwright-results
Expired
|
3.66 MB |
|
|
report--attempt-1
Expired
|
34.1 MB |
|
|
vue-playwright-results
Expired
|
12.4 MB |
|
|
vue-showcase-playwright-results
Expired
|
3.67 MB |
|