Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore: structured expect error #33180

Draft
wants to merge 9 commits into
base: main
Choose a base branch
from

Conversation

yury-s
Copy link
Member

@yury-s yury-s commented Oct 18, 2024

No description provided.

@yury-s yury-s marked this pull request as draft October 18, 2024 20:32

This comment has been minimized.

Copy link
Contributor

Test results for "tests 1"

151 failed
❌ [chromium-page] › page/expect-matcher-result.spec.ts:20:5 › toMatchText-based assertions should have matcher result @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-matcher-result.spec.ts:69:5 › toBeTruthy-based assertions should have matcher result @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-matcher-result.spec.ts:164:5 › toBeChecked({ checked: false }) should have expected: false @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-matcher-result.spec.ts:259:5 › toHaveScreenshot should populate matcherResult @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-to-have-text.spec.ts:34:7 › toHaveText with regex › fail @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-to-have-text.spec.ts:53:7 › toContainText with regex › fail @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-to-have-text.spec.ts:88:7 › toHaveText with text › fail @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-to-have-text.spec.ts:132:7 › toHaveText with text › fail with impossible timeout @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-to-have-text.spec.ts:149:7 › not.toHaveText › fail @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-to-have-text.spec.ts:157:7 › not.toHaveText › should work when selector does not match @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/page-check.spec.ts:20:3 › should check the box @smoke @chromium-ubuntu-22.04-node18 @smoke
❌ [chromium-page] › page/page-screenshot.spec.ts:961:3 › capture changing image @chromium-ubuntu-22.04-node18
❌ [chromium-page] › page/expect-matcher-result.spec.ts:20:5 › toMatchText-based assertions should have matcher result @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-matcher-result.spec.ts:69:5 › toBeTruthy-based assertions should have matcher result @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-matcher-result.spec.ts:164:5 › toBeChecked({ checked: false }) should have expected: false @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-matcher-result.spec.ts:259:5 › toHaveScreenshot should populate matcherResult @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-to-have-text.spec.ts:34:7 › toHaveText with regex › fail @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-to-have-text.spec.ts:53:7 › toContainText with regex › fail @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-to-have-text.spec.ts:88:7 › toHaveText with text › fail @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-to-have-text.spec.ts:132:7 › toHaveText with text › fail with impossible timeout @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-to-have-text.spec.ts:149:7 › not.toHaveText › fail @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-to-have-text.spec.ts:157:7 › not.toHaveText › should work when selector does not match @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/page-check.spec.ts:20:3 › should check the box @smoke @chromium-ubuntu-22.04-node20 @smoke
❌ [chromium-page] › page/page-screenshot.spec.ts:961:3 › capture changing image @chromium-ubuntu-22.04-node20
❌ [chromium-page] › page/expect-matcher-result.spec.ts:20:5 › toMatchText-based assertions should have matcher result @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-matcher-result.spec.ts:69:5 › toBeTruthy-based assertions should have matcher result @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-matcher-result.spec.ts:164:5 › toBeChecked({ checked: false }) should have expected: false @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-matcher-result.spec.ts:259:5 › toHaveScreenshot should populate matcherResult @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-to-have-text.spec.ts:34:7 › toHaveText with regex › fail @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-to-have-text.spec.ts:53:7 › toContainText with regex › fail @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-to-have-text.spec.ts:88:7 › toHaveText with text › fail @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-to-have-text.spec.ts:132:7 › toHaveText with text › fail with impossible timeout @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-to-have-text.spec.ts:149:7 › not.toHaveText › fail @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/expect-to-have-text.spec.ts:157:7 › not.toHaveText › should work when selector does not match @chromium-ubuntu-22.04-node22
❌ [chromium-page] › page/page-check.spec.ts:20:3 › should check the box @smoke @chromium-ubuntu-22.04-node22 @smoke
❌ [chromium-page] › page/page-screenshot.spec.ts:961:3 › capture changing image @chromium-ubuntu-22.04-node22
❌ [firefox-page] › page/expect-matcher-result.spec.ts:20:5 › toMatchText-based assertions should have matcher result @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-matcher-result.spec.ts:69:5 › toBeTruthy-based assertions should have matcher result @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-matcher-result.spec.ts:164:5 › toBeChecked({ checked: false }) should have expected: false @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-matcher-result.spec.ts:259:5 › toHaveScreenshot should populate matcherResult @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-to-have-text.spec.ts:34:7 › toHaveText with regex › fail @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-to-have-text.spec.ts:53:7 › toContainText with regex › fail @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-to-have-text.spec.ts:88:7 › toHaveText with text › fail @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-to-have-text.spec.ts:132:7 › toHaveText with text › fail with impossible timeout @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-to-have-text.spec.ts:149:7 › not.toHaveText › fail @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/expect-to-have-text.spec.ts:157:7 › not.toHaveText › should work when selector does not match @firefox-ubuntu-22.04-node18
❌ [firefox-page] › page/page-check.spec.ts:20:3 › should check the box @smoke @firefox-ubuntu-22.04-node18 @smoke
❌ [firefox-page] › page/page-screenshot.spec.ts:961:3 › capture changing image @firefox-ubuntu-22.04-node18
❌ [playwright-test] › expect.spec.ts:507:5 › should support toHaveURL with baseURL from webServer @macos-latest-node18-1
❌ [playwright-test] › expect.spec.ts:580:5 › should print expected/received before timeout @macos-latest-node18-1
❌ [playwright-test] › expect.spec.ts:599:5 › should print pending operations for toHaveText @macos-latest-node18-1
❌ [playwright-test] › expect.spec.ts:619:5 › should print expected/received on Ctrl+C @macos-latest-node18-1
❌ [playwright-test] › expect.spec.ts:934:5 › should respect timeout from configured expect when used outside of the test runner @macos-latest-node18-1
❌ [playwright-test] › reporter-blob.spec.ts:902:1 › onError in the report @macos-latest-node18-1
❌ [playwright-test] › test-step.spec.ts:426:5 › should nest steps based on zones @macos-latest-node18-1
❌ [playwright-test] › test-step.spec.ts:974:5 › web assertion inside expect.poll @macos-latest-node18-1
❌ [playwright-test] › reporter-html.spec.ts:459:5 › merged › should highlight error @macos-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › merged › should show failed and timed out steps and hooks @macos-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › merged › should show step snippets from non-root @macos-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › merged › should display top-level errors @macos-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:459:5 › created › should highlight error @macos-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › created › should show failed and timed out steps and hooks @macos-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › created › should show step snippets from non-root @macos-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › created › should display top-level errors @macos-latest-node18-2
❌ [chromium-page] › page/expect-matcher-result.spec.ts:20:5 › toMatchText-based assertions should have matcher result @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-matcher-result.spec.ts:69:5 › toBeTruthy-based assertions should have matcher result @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-matcher-result.spec.ts:164:5 › toBeChecked({ checked: false }) should have expected: false @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-matcher-result.spec.ts:259:5 › toHaveScreenshot should populate matcherResult @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-to-have-text.spec.ts:34:7 › toHaveText with regex › fail @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-to-have-text.spec.ts:53:7 › toContainText with regex › fail @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-to-have-text.spec.ts:88:7 › toHaveText with text › fail @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-to-have-text.spec.ts:132:7 › toHaveText with text › fail with impossible timeout @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-to-have-text.spec.ts:149:7 › not.toHaveText › fail @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/expect-to-have-text.spec.ts:157:7 › not.toHaveText › should work when selector does not match @ubuntu-20.04-chromium-tip-of-tree
❌ [chromium-page] › page/page-check.spec.ts:20:3 › should check the box @smoke @ubuntu-20.04-chromium-tip-of-tree @smoke
❌ [chromium-page] › page/page-screenshot.spec.ts:961:3 › capture changing image @ubuntu-20.04-chromium-tip-of-tree
❌ [playwright-test] › expect.spec.ts:507:5 › should support toHaveURL with baseURL from webServer @ubuntu-latest-node18-1
❌ [playwright-test] › expect.spec.ts:580:5 › should print expected/received before timeout @ubuntu-latest-node18-1
❌ [playwright-test] › expect.spec.ts:599:5 › should print pending operations for toHaveText @ubuntu-latest-node18-1
❌ [playwright-test] › expect.spec.ts:619:5 › should print expected/received on Ctrl+C @ubuntu-latest-node18-1
❌ [playwright-test] › expect.spec.ts:934:5 › should respect timeout from configured expect when used outside of the test runner @ubuntu-latest-node18-1
❌ [playwright-test] › reporter-blob.spec.ts:902:1 › onError in the report @ubuntu-latest-node18-1
❌ [playwright-test] › test-step.spec.ts:426:5 › should nest steps based on zones @ubuntu-latest-node18-1
❌ [playwright-test] › test-step.spec.ts:974:5 › web assertion inside expect.poll @ubuntu-latest-node18-1
❌ [playwright-test] › reporter-html.spec.ts:459:5 › merged › should highlight error @ubuntu-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › merged › should show failed and timed out steps and hooks @ubuntu-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › merged › should show step snippets from non-root @ubuntu-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › merged › should display top-level errors @ubuntu-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:459:5 › created › should highlight error @ubuntu-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › created › should show failed and timed out steps and hooks @ubuntu-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › created › should show step snippets from non-root @ubuntu-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › created › should display top-level errors @ubuntu-latest-node18-2
❌ [playwright-test] › expect.spec.ts:507:5 › should support toHaveURL with baseURL from webServer @ubuntu-latest-node20-1
❌ [playwright-test] › expect.spec.ts:580:5 › should print expected/received before timeout @ubuntu-latest-node20-1
❌ [playwright-test] › expect.spec.ts:599:5 › should print pending operations for toHaveText @ubuntu-latest-node20-1
❌ [playwright-test] › expect.spec.ts:619:5 › should print expected/received on Ctrl+C @ubuntu-latest-node20-1
❌ [playwright-test] › expect.spec.ts:934:5 › should respect timeout from configured expect when used outside of the test runner @ubuntu-latest-node20-1
❌ [playwright-test] › reporter-blob.spec.ts:902:1 › onError in the report @ubuntu-latest-node20-1
❌ [playwright-test] › test-step.spec.ts:426:5 › should nest steps based on zones @ubuntu-latest-node20-1
❌ [playwright-test] › test-step.spec.ts:974:5 › web assertion inside expect.poll @ubuntu-latest-node20-1
❌ [playwright-test] › reporter-html.spec.ts:459:5 › merged › should highlight error @ubuntu-latest-node20-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › merged › should show failed and timed out steps and hooks @ubuntu-latest-node20-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › merged › should show step snippets from non-root @ubuntu-latest-node20-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › merged › should display top-level errors @ubuntu-latest-node20-2
❌ [playwright-test] › reporter-html.spec.ts:459:5 › created › should highlight error @ubuntu-latest-node20-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › created › should show failed and timed out steps and hooks @ubuntu-latest-node20-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › created › should show step snippets from non-root @ubuntu-latest-node20-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › created › should display top-level errors @ubuntu-latest-node20-2
❌ [playwright-test] › expect.spec.ts:507:5 › should support toHaveURL with baseURL from webServer @ubuntu-latest-node22-1
❌ [playwright-test] › expect.spec.ts:580:5 › should print expected/received before timeout @ubuntu-latest-node22-1
❌ [playwright-test] › expect.spec.ts:599:5 › should print pending operations for toHaveText @ubuntu-latest-node22-1
❌ [playwright-test] › expect.spec.ts:619:5 › should print expected/received on Ctrl+C @ubuntu-latest-node22-1
❌ [playwright-test] › expect.spec.ts:934:5 › should respect timeout from configured expect when used outside of the test runner @ubuntu-latest-node22-1
❌ [playwright-test] › reporter-blob.spec.ts:902:1 › onError in the report @ubuntu-latest-node22-1
❌ [playwright-test] › test-step.spec.ts:426:5 › should nest steps based on zones @ubuntu-latest-node22-1
❌ [playwright-test] › test-step.spec.ts:974:5 › web assertion inside expect.poll @ubuntu-latest-node22-1
❌ [playwright-test] › reporter-html.spec.ts:459:5 › merged › should highlight error @ubuntu-latest-node22-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › merged › should show failed and timed out steps and hooks @ubuntu-latest-node22-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › merged › should show step snippets from non-root @ubuntu-latest-node22-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › merged › should display top-level errors @ubuntu-latest-node22-2
❌ [playwright-test] › reporter-html.spec.ts:459:5 › created › should highlight error @ubuntu-latest-node22-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › created › should show failed and timed out steps and hooks @ubuntu-latest-node22-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › created › should show step snippets from non-root @ubuntu-latest-node22-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › created › should display top-level errors @ubuntu-latest-node22-2
❌ [webkit-page] › page/expect-matcher-result.spec.ts:20:5 › toMatchText-based assertions should have matcher result @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-matcher-result.spec.ts:69:5 › toBeTruthy-based assertions should have matcher result @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-matcher-result.spec.ts:164:5 › toBeChecked({ checked: false }) should have expected: false @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-matcher-result.spec.ts:259:5 › toHaveScreenshot should populate matcherResult @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-to-have-text.spec.ts:34:7 › toHaveText with regex › fail @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-to-have-text.spec.ts:53:7 › toContainText with regex › fail @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-to-have-text.spec.ts:88:7 › toHaveText with text › fail @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-to-have-text.spec.ts:132:7 › toHaveText with text › fail with impossible timeout @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-to-have-text.spec.ts:149:7 › not.toHaveText › fail @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/expect-to-have-text.spec.ts:157:7 › not.toHaveText › should work when selector does not match @webkit-ubuntu-22.04-node18
❌ [webkit-page] › page/page-check.spec.ts:20:3 › should check the box @smoke @webkit-ubuntu-22.04-node18 @smoke
❌ [webkit-page] › page/page-screenshot.spec.ts:961:3 › capture changing image @webkit-ubuntu-22.04-node18
❌ [playwright-test] › expect.spec.ts:507:5 › should support toHaveURL with baseURL from webServer @windows-latest-node18-1
❌ [playwright-test] › expect.spec.ts:580:5 › should print expected/received before timeout @windows-latest-node18-1
❌ [playwright-test] › expect.spec.ts:599:5 › should print pending operations for toHaveText @windows-latest-node18-1
❌ [playwright-test] › expect.spec.ts:934:5 › should respect timeout from configured expect when used outside of the test runner @windows-latest-node18-1
❌ [playwright-test] › reporter-blob.spec.ts:902:1 › onError in the report @windows-latest-node18-1
❌ [playwright-test] › test-step.spec.ts:426:5 › should nest steps based on zones @windows-latest-node18-1
❌ [playwright-test] › test-step.spec.ts:974:5 › web assertion inside expect.poll @windows-latest-node18-1
❌ [playwright-test] › reporter-html.spec.ts:459:5 › merged › should highlight error @windows-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › merged › should show failed and timed out steps and hooks @windows-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › merged › should show step snippets from non-root @windows-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › merged › should display top-level errors @windows-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:459:5 › created › should highlight error @windows-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:659:5 › created › should show failed and timed out steps and hooks @windows-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:730:5 › created › should show step snippets from non-root @windows-latest-node18-2
❌ [playwright-test] › reporter-html.spec.ts:2460:5 › created › should display top-level errors @windows-latest-node18-2

4 flaky ⚠️ [firefox-page] › page/workers.spec.ts:106:3 › should clear upon navigation @firefox-ubuntu-22.04-node18
⚠️ [webkit-library] › library/browsercontext-viewport-mobile.spec.ts:157:5 › mobile viewport › mouse should work with mobile viewports and cross process navigations @webkit-ubuntu-22.04-node18
⚠️ [webkit-library] › library/screenshot.spec.ts:204:14 › element screenshot › element screenshot should work with a mobile viewport @webkit-ubuntu-22.04-node18
⚠️ [playwright-test] › ui-mode-test-watch.spec.ts:145:5 › should watch all @windows-latest-node18-1

36250 passed, 639 skipped
✔️✔️✔️

Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant