Skip to content

test: improve stability of refresh test #4582

test: improve stability of refresh test

test: improve stability of refresh test #4582

Triggered via pull request August 13, 2024 12:43
Status Cancelled
Total duration 35m 46s
Artifacts

ci.yaml

on: pull_request
Run tests and lints
24m 34s
Run tests and lints
Matrix: Run end-to-end tests
Matrix: Run Playwright end-to-end tests
Generate changelog
0s
Generate changelog
Generate release
0s
Generate release
Draft newsletter
0s
Draft newsletter
Render version schema
0s
Render version schema
Release SDKs
0s
Release SDKs
Pending approval Slack notification
0s
Pending approval Slack notification
Send newsletter
0s
Send newsletter
Fit to window
Zoom out
Zoom in

Annotations

16 errors, 23 warnings, and 4 notices
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts#L1
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Test timeout of 30000ms exceeded.
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/models/elements/login.ts#L148
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Error: page.waitForURL: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for navigation until "load" ============================================================ at ../models/elements/login.ts:148 146 | const waitFor = [ 147 | opts?.waitForURL > 148 | ? this.page.waitForURL(opts.waitForURL) | ^ 149 | : Promise.resolve(), 150 | ] 151 | if (opts?.submitWithKeyboard) { at LoginPage.submit (/home/runner/work/kratos/kratos/test/e2e/playwright/models/elements/login.ts:148:21) at /home/runner/work/kratos/kratos/test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts:104:17
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts#L1
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Test timeout of 30000ms exceeded.
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/models/elements/login.ts#L148
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Error: page.waitForURL: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for navigation until "load" ============================================================ at ../models/elements/login.ts:148 146 | const waitFor = [ 147 | opts?.waitForURL > 148 | ? this.page.waitForURL(opts.waitForURL) | ^ 149 | : Promise.resolve(), 150 | ] 151 | if (opts?.submitWithKeyboard) { at LoginPage.submit (/home/runner/work/kratos/kratos/test/e2e/playwright/models/elements/login.ts:148:21) at /home/runner/work/kratos/kratos/test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts:104:17
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts#L1
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Test timeout of 30000ms exceeded.
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/models/elements/login.ts#L148
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Error: page.waitForURL: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for navigation until "load" ============================================================ at ../models/elements/login.ts:148 146 | const waitFor = [ 147 | opts?.waitForURL > 148 | ? this.page.waitForURL(opts.waitForURL) | ^ 149 | : Promise.resolve(), 150 | ] 151 | if (opts?.submitWithKeyboard) { at LoginPage.submit (/home/runner/work/kratos/kratos/test/e2e/playwright/models/elements/login.ts:148:21) at /home/runner/work/kratos/kratos/test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts:104:17
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts#L1
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Test timeout of 30000ms exceeded.
[chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh: test/e2e/playwright/models/elements/login.ts#L148
1) [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh Error: page.waitForURL: Test timeout of 30000ms exceeded. =========================== logs =========================== waiting for navigation until "load" ============================================================ at ../models/elements/login.ts:148 146 | const waitFor = [ 147 | opts?.waitForURL > 148 | ? this.page.waitForURL(opts.waitForURL) | ^ 149 | : Promise.resolve(), 150 | ] 151 | if (opts?.submitWithKeyboard) { at LoginPage.submit (/home/runner/work/kratos/kratos/test/e2e/playwright/models/elements/login.ts:148:21) at /home/runner/work/kratos/kratos/test/e2e/playwright/tests/desktop/identifier_first/password.login.spec.ts:104:17
Run end-to-end tests (postgres)
Canceling since a higher priority waiting request for 'CI-refs/pull/4037/merge' exists
Run end-to-end tests (mysql)
Canceling since a higher priority waiting request for 'CI-refs/pull/4037/merge' exists
Run end-to-end tests (postgres)
The operation was canceled.
Run end-to-end tests (mysql)
The operation was canceled.
Run end-to-end tests (cockroach)
Canceling since a higher priority waiting request for 'CI-refs/pull/4037/merge' exists
Run end-to-end tests (cockroach)
The operation was canceled.
Run end-to-end tests (sqlite)
Canceling since a higher priority waiting request for 'CI-refs/pull/4037/merge' exists
Run end-to-end tests (sqlite)
The operation was canceled.
Generate SDKs
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Generate SDKs
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-go@v2, actions/cache@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Generate SDKs
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2, actions/setup-go@v2, actions/cache@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run Playwright end-to-end tests (sqlite)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Run Playwright end-to-end tests (sqlite)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/checkout@v2, actions/setup-go@v4, actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Slow Test: test/e2e/[mobile-chrome] › mobile/app_login.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_login.spec.ts took 27.9s
Slow Test: test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts took 24.1s
Run Playwright end-to-end tests (postgres)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Run Playwright end-to-end tests (postgres)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/checkout@v2, actions/setup-go@v4, actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Slow Test: test/e2e/[mobile-chrome] › mobile/app_login.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_login.spec.ts took 31.4s
Slow Test: test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts took 23.5s
Run Playwright end-to-end tests (cockroach)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Run Playwright end-to-end tests (cockroach)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/checkout@v2, actions/setup-go@v4, actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Slow Test: test/e2e/[mobile-chrome] › mobile/app_login.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_login.spec.ts took 29.6s
Slow Test: test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts took 26.1s
Run Playwright end-to-end tests (mysql)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Run Playwright end-to-end tests (mysql)
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/setup-node@v3, actions/checkout@v2, actions/setup-go@v4, actions/checkout@v3. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Slow Test: test/e2e/[mobile-chrome] › mobile/app_login.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_login.spec.ts took 27.6s
Slow Test: test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts#L1
test/e2e/[mobile-chrome] › mobile/app_recovery.spec.ts took 24.7s
Run tests and lints
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Run tests and lints
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2, actions/setup-go@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Build CLI docs
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2, actions/setup-go@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/
Build CLI docs
The following actions use a deprecated Node.js version and will be forced to run on node20: actions/checkout@v2, actions/setup-go@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
🎭 Playwright Run Summary
1 flaky [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh 34 passed (2.3m)
🎭 Playwright Run Summary
1 flaky [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh 34 passed (2.4m)
🎭 Playwright Run Summary
1 flaky [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh 34 passed (3.0m)
🎭 Playwright Run Summary
1 flaky [chromium] › desktop/identifier_first/password.login.spec.ts:75:7 › account enumeration protection off › login with refresh 34 passed (2.4m)