Skip to content

Regression Tests

Regression Tests #475

Manually triggered July 9, 2024 08:19
Status Success
Total duration 17m 38s
Artifacts

regression-tests.yml

on: workflow_dispatch
Fit to window
Zoom out
Zoom in

Annotations

10 errors, 20 warnings, and 1 notice
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L92
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#return-url') 90 | await page.getByText(payButtonText).click(); 91 | await fillGovUkCardDetails({ page, cardNumber: cards.invalid_card_number }); > 92 | await page.locator("#return-url").click(); | ^ 93 | 94 | const { paymentId: failedPaymentRef } = await waitForPaymentResponse( 95 | page, at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:92:39
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L92
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#return-url') 90 | await page.getByText(payButtonText).click(); 91 | await fillGovUkCardDetails({ page, cardNumber: cards.invalid_card_number }); > 92 | await page.locator("#return-url").click(); | ^ 93 | 94 | const { paymentId: failedPaymentRef } = await waitForPaymentResponse( 95 | page, at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:92:39
[chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
2) [chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment: e2e/tests/ui-driven/src/globalHelpers.ts#L261
2) [chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#confirm') at globalHelpers.ts:261 259 | 260 | export async function submitCardDetails(page: Page) { > 261 | await page.locator("#confirm").click(); | ^ 262 | } 263 | 264 | export async function answerFindProperty(page: Page) { at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34) at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:172:28
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment: e2e/tests/ui-driven/src/globalHelpers.ts#L261
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#confirm') at globalHelpers.ts:261 259 | 260 | export async function submitCardDetails(page: Page) { > 261 | await page.locator("#confirm").click(); | ^ 262 | } 263 | 264 | export async function answerFindProperty(page: Page) { at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34) at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:308:28
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment: e2e/tests/ui-driven/src/globalHelpers.ts#L261
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#confirm') at globalHelpers.ts:261 259 | 260 | export async function submitCardDetails(page: Page) { > 261 | await page.locator("#confirm").click(); | ^ 262 | } 263 | 264 | export async function answerFindProperty(page: Page) { at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34) at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:308:28
Run API Tests
The following actions uses Node.js version which is deprecated and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run API Tests: api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/flows/validate/service/fileTypes.ts#L73
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/classifiedRoads.ts#L150
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L80
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L81
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L115
Unexpected any. Specify a different type
Run Integration tests
The following actions uses Node.js version which is deprecated and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
Run React Tests
The following actions uses Node.js version which is deprecated and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L93
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L87
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L96
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L131
Unexpected use of networkidle
Slow Test: e2e/tests/ui-driven/[chromium] › pay.spec.ts#L1
e2e/tests/ui-driven/[chromium] › pay.spec.ts took 4.7m
Slow Test: e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 1.2m
Slow Test: e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts took 17.9s
🎭 Playwright Run Summary
3 flaky [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment [chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment 35 passed (7.4m)