Regression Tests #444
regression-tests.yml
on: schedule
Run Integration tests
5m 31s
Run API Tests
2m 51s
Run React Tests
5m 27s
E2E tests
17m 6s
Notify On Failure
0s
Annotations
8 errors, 21 warnings, and 1 notice
[chromium] › invite-to-pay/nominee.spec.ts:46:7 › Nominee journey @regression › responding to a valid payment request:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L1
1) [chromium] › invite-to-pay/nominee.spec.ts:46:7 › Nominee journey @regression › responding to a valid payment request
Test timeout of 45000ms exceeded.
|
[chromium] › invite-to-pay/nominee.spec.ts:46:7 › Nominee journey @regression › responding to a valid payment request:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L72
1) [chromium] › invite-to-pay/nominee.spec.ts:46:7 › Nominee journey @regression › responding to a valid payment request
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByRole('button', { name: 'Confirm payment' })
70 | cardNumber: cards.successful_card_number,
71 | });
> 72 | await page.getByRole("button", { name: "Confirm payment" }).click();
| ^
73 | await page.waitForURL("**/invite-to-pay-test/**");
74 |
75 | await expect(page.getByText("Payment received")).toBeVisible();
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts:72:65
|
[chromium] › pay.spec.ts:53:7 › Gov Pay integration @regression › a successful payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
2) [chromium] › pay.spec.ts:53:7 › Gov Pay integration @regression › a successful payment ────────
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:53:7 › Gov Pay integration @regression › a successful payment:
e2e/tests/ui-driven/src/globalHelpers.ts#L261
2) [chromium] › pay.spec.ts:53:7 › Gov Pay integration @regression › a successful payment ────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at globalHelpers.ts:261
259 |
260 | export async function submitCardDetails(page: Page) {
> 261 | await page.locator("#confirm").click();
| ^
262 | }
263 |
264 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:62:28
|
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L92
3) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#return-url')
90 | await page.getByText(payButtonText).click();
91 | await fillGovUkCardDetails({ page, cardNumber: cards.invalid_card_number });
> 92 | await page.locator("#return-url").click();
| ^
93 |
94 | const { paymentId: failedPaymentRef } = await waitForPaymentResponse(
95 | page,
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:92:39
|
[chromium] › pay.spec.ts:196:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
4) [chromium] › pay.spec.ts:196:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:196:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment:
e2e/tests/ui-driven/src/globalHelpers.ts#L261
4) [chromium] › pay.spec.ts:196:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at globalHelpers.ts:261
259 |
260 | export async function submitCardDetails(page: Page) {
> 261 | await page.locator("#confirm").click();
| ^
262 | }
263 |
264 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:229:28
|
Run API Tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: andstor/file-existence-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Run API Tests:
api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.test.ts#L20
Disabled test suite
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L150
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L80
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L81
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L115
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L163
Unexpected any. Specify a different type
|
Run React Tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: andstor/file-existence-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
Run Integration tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: andstor/file-existence-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L93
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L87
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L96
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L131
Unexpected use of networkidle
|
Slow Test:
e2e/tests/ui-driven/[chromium] › pay.spec.ts#L1
e2e/tests/ui-driven/[chromium] › pay.spec.ts took 3.3m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 1.2m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › invite-to-pay/nominee.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/nominee.spec.ts took 1.0m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts took 18.1s
|
🎭 Playwright Run Summary
4 flaky
[chromium] › invite-to-pay/nominee.spec.ts:46:7 › Nominee journey @regression › responding to a valid payment request
[chromium] › pay.spec.ts:53:7 › Gov Pay integration @regression › a successful payment ─────────
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
[chromium] › pay.spec.ts:196:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment
34 passed (6.7m)
|