Regression Tests #475
regression-tests.yml
on: workflow_dispatch
Run Integration tests
5m 4s
Run API Tests
1m 58s
Run React Tests
5m 39s
E2E tests
17m 27s
Notify On Failure
0s
Annotations
10 errors, 20 warnings, and 1 notice
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L92
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#return-url')
90 | await page.getByText(payButtonText).click();
91 | await fillGovUkCardDetails({ page, cardNumber: cards.invalid_card_number });
> 92 | await page.locator("#return-url").click();
| ^
93 |
94 | const { paymentId: failedPaymentRef } = await waitForPaymentResponse(
95 | page,
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:92:39
|
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L92
1) [chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#return-url')
90 | await page.getByText(payButtonText).click();
91 | await fillGovUkCardDetails({ page, cardNumber: cards.invalid_card_number });
> 92 | await page.locator("#return-url").click();
| ^
93 |
94 | const { paymentId: failedPaymentRef } = await waitForPaymentResponse(
95 | page,
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:92:39
|
[chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
2) [chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment:
e2e/tests/ui-driven/src/globalHelpers.ts#L261
2) [chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at globalHelpers.ts:261
259 |
260 | export async function submitCardDetails(page: Page) {
> 261 | await page.locator("#confirm").click();
| ^
262 | }
263 |
264 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:172:28
|
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment:
e2e/tests/ui-driven/src/globalHelpers.ts#L261
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at globalHelpers.ts:261
259 |
260 | export async function submitCardDetails(page: Page) {
> 261 | await page.locator("#confirm").click();
| ^
262 | }
263 |
264 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:308:28
|
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment:
e2e/tests/ui-driven/src/globalHelpers.ts#L261
3) [chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at globalHelpers.ts:261
259 |
260 | export async function submitCardDetails(page: Page) {
> 261 | await page.locator("#confirm").click();
| ^
262 | }
263 |
264 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/globalHelpers.ts:261:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:308:28
|
Run API Tests
The following actions uses Node.js version which is deprecated and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run API Tests:
api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/flows/validate/service/fileTypes.ts#L73
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.test.ts#L20
Disabled test suite
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L150
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L80
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L81
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L115
Unexpected any. Specify a different type
|
Run Integration tests
The following actions uses Node.js version which is deprecated and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run React Tests
The following actions uses Node.js version which is deprecated and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L93
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L87
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L96
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L131
Unexpected use of networkidle
|
Slow Test:
e2e/tests/ui-driven/[chromium] › pay.spec.ts#L1
e2e/tests/ui-driven/[chromium] › pay.spec.ts took 4.7m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 1.2m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts took 17.9s
|
🎭 Playwright Run Summary
3 flaky
[chromium] › pay.spec.ts:86:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
[chromium] › pay.spec.ts:145:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment
[chromium] › pay.spec.ts:297:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
35 passed (7.4m)
|