Regression Tests #343
DafyddLlyrregression-tests.yml
on: workflow_dispatch
Run Integration tests
5m 21s
Run API Tests
1m 57s
Run React Tests
5m 1s
E2E tests
42m 10s
Notify On Failure
0s
Annotations
11 errors, 22 warnings, and 1 notice
|
Run Integration tests
Process completed with exit code 1.
|
|
[chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
1) [chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request
Test timeout of 45000ms exceeded.
|
|
[chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L65
1) [chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request
Error: expect(locator).toBeHidden()
Locator: getByText('Error generating payment request, please try again')
Expected: hidden
Received: visible
Call log:
- expect.toBeHidden with timeout 45000ms
- waiting for getByText('Error generating payment request, please try again')
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
|
|
[chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
1) [chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
|
[chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L65
1) [chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeHidden()
Locator: getByText('Error generating payment request, please try again')
Expected: hidden
Received: visible
Call log:
- expect.toBeHidden with timeout 45000ms
- waiting for getByText('Error generating payment request, please try again')
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-
|
|
[chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
1) [chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
|
[chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L65
1) [chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(locator).toBeHidden()
Locator: getByText('Error generating payment request, please try again')
Expected: hidden
Received: visible
Call log:
- expect.toBeHidden with timeout 45000ms
- waiting for getByText('Error generating payment request, please try again')
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-body1 cs…>Error generating payment request, please try again</p>
- unexpected value "visible"
- locator resolved to <p class="MuiTypography-root MuiTypography-
|
|
[chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
2) [chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Test timeout of 45000ms exceeded.
|
|
[chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L88
2) [chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByText('Cancel payment')
86 |
87 | await page.getByText("Pay now using GOV.UK Pay").click();
> 88 | await page.getByText("Cancel payment").click();
| ^
89 | await page.getByText("Continue").click();
90 | await page.getByLabel("email").fill(context.user.email);
91 | await page.getByText("Continue").click();
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts:88:44
|
|
[chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
2) [chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
|
[chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L88
2) [chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByText('Cancel payment')
86 |
87 | await page.getByText("Pay now using GOV.UK Pay").click();
> 88 | await page.getByText("Cancel payment").click();
| ^
89 | await page.getByText("Continue").click();
90 | await page.getByLabel("email").fill(context.user.email);
91 | await page.getByText("Continue").click();
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts:88:44
|
|
Run API Tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: andstor/file-existence-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
|
Run API Tests:
api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
|
|
|
|
Run API Tests:
api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.test.ts#L20
Disabled test suite
|
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L150
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L77
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L78
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L112
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L160
Unexpected any. Specify a different type
|
|
Run React Tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: andstor/file-existence-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
|
Run Integration tests
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: andstor/file-existence-action@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
|
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L92
Unexpected use of networkidle
|
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L86
Unexpected use of networkidle
|
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L95
Unexpected use of networkidle
|
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L130
Unexpected use of networkidle
|
|
Slow Test:
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 13.5m
|
|
Slow Test:
e2e/tests/ui-driven/[chromium] › pay.spec.ts#L1
e2e/tests/ui-driven/[chromium] › pay.spec.ts took 13.5m
|
|
Slow Test:
e2e/tests/ui-driven/[chromium] › invite-to-pay/nominee.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/nominee.spec.ts took 2.3m
|
|
Slow Test:
e2e/tests/ui-driven/[chromium] › sections.spec.ts#L1
e2e/tests/ui-driven/[chromium] › sections.spec.ts took 16.1s
|
|
Slow Test:
e2e/tests/ui-driven/[chromium] › save-and-return.spec.ts#L1
e2e/tests/ui-driven/[chromium] › save-and-return.spec.ts took 15.0s
|
|
🎭 Playwright Run Summary
15 failed
[chromium] › invite-to-pay/agent.spec.ts:44:7 › Agent journey @regression › agent can send a payment request
[chromium] › invite-to-pay/agent.spec.ts:78:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
[chromium] › invite-to-pay/agent.spec.ts:97:7 › Agent journey @regression › agent cannot make changes after sending a payment request - session is locked
[chromium] › invite-to-pay/agent.spec.ts:124:7 › Agent journey @regression › reconciliation does not apply to sessions with open payment requests
[chromium] › invite-to-pay/agent.spec.ts:161:7 › Agent journey @regression › agent cannot make payment after sending a payment request in another tab
[chromium] › invite-to-pay/agent.spec.ts:193:7 › Agent journey @regression › agent cannot generate payment request after starting payment in another tab
[chromium] › invite-to-pay/nominee.spec.ts:45:7 › Nominee journey @regression › responding to a valid payment request
[chromium] › invite-to-pay/nominee.spec.ts:100:7 › Nominee journey @regression › responding to a payment request which has been paid
[chromium] › invite-to-pay/nominee.spec.ts:111:7 › Nominee journey @regression › responding to a payment request which has expired
[chromium] › pay.spec.ts:51:7 › Gov Pay integration @regression › a successful payment ─────────
[chromium] › pay.spec.ts:84:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
[chromium] › pay.spec.ts:143:7 › Gov Pay integration @regression › a retry attempt for a cancelled GOV.UK payment
[chromium] › pay.spec.ts:194:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment
[chromium] › pay.spec.ts:252:7 › Gov Pay integration @regression › a retry attempt for an abandoned and then cancelled GOV.UK payment
[chromium] › pay.spec.ts:295:7 › Gov Pay integration @regression › navigating back to the pay component after a successful payment
21 passed (32.4m)
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
playwright-report
Expired
|
126 MB |
|