Regression Tests #677
regression-tests.yml
on: schedule
Run Integration tests
5m 13s
Run API Tests
1m 57s
Run React Tests
6m 30s
E2E tests
16m 56s
Notify On Failure
0s
Annotations
8 errors, 16 warnings, and 1 notice
[chromium] › create-flow.spec.ts:46:7 › Flow creation:
e2e/tests/ui-driven/src/create-flow.spec.ts#L1
1) [chromium] › create-flow.spec.ts:46:7 › Flow creation, publish and preview › Create a flow ────
Test timeout of 45000ms exceeded.
|
[chromium] › create-flow.spec.ts:46:7 › Flow creation:
e2e/tests/ui-driven/src/helpers/addComponent.ts#L11
1) [chromium] › create-flow.spec.ts:46:7 › Flow creation, publish and preview › Create a flow ────
Error: locator.click: Test ended.
Call log:
- waiting for locator('.hanger > a').last()
- locator resolved to <a class=" " href="/E2E/a-test-service/nodes/_root/nodes/new"></a>
- attempting click action
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <h4 class="MuiTypography-root MuiTypography-subtitle1 css-24cwob">Options</h4> from <div role="presentation" class="MuiDialog-root MuiModal-root css-qnzqcu">…</div> subtree intercepts pointer events
- retrying click action
- waiting 20ms
2 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <h4 class="MuiTypography-root MuiTypography-subtitle1 css-24cwob">Options</h4> from <div role="presentation" class="MuiDialog-root MuiModal-root css-qnzqcu">…</div> subtree intercepts pointer events
- retrying click action
- waiting 100ms
75 × waiting for element to be visible, enabled and stable
- element is visible, enabled and stable
- scrolling into view if needed
- done scrolling
- <h4 class="MuiTypography-root MuiTypography-subtitle1 css-24cwob">Options</h4> from <div role="presentation" class="MuiDialog-root MuiModal-root css-qnzqcu">…</div> subtree intercepts pointer events
- retrying click action
- waiting 500ms
at helpers/addComponent.ts:11
9 | options?: string[],
10 | ) => {
> 11 | await locatingNode.click();
| ^
12 | await page.getByRole("dialog").waitFor();
13 | await page.locator("select").selectOption({ value: type.toString() });
14 |
at createBaseComponent (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/addComponent.ts:11:22)
at createTextInput (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/addComponent.ts:176:9)
at PlaywrightEditor.createTextInput (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pages/Editor.ts:107:26)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/create-flow.spec.ts:64:18
|
[chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L1
2) [chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request
Test timeout of 45000ms exceeded.
|
[chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L73
2) [chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByRole('button', { name: 'Confirm payment' })
71 | cardNumber: cards.successful_card_number,
72 | });
> 73 | await page.getByRole("button", { name: "Confirm payment" }).click();
| ^
74 | await page.waitForURL("**/invite-to-pay-test/**");
75 |
76 | await expect(page.getByText("Payment received")).toBeVisible();
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts:73:65
|
[chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L91
3) [chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#return-url')
89 | await page.getByText(payButtonText).click();
90 | await fillGovUkCardDetails({ page, cardNumber: cards.invalid_card_number });
> 91 | await page.locator("#return-url").click();
| ^
92 |
93 | const { paymentId: failedPaymentRef } = await waitForPaymentResponse(
94 | page,
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:91:39
|
[chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment:
e2e/tests/ui-driven/src/pay.spec.ts#L1
4) [chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment
Test timeout of 45000ms exceeded.
|
[chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment:
e2e/tests/ui-driven/src/helpers/userActions.ts#L194
4) [chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for locator('#confirm')
at helpers/userActions.ts:194
192 |
193 | export async function submitCardDetails(page: Page) {
> 194 | await page.locator("#confirm").click();
| ^
195 | }
196 |
197 | export async function answerFindProperty(page: Page) {
at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/userActions.ts:194:34)
at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:228:28
|
Run API Tests:
api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/flows/validate/service/fileTypes.ts#L70
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L151
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L100
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L101
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L135
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L183
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L240
Unexpected any. Specify a different type
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L97
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L88
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L97
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L132
Unexpected use of networkidle
|
Slow Test:
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 1.2m
|
Slow Test:
e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts took 19.4s
|
🎭 Playwright Run Summary
4 flaky
[chromium] › create-flow.spec.ts:46:7 › Flow creation, publish and preview › Create a flow ─────
[chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request
[chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment
[chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment
36 passed (6.9m)
|