Skip to content

Regression Tests

Regression Tests #677

Triggered via schedule November 26, 2024 06:03
Status Success
Total duration 17m 7s
Artifacts

regression-tests.yml

on: schedule
Fit to window
Zoom out
Zoom in

Annotations

8 errors, 16 warnings, and 1 notice
[chromium] › create-flow.spec.ts:46:7 › Flow creation: e2e/tests/ui-driven/src/create-flow.spec.ts#L1
1) [chromium] › create-flow.spec.ts:46:7 › Flow creation, publish and preview › Create a flow ──── Test timeout of 45000ms exceeded.
[chromium] › create-flow.spec.ts:46:7 › Flow creation: e2e/tests/ui-driven/src/helpers/addComponent.ts#L11
1) [chromium] › create-flow.spec.ts:46:7 › Flow creation, publish and preview › Create a flow ──── Error: locator.click: Test ended. Call log: - waiting for locator('.hanger > a').last() - locator resolved to <a class=" " href="/E2E/a-test-service/nodes/_root/nodes/new"></a> - attempting click action 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <h4 class="MuiTypography-root MuiTypography-subtitle1 css-24cwob">Options</h4> from <div role="presentation" class="MuiDialog-root MuiModal-root css-qnzqcu">…</div> subtree intercepts pointer events - retrying click action - waiting 20ms 2 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <h4 class="MuiTypography-root MuiTypography-subtitle1 css-24cwob">Options</h4> from <div role="presentation" class="MuiDialog-root MuiModal-root css-qnzqcu">…</div> subtree intercepts pointer events - retrying click action - waiting 100ms 75 × waiting for element to be visible, enabled and stable - element is visible, enabled and stable - scrolling into view if needed - done scrolling - <h4 class="MuiTypography-root MuiTypography-subtitle1 css-24cwob">Options</h4> from <div role="presentation" class="MuiDialog-root MuiModal-root css-qnzqcu">…</div> subtree intercepts pointer events - retrying click action - waiting 500ms at helpers/addComponent.ts:11 9 | options?: string[], 10 | ) => { > 11 | await locatingNode.click(); | ^ 12 | await page.getByRole("dialog").waitFor(); 13 | await page.locator("select").selectOption({ value: type.toString() }); 14 | at createBaseComponent (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/addComponent.ts:11:22) at createTextInput (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/addComponent.ts:176:9) at PlaywrightEditor.createTextInput (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pages/Editor.ts:107:26) at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/create-flow.spec.ts:64:18
[chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L1
2) [chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request Test timeout of 45000ms exceeded.
[chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L73
2) [chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for getByRole('button', { name: 'Confirm payment' }) 71 | cardNumber: cards.successful_card_number, 72 | }); > 73 | await page.getByRole("button", { name: "Confirm payment" }).click(); | ^ 74 | await page.waitForURL("**/invite-to-pay-test/**"); 75 | 76 | await expect(page.getByText("Payment received")).toBeVisible(); at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts:73:65
[chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
3) [chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L91
3) [chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#return-url') 89 | await page.getByText(payButtonText).click(); 90 | await fillGovUkCardDetails({ page, cardNumber: cards.invalid_card_number }); > 91 | await page.locator("#return-url").click(); | ^ 92 | 93 | const { paymentId: failedPaymentRef } = await waitForPaymentResponse( 94 | page, at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:91:39
[chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment: e2e/tests/ui-driven/src/pay.spec.ts#L1
4) [chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment Test timeout of 45000ms exceeded.
[chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment: e2e/tests/ui-driven/src/helpers/userActions.ts#L194
4) [chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment Error: locator.click: Test timeout of 45000ms exceeded. Call log: - waiting for locator('#confirm') at helpers/userActions.ts:194 192 | 193 | export async function submitCardDetails(page: Page) { > 194 | await page.locator("#confirm").click(); | ^ 195 | } 196 | 197 | export async function answerFindProperty(page: Page) { at submitCardDetails (/home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/helpers/userActions.ts:194:34) at /home/runner/work/planx-new/planx-new/e2e/tests/ui-driven/src/pay.spec.ts:228:28
Run API Tests: api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/flows/validate/service/fileTypes.ts#L70
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/classifiedRoads.ts#L151
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L100
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L101
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L135
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L183
Unexpected any. Specify a different type
Run API Tests: api.planx.uk/modules/gis/service/digitalLand.ts#L240
Unexpected any. Specify a different type
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L97
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L88
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L97
Unexpected use of networkidle
E2E tests: e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L132
Unexpected use of networkidle
Slow Test: e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts#L1
e2e/tests/ui-driven/[chromium] › invite-to-pay/agent.spec.ts took 1.2m
Slow Test: e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow-with-geospatial.spec.ts took 19.4s
🎭 Playwright Run Summary
4 flaky [chromium] › create-flow.spec.ts:46:7 › Flow creation, publish and preview › Create a flow ───── [chromium] › invite-to-pay/nominee.spec.ts:47:7 › Nominee journey @regression › responding to a valid payment request [chromium] › pay.spec.ts:85:7 › Gov Pay integration @regression › a retry attempt for a failed GOV.UK payment [chromium] › pay.spec.ts:195:7 › Gov Pay integration @regression › a retry attempt for an abandoned GOV.UK payment 36 passed (6.9m)