Regression Tests #555
regression-tests.yml
on: workflow_dispatch
Run Integration tests
5m 31s
Run API Tests
2m 20s
Run React Tests
6m 17s
E2E tests
43m 12s
Notify On Failure
0s
Annotations
10 errors, 19 warnings, and 1 notice
[chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
1) [chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request
Test timeout of 45000ms exceeded.
|
[chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/helpers.ts#L34
1) [chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByText('Continue')
- locator resolved to <button disabled tabindex="-1" type="submit" data-testid="continue-button" class="MuiButtonBase-root MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation Mui-disabled MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation css-oqhspv">Continue</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #21
|
[chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
1) [chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
[chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/helpers.ts#L34
1) [chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByText('Continue')
- locator resolved to <button disabled tabindex="-1" type="submit" data-testid="continue-button" class="MuiButtonBase-root MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation Mui-disabled MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation css-oqhspv">Continue</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be v
|
[chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
1) [chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
[chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request:
e2e/tests/ui-driven/src/invite-to-pay/helpers.ts#L34
1) [chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByText('Continue')
- locator resolved to <button disabled tabindex="-1" type="submit" data-testid="continue-button" class="MuiButtonBase-root MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation Mui-disabled MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation css-oqhspv">Continue</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be v
|
[chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
2) [chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Test timeout of 45000ms exceeded.
|
[chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/helpers.ts#L34
2) [chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByText('Continue')
- locator resolved to <button disabled tabindex="-1" type="submit" data-testid="continue-button" class="MuiButtonBase-root MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation Mui-disabled MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation css-oqhspv">Continue</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
|
[chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L1
2) [chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 45000ms exceeded.
|
[chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment:
e2e/tests/ui-driven/src/invite-to-pay/helpers.ts#L34
2) [chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 45000ms exceeded.
Call log:
- waiting for getByText('Continue')
- locator resolved to <button disabled tabindex="-1" type="submit" data-testid="continue-button" class="MuiButtonBase-root MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation Mui-disabled MuiButton-root MuiButton-contained MuiButton-containedPrompt MuiButton-sizeLarge MuiButton-containedSizeLarge MuiButton-disableElevation css-oqhspv">Continue</button>
- attempting click action
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #1
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and stable
- element is not enabled
- retrying click action, attempt #20
- waiting 500m
|
Run Integration tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run React Tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run API Tests
The following actions use a deprecated Node.js version and will be forced to run on node20: andstor/file-existence-action@v2. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Run API Tests:
api.planx.uk/lib/notify/index.ts#L73
Unexpected any. Specify a different type
|
|
Run API Tests:
api.planx.uk/modules/auth/strategy/google.ts#L20
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/flows/validate/service/fileTypes.ts#L73
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.test.ts#L20
Disabled test suite
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L129
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/classifiedRoads.ts#L151
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L100
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L101
Unexpected any. Specify a different type
|
Run API Tests:
api.planx.uk/modules/gis/service/digitalLand.ts#L135
Unexpected any. Specify a different type
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/agent.spec.ts#L93
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L87
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L96
Unexpected use of networkidle
|
E2E tests:
e2e/tests/ui-driven/src/invite-to-pay/nominee.spec.ts#L131
Unexpected use of networkidle
|
Slow Test:
e2e/tests/ui-driven/[chromium] › pay.spec.ts#L1
e2e/tests/ui-driven/[chromium] › pay.spec.ts took 44.0s
|
Slow Test:
e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts#L1
e2e/tests/ui-driven/[chromium] › create-flow/create-flow.spec.ts took 18.0s
|
🎭 Playwright Run Summary
13 failed
[chromium] › invite-to-pay/agent.spec.ts:45:7 › Agent journey @regression › agent can send a payment request
[chromium] › invite-to-pay/agent.spec.ts:79:7 › Agent journey @regression › agent cannot send a payment request after initialising a normal payment
[chromium] › invite-to-pay/agent.spec.ts:98:7 › Agent journey @regression › agent cannot make changes after sending a payment request - session is locked
[chromium] › invite-to-pay/agent.spec.ts:125:7 › Agent journey @regression › reconciliation does not apply to sessions with open payment requests
[chromium] › invite-to-pay/agent.spec.ts:162:7 › Agent journey @regression › agent cannot make payment after sending a payment request in another tab
[chromium] › invite-to-pay/agent.spec.ts:194:7 › Agent journey @regression › agent cannot generate payment request after starting payment in another tab
[chromium] › save-and-return.spec.ts:66:9 › Save and return › resuming a saved application › the application presents a review screen on return
[chromium] › save-and-return.spec.ts:92:9 › Save and return › resuming a saved application › the application resumes from the last unanswered question
[chromium] › save-and-return.spec.ts:119:9 › Save and return › session reconciliation › the application resumes with no modifications
[chromium] › save-and-return.spec.ts:142:9 › Save and return › session reconciliation › the application resumes from the first modified question
[chromium] › sections.spec.ts:314:9 › Section statuses › simple save and return › not started, ready to start and complete statuses
[chromium] › sections.spec.ts:373:9 › Section statuses › simple save and return › the ready to continue status
[chromium] › sections.spec.ts:447:9 › Section statuses › save and return with service changes (reconciliation) › needs new information and started
25 passed (32.9m)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-report
Expired
|
81.4 MB |
|