Accessibility Tests for 495efdd0833185437bf30db1ec018f314eccd1bd #108
stephaniehobsona11y_tests.yml
on: schedule
notify-of-test-run-start
6s
notify-of-test-run-completion
6s
Annotations
10 errors, 3 warnings, and 1 notice
|
[chromium] › a11y/components/footer.spec.js:45:9 › Footer (mobile) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/footer.spec.js#L52
1) [chromium] › a11y/components/footer.spec.js:45:9 › Footer (mobile) › should not have any detectable a11y issues @a11y
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: getByTestId('footer-list-company')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for getByTestId('footer-list-company')
9 × locator resolved to <ul class="moz24-footer-primary-list" data-testid="footer-list-company">…</ul>
- unexpected value "visible"
50 |
51 | // Open Company section
> 52 | await expect(footerListCompany).not.toBeVisible();
| ^
53 | await footerHeadingCompany.click();
54 | await expect(footerListCompany).toBeVisible();
55 |
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/footer.spec.js:52:49
|
|
[chromium] › a11y/components/footer.spec.js:45:9 › Footer (mobile) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/footer.spec.js#L52
1) [chromium] › a11y/components/footer.spec.js:45:9 › Footer (mobile) › should not have any detectable a11y issues @a11y
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: getByTestId('footer-list-company')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for getByTestId('footer-list-company')
9 × locator resolved to <ul class="moz24-footer-primary-list" data-testid="footer-list-company">…</ul>
- unexpected value "visible"
50 |
51 | // Open Company section
> 52 | await expect(footerListCompany).not.toBeVisible();
| ^
53 | await footerHeadingCompany.click();
54 | await expect(footerListCompany).toBeVisible();
55 |
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/footer.spec.js:52:49
|
|
[chromium] › a11y/components/footer.spec.js:45:9 › Footer (mobile) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/footer.spec.js#L52
1) [chromium] › a11y/components/footer.spec.js:45:9 › Footer (mobile) › should not have any detectable a11y issues @a11y
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible()
Locator: getByTestId('footer-list-company')
Expected: not visible
Received: visible
Call log:
- expect.not.toBeVisible with timeout 5000ms
- waiting for getByTestId('footer-list-company')
9 × locator resolved to <ul class="moz24-footer-primary-list" data-testid="footer-list-company">…</ul>
- unexpected value "visible"
50 |
51 | // Open Company section
> 52 | await expect(footerListCompany).not.toBeVisible();
| ^
53 | await footerHeadingCompany.click();
54 | await expect(footerListCompany).toBeVisible();
55 |
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/footer.spec.js:52:49
|
|
[chromium] › a11y/components/side-menu.spec.js:25:9 › Side Menu (desktop) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/side-menu.spec.js#L28
2) [chromium] › a11y/components/side-menu.spec.js:25:9 › Side Menu (desktop) › should not have any detectable a11y issues @a11y
Error: expect(received).toEqual(expected) // deep equality
Expected: 0
Received: 1
26 | const results = await scanPageElement(page, sideMenuLocator);
27 | createReport('component', 'side-menu-desktop', results);
> 28 | expect(results.violations.length).toEqual(0);
| ^
29 | });
30 | }
31 | );
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/side-menu.spec.js:28:47
|
|
[chromium] › a11y/components/side-menu.spec.js:25:9 › Side Menu (desktop) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/side-menu.spec.js#L28
2) [chromium] › a11y/components/side-menu.spec.js:25:9 › Side Menu (desktop) › should not have any detectable a11y issues @a11y
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toEqual(expected) // deep equality
Expected: 0
Received: 1
26 | const results = await scanPageElement(page, sideMenuLocator);
27 | createReport('component', 'side-menu-desktop', results);
> 28 | expect(results.violations.length).toEqual(0);
| ^
29 | });
30 | }
31 | );
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/side-menu.spec.js:28:47
|
|
[chromium] › a11y/components/side-menu.spec.js:25:9 › Side Menu (desktop) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/side-menu.spec.js#L28
2) [chromium] › a11y/components/side-menu.spec.js:25:9 › Side Menu (desktop) › should not have any detectable a11y issues @a11y
Retry #2 ───────────────────────────────────────────────────────────────────────────────────────
Error: expect(received).toEqual(expected) // deep equality
Expected: 0
Received: 1
26 | const results = await scanPageElement(page, sideMenuLocator);
27 | createReport('component', 'side-menu-desktop', results);
> 28 | expect(results.violations.length).toEqual(0);
| ^
29 | });
30 | }
31 | );
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/side-menu.spec.js:28:47
|
|
[chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/side-menu.spec.js#L1
3) [chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y
Test timeout of 30000ms exceeded.
|
|
[chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/side-menu.spec.js#L51
3) [chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByTestId('sidebar-menu-toggle')
49 | // Open side menu panel
50 | await expect(sidebarMenuMain).not.toBeVisible();
> 51 | await sidebarMenuToggle.click();
| ^
52 | await expect(sidebarMenuMain).toBeVisible();
53 |
54 | const results = await scanPageElement(page, sideMenuLocator);
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/side-menu.spec.js:51:37
|
|
[chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/side-menu.spec.js#L1
3) [chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 30000ms exceeded.
|
|
[chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y:
tests/playwright/specs/a11y/components/side-menu.spec.js#L51
3) [chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByTestId('sidebar-menu-toggle')
49 | // Open side menu panel
50 | await expect(sidebarMenuMain).not.toBeVisible();
> 51 | await sidebarMenuToggle.click();
| ^
52 | await expect(sidebarMenuMain).toBeVisible();
53 |
54 | const results = await scanPageElement(page, sideMenuLocator);
at /home/runner/work/bedrock/bedrock/tests/playwright/specs/a11y/components/side-menu.spec.js:51:37
|
|
notify-of-test-run-start
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
accessibility-tests
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
notify-of-test-run-completion
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
|
🎭 Playwright Run Summary
46 failed
[chromium] › a11y/components/footer.spec.js:45:9 › Footer (mobile) › should not have any detectable a11y issues @a11y
[chromium] › a11y/components/side-menu.spec.js:25:9 › Side Menu (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/components/side-menu.spec.js:45:9 › Side Menu (mobile) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /de/firefox/built-for-you/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /de/firefox/challenge-the-default/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/about/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/about/governance/policies/participation/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/about/leadership/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/about/manifesto/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/advertising/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/careers/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/careers/benefits/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/careers/diversity/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/careers/listings/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/careers/locations/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/careers/teams/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/contact/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/contribute/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/all/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/browsers/mobile/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/browsers/mobile/android/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/browsers/mobile/focus/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/browsers/mobile/ios/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/channel/android/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/channel/desktop/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/developer/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/download/thanks/ page (desktop) › should not have any detectable a11y issues @a11y
[chromium] › a11y/pages.spec.js:25:13 › /en-US/firefox/enterprise/ page (desktop) › should not have any detectable a11y issues @a11y
|
Artifacts
Produced during runtime
| Name | Size | |
|---|---|---|
|
test-results-a11y-495efdd0833185437bf30db1ec018f314eccd1bd
Expired
|
269 KB |
|