Fix flaky playwright tests (#28959) #4030
Annotations
10 errors, 3 warnings, and 1 notice
Run Playwright tests:
playwright/e2e/room/room-header.spec.ts#L1
1) [Chrome] › room/room-header.spec.ts:23:13 › Room Header › with feature_notifications enabled › should render default buttons properly @screenshot
Test timeout of 30000ms exceeded.
|
Run Playwright tests:
playwright/pages/ElementAppPage.ts#L96
1) [Chrome] › room/room-header.spec.ts:23:13 › Room Header › with feature_notifications enabled › should render default buttons properly @screenshot
Error: locator.click: Test timeout of 30000ms exceeded.
Call log:
- waiting for getByRole('tree', { name: 'Rooms' }).locator('[title="Test Room"],[aria-label="Test Room"]').first()
at ../pages/ElementAppPage.ts:96
94 | .locator(`[title="${name}"],[aria-label="${name}"]`)
95 | .first()
> 96 | .click();
| ^
97 | }
98 |
99 | public async viewRoomById(roomId: string): Promise<void> {
at ElementAppPage.viewRoomByName (/home/runner/work/element-web/element-web/playwright/pages/ElementAppPage.ts:96:14)
at /home/runner/work/element-web/element-web/playwright/e2e/room/room-header.spec.ts:25:23
|
Run Playwright tests:
playwright/e2e/room_options/marked_unread.spec.ts#L51
2) [Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread
Error: expect(locator).toBeVisible()
Locator: getByLabel('The mark unread test room Unread messages.')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByLabel('The mark unread test room Unread messages.')
49 | await page.getByRole("menuitem", { name: "Mark as unread" }).click();
50 |
> 51 | expect(page.getByLabel(TEST_ROOM_NAME + " Unread messages.")).toBeVisible();
| ^
52 | });
53 | });
54 |
at /home/runner/work/element-web/element-web/playwright/e2e/room_options/marked_unread.spec.ts:51:71
|
Run Playwright tests:
playwright/e2e/settings/general-room-settings-tab.spec.ts#L47
3) [Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit
Error: Timed out 5000ms waiting for expect(locator).toHaveValue(expected)
Locator: locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
Expected string: "#abcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksdabcasdhjasjhdaj1jh1asdhasjdhajsdhjavhjksd:localhost"
Received string: ""
Call log:
- expect.toHaveValue with timeout 5000ms
- waiting for locator('.mx_Dialog').filter({ has: locator('.mx_RoomSettingsDialog') }).locator('#canonicalAlias')
9 × locator resolved to <select type="text" id="canonicalAlias" label="Main address" placeholder="Main address">…</select>
- unexpected value ""
45 |
46 | // 2. wait for the new setting to apply ...
> 47 | await expect(settings.locator("#canonicalAlias")).toHaveValue(`#${longString}:localhost`);
| ^
48 |
49 | // 3. Check if the dialog overflows
50 | const dialogBoundingBox = await page.locator(".mx_Dialog").boundingBox();
at /home/runner/work/element-web/element-web/playwright/e2e/settings/general-room-settings-tab.spec.ts:47:59
|
Run Playwright tests:
playwright/e2e/sliding-sync/sliding-sync.spec.ts#L86
4) [Chrome] › sliding-sync/sliding-sync.spec.ts:305:5 › Sliding Sync › should clear the reply to field when swapping rooms
Test timeout of 30000ms exceeded while running "beforeEach" hook.
84 |
85 | // Load the user fixture for all tests
> 86 | test.beforeEach(({ user }) => {});
| ^
87 |
88 | test("should render the Rooms list in reverse chronological order by default and allowing sorting A-Z", async ({
89 | page,
at /home/runner/work/element-web/element-web/playwright/e2e/sliding-sync/sliding-sync.spec.ts:86:10
|
Run Playwright tests:
playwright/element-web-test.ts#L191
4) [Chrome] › sliding-sync/sliding-sync.spec.ts:305:5 › Sliding Sync › should clear the reply to field when swapping rooms
Error: page.waitForSelector: Test timeout of 30000ms exceeded.
Call log:
- waiting for locator('.mx_MatrixChat') to be visible
at ../element-web-test.ts:191
189 | user: async ({ pageWithCredentials: page, credentials }, use) => {
190 | await page.goto("/");
> 191 | await page.waitForSelector(".mx_MatrixChat", { timeout: 30000 });
| ^
192 | await use(credentials);
193 | },
194 |
at Object.user (/home/runner/work/element-web/element-web/playwright/element-web-test.ts:191:20)
|
Run Playwright tests:
playwright/e2e/spotlight/spotlight.spec.ts#L138
5) [Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ─────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 3
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 3 elements
- unexpected value "3"
136 | await spotlight.search(room1Name);
137 | const resultLocator = spotlight.results;
> 138 | await expect(resultLocator).toHaveCount(1);
| ^
139 | await expect(resultLocator.first()).toContainText(room1Name);
140 | await expect(resultLocator.first()).toContainText("View");
141 | await resultLocator.first().click();
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:138:37
|
Run Playwright tests:
playwright/e2e/spotlight/spotlight.spec.ts#L152
6) [Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ───
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 2 elements
- unexpected value "2"
150 | await spotlight.search(room2Name);
151 | const resultLocator = spotlight.results;
> 152 | await expect(resultLocator).toHaveCount(1);
| ^
153 | await expect(resultLocator.first()).toContainText(room2Name);
154 | await expect(resultLocator.first()).toContainText("Join");
155 | await resultLocator.first().click();
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:152:37
|
Run Playwright tests:
playwright/e2e/spotlight/spotlight.spec.ts#L167
7) [Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 2
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 2 elements
- unexpected value "2"
165 | await spotlight.search(room3Name);
166 | const resultLocator = spotlight.results;
> 167 | await expect(resultLocator).toHaveCount(1);
| ^
168 | await expect(resultLocator.first()).toContainText(room3Name);
169 | await expect(resultLocator.first()).toContainText("View");
170 | await resultLocator.first().click();
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:167:37
|
Run Playwright tests:
playwright/e2e/spotlight/spotlight.spec.ts#L226
8) [Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ─────────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
Expected: 1
Received: 3
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('[role=dialog][aria-label="Search Dialog"]').locator('.mx_SpotlightDialog_section.mx_SpotlightDialog_results .mx_SpotlightDialog_option')
2 × locator resolved to 0 elements
- unexpected value "0"
7 × locator resolved to 3 elements
- unexpected value "3"
224 | await spotlight.search(bot2Name);
225 | const resultLocator = spotlight.results;
> 226 | await expect(resultLocator).toHaveCount(1);
| ^
227 | await expect(resultLocator.first()).toContainText(bot2Name);
228 | await resultLocator.first().click();
229 | await expect(roomHeaderName(page)).toHaveText(bot2Name);
at /home/runner/work/element-web/element-web/playwright/e2e/spotlight/spotlight.spec.ts:226:37
|
Run Playwright tests:
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts#L1
[Chrome] › spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 48.2s
|
Run Playwright tests:
[Chrome] › spaces/spaces.spec.ts#L1
[Chrome] › spaces/spaces.spec.ts took 30.9s
|
Run Playwright tests:
[Chrome] › settings/account-user-settings-tab.spec.ts#L1
[Chrome] › settings/account-user-settings-tab.spec.ts took 17.5s
|
Run Playwright tests
12 flaky
[Chrome] › room/room-header.spec.ts:23:13 › Room Header › with feature_notifications enabled › should render default buttons properly @screenshot
[Chrome] › room_options/marked_unread.spec.ts:22:9 › Mark as Unread › should mark a room as unread
[Chrome] › settings/general-room-settings-tab.spec.ts:39:9 › General room settings tab › long address should not cause dialog to overflow @no-webkit
[Chrome] › sliding-sync/sliding-sync.spec.ts:305:5 › Sliding Sync › should clear the reply to field when swapping rooms
[Chrome] › spotlight/spotlight.spec.ts:132:9 › Spotlight › should find known public rooms ──────
[Chrome] › spotlight/spotlight.spec.ts:146:9 › Spotlight › should find unknown public rooms ────
[Chrome] › spotlight/spotlight.spec.ts:161:9 › Spotlight › should find unknown public world readable rooms
[Chrome] › spotlight/spotlight.spec.ts:220:9 › Spotlight › should find unknown people ──────────
[Chrome] › spotlight/spotlight.spec.ts:321:9 › Spotlight › should allow opening group chat dialog
[Chrome] › spotlight/spotlight.spec.ts:339:9 › Spotlight › should close spotlight after starting a DM
[Chrome] › spotlight/spotlight.spec.ts:344:9 › Spotlight › should show the same user only once ─
[Chrome] › spotlight/spotlight.spec.ts:357:9 › Spotlight › should be able to navigate results via keyboard
2 skipped
69 passed (9.9m)
|
Loading