Skip to content

e2e-flakiness-detector #261

e2e-flakiness-detector

e2e-flakiness-detector #261

Triggered via schedule November 25, 2024 14:05
Status Failure
Total duration 1h 55m 3s
Artifacts 2
Matrix: test-e2e
Fit to window
Zoom out
Zoom in

Annotations

19 errors and 2 notices
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection: vscode\test\e2e\common.ts#L185
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ───────────────────────── Error: Timed out 5000ms waiting for expect(locator).toHaveAccessibleName(expected) Locator: getByRole('listbox', { name: /^Search files/ }).getByRole('option').first() Expected pattern: /buzz.ts,/ Received: <element(s) not found> Call log: - expect.toHaveAccessibleName with timeout 5000ms - waiting for getByRole('listbox', { name: /^Search files/ }).getByRole('option').first() at common.ts:185 183 | .getByRole('option') 184 | .first() > 185 | ).toHaveAccessibleName(new RegExp(`${filename},`)) | ^ 186 | await page.keyboard.press('Enter') 187 | 188 | await clickEditorTab(page, filename) at openFileInEditorTab (D:\a\cody\cody\vscode\test\e2e\common.ts:185:7) at D:\a\cody\cody\vscode\test\e2e\chat-keyboard-shortcuts.test.ts:50:5
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection: vscode\test\e2e\chat-keyboard-shortcuts.test.ts#L1
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ───────────────────────── Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\re_opening_chat_adds_selection\temp-videos\5dadae9867a01fca8f47f1498ca3be2b.webm' -> 'D:\a\cody\cody\playwright\re_opening_chat_adds_selection\videos\run_0_retry_0_failure.webm'
command-custom.test.ts:141:3 › execute custom commands with context defined in cody.json: vscode\test\e2e\command-custom.test.ts#L198
2) command-custom.test.ts:141:3 › execute custom commands with context defined in cody.json ────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('tab', { name: 'var.go' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('tab', { name: 'var.go' }) 196 | .getByRole('button', { name: withPlatformSlashes('var.go:1 lib/batches/env') }) 197 | .click() > 198 | await expect(page.getByRole('tab', { name: 'var.go' })).toBeVisible() | ^ 199 | 200 | /* Test: context.openTabs with openTabs command */ 201 | at D:\a\cody\cody\vscode\test\e2e\command-custom.test.ts:198:61
command-edit.test.ts:106:1 › edit (fixup) input - range selection: vscode\test\e2e\command-edit.test.ts#L124
3) command-edit.test.ts:106:1 › edit (fixup) input - range selection ───────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('Nearest Code Block') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('Nearest Code Block') 122 | // Check the correct range item is auto-selected 123 | const rangeItem = page.getByText('Nearest Code Block') > 124 | expect(rangeItem).toBeVisible() | ^ 125 | 126 | // Open the range input and check it has the correct item selected 127 | await rangeItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:124:23
command-edit.test.ts:106:1 › edit (fixup) input - range selection: vscode\test\e2e\command-edit.test.ts#L124
4) command-edit.test.ts:106:1 › edit (fixup) input - range selection ───────────────────────────── Error: expect(locator).toBeVisible() Locator: getByText('Nearest Code Block') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('Nearest Code Block') 122 | // Check the correct range item is auto-selected 123 | const rangeItem = page.getByText('Nearest Code Block') > 124 | expect(rangeItem).toBeVisible() | ^ 125 | 126 | // Open the range input and check it has the correct item selected 127 | await rangeItem.click() at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:124:23
command-edit.test.ts:144:1 › edit (fixup) input - model selection: vscode\test\e2e\helpers.ts#L381
5) command-edit.test.ts:144:1 › edit (fixup) input - model selection ───────────────────────────── Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceNyPY50 after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceNyPY50\Crashpad\reports\2520dbaf-9d89-4856-b0a7-1b3cdaf29613.dmp' at helpers.ts:381 379 | } catch (error) { 380 | if (attempts === 1) { > 381 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`) | ^ 382 | } 383 | 384 | await new Promise(resolve => setTimeout(resolve, 100)) at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:381:23) at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:262:13)
uninstall.test.ts:7:5 › uninstall extension: vscode\test\e2e\common.ts#L54
6) uninstall.test.ts:7:5 › uninstall extension ─────────────────────────────────────────────────── TimeoutError: page.click: Timeout 30000ms exceeded. Call log: - waiting for locator('[aria-label="Cody"]') at common.ts:54 52 | // In case the cody sidebar isn't focused, select it. 53 | while (!(await isSidebarVisible(page))) { > 54 | await page.click('[aria-label="Cody"]') | ^ 55 | } 56 | } 57 | at focusSidebar (D:\a\cody\cody\vscode\test\e2e\common.ts:54:20) at signin (D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:65:5) at D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:50:5
uninstall.test.ts:7:5 › uninstall extension: vscode\test\e2e\common.ts#L54
7) uninstall.test.ts:7:5 › uninstall extension ─────────────────────────────────────────────────── TimeoutError: page.click: Timeout 30000ms exceeded. Call log: - waiting for locator('[aria-label="Cody"]') at common.ts:54 52 | // In case the cody sidebar isn't focused, select it. 53 | while (!(await isSidebarVisible(page))) { > 54 | await page.click('[aria-label="Cody"]') | ^ 55 | } 56 | } 57 | at focusSidebar (D:\a\cody\cody\vscode\test\e2e\common.ts:54:20) at signin (D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:65:5) at D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:50:5
test-e2e (windows)
Process completed with exit code 1.
chat-atFile.test.ts:35:3 › @-mention file in chat: vscode/test/e2e/chat-atFile.test.ts#L89
1) chat-atFile.test.ts:35:3 › @-mention file in chat ───────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' }) Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' }) 87 | await chatInput.fill('') 88 | await chatInput.pressSequentially('@mj', { delay: 350 }) > 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible() | ^ 90 | await chatInput.fill('clear') 91 | 92 | // Searching and clicking at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection: vscode/test/e2e/chat-keyboard-shortcuts.test.ts#L1
2) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ───────────────────────── Test timeout of 30000ms exceeded.
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection: vscode/test/e2e/common.ts#L179
2) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ───────────────────────── Error: locator.fill: Target page, context or browser has been closed Call log: - waiting for getByPlaceholder('Type the name of a command to run.') - locator resolved to <input wrap="off" type="text" class="input" role="combobox" autocorrect="off" spellcheck="false" aria-label="input" custom-hover="true" autocapitalize="off" aria-haspopup="menu" aria-expanded="true" aria-autocomplete="list" aria-controls="quickInput_list" aria-activedescendant="list_id_4_0" aria-describedby="quickInput_message" placeholder="Type the name of a command to run."/> - fill("buzz.ts") - attempting fill action - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #1 - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #2 - waiting 20ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #3 - waiting 100ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #4 - waiting 100ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #5 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #6 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #7 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #8 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #9 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #10 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #11 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #12 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #13 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #14 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #15 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #16 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #17 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #18 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #19 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible - retrying fill action, attempt #20 - waiting 500ms - waiting for element to be visible, enabled and editable - element is not visible
command-core.test.ts:114:3 › Explain Command from Prompts Tab: vscode/test/e2e/command-core.test.ts#L1
3) command-core.test.ts:114:3 › Explain Command from Prompts Tab ───────────────────────────────── Test timeout of 30000ms exceeded.
command-core.test.ts:114:3 › Explain Command from Prompts Tab: vscode/test/e2e/command-core.test.ts#L139
3) command-core.test.ts:114:3 › Explain Command from Prompts Tab ───────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('option', { name: 'Explain Code' }) 137 | const sidebarTab = sidebarChat.getByTestId('tab-prompts') 138 | await sidebarTab.click() > 139 | await sidebarChat.getByRole('option', { name: 'Explain Code' }).click() | ^ 140 | 141 | // Click on a command from the sidebar should not start a new Editor window when sidebar is empty. 142 | await expect(sidebarChat.getByText('hello from the assistant')).toBeVisible() at /home/runner/work/cody/cody/vscode/test/e2e/command-core.test.ts:139:69
command-core.test.ts:114:3 › Explain Command from Prompts Tab: vscode/test/e2e/command-core.test.ts#L1
4) command-core.test.ts:114:3 › Explain Command from Prompts Tab ───────────────────────────────── Test timeout of 30000ms exceeded.
command-core.test.ts:114:3 › Explain Command from Prompts Tab: vscode/test/e2e/command-core.test.ts#L139
4) command-core.test.ts:114:3 › Explain Command from Prompts Tab ───────────────────────────────── Error: locator.click: Target page, context or browser has been closed Call log: - waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('option', { name: 'Explain Code' }) 137 | const sidebarTab = sidebarChat.getByTestId('tab-prompts') 138 | await sidebarTab.click() > 139 | await sidebarChat.getByRole('option', { name: 'Explain Code' }).click() | ^ 140 | 141 | // Click on a command from the sidebar should not start a new Editor window when sidebar is empty. 142 | await expect(sidebarChat.getByText('hello from the assistant')).toBeVisible() at /home/runner/work/cody/cody/vscode/test/e2e/command-core.test.ts:139:69
command-custom.test.ts:46:3 › create a new user command via the custom commands menu: vscode/test/e2e/command-custom.test.ts#L93
5) command-custom.test.ts:46:3 › create a new user command via the custom commands menu ────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByText('New Custom Cody Command: Prompt') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByText('New Custom Cody Command: Prompt') 91 | // Enter prompt 92 | const promptInputTitle = page.getByText('New Custom Cody Command: Prompt') > 93 | await expect(promptInputTitle).toBeVisible() | ^ 94 | const promptInputBox = page.getByPlaceholder( 95 | 'e.g. Create five different test cases for the selected code' 96 | ) at /home/runner/work/cody/cody/vscode/test/e2e/command-custom.test.ts:93:36
uninstall.test.ts:7:5 › uninstall extension: vscode/test/e2e/common.ts#L54
6) uninstall.test.ts:7:5 › uninstall extension ─────────────────────────────────────────────────── TimeoutError: page.click: Timeout 30000ms exceeded. Call log: - waiting for locator('[aria-label="Cody"]') at common.ts:54 52 | // In case the cody sidebar isn't focused, select it. 53 | while (!(await isSidebarVisible(page))) { > 54 | await page.click('[aria-label="Cody"]') | ^ 55 | } 56 | } 57 | at focusSidebar (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:54:20) at signin (/home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:65:5) at /home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:50:5
uninstall.test.ts:7:5 › uninstall extension: vscode/test/e2e/common.ts#L54
7) uninstall.test.ts:7:5 › uninstall extension ─────────────────────────────────────────────────── TimeoutError: page.click: Timeout 30000ms exceeded. Call log: - waiting for locator('[aria-label="Cody"]') at common.ts:54 52 | // In case the cody sidebar isn't focused, select it. 53 | while (!(await isSidebarVisible(page))) { > 54 | await page.click('[aria-label="Cody"]') | ^ 55 | } 56 | } 57 | at focusSidebar (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:54:20) at signin (/home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:65:5) at /home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:50:5
🎭 Playwright Run Summary
7 failed chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ────────────────────────── command-custom.test.ts:141:3 › execute custom commands with context defined in cody.json ─────── command-edit.test.ts:106:1 › edit (fixup) input - range selection ────────────────────────────── command-edit.test.ts:106:1 › edit (fixup) input - range selection ────────────────────────────── command-edit.test.ts:144:1 › edit (fixup) input - model selection ────────────────────────────── uninstall.test.ts:7:5 › uninstall extension ──────────────────────────────────────────────────── uninstall.test.ts:7:5 › uninstall extension ──────────────────────────────────────────────────── 12 skipped 169 passed (49.0m)
🎭 Playwright Run Summary
7 failed chat-atFile.test.ts:35:3 › @-mention file in chat ────────────────────────────────────────────── chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ────────────────────────── command-core.test.ts:114:3 › Explain Command from Prompts Tab ────────────────────────────────── command-core.test.ts:114:3 › Explain Command from Prompts Tab ────────────────────────────────── command-custom.test.ts:46:3 › create a new user command via the custom commands menu ─────────── uninstall.test.ts:7:5 › uninstall extension ──────────────────────────────────────────────────── uninstall.test.ts:7:5 › uninstall extension ──────────────────────────────────────────────────── 30 skipped 433 passed (1.9h)

Artifacts

Produced during runtime
Name Size
playwright-recordings ubuntu
3.71 MB
playwright-recordings windows
1.52 MB