e2e-flakiness-detector #261
Annotations
19 errors and 2 notices
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection:
vscode\test\e2e\common.ts#L185
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toHaveAccessibleName(expected)
Locator: getByRole('listbox', { name: /^Search files/ }).getByRole('option').first()
Expected pattern: /buzz.ts,/
Received: <element(s) not found>
Call log:
- expect.toHaveAccessibleName with timeout 5000ms
- waiting for getByRole('listbox', { name: /^Search files/ }).getByRole('option').first()
at common.ts:185
183 | .getByRole('option')
184 | .first()
> 185 | ).toHaveAccessibleName(new RegExp(`${filename},`))
| ^
186 | await page.keyboard.press('Enter')
187 |
188 | await clickEditorTab(page, filename)
at openFileInEditorTab (D:\a\cody\cody\vscode\test\e2e\common.ts:185:7)
at D:\a\cody\cody\vscode\test\e2e\chat-keyboard-shortcuts.test.ts:50:5
|
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection:
vscode\test\e2e\chat-keyboard-shortcuts.test.ts#L1
1) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Error: EBUSY: resource busy or locked, rename 'D:\a\cody\cody\playwright\re_opening_chat_adds_selection\temp-videos\5dadae9867a01fca8f47f1498ca3be2b.webm' -> 'D:\a\cody\cody\playwright\re_opening_chat_adds_selection\videos\run_0_retry_0_failure.webm'
|
command-custom.test.ts:141:3 › execute custom commands with context defined in cody.json:
vscode\test\e2e\command-custom.test.ts#L198
2) command-custom.test.ts:141:3 › execute custom commands with context defined in cody.json ──────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByRole('tab', { name: 'var.go' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByRole('tab', { name: 'var.go' })
196 | .getByRole('button', { name: withPlatformSlashes('var.go:1 lib/batches/env') })
197 | .click()
> 198 | await expect(page.getByRole('tab', { name: 'var.go' })).toBeVisible()
| ^
199 |
200 | /* Test: context.openTabs with openTabs command */
201 |
at D:\a\cody\cody\vscode\test\e2e\command-custom.test.ts:198:61
|
command-edit.test.ts:106:1 › edit (fixup) input - range selection:
vscode\test\e2e\command-edit.test.ts#L124
3) command-edit.test.ts:106:1 › edit (fixup) input - range selection ─────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('Nearest Code Block')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Nearest Code Block')
122 | // Check the correct range item is auto-selected
123 | const rangeItem = page.getByText('Nearest Code Block')
> 124 | expect(rangeItem).toBeVisible()
| ^
125 |
126 | // Open the range input and check it has the correct item selected
127 | await rangeItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:124:23
|
command-edit.test.ts:106:1 › edit (fixup) input - range selection:
vscode\test\e2e\command-edit.test.ts#L124
4) command-edit.test.ts:106:1 › edit (fixup) input - range selection ─────────────────────────────
Error: expect(locator).toBeVisible()
Locator: getByText('Nearest Code Block')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Nearest Code Block')
122 | // Check the correct range item is auto-selected
123 | const rangeItem = page.getByText('Nearest Code Block')
> 124 | expect(rangeItem).toBeVisible()
| ^
125 |
126 | // Open the range input and check it has the correct item selected
127 | await rangeItem.click()
at D:\a\cody\cody\vscode\test\e2e\command-edit.test.ts:124:23
|
command-edit.test.ts:144:1 › edit (fixup) input - model selection:
vscode\test\e2e\helpers.ts#L381
5) command-edit.test.ts:144:1 › edit (fixup) input - model selection ─────────────────────────────
Error: Failed to rmSync C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceNyPY50 after 5 attempts: Error: EBUSY: resource busy or locked, unlink '\\?\C:\Users\RUNNER~1\AppData\Local\Temp\cody-vsceNyPY50\Crashpad\reports\2520dbaf-9d89-4856-b0a7-1b3cdaf29613.dmp'
at helpers.ts:381
379 | } catch (error) {
380 | if (attempts === 1) {
> 381 | throw new Error(`Failed to rmSync ${path} after ${maxAttempts} attempts: ${error}`)
| ^
382 | }
383 |
384 | await new Promise(resolve => setTimeout(resolve, 100))
at rmSyncWithRetries (D:\a\cody\cody\vscode\test\e2e\helpers.ts:381:23)
at Object.app (D:\a\cody\cody\vscode\test\e2e\helpers.ts:262:13)
|
uninstall.test.ts:7:5 › uninstall extension:
vscode\test\e2e\common.ts#L54
6) uninstall.test.ts:7:5 › uninstall extension ───────────────────────────────────────────────────
TimeoutError: page.click: Timeout 30000ms exceeded.
Call log:
- waiting for locator('[aria-label="Cody"]')
at common.ts:54
52 | // In case the cody sidebar isn't focused, select it.
53 | while (!(await isSidebarVisible(page))) {
> 54 | await page.click('[aria-label="Cody"]')
| ^
55 | }
56 | }
57 |
at focusSidebar (D:\a\cody\cody\vscode\test\e2e\common.ts:54:20)
at signin (D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:65:5)
at D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:50:5
|
uninstall.test.ts:7:5 › uninstall extension:
vscode\test\e2e\common.ts#L54
7) uninstall.test.ts:7:5 › uninstall extension ───────────────────────────────────────────────────
TimeoutError: page.click: Timeout 30000ms exceeded.
Call log:
- waiting for locator('[aria-label="Cody"]')
at common.ts:54
52 | // In case the cody sidebar isn't focused, select it.
53 | while (!(await isSidebarVisible(page))) {
> 54 | await page.click('[aria-label="Cody"]')
| ^
55 | }
56 | }
57 |
at focusSidebar (D:\a\cody\cody\vscode\test\e2e\common.ts:54:20)
at signin (D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:65:5)
at D:\a\cody\cody\vscode\test\e2e\uninstall.test.ts:50:5
|
test-e2e (windows)
Process completed with exit code 1.
|
chat-atFile.test.ts:35:3 › @-mention file in chat:
vscode/test/e2e/chat-atFile.test.ts#L89
1) chat-atFile.test.ts:35:3 › @-mention file in chat ─────────────────────────────────────────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for frameLocator('.simple-find-part-wrapper + iframe.webview').last().frameLocator('iframe').getByRole('option', { name: 'Main.java' })
87 | await chatInput.fill('')
88 | await chatInput.pressSequentially('@mj', { delay: 350 })
> 89 | await expect(chatPanelFrame.getByRole('option', { name: 'Main.java' })).toBeVisible()
| ^
90 | await chatInput.fill('clear')
91 |
92 | // Searching and clicking
at /home/runner/work/cody/cody/vscode/test/e2e/chat-atFile.test.ts:89:77
|
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection:
vscode/test/e2e/chat-keyboard-shortcuts.test.ts#L1
2) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Test timeout of 30000ms exceeded.
|
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection:
vscode/test/e2e/common.ts#L179
2) chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ─────────────────────────
Error: locator.fill: Target page, context or browser has been closed
Call log:
- waiting for getByPlaceholder('Type the name of a command to run.')
- locator resolved to <input wrap="off" type="text" class="input" role="combobox" autocorrect="off" spellcheck="false" aria-label="input" custom-hover="true" autocapitalize="off" aria-haspopup="menu" aria-expanded="true" aria-autocomplete="list" aria-controls="quickInput_list" aria-activedescendant="list_id_4_0" aria-describedby="quickInput_message" placeholder="Type the name of a command to run."/>
- fill("buzz.ts")
- attempting fill action
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #1
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #2
- waiting 20ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #3
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #4
- waiting 100ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #5
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #6
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #7
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #8
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #9
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #10
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #11
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #12
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #13
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #14
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #15
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #16
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #17
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #18
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #19
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
- retrying fill action, attempt #20
- waiting 500ms
- waiting for element to be visible, enabled and editable
- element is not visible
|
command-core.test.ts:114:3 › Explain Command from Prompts Tab:
vscode/test/e2e/command-core.test.ts#L1
3) command-core.test.ts:114:3 › Explain Command from Prompts Tab ─────────────────────────────────
Test timeout of 30000ms exceeded.
|
command-core.test.ts:114:3 › Explain Command from Prompts Tab:
vscode/test/e2e/command-core.test.ts#L139
3) command-core.test.ts:114:3 › Explain Command from Prompts Tab ─────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('option', { name: 'Explain Code' })
137 | const sidebarTab = sidebarChat.getByTestId('tab-prompts')
138 | await sidebarTab.click()
> 139 | await sidebarChat.getByRole('option', { name: 'Explain Code' }).click()
| ^
140 |
141 | // Click on a command from the sidebar should not start a new Editor window when sidebar is empty.
142 | await expect(sidebarChat.getByText('hello from the assistant')).toBeVisible()
at /home/runner/work/cody/cody/vscode/test/e2e/command-core.test.ts:139:69
|
command-core.test.ts:114:3 › Explain Command from Prompts Tab:
vscode/test/e2e/command-core.test.ts#L1
4) command-core.test.ts:114:3 › Explain Command from Prompts Tab ─────────────────────────────────
Test timeout of 30000ms exceeded.
|
command-core.test.ts:114:3 › Explain Command from Prompts Tab:
vscode/test/e2e/command-core.test.ts#L139
4) command-core.test.ts:114:3 › Explain Command from Prompts Tab ─────────────────────────────────
Error: locator.click: Target page, context or browser has been closed
Call log:
- waiting for frameLocator('iframe.webview:first-child:last-child').frameLocator('iframe').getByRole('option', { name: 'Explain Code' })
137 | const sidebarTab = sidebarChat.getByTestId('tab-prompts')
138 | await sidebarTab.click()
> 139 | await sidebarChat.getByRole('option', { name: 'Explain Code' }).click()
| ^
140 |
141 | // Click on a command from the sidebar should not start a new Editor window when sidebar is empty.
142 | await expect(sidebarChat.getByText('hello from the assistant')).toBeVisible()
at /home/runner/work/cody/cody/vscode/test/e2e/command-core.test.ts:139:69
|
command-custom.test.ts:46:3 › create a new user command via the custom commands menu:
vscode/test/e2e/command-custom.test.ts#L93
5) command-custom.test.ts:46:3 › create a new user command via the custom commands menu ──────────
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('New Custom Cody Command: Prompt')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('New Custom Cody Command: Prompt')
91 | // Enter prompt
92 | const promptInputTitle = page.getByText('New Custom Cody Command: Prompt')
> 93 | await expect(promptInputTitle).toBeVisible()
| ^
94 | const promptInputBox = page.getByPlaceholder(
95 | 'e.g. Create five different test cases for the selected code'
96 | )
at /home/runner/work/cody/cody/vscode/test/e2e/command-custom.test.ts:93:36
|
uninstall.test.ts:7:5 › uninstall extension:
vscode/test/e2e/common.ts#L54
6) uninstall.test.ts:7:5 › uninstall extension ───────────────────────────────────────────────────
TimeoutError: page.click: Timeout 30000ms exceeded.
Call log:
- waiting for locator('[aria-label="Cody"]')
at common.ts:54
52 | // In case the cody sidebar isn't focused, select it.
53 | while (!(await isSidebarVisible(page))) {
> 54 | await page.click('[aria-label="Cody"]')
| ^
55 | }
56 | }
57 |
at focusSidebar (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:54:20)
at signin (/home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:65:5)
at /home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:50:5
|
uninstall.test.ts:7:5 › uninstall extension:
vscode/test/e2e/common.ts#L54
7) uninstall.test.ts:7:5 › uninstall extension ───────────────────────────────────────────────────
TimeoutError: page.click: Timeout 30000ms exceeded.
Call log:
- waiting for locator('[aria-label="Cody"]')
at common.ts:54
52 | // In case the cody sidebar isn't focused, select it.
53 | while (!(await isSidebarVisible(page))) {
> 54 | await page.click('[aria-label="Cody"]')
| ^
55 | }
56 | }
57 |
at focusSidebar (/home/runner/work/cody/cody/vscode/test/e2e/common.ts:54:20)
at signin (/home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:65:5)
at /home/runner/work/cody/cody/vscode/test/e2e/uninstall.test.ts:50:5
|
🎭 Playwright Run Summary
7 failed
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ──────────────────────────
command-custom.test.ts:141:3 › execute custom commands with context defined in cody.json ───────
command-edit.test.ts:106:1 › edit (fixup) input - range selection ──────────────────────────────
command-edit.test.ts:106:1 › edit (fixup) input - range selection ──────────────────────────────
command-edit.test.ts:144:1 › edit (fixup) input - model selection ──────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
12 skipped
169 passed (49.0m)
|
🎭 Playwright Run Summary
7 failed
chat-atFile.test.ts:35:3 › @-mention file in chat ──────────────────────────────────────────────
chat-keyboard-shortcuts.test.ts:35:5 › re-opening chat adds selection ──────────────────────────
command-core.test.ts:114:3 › Explain Command from Prompts Tab ──────────────────────────────────
command-core.test.ts:114:3 › Explain Command from Prompts Tab ──────────────────────────────────
command-custom.test.ts:46:3 › create a new user command via the custom commands menu ───────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
uninstall.test.ts:7:5 › uninstall extension ────────────────────────────────────────────────────
30 skipped
433 passed (1.9h)
|
Artifacts
Produced during runtime
Name | Size | |
---|---|---|
playwright-recordings ubuntu
|
3.71 MB |
|
playwright-recordings windows
|
1.52 MB |
|