Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: improve stability of E2E tests #3983

Merged
merged 2 commits into from
Aug 19, 2024
Merged

ci: improve stability of E2E tests #3983

merged 2 commits into from
Aug 19, 2024

Conversation

brandonroberts
Copy link
Contributor

@brandonroberts brandonroberts commented Aug 19, 2024

Description

  • First pass at improving stability of E2E tests
  • Removes checks for URLs for external services
  • Fixes a hydration issue on repo pages for small screens
  • Increases the timeout for local/CI runs

Related Tickets & Documents

Closes #3946
Closes #3557

Mobile & Desktop Screenshots/Recordings

Steps to QA

Tier (staff will fill in)

  • Tier 1
  • Tier 2
  • Tier 3
  • Tier 4

[optional] What gif best describes this PR or how it makes you feel?

Copy link

netlify bot commented Aug 19, 2024

Deploy Preview for design-insights ready!

Name Link
🔨 Latest commit b44e39d
🔍 Latest deploy log https://app.netlify.com/sites/design-insights/deploys/66c37e1427395c00085fe8cc
😎 Deploy Preview https://deploy-preview-3983--design-insights.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link

netlify bot commented Aug 19, 2024

Deploy Preview for oss-insights ready!

Name Link
🔨 Latest commit b44e39d
🔍 Latest deploy log https://app.netlify.com/sites/oss-insights/deploys/66c37e157a05f5000863a018
😎 Deploy Preview https://deploy-preview-3983--oss-insights.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@brandonroberts brandonroberts requested a review from a team August 19, 2024 17:16
@brandonroberts brandonroberts marked this pull request as ready for review August 19, 2024 17:16
@brandonroberts brandonroberts added this pull request to the merge queue Aug 19, 2024
Merged via the queue into beta with commit 7668b06 Aug 19, 2024
19 checks passed
@brandonroberts brandonroberts deleted the ci-e2e-stability branch August 19, 2024 18:55
open-sauced bot pushed a commit that referenced this pull request Aug 19, 2024
## [2.59.0-beta.4](v2.59.0-beta.3...v2.59.0-beta.4) (2024-08-19)

### 🔁 Continuous Integration

* improve stability of E2E tests ([#3983](#3983)) ([7668b06](7668b06))
open-sauced bot pushed a commit that referenced this pull request Aug 21, 2024
## [2.59.0](v2.58.0...v2.59.0) (2024-08-21)

### 🔁 Continuous Integration

* improve stability of E2E tests ([#3983](#3983)) ([7668b06](7668b06))

### 🍕 Features

* copy `LotteryFactorChart` as image ([#3987](#3987)) ([fa3255e](fa3255e))
* implement the CopyContainer component for copying it's contents as an image ([#3975](#3975)) ([cee5fa8](cee5fa8))

### 🐛 Bug Fixes

* add tooltip for long titles ([#3969](#3969)) ([e3404df](e3404df))
* adjust workspace upgrade pricing modal ([#3995](#3995)) ([798041a](798041a))
* make timezone optional for onboarding and user settings ([#3972](#3972)) ([f1795a3](f1795a3))
* reverted a file that accidentally went in cee5fa8 ([#3979](#3979)) ([d776a13](d776a13))
* Searching for a user/repository name throws error and crashes page ([#3980](#3980)) ([73f1c2c](73f1c2c))
* update PostHog SDK to latest version (1.152.7) ([#3996](#3996)) ([a5b7f3d](a5b7f3d))
@@ -30,8 +30,7 @@ test.describe("large screen", () => {
const dialog = await page.getByRole("dialog", { name: "Add repository to Workspace", exact: true });
await expect(dialog).toBeVisible();

await dialog.getByRole("button", { name: "Connect with GitHub", exact: true }).click();
await expect(page.url()).toContain("https://github.com/login");
expect(dialog.getByRole("button", { name: "Connect with GitHub", exact: true })).toBeVisible();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder why clicking it and checking for the Github login was flaky. I'll need to revisit this.

await expect(dialog).toBeVisible();

await dialog.getByRole("button", { name: "Connect with GitHub", exact: true }).click();
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we remove the remove the click, we can probably still check for the login button in the dialog, but again, need to see what's up with the click not firing consistently to check the login URL.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Chore: Fix Flaky E2E Tests Bug: Repository page throws a hydration error on smaller screens
4 participants