-
Notifications
You must be signed in to change notification settings - Fork 890
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
pkg/search/controllers_test: address flaky test [WIP] #5875
base: master
Are you sure you want to change the base?
pkg/search/controllers_test: address flaky test [WIP] #5875
Conversation
Signed-off-by: Mohamed Awnallah <[email protected]>
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Thanks~ @mohamedawnallah How does it work? |
@XiShanYongYe-Chang, I've updated the PR description how these changes may fix these flaky test cases. That said it may pass this time in CI, which isn't detrimental if the test cases are no longer flaky. I've run the test cases again locally 100 times, and all passed. One point I observed is that the shared informer sometimes doesn't receive changes, meaning the upserted cluster from the watch API in the fake client is not detected. As a result, the invoke handlers are not triggered, and the system waits in the queue for elements, leading to the timeout issue. I'm curious, though—are the unit tests in CI running in parallel? |
Codecov ReportAll modified and coverable lines are covered by tests ✅
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## master #5875 +/- ##
==========================================
+ Coverage 46.20% 46.26% +0.06%
==========================================
Files 663 663
Lines 54580 54621 +41
==========================================
+ Hits 25218 25272 +54
+ Misses 27739 27723 -16
- Partials 1623 1626 +3
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚨 Try these New Features:
|
@XiShanYongYe-Chang The unit tests passed this time in the CI. What do you think about the changes in this PR? We may also keep an eye on it since for every PR submitted to the repo the unit tests will be triggered? |
I'm leaning towards this, so that we can test a little more before we incorporate it. |
Hi @mohamedawnallah please remember to push this pr again from time to time every day. |
✅2️⃣ Unit tests passed on the second run—no flaky test cases: GitHub Actions Logs |
Description
This PR introduces two key changes, which may address flaky test cases:
What type of PR is this?
/kind flake
What this PR does / why we need it:
Which issue(s) this PR fixes:
There are flake tests regards some test cases in search controller as found in this PR #5864.
Special notes for your reviewer:
Does this PR introduce a user-facing change?: