Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Intermittent test failures - lru / hypothesis #616

Open
madwort opened this issue Jun 21, 2023 · 0 comments
Open

Intermittent test failures - lru / hypothesis #616

madwort opened this issue Jun 21, 2023 · 0 comments

Comments

@madwort
Copy link
Contributor

madwort commented Jun 21, 2023

the tests/lib/test_lru_dict.py intermittently fails in CI with a message like:

Unreliable test timings! On an initial run, this test took 251.43ms, which exceeded the deadline of 200.00ms, but on a subsequent run it took 43.48 ms, which did not. If you expect this sort of variability in your test timings, consider turning deadlines off for this test by setting deadline=None.

I think this test is run in six environments per PR/merge, increasing the chances that one of the tests will hit a slow case & fail due to this. Maybe we could turn off (or increase the timeout) for this test?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant