Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integration tests are flaky -- replace dataset sampling with top 50 datasets #215

Open
betolink opened this issue Mar 11, 2023 · 3 comments · May be fixed by #749
Open

Integration tests are flaky -- replace dataset sampling with top 50 datasets #215

betolink opened this issue Mar 11, 2023 · 3 comments · May be fixed by #749
Labels
enhancement New feature or request

Comments

@betolink
Copy link
Member

Right now the integration tests use randomly sampled datasets from different DAACs, this results in intermittent failures due EULAs/unavailability etc. A probably better approach would be to test only the most popular datasets (+IS2 data). A list of the most popular datasets from NASA is attached.
collection_short_names.txt

@MattF-NSIDC
Copy link

Maybe we could keep the random-sample test as an optional test suite? It would be useful to keep track of corner cases, but we wouldn't really want our main regression test suite to fail because of a new corner case.

@asteiker
Copy link
Member

@mfisher87 we're leaving this open for now knowing that it's likely resolved with #749. Are you still needing reviewers to move the PR forward? Lmk how I can help facilitate!

@mfisher87
Copy link
Collaborator

We do need more work on that PR. It's been tough moving it forward just during hack days! I think the remaining tasks are achievable without needing decision input, just requires some time.

@mfisher87 mfisher87 changed the title Test top 50 datasets Integration tests are flaky -- replace dataset sampling with top 50 datasets Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: 🆕 New
Development

Successfully merging a pull request may close this issue.

4 participants