Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust TPC-H testing on CI #1530

Merged
merged 10 commits into from
Aug 20, 2024
Merged

Adjust TPC-H testing on CI #1530

merged 10 commits into from
Aug 20, 2024

Conversation

hendrikmakait
Copy link
Member

I don't see a point in testing 10 GB workloads. If we're cost-conscious, I'd rather reduce the frequency of testing.



def upgrade() -> None:
op.execute("delete from tpch_run")
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will drop all existing records.

@fjetter
Copy link
Member

fjetter commented Aug 15, 2024

how long is one test run (compared to the rest of the suite)?

@hendrikmakait
Copy link
Member Author

hendrikmakait commented Aug 16, 2024

Coiled estimates that the cluster cost for test_dask.py increase from ~$0.14 to $2.70 per run, which will add up to an increase of ~$77/month. test_optimization.py increases from ~$0.10 to ~$0.34, adding up to an increase of ~$7/month.

@hendrikmakait
Copy link
Member Author

#1534 entirely disables all automated tests for PRs and reduces scheduled testing to once per week. This should mitigate cost concerns.

@hendrikmakait hendrikmakait merged commit 885e9f0 into main Aug 20, 2024
5 checks passed
@hendrikmakait hendrikmakait deleted the adjust-tpch-testing-on-ci branch August 20, 2024 14:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants