Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adjust TPC-H testing on CI #1530

Merged
merged 10 commits into from
Aug 20, 2024
6 changes: 1 addition & 5 deletions .github/workflows/tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -110,11 +110,7 @@ jobs:
run: |
echo PYTEST_MARKERS=" and not workflows" >> $GITHUB_ENV

- name: Disable non-Dask TPCH benchmarks on most PRs and on daily schedule (except Sundays)
if: |
matrix.name_prefix != 'tpch' ||
(github.event_name != 'schedule' || github.event.schedule != '1 0 * * 0') &&
(github.event_name != 'pull_request' || !contains(github.event.pull_request.labels.*.name, 'tpch'))
- name: Disable non-Dask TPCH benchmarks
run: |
echo PYTEST_MARKERS="${{ env.PYTEST_MARKERS }} and not tpch_nondask" >> $GITHUB_ENV

Expand Down
24 changes: 24 additions & 0 deletions alembic/versions/2d2405ad763b_drop_tpc_h_data.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
"""Drop TPC-H data

Revision ID: 2d2405ad763b
Revises: e11cd1aaed38
Create Date: 2024-08-15 13:54:45.251458

"""
from alembic import op
import sqlalchemy as sa


# revision identifiers, used by Alembic.
revision = '2d2405ad763b'
down_revision = 'e11cd1aaed38'
branch_labels = None
depends_on = None


def upgrade() -> None:
op.execute("delete from tpch_run")
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will drop all existing records.



def downgrade() -> None:
pass
2 changes: 1 addition & 1 deletion tests/tpch/conftest.py
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ def pytest_addoption(parser):
parser.addoption(
"--scale",
action="store",
default=10,
default=1000,
help="Scale to run, 10, 100, 1000, or 10000",
)
parser.addoption(
Expand Down
Loading