Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cleanup test schema in connector tests #24823

Merged
merged 2 commits into from
Jan 30, 2025

Conversation

anusudarsan
Copy link
Member

@anusudarsan anusudarsan commented Jan 28, 2025

Release notes

(x) This is not user-visible or is docs only, and no release notes are required.

@cla-bot cla-bot bot added the cla-signed label Jan 28, 2025
@anusudarsan anusudarsan requested a review from ebyhr January 28, 2025 15:25
@github-actions github-actions bot added the bigquery BigQuery connector label Jan 28, 2025
@anusudarsan anusudarsan force-pushed the anu/cleanup-test-schema-bq branch 4 times, most recently from d82cf20 to 43a2da7 Compare January 28, 2025 15:36
try {
assertUpdate("CREATE SCHEMA " + schemaName);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure why we need this change. Could you share the motivation?

Copy link
Member Author

@anusudarsan anusudarsan Jan 28, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there were left over schema in bigquery from this test (not sure what exact CI failures) because of unproper cleanup. Over time this (and other tests being fixed here) caused a lot of schema left behind causing read timeout in BQ intermittently while getting schema

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a real issue, not specific to tests. We should suppress a timeout failure then the schema is created remotely like #13242. Could you file an issue to track this?

@ebyhr
Copy link
Member

ebyhr commented Jan 28, 2025

/test-with-secrets sha=43a2da76743abe38a71c20e704167006c5ca1d96

Copy link

github-actions bot commented Jan 28, 2025

The CI workflow run with tests that require additional secrets finished as failure: https://github.com/trinodb/trino/actions/runs/13020639959

@anusudarsan anusudarsan force-pushed the anu/cleanup-test-schema-bq branch from 43a2da7 to 7ec29af Compare January 28, 2025 22:55
@anusudarsan
Copy link
Member Author

I rebased on latest master. Please retrigger the CI with secrets. The failures looked unrelated

@ebyhr
Copy link
Member

ebyhr commented Jan 28, 2025

@anusudarsan Could you confirm my review comments?

@anusudarsan anusudarsan force-pushed the anu/cleanup-test-schema-bq branch 2 times, most recently from fd3eed0 to 61a3000 Compare January 28, 2025 23:47
@anusudarsan
Copy link
Member Author

@anusudarsan Could you confirm my review comments?

done

try {
assertUpdate("CREATE SCHEMA " + schemaName);
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a real issue, not specific to tests. We should suppress a timeout failure then the schema is created remotely like #13242. Could you file an issue to track this?

@ebyhr
Copy link
Member

ebyhr commented Jan 28, 2025

/test-with-secrets sha=61a3000047f33b92c498b51d03678e2267d6f8a6

Copy link

github-actions bot commented Jan 28, 2025

The CI workflow run with tests that require additional secrets finished as failure: https://github.com/trinodb/trino/actions/runs/13021759543

@ebyhr
Copy link
Member

ebyhr commented Jan 29, 2025

@anusudarsan Could you confirm CI failure? https://github.com/trinodb/trino/actions/runs/13021759543/job/36323735412

@anusudarsan anusudarsan force-pushed the anu/cleanup-test-schema-bq branch from 61a3000 to f5945f8 Compare January 29, 2025 14:05
@ebyhr
Copy link
Member

ebyhr commented Jan 29, 2025

/test-with-secrets sha=f5945f8aeb01f6143a69aa80ea0b6ab51e32946b

Copy link

github-actions bot commented Jan 29, 2025

The CI workflow run with tests that require additional secrets finished as failure: https://github.com/trinodb/trino/actions/runs/13041977312

@ebyhr ebyhr merged commit 02eeb21 into trinodb:master Jan 30, 2025
92 of 93 checks passed
@github-actions github-actions bot added this to the 470 milestone Jan 30, 2025
@anusudarsan anusudarsan deleted the anu/cleanup-test-schema-bq branch January 30, 2025 18:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bigquery BigQuery connector cla-signed
Development

Successfully merging this pull request may close these issues.

3 participants