Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: close and recreate destination connections during syncflow when needed #1735

Merged
merged 8 commits into from
May 29, 2024

Conversation

iamKunalGupta
Copy link
Member

No description provided.

@serprex
Copy link
Contributor

serprex commented May 20, 2024

why is this needed?

@serprex serprex self-requested a review May 20, 2024 18:04
@iamKunal
Copy link

This was to try and fix read timeouts on clickhouse on one of the customers. We are opening connections at the start of pull but we re-need it only when starting the push.

@serprex
Copy link
Contributor

serprex commented May 20, 2024

Better would be to lazily open connection after constructor called. First dstConn is only looking up data from catalog

@iamKunalGupta
Copy link
Member Author

Better would be to lazily open connection after constructor called. First dstConn is only looking up data from catalog

That also makes sense

@CLAassistant
Copy link

CLAassistant commented May 21, 2024

CLA assistant check
All committers have signed the CLA.

@iamKunalGupta iamKunalGupta changed the title fix: close and recreate destination when needed fix: close and recreate destination connections during syncflow when needed May 23, 2024
@Amogh-Bharadwaj Amogh-Bharadwaj requested a review from serprex May 24, 2024 15:31
@Amogh-Bharadwaj Amogh-Bharadwaj merged commit f97f78b into main May 29, 2024
7 checks passed
@Amogh-Bharadwaj Amogh-Bharadwaj deleted the fix/recreate-destination-connector branch May 29, 2024 14:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants