Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change CDCRecordStream TableSchemaChanges from channel to slice #1135

Merged
merged 1 commit into from
Jan 24, 2024

Conversation

serprex
Copy link
Contributor

@serprex serprex commented Jan 23, 2024

Simpler alternative to #1134

Particularly convenient having exclusion info already transformed into maps/sets in pull connector

Idea is that CDCRecordStream is a synchronization object. While Records is open everything is written to only by pull connector, we only receive records out Records channel. Pull connector relieves write access once Records closed, allowing everything else to read out the rest. In this regard lastCheckpointSet is unnecessary & I eventually intend to get rid of it

@serprex serprex merged commit 63f3717 into main Jan 24, 2024
7 checks passed
@serprex serprex deleted the cdc-recordbatch-slice branch January 24, 2024 13:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants