Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

adding visibility into current mirror state #657

Closed
wants to merge 3 commits into from

Conversation

heavycrystal
Copy link
Contributor

@heavycrystal heavycrystal commented Nov 14, 2023

breaks some protos and routes for clearer naming conventions, UI needs to be updated accordingly

removes SetupComplete and SnapshotComplete booleans in CDCFlowState in favour of a CurrentFlowState that expresses all states of a CDC workflow in a single variable.

@serprex
Copy link
Contributor

serprex commented Nov 14, 2023

If protos are breaking, could also remove deprecated fields

if err != nil {
return nil, err
}
_, err = h.ShutdownFlow(ctx, &protos.ShutdownRequest{
Copy link
Contributor

@serprex serprex Nov 14, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Calling ShutdownFlow doesn't seem related to visibility. Is the purpose of this call to reduce latency to start terminating?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is to preserve existing behavior that waits till the workflow terminates before returning, while also ensuring we go from STATUS_TERMINATING -> STATUS_TERMINATED

@@ -414,7 +414,7 @@ func (s *PeerFlowE2ETestSuiteSF) Test_Toast_SF(t *testing.T) {
// in a separate goroutine, wait for PeerFlowStatusQuery to finish setup
// and execute a transaction touching toast columns
go func() {
e2e.SetupCDCFlowStatusQuery(env, connectionGen)
e2e.SetupCDCFlowStateQuery(env, connectionGen)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Moving renaming into a separate PR would make this easier to review

@serprex
Copy link
Contributor

serprex commented Nov 14, 2023

PR description should explain why cdc flow SetupComplete/SnapshotComplete bools are changed into CurrentFlowState *protos.FlowStatus

Was there a correctness issue? Was it not allowing enough info for pausing/terminating to be shown while in progress? Is there future improvements which this change is considering?

@heavycrystal heavycrystal force-pushed the mirror-status-reporting branch 2 times, most recently from e6d5827 to 24821ef Compare November 15, 2023 15:31
@heavycrystal heavycrystal force-pushed the mirror-status-reporting branch from 24821ef to e720a67 Compare November 23, 2023 16:50
@heavycrystal heavycrystal marked this pull request as draft December 26, 2023 18:59
iskakaushik added a commit that referenced this pull request Jan 3, 2024
breaks some protos and routes for clearer naming conventions, UI needs to be updated accordingly

removes SetupComplete and SnapshotComplete booleans in CDCFlowState in favour of a CurrentFlowState that expresses all states of a CDC workflow in a single variable.

rebase of PR: #657
@iskakaushik iskakaushik closed this Jan 3, 2024
iskakaushik added a commit that referenced this pull request Jan 3, 2024
breaks some protos and routes for clearer naming conventions, UI needs
to be updated accordingly

removes SetupComplete and SnapshotComplete booleans in CDCFlowState in
favour of a CurrentFlowState that expresses all states of a CDC workflow
in a single variable.

rebase of PR: #657

---------

Co-authored-by: Kevin Biju <[email protected]>
@serprex serprex deleted the mirror-status-reporting branch July 19, 2024 15:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants