Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prevent concurrent crud sweeps and add proper cleanup #10865

Closed
wants to merge 1 commit into from

Conversation

endline
Copy link
Contributor

@endline endline commented Dec 30, 2024

The CRUD sweep mechanism was running more frequently than intended due to lack of proper goroutine management.

  • Adds mutex protection to prevent concurrent sweeps
  • Implements proper goroutine cleanup with stop channels
  • Adds sync.Once to prevent multiple starts/stops
  • Adds proper resource cleanup on shutdown
  • Stagger initial sweeps to prevent thundering herd

This should reduce the load on /internal/crud/sweep endpoints.

The CRUD sweep mechanism was running more frequently than intended due to
lack of proper goroutine management. This commit:

- Adds mutex protection to prevent concurrent sweeps
- Implements proper goroutine cleanup with stop channels
- Adds sync.Once to prevent multiple starts/stops
- Adds proper resource cleanup on shutdown
- Stagger initial sweeps to prevent thundering herd

This should reduce the load on /internal/crud/sweep endpoints
Copy link

changeset-bot bot commented Dec 30, 2024

⚠️ No Changeset found

Latest commit: dbf1cc7

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@endline endline requested review from stereosteve and removed request for stereosteve December 30, 2024 19:16
@endline endline marked this pull request as draft December 30, 2024 19:31
@endline endline closed this Jan 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant