Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: improve stack margin for s3 related operations. #4731

Merged
merged 1 commit into from
Mar 9, 2025
Merged

fix: improve stack margin for s3 related operations. #4731

merged 1 commit into from
Mar 9, 2025

Conversation

romange
Copy link
Collaborator

@romange romange commented Mar 8, 2025

our S3 code relies on aws sdk client, which is extremely stack hungry.
this PR moves some of s3 calls to one-off fibers with increased stacks,
which reduces stack usage for connection fibers executing snapshot save/load operations.

Signed-off-by: Roman Gershman [email protected]

@romange romange force-pushed the Pr5 branch 3 times, most recently from 5168261 to a4992b6 Compare March 8, 2025 16:43
@romange
Copy link
Collaborator Author

romange commented Mar 8, 2025

the run with fiber_safety_margin=8000 is here: https://github.com/dragonflydb/dragonfly/actions/runs/13739554151

before this PR it failed in multiple places around the s3 code.

our S3 code relies on aws sdk client, which is extremely stack hungry.
this PR moves some of s3 calls to one-off fibers with increased stacks,
which reduces stack usage for connection fibers executing snapshot save/load operations.

Signed-off-by: Roman Gershman <[email protected]>
@romange romange merged commit 7c0eed6 into main Mar 9, 2025
10 checks passed
@romange romange deleted the Pr5 branch March 9, 2025 12:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants