Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove workaround for ghost jobs caused by stale reads from SDB #1091

Open
cket opened this issue Jul 29, 2016 · 3 comments
Open

Remove workaround for ghost jobs caused by stale reads from SDB #1091

cket opened this issue Jul 29, 2016 · 3 comments
Labels
aws enhancement roadmap

Comments

@cket
Copy link
Contributor

cket commented Jul 29, 2016 •
edited by unito-bot
Loading

AWS is moving away from SDB in favor of DynamoDB. Switching would solve the inconsistency problems seen in #760 and increase scalability.

Once we moved the AWSJobSTore from SDB to DynamoDB, we should remove the workaround for #760. [edited by @hannes_ucsc]

┆Issue is synchronized with this Jira Story
┆Issue Number: TOIL-96
@hannes-ucsc
Copy link
Member

The way its written now, it would be a dupe of #964, but I will rewrite it.

@hannes-ucsc hannes-ucsc changed the title Replace SDB with DynamoDB Remove workaround for ghost jobs caused by stale reads from SDB Jul 29, 2016
@DailyDreaming DailyDreaming mentioned this issue Apr 15, 2020
Closed
@adamnovak
Copy link
Member

This also seems to need to apply to stale reads from inconsistent filesystems.

@adamnovak
Copy link
Member

This is going to be fixed by the fix for #3841.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
aws enhancement roadmap
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@adamnovak @hannes-ucsc @cket @DailyDreaming