-
Notifications
You must be signed in to change notification settings - Fork 817
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
LocalFileSystem Copy is not Atomic #4758
Labels
Comments
chebbyChefNEQ
added
the
enhancement
Any new improvement worthy of a entry in the changelog
label
Aug 31, 2023
tustvold
added
bug
and removed
enhancement
Any new improvement worthy of a entry in the changelog
labels
Aug 31, 2023
tustvold
changed the title
Support atomic copy semantic in
LocalFileSystem Copy is not Atomic
Aug 31, 2023
object_store
This is actually a bug, ObjectStore operations should be atomic except for where explicitly stated otherwise (append) |
tustvold
added a commit
to tustvold/arrow-rs
that referenced
this issue
Aug 31, 2023
This was referenced Sep 1, 2023
tustvold
added a commit
that referenced
this issue
Sep 2, 2023
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
In most object stores
copy
operation is atomic, the file will not appear partially written.However, on *nix,
copy
is usually not atomic and partially written file can appear.Describe the solution you'd like
It would be nice if
object_store
had aatomic_copy
apiDescribe alternatives you've considered
I have been doing
The text was updated successfully, but these errors were encountered: