You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In the (rare) case where multiple input files are uploaded to S3 with the same name, they will overwrite one another. This can occur when processing Parquet files, where each file ends up with a name like part.N.parquet.
We need to update the code to check whether files are identically named and to append additional metadata to their names to prevent collisions in this instance.
The text was updated successfully, but these errors were encountered:
In the (rare) case where multiple input files are uploaded to S3 with the same name, they will overwrite one another. This can occur when processing Parquet files, where each file ends up with a name like
part.N.parquet
.We need to update the code to check whether files are identically named and to append additional metadata to their names to prevent collisions in this instance.
The text was updated successfully, but these errors were encountered: