[upload] Error with Protocol S3 on Fedora41

[TrevorBenson]

Using a non Amazon AWS S3 endpoint with upload protocol s3 results in error:

Upload attempt failed: Failed to upload to S3: Failed to upload /var/tmp/sosreport-fedora-2025-02-07-edtislu.tar.xz to sreport/XXXXXXXX/2025/01/sosreport-fedora-2025-02-07-edtislu.tar.xz: An error occurred (BadRequest) when calling the PutObject operation: trailing checksum is not supported

This was on Fedora 41. I went ahead and tested against Enterprise distros, instead of community workstation/desktops, as that is the primary platforms for my s3 upload use case. I confirmed that both EL8 with sos-4.7.2 and python3-boto3-1.15.15 and EL9 with sos-4.8.1 and python3-boto3-1.28.62 this error is not observed when running sos report --upload.

Due to the above tests working I figured it was specific to fedora and no ongoing work in sos which was also being tested. I found the same issue regardless of sos-4.8.2-1 and sos-4.8.0-1. I did however isolate it to when using python3-boto3-1.36.12-1.fc41. When I downgraded to python3-boto3-1.35.37-1.fc41 the error goes away and the s3 uploads to non AWS S3 endpoints once again work.

[pmoravec]

Maybe the problem is in the python3-boto3 library, then? If older version of the library works well..? (or do we use the library in some wrong way..?)

[TrevorBenson]

Maybe the problem is in the python3-boto3 library, then? If older version of the library works well..? (or do we use the library in some wrong way..?)

At the moment I'm not sure if boto3 has a bug, or simply made a change which was not backwards compatible.

I'll look into it more deeply and if it's a bug open an issue with that repository, if not I'll submit a fix here to address the change in method usage.

[TrevorBenson]

I suspect it's rooted in this current issue:
boto/boto3#4409

Yesterday I recall this error when testing non AWS buckets. Today I limited the report plugins to only the block plugin to speed up testing, which made the archive smaller than the default size for splitting MPU's, changing the error.