Martijn Visser created FLINK-41587:
--------------------------------------
Summary: Bump the SeaweedFS test image to 4.54
Key: FLINK-41587
URL: https://issues.apache.org/jira/browse/FLINK-41587
Project: Flink
Issue Type: Technical Debt
Components: Tests
Reporter: Martijn Visser
The SeaweedFS image that our S3 tests use (chrislusf/seaweedfs:4.47, in
DockerImageVersions and common_s3_seaweedfs.sh) mishandles the trailing
checksum of aws-chunked uploads. When the trailer lines arrive in separate TCP
segments, it rejects the request with "400 The Content-Md5 you specified is not
valid", see https://github.com/seaweedfs/seaweedfs/issues/11582. AWS SDK v2
sends this trailer by default on every PutObject and UploadPart.
With s3.crt.enabled=true, every write from flink-s3-fs-native fails this way,
because the CRT HTTP client sends the trailer in small pieces. The default
Apache client can hit it too, depending on how the body is split in transit.
Real S3 accepts the same requests.
SeaweedFS fixed this in 4.49.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)