[
https://issues.apache.org/jira/browse/HADOOP-19654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18035892#comment-18035892
]
ASF GitHub Bot commented on HADOOP-19654:
-----------------------------------------
ahmarsuhail commented on code in PR #7882:
URL: https://github.com/apache/hadoop/pull/7882#discussion_r2499741481
##########
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/impl/ITestS3APutIfMatchAndIfNoneMatch.java:
##########
@@ -390,7 +416,7 @@ public void testIfNoneMatchOverwriteWithEmptyFile() throws
Throwable {
// close the stream, should throw RemoteFileChangedException
RemoteFileChangedException exception =
intercept(RemoteFileChangedException.class, stream::close);
- assertS3ExceptionStatusCode(SC_412_PRECONDITION_FAILED, exception);
+ verifyS3ExceptionStatusCode(SC_412_PRECONDITION_FAILED, exception);
Review Comment:
checked..the answer is that it's MPU that has divergence, put object which
these tests do will return 412
##########
hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/third_party_stores.md:
##########
@@ -414,7 +480,47 @@ Fix: path style access
</property>
```
-# Connecting to Google Cloud Storage through the S3A connector
+# Settings for Specific Stores
+
+## Dell ECS through the S3A Connector
+
+As of November 2025 and the 2.35.4 AWS SDK, the settings needed to interact
with Dell ECS
+at [ECS Test Drive](https://portal.ecstestdrive.com/) were
+
+```xml
+<property>
+ <name>fs.s3a.region</name>
+ <value>region</value>
+ <description>arbitrary name</description>
+</property>
+
+<property>
+ <name>fs.s3a.endpoint.region</name>
+ <value>region</value>
+</property>
+
+<property>
+ <name>fs.s3a.path.style.access</name>
+ <value>true</value>
+</property>
+
+<property>
+ <name>fs.s3a.create.conditional.enabled</name>
+ <value>false</value>
+</property>
+
+<property>
+ <name>fs.s3a.request.md5.header</name>
+ <value>false</value>
Review Comment:
confused - I thought this should be true, otherwise the SDK won't generate
the MD5's, which was causing the compatibility issues with third party stores?
> Upgrade AWS SDK to 2.35.4
> -------------------------
>
> Key: HADOOP-19654
> URL: https://issues.apache.org/jira/browse/HADOOP-19654
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build, fs/s3
> Affects Versions: 3.5.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Major
> Labels: pull-request-available
>
> Upgrade to a recent version of 2.33.x or later while off the critical path of
> things.
> HADOOP-19485 froze the sdk at a version which worked with third party stores.
> Apparently the new version works; early tests show that Bulk Delete calls
> with third party stores complain about lack of md5 headers, so some tuning is
> clearly going to be needed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
