Revathi Vijay created HADOOP-19588:
--------------------------------------
Summary: Add support for S3express in S3A
Key: HADOOP-19588
URL: https://issues.apache.org/jira/browse/HADOOP-19588
Project: Hadoop Common
Issue Type: Improvement
Components: fs/s3
Affects Versions: 3.4.1, 3.4.0
Reporter: Revathi Vijay
Fix For: 3.4.1, 3.4.0
Currently, the endpoint for using S3 accesspoint is resolved for S3 and S3 on
outposts:
https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/ArnResource.java#L29-L30
However, for s3express, the endpoint is
"s3express-<zoneId>.<region>.amazonaws.com".
This ticket adds support for s3express endpoint.
Additionally, for access objects using s3express in the `S3AFileSystem`, we
need to parse the access point ARN for an S3express access point into the
access point name, since ARNs aren't supported on S3express other than in IAM
policies.
(https://docs.aws.amazon.com/AmazonS3/latest/userguide/access-points-directory-buckets-restrictions-limitations-naming-rules.html).
This ticket also addresses this change.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
