[
https://issues.apache.org/jira/browse/HADOOP-18328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17563649#comment-17563649
]
Daniel Carl Jones commented on HADOOP-18328:
--------------------------------------------
Dropping some additional context here:
- S3 on Outposts can only be accessed via an access point, not via a bucket
([https://docs.aws.amazon.com/AmazonS3/latest/userguide/S3OnOutpostsRestrictionsLimitations.html#S3OnOutpostsSpecifications])
- Using Java SDKs with S3 Outposts (no mention of endpoint conf). SDK
recognises outpost and signing region from the ARN typically.
[https://docs.aws.amazon.com/AmazonS3/latest/userguide/S3OutpostsGSCLIJava.html#S3OutpostsUploadObjects]
- There are more limitations which may be relevant - for instance, some
features are not available such as S3 Select.
> S3A supports S3 on Outposts
> ---------------------------
>
> Key: HADOOP-18328
> URL: https://issues.apache.org/jira/browse/HADOOP-18328
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Reporter: Sotetsu Suzugamine
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Currently, the endpoint for using S3 accesspoint is set as
> "s3-accesspoint.%s.amazonaws.com" as follows.
> [https://github.com/apache/hadoop/blob/3ec4b932c179d9ec6c4e465f25e35b3d7eded08b/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/ArnResource.java#L29]
> However, "s3-outposts.%s.amazonaws.com" is the preferred endpoint when
> accessing S3 on Outposts bucket by accesspoint.
> This ticket improves them.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
