[
https://issues.apache.org/jira/browse/HADOOP-18889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17772328#comment-17772328
]
ASF GitHub Bot commented on HADOOP-18889:
-----------------------------------------
steveloughran commented on PR #6141:
URL: https://github.com/apache/hadoop/pull/6141#issuecomment-1749420283
new commit now works properly with GCS except for some known test failures!
Docs cover the details...the key thing is s3a can handle it if you don't have
the gcs-connector. No idea about performance diffs. I know gcs does some things
with caching parquet footers etc, but s3a offers vector io.
also i've somehow got multipart playing up. will look at.
> S3A: V2 SDK client does not work with third-party store
> -------------------------------------------------------
>
> Key: HADOOP-18889
> URL: https://issues.apache.org/jira/browse/HADOOP-18889
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Critical
> Labels: pull-request-available
>
> testing against an external store without specifying region now blows up
> because the region is queried off eu-west-1.
> What are we do to here? require the region setting *which wasn't needed
> before? what even region do we provide for third party stores?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
