[
https://issues.apache.org/jira/browse/ARROW-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196274#comment-17196274
]
Antoine Pitrou commented on ARROW-9775:
---------------------------------------
Notes to self:
- the "x-amz-bucket-region" header is always populated on return if the bucket
exists, even if it's the same region
- the HTTP status can be 301 for a public bucket, 403 if authentication will be
required
- HTTP status 404 means the bucket doesn't exist in any region
> [C++] Automatic S3 region selection
> -----------------------------------
>
> Key: ARROW-9775
> URL: https://issues.apache.org/jira/browse/ARROW-9775
> Project: Apache Arrow
> Issue Type: Wish
> Components: C++, Python
> Environment: macOS, Linux.
> Reporter: Sahil Gupta
> Assignee: Antoine Pitrou
> Priority: Major
> Labels: filesystem
> Fix For: 2.0.0
>
>
> Currently, PyArrow and ArrowCpp need to be provided the region of the S3
> file/bucket, else it defaults to using 'us-east-1'. Ideally, PyArrow and
> ArrowCpp can automatically detect the region and get the files, etc. For
> instance, s3fs and boto3 can read and write files without having to specify
> the region explicitly. Similar functionality to auto-detect the region would
> be great to have in PyArrow and ArrowCpp.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)