Carl Boettiger created ARROW-17201:
--------------------------------------
Summary: Cannot override environmental variables setting region
Key: ARROW-17201
URL: https://issues.apache.org/jira/browse/ARROW-17201
Project: Apache Arrow
Issue Type: Improvement
Components: R
Affects Versions: 8.0.1
Reporter: Carl Boettiger
If a user has set the AWS_DEFAULT_REGION, there is no way we can override that
setting (especially to a null value) in a one-off call. Consider the following
example. This fails:
{code:java}
library(arrow)
Sys.setenv(AWS_DEFAULT_REGION="data")
noaa <- s3_bucket("neon4cast-drivers/",
endpoint_override = "data.ecoforecast.org",
anonymous = TRUE) {code}
If the env var is not set or unset, this succeeds. However, attempting to
override the region does not help:
{code:java}
noaa <- s3_bucket("neon4cast-drivers/",
endpoint_override = "data.ecoforecast.org",
region = "us-east-1",
anonymous = TRUE) {code}
(nor does it help to set the region to "", or NULL. – note this is a MINIO host
and so region is not needed anyway).
Relatedly, one might expect that AWS_S3_ENDPOINT could be used instead of
setting `endpoint_override`, but this does not seem to work either (lemme know
if you want that in a separate issue thread). At least on the plus side, the
above code does not fail if AWS_S3_ENDPOINT is set to some other value than
given in endpoint_override, so that is nice).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
