Nlte edited a comment on issue #56:
URL: https://github.com/apache/arrow-cookbook/issues/56#issuecomment-914470885
Ah my bad I've tried again without any aws configuration on my local laptop
this time and test passes.
It was pyarrow loading the aws credentials from env vars or
~/.aws/credentials and signing requests with those credentials that made it
failed.
But the bucket is indeed open to public.
The only solution I see would be to pass an anonymous filesystem. This
passes regardless or what's configured on the machine.
```
from pyarrow import fs
s3 = fs.S3FileSystem(region="us-east-2", anonymous=True)
dataset = ds.dataset("ursa-labs-taxi-data/2011/",
partitioning=["month"], filesystem=s3)
```
However it makes the simple example more complex.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
