kevinjqliu opened a new issue, #35409: URL: https://github.com/apache/arrow/issues/35409
### Describe the enhancement requested ### Context While working with both `s3fs` and `pyarrow`, I noticed the difference in documentation regarding establishing AWS credentials. `s3fs` documentation explicitly mentions this scenario for using EC2 ``` Boto will try the following methods, in order: ... * for nodes on EC2, the IAM metadata provider ``` `pyarrow` documentation does not mention this behavior. After digging into `pyarrow` code and the C++ implementation, I was able to find that `pyarrow` will use IAM metadata provide in EC2 to establish credentials. Here's the PR to explain in depth and the associated change to the `pyarrow.fs.S3FileSystem` documentation: * MINOR: [S3FileSystem] Clarify S3FileSystem Credentials chain for EC2 #35312 ### Component(s) Documentation -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
