alamb commented on code in PR #3631: URL: https://github.com/apache/arrow-datafusion/pull/3631#discussion_r982854727
########## datafusion-cli/README.md: ########## @@ -65,6 +65,41 @@ DataFusion CLI v12.0.0 1 row in set. Query took 0.017 seconds. ``` +## Querying S3 Data Sources + +The CLI can query data in S3 if the following environment variables are defined: + +- `AWS_REGION` +- `AWS_ACCESS_KEY_ID` +- `AWS_SECRET_ACCESS_KEY` + +Note that the region must be set to the region where the bucket exists until the following issue is resolved: + +- https://github.com/apache/arrow-rs/issues/2795 + +Example: + +```bash +$ aws s3 cp test.csv s3://my-bucket/ +upload: ./test.csv to s3://my-bucket/test.csv + +$ export AWS_REGION=us-east-1 +$ export AWS_SECRET_ACCESS_KEY=*************************** +$ export AWS_ACCESS_KEY_ID=************** + +$ ./target/release/datafusion-cli Review Comment: this is so cool -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
