stevenayers commented on issue #5455:
URL: https://github.com/apache/hudi/issues/5455#issuecomment-1114609813
Thanks @rkkalluri. So while I'm able to run the following on the S3 location
the catalog points to:
```python
from boto3 import client
conn = client('s3'
conn.head_bucket(Bucket='olympus-dev-data-refined')
conn.list_objects(Bucket='olympus-dev-data-refined')
```
and receive a 200 response, when I run a version of your command above:
```python
input_dyf = glueContext.create_dynamic_frame.from_catalog(
database="db",
table_name="tble",
additional_options={"useS3ListImplementation": True, "groupFiles":
"inPartition"},
)
```
I get:
```
Py4JJavaError: An error occurred while calling o255.getDynamicFrame.
: com.amazonaws.services.s3.model.AmazonS3Exception: Forbidden (Service:
Amazon S3; Status Code: 403; Error Code: 403 Forbidden; Request ID:
31JC4RTFEXPTFTFH; S3 Extended Request ID:
qq+KRFeagbenCG9CEikohlGLPTDyftUz+MqoiMmw0XV6KlmBDXQmWxja4dE8tXvl5/sLF4nWhgQ=;
Proxy: null), S3 Extended Request ID:
qq+KRFeagbenCG9CEikohlGLPTDyftUz+MqoiMmw0XV6KlmBDXQmWxja4dE8tXvl5/sLF4nWhgQ=
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1819)
at
com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1403)
```
A few comments:
* The role has full S3 access
* Lake Formation is configured correctly
* I had to remove boundedSize and the bookmark as bookmarking is turned off
for now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
