[
https://issues.apache.org/jira/browse/DRILL-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matt Keranen updated DRILL-7197:
--------------------------------
Description:
Attempting to create Parquet tables from JSON data both within an on premises
Minio S3A cluster.
Able to SELECT from local S3 storage (Minio), but CTAS seems to be trying to go
to Amazon S3:
SELECT * FROM s3.logs LIMIT 1;
works, but
CREATE TABLE s3.logs.`test` SELECT ... FROM s3.logs
results in error:
{{Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service: Amazon
S3, AWS Request ID: XXX, AWS Error Code: InvalidAccessKeyId, AWS Error Message:
The AWS Access Key Id you provided does not exist in our records.}}
was:
Able to SELECT from local S3 storage (Minio), but CTAS seems to be trying to go
to Amazon S3:
SELECT * FROM s3.logs LIMIT 1;
works, but
CREATE TABLE s3.logs.`test` SELECT ... FROM s3.logs
results in error:
{{Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service: Amazon
S3, AWS Request ID: XXX, AWS Error Code: InvalidAccessKeyId, AWS Error Message:
The AWS Access Key Id you provided does not exist in our records.}}
> Drill attempts to create table on Amazon when configured for on premise S3A
> ---------------------------------------------------------------------------
>
> Key: DRILL-7197
> URL: https://issues.apache.org/jira/browse/DRILL-7197
> Project: Apache Drill
> Issue Type: Bug
> Components: Server
> Affects Versions: 1.15.0
> Environment: On premises 4 node Minio S3A storage cluster:
> {
> {{ "type": "file",}}
> {{ "connection": "s3a://logs",}}
> {{ "config": {}}
> {{ "fs.s3a.endpoint": "x.x.x.x:9001",}}
> {{ "fs.s3a.connection.ssl.enabled": "false",}}
> {{ "fs.s3a.access.key": "xxx",}}
> {{ "fs.s3a.secret.key": "xxx"}}
> {{ },}}
> {{ "workspaces": {}}
> {{ "tmp": {}}
> {{ "location": "/tmp",}}
> {{ "writable": true,}}
> {{ "defaultInputFormat": null,}}
> {{ "allowAccessOutsideWorkspace": false}}
> {{ },}}
> {{ "logs": {}}
> {{ "location": "/",}}
> {{ "writable": true,}}
> {{ "defaultInputFormat": null,}}
> {{ "allowAccessOutsideWorkspace": false }}
> {{ }}}
> },
> Reporter: Matt Keranen
> Priority: Major
>
> Attempting to create Parquet tables from JSON data both within an on premises
> Minio S3A cluster.
> Able to SELECT from local S3 storage (Minio), but CTAS seems to be trying to
> go to Amazon S3:
> SELECT * FROM s3.logs LIMIT 1;
> works, but
> CREATE TABLE s3.logs.`test` SELECT ... FROM s3.logs
> results in error:
> {{Error: SYSTEM ERROR: AmazonS3Exception: Status Code: 403, AWS Service:
> Amazon S3, AWS Request ID: XXX, AWS Error Code: InvalidAccessKeyId, AWS Error
> Message: The AWS Access Key Id you provided does not exist in our records.}}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
