Help configuring the S3 plugin

[Renier Morales]

Hello,

I’m having some trouble getting the AWS S3 storage plugin working and I’m 
wondering if I can get some pointers. I have been following the docs at 
https://drill.apache.org/docs/s3-storage-plugin/ and doing other searches 
online.

After running drill-embedded and going to http://localhost:8047/storage, I 
configured (and enabled) the S3 plugin with this (renaming things in the pasted 
config for security reasons):

{
  "type": "file",
  "connection": "s3a://bucket-name-here/“,
  "config": {
    "fs.s3a.secret.key": “secret access key here",
    "fs.s3a.access.key": “access key id here",
    "fs.s3a.endpoint": "s3.us-east-2.amazonaws.com",
    "fs.s3a.impl.disable.cache": "true"
  },
  "workspaces": {
    "root": {
      "location": "/",
      "writable": false,
      "defaultInputFormat": null,
      "allowAccessOutsideWorkspace": false
    }
  },
  "formats": {
    "parquet": {
      "type": "parquet"
    }
  },
  "authMode": "SHARED_USER",
  "enabled": true
}

Then in the drill-embedded console, I did this:

apache drill> SELECT * FROM s3.root.`/my-data.parquet`;
Error: VALIDATION ERROR: From line 1, column 15 to line 1, column 176: Object 
‘/my-data.parquet' not found within 's3.root'

[Error Id: a6691c3d-c5a7-47af-af51-3adb32c15b1b ] (state=,code=0)

I also did this, but got no files:

apache drill> USE s3.root;
+------+-------------------------------------+
|  ok  |               summary               |
+------+-------------------------------------+
| true | Default schema changed to [s3.root] |
+------+-------------------------------------+
1 row selected (0.188 seconds)
apache drill (s3.root)> SHOW files;
+------+-------------+--------+--------+-------+-------+-------------+------------+------------------+
| name | isDirectory | isFile | length | owner | group | permissions | 
accessTime | modificationTime |
+------+-------------+--------+--------+-------+-------+-------------+------------+------------------+
No rows selected (0.397 seconds)

I’m not seeing any 403 errors, so it can’t be permissions. I am basically 
copying the object key from the AWS S3 UI and pasting it between the ​`` with 
the forward slash added (tried without it, too).  I don’t know if my commands 
are just incorrect. Anything else I can look into?

Thank you.

-Renier