Re: Do i need hadoop installed to use dfs storage?

[Nathan Griffith]

Hi Scott,

You definitely don't need to have Hadoop to query your local file system.
Could you list the exact command to Drill that gave you this error?

Best,

Nathan Griffith
Technical Writer
Dremio

On Tue, May 31, 2016 at 1:26 PM, Scott Kinney  wrote:

>
> I'm trying to test running drill on gz json files in s3 and i keep getting.
>
>
> VALIDATION ERROR: From line 1, column 15 to line 1, column 17: Table
> 's3_file.gz' not found
>
>
> I downloaded the file and unzipped it, setup a new storage plugin to point
> to the local file
>
>
> {
>   "type": "file",
>   "enabled": true,
>   "connection": "file:///tmp/data/",
>   "config": null,
>   "workspaces": {
> "root": {
>   "location": "/",
>   "writable": false,
>   "defaultInputFormat": "json"
> },
> ...
>
> And i get the same thing.
> I do not have hadoop installed. do i need it?
>
> Thanks,
>
>
>
> 
> Scott Kinney | DevOps
> stem    |   m  510.282.1299
> 100 Rollins Road, Millbrae, California 94030
>
> This e-mail and/or any attachments contain Stem, Inc. confidential and
> proprietary information and material for the sole use of the intended
> recipient(s). Any review, use or distribution that has not been expressly
> authorized by Stem, Inc. is strictly prohibited. If you are not the
> intended recipient, please contact the sender and delete all copies. Thank
> you.
>

Do i need hadoop installed to use dfs storage?

[Scott Kinney]

I'm trying to test running drill on gz json files in s3 and i keep getting.


VALIDATION ERROR: From line 1, column 15 to line 1, column 17: Table 
's3_file.gz' not found


I downloaded the file and unzipped it, setup a new storage plugin to point to 
the local file


{
  "type": "file",
  "enabled": true,
  "connection": "file:///tmp/data/",
  "config": null,
  "workspaces": {
"root": {
  "location": "/",
  "writable": false,
  "defaultInputFormat": "json"
},
...

And i get the same thing.
I do not have hadoop installed. do i need it?

Thanks,




Scott Kinney | DevOps
stem    |   m  510.282.1299
100 Rollins Road, Millbrae, California 94030

This e-mail and/or any attachments contain Stem, Inc. confidential and 
proprietary information and material for the sole use of the intended 
recipient(s). Any review, use or distribution that has not been expressly 
authorized by Stem, Inc. is strictly prohibited. If you are not the intended 
recipient, please contact the sender and delete all copies. Thank you.