{
"type": "file",
"enabled": true,
"connection": "s3a://PATH.TO.BUCKET/",
"config": {
"fs.s3a.access.key": "<YOUR ACCESS KEY HERE>",
"fs.s3a.secret.key": "<YOUR SECRET KEY HERE>"
},
"workspaces": {
"root": {
"location": "/",
"writable": false,
"defaultInputFormat": null
},
"tmp": {
"location": "/tmp",
"writable": true,
"defaultInputFormat": null
}
},
"formats": {
"psv": {
"type": "text",
"extensions": [
"tbl"
],
"delimiter": "|"
},
"csv": {
"type": "text",
"extensions": [
"csv"
],
"delimiter": ","
},
"tsv": {
"type": "text",
"extensions": [
"tsv"
],
"delimiter": "\t"
},
"parquet": {
"type": "parquet"
},
"json": {
"type": "json",
"extensions": [
"json"
]
},
"avro": {
"type": "avro"
},
"sequencefile": {
"type": "sequencefile",
"extensions": [
"seq"
]
},
"csvh": {
"type": "text",
"extensions": [
"csvh"
],
"extractHeader": true,
"delimiter": ","
}
}
}
Jason Altekruse
Software Engineer at Dremio
Apache Drill Committer
On Wed, Apr 20, 2016 at 1:24 PM, Nick Monetta <[email protected]> wrote:
> Can you send me the full JSON for the new config example you provided? I
> keep getting JSON errors.
>
>
> Nick Monetta | INRIX |[email protected] |Movement Intelligence |
> www.inrix.com | mobile +1 646-248-4105 |
>
>
> -----Original Message-----
> From: Abhishek Girish [mailto:[email protected]]
> Sent: Wednesday, April 20, 2016 12:57 PM
> To: user <[email protected]>
> Subject: Re: Unable to connect to S3 parquet data using Drill
>
> Hey Trang,
>
> A similar issue related to S3 config was discussed today on the mailing
> list [1]. Can you see if that helps resolve the issue?
>
> [1]
>
> http://mail-archives.apache.org/mod_mbox/drill-dev/201604.mbox/%3CCAN6ttnukzsAKgQE-RTF0RNCvBr1uWsB9SaxnS_7y-v0yBdUj%3Dw%40mail.gmail.com%3E
>
>
> -Abhishek
>
> On Tue, Apr 19, 2016 at 6:38 PM, Trang Nguyen <[email protected]>
> wrote:
>
> > Hi,
> >
> > I am having trouble to connect to an Amazon S3 bucket containing
> > parquet files.
> > I followed the instructions on
> > https://drill.apache.org/docs/s3-storage-plugin/ to download
> > jets3_0.9.3 on my Ubuntu VM.
> > My storage configs:
> > {
> > "type": "file",
> > "enabled": true,
> > "connection": "s3://inrixprod-tapp",
> > "config": null,
> > "workspaces": {
> > "root": {
> > "location": "/",
> > "writable": false,
> > "defaultInputFormat": null
> > },
> > "tmp": {
> > "location": "/tmp",
> > "writable": true,
> > "defaultInputFormat": null
> > }
> > },
> > ...
> > }
> >
> > I've started the embedded-drill instance but get the following error
> > trying to connect:
> > 0: jdbc:drill:zk=local> use s3-trips.`root`;
> > Error: SYSTEM ERROR: IOException: / doesn't exist
> >
> >
> > [Error Id: 081c66e6-177d-48fa-8eca-4ee1370ae785 on
> > ubuntu-VirtualBox:31010] (state=,code=0)
> >
> > Any advice would be appreciated!
> >
> > Thanks,
> > Trang
> >
>
