Re: S3 Storage Plugin - IAM roles support

2018-09-19 Thread Nitin S
After spending a day or two, I found the solution to the issue. We need to add the following snippet in the core-site.xml fs.s3a.aws.credentials.provider com.amazonaws.auth.InstanceProfileCredentialsProvider This explicitly tells drill to use that mode of fetching credentials instead of rel

Re: S3 Storage Plugin - IAM roles support

2018-09-17 Thread Nitin S
Hi , I did try that before and it did not work. I was not able to find it in the documentation Thanks Nitin On Mon, Sep 17, 2018 at 3:37 PM Khurram Faraaz wrote: > Hi Nitin, > > You can read the details from here - > http://drill-user.incubator.apache.narkive.com/mP5GE7fq/s3-using-iam-roles >

Re: S3 Storage Plugin - IAM roles support

2018-09-17 Thread Khurram Faraaz
Hi Nitin, You can read the details from here - http://drill-user.incubator.apache.narkive.com/mP5GE7fq/s3-using-iam-roles A drill user hit the same issue in the past and he has documented the steps for others to benefit. Hope that helps. Regards, Khurram On Mon, Sep 17, 2018 at 2:20 PM, Nitin S

S3 Storage Plugin - IAM roles support

2018-09-17 Thread Nitin S
Hello, I am trying to setup drill in distributed mode and access some parquet files in S3. The instructions here: https://drill.apache.org/docs/s3-storage-plugin/ do not provide any info on what to do if we are using IAM roles for S3 (instead of static keys) Kindly advise how to set that up. Th