After spending a day or two, I found the solution to the issue. We need to
add the following snippet in the core-site.xml
fs.s3a.aws.credentials.provider
com.amazonaws.auth.InstanceProfileCredentialsProvider
This explicitly tells drill to use that mode of fetching credentials
instead of rel
Hi ,
I did try that before and it did not work. I was not able to find it in the
documentation
Thanks
Nitin
On Mon, Sep 17, 2018 at 3:37 PM Khurram Faraaz wrote:
> Hi Nitin,
>
> You can read the details from here -
> http://drill-user.incubator.apache.narkive.com/mP5GE7fq/s3-using-iam-roles
>
Hi Nitin,
You can read the details from here -
http://drill-user.incubator.apache.narkive.com/mP5GE7fq/s3-using-iam-roles
A drill user hit the same issue in the past and he has documented the steps
for others to benefit. Hope that helps.
Regards,
Khurram
On Mon, Sep 17, 2018 at 2:20 PM, Nitin S
Hello,
I am trying to setup drill in distributed mode and access some parquet
files in S3. The instructions here:
https://drill.apache.org/docs/s3-storage-plugin/ do not provide any info
on what to do if we are using IAM roles for S3 (instead of static keys)
Kindly advise how to set that up.
Th