Re: How to authenticate to ADLS from within spark job on the fly

2017-08-19 Thread Imtiaz Ahmed
that make sense? Imtiaz On Sat, Aug 19, 2017 at 7:04 AM, Steve Loughran <ste...@hortonworks.com> wrote: > > On 19 Aug 2017, at 02:42, Imtiaz Ahmed <emtiazah...@gmail.com> wrote: > > Hi All, > > I am building a spark library which developers will use when writing their >

How to authenticate to ADLS from within spark job on the fly

2017-08-18 Thread Imtiaz Ahmed
Hi All, I am building a spark library which developers will use when writing their spark jobs to get access to data on Azure Data Lake. But the authentication will depend on the dataset they ask for. I need to call a rest API from within spark job to get credentials and authenticate to read data