RE: Enable HTTP Basic Authenticaton for Livy Rest APIs
Thanks Kevin. But we're Cloudera shop and utilizing SAML architecture for authentication/architecture and Knox is not supported by Cloudera. I'm now exploring the option of utilizing Jupyter Hub with OAuth. From: Kevin Risden [mailto:kris...@apache.org] Sent: Tuesday, October 16, 2018 12:52 PM To: user@livy.incubator.apache.org Subject: Re: Enable HTTP Basic Authenticaton for Livy Rest APIs One option that is available today is to use Apache Knox [1]. Apache Knox supports Livy [2] as a backend and a lot of different options for authentication [3]. 1. https://knox.apache.org/ 2. https://knox.apache.org/books/knox-1-1-0/user-guide.html#Livy+Server 3. https://knox.apache.org/books/knox-1-1-0/user-guide.html#Authentication Kevin Risden On Fri, Oct 5, 2018 at 7:05 PM Santosh Dandey mailto:dd.sant...@gmail.com>> wrote: Thanks On Fri, Oct 5, 2018, 6:03 PM Marcelo Vanzin mailto:van...@cloudera.com>> wrote: As I mentioned in my e-mail, there's already work to support generic auth methods. Once that's in you can plug in your own authentication filter to Livy. On Fri, Oct 5, 2018 at 4:00 PM Santosh Dandey mailto:dd.sant...@gmail.com>> wrote: Vanzin, I would like to implement this change to tailor our Enterprise requirements. Is there any developments guidelined available to get me started to change the code? On Fri, Oct 5, 2018, 2:50 PM Marcelo Vanzin mailto:van...@cloudera.com>> wrote: I don't think Livy currently has support for basic auth. Although this PR would allow you to set up your own custom auth configuration: https://github.com/apache/incubator-livy/pull/110 On Thu, Oct 4, 2018 at 2:34 PM mailto:santosh.dan...@ubs.com>> wrote: I'm Santosh Dandey, I'm working at UBS as one of the lead-developer for a Big Data Project. We are working on enabling Jupyter notebook as a data-science tool for data-scientists. I have below setup that's working good in my local environment without any authentication between spark-magic and Livy. I have to implement security for SparkMagic and Apache Livy. On Spark Magic it says I can enable HTTP Basic Authentication if it's enabled in Livy. How do I enable HTTP Basic authentication in livy? How can we enable basic-authentication on Livy? Is there any specific configuration that I have to set on livy.conf to enable basic authentication. Did anyone had luck implementing basic authentication? I appreciate if you can provide any help here. Thanks Santosh Error! Filename not specified. -- Marcelo -- Marcelo Please visit our website at http://financialservicesinc.ubs.com/wealth/E-maildisclaimer.html for important disclosures and information about our e-mail policies. For your protection, please do not transmit orders or instructions by e-mail or include account numbers, Social Security numbers, credit card numbers, passwords, or other personal information.
Re: Enable HTTP Basic Authenticaton for Livy Rest APIs
One option that is available today is to use Apache Knox [1]. Apache Knox supports Livy [2] as a backend and a lot of different options for authentication [3]. 1. https://knox.apache.org/ 2. https://knox.apache.org/books/knox-1-1-0/user-guide.html#Livy+Server 3. https://knox.apache.org/books/knox-1-1-0/user-guide.html#Authentication Kevin Risden On Fri, Oct 5, 2018 at 7:05 PM Santosh Dandey wrote: > Thanks > > On Fri, Oct 5, 2018, 6:03 PM Marcelo Vanzin wrote: > >> As I mentioned in my e-mail, there's already work to support generic auth >> methods. Once that's in you can plug in your own authentication filter to >> Livy. >> >> On Fri, Oct 5, 2018 at 4:00 PM Santosh Dandey >> wrote: >> >>> Vanzin, >>> >>> I would like to implement this change to tailor our Enterprise >>> requirements. >>> >>> Is there any developments guidelined available to get me started to >>> change the code? >>> >>> On Fri, Oct 5, 2018, 2:50 PM Marcelo Vanzin wrote: >>> I don't think Livy currently has support for basic auth. Although this PR would allow you to set up your own custom auth configuration: https://github.com/apache/incubator-livy/pull/110 On Thu, Oct 4, 2018 at 2:34 PM wrote: > I'm Santosh Dandey, I'm working at UBS as one of the lead-developer > for a Big Data Project. We are working on enabling Jupyter notebook as a > data-science tool for data-scientists. I have below setup that's working > good in my local environment without any authentication between > spark-magic > and Livy. > > I have to implement security for SparkMagic and Apache Livy. On Spark > Magic it says I can enable HTTP Basic Authentication if it's enabled in > Livy. How do I enable HTTP Basic authentication in livy? > > > > How can we enable basic-authentication on Livy? Is there any specific > configuration that I have to set on livy.conf to enable basic > authentication. > > > > Did anyone had luck implementing basic authentication? I appreciate > if you can provide any help here. > > > > Thanks > > Santosh > > > > [image: cid:image003.png@01D45BF9.4FC434F0] > -- Marcelo >>> >> >> -- >> Marcelo >> >
Re: Enable HTTP Basic Authenticaton for Livy Rest APIs
As I mentioned in my e-mail, there's already work to support generic auth methods. Once that's in you can plug in your own authentication filter to Livy. On Fri, Oct 5, 2018 at 4:00 PM Santosh Dandey wrote: > Vanzin, > > I would like to implement this change to tailor our Enterprise > requirements. > > Is there any developments guidelined available to get me started to change > the code? > > On Fri, Oct 5, 2018, 2:50 PM Marcelo Vanzin wrote: > >> I don't think Livy currently has support for basic auth. >> >> Although this PR would allow you to set up your own custom auth >> configuration: >> https://github.com/apache/incubator-livy/pull/110 >> >> >> On Thu, Oct 4, 2018 at 2:34 PM wrote: >> >>> I'm Santosh Dandey, I'm working at UBS as one of the lead-developer for >>> a Big Data Project. We are working on enabling Jupyter notebook as a >>> data-science tool for data-scientists. I have below setup that's working >>> good in my local environment without any authentication between spark-magic >>> and Livy. >>> >>> I have to implement security for SparkMagic and Apache Livy. On Spark >>> Magic it says I can enable HTTP Basic Authentication if it's enabled in >>> Livy. How do I enable HTTP Basic authentication in livy? >>> >>> >>> >>> How can we enable basic-authentication on Livy? Is there any specific >>> configuration that I have to set on livy.conf to enable basic >>> authentication. >>> >>> >>> >>> Did anyone had luck implementing basic authentication? I appreciate if >>> you can provide any help here. >>> >>> >>> >>> Thanks >>> >>> Santosh >>> >>> >>> >>> [image: cid:image003.png@01D45BF9.4FC434F0] >>> >> >> >> -- >> Marcelo >> > -- Marcelo
Enable HTTP Basic Authenticaton for Livy Rest APIs
I'm Santosh Dandey, I'm working at UBS as one of the lead-developer for a Big Data Project. We are working on enabling Jupyter notebook as a data-science tool for data-scientists. I have below setup that's working good in my local environment without any authentication between spark-magic and Livy. I have to implement security for SparkMagic and Apache Livy. On Spark Magic it says I can enable HTTP Basic Authentication if it's enabled in Livy. How do I enable HTTP Basic authentication in livy? How can we enable basic-authentication on Livy? Is there any specific configuration that I have to set on livy.conf to enable basic authentication. Did anyone had luck implementing basic authentication? I appreciate if you can provide any help here. Thanks Santosh [cid:image003.png@01D45BF9.4FC434F0] Please visit our website at http://financialservicesinc.ubs.com/wealth/E-maildisclaimer.html for important disclosures and information about our e-mail policies. For your protection, please do not transmit orders or instructions by e-mail or include account numbers, Social Security numbers, credit card numbers, passwords, or other personal information.
Enable HTTP Basic Authenticaton for Livy Rest APIs
I'm Santosh Dandey, I'm working at UBS as one of the lead-developer for a Big Data Project. We are working on enabling Jupyter notebook as a data-science tool for data-scientists. I have below setup that's working good in my local environment without any authentication between spark-magic and Livy. I have to implement security for SparkMagic and Apache Livy. On Spark Magic it says I can enable HTTP Basic Authentication if it's enabled in Livy. How do I enable HTTP Basic authentication in livy? How can we enable basic-authentication on Livy? Is there any specific configuration that I have to set on livy.conf to enable basic authentication. Did anyone had luck implementing basic authentication? I appreciate if you can provide any help here. Thanks Santosh [image: cid:image003.png@01D45BF9.4FC434F0] Please visit our website at http://financialservicesinc.ubs.com/wealth/E-maildisclaimer.html for important disclosures and information about our e-mail policies. For your protection, please do not transmit orders or instructions by e-mail or include account numbers, Social Security numbers, credit card numbers, passwords, or other personal information.
