Re: Spark API authentication
IIUC auth filter on the Live UI REST API should already be supported, the fix in SPARK-19652 is mainly for the History UI to support per app based ACL. For application submission REST API in standalone mode, I think currently it is not supported, it is not a bug. On Fri, Apr 14, 2017 at 6:56 PM, Sergey Grigorev <grigorev-...@yandex.ru> wrote: > Thanks for help! > > I've found the ticket with a similar problem https://issues.apache.org/ > jira/browse/SPARK-19652. It looks like this fix did not hit to 2.1.0 > release. > You said that for the second example custom filter is not supported. It > is a bug or expected behavior? > > On 14.04.2017 13:22, Saisai Shao wrote: > > AFAIK, For the first line, custom filter should be worked. But for the > latter it is not supported. > > On Fri, Apr 14, 2017 at 6:17 PM, Sergey Grigorev <grigorev-...@yandex.ru> > wrote: > >> GET requests like * >> <http://worker:4040/api/v1/applications>http://worker:4040/api/v1/ >> <http://worker:4040/api/v1/>applications *or >> *http://master:6066/v1/submissions/status/driver-20170414025324- >> <http://master:6066/v1/submissions/status/driver-20170414025324-> *return >> successful result. But if I open the spark master web ui then it requests >> username and password. >> >> >> On 14.04.2017 12:46, Saisai Shao wrote: >> >> Hi, >> >> What specifically are you referring to "Spark API endpoint"? >> >> Filter can only be worked with Spark Live and History web UI. >> >> On Fri, Apr 14, 2017 at 5:18 PM, Sergey < <grigorev-...@yandex.ru> >> grigorev-...@yandex.ru> wrote: >> >>> Hello all, >>> >>> I've added own spark.ui.filters to enable basic authentication to access >>> to >>> Spark web UI. It works fine, but I still can do requests to spark API >>> without any authentication. >>> Is there any way to enable authentication for API endpoints? >>> >>> P.S. spark version is 2.1.0, deploy mode is standalone. >>> >>> >>> >>> -- >>> View this message in context: >>> <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html> >>> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-AP >>> I-authentication-tp28601.html >>> Sent from the Apache Spark User List mailing list archive at Nabble.com. >>> >>> - >>> To unsubscribe e-mail: <user-unsubscr...@spark.apache.org> >>> user-unsubscr...@spark.apache.org >>> >>> >> >> > >
Re: Spark API authentication
Thanks for help! I've found the ticket with a similar problem https://issues.apache.org/jira/browse/SPARK-19652. It looks like this fix did not hit to 2.1.0 release. You said that for the second example custom filter is not supported. It is a bug or expected behavior? On 14.04.2017 13:22, Saisai Shao wrote: AFAIK, For the first line, custom filter should be worked. But for the latter it is not supported. On Fri, Apr 14, 2017 at 6:17 PM, Sergey Grigorev <grigorev-...@yandex.ru <mailto:grigorev-...@yandex.ru>> wrote: GET requests like *http://worker:4040/api/v1/applications <http://worker:4040/api/v1/applications> *or *http://master:6066/v1/submissions/status/driver-20170414025324- <http://master:6066/v1/submissions/status/driver-20170414025324-> *return successful result. But if I open the spark master web ui then it requests username and password. On 14.04.2017 12:46, Saisai Shao wrote: Hi, What specifically are you referring to "Spark API endpoint"? Filter can only be worked with Spark Live and History web UI. On Fri, Apr 14, 2017 at 5:18 PM, Sergey <grigorev-...@yandex.ru <mailto:grigorev-...@yandex.ru>> wrote: Hello all, I've added own spark.ui.filters to enable basic authentication to access to Spark web UI. It works fine, but I still can do requests to spark API without any authentication. Is there any way to enable authentication for API endpoints? P.S. spark version is 2.1.0, deploy mode is standalone. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html> Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org <mailto:user-unsubscr...@spark.apache.org>
Re: Spark API authentication
AFAIK, For the first line, custom filter should be worked. But for the latter it is not supported. On Fri, Apr 14, 2017 at 6:17 PM, Sergey Grigorev <grigorev-...@yandex.ru> wrote: > GET requests like *http://worker:4040/api/v1/applications > <http://worker:4040/api/v1/applications> *or > *http://master:6066/v1/submissions/status/driver-20170414025324- > <http://master:6066/v1/submissions/status/driver-20170414025324-> *return > successful result. But if I open the spark master web ui then it requests > username and password. > > > On 14.04.2017 12:46, Saisai Shao wrote: > > Hi, > > What specifically are you referring to "Spark API endpoint"? > > Filter can only be worked with Spark Live and History web UI. > > On Fri, Apr 14, 2017 at 5:18 PM, Sergey <grigorev-...@yandex.ru> wrote: > >> Hello all, >> >> I've added own spark.ui.filters to enable basic authentication to access >> to >> Spark web UI. It works fine, but I still can do requests to spark API >> without any authentication. >> Is there any way to enable authentication for API endpoints? >> >> P.S. spark version is 2.1.0, deploy mode is standalone. >> >> >> >> -- >> View this message in context: http://apache-spark-user-list. >> 1001560.n3.nabble.com/Spark-API-authentication-tp28601.html >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> - >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> >> > >
Re: Spark API authentication
GET requests like *http://worker:4040/api/v1/applications *or *http://master:6066/v1/submissions/status/driver-20170414025324- *return successful result. But if I open the spark master web ui then it requests username and password. On 14.04.2017 12:46, Saisai Shao wrote: Hi, What specifically are you referring to "Spark API endpoint"? Filter can only be worked with Spark Live and History web UI. On Fri, Apr 14, 2017 at 5:18 PM, Sergey <grigorev-...@yandex.ru <mailto:grigorev-...@yandex.ru>> wrote: Hello all, I've added own spark.ui.filters to enable basic authentication to access to Spark web UI. It works fine, but I still can do requests to spark API without any authentication. Is there any way to enable authentication for API endpoints? P.S. spark version is 2.1.0, deploy mode is standalone. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html <http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html> Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org <mailto:user-unsubscr...@spark.apache.org>
Re: Spark API authentication
Hi, What specifically are you referring to "Spark API endpoint"? Filter can only be worked with Spark Live and History web UI. On Fri, Apr 14, 2017 at 5:18 PM, Sergey <grigorev-...@yandex.ru> wrote: > Hello all, > > I've added own spark.ui.filters to enable basic authentication to access to > Spark web UI. It works fine, but I still can do requests to spark API > without any authentication. > Is there any way to enable authentication for API endpoints? > > P.S. spark version is 2.1.0, deploy mode is standalone. > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Spark-API-authentication-tp28601.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
Spark API authentication
Hello all, I've added own spark.ui.filters to enable basic authentication to access to Spark web UI. It works fine, but I still can do requests to spark API without any authentication. Is there any way to enable authentication for API endpoints? P.S. spark version is 2.1.0, deploy mode is standalone. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-API-authentication-tp28601.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org
