Stavros Kontopoulos created SPARK-25355: -------------------------------------------
Summary: Support --proxy-user for Spark on K8s Key: SPARK-25355 URL: https://issues.apache.org/jira/browse/SPARK-25355 Project: Spark Issue Type: New Feature Components: Kubernetes Affects Versions: 2.4.0 Reporter: Stavros Kontopoulos SPARK-23257 adds kerberized hdfs support for Spark on K8s. A major addition needed is the support for proxy user. A proxy user is impersonated by a superuser who executes operations on behalf of the proxy user. More on this: [https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Superusers.html] [https://github.com/spark-notebook/spark-notebook/blob/master/docs/proxyuser_impersonation.md] This has been implemented for Yarn upstream and Spark on Mesos here: [https://github.com/mesosphere/spark/pull/26] [~ifilonenko] creating this issue according to our discussion. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org