Andreas Weise created ZEPPELIN-4722:
---------------------------------------
Summary: Support User Impersonation via --proxy-user for Spark
Interpreter with K8s
Key: ZEPPELIN-4722
URL: https://issues.apache.org/jira/browse/ZEPPELIN-4722
Project: Zeppelin
Issue Type: Improvement
Components: Kubernetes
Affects Versions: 0.9.0
Reporter: Andreas Weise
Attachments: image-2020-04-03-21-58-29-767.png
Enabling User Impersonation for Spark Interpreter running on K8s is currently
not support. (propably also not on other interpreters)
While the Spark Interpreter can be configured with "User Impersonate", no
--proxy-user is passed to the corresponding spark-submit command in K8s.
!image-2020-04-03-21-58-29-767.png|thumbnail!
{code:java}
Interpreter launch command: /opt/spark/bin/spark-submit --class
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer
--driver-class-path
":/opt/zeppelin/interpreter/spark/*::/opt/zeppelin/interpreter/zeppelin-interpreter-shaded-0.9.0-SNAPSHOT.jar:/opt/zeppelin/interpreter/spark/spark-interpreter-0.9.0-SNAPSHOT.jar"
--driver-java-options " -Dfile.encoding=UTF-8
-Dlog4j.configuration=file:///opt/zeppelin/conf/log4j.properties
-Dzeppelin.log.file='/opt/zeppelin/logs/zeppelin-interpreter-spark-aweise--spark-lnsuqc.log'"
--master k8s://https://kubernetes.default.svc --deploy-mode client
--driver-memory 1g --conf spark.kubernetes.namespace=spark-test --conf
spark.executor.instances=1 --conf spark.kubernetes.driver.pod.name=spark-lnsuqc
--conf spark.kubernetes.container.image=spark-anaconda:3.0.0 --conf
spark.driver.bindAddress=0.0.0.0 --conf
spark.driver.host=spark-lnsuqc.spark-test.svc --conf spark.driver.port=22321
--conf spark.blockManager.port=22322
/opt/zeppelin/interpreter/spark/spark-interpreter-0.9.0-SNAPSHOT.jar
zeppelin-server 12320 "spark-aweise" 12321:12321
{code}
The --proxy-user Feature will also require Spark Version 3.1.0, see
https://issues.apache.org/jira/browse/SPARK-25355
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
