Mit Desai created YUNIKORN-1961:
-----------------------------------
Summary: User Info annotation incorrect for executor pods
Key: YUNIKORN-1961
URL: https://issues.apache.org/jira/browse/YUNIKORN-1961
Project: Apache YuniKorn
Issue Type: Improvement
Components: shim - kubernetes
Reporter: Mit Desai
UserInfo annotation is getting populated correctly for driver pods. But for the
executor pods, _spark_ service account information is populated. Ideally, this
should be same as the driver pod where we have the information of the user who
originally submitted the job.
Here is the example of pod describe when running a worcount job with 2
executors:
{noformat}
Name: md-wc-94ec368a6d3b30cd-driver
Namespace: mdesai
Priority: 0
Service Account: spark
Node: *** node1 ***
Start Time: Wed, 06 Sep 2023 18:21:59 -0700
Labels: spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
spark-role=driver
Annotations: otherAnnotations: omited
yunikorn.apache.org/allow-preemption: true
yunikorn.apache.org/user.info:
{"user":"[email protected]","groups":["group1","group2","...
Status: Running {noformat}
{noformat}
Name: javawordcount-ca2f0f8a6d3b64e6-exec-1
Namespace: mdesai
Priority: 0
Service Account: spark
Node: *** node2 ***
Start Time: Wed, 06 Sep 2023 18:22:06 -0700
Labels: spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
spark-exec-id=1
spark-exec-resourceprofile-id=0
spark-role=executor
Annotations: otherAnnotations: omited
yunikorn.apache.org/allow-preemption: true
yunikorn.apache.org/user.info:
{"user":"system:serviceaccount:mdesai:spark","groups":["system:serviceaccounts","system:serviceaccounts:mdesai","system:authenticated"]}
{noformat}
{noformat}
Name: javawordcount-ca2f0f8a6d3b64e6-exec-2
Namespace: mdesai
Priority: 0
Service Account: spark
Node: *** node3 ***
Start Time: Wed, 06 Sep 2023 18:22:07 -0700
Labels: spark-app-selector=spark-c9315eb5d3bf4552b30c77090a328249
spark-exec-id=2
spark-exec-resourceprofile-id=0
spark-role=executor
Annotations: otherAnnotations: omited
yunikorn.apache.org/allow-preemption: true
yunikorn.apache.org/user.info:
{"user":"system:serviceaccount:mdesai:spark","groups":["system:serviceaccounts","system:serviceaccounts:mdesai","system:authenticated"]}
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
