[
https://issues.apache.org/jira/browse/YARN-8384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wangda Tan updated YARN-8384:
-----------------------------
Description:
When {{yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users}}
is set to true, and
{{yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user}} is set
to nobody.
This will cause the docker to run as nobody:nobody in yarn mode.
The log files will be initialized as nobody:nobody:
{noformat}
rw-rr- 1 nobody hadoop 354 May 31 17:33 container-localizer-syslog
rw-rr- 1 nobody hadoop 1042 May 31 17:35 directory.info
rw-r---- 1 nobody hadoop 4944 May 31 17:35 launch_container.sh
rw-rr- 1 nobody hadoop 440 May 31 17:35 prelaunch.err
rw-rr- 1 nobody hadoop 100 May 31 17:35 prelaunch.out
rw-r---- 1 nobody nobody 18733 May 31 17:37 stderr.txt
rw-r---- 1 nobody nobody 400 May 31 17:35 stdout.txt
{noformat}
This causes YARN NM cannot read stderr.txt and stdout.txt
was:
When {{yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users}}
is set to true, and
{{yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user}} is set
to nobody.
This will cause the docker to run as nobody:nobody in yarn mode.
The log files will be initialized as nobody:nobody:
{noformat}
rw-rr- 1 nobody hadoop 354 May 31 17:33 container-localizer-syslog
rw-rr- 1 nobody hadoop 1042 May 31 17:35 directory.info
rw-r---- 1 nobody hadoop 4944 May 31 17:35 launch_container.sh
rw-rr- 1 nobody hadoop 440 May 31 17:35 prelaunch.err
rw-rr- 1 nobody hadoop 100 May 31 17:35 prelaunch.out
rw-r---- 1 nobody nobody 18733 May 31 17:37 stderr.txt
rw-r---- 1 nobody nobody 400 May 31 17:35 stdout.txt
{noformat}
> stdout.txt, stderr.txt logs of a launched docker container is coming with
> primary group of submit user instead of hadoop
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-8384
> URL: https://issues.apache.org/jira/browse/YARN-8384
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn-native-services
> Reporter: Sunil Govindan
> Assignee: Eric Yang
> Priority: Critical
> Labels: docker
> Attachments: YARN-8384.001.patch
>
>
> When {{yarn.nodemanager.linux-container-executor.nonsecure-mode.limit-users}}
> is set to true, and
> {{yarn.nodemanager.linux-container-executor.nonsecure-mode.local-user}} is
> set to nobody.
> This will cause the docker to run as nobody:nobody in yarn mode.
> The log files will be initialized as nobody:nobody:
> {noformat}
> rw-rr- 1 nobody hadoop 354 May 31 17:33 container-localizer-syslog
> rw-rr- 1 nobody hadoop 1042 May 31 17:35 directory.info
> rw-r---- 1 nobody hadoop 4944 May 31 17:35 launch_container.sh
> rw-rr- 1 nobody hadoop 440 May 31 17:35 prelaunch.err
> rw-rr- 1 nobody hadoop 100 May 31 17:35 prelaunch.out
> rw-r---- 1 nobody nobody 18733 May 31 17:37 stderr.txt
> rw-r---- 1 nobody nobody 400 May 31 17:35 stdout.txt
> {noformat}
> This causes YARN NM cannot read stderr.txt and stdout.txt
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
