[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255005#comment-16255005 ] Varun Vasudev commented on YARN-7430: - Looks like we have consensus of making uid:gid the default

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16253831#comment-16253831 ] Eric Badger commented on YARN-7430: --- Hey [~eyang], thanks for the updated explanation. bq. This JIRA is

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252023#comment-16252023 ] Eric Yang commented on YARN-7430: - [~ebadger] {quote} I agree, but I was under the assumption that this was

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251940#comment-16251940 ] Eric Badger commented on YARN-7430: --- bq. If someone is allowing jobs in the mix uid:gid environment

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251805#comment-16251805 ] Eric Yang commented on YARN-7430: - [~ebadger] IT infrastructure keeps the entire company's user credential

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16251740#comment-16251740 ] Eric Badger commented on YARN-7430: --- bq. I'm fine with it. Eric Badger - does it sounds ok to you? I'm

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250879#comment-16250879 ] Varun Vasudev commented on YARN-7430: - I'm fine with it. [~ebadger] - does it sounds ok to you? > User

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250334#comment-16250334 ] Shane Kumpf commented on YARN-7430: --- Thanks for clarifying, I hadn't considered a system configured to

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250312#comment-16250312 ] Eric Yang commented on YARN-7430: - [~ebadger] {quote} I could be wrong, but I don't think Shane Kumpf's

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250276#comment-16250276 ] Eric Badger commented on YARN-7430: --- bq. User 12345 shouldn't belong to root group, but it has been given

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16250242#comment-16250242 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] {quote} I'm concerned that we are changing

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249824#comment-16249824 ] Shane Kumpf commented on YARN-7430: --- {quote} Is there any other concern to enable user/group mapping on

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249817#comment-16249817 ] Eric Yang commented on YARN-7430: - [~ebadger] {quote} What about the logs written via log4j or some other

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249796#comment-16249796 ] Eric Badger commented on YARN-7430: --- bq. This will redirect docker output by the shell script. It depends

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248147#comment-16248147 ] Eric Yang commented on YARN-7430: - {quote} I don't believe that is true? I'm referring to YARN containers,

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247903#comment-16247903 ] Eric Badger commented on YARN-7430: --- bq. Eric Badger My understanding is the container stderr, stdout are

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-09 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246038#comment-16246038 ] Eric Yang commented on YARN-7430: - [~ebadger] My understanding is the container stderr, stdout are

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245139#comment-16245139 ] Eric Badger commented on YARN-7430: --- [~aceric], if the application is running as root inside of the

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245016#comment-16245016 ] Shane Kumpf commented on YARN-7430: --- IMO, I think this issue can be closed as invalid. Most of this does

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244970#comment-16244970 ] Eric Yang commented on YARN-7430: - [~ebadger] They are two separate problems. A lot of conversation here

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244948#comment-16244948 ] Eric Yang commented on YARN-7430: - [~ebadger] In a unix box, when a user run sudo commands, all logs are

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244915#comment-16244915 ] Eric Badger commented on YARN-7430: --- Also, this conversation seems to have morphed into a dup of

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244910#comment-16244910 ] Eric Badger commented on YARN-7430: --- {quote} For users on LDAP, there is no good way to populate

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244825#comment-16244825 ] Shane Kumpf commented on YARN-7430: --- {quote} User foo should not allow to execute script owned by skumpf,

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244811#comment-16244811 ] Eric Badger commented on YARN-7430: --- I don't see how running the container as root will work with log

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244787#comment-16244787 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] . {quote} I still believe there will be an issue

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244498#comment-16244498 ] Shane Kumpf commented on YARN-7430: --- I still believe there will be an issue if we do not specify --user.

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1623#comment-1623 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] . Thank you for explaining your point of view.

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243982#comment-16243982 ] Shane Kumpf commented on YARN-7430: --- {quote} This is not true, see the following examples: {quote} I

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243031#comment-16243031 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] {quote} Hey Eric Yang, I'm not sure that's the

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242862#comment-16242862 ] Shane Kumpf commented on YARN-7430: --- {quote} Privileged container does not need to have --user flag. They

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16242590#comment-16242590 ] Eric Yang commented on YARN-7430: - Hi [~vvasudev], Privileged container does not need to have --user flag.

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16241947#comment-16241947 ] Varun Vasudev commented on YARN-7430: - [~eyang] - can you modify your path slightly - if the user is

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240104#comment-16240104 ] Varun Vasudev commented on YARN-7430: - [~shaneku...@gmail.com], [~ebadger] - any objections to turning

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238687#comment-16238687 ] Hadoop QA commented on YARN-7430: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238428#comment-16238428 ] Eric Yang commented on YARN-7430: - Looks like we built too many knobs for this to occur. If

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237891#comment-16237891 ] Eric Yang commented on YARN-7430: - [~vvasudev] Sorry, raise this as a blocker. Anyone can become root user