[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097129#comment-14097129
]
Hudson commented on YARN-2070:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1863 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1863/])
YARN-2070. Made DistributedShell publish the short user name to the timeline
server. Contributed by Robert Kanter. (zjshen:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1617837)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Fix For: 2.6.0
>
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097097#comment-14097097
]
Hudson commented on YARN-2070:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #1837 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1837/])
YARN-2070. Made DistributedShell publish the short user name to the timeline
server. Contributed by Robert Kanter. (zjshen:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1617837)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Fix For: 2.6.0
>
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096867#comment-14096867
]
Hudson commented on YARN-2070:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #646 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/646/])
YARN-2070. Made DistributedShell publish the short user name to the timeline
server. Contributed by Robert Kanter. (zjshen:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1617837)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Fix For: 2.6.0
>
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096212#comment-14096212
]
Hudson commented on YARN-2070:
--
FAILURE: Integrated in Hadoop-trunk-Commit #6061 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/6061/])
YARN-2070. Made DistributedShell publish the short user name to the timeline
server. Contributed by Robert Kanter. (zjshen:
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1617837)
* /hadoop/common/trunk/hadoop-yarn-project/CHANGES.txt
*
/hadoop/common/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/main/java/org/apache/hadoop/yarn/applications/distributedshell/ApplicationMaster.java
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Fix For: 2.6.0
>
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096111#comment-14096111
]
Zhijie Shen commented on YARN-2070:
---
+1 for the patch. Will commit it.
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007862#comment-14007862
]
Hadoop QA commented on YARN-2070:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12646095/YARN-2070.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 1.3.9) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell.
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/3815//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/3815//console
This message is automatically generated.
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007640#comment-14007640
]
Zhijie Shen commented on YARN-2070:
---
The situation here is that users are free to define their own filters, even if
they duplicate the system info. The system info should be invisible to users,
such that user won't see, for example, "ENTITY_OWNER" in the response timeline
data. Then, if users want to show the user information, they need to add it
somewhere in the timeline entity/event, and this is what distributed shell does.
The problem here is that the complete UGI name is used as the user in the
distributed shell. Therefore, we will see "zjshen/localhost@LOCALHOST
(auth.KERBEROS)" or "zjshen (auth.SIMPLE)" in the user field. The
authentication details is not much useful, IMO. And it will trouble user when
he want to query the timeline entities by filtering by user.
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14007558#comment-14007558
]
Vinod Kumar Vavilapalli commented on YARN-2070:
---
Given that, should we consider dropping this patch completely?
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005340#comment-14005340
]
Zhijie Shen commented on YARN-2070:
---
bq. the Server itself is going to start injecting a user-name that is the sole
authority.
In YARN-1937, I try to keep users away from the system information (entity
owner here), and it will be removed before the entity/event is returned back to
the user.
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (YARN-2070) DistributedShell publishes unfriendly user information to the timeline server
[
https://issues.apache.org/jira/browse/YARN-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14005320#comment-14005320
]
Vinod Kumar Vavilapalli commented on YARN-2070:
---
With some of the tickets under YARN-1935, the Server itself is going to start
injecting a user-name that is the sole authority. Given that, should we
consider dropping this completely?
> DistributedShell publishes unfriendly user information to the timeline server
> -
>
> Key: YARN-2070
> URL: https://issues.apache.org/jira/browse/YARN-2070
> Project: Hadoop YARN
> Issue Type: Sub-task
>Reporter: Zhijie Shen
>Assignee: Robert Kanter
>Priority: Minor
> Labels: newbie
> Attachments: YARN-2070.patch
>
>
> Bellow is the code of using the string of current user object as the "user"
> value.
> {code}
> entity.addPrimaryFilter("user", UserGroupInformation.getCurrentUser()
> .toString());
> {code}
> When we use kerberos authentication, it's going to output the full name, such
> as "zjshen/localhost@LOCALHOST (auth.KERBEROS)". It is not user friendly for
> searching by the primary filters. It's better to use shortUserName instead.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
