[jira] [Commented] (HADOOP-13527) Add Spark to CallerContext LimitedPrivate scope
[ https://issues.apache.org/jira/browse/HADOOP-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435093#comment-15435093 ] Allen Wittenauer commented on HADOOP-13527: --- How many more things need to get added before we declare defeat though? Ignoring the internal bits, we've already got HBase, Hive, Pig, and Spark. > Add Spark to CallerContext LimitedPrivate scope > --- > > Key: HADOOP-13527 > URL: https://issues.apache.org/jira/browse/HADOOP-13527 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Reporter: Weiqing Yang >Assignee: Weiqing Yang >Priority: Minor > Fix For: 2.8.0 > > Attachments: HADOOP-13527.000.patch > > > A lots of Spark applications run on Hadoop. Spark will invoke Hadoop caller > context APIs to set up its caller contexts in HDFS/Yarn, so Hadoop should add > Spark as one of the users in the LimitedPrivate scope. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13527) Add Spark to CallerContext LimitedPrivate scope
[ https://issues.apache.org/jira/browse/HADOOP-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15432405#comment-15432405 ] Steve Loughran commented on HADOOP-13527: - We can do that; it's just making it public would probably stir up some discussion about stability. Adding spark just lists another user without going there > Add Spark to CallerContext LimitedPrivate scope > --- > > Key: HADOOP-13527 > URL: https://issues.apache.org/jira/browse/HADOOP-13527 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Reporter: Weiqing Yang >Assignee: Weiqing Yang >Priority: Minor > Fix For: 2.8.0 > > Attachments: HADOOP-13527.000.patch > > > A lots of Spark applications run on Hadoop. Spark will invoke Hadoop caller > context APIs to set up its caller contexts in HDFS/Yarn, so Hadoop should add > Spark as one of the users in the LimitedPrivate scope. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13527) Add Spark to CallerContext LimitedPrivate scope
[ https://issues.apache.org/jira/browse/HADOOP-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15430928#comment-15430928 ] Allen Wittenauer commented on HADOOP-13527: --- Why wasn't this just made public? > Add Spark to CallerContext LimitedPrivate scope > --- > > Key: HADOOP-13527 > URL: https://issues.apache.org/jira/browse/HADOOP-13527 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Reporter: Weiqing Yang >Assignee: Weiqing Yang >Priority: Minor > Fix For: 2.8.0 > > Attachments: HADOOP-13527.000.patch > > > A lots of Spark applications run on Hadoop. Spark will invoke Hadoop caller > context APIs to set up its caller contexts in HDFS/Yarn, so Hadoop should add > Spark as one of the users in the LimitedPrivate scope. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13527) Add Spark to CallerContext LimitedPrivate scope
[ https://issues.apache.org/jira/browse/HADOOP-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15430248#comment-15430248 ] Weiqing Yang commented on HADOOP-13527: --- Thank you, [~ste...@apache.org] [~cnauroth] [~liuml07] > Add Spark to CallerContext LimitedPrivate scope > --- > > Key: HADOOP-13527 > URL: https://issues.apache.org/jira/browse/HADOOP-13527 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Reporter: Weiqing Yang >Assignee: Weiqing Yang >Priority: Minor > Fix For: 2.8.0 > > Attachments: HADOOP-13527.000.patch > > > A lots of Spark applications run on Hadoop. Spark will invoke Hadoop caller > context APIs to set up its caller contexts in HDFS/Yarn, so Hadoop should add > Spark as one of the users in the LimitedPrivate scope. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13527) Add Spark to CallerContext LimitedPrivate scope
[ https://issues.apache.org/jira/browse/HADOOP-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15429801#comment-15429801 ] Hudson commented on HADOOP-13527: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10317 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/10317/]) HADOOP-13527. Add Spark to CallerContext LimitedPrivate scope. (liuml07: rev 115ecb52a86b49aad3d058a6b4c1c7926b8b0a40) * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/CallerContext.java > Add Spark to CallerContext LimitedPrivate scope > --- > > Key: HADOOP-13527 > URL: https://issues.apache.org/jira/browse/HADOOP-13527 > Project: Hadoop Common > Issue Type: Improvement > Components: ipc >Reporter: Weiqing Yang >Assignee: Weiqing Yang >Priority: Minor > Fix For: 2.8.0 > > Attachments: HADOOP-13527.000.patch > > > A lots of Spark applications run on Hadoop. Spark will invoke Hadoop caller > context APIs to set up its caller contexts in HDFS/Yarn, so Hadoop should add > Spark as one of the users in the LimitedPrivate scope. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
