[jira] [Commented] (SPARK-1472) Go through YARN api used in Spark to make sure we aren't using Private Apis
[ https://issues.apache.org/jira/browse/SPARK-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14289263#comment-14289263 ] Thomas Graves commented on SPARK-1472: -- No there are a bunch of others we can get rid of. I had started a patch a long time back but haven't had time to get back to it. > Go through YARN api used in Spark to make sure we aren't using Private Apis > --- > > Key: SPARK-1472 > URL: https://issues.apache.org/jira/browse/SPARK-1472 > Project: Spark > Issue Type: Task > Components: YARN >Affects Versions: 1.0.0 >Reporter: Thomas Graves >Assignee: Thomas Graves > > We need to look through all the yarn api's we are using to make sure they > aren't now Private. If they are private change to not use those api's. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-1472) Go through YARN api used in Spark to make sure we aren't using Private Apis
[ https://issues.apache.org/jira/browse/SPARK-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14289256#comment-14289256 ] Sean Owen commented on SPARK-1472: -- [~tgraves] Is this as resolved as it can be? now that YARN alpha support is out too? > Go through YARN api used in Spark to make sure we aren't using Private Apis > --- > > Key: SPARK-1472 > URL: https://issues.apache.org/jira/browse/SPARK-1472 > Project: Spark > Issue Type: Task > Components: YARN >Affects Versions: 1.0.0 >Reporter: Thomas Graves >Assignee: Thomas Graves > > We need to look through all the yarn api's we are using to make sure they > aren't now Private. If they are private change to not use those api's. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-1472) Go through YARN api used in Spark to make sure we aren't using Private Apis
[ https://issues.apache.org/jira/browse/SPARK-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13975609#comment-13975609 ] Thomas Graves commented on SPARK-1472: -- So it looks like its currently impossible to use all public interfaces with Hadoop. There are some that are limitedprivate that we will have to use. I filed several jira in Hadoop land to add public interfaces for various things that we either need or would be handy for all types of applications. https://issues.apache.org/jira/browse/YARN-1953 I should file a couple more jira also as things like UserGroupInformation is marked limitedprivate also. In this jira I will clean up as much as possible mostly in the "yarn stable" code since that is where api's changed scope. > Go through YARN api used in Spark to make sure we aren't using Private Apis > --- > > Key: SPARK-1472 > URL: https://issues.apache.org/jira/browse/SPARK-1472 > Project: Spark > Issue Type: Task > Components: YARN >Affects Versions: 1.0.0 >Reporter: Thomas Graves >Assignee: Thomas Graves > > We need to look through all the yarn api's we are using to make sure they > aren't now Private. If they are private change to not use those api's. -- This message was sent by Atlassian JIRA (v6.2#6252)
