[jira] [Commented] (SPARK-6207) YARN secure cluster mode doesn't obtain a hive-metastore token
[ https://issues.apache.org/jira/browse/SPARK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14364441#comment-14364441 ] Doug Balog commented on SPARK-6207: --- Need to catch java.lang.UnsupportedOperationException and ignore, or check to see if delegation token mode is supported with current configuration before trying to get a delegation token. See https://issues.apache.org/jira/browse/HIVE-4625 YARN secure cluster mode doesn't obtain a hive-metastore token --- Key: SPARK-6207 URL: https://issues.apache.org/jira/browse/SPARK-6207 Project: Spark Issue Type: Bug Components: Spark Submit, SQL, YARN Affects Versions: 1.2.0, 1.3.0, 1.2.1 Environment: YARN Reporter: Doug Balog When running a spark job, on YARN in secure mode, with --deploy-mode cluster, org.apache.spark.deploy.yarn.Client() does not obtain a delegation token to the hive-metastore. Therefore any attempts to talk to the hive-metastore fail with a GSSException: No valid credentials provided... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6207) YARN secure cluster mode doesn't obtain a hive-metastore token
[ https://issues.apache.org/jira/browse/SPARK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362271#comment-14362271 ] Apache Spark commented on SPARK-6207: - User 'dougb' has created a pull request for this issue: https://github.com/apache/spark/pull/5031 YARN secure cluster mode doesn't obtain a hive-metastore token --- Key: SPARK-6207 URL: https://issues.apache.org/jira/browse/SPARK-6207 Project: Spark Issue Type: Bug Components: Spark Submit, SQL, YARN Affects Versions: 1.2.0, 1.3.0, 1.2.1 Environment: YARN Reporter: Doug Balog When running a spark job, on YARN in secure mode, with --deploy-mode cluster, org.apache.spark.deploy.yarn.Client() does not obtain a delegation token to the hive-metastore. Therefore any attempts to talk to the hive-metastore fail with a GSSException: No valid credentials provided... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-6207) YARN secure cluster mode doesn't obtain a hive-metastore token
[ https://issues.apache.org/jira/browse/SPARK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14350895#comment-14350895 ] Doug Balog commented on SPARK-6207: --- I have some code that fixes this issue. I'm preparing a pr. YARN secure cluster mode doesn't obtain a hive-metastore token --- Key: SPARK-6207 URL: https://issues.apache.org/jira/browse/SPARK-6207 Project: Spark Issue Type: Bug Components: Spark Submit, YARN Affects Versions: 1.2.0, 1.3.0, 1.2.1 Environment: YARN Reporter: Doug Balog When running a spark job, on YARN in secure mode, with --deploy-mode cluster, org.apache.spark.deploy.yarn.Client() does not obtain a delegation token to the hive-metastore. Therefore any attempts to talk to the hive-metastore fail with a GSSException: No valid credentials provided... -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
