[
https://issues.apache.org/jira/browse/SPARK-6207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364441#comment-14364441
]
Doug Balog commented on SPARK-6207:
-----------------------------------
Need to catch java.lang.UnsupportedOperationException and ignore,
or check to see if delegation token mode is supported with current
configuration
before trying to get a delegation token.
See https://issues.apache.org/jira/browse/HIVE-4625
> YARN secure cluster mode doesn't obtain a hive-metastore token
> ---------------------------------------------------------------
>
> Key: SPARK-6207
> URL: https://issues.apache.org/jira/browse/SPARK-6207
> Project: Spark
> Issue Type: Bug
> Components: Spark Submit, SQL, YARN
> Affects Versions: 1.2.0, 1.3.0, 1.2.1
> Environment: YARN
> Reporter: Doug Balog
>
> When running a spark job, on YARN in secure mode, with "--deploy-mode
> cluster", org.apache.spark.deploy.yarn.Client() does not obtain a delegation
> token to the hive-metastore. Therefore any attempts to talk to the
> hive-metastore fail with a "GSSException: No valid credentials provided..."
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
