Saisai Shao created SPARK-18840:
-----------------------------------
Summary: HDFSCredentialProvider throws exception in non-HDFS
security environment
Key: SPARK-18840
URL: https://issues.apache.org/jira/browse/SPARK-18840
Project: Spark
Issue Type: Bug
Components: YARN
Affects Versions: 1.6.3, 2.1.0
Reporter: Saisai Shao
Current in {{HDFSCredentialProvider}}, the code logic assumes HDFS delegation
token should be existed, this is ok for HDFS environment, but for some cloud
environment like Azure, HDFS is not required, so it will throw exception:
{code}
java.util.NoSuchElementException: head of empty list
at scala.collection.immutable.Nil$.head(List.scala:337)
at scala.collection.immutable.Nil$.head(List.scala:334)
at
org.apache.spark.deploy.yarn.Client.getTokenRenewalInterval(Client.scala:627)
{code}
We should also consider this situation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
