[
https://issues.apache.org/jira/browse/SPARK-15800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15322804#comment-15322804
]
Saisai Shao commented on SPARK-15800:
-------------------------------------
{quote}
Spark is currently running using the Resource Manager, not on YARN.
{quote}
What's the meaning of "Resource Manager", are you referring to YARN's Resource
Manager or kubernetes?
>From my understanding only Spark running on YARN can support accessing
>Kerberized Hadoop environment.
> Accessing kerberised hdfs from Spark running with Resource Manager
> ------------------------------------------------------------------
>
> Key: SPARK-15800
> URL: https://issues.apache.org/jira/browse/SPARK-15800
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.6.1
> Reporter: Morgan Jones
> Priority: Minor
>
> Hi,
> I've been runing a Spark cluster in kubernetes and i'm trying to access data
> in HDFS in a kerberised instance of hadoop. It seems that the Spark cluster
> is unable to pass my tickets to the hadoop instance, is this by design?
> If so how much work would be involved to allow the cluster to communicate
> with kerberised hdfs and is this currently in the roadmap?
> Edit: Spark is currently running using the Resource Manager, not on YARN.
> Cheers,
> Morgan
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
