[
https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14208576#comment-14208576
]
Marcelo Vanzin commented on HIVE-8548:
--------------------------------------
Suhas, I'm not sure I understand your question.
First, you can't use yarn in unit tests since Spark does not publish the
classes needed to run against yarn in any artifact that you can depend on.
Second, the choice of "client" vs. "cluster" should make no difference when
running unit tests. A "local" master is not Spark standalone; it's Spark
running in a single JVM, with no cluster manager. A "local-cluster" master is
standalone mode, similar to running a MiniYARNCluster, and should support both
client and cluster mode.
> Integrate with remote Spark context after HIVE-8528 [Spark Branch]
> ------------------------------------------------------------------
>
> Key: HIVE-8548
> URL: https://issues.apache.org/jira/browse/HIVE-8548
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Reporter: Xuefu Zhang
> Assignee: Chengxiang Li
>
> With HIVE-8528, HiverSever2 should use remote Spark context to submit job and
> monitor progress, etc. This is necessary if Hive runs on standalone cluster,
> Yarn, or Mesos. If Hive runs with spark.master=local, we should continue
> using SparkContext in current way.
> We take this as root JIRA to track all Remote Spark Context integration
> related subtasks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
