[
https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14201748#comment-14201748
]
Chengxiang Li commented on HIVE-8548:
-------------------------------------
Hi [~xuefuz], I agree with your point, and with a extra addup. As you
mentioned, user should use remote spark context in HS2 production environment,
and local spark context is mainly used for debugging. Finally we should enable
automatic test for remote spark context, which should run with
"spark.master=local" as it would be to overstaffing to enable a
standalone/yarn/mesos cluster for hive test. So besides the default option you
mentioned before, we may add a parameter to control spark context choice more
flexible.
> Integrate with remote Spark context after HIVE-8528 [Spark Branch]
> ------------------------------------------------------------------
>
> Key: HIVE-8548
> URL: https://issues.apache.org/jira/browse/HIVE-8548
> Project: Hive
> Issue Type: Sub-task
> Components: Spark
> Reporter: Xuefu Zhang
> Assignee: Chengxiang Li
>
> With HIVE-8528, HiverSever2 should use remote Spark context to submit job and
> monitor progress, etc. This is necessary if Hive runs on standalone cluster,
> Yarn, or Mesos. If Hive runs with spark.master=local, we should continue
> using SparkContext in current way.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
