[
https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274972#comment-14274972
]
Pierre Yin commented on HIVE-9342:
----------------------------------
I have verified with the new options ( spark.executor.instances / cores /
memory) in my cluster by command line .
In yarn-client mode, it worked as what I expected.
But in yarn-cluster mode, these options doesn't work.
I will try to find it why yarn-cluster can't support these options.
> add num-executors / executor-cores / executor-memory option support for hive
> on spark in Yarn mode
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-9342
> URL: https://issues.apache.org/jira/browse/HIVE-9342
> Project: Hive
> Issue Type: Improvement
> Components: spark-branch
> Affects Versions: spark-branch
> Reporter: Pierre Yin
> Priority: Minor
> Labels: spark
> Fix For: spark-branch
>
> Attachments: HIVE-9342.1-spark.patch
>
>
> When I run hive on spark with Yarn mode, I want to control some yarn option,
> such as --num-executors, --executor-cores, --executor-memory.
> We can append these options into argv in SparkClientImpl.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
