Thomas Scott created HIVE-14125:
-----------------------------------
Summary: Spark app name should be in line with MapReduce app name
when using Hive On Spark
Key: HIVE-14125
URL: https://issues.apache.org/jira/browse/HIVE-14125
Project: Hive
Issue Type: Improvement
Components: Spark
Affects Versions: 1.1.0
Reporter: Thomas Scott
Priority: Minor
When using the spark execution engine the jobs submitted to YARN are submitted
with name "Hive On Spark" whereas in mr execution engine the name contains the
query executed. This is overrideable via spark.app.name but it should
automatically fill out the query executed in line with the mr engine.
Example:
set hive.execution.engine=spark;
Select count(*) from sometable;
-> Launched YARN Job description: Hive On Spark
set hive.execution.engine=mr;
Select count(*) from sometable;
-> Launched YARN Job description: Select count(*) from sometable
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
