[
https://issues.apache.org/jira/browse/HIVE-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Song Jun updated HIVE-19878:
----------------------------
Description:
the Application Master of Hive on Spark always live on the yarn if the Hive
client do not exit(such as one session in HiveServer2), which will accupy lots
of resources, we should control the AM shut down when there is no more jobs
submit.
Now Tez use the param ` tez.session.am.dag.submit.timeout.secs` to control the
DAGAppMaster on the yarn to shut down.
So here Spark need to do this too.
was:
the Application Master of Hive on Spark always live on the yarn, which will
accupy lots of resources, we should control the AM shut down when there is no
more jobs submit.
Now Tez use the param ` tez.session.am.dag.submit.timeout.secs` to control the
DAGAppMaster on the yarn to shut down.
So here Spark need to do this too.
> Hive On Spark support AM shut down when there is no job submit
> --------------------------------------------------------------
>
> Key: HIVE-19878
> URL: https://issues.apache.org/jira/browse/HIVE-19878
> Project: Hive
> Issue Type: New Feature
> Components: Spark
> Reporter: Song Jun
> Priority: Minor
> Attachments: HIVE-19878.patch.1
>
>
> the Application Master of Hive on Spark always live on the yarn if the Hive
> client do not exit(such as one session in HiveServer2), which will accupy
> lots of resources, we should control the AM shut down when there is no more
> jobs submit.
> Now Tez use the param ` tez.session.am.dag.submit.timeout.secs` to control
> the DAGAppMaster on the yarn to shut down.
> So here Spark need to do this too.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
