[
https://issues.apache.org/jira/browse/SPARK-20800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-20800:
---------------------------------
Labels: bulk-closed (was: )
> Allow users to set job group when connecting through the SQL thrift server
> --------------------------------------------------------------------------
>
> Key: SPARK-20800
> URL: https://issues.apache.org/jira/browse/SPARK-20800
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.1.0
> Reporter: Tim Zeyl
> Priority: Minor
> Labels: bulk-closed
>
> It would be useful for users to be able to set the job group through thrift
> server clients like beeline so that jobs in the event log could be grouped
> together logically. This would help in tracking the performance of repeated
> runs of similar sql queries, which could be tagged by the user with the same
> job group id. Currently each sql query, and corresponding job, is assigned a
> random UUID as the job group.
> Ideally users could set the job group in two ways:
> 1. by issuing a sql command prior to their query (for example, SET
> spark.sql.thriftserver.jobGroupID=jobA)
> 2. by passing a hive conf parameter through beeline to set the job group for
> the session.
> Alternatively, if people think the job group needs to be a random UUID for
> each sql query, introducing another parameter that could be written into the
> job properties field of the event log would be helpful for tracking the
> performance of repeated runs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
