[
https://issues.apache.org/jira/browse/HIVE-15386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15740845#comment-15740845
]
Rui Li edited comment on HIVE-15386 at 12/12/16 3:23 AM:
---------------------------------------------------------
Hi [~zxu], the v1 patch looks better. One question is what's the difference
between startTime and submitTime? And why is startTime set like this (with a
PerfLogger and after the task finishes)?
{code}
startTime = perfLogger.getEndTime(PerfLogger.SPARK_SUBMIT_TO_RUNNING);
{code}
And btw, is this intended to expose some hook for user to monitor the job? I
think even {{Utilities}} is not for public use.
was (Author: lirui):
Hi [~zxu], the v2 patch looks better. One question is what's the difference
between startTime and submitTime? And why is startTime set like this (with a
PerfLogger and after the task finishes)?
{code}
startTime = perfLogger.getEndTime(PerfLogger.SPARK_SUBMIT_TO_RUNNING);
{code}
And btw, is this intended to expose some hook for user to monitor the job? I
think even {{Utilities}} is not for public use.
> Expose Spark task counts and stage Ids information in SparkTask from
> SparkJobMonitor
> ------------------------------------------------------------------------------------
>
> Key: HIVE-15386
> URL: https://issues.apache.org/jira/browse/HIVE-15386
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Affects Versions: 2.2.0
> Reporter: zhihai xu
> Assignee: zhihai xu
> Attachments: HIVE-15386.000.patch, HIVE-15386.001.patch
>
>
> Expose Spark task counts and stage Ids information in SparkTask from
> SparkJobMonitor. So these information can be used by hive hook to monitor
> spark jobs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
