[
https://issues.apache.org/jira/browse/HIVE-15386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15738619#comment-15738619
]
zhihai xu commented on HIVE-15386:
----------------------------------
Thanks for the review [~xuefuz] and [~lirui]! The first patch changed too many
files. I upload a new patch which only change one file sparkTask.java. The
patch read the spark job information(tasks and stageIds) right after the job
finished. Since the sparkTask can be got from hook by Utilities.getSparkTasks.
we will get tasks and stageIds information in hooks with this patch.
> Expose Spark task counts and stage Ids information in SparkTask from
> SparkJobMonitor
> ------------------------------------------------------------------------------------
>
> Key: HIVE-15386
> URL: https://issues.apache.org/jira/browse/HIVE-15386
> Project: Hive
> Issue Type: Bug
> Components: Spark
> Affects Versions: 2.2.0
> Reporter: zhihai xu
> Assignee: zhihai xu
> Attachments: HIVE-15386.000.patch, HIVE-15386.001.patch
>
>
> Expose Spark task counts and stage Ids information in SparkTask from
> SparkJobMonitor. So these information can be used by hive hook to monitor
> spark jobs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
