[
https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113611#comment-14113611
]
Chengxiang Li commented on SPARK-2633:
--------------------------------------
It's quite subjective I think, like Hive on MR display job progress by task
finished percentage, while Hive on Tez display job progress with exact
running/failed/finished task number. I think it's better we collect more detail
job status info while it does not introduce much extra effort.
> enhance spark listener API to gather more spark job information
> ---------------------------------------------------------------
>
> Key: SPARK-2633
> URL: https://issues.apache.org/jira/browse/SPARK-2633
> Project: Spark
> Issue Type: New Feature
> Components: Java API
> Reporter: Chengxiang Li
> Priority: Critical
> Labels: hive
> Attachments: Spark listener enhancement for Hive on Spark job monitor
> and statistic.docx
>
>
> Based on Hive on Spark job status monitoring and statistic collection
> requirement, try to enhance spark listener API to gather more spark job
> information.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]