Rui Li created SPARK-4440:
-----------------------------
Summary: Enhance the job progress API to expose more information
Key: SPARK-4440
URL: https://issues.apache.org/jira/browse/SPARK-4440
Project: Spark
Issue Type: Improvement
Reporter: Rui Li
The progress API introduced in SPARK-2321 provides a new way for user to
monitor job progress. However the information exposed in the API is relatively
limited. It'll be much more useful if we can enhance the API to expose more
data.
Some improvement for example may include but not limited to:
1. Stage submission and completion time.
2. Task metrics.
The requirement is initially identified for the hive on spark
project(HIVE-7292), other application should benefit as well.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
