jam xu created SPARK-47317:
------------------------------
Summary: taskSummary API should include the task state as a
parameter
Key: SPARK-47317
URL: https://issues.apache.org/jira/browse/SPARK-47317
Project: Spark
Issue Type: Bug
Components: Spark Core, Web UI
Affects Versions: 3.5.1
Reporter: jam xu
After the JIRA, https://issues.apache.org/jira/browse/SPARK-26119, task summary
only contain successful task.
In our scenario, utilize the REST API
[/applications/[app-id]/stages/[stage-id]/[stage-attempt-id]/taskSummary] to
obtain the taskSummary metric. Use the Max(schedule delay) to diagnose why the
stage duration is excessively long. but in some case the slowest task is a
failed state task, so task summary metrics is not included this task.
expect：
the rest api
[/applications/[app-id]/stages/[stage-id]/[stage-attempt-id]/taskSummary] task
state as a parameter.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
