Sungpeo Kook created SPARK-36582:
------------------------------------
Summary: Spark HistoryPage show 'NotFound' in not logged multiple
attempts
Key: SPARK-36582
URL: https://issues.apache.org/jira/browse/SPARK-36582
Project: Spark
Issue Type: Bug
Components: Web UI
Affects Versions: 3.1.2, 2.4.8
Reporter: Sungpeo Kook
Current historypage show a attemptId column in case of hasMultipleAttempts is
true.
Moreover if hasMultipleAttempts is false, remove the attemptId column.
But, applications in yarn could be failed even not logged to spark application
history.
application_1628518360417_0028's attemptId is 2, but size of attempt in spark
history is 1.
For this case, the attemptId column is needed.
{code:java}
[
{
"id": "application_1628518360417_0029",
"name": "Spark Pi",
"attempts": [
{
"attemptId": "1",
"startTime": "2021-08-25T05:20:15.521GMT",
"endTime": "2021-08-25T05:20:30.398GMT",
"lastUpdated": "2021-08-25T05:20:30.475GMT",
"duration": 14877,
"sparkUser": "elixir-kook",
"completed": true,
"appSparkVersion": "2.4.5",
"endTimeEpoch": 1629868830398,
"lastUpdatedEpoch": 1629868830475,
"startTimeEpoch": 1629868815521
}
]
},
{
"id": "application_1628518360417_0028",
"name": "Spark Pi",
"attempts": [
{
"attemptId": "2",
"startTime": "2021-08-25T05:19:22.850GMT",
"endTime": "2021-08-25T05:19:44.662GMT",
"lastUpdated": "2021-08-25T05:19:44.726GMT",
"duration": 21812,
"sparkUser": "elixir-kook",
"completed": true,
"appSparkVersion": "2.4.5",
"endTimeEpoch": 1629868784662,
"lastUpdatedEpoch": 1629868784726,
"startTimeEpoch": 1629868762850
}
]
},
....
]
{code}
attemptId should be exists.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
