Github user shahidki31 commented on the issue:
https://github.com/apache/spark/pull/23038
Hi @vanzin ,
For history server also the same issue happens (see
https://issues.apache.org/jira/browse/SPARK-26100) , and the current fix alone
is not sufficient for history server case.
In History server, both 'Jobs' table and 'Aggregated Metrics' table shows
incorrect total tasks.
The reason is because, when the condition satisfies, we force update only
live application store.
I have modified the code, so that the issue will not happen for both
History and live UI.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
