Github user jerryshao commented on the issue:
https://github.com/apache/spark/pull/19263
Hi @michaelmalak , history server only shows the last state of application
before finished, and cached blocks can be evicted/unpersisted during the middle
of application. So you probably cannot get such information from history
server. IMHO, looks like such feature is not so useful, but since this is off
by default, so I'm neutral on this feature. You can ask other reviewers to give
the green light ð .
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
