Github user andrewor14 commented on the pull request:
https://github.com/apache/spark/pull/718#issuecomment-45550223
@vanzin Thanks for your work on the history server. I left a few comments
in the code.
It seems that right now we replay every rendered application twice (by
calling `loadAppInfo`), once when we first check for the logs, and once when we
actually render it. This could be expensive if these logs are huge. Is there a
way to avoid this? It looks like we're only really interested in the
ApplicationStart event anyway if we're not actually rendering the SparkUI. This
probably requires a little bit of refactoring.
Also, I tested the pagination thing locally and it didn't work for me. When
I tried to load anything beyond the first page, I got blank tables. Are you
able to reproduce this?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
