Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/15556
I tried this out on one of our larger clusters. Normally history UI shows
around 4500-5000 applications and takes a long time to load all of them. I
don't have an exact time but I'm sure its over an hour. We have history files
that can be 10's of GBs.
It is loading noticeably faster but to me its still not as good as it could
be for just listing the apps. It took 30 minutes for it to create the entire
listing. That is the initial startup.
anyway I'm fine with it as its definitely an improvement but I think we
should leave the other one open. Or if no one else has this problem leave it
closed and I'll reopen when I have time to work on it. I won't have time to
code review in detail today but if others have already you don't have to wait
for me.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
