Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/7253#issuecomment-119370636
My interpretation of the bug is different. Basically, the bug says that
when an old attempt that shows up as "running" exists, the newer attempt, even
if finished, is ignored, meaning the application is actually finished but does
not show up on the finished list.
I think the bug is actually in `FsHistoryProvider::compareAttemptInfo`. The
javadoc says:
Comparison function that defines the sort order for application
attempts within the same
application. Order is: running attempts before complete attempts,
running attempts sorted
by start time, completed attempts sorted by end time.
That is wrong given what the bug describes; perhaps the correct sort order
should be based solely on the attempt's start time.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
