Github user kayousterhout commented on the pull request:
https://github.com/apache/spark/pull/246#issuecomment-39297535
Hey @sundeepn, so there's one other problem with your change which is that
the code you added in the UI to clean up the stages for a cancelled job doesn't
quite work because of the issue we discussed above, where a stage can be used
by multiple jobs. Fixing this is a big pain that I don't want to subject you
to, so I'm working on a separate pull request that properly cleans up stuff in
the UI when a job gets cancelled (since this fact that this is broken is not an
artifact of your change; it's just made more obvious by your change). I've
started this but I'm not quite done; I'll submit this in the next day or so and
cc you on the pull request, and then hopefully we can get both of these things
into the 1.0 release.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
