Github user srowen commented on the pull request:
https://github.com/apache/spark/pull/4845#issuecomment-76680020
(Title should start with something like `SPARK-4705 [YARN] ...`)
This seems like a big change for a fairly narrow problem, which is that
retrying the driver in cluster mode fails because the same logs dir is used. I
think we just need to pick semantics, like using a subdir of the given dir, or
removing old logs on a retry, and implement that. I think adding a new UI
sounds like overkill, at least to address this.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
