Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/5491#issuecomment-92567471
Yeah, I'm a little on the fence. Pressure on HDFS shouldn't be a problem -
you don't need to call `setTimes` that often, just often enough that the HS
wouldn't clean up the log.
On the other hand, users should fix their apps.
Anyway, I'll review the current patch as is. It was just an idea to try to
still clean up these broken logs.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
