Github user mateiz commented on the pull request:
https://github.com/apache/spark/pull/1776#issuecomment-51552785
As I said, we do *not* want users to have to change anything when
rerunning. It's just an extra step and it makes it much harder to report
problems. From my point of view:
- The executor logs can remain at INFO and contain what they have now; you
only look at those if you had a problem
- The driver could be less verbose; we can eventually put it on WARN, but
for now we should at least reduce their verbosity. For example long-term we
might make spark-shell launch with WARN while executors launch with INFO.
Also IMO it's too late to change this stuff for 1.1; this is a pretty big
change. We can look at it for 1.2 though, and I'd also be okay removing a few
noisy log messages for 1.1.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
