Marcelo Vanzin created SPARK-11929:
--------------------------------------
Summary: spark-shell log level customization is lost if user
provides a log4j.properties file
Key: SPARK-11929
URL: https://issues.apache.org/jira/browse/SPARK-11929
Project: Spark
Issue Type: Improvement
Components: Spark Core, Spark Shell
Reporter: Marcelo Vanzin
Priority: Minor
{{Logging.scala}} has code that defines the default log level for the
spark-shell to WARN, to avoid lots of noise in the output.
But if a user provides a log4j.properies file in the Spark configuration, that
customization is lost. That means that without a log4j.properties, there are
two different configurations (one for regular apps, one for the shell). But if
you have a custom file, you lose the ability to easily differentiate between
those two, and you're stuck with a single config for both.
It would be nice to allow different configurations also in the second case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
