[
https://issues.apache.org/jira/browse/SPARK-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Patrick Wendell updated SPARK-7261:
-----------------------------------
Description:
We should add a log4j properties file for the repl
(log4j-defaults-repl.properties) that has the level of warning. The main reason
for doing this is that we now display nice progress bars in the REPL so the
need for task level INFO messages is much less.
The best way to accomplish this is the following:
1. Add a second logging defaults file called log4j-defaults-repl.properties
that has log level WARN.
https://github.com/apache/spark/blob/branch-1.4/core/src/main/resources/org/apache/spark/log4j-defaults.properties
2. When logging is initialized, check whether you are inside the REPL. If so,
then use that one:
https://github.com/apache/spark/blob/branch-1.4/core/src/main/scala/org/apache/spark/Logging.scala#L124
3. The printed message should say something like:
Using Spark's repl log4j profile:
org/apache/spark/log4j-defaults-repl.properties
To adjust logging level use sc.setLogLevel("INFO")
was:
We should add a log4j properties file for the repl
(log4j-defaults-repl.properties) that has the level of warning. The main reason
for doing this is that we now display nice progress bars in the REPL so the
need for task level INFO messages is much less.
A couple other things:
1. I'd block this on SPARK-7260
2. We should say in the repl opening that the log leve is set to WARN and
explain to people how to change it programatically.
3. If the user has a log4j properties, it should take precedence over this
default of WARN.
> Change default log level to WARN in the REPL
> --------------------------------------------
>
> Key: SPARK-7261
> URL: https://issues.apache.org/jira/browse/SPARK-7261
> Project: Spark
> Issue Type: Improvement
> Components: Spark Shell
> Reporter: Patrick Wendell
> Assignee: Patrick Wendell
> Priority: Blocker
> Labels: starter
>
> We should add a log4j properties file for the repl
> (log4j-defaults-repl.properties) that has the level of warning. The main
> reason for doing this is that we now display nice progress bars in the REPL
> so the need for task level INFO messages is much less.
> The best way to accomplish this is the following:
> 1. Add a second logging defaults file called log4j-defaults-repl.properties
> that has log level WARN.
> https://github.com/apache/spark/blob/branch-1.4/core/src/main/resources/org/apache/spark/log4j-defaults.properties
> 2. When logging is initialized, check whether you are inside the REPL. If so,
> then use that one:
> https://github.com/apache/spark/blob/branch-1.4/core/src/main/scala/org/apache/spark/Logging.scala#L124
> 3. The printed message should say something like:
> Using Spark's repl log4j profile:
> org/apache/spark/log4j-defaults-repl.properties
> To adjust logging level use sc.setLogLevel("INFO")
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
