The spark log classes are based on the actual class names. So if you want to filter out a package's logs you need to specify the full package name (e.g. "org.apache.spark.storage" instead of just "spark.storage").
On Tue, Jul 22, 2014 at 2:07 PM, abhiguruvayya <sharath.abhis...@gmail.com> wrote: > Thanks i am able to load the file now. Can i turn off specific logs using > log4j.properties. I don't want to see the below logs. How can i do this. > > 14/07/22 14:01:24 INFO scheduler.TaskSetManager: Starting task 2.0:129 as > TID 129 on executor 3: ****** (NODE_LOCAL) > 14/07/22 14:01:24 INFO scheduler.TaskSetManager: Serialized task 2.0:129 as > 14708 bytes in 0 ms > > *current log4j.properties entry:* > > # make a file appender and a console appender > # Print the date in ISO 8601 format > log4j.appender.myConsoleAppender=org.apache.log4j.ConsoleAppender > log4j.appender.myConsoleAppender.layout=org.apache.log4j.PatternLayout > log4j.appender.myConsoleAppender.layout.ConversionPattern=%d [%t] %-5p %c - > %m%n > log4j.appender.myFileAppender=org.apache.log4j.RollingFileAppender > log4j.appender.myFileAppender.File=spark.log > log4j.appender.myFileAppender.layout=org.apache.log4j.PatternLayout > log4j.appender.myFileAppender.layout.ConversionPattern=%d [%t] %-5p %c - > %m%n > > > > # By default, everything goes to console and file > log4j.rootLogger=INFO, myConsoleAppender, myFileAppender > > # The noisier spark logs go to file only > log4j.logger.spark.storage=INFO, myFileAppender > log4j.additivity.spark.storage=false > log4j.logger.spark.scheduler=INFO, myFileAppender > log4j.additivity.spark.scheduler=false > log4j.logger.spark.CacheTracker=INFO, myFileAppender > log4j.additivity.spark.CacheTracker=false > log4j.logger.spark.CacheTrackerActor=INFO, myFileAppender > log4j.additivity.spark.CacheTrackerActor=false > log4j.logger.spark.MapOutputTrackerActor=INFO, myFileAppender > log4j.additivity.spark.MapOutputTrackerActor=false > log4j.logger.spark.MapOutputTracker=INFO, myFileAppender > log4j.additivty.spark.MapOutputTracker=false > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Spark-job-tracker-tp8367p10440.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. -- Marcelo
