Hi Eric, Check the "Debugging Your Application" section at: http://spark.apache.org/docs/latest/running-on-yarn.html
Long story short: upload your log4j.properties using the "--files" argument of spark-submit. (Mental note: we could make the log level configurable via a system property...) On Wed, Oct 15, 2014 at 5:58 PM, eric wong <win19...@gmail.com> wrote: > Hi, > > I want to check the DEBUG log of spark executor on YARN(using yarn-cluster > mode), but > > 1. yarn daemonlog setlevel DEBUG YarnChild.class > 2. set log4j.properties in spark/conf folder on client node. > > no means above works. > > So how could i set the log level of spark executor on YARN container to > DEBUG？ > > Thanks! > > > > > -- > Wang Haihua > -- Marcelo --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
