RE: Spark logging strategy on YARN

2014-07-07 Thread Andrew Lee
: kudryavtsev.konstan...@gmail.com Subject: Spark logging strategy on YARN Date: Thu, 3 Jul 2014 22:26:48 +0300 To: user@spark.apache.org Hi all, Could you please share your the best practices on writing logs in Spark? I’m running it on YARN, so when I check logs I’m bit confused

Spark logging strategy on YARN

2014-07-03 Thread Kostiantyn Kudriavtsev
Hi all, Could you please share your the best practices on writing logs in Spark? I’m running it on YARN, so when I check logs I’m bit confused… Currently, I’m writing System.err.println to put a message in log and access it via YARN history server. But, I don’t like this way… I’d like to use