Re: job execution logs

2018-06-26 Thread Abbass
uys any idea about where Livy keeps job execution logs (Spark driver > logs) ? > > I saw a couple of lines here : > > https://github.com/apache/incubator-livy/blob/master/server/src/main/scala/org/apache/livy/server/batch/BatchSession.scala#L90 >

Re: job execution logs

2018-06-25 Thread Meisam Fathi
If you are using YARN the driver logs are always available at YARN resource manager. You can also see the logs from /sessions/{sessionid}/logs Thanks, Meisam On Sun, Jun 24, 2018 at 1:37 PM Abbass wrote: > Guys any idea about where Livy keeps job execution logs (Spark driver > logs) ?

job execution logs

2018-06-24 Thread Abbass
Guys any idea about where Livy keeps job execution logs (Spark driver logs) ? I saw a couple of lines here : https://github.com/apache/incubator-livy/blob/master/server/src/main/scala/org/apache/livy/server/batch/BatchSession.scala#L90 to redirect stdout & stderr somewhere. Is there an