Re: Interpreter zombie processes

2016-12-16 Thread Ruslan Dautkhanov
e have many concurrent interpreters running. > > > > -- > View this message in context: http://apache-zeppelin-users- > incubating-mailing-list.75479.x6.nabble.com/Interpreter- > zombie-processes-tp4738p4746.html > Sent from the Apache Zeppelin Users (incubating) mailing

Re: Interpreter zombie processes

2016-12-16 Thread blaubaer
We are seeing this problem as well, regularly actually. Especially in situations when we have many concurrent interpreters running. -- View this message in context: http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Interpreter-zombie-processes-tp4738p4746.html Sent from

Re: Interpreter zombie processes

2016-12-15 Thread Alexander Bezzubov
Have similar experience, although hard to say what's the reason as all process supposed to killed, as Moon pointed out. Also noticed that with `mvn tests`, after almost every run, there are 1-2 zombie RemoteInterpreter processes hanging around. -- Alex On Fri, Dec 16, 2016 at 11:24 AM, Jeff Zhang

Re: Interpreter zombie processes

2016-12-15 Thread Jeff Zhang
I believe I see this before too. Luciano Resende 于2016年12月16日周五 上午10:17写道: > I have also seen similar issues even using zeppelin-ddeamon but didn't > have much time to investigate the issue when it was happening to me. > > On Thu, Dec 15, 2016 at 12:15 PM Ruslan Dautkhanov > wrote: > > Moon, >

Re: Interpreter zombie processes

2016-12-15 Thread Luciano Resende
I have also seen similar issues even using zeppelin-ddeamon but didn't have much time to investigate the issue when it was happening to me. On Thu, Dec 15, 2016 at 12:15 PM Ruslan Dautkhanov wrote: > Moon, > > > ZeppelinServer try to terminate interpreter process when shutting down > [1]. > > Un

Re: Interpreter zombie processes

2016-12-15 Thread Ruslan Dautkhanov
Moon, > ZeppelinServer try to terminate interpreter process when shutting down [1]. Unfortunatally, this does not happen all the time. I have seen zombie spark interpreter processes many times. As a double conirmation - I see spark yarn application was still running. > Also bin/zeppelin-deamon.s

Interpreter zombie processes

2016-12-15 Thread Ruslan Dautkhanov
How to make Interpreter processes terminate if Zeppelin server exits? When we restart Zeppelin server (main process), in many cases, Interpreter process keeps running, essential becoming a zombie processes. In case of Spark interpreter, it also holds SparkContext - consuming server-side resources