Re: TimeoutLifecycleManager not doing anything

2018-04-06 Thread Paul Brenner
These are Spark interpreters that aren’t getting killed. Does  TimeoutLifecycleManager kill spark interpreters when the last submitted job finished was more than zeppelin.interpreter.lifecyclemanager.timeout.threshold milliseconds ago

Re: TimeoutLifecycleManager not doing anything

2018-04-05 Thread Jeff Zhang
Hi Paul, What interpreter do you find that is not killed ? Unfortunately there's no log for the lasttimeusing (I should add that for debugging). And let me know if it is easy to reproduce. Paul Brenner 于2018年4月5日周四 下午11:21写道: > Wow, looks like I was wrong. TimeoutLifecycleMa

Re: TimeoutLifecycleManager not doing anything

2018-04-05 Thread Paul Brenner
Wow, looks like I was wrong. TimeoutLifecycleManager is definitely killing some idle interpreters, just not all idle interpreters. I have no idea what could be causing the difference. It looks like the manager is pulling some value for lasttimeusing here  https://github.com/apache/zeppelin/blob

Re: TimeoutLifecycleManager not doing anything

2018-04-05 Thread Michael Bullock
Hi Jeff, If I am using zeppelin in an AWS environment what type of metric could I gather using cloudformation scripts? On Thu, Apr 5, 2018 at 10:43 AM, Jeff Zhang wrote: > > Try to look for logs like following in zeppelin server log file. Make sure > you are using TimeoutLifecyc

Re: TimeoutLifecycleManager not doing anything

2018-04-05 Thread Jeff Zhang
Try to look for logs like following in zeppelin server log file. Make sure you are using TimeoutLifecycleManager instead of NullLifecycleManager INFO [2018-04-04 18:12:26,209] ({main} InterpreterSettingManager.java[]:170) - Using LifecycleManager

TimeoutLifecycleManager not doing anything

2018-04-05 Thread Paul Brenner
We finally got our team up and running on a version of Zeppelin 0.8 built from source. However, we can’t seem to get TimeoutLifecycleManager manager to kill idle interpreters. When I look at the config page I see: zeppelin.interpreter.lifecyclemanager.class

Re: TimeoutLifecycleManager

2018-02-12 Thread Ruslan Dautkhanov
terpreter log ? > > > Ruslan Dautkhanov 于2018年2月13日周二 上午7:45写道: > >> Trying out below settings for the new TimeoutLifecycleManager : >> >> >>> zeppelin.interpreter.lifecyclemanager.class >>> org.

Re: TimeoutLifecycleManager

2018-02-12 Thread Jeff Zhang
Right, you spark interpreter should be killed in 10 minutes of idless, could you attach your full zeppelin server log & spark interpreter log ? Ruslan Dautkhanov 于2018年2月13日周二 上午7:45写道: > Trying out below settings for the new TimeoutLifecycle

TimeoutLifecycleManager

2018-02-12 Thread Ruslan Dautkhanov
Trying out below settings for the new TimeoutLifecycleManager : > zeppelin.interpreter.lifecyclemanager.class > org.apache.zeppelin.interpreter.lifecycle.TimeoutLifecycleManager > zeppelin.interpreter.lifecyclemanager.timeout.checkinterva