HI Ajay, Thanks for the reporting, which version do you use ? One know issue of spark scoped mode is that each spark repl will occupy large memory and won't be released, one workaround is to increase the driver memory.
https://jira.apache.org/jira/browse/ZEPPELIN-3389 Ajay Viswanathan <[email protected]>于2018年11月9日周五 下午3:31写道： > This is an issue even I am facing in my project currently. By running the > spark interpreter in Scoped + Per Note mode, I do manage to execute > paragraphs in parallel, but it becomes very resource intensive and times > out if I run more than 3-4 jobs in parallel on a 4-core cloud instance. > Typically a Thrift Transport exception is thrown after a prolonged period > of inactivity, > > On Fri, 9 Nov 2018 at 06:54, Jeff Zhang <[email protected]> wrote: > > > Which version do you use ? This seems a bug. Each note should have its > own > > scheduler in scoped per note mode. > > > > <[email protected]>于2018年11月9日周五 上午1:56写道： > > > > > Hi > > > > > > We use zeppelin in multi-user environment, the interpreter scope mode > > > seems to allow notebook execution in serial only. If multiple users are > > > running their notebooks concurrently, these notebooks are queued for > > serial > > > execution. If one notebook takes a long time to complete, it basically > > > blocks other notebooks from execution. To enable parallel notebook > > > execution, it seems we need to use the isolated mode, which creates a > new > > > interpreter instance (run on separate JVM) per user. But this can > become > > > expensive (compute resource intensive). what is the suggested > interpreter > > > mode for multi-user environment? > > > > > > Thanks > > > Denny > > > > > > > > -- > Ajay Viswanathan > *Sr. Software Engineer, CAPS - Processing* > *A: *5th & 6th Floor | Skav 909 | 9/1 | Lavelle Road | Bangalore | 560001 > *E: *[email protected] > *M: *+00 (0)0 0000 0000 > *W: *wearemiq.com > [image: MiQ] <http://wearemiq.com/> > *Disclaimer: *This email and its attachments are confidential and are > intended solely for the use of the individual to whom it is addressed. If > you are not the intended recipient of this email and its attachments, you > must take no action based upon them, nor must you copy or show them to > anyone. No contracts or official orders shall be concluded by means of this > email. Please contact the sender if you believe you have received this > email in error. >
