This is an issue even I am facing in my project currently. By running the spark interpreter in Scoped + Per Note mode, I do manage to execute paragraphs in parallel, but it becomes very resource intensive and times out if I run more than 3-4 jobs in parallel on a 4-core cloud instance. Typically a Thrift Transport exception is thrown after a prolonged period of inactivity,
On Fri, 9 Nov 2018 at 06:54, Jeff Zhang <[email protected]> wrote: > Which version do you use ? This seems a bug. Each note should have its own > scheduler in scoped per note mode. > > <[email protected]>于2018年11月9日周五 上午1:56写道： > > > Hi > > > > We use zeppelin in multi-user environment, the interpreter scope mode > > seems to allow notebook execution in serial only. If multiple users are > > running their notebooks concurrently, these notebooks are queued for > serial > > execution. If one notebook takes a long time to complete, it basically > > blocks other notebooks from execution. To enable parallel notebook > > execution, it seems we need to use the isolated mode, which creates a new > > interpreter instance (run on separate JVM) per user. But this can become > > expensive (compute resource intensive). what is the suggested interpreter > > mode for multi-user environment? > > > > Thanks > > Denny > > > -- Ajay Viswanathan *Sr. Software Engineer, CAPS - Processing* *A: *5th & 6th Floor | Skav 909 | 9/1 | Lavelle Road | Bangalore | 560001 *E: *[email protected] *M: *+00 (0)0 0000 0000 *W: *wearemiq.com [image: MiQ] <http://wearemiq.com/> *Disclaimer: *This email and its attachments are confidential and are intended solely for the use of the individual to whom it is addressed. If you are not the intended recipient of this email and its attachments, you must take no action based upon them, nor must you copy or show them to anyone. No contracts or official orders shall be concluded by means of this email. Please contact the sender if you believe you have received this email in error.
