Hi Dafeng, Zeppelin keeps notebooks in memory. That may cause OOM when notebooks has a lot of contents (code + result) inside. Unfortunately, unless modify Zeppelin to not keep notebooks in memory, there're no good way to reduce memory usage except for keep result small.
Most of notebooks i've seen is less than 2MB and i've seen people usually has ~300 notebooks in their Zeppelin instance. Do you mind sharing your case? How big your notebook is and how many notebooks your Zeppelin instance have? That might help zeppelin developers to get idea how notebook need to be handled in ZeppelinServer. Thanks, moon On Wed, Feb 24, 2016 at 8:58 PM Dafeng Wang <dafe...@microsoft.com> wrote: > It turns out zeppelin server itself oom since it cache too many results, > are there any methods/work arounds/fixes to get this issue done? > > > > Regards, > > Dafeng > > > > *From:* Dafeng Wang [mailto:dafe...@microsoft.com] > *Sent:* Thursday, February 25, 2016 10:31 AM > *To:* users@zeppelin.incubator.apache.org > *Subject:* OOM error when run all paragraphs > > > > Hi, > > Today when I try to run the zeppelin with a complicated notebook, if I run > them one by one, it works well, however, when I click on running all > paragraphs, it will throw OOM errors in a short time, I set zeppelin’s > interpreter’s memory as 6G. any idea? > > Regards, > > Dafeng > >
