Zeppelin performances with a lot of notebooks

[stephane.davy]

Hello,

 

I’m facing performances issues with zeppelin. It seems that these
performances are mainly located on the browser side. I have actually a
Zeppelin instance with quite a lot of notebooks and many paragraphs inside,
and I find that Zeppelin refresh and rendering is really slow. It means for
example that the spark job is finished, but the Web UI shows that it is 20%
completed, and it takes a few minutes to reflect the real spark status.

So, I extracted one notebook, and imported it in another Zeppelin on the
same server. Actually, I have this:

-          A Zeppelin 0.8.0 which comes with Hortonworks data platform

-          A standalone Zeppelin 0.8.2 on the same server, with the same
configuration for memory

 

And then, my notebook imported in the standalone instance runs really
fastly. One difference I also have between the 2 instances is that the
standalone one has its notebook on local filesystem, while the HDP one has
its notebook on hdfs. For sure, hdfs access is slower than the local fs one.
Can this also be a possible origin of this issue?

 

Thanks for your help,

 

Stéphane

smime.p7s
Description: S/MIME cryptographic signature