RE: Equivalent of Jupyter %run

I've hardly used Jupyter so can't comment on an equivalent for %run. But for Zeppelin you can put your python files on the local file system of your Spark driver node, or more commonly in HDFS, and then use sc.addPyFile() [1] to make each file available in the SparkContext. Then you can import

Can you reload/reimport a Python module in Zeppelin without restarting the livy pyspark interpreter?

We're using sc.addPyFile("path/to/mymodule.py") to load our own custom Python modules from HDFS. We're frequently editing the .py files and so want to update what's imported into the %pyspark interpreter of Zeppelin. However we have not found a way to do this without restarting the livy

Question About Zeppelin/Git...

Hi Marcelo, Please see https://zeppelin.apache.org/community.html . That links to the issue tracker on JIRA: https://issues.apache.org/jira/projects/ZEPPELIN Thanks, Lucas. From: Marcelo Marques Sent: 26 October 2018 12:37 To: users@zeppelin.apache.org Subject: EXT: Re: Question About

RE: Python script calls R script in Zeppelin on Hadoop

Have you tried SparkContext.addFile() (not addPyFile()) to add your R script? https://spark.apache.org/docs/2.2.0/api/python/pyspark.html#pyspark.SparkContext.addFile From: Lian Jiang Sent: 27 August 2018 22:42 To: users@zeppelin.apache.org Subject: EXT: Python script calls R script in Zeppelin

[DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json

/notebooks at >>> present. That’s not very user-friendly. Actually my proposal is to use real folders. What user see in zeppelin note menu is the actual notes folder structure. If they want to move the notebooks to another folder, they can change the folder name just like what user did i

[DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json

Hi Jeff, I have some questions about this proposal (I can’t edit the design doc): 1. Do we need the note id in the file name at all? What’s wrong with just note_name.zpln? 2. If the file content is json then why not use note_name.json instead of .zpln? That would make it easier for

[DISCUSS] Is interpreter binding necessary ?

“So usually we would recommend user to specify the full qualified interpreter name.” - I usually recommend the exact opposite to our users. We frequently change interpreter groups to allow for different Spark cluster settings (number of executors, memory, etc). Users with more demanding

RE: [DISCUSS] Roadmap 0.9 and future

Yes, thanks for sharing this roadmap, moon! I don’t know what the “Sidebar with plugin widget” item was referring to, but navigation within large notebooks could definitely be improved. E.g., add a clickable outline view in a sidebar, like Jupyter does, which can be used to jump straight to a

Jar dependencies are not reloaded when Spark interpreter is restarted?

you change the dependency, is only about the content? Or content and version. I think the dependency should be reloaded only if its version change. I do not think it's optimal to re-download the dependencies every time the interpreter reboots. El 22 feb. 2018 05:22, "Partridge, Lucas (GE Avi

Jar dependencies are not reloaded when Spark interpreter is restarted?

I'm using Zeppelin 0.7.3 against a local standalone Spark 'cluster'. I've added a Scala jar dependency to my Spark interpreter using Zeppelin's UI. I thought if I changed my Scala code and updated the jar (using sbt outside of Zeppelin) then all I'd have to do is restart the interpreter for the

Importing notes

. Or maybe I can consider that a limitation of the import feature I'm doing now. On Thu, Feb 1, 2018 at 10:15 AM, Partridge, Lucas (GE Aviation) <lucas.partri...@ge.com<mailto:lucas.partri...@ge.com>> wrote: As far as I know all you have to do is copy the contents of the not

Importing notes

As far as I know all you have to do is copy the contents of the notebook folder as-is into the same folder of the new Zeppelin instance. That’s what I did when I moved from one Zeppelin version to another recently and it all appears to work! I think Zeppelin just reads the contents of that

RE: Use Bokeh in Apache Zeppelin

zjf...@gmail.com> Cc: users@zeppelin.apache.org Subject: EXT: Re: Use Bokeh in Apache Zeppelin Nice! Get this in https://github.com/apache/zeppelin/blob/master/docs/interpreter/python.md? From: Partridge, Lucas (GE Aviation) <lucas.partri...@ge.com<mailto:

Use Bokeh in Apache Zeppelin

= figure() f.line(x=[1,2],y=[3,4]) show(f) From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: 09 January 2018 23:24 To: Partridge, Lucas (GE Aviation) <lucas.partri...@ge.com> Cc: users@zeppelin.apache.org Subject: EXT: Re: Use Bokeh in Apache Zeppelin Awesome. Glad to see you can use

RE: Use Bokeh in Apache Zeppelin

I forgot to say I’m using Bokeh 0.12.13. From: Partridge, Lucas (GE Aviation) Sent: 09 January 2018 13:24 To: users@zeppelin.apache.org Cc: zjf...@gmail.com Subject: EXT: RE: Use Bokeh in Apache Zeppelin Hi Jeff, Adding support for Bokeh in Zeppelin is great! At https://www.zepl.com/viewer

RE: Use Bokeh in Apache Zeppelin

Hi Jeff, Adding support for Bokeh in Zeppelin is great! At https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS90ZXN0L2VhMGI0ODQ0MzNhYjQxNjZhODg5MjI1ZjAxZWVjMjdiL25vdGUuanNvbg it says: “If you want to use bokeh in spark interpreter. You need HDP 2.6.0 (Zeppelin 0.7.0) or afterwards” I’m

How to execute spark-submit on Note

“we were considering how to deliver our programs to users widely after we made a program with collaboration on Zeppelin” - This is a common question/use case in my experience with Zeppelin: “How do we roll out code to everyone once it’s been prototyped in Zeppelin?”. Our approach is to

Implementing run all paragraphs sequentially

Interesting idea. But by ‘p1’, ‘p2’, etc did you literally mean that; or were you using that as shorthand for the id of the paragraph? If the former then what happens if someone inserts, deletes or reorders paragraphs? But if the latter then the paragraph ids wouldn’t be very easy for someone

FW: "Reload notes from storage" button overwrites recent edits

Steam, etc handle syncing of files between devices and cloud storage without the need for a refresh button at all, but I guess it would be a big job to replicate this behaviour in Zeppelin. From: Partridge, Lucas (GE Aviation) Sent: 25 July 2017 10:10 To: users@zeppelin.apache.org Subject: EXT: &qu

How to find out zeppelin's version number from within a notebook?

n() { const currentVersion = $rootScope.zeppelinVersion https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/interpreter/interpreter.controller.js#L777-L778 Regard, ​ On Tue, Jul 25, 2017 at 5:50 PM, Partridge, Lucas (GE Aviation) <lucas.partri...@ge.com<mailto:lucas.pa

"Reload notes from storage" button overwrites recent edits

When a user clicks on this button on the Zeppelin homepage: [Screen Clipping] ...which notebooks are reloaded from storage: all the notebooks, or only the notebooks that belong to the user who clicked the refresh button? Unfortunately in our setup, where all the notebooks are backed up on S3, it

Clarifying the docs on interpreter binding modes

FYI I've raised a JIRA issue to clarify the docs on the relationship between interpreters, interpreter groups and interpreter binding modes: https://issues.apache.org/jira/browse/ZEPPELIN-2582 . It would be great to see some diagrams that explain the different modes and what implications they

Can't delete an empty paragraph?

free share any issues on your version. Thanks, moon [1] https://issues.apache.org/jira/browse/ZEPPELIN-2276 On Fri, Apr 21, 2017 at 6:22 AM Partridge, Lucas (GE Aviation) <lucas.partri...@ge.com<mailto:lucas.partri...@ge.com>> wrote: I can’t delete an empty paragraph in a notebook.

Can't delete an empty paragraph?

I can't delete an empty paragraph in a notebook. I'm talking about an empty paragraph that's not the last paragraph. I can click on Remove under the paragraph's settings icon and be prompted to delete it, but when I click OK the paragraph doesn't get deleted! To delete it I have to put

How can I install Python packages from within a Zeppelin notebook?

The docs for the Python interpreter say: "The interpreter can use all modules already installed (with pip, easy_install...)". For example, on my own personal Zeppelin installation I can access the hdfs package by running

Ask opinion regarding 0.6.0 release package

I like the 'zeppelin-bin-netinst’ idea too. Hopefully it would be easy to configure it to work with a proxy for users behind a corporate firewall. Thanks, Lucas. From: Mohit Jaggi [mailto:mohitja...@gmail.com] Sent: 17 June 2016 18:06 To: users@zeppelin.apache.org Subject: EXT: Re: Ask opinion