Re: PySpark with livy

It is more likely your spark configuration issue, could you run this code in pyspark shell ? Mauro Schneider 于2017年9月29日周五 下午11:24写道： > > Hi > > I'm trying execute PySpark code with Zeppelin and Livy but without > success. With Scala and Livy work well but when I execute the

Re: Implementing run all paragraphs sequentially

Current behavior is as parallel as possible. Run notebook button currently submits all paragraphs in a notebook into each interpreter's own scheduler (FIFO, Parallel) at once. And each individual scheduler of interpreter runs the paragraphs. I think we can provide "sequential" run button for

Re: Implementing run all paragraphs sequentially

What is the current behavior? On Fri, Sep 29, 2017 at 6:56 AM, Herval Freire wrote: > At least in our case, the notebooks that we need to run sequentially are > expected to *always* run sequentially - thus it makes more sense to be a > note option than a per-run mode > > H

PySpark with livy

Hi I'm trying execute PySpark code with Zeppelin and Livy but without success. With Scala and Livy work well but when I execute the code below I getting a Exception from Zeppelin. %livy.pyspark txtFile = sc.textFile ("/data/staging/zeppelin_test/data.txt") counts = txtFile.flatMap(lambda line:

Re: Implementing run all paragraphs sequentially

At least in our case, the notebooks that we need to run sequentially are expected to *always* run sequentially - thus it makes more sense to be a note option than a per-run mode H _ From: moon soo Lee > Sent: Thursday,

RE: Implementing run all paragraphs sequentially

even frustrating, especially when ‘20170929-143857_1744629322’ names are involved. Sergey Sotnichenko From: Polyakov Valeriy [mailto:v.polja...@tinkoff.ru] Sent: Friday, September 29, 2017 3:11 PM To: users@zeppelin.apache.org Subject: RE: Implementing run all paragraphs sequentially This can

Re: ZeppelinContext run method runs a paragraph as anonymous user

These are my findings: I think I have found why the credentials are lost, I I think I might be able to create a patched version that will work for us.Execution flow: 1. Spark job uses method run from ZeppelinContext. 2. The method run gets all the InterpreterContextRunner for a given

RE: Implementing run all paragraphs sequentially

nkoff.ru>>于2017年9月29日周五 下午7:45写道： It would be very complicated to be honest to build a DAG with names like ‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such names. Sergey Sotnichenko From: Jeff Zhang [mailto:zjf...@gmail.com<mailto:zjf...@gmail.com>] Sent: Fr

Re: Implementing run all paragraphs sequentially

ying the > dependency relationship between paragraphs, it is almost impossible to > schedule paragraphs correctly. > > > > > Sotnichenko Sergey <s.sotniche...@tinkoff.ru>于2017年9月29日周五 下午7:45写道： > >> It would be very complicated to be honest to build a DAG with nam

Re: Implementing run all paragraphs sequentially

u>于2017年9月29日周五 下午7:45写道： > It would be very complicated to be honest to build a DAG with names like > ‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such > names. > > > > > > > *Sergey Sotnichenko * > > > > > > *From:*

RE: Implementing run all paragraphs sequentially

‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such names. Sergey Sotnichenko From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Friday, September 29, 2017 2:35 PM To: users@zeppelin.apache.org<mailto:users@zeppelin.apache.org> Subject: Re: Implementing run all para

RE: Implementing run all paragraphs sequentially

It would be very complicated to be honest to build a DAG with names like ‘20170929-143857_1744629322’. Let’s imagine we have 20 paragraphs with such names. Sergey Sotnichenko From: Jeff Zhang [mailto:zjf...@gmail.com] Sent: Friday, September 29, 2017 2:35 PM To: users@zeppelin.apache.org

Re: Implementing run all paragraphs sequentially

'p1', 'p2' is paragraphId. Regarding the readability, we could allow user to set paragraph name, but this is another story, could be an improvement later. Partridge, Lucas (GE Aviation) 于2017年9月29日周五 下午7:30写道： > Interesting idea. But by ‘p1’, ‘p2’, etc did you

Design and Setup consideration?

Ok… so I have Nginx set up as a proxy in front of Zeppelin. With nginx I have to enter my username and password that I set up with htpasswd. Then I’m seeing my Zeppelin where I have shiro still implemented. (So I can have multiple users rather everyone running as anonymous.) This may be a

Implementing run all paragraphs sequentially

Interesting idea. But by ‘p1’, ‘p2’, etc did you literally mean that; or were you using that as shorthand for the id of the paragraph? If the former then what happens if someone inserts, deletes or reorders paragraphs? But if the latter then the paragraph ids wouldn’t be very easy for someone

Re: Implementing run all paragraphs sequentially

I don't think 2 note setting (parallel/sequential) is sufficient for paragraph scheduling (take the spark tutorial note as an example, we should run the loading bank data paragraph first and then could run all the sql paragraph parallelly). So the key is how we define the dependency relationship

Re: Implementing run all paragraphs sequentially

+1 I think this is one of the most important features. don't know why this requirement has been skipped. /afancy On Thu, Sep 28, 2017 at 5:28 PM, Belousov Maksim Eduardovich < m.belou...@tinkoff.ru> wrote: > Hello, users! > > At the moment our analysts often use mixes of interpreters in their

Re: Implementing run all paragraphs sequentially

We've been needing this feature as well. Very frustrating the way it currently works. Get Outlook for Android On Fri, Sep 29, 2017 at 12:04 AM -0400, "moon soo Lee" wrote: This is going to be really useful! Curios why do you prefer 'note option' instead of

setting paragraph text

Hello, I'm trying to set a paragraph text from within custom sink provider with the following code: val template ="%angular" + "" + "alert(123)" + "" val pid ="20170928-133811_1295405352" z.put(pid, template) z.run(pid) The paragraph run successfully but the content is not set. The