How to execute spark-submit on Note

Hi all, I searched this topic on the archive of ml, but still could not find out the solution clearly. So i have tried to post this again(maybe). I am using ver 0.8.0, and have installed spark 2.2 on the other path, just for checking my test program. Then i wrote a quite simple sample python

Re: Is any limitation of maximum interpreter processes?

Which interpreter is pending ? It is possible that spark interpreter pending due to yarn resource capacity if you run it in yarn client mode If it is pending, you can check the log first. Best Regard, Jeff Zhang From: Belousov Maksim Eduardovich

Re: Implementing run all paragraphs sequentially

Whoa! Seems I walked in to something. Herval, What do you suggest? A simple switch that runs everything in serial, or everything in parallel? That would be a very bad idea. I gave you an example of a class of solutions where you don’t want that behavior. E.g Unit testing where you have one

Re: How to update paragraph text

Not sure if it solves your use-case but updating paragraph text via Zeppelin REST API will soon be available (Pending PR https://github.com/apache/zeppelin/pull/2604) On 2 October 2017 at 15:32, Plamen Paskov wrote: > Hello everyone, > > I need a functionality to

Re: Implementing run all paragraphs sequentially

Yes… You have bunch of unit tests you can run in parallel where you only need one constructor and one cleanup. I would strongly suggest that you really, really think about this long and hard before you start to pound code. Its going to be harder to back out and fix than if you take the time to

Re: Implementing run all paragraphs sequentially

Because that simplicity doesn’t work. You will want to run some things serial and some things in parallel. Which is why you will need a dependency graph. On Oct 2, 2017, at 10:40 AM, Herval Freire > wrote: Why do you need rules and graphs and

RE: Implementing run all paragraphs sequentially

Option (3) does not solve the problem of manageable running order which is really useful in some cases (sequential running of different interpreters and parallel running of same interpreters in one note). Valeriy Polyakov From: Herval Freire [mailto:hfre...@twitter.com] Sent: Monday, October

Re: Implementing run all paragraphs sequentially

Why do you need rules and graphs and any of that to support running everything sequentially or everything in parallel? 3) add a “run mode” to the note. If it’s “sequential”, run the paragraphs one at a time, in the order they’re defined. If parallel, run using current scheme (as many at the

RE: Implementing run all paragraphs sequentially

Let me try to summarize the discussion. Evidently, current behavior of running notes does not meet actual requirements. The most important thing that we need is the ability of sequential running. However, at the same time we want to keep functionality of parallel running. We discussed that the

How to update paragraph text

Hello everyone, I need a functionality to update the paragraph text from spark interpreter. I was searching over the internet and looked at the source code but i didn't find anything. Is it possible to achieve that? If not how i can achieve the following: - connect to kinesis stream - create

Is any limitation of maximum interpreter processes?

Hello, users! Our analysts run notes with such interpreters: markdown, one or two jdbc and pyspark. The interpreters are instantiated Per User in isolated process and Per Note in isolated process. And the analysts complain that sometimes paragraphs aren't processed and stay in status

Run all paragraph above/below the highlighted one

Hello everyone, I looked through the UI and across previous JIRAs but I could not find any mention for this feature so I'll ask here: Does anyone know if there is an efficient way / shortcut in Zeppelin to run all paragraphs above or below a cell? I only know of the 'run all paragraphs' options,