Re: why zeppelin SparkInterpreter use FIFOScheduler

2015-08-16 Thread IT CTO
+1 for "to re-factor the Zeppelin architecture so that it can handle multi-tenancy easily" On Sun, Aug 16, 2015 at 9:47 AM DuyHai Doan wrote: > Agree with Joel, we may think to re-factor the Zeppelin architecture so > that it can handle multi-tenancy easily. The technical solution proposed by >

Re: WELCOME to users@zeppelin.incubator.apache.org

2015-08-16 Thread moon soo Lee
I'm not familiar with ifttt, is there any API to access the service? Thanks, moon On Fri, Aug 14, 2015 at 10:47 PM Jun Chen wrote: > Is there any method to let zeppelin talk with ifttt? so the notebook can > display or send feedback to any other apps, just like a repl or cowork > notebook > @mo

Re: how to link server graphs in one page ?

2015-08-16 Thread moon soo Lee
Hi, It would helpful If you explain little bit more about what you're trying to do. Thanks, moon On Thu, Aug 13, 2015 at 6:12 AM Aaron Li wrote: > thanks >

Re: https

2015-08-16 Thread moon soo Lee
This link might help to configure https. https://github.com/NFLabs/zeppelin/pull/243 Best, moon On Sat, Aug 15, 2015 at 12:43 AM Markovitz, Dudu wrote: > Thanks Anthony, I’ve forward your answer to the Hadoop system group. > > > > Dudu > > > > *From:* Anthony Corbacho [mailto:anthonycorba...@ap

Re: Zeppelin job hang there

2015-08-16 Thread moon soo Lee
Hi, Can not see anything wrong in your logs. Do you have any non-default configuration for Spark interpreter? Or do you have hive-site.xml in you classpath? Thanks, moon On Mon, Aug 10, 2015 at 5:16 AM Jeff Zhang wrote: > > I have 2 paragraph, one is spark job the other is spark sql. > The fi

Re: WELCOME to users@zeppelin.incubator.apache.org

2015-08-16 Thread Jun Chen
I'm also new in it(I just remember slack provide web in and out hook), but I feel it powerful (you can check slack.com zapier.com ifttt.com, etc) my idea is that: zeppelin + slack/twitter/other msg system if in any message of slack (or tweets of twitter ) have a symbol : %%scala, %%python etc, t

Re: why zeppelin SparkInterpreter use FIFOScheduler

2015-08-16 Thread moon soo Lee
Pranav, proposal looks awesome! I have a question and feedback, You said you tested 1,2 and 3. To create SparkIMain per notebook, you need information of notebook id. Did you get it from InterpreterContext? Then how did you handle destroying of SparkIMain (when notebook is deleting)? As far as i

Rest endpoints provided by Zeppelin

2015-08-16 Thread Udit Mehta
Hi, I was trying to figure if its possible to update the zeppelin interpreter settings using a REST endpoint. Is this possible and is there any documentation around it? Thanks in advance, Udit

static asset folder?

2015-08-16 Thread Randy Gelhausen
Does Zeppelin Server have the capability to serve static files from a directory? For instance, if I want a Notebook to import HTML and JS files which are not hosted anywhere externally, is there a way to have Zeppelin itself host those without recompiling and building the static assets into the JA

Re: WELCOME to users@zeppelin.incubator.apache.org

2015-08-16 Thread moon soo Lee
I think https://issues.apache.org/jira/browse/ZEPPELIN-137 (Let external schedulers run notebook) addresses similar problem. Connecting to services like slack.com zapier.com ifttt.com is i think beyond ZEPPELIN-137 and sounds interesting. Thanks for sharing your idea. Best, moon On Sun, Aug 16

Re: static asset folder?

2015-08-16 Thread moon soo Lee
Hi Randy, The answer is no. However, depending on how you build and run Zeppelin, there is on trick. If you build and run Zeppelin directly from source, Zeppelin serves it's web resources from zeppelin-web/dist directory rather than packaged war file. Here's one example that uses this trick. Thi

Able to submit same job multiple times

2015-08-16 Thread Rajat Gupta
If I press shift+enter multiple times then I am able to submit multiple instances of same para to run. Is this intentional? If not I can file a jira and raise a PR for this

Re: Able to submit same job multiple times

2015-08-16 Thread moon soo Lee
Hi, Thanks for sharing a problem. It is not intentional. Please file a jira issue. Thanks, moon On Sun, Aug 16, 2015 at 10:18 PM Rajat Gupta wrote: > If I press shift+enter multiple times then I am able to submit multiple > instances of same para to run. Is this intentional? > > If not I can f

Re: static asset folder?

2015-08-16 Thread Corneau Damien
Hi, To bypass the zeppelin-web ressources restriction, you could also open and read file from scala, and printing its content using println("%html " + fileContent) On Mon, Aug 17, 2015 at 1:41 PM, moon soo Lee wrote: > Hi Randy, > > The answer is no. > > However, depending on how you build and

Re: Rest endpoints provided by Zeppelin

2015-08-16 Thread IT CTO
Thanks for the good question (god questions are one that makes us build a better product :-)) The short answer is yes. BUT no documentation for it right now. if you go to your browser to your zeppelin IP (replace localhost:8080 with your server IP and port)

Re: Rest endpoints provided by Zeppelin

2015-08-16 Thread moon soo Lee
Hi Udit, In addition to Eran's answer, https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-server/src/main/java/org/apache/zeppelin/rest/InterpreterRestApi.java is implementation of REST endpoint for interpreter setting. The code might help until we get some documentation. Thanks, m

Re: why zeppelin SparkInterpreter use FIFOScheduler

2015-08-16 Thread Pranav Kumar Agarwal
Hi Moon, Yes, the notebookid comes from InterpreterContext. At the moment destroying SparkIMain on deletion of notebook is not handled. I think SparkIMain is a lightweight object, do you see a concern having these objects in a map? One possible option could be to destroy notebook related obje