Re: IDE

2016-05-04 Thread Alexander Bezzubov
Hi, right, maven integration in eclipse works, or you can also use old-school way (with some optimization flags to save time) of generating eclipse projects: mvn eclipse:eclipse -Dcheckstyle.skip=true -Drat.skip=true -Denforcer.skip=true -DskipTests -Pr -pl \!zeppelin-web and then just "Import

Re: Zeppelin server hangs due to websocket deadlock bug in Jetty 8

2016-04-11 Thread Alexander Bezzubov
rg.apache.zeppelin.notebook.NoteInterpreterLoader.getInterpreterSettings(NoteInterpreterLoader.java:60) > at > org.apache.zeppelin.notebook.NoteInterpreterLoader.get(NoteInterpreterLoader.java:77) > at org.apache.zeppelin.notebook.Note.runAll(Note.java:409) > - locked <0x0006c34a12c0> (a java.util.Arra

Re: Zeppelin server hangs due to websocket deadlock bug in Jetty 8

2016-04-07 Thread Alexander Bezzubov
Hi, thank you Eric, upgrading Jetty sounds like a great idea! Prasad, I think braodcastAll and synchronization of note<->client_connection is used by default to achieve the ability to collaborate over analysis with multiple people at same Note in realtime - to notify all other clients who have

Re: Unable to start Zeppelin

2016-02-20 Thread Alexander Bezzubov
Hi Ankur, Zeppelin has pluggable Notebook storage implementation , configured i.e though `conf/zeppelin-env.sh` using 'export ZEPPELIN_NOTEBOOK_STORAGE= "org.apache.zeppelin.notebook.repo.VFSNotebookRepo"'

Re: zeppelin multi user mode?

2016-02-14 Thread Alexander Bezzubov
Benjamin, z-manager consists of 2 independant applications - installer and multitenancy. You can use only the second one that Hyung Sung pointed out with any spark/zeppelin version. If you have further questions, please do not hesitate to ask at z-mana...@googlegroups.com

Re: R Interpreter

2016-02-14 Thread Alexander Bezzubov
Hi Ankur, community is working on accepting https://github.com/elbamos/Zeppelin-With-R contribution as a part of Zeppelin codebase before the next release. -- Alex On Tue, Feb 9, 2016, 06:48 DuyHai Doan wrote: > Look at the discussion on the second PR (#702) about this

Re: Incoming conference for Zeppelin

2016-02-14 Thread Alexander Bezzubov
Great stuff, thank you for sharing! On Thu, Feb 11, 2016 at 7:58 AM, DuyHai Doan wrote: > Update done, I have submitted the talk to other conferences too (Devoxx > UK, Devoxx France, GeeCon Poland ...) I'll update and notify as soon as I > receive confirmation that the

[ANNOUNCE] Apache Zeppelin 0.5.6-incubating released

2016-01-24 Thread Alexander Bezzubov
The Apache Zeppelin (incubating) community is pleased to announce the availability of the 0.5.6-incubating release. The community puts significant effort into improving Apache Zeppelin since the last release, focusing on having better API, new backends, improvements on stability and project

2015: year in review

2015-12-30 Thread Alexander Bezzubov
Dear fellow Zeppelin developers and useres, the year 2015 is about to end so I wanted to say thank you to everybody here - its been a great year for the project indeed! Wish you a happy new year and want to share a small review of Zeppelin in 2015 I did

Re: Too many open files exception

2015-12-22 Thread Alexander Bezzubov
Hi, wellcome to the Zeppelin community! It looks like you are doing everything right but have some platform-specific issue, that Spark is hitting the limit of open files on your OS. This should not happen, so could you please check what is the current open file limit on your environment/OS and

Re: Keep track notebooks

2015-12-10 Thread Alexander Bezzubov
Hi, recently a new, Git notebooks storage [1] was introduced that keeps all the notebooks in the single repository under version control. [1] http://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/storage/storage.html#Git Please let me know if that helps! On Tue, Dec 1, 2015 at

Re: Keep track notebooks

2015-12-10 Thread Alexander Bezzubov
ebook.repo.GitNotebookRepo > notebook persistence layer implementation > > > > 2015-12-10 14:48 GMT+01:00 Pablo Torre <pablotorr...@gmail.com>: > >> Thanks Alexander! I will take a look. Appreciate your help! >> >> 2015-12-10 12:52 GMT+01:00 Alexander

Re: Zeppelin notes version control, scheduler and external deps

2015-12-07 Thread Alexander Bezzubov
Hi, sorry for the late reply, answering only your first question: >1. How do we version control Zeppelin notes? Now, as https://github.com/apache/incubator-zeppelin/pull/497 has landed to the master - you can enable versioning of the notebooks using Git. Need to build latest Zeppelin though,

Re: Notebook feature - "Link this paragraph"

2015-12-02 Thread Alexander Bezzubov
Thank you Damien for pointing it out. Indeed, it has been taken care of recently, and should be a part of the next release. Please let me know if that still does not work somehow - would be glad to help. -- Alex On Wed, Dec 2, 2015 at 9:14 AM, Corneau Damien wrote: > Hi,

Re: [ANNOUNCE] Apache Zeppelin 0.5.5-incubating released

2015-11-19 Thread Alexander Bezzubov
Great job, thanks to everybody envolved! Looking forward futher time-based releases of Zeppelin. On Fri, Nov 20, 2015, 09:00 Pablo Torre wrote: > Congrats!! > > Good job guys, as user of Zeppelin I appreciate a lot this effort. > > Best, > > 2015-11-20 0:46 GMT+01:00

Re: Get data from Oracle Database using Apache Zeppelin

2015-11-06 Thread Alexander Bezzubov
Great post, thank you fro sharing Alexander! On Fri, Oct 30, 2015, 19:07 Alexander Kardapolov wrote: > Hi everyone! > > Get data from Oracle Database using Apache Zeppelin #Russia #habrahabr > #apachezeppelin @ZeppelinHub @Jetinfosystems > >

Re: Meet Moon soo Lee

2015-10-31 Thread Alexander Bezzubov
Well done, Moon! And thanks a lot for sharing the video ;) On Sat, Oct 31, 2015 at 6:30 PM, Dongjoon Hyun wrote: > Thank you for sharing. > > Cheers, > Dongjoon. > > On Sat, Oct 31, 2015 at 6:05 PM, tog wrote: > >> Hi there, >> >> In case you

Re: Problem Installing Zeppelin

2015-10-17 Thread Alexander Bezzubov
Hi, this is the maven plugin doing a Grunt build of the frontend webapplication failing somehow. For us to investigate the reason, could you post the OS you are using (`uname -a`, `cat /etc/issue`), as well as results of running the same mvn command but with `-e` switch please? Another thing to

Re: Help with loading a CSV using Spark-SQL & Spark-CSV

2015-09-28 Thread Alexander Bezzubov
Hi, thank you for your interested in Zeppelin! Couple of things I noticed: as you probably already know , %dep and %spark parts should always be in separate paragraphs. %spark already exposes sql context though `sqlc` variable, so you better use sqlc.load("...") instead. And of course to be

Re: Zeppelin server can get very slow when logs/ folder is too big

2015-09-27 Thread Alexander Bezzubov
Hi, thank you for bringing it to our attention! What was the rough size of the logs when it started to give you troubles? Indeed muting or explicitly configuring log verbosity makes a lot of sense. May be you could also create an issue in jira to track the progress? Thank you! -- BR, Alex On

Re: Build Zeppelin for Spark 1.5 on OSX

2015-09-17 Thread Alexander Bezzubov
Hi, thank you for interest in Zeppelin! It looks like frontend webapp build failed on executing the grunt task (a build system we use in web app). Can you try running it manually (instead of using maven) ``` cd zepelin-web ./grunt ``` and let me know if that works? It suppose to print smth

Re: spark worker log stderr

2015-09-13 Thread Alexander Bezzubov
Hi, I think at this point it might be worth creating an issue to track this and bring it to attention dev@ Thanks! On Wed, Sep 2, 2015 at 12:14 PM, zhao selery wrote: > I run scala code from zeppelin notebook, when I look at spark log from >

Re: sql interpreter not found

2015-09-04 Thread Alexander Bezzubov
Hi, that is a bit wired, as there is no separate sql interpreter (it is spark one) - you check the interpreter bindings using wrench icon on the right and make sure spark-local is activated and is the first (default) one. Can you also send spark interpret logs, they should be in a separate file,

Re: zeppelin tar file size

2015-09-02 Thread Alexander Bezzubov
Hi, thank you for you interest in Zeppelin project! Yes, by default a build that you did includes a lot of different interpreters like Spark, Flink, Lens, etc so that is why the size is quite substantial. In case you are about to use existing Spark\Hadoop - as of

Re: Anybody has Zeppelin working against AWS EMR 4.0?

2015-07-28 Thread Alexander Bezzubov
HI Francis, thank you for your interest in using Zeppelin with AWS EMR, and please keep sharing it. The reason you have disconnected state is that before https://github.com/apache/incubator-zeppelin/pull/170 as it is mentioned here https://github.com/apache/incubator-zeppelin#run Zeppelin

Re: how to configure yarn client mode with Zeppelin

2015-07-28 Thread Alexander Bezzubov
Indeed! I think there also should be something like `export HADOOP_CONF_DIR=$HADOOP_CONF_DIR` pointing to YARN-configured hadoop setup, to pick a ResourceManager address. Hope this helps! -- BR, Alexander. On Wed, Jul 29, 2015 at 10:48 AM, Jongyoul Lee jongy...@gmail.com wrote: Hi, 1.

Re: reload spark context

2015-07-28 Thread Alexander Bezzubov
Hi, I'm not sure if that exactly 'reload spark context' is, but if you go to 'Interpreters' and hit 'restart' button for the spark interpreter that will restart Spark and create a new context. Other 2 question look like a Spar-specific behaviour, so It might be better to ask Spark community

Re: Using Trello to Show Mid to High Level features in Apache Zeppelin

2015-07-23 Thread Alexander Bezzubov
Guys, thank you for great suggestions! Am I right that you suggest using Trello not instead of ASF hosted JIRA, but together with it, and are volunteering to support it as a tool for prioritizing user's feedback? Also, how do you think, should we then move further discussion to the

Re: Spark memory configuration

2015-07-23 Thread Alexander Bezzubov
Hi, thank you for your interest in Zeppelin! You just have to set the 'Spark' interpreter properties in 'Interpreters' menu: CPU spark.cores.max: 24 Mem spark.executor.memory 22g You actually can use any of the http://spark.apache.org/docs/latest/configuration.html#application-properties

Re: a small question about zeppelin-manager

2015-07-22 Thread Alexander Bezzubov
-Dspark.version=1.3.0 -Dhadoop.version=2.0.0-cdh4.5.0 (did zeppelin support cdh4.5.0) Should i have to do the custom built spark like(-Dspark.version=1.1.0-Custom) 4.modify my master spark://...:7077 Is it completed? or i lost something please tell me. thanks jzy 在 2015年7月21日,下午5:48,Alexander

Re: a small question about zeppelin-manager

2015-07-21 Thread Alexander Bezzubov
Hi, thank you for your interest in the project! It seems like the best way to get Zeppelin up and running in your case would be to build it manually with relevant Spark\Hadoop options as described here http://zeppelin.incubator.apache.org/docs/install/install.html Please, let me know if that

Re: Does zeppelin work on windows?

2015-07-16 Thread Alexander Bezzubov
Hi Puneet, thank you for your interest in Zeppelin. Right now we officially do not support windows platform, but there are at least two ways to get Zeppelin running there: - build using cygwin - or follow this procedure described by one of the community members

Re: google charts for zeppelin

2015-07-15 Thread Alexander Bezzubov
Hi Axel, I think the repo you are pointing out is outdated and is not useful for the current Apache Zeppelin (incubating) codebase. That being said, there is an engineer here on the list, Madhuka (in CC) who is working on adding more charts to Zeppelin i.e

Re: Provide binaries

2015-07-09 Thread Alexander Bezzubov
Hi, thank you for asking! We definitely looking into providing a convenience binaries for the release, as soon as it is out. Stay tuned! On Fri, Jul 10, 2015 at 7:30 AM, Illu Ying illuying2...@gmail.com wrote: +1 On Thu, Jul 9, 2015 at 3:28 PM, Abhi Basu 9000r...@gmail.com wrote: Can you

Re: Not able to see registered table records and Pyspark not working

2015-07-09 Thread Alexander Bezzubov
Hi, please mind that flag -Pyspark will download full spark binary distribution, so it might take a while for the first time you do it. That was the main reason behind hiding it under the separate profile. On Thu, Jul 9, 2015 at 11:53 PM, moon soo Lee m...@apache.org wrote: You can still

Re: Zeppelin Interpreter end

2015-06-30 Thread Alexander Bezzubov
Hi, right now, I'm not aware of such configuration in Zeppelin (please, feel free to open the issue\submit a patch). AFAIK dynamic YARN resource allocation is up to the user and is not configured by default right now, which looks like one possible solution to the problem you describe (at least

Re: Zeppelin in multi user environment

2015-06-29 Thread Alexander Bezzubov
Hi, thank you for asking, indeed, as Moon mentioned, we are working on making a standalone tool available that is a reverse proxy, capable of launching separate docker container per-user for the chosen spark\hadoop version, implementing the A. architecture from above. -- Alex On Mon, Jun 29,

Re: Importing HBase data to Zeppelin notebook

2015-06-11 Thread Alexander Bezzubov
Hey Ignacia, this error message my be a bit cryptic indeed, but what this means is that this paragraph should be run first, after the interpreter start. Easiest way to do that - go to Interpreters menu on top and there manually restart particular interpreter the you are using at that notebook.

Re: Question

2015-06-04 Thread Alexander Bezzubov
Indeed, also the focus of Zeppelin is mostly cluster computing system backends. But answering your question about unique features - collaborative analysis is the one from the top of my head: try opening multiple tabs of single Zeppelin instance and start making changes (adding new paragraphs and

Re: Zeppelin on remote machine

2015-06-02 Thread Alexander Bezzubov
Hi Harsh, can you please post the spark interpreter (I assume that's what you are using) logs here too? You can find them under ./log/zeppelin-interpreter-spark-*.log It looks like it ZeppelinServer has troubles communicating to the Interpreter process somehow. -- Best regards, Alexander

Re: Using Zeppelin with EC2 spark cluster

2015-05-25 Thread Alexander Bezzubov
Hi Jihun, thanks for your interest in Zeppelin! It looks like zeppelin server having troubles connecting to spark interpreter process. Could you please post logs/zeppelin-* server and interpreter logs? Thanks. On Mon, May 25, 2015 at 2:23 PM, Jihun choi jihun.c...@kongstudios.net wrote: Hi,

Re: Zeppelin packaging for Spark 1.3 gives errors

2015-05-25 Thread Alexander Bezzubov
Hi Roopa, which command did you use to build Zeppelin? Please try 'mvn package ' instead and let us know if that works. On Tue, May 26, 2015 at 8:45 AM, Corneau Damien cornead...@gmail.com wrote: Hi, Tests tends to fail when people compile zeppelin (works fine on CI). Can you try

Re: adding custom jars to zeppelin

2015-05-06 Thread Alexander Bezzubov
Hi Roopa, thanks for your interest! This is definitely possible and the simplest way would be to use a dependency loading mechanism that is embedded in Zeppelin using %dep in the first paragraph as described here http://zeppelin.incubator.apache.org/docs/interpreter/spark.html#dependencyloading

Re: Problems with web proxy

2015-02-25 Thread Alexander Bezzubov
Hi Frank, mvn build in zeppelin-web calls 'npm install' 'grunt build' underneath, could you try doing those manually (with 'rm -rf node_modules') and posting npm-debug.log\output in case it is still failing? Just to clarify your setup: you need to build Zeppelin on a machine with internet

Re: Problems with web proxy

2015-02-25 Thread Alexander Bezzubov
: After running ‘sudo npm install’ and ‘grunt build’ I got the following warning/error message: Running wiredep:app (wiredep) task Warning: Error: Cannot find where you keep your Bower packages. Use --force to continue. Aborted due to warnings. From: Alexander Bezzubov b