Re: Importaing Hbase data

2016-03-25 Thread Silvio Fiorito
There’s also this, which seems more current: https://github.com/apache/hbase/tree/master/hbase-spark I haven’t used it, but I know Ted Malaska and others from Cloudera have worked heavily on it. From: Felix Cheung > Reply-To:

RE: Spark interpreter idle timeout

2016-03-04 Thread Silvio Fiorito
12:55 PM To: Silvio Fiorito<mailto:silvio.fior...@granturing.com>; users@zeppelin.incubator.apache.org<mailto:users@zeppelin.incubator.apache.org> Subject: Re: Spark interpreter idle timeout Thank you Silvio. I have not actually tried dynamic allocation (it's not trivial to use an

Re: Spark interpreter idle timeout

2016-03-04 Thread Silvio Fiorito
If you’re using Mesos as your Spark cluster manager, then you can use dynamic resource allocation. So as your users are running notebooks the Spark executors will scale up and down as needed, per the thresholds you define. And when the user is idle, Spark will automatically release resources.

Re: Building and running on Mac OS 11.11

2016-03-03 Thread Silvio Fiorito
wing articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn -rf :zeppelin-web Joses-Mac-Pro:incubator-zeppelin-master JCelaya$ On Mar 3, 2

Re: Building and running on Mac OS 11.11

2016-03-03 Thread Silvio Fiorito
Can you give us an idea on the errors you getting? I build regularly on both Mac and Windows without a problem but your troubles could be due to a number of factors. Also, you should not need sudo for building unless there are some incorrect file permissions. From: Jose Celaya

RE: problem with start H2OContent

2016-03-02 Thread Silvio Fiorito
bstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at org.apache.thrift.transport.TSocket.open(TSocket.java:182) ... 20 more" On Mon, Feb 29, 2016 at 7:35 PM, Silvio Fiorito <silvio.fior..

RE: problem with start H2OContent

2016-02-29 Thread Silvio Fiorito
t(Socket.java:579) at org.apache.thrift.transport.TSocket.open(TSocket.java:182) ... 19 more" On Mon, Feb 29, 2016 at 7:07 PM, Silvio Fiorito <silvio.fior...@granturing.com<mailto:silvio.fior...@granturing.com>> wrote: In your zeppelin-env you set SPARK_HOME and SPARK_SUBMIT_OPTI

RE: problem with start H2OContent

2016-02-29 Thread Silvio Fiorito
or.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) On Mon, Feb 29, 2016 at 5:43 PM, Silvio Fiorito <silvio.fior...@granturing.com<mailto:silvio.fior...@granturing.com>> wrote: It doesn’t seem to be loading transitive dependencies prope

Re: problem with start H2OContent

2016-02-29 Thread Silvio Fiorito
It doesn’t seem to be loading transitive dependencies properly. When I was helping someone else set this up recently, I had to use SPARK_SUBMIT_OPTIONS=“--packages ai.h2o:sparkling-water-core_2.10:1.5.10” with an external Spark installation (vs using bundled Spark in Zeppelin). From: Aleksandr

Re: Sparkling Water (H2O) Interpeter

2016-02-25 Thread Silvio Fiorito
Hi, We actually just had a talk at our DC Spark Meetup from H2O last night. Since Sparkling Water is available as a Spark Package, you could very quickly define a new interpreter that includes the necessary package, as described in the JIRA comments. That way you don’t need to wait for a new

RE: Unable to start Zeppelin

2016-02-20 Thread Silvio Fiorito
Hi Ankur, Glad you were able to get up and running with my patch. You should set the ZEPPELIN_NOTEBOOK_DIR value in zeppelin-env.cmd rather than zeppelin.cmd though. That way you can keep your settings across releases without worrying about them getting overwritten. I’ve been working on a few

RE: Does zeppelin work on windows?

2016-02-20 Thread Silvio Fiorito
(though, I'm not sure other people still use it) Best, moon On Thu, Feb 11, 2016 at 5:23 AM Silvio Fiorito <silvio.fior...@granturing.com<mailto:silvio.fior...@granturing.com>> wrote: I actually have some Windows batch files that I plan on submitting as a PR soon. I've tested them so f

Re: Cannot get Zeppelin to work

2016-02-17 Thread Silvio Fiorito
Hi, If you want Windows scripts to run Zeppelin please take a look at this branch on my fork. I have a couple more things to do before I’m ready to submit as a PR, but these scripts have been tested on my Windows 10 machine as well Azure App Service.

Anyone at Spark Summit East this week?

2016-02-14 Thread Silvio Fiorito
Hello fellow Zeppelin users, Just wondering if anyone will be at Spark Summit east this week in New York? If so, would love to meet and talk about Zeppelin, Spark, etc. If you’re especially interested in Windows or Azure I'd be happy to talk and demo what I’ve been working on that will

Re: Does zeppelin work on windows?

2016-02-11 Thread Silvio Fiorito
I actually have some Windows batch files that I plan on submitting as a PR soon. I’ve tested them so far on Win10 and an Azure Web App. If anyone would like to help testing on more environments please let me know. On 2/11/16, 6:26 AM, "Kamalkanta" wrote: >Hi puneet, >

Re: Real time chart in Zeppelin?

2015-11-11 Thread Silvio Fiorito
Hi Roger, Here’s an example I made using Angular and Leaflet updating based on a Spark Streaming app https://gist.github.com/granturing/a09aed4a302a7367be92 Same concept could be used for any other client side JavaScript (d3, etc.) Thanks, Silvio From: Roger Hui

Need official release packages

2015-10-21 Thread Silvio Fiorito
For the Zeppelin maintainers, Just a heads up that I think the lack of official binary releases on the Zeppelin website and GitHub gives the wrong impression. I personally always build from source and package my own distribution, but for visibility and newbies it would be best to have regular

Re: Need official release packages

2015-10-21 Thread Silvio Fiorito
route than trying to get around our security precautions (and safer ☺). Anyhow, just my two cents. Thanks, -Steven From: Silvio Fiorito [mailto:silvio.fior...@granturing.com<mailto:silvio.fior...@granturing.com>] Sent: Wednesday, October 21, 2015 11:44 AM To: users@zeppelin.incubator.apa

Re: Reactive Angular charts sample

2015-10-15 Thread Silvio Fiorito
ar charts sample Silvio, thanks for the examples. I'm a bit [totally] new when it comes to working with angular. I'm running your map example and I get the map to display just fine, but how would I add markers to the map from a separate paragraph? Thanks, Chad On Tue, Oct 6, 2015 at 10:48

Re: Reactive Angular charts sample

2015-10-06 Thread Silvio Fiorito
Hey everyone, Great I’m glad this was helpful! It definitely opens up a lot of possibilities to extend the power of Zeppelin UI. I’m also working on a few things to make Streaming a bit nicer, like a button to start/stop the streaming context and displaying realtime stats of the streaming job

DC Spark meetup talk

2015-09-15 Thread Silvio Fiorito
Hey everyone, Just wanted to point out that if you’re in the Washington DC area I’ll be giving a talk on exploratory analysis using Spark SQL and Zeppelin, next week. http://www.meetup.com/Washington-DC-Area-Spark-Interactive/events/224998133/ There are still a few spots open so if you’re

RE: File name too long error in Spark paragraphs

2015-08-23 Thread Silvio Fiorito
I've seen this recently as well. Seems to be an issue with the Scala REPL after running and rerunning notebooks with a lot of code. Only solution I found was too restart the interpreter. Even Databricks cloud seems to have this issue:

Re: Executing spark code in Zeppelin

2015-07-29 Thread Silvio Fiorito
Hi Stefan, Looks like this question was just covered here http://mail-archives.apache.org/mod_mbox/incubator-zeppelin-users/201507.mbox/browser Thanks, Silvio From: Stefan Panayotov Reply-To: users@zeppelin.incubator.apache.orgmailto:users@zeppelin.incubator.apache.org Date: Wednesday, July

RE: Zeppelin showing disconnected after successful build and daemon start

2015-05-08 Thread Silvio Fiorito
Did you publish both port 8080 and 8081? From: Jose Rivera-Rubiomailto:jose.riv...@internavenue.com Sent: ‎5/‎8/‎2015 6:16 AM To: users@zeppelin.incubator.apache.orgmailto:users@zeppelin.incubator.apache.org Subject: Zeppelin showing disconnected after successful

Re: Multi-user approach

2015-03-27 Thread Silvio Fiorito
I haven’t tried this myself yet but something I’ve been thinking as well. Will the nginx reverse proxy support web sockets as well? Ideally we’d have isolated SparkContexts so users aren’t trampling over each other. Honestly I think it’d be good to have the option of starting a new