Re: HBase Interpreter

[Benjamin Kim]

Any updates regarding this?

> On Feb 23, 2016, at 8:43 PM, Felix Cheung  wrote:
> 
> Hi Ben
> 
> 
> Not yet - I made the change but unfortunately it's not working. Have not had 
> the chance to debug through the HBase ruby code yet. I should have some time 
> next week.
> 
> 
> _
> From: Benjamin Kim mailto:bbuil...@gmail.com>>
> Sent: Tuesday, February 23, 2016 6:19 PM
> Subject: Re: HBase Interpreter
> To:  >
> 
> 
> Hi Felix,
> 
> Any updates? Does the latest merged master have the hbase quorum properties?
> 
> Thanks,
> Ben
> 
> 
> On Feb 12, 2016, at 1:29 AM, Felix Cheung < felixcheun...@hotmail.com 
> > wrote:
> 
> Cool, I think I have figured out how to set properties too. I might open a PR 
> tomorrow or later. 
> 
> 
> 
> 
> 
> On Thu, Feb 11, 2016 at 9:24 PM -0800, "Rajat Venkatesh" 
> mailto:rvenkat...@qubole.com>> wrote: 
> 
> Hi,
> I'll take a look over the weekend. Sorry for the delay in replying. 
> 
> On Wed, Feb 10, 2016 at 6:44 AM Felix Cheung < felixcheun...@hotmail.com 
> > wrote: 
> It looks like hbase-site.xml is not picked up somehow.
> 
> Rajat would you know of a way to get that set with the ruby code? 
> 
> 
> _ 
> From: Benjamin Kim < bbuil...@gmail.com > 
> Sent: Tuesday, February 9, 2016 2:58 PM
> 
> Subject: Re: HBase Interpreter 
> To: < users@zeppelin.incubator.apache.org 
> > 
> 
> 
> It looks like it’s not reaching the zookeeper quorum.
> 
> 16/02/09 21:52:19 ERROR client.ConnectionManager$HConnectionImplementation: 
> Can't get connection to ZooKeeper: KeeperErrorCode = ConnectionLoss for /hbase
> 
> And the setting is:
> 
> quorum=localhost:2181
> 
> The HBase quorum is actually namenode001, namenode002, hbase-master001. Where 
> do I set this?
> 
> Thanks,
> Ben
> 
> 
> On Feb 4, 2016, at 9:15 PM, Felix Cheung < felixcheun...@hotmail.com 
> > wrote:
> 
> We could probably look into HBase/Pom.xml handling the vendor-repo profile 
> too.
> 
> 
> 
> 
> 
> On Thu, Feb 4, 2016 at 8:08 PM -0800, "Rajat Venkatesh" 
> mailto:rvenkat...@qubole.com>> wrote: 
> 
> Benjamin,
> Can you try compiling Zeppelin by changing the dependencies in hbase/pom.xml 
> to use cloudera jars ? 
> In the long run, one option is to
> 1. run & capture o/p of 'bin/hbase classpath'
> 2. create a classloader
> 3. load all the classes from 1
> 
> Then it will work with any version of HBase theoritically.
>  
> 
> On Fri, Feb 5, 2016 at 8:14 AM Benjamin Kim < bbuil...@gmail.com 
> > wrote: 
> Felix,
> 
> I know that Cloudera practice. We hate that they do that without informing 
> anyone.
> 
> Thanks,
> Ben
> 
> 
> 
> On Feb 4, 2016, at 9:18 AM, Felix Cheung < felixcheun...@hotmail.com 
> > wrote:
> 
> CDH is known to cherry pick patches from later releases. Maybe it is because 
> of that.
> 
> Rajat do you have any lead on the release compatibility issue?
> 
> 
> _ 
> From: Rajat Venkatesh < rvenkat...@qubole.com > 
> Sent: Wednesday, February 3, 2016 10:05 PM 
> Subject: Re: HBase Interpreter 
> To: < users@zeppelin.incubator.apache.org 
> > 
> 
> 
> Oh. That should work. I've tested with 1.0.0. Hmm
> 
> On Thu, Feb 4, 2016 at 10:50 AM Benjamin Kim < bbuil...@gmail.com 
> > wrote: 
> Hi Rajat,
> 
> The version of HBase that comes with CDH 5.4.8 is 1.0.0. How do I check if 
> they are compatible?
> 
> Thanks,
> Ben
> 
> 
> On Feb 3, 2016, at 9:16 PM, Rajat Venkatesh < rvenkat...@qubole.com 
> > wrote:
> 
> Can you check the version of HBase ? HBase interpreter has been tested with 
> HBase 1.0.x and Hadoop 2.6.0. There is a good chance this error is due to 
> mismatch in versions. 
> 
> On Thu, Feb 4, 2016 at 10:20 AM Benjamin Kim < bbuil...@gmail.com 
> > wrote: 
> I got this error below trying out the new HBase Interpreter after pulling and 
> compiling the latest. 
> 
> org.jruby.exceptions.RaiseException: (NameError) cannot load Java class 
> org.apache.hadoop.hbase.quotas.ThrottleType 
> at 
> org.jruby.javasupport.JavaUtilities.get_proxy_or_package_under_package(org/jruby/javasupport/JavaUtilities.java:54)
>  
> at (Anonymous).method_missing(/builtin/javasupport/java.rb:51) 
> at 
> (Anonymous).(root)(/opt/cloudera/parcels/CDH/lib/hbase/lib/ruby/hbase/quotas.rb:23)
>  
> at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:1062) 
> at 
> (Anonymous).(root)(/opt/cloudera/parcels/CDH/lib/hbase/lib/ruby/hbase/quotas.rb:24)
>  
> at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:1062) 
> at 
> (Anonymous).(root)(/opt/cloude

Re: Data Export

[Benjamin Kim]

Any updates as to the progress of this issue?

> On Feb 26, 2016, at 6:16 PM, Khalid Huseynov  wrote:
> 
> As far as I know there're few PRs (#6 
> , #725 
> , #89 
> , #714 
> ) addressing similar 
> issue with some variation in approaches. They're being compared and probably 
> some resolution should be reached. You can also take a look and express your 
> opinion. Community may let us know if I'm missing something.
> 
> Best,
> Khalid
> 
> On Sat, Feb 27, 2016 at 2:23 AM, Benjamin Kim  > wrote:
> I don’t know if I’m missing something, but is there a way to export the 
> result data into a CSV, Excel, etc. from a SQL statement?
> 
> Thanks,
> Ben
> 
> 

Shiro authentication dialog does not appear

[Peter Briggs]

Hi,

I am having trouble getting the Shiro user authentication to work for Zeppelin 
- the issue is that when I open the Zeppelin home page in browser, the login 
dialog does not appear as expected. I’ve tested in Chrome and Safari, which the 
same results.

I downloaded the latest 0.6.0-incubating-SNAPSHOT, and followed the config 
instructions here: 
https://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/manual/shiroauthentication.html
 

 

The config setting that disables anonymous access seems to work ok though, as I 
can’t access any notebooks on the site when I apply those settings. The DEBUG 
logs seem to confirm that the shiro.ini file has been found and used for 
configuration. And the logs also show that my requests to the site are 
considered anonymous, which is to be expected given I haven’t logged in yet.

Anyone have any ideas where I might be going wrong?

Thanks,
Peter

Re: DataFrames DISK_ONLY persistence leads to OOME

[Andy Dang]

I've seen this before with JavaRDD. Some of our jobs perform much worse
when we persist them in any form!

---
Regards,
Andy

On Tue, Mar 15, 2016 at 2:22 PM, Jakub Liska  wrote:

> Hey,
>
> I submitted this issue to Spark
> https://issues.apache.org/jira/browse/SPARK-13909
>
> But I think it is rather a Zeppelin issue because it came with upgrade to
> current Zeppelin master version. It seems to be happening even on Spark
> 1.5.x ...
>
> Any idea what might be wrong? Simply any kind of DISK_ONLY leads to OOME
> ... I have a really simple single-node setup.
>

DataFrames DISK_ONLY persistence leads to OOME

[Jakub Liska]

Hey,

I submitted this issue to Spark
https://issues.apache.org/jira/browse/SPARK-13909

But I think it is rather a Zeppelin issue because it came with upgrade to
current Zeppelin master version. It seems to be happening even on Spark
1.5.x ...

Any idea what might be wrong? Simply any kind of DISK_ONLY leads to OOME
... I have a really simple single-node setup.

Empy Notebook file prevents Zeppelin from starting

[Boris Schminke]

Hi,
if one replaces any of note.json files in Zeppelin Notebooks directory with
an empty one then Zeppelin server fails to start with very weird error.
Probably it should start and report that some notebook is corrupted. The
error is generated any time when note.json is not a valid JSON. I had one
of my notebooks corrupted after sudden power loss and then lost several
hours trying to understand why the Zeppelin daemon stopped working:(

javax.servlet.ServletException: Resource class
org.apache.zeppelin.server.ZeppelinServer can not be instantiated due to
InvocationTargetException at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:396)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
at
org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:532)
at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:344)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791)
at
org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)
at
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.eclipse.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.java:229)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:172)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.eclipse.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:95)
at org.eclipse.jetty.server.Server.doStart(Server.java:282) at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:116)
WARN [2016-03-15 15:04:08,196] ({main}
AbstractLifeCycle.java[setFailed]:204) - FAILED rest:
javax.servlet.ServletException: Resource class
org.apache.zeppelin.server.ZeppelinServer can not be instantiated due to
InvocationTargetException javax.servlet.ServletException: Resource class
org.apache.zeppelin.server.ZeppelinServer can not be instantiated due to
InvocationTargetException at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:396)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.init(CXFNonSpringJaxrsServlet.java:93)
at
org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:532)
at org.eclipse.jetty.servlet.ServletHolder.doStart(ServletHolder.java:344)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791)
at
org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:265)
at
org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:717)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.eclipse.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.java:229)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:172)
at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at
org.eclipse.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:95)
at org.eclipse.jetty.server.Server.doStart(Server.java:282) at
org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServer.java:116)
WARN [2016-03-15 15:04:08,196] ({main}
AbstractLifeCycle.java[setFailed]:204) - FAILED
o.e.j.s.ServletContextHandler{/,null}: javax.servlet.ServletException:
Resource class org.apache.zeppelin.server.ZeppelinServer can not be
instantiated due to InvocationTargetException
javax.servlet.ServletException: Resource class
org.apache.zeppelin.server.ZeppelinServer can not be instantiated due to
InvocationTargetException at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createSingletonInstance(CXFNonSpringJaxrsServlet.java:396)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createApplicationInstance(CXFNonSpringJaxrsServlet.java:454)
at
org.apache.cxf.jaxrs.servlet.CXFNonSpringJaxrsServlet.createServerFromApplication(CXFNonSpringJaxrsServlet.java:432)
at
org.