Re: spark.jars option for Zeppelin over Livy

packages" on Livy interpreter properties. Please see the attached screenshot On Tue, Aug 2, 2016 at 1:43 PM, Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> wrote: Have you tried setting it in the Interpreter menu under Livy? On Tue, Aug 2, 2

Re: Passing command line params when cell is evaluated?

This should be captured in a log file under /logs of Zeppelin binaries. This specific warning, in believe, might be coming from the way Zeppelin is calling spark-submit? On Wed, Jul 6, 2016 at 5:24 PM -0700, "Shayne Hodge" > wrote: When I

Re: Another instance of Derby already booted the database .../metastore_db

The issue is since you are running Spark interpreter in isolated mode there are two running Spark driver process trying to access derby metastore at the same location, at the same time. There are some config in Spark that could redirect metastore to different location (try spark.warehouse.dir)

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC1)

Thanks. I'd incline to agree having latest matplotlib broken with python (python interpreter) seems like a big inconvenience. Is there a workaround? Let's discuss a bit in the JIRA and bring this back to the vote thread. Also we should really try to mark JIRA too to be included in RC builds,

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC2)

I'm seeing the same behavior with the marital status drop down box on the intro notebook on netinst build. I think this could be a bigger problem. _ From: Khalid Huseynov > Sent: Sunday, January 22, 2017 8:08 PM Subject:

Re: Hbase configuration storage without data

I like that approach - though you should be able to clear result output before exporting the note, if all you want is the config? The should remove all output data, keeping it smaller? _ From: Mohit Jaggi > Sent:

Re: Matplotlib uses tkinter instead of Agg

And matplotlib.use('Agg') Would only work before matplotlib is first used so you would need to restart the interpreter. From error stack below it looks like something might be setting the default backend in matplotlib to TkAgg though. Are you using the Python interpreter or PySpark

Re: Binary for CDH 5.8.0

We don't have Hadoop distribution specific binary releases - compiling from source with switches would be the best route. On Mon, Sep 19, 2016 at 12:22 PM -0700, "Abhi Basu" <9000r...@gmail.com> wrote: Is there a specific binary for CDH 5.8.0, hadoop 2.6. and

Re: Zepelin problem in HA HDFS

Quite possibly since Spark is talking to HDFS. Does it work in your environment when HA switch over with a long running spark shell session? From: Ruslan Dautkhanov Sent: Sunday, November 20, 2016 5:27:54 PM To: users@zeppelin.apache.org

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

Hmm, SPARK_HOME is set it should pick up the right Spark. Does this work with the Scala Spark interpreter instead of pyspark? If it doesn't, is there more info in the log? From: Ruslan Dautkhanov Sent: Monday, November 21, 2016 1:52:36 PM

Re: Is it possible to run Java code on Zeppelin Notebook?

I think you will need to convert Java code into Scala syntax? But Scala can call into Java libraries and so on. I don't think we have an interpreter for Java since it does not come with a REPL until Java 9? From: Abhisar Mohapatra

Re: Unable to connect with Spark Interpreter

Hmm possibly with the classpath. These might be Windows specific issues. We probably need to debug to fix these. From: Jan Botorek Sent: Tuesday, November 29, 2016 4:01:43 AM To: users@zeppelin.apache.org Subject: RE: Unable to connect

Re: Mailing List

There was a few email yesterday - do you not get them? From: Meeraj Kunnumpurath Sent: Tuesday, January 10, 2017 9:09:52 AM To: users@zeppelin.apache.org Subject: Mailing List Hello Is this mailing list active? I see hardly any

Re: Mailing List

lix. I saw a couple on the interpreter REST API, that was it. Sent from my iPhone On Jan 10, 2017, at 10:06 PM, Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> wrote: There was a few email yesterday - do you not get them? ___

Re: py4j doesn't work with python interpreter

You said you ran sudo pip install pyplot I think you need to pip install py4j instead? _ From: Jianfeng (Jeff) Zhang > Sent: Monday, January 2, 2017 4:24 PM Subject: Re: py4j doesn't work with python interpreter

Re: Tensorflow not working in Zeppelin 0.7.0

it out on both Zeppelin and Jupyter and it seems to work. Do you have a better version of this in mind? On Tue, Mar 14, 2017 at 8:45 PM Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> wrote: I realize there is a discussion on be Tensorflow issue, aside fro

Re: Roadmap for 0.8.0

g new features. And with subsequent minor release, 0.8.1, 0.8.2 ... moment we feel confident about the quality, release it as a 1.0.0 instead of 0.8.x. Once we have 1.0.0 released, then I think we can make larger, experimental changes on 2.0.0 branch aggressively, while we keep maintaining 1.

Re: Roadmap for 0.8.0

There are several pending visualization improvements/PRs that would be very good to get them in as well. From: Jongyoul Lee Sent: Sunday, March 19, 2017 9:03:24 PM To: dev; users@zeppelin.apache.org Subject: Roadmap for 0.8.0 Hi dev &

Re: Tensorflow not working in Zeppelin 0.7.0

sorflow not working in Zeppelin 0.7.0 Thanks. I have submitted a Jira ticket: https://issues.apache.org/jira/browse/ZEPPELIN-2259 Also, opened an issue on tensorflow: https://github.com/tensorflow/tensorflow/issues/8401 On Tue, Mar 14, 2017 at 8:38 AM, Felix Cheung <felixcheun...@hotmail.com<m

Re: UnicodeDecodeError in zeppelin 0.7.1

And are they running with the same Python version? What is the Python version? _ From: moon soo Lee > Sent: Thursday, April 20, 2017 11:53 AM Subject: Re: UnicodeDecodeError in zeppelin 0.7.1 To:

Re: How can i convert below DataFrame array to string

Explode? https://spark.apache.org/docs/latest/api/python/pyspark.sql.html?highlight=explode#pyspark.sql.functions.explode For Spark questions like this, try stackoverflow spark.apache.org/community.html From: Suresh

Re: Tensorflow not working in Zeppelin 0.7.0

This sounds like more an issue with Tensorflow when working in notebook environment in general. Would you please open a JIRA. Also feel free to open an issue on Tensorflow as well. From: Sriram Narayanamoorthy Sent: Tuesday, March 14,

Re: Hive Reserve Keyword support

I think you can put backticks around the name date https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL From: Jongyoul Lee Sent: Tuesday, May 9, 2017 10:33:50 AM To: users@zeppelin.apache.org Subject: Re: Hive Reserve Keyword

Re: Permission denied: user=zeppelin while using %spark.pyspark interpreter in AWS EMR cluster

Seems to be with hdfs ACL - does the service user Zeppelin have access to your storage? From: BigData Consultant Sent: Friday, May 26, 2017 10:56:31 PM To: d...@zeppelin.apache.org; users@zeppelin.apache.org Subject: Permission

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

Are we proposing some interpreters to be built and released separately? Is this going to be separate packaging? Or separate release pipeline? _ From: Jongyoul Lee > Sent: Friday, June 2, 2017 11:04 PM Subject: [DISCUSS]

Re: Livy - add external libraries from additional maven repo

ral and not a local repo. --Ben On Tue, May 30, 2017 at 12:36 PM, Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> wrote: To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API direct

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

rs into maven separately. We already had a install-interpreter script inside it. If someone wants to install specific interpreter not included in default release package, they can use that script to install specific one. On Sun, Jun 4, 2017 at 9:11 AM, Felix Cheung <felixcheun...@hotmail.com&l

Re: Livy - add external libraries from additional maven repo

if I recall, %dep only works with the built in Spark interpreter and not the Livy interpreter. To manage dependency win Livy you will need to set Spark conf with Livy. From: Theofilos Kakantousis Sent: Tuesday, May 30, 2017 9:05:15 AM To:

Re: Livy - add external libraries from additional maven repo

To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API directly it will be worthwhile to follow up with the Livy community separately. From: Felix Cheung <felixcheun...@hotmail.

Re: Cloudera Data Science Workbench and Zeppelin

Having used it myself, it looks to be a different technology at several different levels, so I'm not sure it is based on Zeppelin in any way. From: Mich Talebzadeh Sent: Sunday, September 10, 2017 1:07:55 AM To:

Re: [DISCUSS] Change some default settings for avoiding unintended usages

I don’t think that’s limited to the shell interpreter. You can run any arbitrary program or script from python or Scala (or java) as well. _ From: Jeff Zhang Sent: Wednesday, November 29, 2017 4:00 PM Subject: Re: [DISCUSS] Change some default

Re: Accessing Spark UI from Zeppelin

You could set to replace http://masternode with your custom http hostname. Perhaps you want that to be set to a known, public (and authenticated?) IP/url? If you do have it it can be set to the Zeppelin config before Zeppelin starts. From: ankit jain

Re: zeppelin build fails with DependencyConvergence error

Instead of exclusion, would it be better to use the version in the cloudera repo? Please do consider contributing these changes back to Zeppelin source. Thanks! _ From: Ruslan Dautkhanov Sent: Monday, December 11, 2017 3:42 PM Subject: Re:

Re: Zeppelin 0.7.2 integration with Presto 0.184

Great. Could someone open a JIRA on this? Unless the policy is changing, this can be a blocker for Presto for 0.8 release

Re: [DISCUSS] Change some default settings for avoiding unintended usages

run any script through python and Scala. Shell is just an example. Using docker looks good but it cannot avoid unindented usage of resources like mining coin. On Fri, Dec 1, 2017 at 2:36 PM, Felix Cheung <felixcheun...@hotmail.com<mailto:felixcheun...@hotmail.com>> wrote: > I don’t

Re: zeppelin 0.8 tar file

0.8 is not released yet. From: Soheil Pourbafrani Sent: Sunday, April 29, 2018 9:18:10 AM To: users@zeppelin.apache.org Subject: zeppelin 0.8 tar file Is there any pre-compiled tar file of Zeppelin 0.8 to download?

Re: [DISCUSS] Change some default settings for avoiding unintended usages

but I don't think it's the part of this issue directly. Let's talk about this issue with another email. I want to talk about enabling authentication by default. If it's enabled, we should login admin/password1 at the beginning. How do you think of it? On Sat, Dec 2, 2017 at 1:57 AM, Felix Cheung

Re: Use Bokeh in Apache Zeppelin

Nice! Get this in https://github.com/apache/zeppelin/blob/master/docs/interpreter/python.md? From: Partridge, Lucas (GE Aviation) Sent: Wednesday, January 10, 2018 2:27:19 AM To: Jeff Zhang Cc: users@zeppelin.apache.org Subject: Use Bokeh

Re: Issue with multiple users running Spark

Should we have some doc on this? I think this could be a common problem From: Austin Heyne Sent: Monday, January 15, 2018 6:59:55 AM To: users@zeppelin.apache.org Subject: Re: Issue with multiple users running Spark Thanks Jeff and Michael for

Re: NullPointerException in paragraph when getting batched TableEnvironment

Does it work within the Flink Scala Shell? From: André Schütz Sent: Wednesday, February 14, 2018 4:02:30 AM To: us...@zeppelin.incubator.apache.org Subject: NullPointerException in paragraph when getting batched TableEnvironment Hi, within the

Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json

Perhaps one concern is users having characters in note name that are invalid for file name/file path? From: Mohit Jaggi Sent: Sunday, August 12, 2018 6:02 PM To: users@zeppelin.apache.org Cc: dev Subject: Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln

Re: [Julia] Does Spark.jl work in Zeppelin's existing Spark/livy.spark interpreters?

Actually, I’m not sure we support Julia as a language in the Spark interpreter. As far as I understand this, this is Julia -> Spark so we would need support for this added to enable Java (Zeppelin) -> Julia -> Spark From: Jongyoul Lee

Re: "IPython is available, use IPython for PySparkInterpreter"

I think that's a good point - perhaps this shouldn't be a warning. From: Ruslan Dautkhanov Sent: Monday, March 19, 2018 11:10:48 AM To: users Subject: "IPython is available, use IPython for PySparkInterpreter" We're getting " IPython is

Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

Congrats and thanks for putting together the release From: Miquel Angel Andreu Febrer Sent: Wednesday, June 27, 2018 11:02:20 PM To: d...@zeppelin.apache.org Cc: users@zeppelin.apache.org Subject: Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released Great news, It has

Re: [Discuss] 0.8.1 Release

+1 thanks! From: Jeff Zhang Sent: Tuesday, January 15, 2019 5:39 PM To: users Subject: Re: [Discuss] 0.8.1 Release Hi Folks, I will start the 0.8.1 release since there's no concerns on this. Jeff Zhang mailto:zjf...@gmail.com>> 于2019年1月14日周一 下午8:50写道： Hi

Re: Windows Supports

Testing on windows can also be done as CI on appveyer. I don’t completely get your comment on .cmd file though. Are you suggesting we don’t support windows and users can “run on windows” by basically running Linux in a virtual environment? Docker is one and there is Linux on Windows

Re: Windows Supports

Ok but was the point about appveyer as CI. It’s not hard to setup. From: Jongyoul Lee Sent: Tuesday, February 26, 2019 11:12 PM To: users Subject: Re: Windows Supports @Felix What I meant was the case that running Zeppelin in the Windows environment natively

Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th

See the Big Data track or the Machine Learning track! We’re delighted to announce that the Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th! As the official conference series of the ASF, ApacheCon North America will feature over a dozen Apache

Re: [DISCUSS] Deprecate support for Spark 2.2.x and earlier version

+1 From: Jeff Zhang Sent: Thursday, February 14, 2019 10:28 PM To: users Subject: [DISCUSS] Deprecate support for Spark 2.2.x and earlier version Hi Folks, Spark 2.2.x will be EOL[1] from January of 2019. So I am considering to deprecate support for spark

Re: Zeppelin log files in windows

Thanks for the report! Other projects have testing setup on the like of AppVeyor. We would greatly appreciate any contribution in this area to fix the issue and enable continuous testing coverage! From: Jeff Zhang Sent: Tuesday, May 28, 2019 6:26:43 AM To:

Re: Zeppelin Studio Proposal

This is cool! From: CHALLA Sent: Wednesday, August 28, 2019 4:39:46 AM To: users@zeppelin.apache.org Subject: Re: Zeppelin Studio Proposal  great. On Wed, Aug 28, 2019 at 4:04 PM Ivan Shapovalov mailto:shapovalov.iva...@gmail.com>> wrote: Hey All, The idea

Re: Intellij announce Big Data Tools – Integration with Zeppelin

Cool! From: Jeff Zhang Sent: Wednesday, October 16, 2019 6:52:02 AM To: users Subject: Intellij announce Big Data Tools – Integration with Zeppelin Here's the related details

Re: [Announce] New Zeppelin Committer: Philipp Dallig

Congrats and welcome! From: Xun Liu Sent: Saturday, June 27, 2020 8:58:34 AM To: dev Cc: users ; philipp.dal...@gmail.com Subject: Re: [Announce] New Zeppelin Committer: Philipp Dallig That's great news! Welcome aboard Philipp! :-) On Sat, Jun 27, 2020 at

Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2)

+1 From: Jeff Zhang Sent: Sunday, July 26, 2020 7:29:22 AM To: users Cc: dev Subject: Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2) +1 Tested spark interpreter tutorial, flink interpreter tutorial. Prabhjyot Singh mailto:prabhjyotsi...@gmail.com>>

Re: [DISCUSS] Zeppelin community sync up meeting

+1 From: Eric Pugh Sent: Tuesday, January 26, 2021 5:28:59 AM To: users Subject: Re: [DISCUSS] Zeppelin community sync up meeting I’d advocate for a regular quarterly run well versus a monthly that ends up sparsely attended and a scramble to setup. The