Re: [DISCUSS] Zeppelin community sync up meeting

+1 From: Eric Pugh Sent: Tuesday, January 26, 2021 5:28:59 AM To: users Subject: Re: [DISCUSS] Zeppelin community sync up meeting I’d advocate for a regular quarterly run well versus a monthly that ends up sparsely attended and a scramble to setup. The genera

Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2)

+1 From: Jeff Zhang Sent: Sunday, July 26, 2020 7:29:22 AM To: users Cc: dev Subject: Re: [VOTE] Release Apache Zeppelin 0.9.0-preview2 (RC2) +1 Tested spark interpreter tutorial, flink interpreter tutorial. Prabhjyot Singh mailto:prabhjyotsi...@gmail.com>>

Re: [Announce] New Zeppelin Committer: Philipp Dallig

Congrats and welcome! From: Xun Liu Sent: Saturday, June 27, 2020 8:58:34 AM To: dev Cc: users ; philipp.dal...@gmail.com Subject: Re: [Announce] New Zeppelin Committer: Philipp Dallig That's great news! Welcome aboard Philipp! :-) On Sat, Jun 27, 2020 at 8:4

Re: Intellij announce Big Data Tools – Integration with Zeppelin

Cool! From: Jeff Zhang Sent: Wednesday, October 16, 2019 6:52:02 AM To: users Subject: Intellij announce Big Data Tools – Integration with Zeppelin Here's the related details https://blog.jetbrains.com/scala/2019/10/16/meet-big-data-tools-spark-integration-and

Re: Zeppelin Studio Proposal

This is cool! From: CHALLA Sent: Wednesday, August 28, 2019 4:39:46 AM To: users@zeppelin.apache.org Subject: Re: Zeppelin Studio Proposal 👏 great. On Wed, Aug 28, 2019 at 4:04 PM Ivan Shapovalov mailto:shapovalov.iva...@gmail.com>> wrote: Hey All, The idea o

Re: Zeppelin log files in windows

Thanks for the report! Other projects have testing setup on the like of AppVeyor. We would greatly appreciate any contribution in this area to fix the issue and enable continuous testing coverage! From: Jeff Zhang Sent: Tuesday, May 28, 2019 6:26:43 AM To: user

Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th

See the Big Data track or the Machine Learning track! We’re delighted to announce that the Call for Presentations (CFP) is now open for ApacheCon North America in Las Vegas, September 9-13th! As the official conference series of the ASF, ApacheCon North America will feature over a dozen Apache pro

Re: Windows Supports

Ok but was the point about appveyer as CI. It’s not hard to setup. From: Jongyoul Lee Sent: Tuesday, February 26, 2019 11:12 PM To: users Subject: Re: Windows Supports @Felix What I meant was the case that running Zeppelin in the Windows environment natively wi

Re: Windows Supports

Testing on windows can also be done as CI on appveyer. I don’t completely get your comment on .cmd file though. Are you suggesting we don’t support windows and users can “run on windows” by basically running Linux in a virtual environment? Docker is one and there is Linux on Windows https://doc

Re: [DISCUSS] Deprecate support for Spark 2.2.x and earlier version

+1 From: Jeff Zhang Sent: Thursday, February 14, 2019 10:28 PM To: users Subject: [DISCUSS] Deprecate support for Spark 2.2.x and earlier version Hi Folks, Spark 2.2.x will be EOL[1] from January of 2019. So I am considering to deprecate support for spark 2.2.

Re: [Discuss] 0.8.1 Release

+1 thanks! From: Jeff Zhang Sent: Tuesday, January 15, 2019 5:39 PM To: users Subject: Re: [Discuss] 0.8.1 Release Hi Folks, I will start the 0.8.1 release since there's no concerns on this. Jeff Zhang mailto:zjf...@gmail.com>> 于2019年1月14日周一 下午8:50写道： Hi Every

Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln instead of [NOTEID]/note.json

Perhaps one concern is users having characters in note name that are invalid for file name/file path? From: Mohit Jaggi Sent: Sunday, August 12, 2018 6:02 PM To: users@zeppelin.apache.org Cc: dev Subject: Re: [DISCUSS] ZEPPELIN-2619. Save note in [Title].zpln in

Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released

Congrats and thanks for putting together the release From: Miquel Angel Andreu Febrer Sent: Wednesday, June 27, 2018 11:02:20 PM To: d...@zeppelin.apache.org Cc: users@zeppelin.apache.org Subject: Re: [ANNOUNCE] Apache Zeppelin 0.8.0 released Great news, It has

Re: zeppelin 0.8 tar file

0.8 is not released yet. From: Soheil Pourbafrani Sent: Sunday, April 29, 2018 9:18:10 AM To: users@zeppelin.apache.org Subject: zeppelin 0.8 tar file Is there any pre-compiled tar file of Zeppelin 0.8 to download?

Re: [Julia] Does Spark.jl work in Zeppelin's existing Spark/livy.spark interpreters?

Actually, I’m not sure we support Julia as a language in the Spark interpreter. As far as I understand this, this is Julia -> Spark so we would need support for this added to enable Java (Zeppelin) -> Julia -> Spark From: Jongyoul Lee Sent: Saturday, April 21,

Re: "IPython is available, use IPython for PySparkInterpreter"

I think that's a good point - perhaps this shouldn't be a warning. From: Ruslan Dautkhanov Sent: Monday, March 19, 2018 11:10:48 AM To: users Subject: "IPython is available, use IPython for PySparkInterpreter" We're getting " IPython is available, use IPython for

Re: NullPointerException in paragraph when getting batched TableEnvironment

Does it work within the Flink Scala Shell? From: André Schütz Sent: Wednesday, February 14, 2018 4:02:30 AM To: us...@zeppelin.incubator.apache.org Subject: NullPointerException in paragraph when getting batched TableEnvironment Hi, within the Flink Interpreter

Re: Issue with multiple users running Spark

Should we have some doc on this? I think this could be a common problem From: Austin Heyne Sent: Monday, January 15, 2018 6:59:55 AM To: users@zeppelin.apache.org Subject: Re: Issue with multiple users running Spark Thanks Jeff and Michael for the help. We're se

Re: Use Bokeh in Apache Zeppelin

Nice! Get this in https://github.com/apache/zeppelin/blob/master/docs/interpreter/python.md? From: Partridge, Lucas (GE Aviation) Sent: Wednesday, January 10, 2018 2:27:19 AM To: Jeff Zhang Cc: users@zeppelin.apache.org Subject: Use Bokeh in Apache Zeppelin Than

Re: [DISCUSS] Change some default settings for avoiding unintended usages

his issue directly. Let's talk about this issue with another email. I want to talk about enabling authentication by default. If it's enabled, we should login admin/password1 at the beginning. How do you think of it? On Sat, Dec 2, 2017 at 1:57 AM, Felix Cheung mailto:felixcheun...@ho

Re: Accessing Spark UI from Zeppelin

You could set to replace http://masternode with your custom http hostname. Perhaps you want that to be set to a known, public (and authenticated?) IP/url? If you do have it it can be set to the Zeppelin config before Zeppelin starts. From: ankit jain Sent: Thurs

Re: zeppelin build fails with DependencyConvergence error

Instead of exclusion, would it be better to use the version in the cloudera repo? Please do consider contributing these changes back to Zeppelin source. Thanks! _ From: Ruslan Dautkhanov Sent: Monday, December 11, 2017 3:42 PM Subject: Re: zeppelin build fails with D

Re: [DISCUSS] Change some default settings for avoiding unintended usages

usage of resources like mining coin. On Fri, Dec 1, 2017 at 2:36 PM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: > I don’t think that’s limited to the shell interpreter. > > You can run any arbitrary program or script from python or Scal

Re: [DISCUSS] Change some default settings for avoiding unintended usages

I don’t think that’s limited to the shell interpreter. You can run any arbitrary program or script from python or Scala (or java) as well. _ From: Jeff Zhang Sent: Wednesday, November 29, 2017 4:00 PM Subject: Re: [DISCUSS] Change some default settings for avoiding u

Re: Zeppelin 0.7.2 integration with Presto 0.184

Great. Could someone open a JIRA on this? Unless the policy is changing, this can be a blocker for Presto for 0.8 release

Re: Cloudera Data Science Workbench and Zeppelin

Having used it myself, it looks to be a different technology at several different levels, so I'm not sure it is based on Zeppelin in any way. From: Mich Talebzadeh Sent: Sunday, September 10, 2017 1:07:55 AM To: users@zeppelin.apache.org Subject: Re: Cloudera Da

Re: Zeppelin can let users write Java code?

There has been discussions on leveraging a Java REPL project to create such Java interpreter. Also Java 9 has JShell which seems to target a release in the next few months. From: Yi Lyu Sent: Saturday, June 24, 2017 9:17:32 AM To: users Subject: Zeppelin can let

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

e wants to install specific interpreter not included in default release package, they can use that script to install specific one. On Sun, Jun 4, 2017 at 9:11 AM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: > Are we proposing some interpreters to be built and released separate

Re: [DISCUSS] Reducing default interpreters while building and releasing Zeppelin

Are we proposing some interpreters to be built and released separately? Is this going to be separate packaging? Or separate release pipeline? _ From: Jongyoul Lee mailto:jongy...@gmail.com>> Sent: Friday, June 2, 2017 11:04 PM Subject: [DISCUSS] Reducing default inter

Re: Livy - add external libraries from additional maven repo

l repo. --Ben On Tue, May 30, 2017 at 12:36 PM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API directly it will be worthwhi

Re: Livy - add external libraries from additional maven repo

To add, this might be an issue with Livy. I'm seeing something similar as well. If you can get a repo with calling the Livy REST API directly it will be worthwhile to follow up with the Livy community separately. From: Felix Cheung Sent: Tuesday, May 30,

Re: Livy - add external libraries from additional maven repo

if I recall, %dep only works with the built in Spark interpreter and not the Livy interpreter. To manage dependency win Livy you will need to set Spark conf with Livy. From: Theofilos Kakantousis Sent: Tuesday, May 30, 2017 9:05:15 AM To: users@zeppelin.apache.o

Re: Permission denied: user=zeppelin while using %spark.pyspark interpreter in AWS EMR cluster

Seems to be with hdfs ACL - does the service user Zeppelin have access to your storage? From: BigData Consultant Sent: Friday, May 26, 2017 10:56:31 PM To: d...@zeppelin.apache.org; users@zeppelin.apache.org Subject: Permission denied: user=zeppelin while using %

Re: Does Zeppelin 0.7.1 work with Spark Structured Streaming 2.1.1?

I think you can have one notebook for setup - calling the source and sink as you have below; then another notebook to run the %sql to read from memory temp view and output to a visualization. This way you could have the 2nd notebook be a dashboard and run (i.e. refresh automatically) on a sched

Re: Hive Reserve Keyword support

I think you can put backticks around the name date https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL From: Jongyoul Lee Sent: Tuesday, May 9, 2017 10:33:50 AM To: users@zeppelin.apache.org Subject: Re: Hive Reserve Keyword support If it's possi

Re: How to create a real time dashboards from spark using web socket?

You could have multiple notes sharing interpreter - could you have one note for setup to call streamingcontext.start and another note on a schedule just to run the select sql statement? _ From: kant kodali mailto:kanth...@gmail.com>> Sent: Tuesday, April 25, 2017 8:12

Re: UnicodeDecodeError in zeppelin 0.7.1

And are they running with the same Python version? What is the Python version? _ From: moon soo Lee mailto:m...@apache.org>> Sent: Thursday, April 20, 2017 11:53 AM Subject: Re: UnicodeDecodeError in zeppelin 0.7.1 To: mailto:users@zeppelin.apache.org>> Hi, 0.7.1 did

Re: Zeppelin hangs in air-gapped environments

Yes please From: Raffaele S Sent: Wednesday, March 29, 2017 5:12:35 AM To: users@zeppelin.apache.org Subject: Re: Zeppelin hangs in air-gapped environments Should I create an Issue on JIRA for this? 2017-03-26 9:47 GMT+02:00 Eric Charles mailto:e...@apache.org>

Re: Roadmap for 0.8.0

1] http://spark.apache.org/news/spark-2.0.0-preview.html On Mon, Mar 20, 2017 at 11:31 PM Jongyoul Lee mailto:jongy...@gmail.com>> wrote: I agree that it will help prolong RC period and use it actually. And also we need code freeze for the new features and spend time to stabilize RC. On Tu

Re: Roadmap for 0.8.0

y, release it as a 1.0.0 instead of 0.8.x. Once we have 1.0.0 released, then I think we can make larger, experimental changes on 2.0.0 branch aggressively, while we keep maintaining 1.0.x branch. Thanks, moon On Mon, Mar 20, 2017 at 8:55 AM Felix Cheung mailto:felixcheun...@hotmail.c

Re: Roadmap for 0.8.0

There are several pending visualization improvements/PRs that would be very good to get them in as well. From: Jongyoul Lee Sent: Sunday, March 19, 2017 9:03:24 PM To: dev; users@zeppelin.apache.org Subject: Roadmap for 0.8.0 Hi dev & users, Recently, communit

Re: Tensorflow not working in Zeppelin 0.7.0

version of this in mind? On Tue, Mar 14, 2017 at 8:45 PM Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: I realize there is a discussion on be Tensorflow issue, aside from the thought of initializing the variables, I think they should broaden their detection of interactive shell to i

Re: Tensorflow not working in Zeppelin 0.7.0

on tensorflow: https://github.com/tensorflow/tensorflow/issues/8401 On Tue, Mar 14, 2017 at 8:38 AM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: This sounds like more an issue with Tensorflow when working in notebook environment in general. Would you please open

Re: Tensorflow not working in Zeppelin 0.7.0

This sounds like more an issue with Tensorflow when working in notebook environment in general. Would you please open a JIRA. Also feel free to open an issue on Tensorflow as well. From: Sriram Narayanamoorthy Sent: Tuesday, March 14, 2017 7:28:12 AM To: users

Re: How can i convert below DataFrame array to string

Explode? https://spark.apache.org/docs/latest/api/python/pyspark.sql.html?highlight=explode#pyspark.sql.functions.explode For Spark questions like this, try stackoverflow spark.apache.org/community.html From: Suresh Ayy

Re: Another instance of Derby already booted the database .../metastore_db

The issue is since you are running Spark interpreter in isolated mode there are two running Spark driver process trying to access derby metastore at the same location, at the same time. There are some config in Spark that could redirect metastore to different location (try spark.warehouse.dir)

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC2)

I'm seeing the same behavior with the marital status drop down box on the intro notebook on netinst build. I think this could be a bigger problem. _ From: Khalid Huseynov mailto:khalid...@zepl.com>> Sent: Sunday, January 22, 2017 8:08 PM Subject: Re: [VOTE] Release A

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC1)

Thanks. I'd incline to agree having latest matplotlib broken with python (python interpreter) seems like a big inconvenience. Is there a workaround? Let's discuss a bit in the JIRA and bring this back to the vote thread. Also we should really try to mark JIRA too to be included in RC builds, to

Re: Mailing List

n the interpreter REST API, that was it. Sent from my iPhone On Jan 10, 2017, at 10:06 PM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: There was a few email yesterday - do you not get them? From: Meeraj Kunnumpurath mailto:mee...@servicesymphony

Re: Mailing List

There was a few email yesterday - do you not get them? From: Meeraj Kunnumpurath Sent: Tuesday, January 10, 2017 9:09:52 AM To: users@zeppelin.apache.org Subject: Mailing List Hello Is this mailing list active? I see hardly any traffic here, just seen couple of

Re: py4j doesn't work with python interpreter

You said you ran sudo pip install pyplot I think you need to pip install py4j instead? _ From: Jianfeng (Jeff) Zhang mailto:jzh...@hortonworks.com>> Sent: Monday, January 2, 2017 4:24 PM Subject: Re: py4j doesn't work with python interpreter To: mailto:users@zeppelin

Re: Unable to connect with Spark Interpreter

Hmm possibly with the classpath. These might be Windows specific issues. We probably need to debug to fix these. From: Jan Botorek Sent: Tuesday, November 29, 2016 4:01:43 AM To: users@zeppelin.apache.org Subject: RE: Unable to connect with Spark Interpreter Yo

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

Can you reuse the HiveContext instead of making new ones with HiveContext(sc)? From: Ruslan Dautkhanov Sent: Sunday, November 27, 2016 8:07:41 AM To: users Subject: Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'" Also, to get rid of this problem (

Re: Zepelin problem in HA HDFS

Quite possibly since Spark is talking to HDFS. Does it work in your environment when HA switch over with a long running spark shell session? From: Ruslan Dautkhanov Sent: Sunday, November 20, 2016 5:27:54 PM To: users@zeppelin.apache.org Subject: Re: Zepelin pr

Re: "You must build Spark with Hive. Export 'SPARK_HIVE=true'"

Hmm, SPARK_HOME is set it should pick up the right Spark. Does this work with the Scala Spark interpreter instead of pyspark? If it doesn't, is there more info in the log? From: Ruslan Dautkhanov Sent: Monday, November 21, 2016 1:52:36 PM To: users@zeppelin.apa

Re: Is it possible to run Java code on Zeppelin Notebook?

I think you will need to convert Java code into Scala syntax? But Scala can call into Java libraries and so on. I don't think we have an interpreter for Java since it does not come with a REPL until Java 9? From: Abhisar Mohapatra Sent: Thursday, November 17,

Re: Zeppelin using Spark to access Hbase throws error

no case be liable for any monetary damages arising from such loss, damage or destruction. On 29 October 2016 at 21:53, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: When you run the code in spark-shell - is that the same machine as where Zeppelin is running? It looks like y

Re: Zeppelin using Spark to access Hbase throws error

When you run the code in spark-shell - is that the same machine as where Zeppelin is running? It looks like you are getting socket connection timeout when Spark, running from Zeppelin, is trying to connect to HBASE. _ From: Mich Talebzadeh mailto:mich.talebza...@gm

Re: How Apache Zeppelin runs a paragraph

Great post! On Tue, Oct 4, 2016 at 8:56 PM -0700, "Jongyoul Lee" mailto:jongy...@gmail.com>> wrote: Hello DuyHai, Thanks for the fixing the typo. I've fixed it. Concerning the debugging, I think writing posts or updating wiki would be better. I'm willing to write a simple post for that re

Re: Pyspark interpreter configuration for Zeppelin

I think you need to build Zeppelin from source to run against CDH On Wed, Sep 14, 2016 at 12:58 PM -0700, "Abhi Basu" <9000r...@gmail.com> wrote: I feel there is a scala compatibility issue and I will try compiling with the right switches. On Wed, Sep 14, 2016 at

Re: Binary for CDH 5.8.0

We don't have Hadoop distribution specific binary releases - compiling from source with switches would be the best route. On Mon, Sep 19, 2016 at 12:22 PM -0700, "Abhi Basu" <9000r...@gmail.com> wrote: Is there a specific binary for CDH 5.8.0, hadoop 2.6. and Spar

Re: Hbase configuration storage without data

I like that approach - though you should be able to clear result output before exporting the note, if all you want is the config? The should remove all output data, keeping it smaller? _ From: Mohit Jaggi mailto:mohitja...@gmail.com>> Sent: Monday, September 12, 2016

Re: Matplotlib uses tkinter instead of Agg

And matplotlib.use('Agg') Would only work before matplotlib is first used so you would need to restart the interpreter. From error stack below it looks like something might be setting the default backend in matplotlib to TkAgg though. Are you using the Python interpreter or PySpark interpreter?

Re: spark.jars option for Zeppelin over Livy

ttached screenshot On Tue, Aug 2, 2016 at 1:43 PM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: Have you tried setting it in the Interpreter menu under Livy? On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" mailto:chen.song...@gmail.com>> wrote: When u

Re: spark.jars option for Zeppelin over Livy

Have you tried setting it in the Interpreter menu under Livy? On Tue, Aug 2, 2016 at 11:04 AM -0700, "Chen Song" mailto:chen.song...@gmail.com>> wrote: When using Zeppelin over Livy, how would I set the spark.jars option? I try to set it in my spark-defaults.conf and Livy doesn't respect it

Re: Run zeppelin spark interpreter in kerberos

You could set the Spark config properties for principal to use with Kerberos - it's not end-to-end, but could be a good step: http://spark.apache.org/docs/latest/security.html#yarn-mode On Wed, Jul 20, 2016 at 4:02 PM -0700, "Jeff Zhang" mailto:zjf...@gmail.com>> wrote: I think the work is

Re: [ANNOUNCE] Apache Zeppelin 0.6.0 released

s, Ben On Jul 8, 2016, at 2:01 AM, Felix Cheung mailto:felixcheun...@hotmail.com>> wrote: Is this possibly caused by CDH requiring a build-from-source instead of the official binary releases? On Thu, Jul 7, 2016 at 8:22 PM -0700, "Benjamin Kim" mailto:bbuil...@gmail.com>

Re: [ANNOUNCE] Apache Zeppelin 0.6.0 released

Is this possibly caused by CDH requiring a build-from-source instead of the official binary releases? On Thu, Jul 7, 2016 at 8:22 PM -0700, "Benjamin Kim" mailto:bbuil...@gmail.com>> wrote: Moon, My environmental setup consists of an 18 node CentOS 6.7 cluster with 24 cores, 64GB, 12TB st

Re: Passing command line params when cell is evaluated?

This should be captured in a log file under /logs of Zeppelin binaries. This specific warning, in believe, might be coming from the way Zeppelin is calling spark-submit? On Wed, Jul 6, 2016 at 5:24 PM -0700, "Shayne Hodge" mailto:sho...@snaplogic.com>> wrote: When I execute a few lines of

Re: Zeppelin Integration with Livy Server

How about a export transform feature that can take notebook content and convert it to a different form that can be submitted to Livy? That could be useful for something like export to code (.py, .scala) or export to PDF? On Thu, Jun 16, 2016 at 10:35 PM -0700, "Jeff Zhang" mailto:zjf...@gm

Re: UnknownHostException in HA cluster when access hive metastore with Spark SQL in Zeppelin

It looks like org.apache.hadoop.fs is  treating ha-cluster as a hostname instead of an alias as it should with HA. Caused by: java.net.UnknownHostException: Invalid host name: local host is: (unknown); destination host is: "ha-cluster":8020;  Could you open a JIRA on this please?