Re: Zeppelin is much slower than pure spark-shell

It could be many reasons. You need to check the spark UI, whether they use the same resources and same number of tasks York Huang 于2016年11月17日周四 下午1:05写道： > Hi, > I am using a spark sql JOIN. It runs well in SPARK-SHELL --master > yarn-client, but is very slow and

Zeppelin is much slower than pure spark-shell

Hi, I am using a spark sql JOIN. It runs well in SPARK-SHELL --master yarn-client, but is very slow and timeout in zeppelin. Where should I examine the issue? Thanks

ArrayIndexOutOfBoundsException on Zeppelin notebook example

Hi All, I have the following Scala code (taken from https://zeppelin.apache.org/docs/0.6.2/quickstart/tutorial.html#data-retrieval) that deals with the sample Bank-details data:

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

Hi Moon, I have set those variables as follows (a partial view of the zeppelin-env.sh file). Is this okay? #!/bin/bash export JAVA_HOME=/usr/lib/jvm/java-8-oracle export PATH=$PATH:$JAVA_HOME/bin export SPARK_HOME=/home/asif/spark-2.0.0-bin-hadoop2.7 export PATH=$PATH:$SPARK_HOME/bin   

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

Hi Moon, No,  I did not set those two environmental variables. I'm still how to do that. I have installed Spark on my machine and have set the SPARK_HOME. However, do I also need to install and configure the Hadoop. But the error is all about the Hive. Am I some how wrong? A sample

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

>>> at /home/asif/zeppelin-0.6.2-bin-all/metastore_db has an incompatible >>> format with the current version of the software. The database was created >>> by or upgraded by version 10.11. Try to delete this folder and rerun it again. Best Regard, Jeff Zhang From: moon soo Lee

Re: Having issues with Hive RuntimeException in runing Zeppelin notebook applicaiton

Hi, It's strange, Do you have SPARK_HOME or HADOOP_CONF_DIR defined in conf/zeppelin-env.sh? You can stop Zeppelin, delete /home/asif/zeppelin-0.6.2-bin-all/metastore_db, start Zeppelin and try again. Thanks, moon On Tue, Nov 15, 2016 at 4:05 PM Muhammad Rezaul Karim

Re: Embedded Mode for interpreter

Hi, Zeppelin actually does have embedded mode that runs Interpreter in the same JVM that Zeppelin run. This feature does not exposed to user, but it can be controlled by InterpreterOption.remote field.

Aw: Re: Two different errors while executing Spark SQL queries against cached temp tables

Hi Alex,   thanks for responding, I hope I can give you all the needed information.  I downloaded the 0.6.2 binary package and used the standard configuration. I only start the zeppelin-deamon and zeppelin spins up the embedded Spark environment. I only added the postgresql package

RE: Unable to connect with Spark Interpreter

Hello Alexander, Thank you for a quick response. Please, see the server log attached. Unfortunately, I don’t have any zeppelin-interpreter-spark*.log in the logs file. Questions: - It happens everytime – even, If I try to run several paragraphs - Yes, it keeps happening even

Re: Unable to connect with Spark Interpreter

Hi Jan, this is rather generic error saying that ZeppelinServer somehow could not connect to the interpreter proces on your machine. Could you please share more from logs/* in particular, .out and .log of the Zeppelin server AND zepplein-interpreter-spark*.log - usually this is enough to

Re: Two different errors while executing Spark SQL queries against cached temp tables

Hi Florian, sorry for slow response, I guess the main reason for not much feedback here is that its hard to reproduce the error you describe, as it does not happen reliably even on your local environment. java.lang.NoSuchMethodException: org.apache.spark.io.LZ4CompressionCodec This can be a

Unable to connect with Spark Interpreter

Hello, I am not able to run any Spark code in the Zeppelin. I tried compiled versions of Zeppelin as well as to compile the source code on my own based on the https://github.com/apache/zeppelin steps. My configuration is Scala in 2.11 version and spark 2.0.1. Also, I tried different versions of

Aw: Two different errors while executing Spark SQL queries against cached temp tables

Hi,   can anyone help me with this? It is very anoying, because I get this error very often (on my local maschine and also on a second vm). I use Zeppelin 0.6.2 with Spark 2.0 and Scala 2.11.     Best regards Florian   Gesendet: Montag, 14. November 2016 um 20:45 Uhr Von: "Florian Schulz"

Re: FW: Issue with Zeppelin setup on Datastax-Spark

Hello DuyHai, Original problem reported by Arpan Saha is related to Datastax. I am using Spark + Zeppelin. Below is the configuration. - Spark 2.0.2 - Zeppelin: 0.6.2 - Java 1.8.0_111 - R: 3.3.1 Thanks, Abul On Wed, Nov 16, 2016 at 3:44 PM, DuyHai Doan

Re: FW: Issue with Zeppelin setup on Datastax-Spark

I recommend downloading my pre-built Zeppelin for Datastax. Shared folder link: https://drive.google.com/folderview?id=0B6wR2aj4Cb6wQ01aR3ItR0xUNms On Wed, Nov 16, 2016 at 11:13 AM, DuyHai Doan wrote: > Ok I understand why you have issue. > > You are using Spark 2.0.2 and

Re: FW: Issue with Zeppelin setup on Datastax-Spark

Ok I understand why you have issue. You are using Spark 2.0.2 and latest Datastax 5.0.3 is still using Spark version 1.6.X On Wed, Nov 16, 2016 at 10:23 AM, Abul Basar wrote: > I am facing a similar issue while using Spark R. > > My environment: > >- Spark 2.0.2 >-