What do you mean "external" spark? Does it mean spark folder in the same
machine already installed? Can you confirm if Zeppelin actually downloads and
put its own spark in zeppelin home folder? So there is potential duplicate?
On Saturday, December 26, 2015 10:21 PM, Jongyoul Lee <jongy...@gmail.com>
wrote:
According to bin/interpreter.sh, it's not necessary if you use external spark.
But without external spark, you should build Zeppelin with -Ppyspark if you
want to use pyspark.
On Sun, Dec 27, 2015 at 10:15 AM, Amos B. Elberg <amos.elb...@me.com> wrote:
I just looked at this, and I’m confused about it too.
It looks like this shouldn’t be necessary when we get rid of launching spark
from a subdirectory of ZEPPELIN_HOME.
It also looks like if -Ppyspark is specified, the installer downloads a second
copy of the Spark binaries, but that’s it.
Is any of this actually necessary? It looks to me that -Ppyspark could come
out of the build completely.
From: Hoc Phan <quang...@yahoo.com>
Reply: users@zeppelin.incubator.apache.org
<users@zeppelin.incubator.apache.org>, Hoc Phan <quang...@yahoo.com>
Date: December 26, 2015 at 7:21:21 PM
To: users@zeppelin.incubator.apache.org <users@zeppelin.incubator.apache.org>
Subject: Re: What is -Ppyspark for?
Hi
Thanks for the response but I amstill vague about this option. So when do we
NOT use -Ppyspark? Iguess I am confused about this statement "Instead
ofconfiguring pyspark manually.." in the old thread. Does itreferring setting
SPARK_HOME and PYSPARK env variables?
On Thursday, December24, 2015 3:18 AM, Renjith Kamath
<renjith.kam...@gmail.com>wrote:
Hi Hoc,
Please have a look at the followingrelated mail thread."Instead ofconfiguring
pyspark manually. To enable pyspark configurationduring build, just provide
profile name “Ppyspark” while buildingyour zeppelin binaries."
http://apache-zeppelin-users-incubating-mailing-list.75479.x6.nabble.com/Zeppelin-on-CDH-td284.html#a285
On Thu, Dec 24, 2015 at 2:03PM, Hoc Phan <quang...@yahoo.com>wrote:
When I build Zeppelin, when do Iuse -Ppyspark?
Does it mean Zeppelin will use pyspark instead ofspark-submit? If so, what's
the difference?
--
이종열, Jongyoul Lee, 李宗烈
http://madeng.net
