Hi,
ls your println() is passed to spark job? ie. rdd.map{ r => ... println() }
would print output to the worker's log.
Otherwise, println() should always print output in to the Zeppelin whether
it is running on Standalone mode or running on Yarn.
if it is not the case, could you give me some example to reproduce?
Thanks!!
moon
On Wed, Apr 22, 2015 at 8:14 AM Kelly, Jonathan <[email protected]> wrote:
> It's not so much that the println() doesn't work in cluster mode but
> that it's printing out to the worker's log rather than to the driver, so
> you don't see it in the Zeppelin UI. If you're using Spark Standalone, I
> think you would see the println() output in the worker's log; if you're
> using Spark on YARN, you'd see it in the YARN task logs.
>
>
> Jonathan Kelly
>
> Elastic MapReduce - SDE
>
> Port 99 (SEA35) 08.220.C2
>
> From: "[email protected]" <[email protected]>
> Reply-To: "[email protected]" <
> [email protected]>
> Date: Tuesday, April 21, 2015 at 5:10 AM
> To: "[email protected]" <
> [email protected]>
>
> Subject: RE: Scala Angular integration in Zeppelin
>
> Hi Moon,
>
>
>
> This is working now. The error was due to two mistakes I made:
>
> 1. I thought that println(…) is part of %angular interpreter. From
> you response I understood that println() is part of %spark
>
> 2. I built zeppelin in cluster mode, but I was running it in local
> mode(ie no external Spark master)
>
>
>
> The prinln() works when running with %spark using zepellin built with
> local mode: mvn install –DskipTests
>
>
>
> Thanks,
>
> Prajod
>
>
>
> *From:* [email protected] [mailto:[email protected]
> <[email protected]>]
> *Sent:* 20 April 2015 19:30
> *To:* [email protected]
> *Subject:* RE: Scala Angular integration in Zeppelin
>
>
>
> Hi Moon,
>
>
>
> Thanks for the reply. The angular-spark integration is a great feature and
> we love it.
>
>
>
> I thought had the latest, since I got the master branch from:
> https://github.com/apache/incubator-zeppelin , on April 16. Just that I
> downloaded the zip file, instead of doing a “git clone”.
>
>
>
> I did a maven install:
>
>
>
> mvn install -DskipTests -Dspark.version=1.3.0 -Dhadoop.version=2.4.0
>
>
>
>
>
> Is this ok ? Should I build and install using a later version of spark or
> hadoop ? Maybe I should use spark 1.3.1. Will try that today.
>
>
>
> Btw, the output I show below was when I used %angular. When I used %spark
> I received a timeout exception. I though println notebook command works
> with %angular, and not scala/%spark.
>
>
>
> Prajod
>
> *From:* moon soo Lee [mailto:[email protected] <[email protected]>]
> *Sent:* 19 April 2015 06:58
> *To:* [email protected]
> *Subject:* Re: Scala Angular integration in Zeppelin
>
>
>
> Hi,
>
>
>
> The usage, code and examples are going to documented and released in
> homepage soon.
>
>
>
> To use this feature, you need build Zeppelin from latest master branch.
>
>
>
> If click 'gear' icon on upper right of your notebook, you'll see
> interpreter binding. Can you check how they look like?
>
> To use println without %spark in front, you need select 'spark'
> interpreter setting and move it to the top, in interpreter binding panel.
>
>
>
> Thanks,
>
> moon
>
> On Sat, Apr 18, 2015 at 1:31 PM <[email protected]> wrote:
>
> Hi,
>
>
>
> I was trying scala-angular integration given in the youtube video show
> here: https://www.youtube.com/watch?v=xU5TBS_MsAs
>
>
>
> That video seems to be the only documentation for this feature in Zeppelin.
>
>
>
> 1. Is the code shown there available somewhere ?
>
> 2. Which code is it using ? I downloaded the zip file from
> zeppelin’s github, on April 16, and installed it. Using spark.version-1.3.0
>
> 3. The basic println(“%html <h3>Hello Zeppelin</h3>”) is not
> working. Only the <h3>…</h3> string is being interpreted. The println
> command is being ignored. I tried the 3 interpreters: %angular, %md, %spark
>
> a. The output I get is
>
> {<<
>
> println(“%html
>
> Hello Zeppelin
>
> “)
>
> >>}
>
>
>
> Thanks,
>
> Prajod
>
> The information contained in this electronic message and any attachments
> to this message are intended for the exclusive use of the addressee(s) and
> may contain proprietary, confidential or privileged information. If you are
> not the intended recipient, you should not disseminate, distribute or copy
> this e-mail. Please notify the sender immediately and destroy all copies of
> this message and any attachments. WARNING: Computer viruses can be
> transmitted via email. The recipient should check this email and any
> attachments for the presence of viruses. The company accepts no liability
> for any damage caused by any virus transmitted by this email.
> www.wipro.com
>
> The information contained in this electronic message and any
> attachments to this message are intended for the exclusive use of the
> addressee(s) and may contain proprietary, confidential or privileged
> information. If you are not the intended recipient, you should not
> disseminate, distribute or copy this e-mail. Please notify the sender
> immediately and destroy all copies of this message and any attachments.
> WARNING: Computer viruses can be transmitted via email. The recipient
> should check this email and any attachments for the presence of viruses.
> The company accepts no liability for any damage caused by any virus
> transmitted by this email. www.wipro.com
> The information contained in this electronic message and any attachments
> to this message are intended for the exclusive use of the addressee(s) and
> may contain proprietary, confidential or privileged information. If you are
> not the intended recipient, you should not disseminate, distribute or copy
> this e-mail. Please notify the sender immediately and destroy all copies of
> this message and any attachments. WARNING: Computer viruses can be
> transmitted via email. The recipient should check this email and any
> attachments for the presence of viruses. The company accepts no liability
> for any damage caused by any virus transmitted by this email.
> www.wipro.com
>
