Re: Monitoring ongoing Spark Job when run in Yarn Cluster mode

[Marcelo Vanzin]

It's linked from the YARN RM's Web UI (see the "Application Master"
link for the running application).

On Mon, Mar 13, 2017 at 6:53 AM, Sourav Mazumder
 wrote:
> Hi,
>
> Is there a way to monitor an ongoing Spark Job when running in Yarn Cluster
> mode ?
>
> In  my understanding in Yarn Cluster mode Spark Monitoring UI for the
> ongoing job would not be available in 4040 port. So is there an alternative
> ?
>
> Regards,
> Sourav



-- 
Marcelo

-
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Re: Monitoring ongoing Spark Job when run in Yarn Cluster mode

[Nirav Patel]

I think it would be on port 4040 by default on the Node where driver is
running. You should be able to navigate to that via Resource Manager's
application master link as in cluster mode both AM and driver runs on same
node.


On Mon, Mar 13, 2017 at 6:53 AM, Sourav Mazumder <
sourav.mazumde...@gmail.com> wrote:

> Hi,
>
> Is there a way to monitor an ongoing Spark Job when running in Yarn
> Cluster mode ?
>
> In  my understanding in Yarn Cluster mode Spark Monitoring UI for the
> ongoing job would not be available in 4040 port. So is there an alternative
> ?
>
> Regards,
> Sourav
>

-- 


[image: What's New with Xactly] 

  [image: LinkedIn] 
  [image: Twitter] 
  [image: Facebook] 
  [image: YouTube] 

Monitoring ongoing Spark Job when run in Yarn Cluster mode

[Sourav Mazumder]

Hi,

Is there a way to monitor an ongoing Spark Job when running in Yarn Cluster
mode ?

In  my understanding in Yarn Cluster mode Spark Monitoring UI for the
ongoing job would not be available in 4040 port. So is there an alternative
?

Regards,
Sourav