Re: Could not access Spark webUI on OpenStack VMs

[Ted Yu]

What happened when you tried to access port 8080 ?

Checking iptables settings is good to do.

At my employer, we use OpenStack clusters daily and don't encounter much
problem - including UI access.
Probably some settings should be tuned.

On Thu, Apr 28, 2016 at 5:03 AM, Dan Dong  wrote:

> Hi, all,
>   I'm having problem to access the web UI of my Spark cluster. The cluster
> is composed of a few virtual machines running on a OpenStack platform. The
> VMs are launched from CentOS7.0 server image available from official site.
> The Spark itself runs well and master and worker process are all up and
> running, and run SparkPi example also get expected result. So, the question
> is, how to debug such a problem? Should it be a native problem of the
> CentOS image as it is not a desktop version, so some graphic packages might
> be missing in the VM?
> Or it is a iptables settings problem comes from OpenStack, as Openstack
> configures complex network inside it and it might block certain
> communication?
> Does anybody find similar problems? Any hints will be appreciated. Thanks!
>
> Cheers,
> Dong
>
>

Could not access Spark webUI on OpenStack VMs

[Dan Dong]

Hi, all,
  I'm having problem to access the web UI of my Spark cluster. The cluster
is composed of a few virtual machines running on a OpenStack platform. The
VMs are launched from CentOS7.0 server image available from official site.
The Spark itself runs well and master and worker process are all up and
running, and run SparkPi example also get expected result. So, the question
is, how to debug such a problem? Should it be a native problem of the
CentOS image as it is not a desktop version, so some graphic packages might
be missing in the VM?
Or it is a iptables settings problem comes from OpenStack, as Openstack
configures complex network inside it and it might block certain
communication?
Does anybody find similar problems? Any hints will be appreciated. Thanks!

Cheers,
Dong