[
https://issues.apache.org/jira/browse/SPARK-7717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Swaranga Sarma updated SPARK-7717:
----------------------------------
Description:
I launched a Spark master in standalone mode in one of my host and then
launched 3 workers on three different hosts. The workers successfully connected
to my master and the Web UI showed the correct details. Specifically, the Web
UI correctly shows that the total memory and the total cores available for the
cluster.
However on one of the worker, I did a "kill -9 <worker process id>" and
restarted the worker again. This time though, the master's Web UI shows
incorrect total memory and number of cores. The total memory is shown to be
4*n, where "n" is the memory in each worker. Also the total workers is shown as
4 and the total number of cores shown is incorrect, it shows 4*c, where "c" is
the number of cores on each worker.
was:
I launched a Spark master in standalone mode in one of my host and then
launched 3 workers on three different hosts. The workers successfully connected
to my master and the Web UI showed the correct details. Specifically, the Web
UI correctly shows that the total memory and the total cores available for the
cluster.
However on one of the worker, I did a "kill -9 <worker process id>" and
restarted the worker again. This time though, the master's Web UI shows
incorrect total memory and number of cores. The total memory is shown to be
4*n, where "n" is the memory in each worker. Also the total cores shown is
incorrect, it shows 4*c, where "c" is the number of cores on each worker.
> Spark Standalone Web UI showing incorrect total memory, workers and cores
> -------------------------------------------------------------------------
>
> Key: SPARK-7717
> URL: https://issues.apache.org/jira/browse/SPARK-7717
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 1.3.1
> Environment: RedHat
> Reporter: Swaranga Sarma
> Priority: Minor
> Labels: web-ui
> Attachments: JIRA.PNG
>
>
> I launched a Spark master in standalone mode in one of my host and then
> launched 3 workers on three different hosts. The workers successfully
> connected to my master and the Web UI showed the correct details.
> Specifically, the Web UI correctly shows that the total memory and the total
> cores available for the cluster.
> However on one of the worker, I did a "kill -9 <worker process id>" and
> restarted the worker again. This time though, the master's Web UI shows
> incorrect total memory and number of cores. The total memory is shown to be
> 4*n, where "n" is the memory in each worker. Also the total workers is shown
> as 4 and the total number of cores shown is incorrect, it shows 4*c, where
> "c" is the number of cores on each worker.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
