[
https://issues.apache.org/jira/browse/SPARK-30092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992401#comment-16992401
]
ZhongYu commented on SPARK-30092:
-
It is hard to give steps that will certainly reproduce this issues. But I use
this step to reproduce this issues with relatively large probability.
# Deploy yarn using AWS ec2 ( or other virtual machine )
# Start spark job on yarn in client mode.
# Stop some yarn ec2 slaves that spark job are running
> Number of active tasks is negative in Live UI Executors page
>
>
> Key: SPARK-30092
> URL: https://issues.apache.org/jira/browse/SPARK-30092
> Project: Spark
> Issue Type: Bug
> Components: Web UI
>Affects Versions: 2.4.1
> Environment: Hadoop version: 2.7.3
> ResourceManager version: 2.7.3
>Reporter: ZhongYu
>Priority: Major
> Attachments: wx20191202-102...@2x.png
>
>
> The number of active tasks is negative in Live UI Executors page when there
> is executor lost and task failure. I am using spark on yarn which built on
> AWS spot instances. When yarn work lost, there is a large probability to
> become negative active tasks in Spark Live UI.
> I saw related tickets below and resolved in earlier version of Spark. But
> Same things happened again in Spark 2.4.1. See attachment.
> https://issues.apache.org/jira/browse/SPARK-8560
> https://issues.apache.org/jira/browse/SPARK-10141
> https://issues.apache.org/jira/browse/SPARK-19356
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
