[
https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
acupple updated SPARK-27169:
----------------------------
Description:
I use spark to process some data in HDFS and HBASE, I use one thread consume
message from a queue, and then submit to a thread pool（16 fix size）for spark
processor.
But when run for some time, the active jobs will be thousands, and number of
active tasks are negative.
Actually, these jobs are already done when I check driver logs。
was:
I use spark to process some data in hdfs and hbase, and the concurrency is 16.
but when run some time, the active jobs will be thousands, and number of active
tasks are negative.
Actually, these jobs are already done when I check driver logs
> number of active tasks is negative on executors page
> ----------------------------------------------------
>
> Key: SPARK-27169
> URL: https://issues.apache.org/jira/browse/SPARK-27169
> Project: Spark
> Issue Type: Bug
> Components: Web UI
> Affects Versions: 2.3.2
> Reporter: acupple
> Priority: Minor
> Attachments: QQ20190315-102215.png, QQ20190315-102235.png
>
>
> I use spark to process some data in HDFS and HBASE, I use one thread consume
> message from a queue, and then submit to a thread pool（16 fix size）for spark
> processor.
> But when run for some time, the active jobs will be thousands, and number of
> active tasks are negative.
> Actually, these jobs are already done when I check driver logs。
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
