[ https://issues.apache.org/jira/browse/SPARK-27169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16795774#comment-16795774 ]
acupple commented on SPARK-27169: --------------------------------- I have enabled event log, on the spark UI, the job has not completed, but according to event log, the job has completed. !image-2019-03-19-15-17-25-522.png|width=872,height=48! the attachment is event log [^job_1924.log] And there is one unknown stage > number of active tasks is negative on executors page > ---------------------------------------------------- > > Key: SPARK-27169 > URL: https://issues.apache.org/jira/browse/SPARK-27169 > Project: Spark > Issue Type: Bug > Components: Web UI > Affects Versions: 2.3.2 > Reporter: acupple > Priority: Minor > Attachments: QQ20190315-102215.png, QQ20190315-102235.png, > image-2019-03-19-15-17-25-522.png, job_1924.log > > > I use spark to process some data in HDFS and HBASE, I use one thread consume > message from a queue, and then submit to a thread pool(16 fix size)for spark > processor. > But when run for some time, the active jobs will be thousands, and number of > active tasks are negative. > Actually, these jobs are already done when I check driver logs。 > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org