Hi all,
We are running spark streaming with version 1.1.1. recently we found
an odd problem.
In stage 44554, All the task finished, but the stage marked finished
long time later, as you can see the log below, the last task finished @15/05/21
21:17:36
And also the stage remove from taskset. But for about 7s later
@15/05/21 21:17:43. It is finished at DAGScheduler. So all the dependency
stages of 44554 launched after 15/05/21 21:17:43. (see image later),I know
there is a config : spark.akka.threads, the default is 4, we do not change it.
Does this config affect ?
Anyone know have any idea about this?
Drive Log：
15/05/21 21:17:36 INFO
[org.apache.spark.scheduler.TaskSetManager---task-result-getter-3]: Finished
task 180.0 in stage 44554.0 (TID 1291943) in 3512 ms on
gd6-mercury-spark-010.idc.vip.com (191/191)
15/05/21 21:17:36 INFO
[org.apache.spark.scheduler.TaskSchedulerImpl---task-result-getter-3]: Removed
TaskSet 44554.0, whose tasks have all completed, from pool default
15/05/21 21:17:43 INFO
[org.apache.spark.scheduler.DAGScheduler---sparkDriver-akka.actor.default-dispatcher-44]:
Stage 44554 (mapToPair at TraceCalculator.java:88) finished in 14.582 s
Stage image:
[cid:[email protected]]
本电子邮件可能为保密文件。如果阁下非电子邮件所指定之收件人，谨请立即通知本人。敬请阁下不要使用、保存、复印、打印、散布本电子邮件及其内容，或将其用于其他任何目的或向任何人披露。谢谢您的合作！
This communication is intended only for the addressee(s) and may contain
information that is privileged and confidential. You are hereby notified that,
if you are not an intended recipient listed above, or an authorized employee or
agent of an addressee of this communication responsible for delivering e-mail
messages to an intended recipient, any dissemination, distribution or
reproduction of this communication (including any attachments hereto) is
strictly prohibited. If you have received this communication in error, please
notify us immediately by a reply e-mail addressed to the sender and permanently
delete the original e-mail communication and any attachments from all storage
devices without making or otherwise retaining a copy.
