Are you using checkpointing/WAL etc? If yes, then it could be blocking on
disk IO.
Thanks
Best Regards
On Mon, May 11, 2015 at 10:33 PM, Seyed Majid Zahedi zah...@cs.duke.edu
wrote:
Hi,
I'm running TwitterPopularTags.scala on a single node.
Everything works fine for a while (about 30min),
Hi,
I'm running TwitterPopularTags.scala on a single node.
Everything works fine for a while (about 30min),
but after a while I see a long processing delay for tasks, and it keeps
increasing.
Has anyone experienced the same issue?
Here is my configurations:
spark.driver.memory
