Ray Qiu created SPARK-19977:
-------------------------------
Summary: Scheduler Delay (in UI Advanced Metrics) for a task
gradually increases from 5 ms to 30 seconds in Spatk Streaming application
Key: SPARK-19977
URL: https://issues.apache.org/jira/browse/SPARK-19977
Project: Spark
Issue Type: Bug
Components: Scheduler
Affects Versions: 2.1.0
Reporter: Ray Qiu
Scheduler Delay (in UI Advanced Metrics) for a task gradually increases from 5
ms to 30+ seconds in a Spark Streaming application, where multiple Kafka direct
streams are processed. These kafka streams are processed separately (not
combined via union).
It causes the task processing time to increase greatly and eventually stops
working.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
