[
https://issues.apache.org/jira/browse/SPARK-20692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhiwen Sun updated SPARK-20692:
-------------------------------
Description:
Spark streaming job with 1s interval.
Process time of micro batch suddenly became to 4s while is is usually 0.4s .
When we check where the time spent, we find a unknown delay in job.
There is no executor computing or shuffle reading. It is about 4s blank in
event timeline,
event timeline snapshot is in attachment.
was:
Spark streaming job with 1s interval.
Process time of micro batch suddenly became to 4s while is is usually 0.4s .
when we check where time spent, we find a unknown delay in job. there is no
executor computing or shuffle reading. About 4s blank in event timeline,
event timeline snapshot is in attachment.
> unknowing delay in event timeline
> ---------------------------------
>
> Key: SPARK-20692
> URL: https://issues.apache.org/jira/browse/SPARK-20692
> Project: Spark
> Issue Type: Bug
> Components: DStreams
> Affects Versions: 1.6.2
> Environment: Spark 1.6.1 + kafka 0.8.2
> Reporter: Zhiwen Sun
> Attachments: screenshot-1.png
>
>
> Spark streaming job with 1s interval.
> Process time of micro batch suddenly became to 4s while is is usually 0.4s .
> When we check where the time spent, we find a unknown delay in job.
> There is no executor computing or shuffle reading. It is about 4s blank in
> event timeline,
> event timeline snapshot is in attachment.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
