[
https://issues.apache.org/jira/browse/SPARK-18116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
liujianhui updated SPARK-18116:
-------------------------------
Description:
run a streaming application which souce from kafka.There are many batchs queued
in the job list before application stopped, and then stop the application, as
follow starting it from checkpointed file, in the spark ui, the size of the
queued batchs which stored in the checkpoint file are 0
Batch Time Input Size Scheduling Delay (?) Processing Time (?)
Total Delay (?) Output Ops: Succeeded/Total
2016/10/26 19:02:15 0 events 1.1 h 13 s 1.1 h
was:
There are many batchs queued in the job list before application stopped, and
then stop the application, as follow starting it from checkpointed file, in the
spark ui, the size of the queued batchs which stored in the checkpoint file are 0
Batch Time Input Size Scheduling Delay (?) Processing Time (?)
Total Delay (?) Output Ops: Succeeded/Total
2016/10/26 19:02:15 0 events 1.1 h 13 s 1.1 h
> spark streaming ui show 0 events when recovering from checkpoint
> ----------------------------------------------------------------
>
> Key: SPARK-18116
> URL: https://issues.apache.org/jira/browse/SPARK-18116
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.6.1
> Environment: jdk1.8.0_77 Red Hat 4.4.7-11
> Reporter: liujianhui
> Priority: Minor
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> run a streaming application which souce from kafka.There are many batchs
> queued in the job list before application stopped, and then stop the
> application, as follow starting it from checkpointed file, in the spark ui,
> the size of the queued batchs which stored in the checkpoint file are 0
> Batch Time Input Size Scheduling Delay (?) Processing Time (?)
> Total Delay (?) Output Ops: Succeeded/Total
> 2016/10/26 19:02:15 0 events 1.1 h 13 s 1.1 h
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
