[
https://issues.apache.org/jira/browse/FLINK-9175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16449172#comment-16449172
]
godfrey johnson commented on FLINK-9175:
----------------------------------------
[~kkl0u] [~sihuazhou][^CEPCal.java]
The input data:
{code:java}
// code placeholder
{code}
DataStream<TrackingEvent> input = env.fromElements( new
TrackingEvent("request_1", "item_1", TrackingType.IMPRESSION, "2018-01-19
10:00:02"), new TrackingEvent("request_1", "item_1", TrackingType.CLICK,
"2018-01-19 10:00:40"), new TrackingEvent("request_1", "item_2",
TrackingType.IMPRESSION, "2018-01-19 10:00:50"), new TrackingEvent("request_1",
"item_3", TrackingType.IMPRESSION, "2018-01-19 10:00:55"), new
TrackingEvent("request_1", "item_1", TrackingType.CLICK, "2018-01-19
10:00:56"), new TrackingEvent("request_1", "item_1", TrackingType.CLICK,
"2018-01-19 10:01:20"), new TrackingEvent("request_1", "item_3",
TrackingType.CLICK, "2018-01-19 10:02:10"), new TrackingEvent("request_2",
"item_1", TrackingType.IMPRESSION, "2018-01-19 10:01:10"), new
TrackingEvent("request_2", "item_2", TrackingType.IMPRESSION, "2018-01-19
10:02:00"), new TrackingEvent("request_2", "item_2", TrackingType.CLICK,
"2018-01-19 10:02:10"), new TrackingEvent("request_2", "item_3",
TrackingType.IMPRESSION, "2018-01-19 10:03:10"), new TrackingEvent("request_2",
"item_3", TrackingType.CLICK, "2018-01-19 10:03:20"), new
TrackingEvent("request_3", "item_2", TrackingType.IMPRESSION, "2018-01-19
10:05:30"), new TrackingEvent("request_3", "item_2", TrackingType.CLICK,
"2018-01-19 10:06:10"), new TrackingEvent("request_3", "item_3",
TrackingType.CLICK, "2018-01-19 10:06:15"), new TrackingEvent("request_2",
"item_1", TrackingType.CLICK, "2018-01-19 10:10:20") )...
> Flink CEP with Checkpointing alway failed
> -----------------------------------------
>
> Key: FLINK-9175
> URL: https://issues.apache.org/jira/browse/FLINK-9175
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
> Affects Versions: 1.4.1
> Environment: * Checkpoint Interval: 1min
> * Checkpoint Timeout: 2min
> * Checkpoint Pause: 5s
> * Checkpoint Concurrent: 1
> * Checkpoint Mode: EXACTLY_ONCE
> * AllowedLateness: 100s
> * CEP within time: 30s
> * Kafka QPS：10,000
> * Source Parallelism: 16
>
> Reporter: godfrey johnson
> Priority: Critical
> Attachments: CEPCal.java, checkpoint failed.png, dataStream.png
>
>
> I used RocksDBStateBackend to checkpoint for my job, and it always failed for
> timeout. But when I closed CEP, only keeped the source operator, which was
> working fine. And FsStateBackend was also finished checkpoint quickly without
> timeout.
> !dataStream.png!
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
