[ 
https://issues.apache.org/jira/browse/FLINK-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14734489#comment-14734489
 ] 

Stephan Ewen commented on FLINK-2624:
-------------------------------------

I think in that case, we should treat this as a non-parallel source. The 
distribution will be arbitrary and hence most likely different on a recovery 
run, compared to the original run.

That means different sources see the messages during recovery, and could not 
filter duplicates.

We could think later make this a parallel source, with the  heap of a 
write-ahead log, or so.



> RabbitMQ source / sink should participate in checkpointing
> ----------------------------------------------------------
>
>                 Key: FLINK-2624
>                 URL: https://issues.apache.org/jira/browse/FLINK-2624
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming Connectors
>    Affects Versions: 0.10
>            Reporter: Stephan Ewen
>            Assignee: Hilmi Yildirim
>
> The RabbitMQ connector does not offer any fault tolerance guarantees right 
> now, because it does not participate in the checkpointing.
> We should integrate it in a similar was as the {{FlinkKafkaConsumer}} is 
> integrated.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to