[
https://issues.apache.org/jira/browse/FLINK-25082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450370#comment-17450370
]
Fabian Paul commented on FLINK-25082:
-------------------------------------
[~Baelec] you are correct the current state is not ideal but fixing it seems
also not trivial. Currently, the source cannot determine the overall
parallelism therefore we choose the plain SourceFunction to ensure the
correctness in the case of exactly-once mechanism.
We would need to implement two different sources for the RMQ one implementing
ParallelSourceFunction and the exactly-once source should only implement
SourceFunction. One option might be to provide a build for the Source and
depending on the delivery guarantee return a different source.
Either way, would you be willing to work on this or update the documentation?
> RMQSource is not parallel
> -------------------------
>
> Key: FLINK-25082
> URL: https://issues.apache.org/jira/browse/FLINK-25082
> Project: Flink
> Issue Type: Bug
> Components: Connectors/ RabbitMQ
> Reporter: Mike Lynch
> Priority: Minor
>
> The official
> [documentation|https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/datastream/rabbitmq/]
> states that {{RMQSource}} can have at-least-once processing when "when
> checkpointing is enabled, but correlation ids are not used or the source is
> parallel." However, as {{RMQSource}} does not implement
> {{{}ParallelSourceFunction{}}}, {{StreamExecutionEnvironment}} will throw an
> exception whenever parallelism is set to a value higher than 1.
> Either the documentation should be corrected or {{RMQSource}} should
> implement {{{}ParallelSourceFunction{}}}.
> Implementing it seems like it should be fairly easy and I'd be willing to
> submit a patch, but as I'm new to the Flink code base I'm not sure if there
> would be unexpected side effects. If I can get feedback from more experienced
> contributors, I'll submit a patch in the near future.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
