Thanks Fabian,

Yeah, looks like overriding setupQueue() could work, I'll give it a shot.

I'm not exactly clear on what I mean by using a stateful function as a flink 
sink.  First thought was to sink aggregations from long tumbling windows (say 
minutes to hours or more), assuming the stateful functions are not really 
set-up for super high-throughput, but instead do things like generate reports 
or something.

But I'm sure this all reflects just being new to thinking in Flink.  I'll give 
it some more thought.

Thank you,

Ivan

From: Fabian Paul <fabianp...@ververica.com>
Sent: Friday, November 5, 2021 9:32 AM
To: ROSERO,IVAN (Agilent CHE) <ivan.ros...@agilent.com>
Cc: user <user@flink.apache.org>
Subject: Re: How to filter these emails?

Hi Ivan,

Please try to always cc the user mailing list otherwise others won't see your 
question :)

You are right by default the Rabbit MQ seems to not support exchanges but take 
a look at this [1]. I think you can inherit from the RMQSource class
and override the setupQueue method to bind to your specific exchange. We are 
also always open for contributions if you would like to improve it.

Unfortunately, we will not invest a lot more time into this connector because 
we are trying to migrate all connectors to the unified source interface to
support batch and streaming executions [2].

I am no real expert with stateful functions but can you maybe add some 
information about your idea?

Best,
Fabian

[1] 
https://github.com/apache/flink/blob/33aaabebc63f7a44fb64930f5daf8006ce030752/flink-connectors/flink-connector-rabbitmq/src/main/java/org/apache/flink/streaming/connectors/rabbitmq/RMQSource.java#L232<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fapache%2Fflink%2Fblob%2F33aaabebc63f7a44fb64930f5daf8006ce030752%2Fflink-connectors%2Fflink-connector-rabbitmq%2Fsrc%2Fmain%2Fjava%2Forg%2Fapache%2Fflink%2Fstreaming%2Fconnectors%2Frabbitmq%2FRMQSource.java%23L232&data=04%7C01%7Civan.rosero%40agilent.com%7C529b63e9224e431468a608d9a036b977%7Ca9c0bc098b46420693512ba12fb4a5c0%7C0%7C0%7C637716979639773513%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=PFHURxOUo5G3LpPOzuXYpuBPgIxeDsXMY5f0AC1Oz%2B4%3D&reserved=0>
[2] 
https://cwiki.apache.org/confluence/display/FLINK/FLIP-27%3A+Refactor+Source+Interface<https://nam12.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcwiki.apache.org%2Fconfluence%2Fdisplay%2FFLINK%2FFLIP-27%253A%2BRefactor%2BSource%2BInterface&data=04%7C01%7Civan.rosero%40agilent.com%7C529b63e9224e431468a608d9a036b977%7Ca9c0bc098b46420693512ba12fb4a5c0%7C0%7C0%7C637716979639783477%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdata=AGkBw24GYglyZZpL346hgqm2CX9wLrEStJxNzRme29E%3D&reserved=0>



On 5. Nov 2021, at 09:23, 
ivan.ros...@agilent.com<mailto:ivan.ros...@agilent.com> wrote:

Hi Fabian,

Indeed, yes!  Thank you.

Ok, now an actual question.  I'm using the RabbitMq connector, and works great 
with queues.  Looked around and saw no obvious way of consuming from exchanges. 
 Do you know of another rabbitmq connector that has this feature?

Also, just now learning about stateful functions.  Is there a way to sink to 
them from a flink job?

Thank you very much,

Ivan

From: Fabian Paul <fabianp...@ververica.com<mailto:fabianp...@ververica.com>>
Sent: Friday, November 5, 2021 9:19 AM
To: ROSERO,IVAN (Agilent CHE) 
<ivan.ros...@agilent.com<mailto:ivan.ros...@agilent.com>>
Cc: user@flink.apache.org<mailto:user@flink.apache.org>
Subject: Re: How to filter these emails?



External Sender - Use caution opening files, clicking links, or responding to 
requests.

Hi Ivan,

You can configure your email client to filter for messages going to 
user@flink.apache.org<mailto:user@flink.apache.org> and move them into a 
separate folder.

Best,
Fabian

Reply via email to