Hi Caizhi:
Thanks for your reply.
I need to aggregate streams based on dynamic groupings. All the groupings
(keyBy) are not known upfront and can be added or removed after the streaming
application is started and I don't want to restart the application/change the
code. So, I wanted to find out, what are the options to achieve this
functionality. Please let me know if you have any advice or recommendations.
Thanks
On Monday, January 24, 2022, 04:28:32 AM EST, Caizhi Weng
<[email protected]> wrote:
Hi!
Adding/removing keyed streams will change the topology graph of the job.
Currently it is not possible to do so without restarting the job and as far as
I know there is no existing framework/pattern to achieve this.
By the way, why do you need this functionality? Could you elaborate more on
your use case?
M Singh <[email protected]> 于2022年1月22日周六 21:32写道：
Hi Folks:
I am working on an exploratory project in which I would like to add/remove
KeyedStreams
(https://nightlies.apache.org/flink/flink-docs-master/docs/dev/datastream/operators/overview/#keyby)
without restarting the Flink streaming application.
Is it possible natively in Apache Flink ? If not, is there any
framework/pattern which can be used to implement this without restarting the
application/changing the code ?
Thanks
