Hi all, Following up on request
Thanks On Mon, 26 May 2025, 15:18 Sambhav Gupta, <sambhavwor...@gmail.com> wrote: > Hey, > > There is no error with the parallelism .I want to increase it for this > function as it is creating a bottleneck for the disk space which I am not > able to do. > > I tried using setParallelism() here but I think it doesn't comply with > flink schema and is using default parallelism instead > > Can you please help me with this? > How can I increase the parallelism of this keyBy and window combination > here. > > Thanks, > Sambhav Gupta > > On Mon, 26 May 2025, 14:21 Pedro Mázala, <pedroh.maz...@gmail.com> wrote: > >> What is the error on the parallelism you're facing? >> >> >> >> Att, >> Pedro Mázala >> Be awesome >> >> >> On Mon, 26 May 2025 at 10:13, Sambhav Gupta <sambhavwor...@gmail.com> >> wrote: >> >>> Hi Team, >>> >>> We are migrating our codebase of flink to V2.1 version. Here were using >>> dataset jobs which we need to migrate to data stream now and while doing >>> this we faced an error of parallelism of keyby and window function in our >>> full outerjoin function which is creating bottleneck for us in case of disk >>> storage and compute >>> >>> The code structure >>> >>> We have 2 inputs db2stream and kafka input on which we perform outerjoin >>> function >>> >>> Db2Stream.keyby(key selector) >>> .cogroup(kafka input) >>> .where(key) >>> .equalto(key) >>> .window(endOfStreamWindow.get) >>> .apply(<join function>) >>> >>> >>> Can you please help me with increasing Parallelism of this function in >>> anyway so that we can remove our bottleneck while migrating it from dataset >>> to datastream >>> >>> Thanks, >>> Sambhav Gupta >>> >>> >>> >>>
