Re: Re: Question on stream joins

2020-05-29 Thread Yun Gao
May 29 14:39:31 2020 Recipients:Yun Gao CC:User-Flink Subject:Re: Question on stream joins Thanks Yun. Was thinking a similar way. I had one more question. leftSource.connect(rightSource) .process(new TagCoprocessFunction()) // In this function, tag the left source with "0&quo

Re: Question on stream joins

2020-05-29 Thread Sudan S
rectly, and > in join function, the framework will iterate the elements for you and you > can only specify the logic for each (left, right) pair. > > Best, > Yun > > --Original Mail ------ > *Sender:*Sudan S > *Send Date:*Fri May 29 01:40:59

Re: Question on stream joins

2020-05-28 Thread Yun Gao
Hi Sudan, As far as I know, both join and cogroup requires keys (namely partitioning), thus for the non-keyed scenario, you may have to use low-level connect operator to achieve it. In my opinion it should be something like leftSource.connect(rightSource) .process(new TagCoprocessFu

Question on stream joins

2020-05-28 Thread Sudan S
Hi , I have two usecases 1. I have two streams which `leftSource` and `rightSource` which i want to join without partitioning over a window and find the difference of count of elements of leftSource and rightSource and emit the result of difference. Which is the appropriate join function ican use