Re: Join with a custom predicate

2015-04-27 Thread Alexander Alexandrov
ot; to > correctly multiply, ideally as a group for streamlined multiplication. > > Johannes > > -Ursprüngliche Nachricht- > Von: Alexander Alexandrov [mailto:alexander.s.alexand...@gmail.com] > Gesendet: Sonntag, 26. April 2015 23:22 > An: dev@flink.apache.org > B

Re: Join with a custom predicate

2015-04-27 Thread Kirschnick, Johannes
April 2015 23:22 An: dev@flink.apache.org Betreff: Re: Join with a custom predicate I thought about your problem over the weekend. Unfortunately the algorithm that you describe does not fit "regular" equi-join semantics, but I think it could be "fitted" with a more complex dataflow. T

Re: Join with a custom predicate

2015-04-27 Thread Till Rohrmann
That's a good solution. In order to deal with ranges which overlap two intervals you have to create multiple "coarse-grained" join keys. One key for each interval contained in the range. Cheers, Till On Apr 26, 2015 11:22 PM, "Alexander Alexandrov" < alexander.s.alexand...@gmail.com> wrote: > I t

Re: Join with a custom predicate

2015-04-26 Thread Alexander Alexandrov
I thought about your problem over the weekend. Unfortunately the algorithm that you describe does not fit "regular" equi-join semantics, but I think it could be "fitted" with a more complex dataflow. To achieve that, I would partition the (active) domain of the two datasets on fine-granular interv

Join with a custom predicate

2015-04-24 Thread Kirschnick, Johannes
Hi I have a small problem with doing a custom join, that I would need some help with. Maybe I'm also approaching the problem wrong. So basically I have two dataset. The simplified example: The first one has a start and end value. The second dataset is just a list of ordered numbers and some value