Re: Full stream-stream join semantics

2019-11-23 Thread Kenneth Knowles
I don't actually see how event time sorting simplifies this case much. You still need to buffer elements until they can no longer be matched in the join, and you still need to query that buffer for elements that might match. The general "bi-temporal join" (without sorting) requires one new state ty

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

2019-11-23 Thread Kenneth Knowles
David - if you can reconfigure the form so it is not anonymous (at least to me) then I may be up for including those results in the tally. I don't want to penalize those who voted via the form. But since there are now two voting channels we have to dedupe or discard the form results. And I need to

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

2019-11-23 Thread Kenneth Knowles
On Fri, Nov 22, 2019 at 10:24 AM Robert Bradshaw wrote: > On Thu, Nov 21, 2019 at 7:05 PM David Cavazos wrote: > >> >> >> I created this Google Form >> >> if everyone is okay with it

Re: Portable runner bundle scheduling (Streaming/Python/Flink)

2019-11-23 Thread Thomas Weise
JIRA: https://issues.apache.org/jira/browse/BEAM-8816 On Thu, Nov 21, 2019 at 10:44 AM Thomas Weise wrote: > Hi Luke, > > Thanks for the background and it is exciting to see the progress on the > SDF side. It will help with this use case and many other challenges. I > imagine the Python user co

Re: [Portability] Turn off artifact staging?

2019-11-23 Thread Thomas Weise
JIRA: https://issues.apache.org/jira/browse/BEAM-8815 On Fri, Nov 22, 2019 at 5:31 PM Thomas Weise wrote: > I'm running into the issue Kyle points out when I try to run a pipeline > that does not use artifact staging: > > 2019-11-23 01:09:18,442 WARN > org.apache.beam.runners.fnexecution.artif

Re: [ANNOUNCE] New committer: Daniel Oliveira

2019-11-23 Thread jincheng sun
Congrats, Daniel! Best, Jincheng Alexey Romanenko 于2019年11月22日周五 下午5:47写道: > Congratulations, Daniel! > > On 22 Nov 2019, at 09:18, Jan Lukavský wrote: > > Congrats Daniel! > On 11/21/19 10:11 AM, Gleb Kanterov wrote: > > Congratulations! > > On Thu, Nov 21, 2019 at 6:24 AM Thomas Weise wrote: