Improvements to issue/version tracking

2016-06-27 Thread Davor Bonaci
Hi everyone, I'd like to propose a simple change in Beam JIRA that will hopefully improve our issue and version tracking -- to actually use the "Fix Versions" field as intended [1]. The goal would be to simplify issue tracking, streamline generation of release notes, add a view of outstanding

Re: Beam Talks at Flink Forward

2016-06-27 Thread Jean-Baptiste Onofré
Hi Tyler, thanks for the news ! I will submit something ;) Regards JB On 06/27/2016 08:22 PM, Tyler Akidau wrote: Hello Beamers, Flink Forward, the Apache Flink conference organized by data Artisans, is happening again this year in Berlin, September 12-14. If you have a Beam-related talk

Beam Talks at Flink Forward

2016-06-27 Thread Tyler Akidau
Hello Beamers, Flink Forward, the Apache Flink conference organized by data Artisans, is happening again this year in Berlin, September 12-14. If you have a Beam-related talk you'd like to give there, please submit a proposal at http://flink-forward.org/submit-your-talk/ in the next day or two.

Re: [DISCUSS] Beam data plane serialization tech

2016-06-27 Thread Aljoscha Krettek
Thanks Kenn for expanding on your previous mail. I now have a better idea of why we need this. Out of the systems you suggested Thrift and ProtoBuf3 + gRPC are probably best suited for the task. Both of these provide a way for generating serializers as well as for specifying an RPC interface.

Re: Sliding-Windowed PCollectionView as SideInput

2016-06-27 Thread Shen Li
Hi Aljoscha, Thanks for the explanation. Shen On Mon, Jun 27, 2016 at 4:38 AM, Aljoscha Krettek wrote: > Hi, > the WindowFn is responsible for mapping from main-input window to > side-input window. Have a look at WindowFn.getSideInputWindow(). For > SlidingWindows this

Re: Sliding-Windowed PCollectionView as SideInput

2016-06-27 Thread Aljoscha Krettek
Hi, the WindowFn is responsible for mapping from main-input window to side-input window. Have a look at WindowFn.getSideInputWindow(). For SlidingWindows this takes the last possible sliding window as the side-input window. Cheers, Aljoscha On Sun, 26 Jun 2016 at 22:30 Shen Li

Re: Scala DSL

2016-06-27 Thread Ismaël Mejía
Just to summarize, at this point: - Everybody agrees about the fact that scio is not an SDK. - Almost everybody agrees that given the current choice they would prefer ‘dsls/scio’ - Some of us are not particularly married with the DSL classification. I have a proposition to make, we can define