Re: [PROPOSAL] Pipeline Runner API design doc

Hi, Yes, there are a few things "TODO" including aggregators and triggers. Triggers can either be an inline syntax tree or flattened and using "pointers" like the transforms and PCollections. With coders we've hit issues with the nesting and repetition that leads us to keep them flattened.

Re: [PROPOSAL] Pipeline Runner API design doc

Hi, thanks for putting this together. Now that I'm seeing them side by side I think the Avro schema looks a lot nicer than the JSON schema but it's probably alright since we don't want to change this often (as you already said). The advantage of JSON is that the (intermediate) plans can easily be

Podling Report Reminder - August 2016

Dear podling, This email was sent by an automated system on behalf of the Apache Incubator PMC. It is an initial reminder to give you plenty of time to prepare your quarterly board report. The board meeting is scheduled for Wed, 17 August 2016, 10:30 am PDT. The report for your podling will form

Re: [PROPOSAL] IRC or slack channel for Apache Beam

Invite sent! Ideally we'd be able to let people self-join Slack. Still in the process of setting that up (eta 1-2 weeks). On Tue, Aug 2, 2016 at 1:22 PM, P. Taylor Goetz wrote: > Can I get an invite to the slack channel? I’m in the early stages of > implementing a Beam

Re: [PROPOSAL] IRC or slack channel for Apache Beam

Can I get an invite to the slack channel? I’m in the early stages of implementing a Beam runner for Apache Storm and have some (probably stupid ;) ) questions. Also, would it make sense to document the process on the Beam website so new users/devs can find out about it and how to join?

Re: [MENTOR] August 2016 Podling report on Wiki

Thanks ! Reviewed and signed off. Regards JB On 08/02/2016 05:33 PM, James Malone wrote: Hello Beam mentors! The Beam podling report for August 2016 is now on the Apache Wiki and ready for your review, comments, and sign off: https://wiki.apache.org/incubator/August2016 Best, James --

Re: Proposal: Dynamic PIpelineOptions

Being able to "late-bind" parameters like input paths to a pre-constructed program would be a very useful feature, and I think is worth adding to Beam. Of the four API proposals, I have a strong preference for (4). Further, it seems that these need not be bound to the PipelineOptions object

[MENTOR] August 2016 Podling report on Wiki

Hello Beam mentors! The Beam podling report for August 2016 is now on the Apache Wiki and ready for your review, comments, and sign off: https://wiki.apache.org/incubator/August2016 Best, James

Re: [REFLECT] Beam’s Half Birthday!

Hello, Nice reminder of the work done, I feel quite proud of what this community has accomplished in this short time (and of course of been a recent member of it). One missing statistic that it is probably hard to measure is how some Beam ideas have helped to improve other Apache projects. I