Build failed in Jenkins: beam_Release_NightlySnapshot #242

See Changes: [klk] Add JUnit category for stateful ParDo tests [klk] Reject stateful DoFn in ApexRunner [klk] Add JUnit category for stateful ParDo tests [klk] Reject stateful DoFn in SparkRunner [davor] Beam

Re: Hosting data stores for IO Transform testing

Hi Ismaël, FYI, we also test the IOs on spark and flink small clusters (not yet apex): it's where I'm using Mesos/Marathon. It's not a large cluster, but the integration tests are performed (by hand) on clusters. We already discussed with Stephan and Jason to use Marathon JSON and Mesos

Re: [DISCUSS] Graduation to a top-level project

+1 I'm excited to see the engagement of the community here. S On Tue, Nov 22, 2016 at 1:22 PM Ismaël Mejía wrote: > +1 > Excellent and congratulations everyone for the great work ! > > On Tue, Nov 22, 2016 at 10:21 PM, Sergio Fernández > wrote: > > > As

Re: Hosting data stores for IO Transform testing

Hi, I'm excited we're getting lots of discussion going. There are many threads of conversation here, we may choose to split some of them off into a different email thread. I'm also betting I missed some of the questions in this thread, so apologies ahead of time for that. Also apologies for the

Re: [DISCUSS] Graduation to a top-level project

+1 Excellent and congratulations everyone for the great work ! On Tue, Nov 22, 2016 at 10:21 PM, Sergio Fernández wrote: > As an external person who has been following the podling very closely from > the very beginning, I definetelly think you are ready for graduation :-) > >

Re: [DISCUSS] Graduation to a top-level project

As an external person who has been following the podling very closely from the very beginning, I definetelly think you are ready for graduation :-) On Nov 22, 2016 19:19, "Davor Bonaci" wrote: > Hi everyone, > With all the progress we’ve had recently in Apache Beam, I think it

Re: [DISCUSS] Graduation to a top-level project

Huge +1 On Tue, Nov 22, 2016 at 1:01 PM, Hadar Hod wrote: > +1 !!! > > On Tue, Nov 22, 2016 at 12:54 PM, Jesse Anderson > wrote: > > > +1 > > > > On Tue, Nov 22, 2016 at 12:35 PM Frances Perry > > wrote: > > > > > +1

Re: [DISCUSS] Graduation to a top-level project

+1 Some of us met recently during the Apache Con week and we had a great time discussing about the project and what can be done to better things to move forward. Great to see the progress and growth! On Tue, Nov 22, 2016 at 10:01 PM, Hadar Hod wrote: > +1 !!! > > On

Re: [DISCUSS] Graduation to a top-level project

+1 !!! On Tue, Nov 22, 2016 at 12:54 PM, Jesse Anderson wrote: > +1 > > On Tue, Nov 22, 2016 at 12:35 PM Frances Perry > wrote: > > > +1 You might even say I'm beaming with pride ;-) > > > > On Tue, Nov 22, 2016 at 11:58 AM, Kenneth Knowles

Re: [DISCUSS] Graduation to a top-level project

+1 On Tue, Nov 22, 2016 at 10:19 AM, Davor Bonaci wrote: > Hi everyone, > With all the progress we’ve had recently in Apache Beam, I think it is time > we start the discussion about graduation as a new top-level project at the > Apache Software Foundation. > > Graduation means

Re: [DISCUSS] Graduation to a top-level project

+1 On Tue, Nov 22, 2016 at 12:35 PM Frances Perry wrote: > +1 You might even say I'm beaming with pride ;-) > > On Tue, Nov 22, 2016 at 11:58 AM, Kenneth Knowles > wrote: > > > +1 !!! > > > > I especially love how the diversity of the

Re: [DISCUSS] Graduation to a top-level project

+1 You might even say I'm beaming with pride ;-) On Tue, Nov 22, 2016 at 11:58 AM, Kenneth Knowles wrote: > +1 !!! > > I especially love how the diversity of the community has contributed to the > conceptual growth and quality of Beam. I can't wait for more! > > On

Re: [DISCUSS] Graduation to a top-level project

+1 !!! I especially love how the diversity of the community has contributed to the conceptual growth and quality of Beam. I can't wait for more! On Tue, Nov 22, 2016 at 11:22 AM, Thomas Groh wrote: > +1 > > It's been a thrilling experience thus far, and I'm excited

Re: Hosting data stores for IO Transform testing

Hi Sourabh, We raised the IO versioning point couple of months ago on the mailing list. Basically, we have two options: 1. Same modules (for example sdks/java/io/kafka) with one branch per version (kafka-0.8 kafka-0.10) 2. Several modules: sdks/java/io/kafka-0.8 sdks/java/io/kafka-0.10 My

Re: Hosting data stores for IO Transform testing

Hi, One tangential question I had around the proposal was how do we currently deal with versioning in IO sources/sinks. For example Cassandra 1.2 vs 2.1 have some differences between them, so the checked in sources and sink probably supports a particular version right now. If yes, follow

Re: [DISCUSS] Graduation to a top-level project

+1 I would like to mention the welcoming, growing community and the focus on solid processes and testing. On Tue, Nov 22, 2016 at 11:07 AM, Aljoscha Krettek wrote: > +1 > > I'm quite enthusiastic about the growth of the community and the open > discussions! > > On Tue, 22

Re: [DISCUSS] Graduation to a top-level project

+1, very exciting and looking forward. -- Pei On Tue, Nov 22, 2016 at 11:07 AM, Aljoscha Krettek wrote: > +1 > > I'm quite enthusiastic about the growth of the community and the open > discussions! > > On Tue, 22 Nov 2016 at 19:51 Jason Kuster

Re: [DISCUSS] Graduation to a top-level project

+1 I'm quite enthusiastic about the growth of the community and the open discussions! On Tue, 22 Nov 2016 at 19:51 Jason Kuster wrote: > An enthusiastic +1! > > In particular it's been really great to see the commitment and interest of > the community in

Re: [DISCUSS] Graduation to a top-level project

+1, super exciting! Thanks to JB, Davor and the whole team for creating this community. I think we've achieved a lot in a short time. Amit. On Tue, Nov 22, 2016, 20:36 Tyler Akidau wrote: > +1, thanks to everyone who's invested time getting us to this point. :-) >

Re: [DISCUSS] Graduation to a top-level project

+1, thanks to everyone who's invested time getting us to this point. :-) -Tyler On Tue, Nov 22, 2016 at 10:33 AM Jean-Baptiste Onofré wrote: > Hi, > > First of all, I would like to thank the whole team, and especially Davor > for the great work and commitment to Apache and

Re: [DISCUSS] Graduation to a top-level project

Hi, First of all, I would like to thank the whole team, and especially Davor for the great work and commitment to Apache and the community. Of course, a big +1 to move forward on graduation ! Regards JB On 11/22/2016 07:19 PM, Davor Bonaci wrote: Hi everyone, With all the progress we’ve

[DISCUSS] Graduation to a top-level project

Hi everyone, With all the progress we’ve had recently in Apache Beam, I think it is time we start the discussion about graduation as a new top-level project at the Apache Software Foundation. Graduation means we are a self-sustaining and self-governing community, and ready to be a full

Re: Hosting data stores for IO Transform testing

​Hello, @Stephen Thanks for your proposal, it is really interesting, I would really like to help with this. I have never played with Kubernetes but this seems a really nice chance to do something useful with it. We (at Talend) are testing most of the IOs using simple container images and in some

Re: DoFn relying on Microservices

Hi Sergio, DoFn will execute per element (with eventually a hook on StartBundle, FinishBundle, and Teardown). It's basic the way it works in IO WriteFn: we create the connection in StartBundle and send each element (with a batch) to external resource. PTransform is maybe more flexible in