Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thanks, I'm testing it as well. Regards JB On 15/06/2018 10:25, Charles Chen wrote: > Thank you and sorry for the delay.  Been testing the fix the past few > hours.  This CP PR fixes the > issue: https://github.com/apache/beam/pull/5658. > > On Thu, Jun 14, 2018 at 10:25 PM Jean-Baptiste Onofré

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thank you and sorry for the delay. Been testing the fix the past few hours. This CP PR fixes the issue: https://github.com/apache/beam/pull/5658 . On Thu, Jun 14, 2018 at 10:25 PM Jean-Baptiste Onofré wrote: > OK, I started the RC2, but I'm stopping the process to cut a new one. > > Is it ok

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

OK, I started the RC2, but I'm stopping the process to cut a new one. Is it ok from your side ? Regards JB On 15/06/2018 01:54, Charles Chen wrote: > Looks like there is something wrong with PR 5636 >  which we cherry-picked > above.  It breaks

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Looks like there is something wrong with PR 5636 which we cherry-picked above. It breaks leaderboard examples which previously passed. I've reopened the issue and will update this thread shortly. On Thu, Jun 14, 2018 at 12:55 PM Jean-Baptiste Onofré

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Sure, just in time ;) Regards JB On 14/06/2018 20:58, Charles Chen wrote: > Can you also merge the CP https://github.com/apache/beam/pull/5636 for > https://issues.apache.org/jira/browse/BEAM-4549? > > On Thu, Jun 14, 2018 at 6:52 AM Jean-Baptiste Onofré > wrote: > >

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Can you also merge the CP https://github.com/apache/beam/pull/5636 for https://issues.apache.org/jira/browse/BEAM-4549? On Thu, Jun 14, 2018 at 6:52 AM Jean-Baptiste Onofré wrote: > FYI, I'm starting RC2 right now. > > Stay tuned ! > > Regards > JB > > On 06/06/2018 10:44, Jean-Baptiste Onofré

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

FYI, I'm starting RC2 right now. Stay tuned ! Regards JB On 06/06/2018 10:44, Jean-Baptiste Onofré wrote: > Hi everyone, > > Please review and vote on the release candidate #1 for the version > 2.5.0, as follows: > > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Hello all, I've found another release blocker: The current findbugs dependency in build_rules.gradle has a GPL license. Here's the PR to depend on the correct findbugs: https://github.com/apache/beam/pull/5609 Best -P. On Tue, Jun 12, 2018 at 11:03 AM Udi Meiri wrote: > Cherrypick created:

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Cherrypick created: https://github.com/apache/beam/pull/5607 Tests still running. On Tue, Jun 12, 2018 at 9:59 AM Udi Meiri wrote: > -1: Would like to cherry pick a fix for > https://issues.apache.org/jira/browse/BEAM-4536 > > On Tue, Jun 12, 2018 at 9:48 AM Jean-Baptiste Onofré > wrote: > >>

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

-1: Would like to cherry pick a fix for https://issues.apache.org/jira/browse/BEAM-4536 On Tue, Jun 12, 2018 at 9:48 AM Jean-Baptiste Onofré wrote: > Any update about your vote and fix ? > > Thanks ! > Regards > JB > > On 12/06/2018 04:02, Udi Meiri wrote: > > Another bug: reading from PubSub

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Any update about your vote and fix ? Thanks ! Regards JB On 12/06/2018 04:02, Udi Meiri wrote: > Another bug: reading from PubSub with_attributes=True is broken on > Python with Dataflow. > https://issues.apache.org/jira/browse/BEAM-4536 > > JB, I'm making a PR that removes this keyword and I'd

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Hi Udi, are you voting -1 ? It would be great if you can cast your vote (-1): I will cancel RC1 based on your vote. Thanks, Regards JB On 12/06/2018 04:02, Udi Meiri wrote: > Another bug: reading from PubSub with_attributes=True is broken on > Python with Dataflow. >

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thank you JB. For the wheel artifacts, Boyuan was trying to get the instructions from Robert and reproduce the artifacts. She can help you with this if you need. Ahmet On Mon, Jun 11, 2018 at 10:29 PM, Jean-Baptiste Onofré wrote: > Hi, > > sorry, I missed wheel artifact. Something to add on

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Hi, sorry, I missed wheel artifact. Something to add on the release guide ;) I will add it this morning, I think I know how to generate it ;) Regards JB On 12/06/2018 02:45, Pablo Estrada wrote: > Thanks everyone who has pitched in to validate the release! > > Boyuan Zhang and I have also run

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Hi, no problem, I can cut RC2 as soon as the cherry pick is done. Thanks for catching up ! Please let me know when the cherry pick is done, or you can do the PR and I will do it, up to you. Regards JB On 12/06/2018 04:02, Udi Meiri wrote: > Another bug: reading from PubSub

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Another bug: reading from PubSub with_attributes=True is broken on Python with Dataflow. https://issues.apache.org/jira/browse/BEAM-4536 JB, I'm making a PR that removes this keyword and I'd like to propose it as a cherrypick to 2.5.0. (feature should be fixed in the next release) On Mon, Jun

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

FYI: looks like Python tests are failing for Windows. JIRA is https://issues.apache.org/jira/browse/BEAM-4535. I don't think this is a release blocker but this should probably go in release notes (for any user that tries to run tests on Python source build). And we should try to incorporate a fix

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thanks everyone who has pitched in to validate the release! Boyuan Zhang and I have also run a few pipelines, and verified that they work properly (see release validation spreadsheet[1]). We have also found that the Game Stats pipeline is failing in Python Streaming Dataflow. I have filed

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

+1 (non-binding) tested some of the quickstarts On Sun, Jun 10, 2018 at 1:39 AM Tim wrote: > Tested by our team: > - mvn inclusion > - Avro, ES, Hadoop IF IO > - Pipelines run on Spark (Cloudera 5.12.0 YARN cluster) > - Reviewed release notes > > +1 > > Thanks also to everyone who helped get

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Tested by our team: - mvn inclusion - Avro, ES, Hadoop IF IO - Pipelines run on Spark (Cloudera 5.12.0 YARN cluster) - Reviewed release notes +1 Thanks also to everyone who helped get over the gradle hurdle and in particular to JB. Tim > On 9 Jun 2018, at 05:56, Jean-Baptiste Onofré wrote:

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

No problem Pablo. The vote period is a minimum, it can be extended as requested or if we don't have the minimum of 3 binding votes. Regards JB On 09/06/2018 01:54, Pablo Estrada wrote: > Hello all, > I'd like to request an extension of the voting period until Monday > evening (US time, so later

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Hello all, I'd like to request an extension of the voting period until Monday evening (US time, so later in other geographical regions). This is because we were only now able to publish Dataflow Workers, and have not had the chance to run release validation tests on them. The extension will allow

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thank you JB for your work! I tested running simple streaming (KafkaIO) and batch (TextIO / HDFS) pipelines with SparkRunner on YARN cluster - it works fine. WBR, Alexey > On 8 Jun 2018, at 10:00, Etienne Chauchot wrote: > > I forgot to vote: > +1 (non binding). > What I tested: > - no

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

I forgot to vote:+1 (non binding). What I tested: - no functional or performance regression comparing to v2.4- dependencies in the poms are ok EtienneLe vendredi 08 juin 2018 à 08:27 +0200, Romain Manni-Bucau a écrit : > +1 (non-binding), mainstream usage is not broken by the pom changes and >

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

+1 (non-binding), mainstream usage is not broken by the pom changes and runtime has no known regression compared to the 2.4.0 (side note: kudo to JB for this build tool change release, I know how it can hurt ;)) Romain Manni-Bucau @rmannibucau | Blog

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thanks for the details Etienne ! The good news is that the artifacts seem OK and the overall Nexmark results are consistent with the 2.4.0 release ones. I'm starting a complete review using the beam-samples as well. Regards JB On 07/06/2018 16:14, Etienne Chauchot wrote: > Hi, > I've just run

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Hi,I've just run the nexmark queries on v2.5.0-RC1 tagWhat we can notice: - query 3 (exercises CoGroupByKey, state and timer) shows different output with DR between batch and streaming and with the other runners => I compared with v2.4 there were still these differences but with different output

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

I have added the 2.5.0 tab to the validation spreadsheet[1], please mark down which things you intend to validate for the release and update the community on progress. 1: https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=152451807 On Wed, Jun 6, 2018 at

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Agreed ! It's not ready being the first to try something. Thank you so much for helping blaze the way! Reuven On Wed, Jun 6, 2018, 11:50 AM Etienne Chauchot wrote: > Thanks JB for all your work ! I believe doing the first gradle release > must have been hard. > I'll run Nexmark on the release

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

I updated dist.apache.org dev with Python distribution. Regards JB On 06/06/2018 18:19, Jean-Baptiste Onofré wrote: > Hi Robert, > > sorry, I missed this step, let me add on dist.apache.org. > > Thanks for the catch and sorry about that ! > > Regards > JB > > On 06/06/2018 18:06, Robert

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Hi Robert, sorry, I missed this step, let me add on dist.apache.org. Thanks for the catch and sorry about that ! Regards JB On 06/06/2018 18:06, Robert Bradshaw wrote: > Thank you JB! Glad to see this finally rolling out. I don't see the > Python artifacts, did you mean to stage them > in 

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thank you JB! Glad to see this finally rolling out. I don't see the Python artifacts, did you mean to stage them in https://dist.apache.org/repos/dist/dev/beam/2.5.0/? If you want help building wheels, let me know. On Wed, Jun 6, 2018 at 1:50 AM Etienne Chauchot wrote: > Thanks JB for all

Re: [VOTE] Apache Beam, version 2.5.0, release candidate #1

Thanks JB for all your work ! I believe doing the first gradle release must have been hard. I'll run Nexmark on the release and keep you posted. Best Etienne Le mercredi 06 juin 2018 à 10:44 +0200, Jean-Baptiste Onofré a écrit : > Hi everyone, > > Please review and vote on the release