Re: [VOTE] Release 2.7.0, release candidate #3

2018-09-25 Thread Charles Chen
To clarify, the only difference between RC2 and RC3 is the Python fix https://github.com/apache/beam/pull/6494. This means that the Java validations from RC2 should carry over, though I reran validations with RC3 anyway, as detailed on the spreadsheet. On Wed, Sep 26, 2018 at 12:41 AM Charles Che

Re: [VOTE] Release 2.7.0, release candidate #3

2018-09-25 Thread Charles Chen
As with before, please add any validation performed to the spreadsheet here: https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=1675964688 On Wed, Sep 26, 2018 at 12:30 AM Charles Chen wrote: > Hi everyone, > > Please review and vote on the release candi

Re: Bug of the MqttIO.java

2018-09-25 Thread flyisland
Cool, I'd like to. Is there anything I should've done first, like create an account etc. On Tue, Sep 25, 2018 at 11:46 PM Lukasz Cwik wrote: > Thanks, I filed https://issues.apache.org/jira/browse/BEAM-5496 with the > details of your report. > > Would you be interested in submitting a patch wit

[VOTE] Release 2.7.0, release candidate #3

2018-09-25 Thread Charles Chen
Hi everyone, Please review and vote on the release candidate #3 for the version 2.7.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1], *

Re: [VOTE] Release 2.7.0, release candidate #2

2018-09-25 Thread Charles Chen
I have merged https://github.com/apache/beam/pull/6494 and https://github.com/apache/beam/pull/6495 which revert the offending commit in master and release-2.7.0, respectively. I am building 2.7.0 RC3 which will be out shortly. On Tue, Sep 25, 2018 at 9:52 PM Charles Chen wrote: > Unfortunately

Re: [VOTE] Release 2.7.0, release candidate #2

2018-09-25 Thread Charles Chen
Unfortunately, I have to -1 this RC. There is a problem with the Python release validation. Specifically, wordcount on the local DirectRunner fails with: *21:02:11* ERROR:root:Exception in _rename_batch. src: /tmp/tmp.PqwH113fm4/beam-temp-wordcount_direct.txt-cb5837b8c12711e8981742010a800020/5d1

Re: [VOTE] Release 2.7.0, release candidate #2

2018-09-25 Thread Charles Chen
Hi all, please add any validation performed to the spreadsheet here: https://docs.google.com/spreadsheets/d/1qk-N5vjXvbcEk68GjbkSZTR8AGqyNUM-oLFo_ZXBpJw/edit#gid=1675964688 On Tue, Sep 25, 2018 at 12:11 PM Romain Manni-Bucau wrote: > +1 tested spark local and a 1 node cluster, direct runner and

Re: Installing jars to local maven repo

2018-09-25 Thread Nithin Sujir
After reading the code, if ((isRelease(project) || project.hasProperty('publishing')) && configuration.publish) { project.apply plugin: "maven-publish" I realized that it's including the same plugin conditionally and I just needed to set the flag to what I was doing earlier.

Re: Installing jars to local maven repo

2018-09-25 Thread Nithin Sujir
Thanks for the info about publish. It is installing the jars, however I am hitting issue with the name. Every time I publish, it increments the version number which I think is preventing my maven project from discovering the jars. I would like the jar file to be -2.8.0-SNAPSHOT.jar for e.g. T

Re: Beam python sdk with gevent

2018-09-25 Thread Ahmet Altay
Thank you Rakesh! Let us know how it goes if you get a chance to try multiprocess. On Tue, Sep 25, 2018 at 9:19 AM, Rakesh Kumar wrote: > Hi Ahmet, > > I filed the jira ticket https://issues.apache.org/jira/browse/BEAM-5497. > Let me know if you need anything else from us. > > Thank you, > Rakes

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-25 Thread Kenneth Knowles
Thanks all for the encouragement & thanks Davor for years of service and mentoring. Looking forward to serving the project & community! Kenn On Fri, Sep 21, 2018 at 12:01 AM Matthias Baetens wrote: > Thank you for all the mentoring and work for the Apache Beam project, > Davor. > > Welcome as a

Re: Installing jars to local maven repo

2018-09-25 Thread Thomas Weise
Publish to a custom repo is already supported. Please see: https://lists.apache.org/thread.html/fdc82e7399fa63f3ffe21458830cd05c84c08c61d44ff94859618d31@%3Cdev.beam.apache.org%3E On Tue, Sep 25, 2018 at 10:21 AM Jean-Baptiste Onofré wrote: > Hi > > We already have publish profile in our Gradle

Re: Installing jars to local maven repo

2018-09-25 Thread Jean-Baptiste Onofré
Hi We already have publish profile in our Gradle build. Did you try with this ? Regards JB Le 25 sept. 2018 à 13:19, à 13:19, Nithin Sujir a écrit: >Hi Beam devs, >We have a couple of maven projects (teleport and performance test >utilties) >that depend on beam. We are also working to improve t

Installing jars to local maven repo

2018-09-25 Thread Nithin Sujir
Hi Beam devs, We have a couple of maven projects (teleport and performance test utilties) that depend on beam. We are also working to improve the spanner io connector performance in beam. Today, it's quite painful to make local beam changes and then use it in our performance tests due to the maven

Re: Beam python sdk with gevent

2018-09-25 Thread Rakesh Kumar
Hi Ahmet, I filed the jira ticket https://issues.apache.org/jira/browse/BEAM-5497. Let me know if you need anything else from us. Thank you, Rakesh On Mon, Sep 24, 2018 at 5:08 PM Ahmet Altay wrote: > On Sun, Sep 23, 2018 at 9:21 PM, Rakesh Kumar > wrote: > >> Thanks Ahmet for providing a ref

Re: [VOTE] Release 2.7.0, release candidate #2

2018-09-25 Thread Romain Manni-Bucau
+1 tested spark local and a 1 node cluster, direct runner and java test tools Le mar. 25 sept. 2018 13:08, Łukasz Gajowy a écrit : > +1 > > I ran the Java - Quickstart on core runners (local) and Dataflow > Quickstarts (on Dataflow instance) either way. Looks good. I wanted to > learn how easy i

Re: Bug of the MqttIO.java

2018-09-25 Thread Lukasz Cwik
Thanks, I filed https://issues.apache.org/jira/browse/BEAM-5496 with the details of your report. Would you be interested in submitting a patch with a test that exercises the bug? On Tue, Sep 25, 2018 at 1:21 AM flyisland wrote: > Hi > > There is a bug of the built-in MqttIO, please check the <

Re: Beam dashboards

2018-09-25 Thread Łukasz Gajowy
Nice! The Grafana dashboards look great! Side question: do you think Grafana can be used to present results stored in BigQuery? Maybe in the future, we could use Grafana to show every testing dashboards (IO tests, nexmark, currently developed load tests) with this tool leveraging its more advanced

Re: [VOTE] Release 2.7.0, release candidate #2

2018-09-25 Thread Łukasz Gajowy
+1 I ran the Java - Quickstart on core runners (local) and Dataflow Quickstarts (on Dataflow instance) either way. Looks good. I wanted to learn how easy it is - kudos to the author of the script! :) wt., 25 wrz 2018 o 12:39 Robert Bradshaw napisał(a): > +1 (binding) > > I verified all the sign

Re: [VOTE] Release 2.7.0, release candidate #2

2018-09-25 Thread Robert Bradshaw
+1 (binding) I verified all the signatures and hashes, as well as one of the Python wheels, and that we're not shipping gradle[w] but otherwise the content matches the git repo (except a SNAPSHOT vs version change to the source). The changes [1] look minimal compared to RC1, so most of the verifi

Jenkins build is back to normal : beam_SeedJob_Standalone #1660

2018-09-25 Thread Apache Jenkins Server
See

Bug of the MqttIO.java

2018-09-25 Thread flyisland
Hi There is a bug of the built-in MqttIO, please check the < https://github.com/apache/beam/blob/master/sdks/java/io/mqtt/src/main/java/org/apache/beam/sdk/io/mqtt/MqttIO.java#L336>, this readObject() method forget to invoke the "stream.defaultReadObject()" method. // set an empty list to message