Re: [ANNOUNCE] New Committer: Kamil Wasilewski

Congrats, Kamil! On Fri, Feb 28, 2020 at 12:23 PM Ismaël Mejía wrote: > Congratulations Kamil! > > On Fri, Feb 28, 2020 at 7:09 PM Yichi Zhang wrote: > >> Congrats, Kamil! >> >> On Fri, Feb 28, 2020 at 9:53 AM Valentyn Tymofieiev >> wrote: >> >>> Congratulations, Kamil! >>> >>> On Fri, Feb

Re: Jenkins jobs not running for my PR 10438

done On Mon, Jan 13, 2020 at 8:03 AM Tomo Suzuki wrote: > Thanks Yifan (but Java Precommit is still missing). > Can somebody run "Run Java PreCommit" on > https://github.com/apache/beam/pull/10554? > > > On Mon, Jan 13, 2020 at 2:59 AM Yifan Zou wrote: > > > > done. > > > > On Sun, Jan 12,

Re: Jenkins jobs not running for my PR 10438

suites are passing while some were >>> not triggered. >>> - Some tests suites never trigger within a reasonable timeframe after >>> "run suite X" command. For example, Run PythonLint precommit didn't trigger >>> the suite after two requests, but did t

Re: [VOTE] Beam's Mascot will be the Firefly (Lampyridae)

+1 On Mon, Dec 16, 2019 at 11:31 AM Daniel Oliveira wrote: > +1 (non-binding) > > On Sat, Dec 14, 2019 at 5:24 PM Kyle Weaver wrote: > >> +1 (non-binding) >> >> On Sat, Dec 14, 2019 at 3:10 AM Jan Lukavský wrote: >> >>> +1 (non-binding) >>> On 12/13/19 7:22 PM, Pablo Estrada wrote: >>> >>> +1

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[ ] Beaver [ ] Hedgehog [ ] Lemur [ ] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [ ] Firefly [ ] Cuttlefish [X] Dumbo Octopus [ ] Angler fish On Mon, Nov 25, 2019 at 1:22 PM David Cavazos wrote: > Hi Kenneth, I tried adding back the email addresses, but they weren't > added on the existing

Re: [ANNOUNCE] New committer: Daniel Oliveira

Congratulations, Daniel! On Mon, Nov 25, 2019 at 9:31 AM Ahmet Altay wrote: > Congratulations, Daniel! > > On Sat, Nov 23, 2019 at 3:47 AM jincheng sun > wrote: > >> >> Congrats, Daniel! >> Best, >> Jincheng >> >> Alexey Romanenko 于2019年11月22日周五 下午5:47写道： >> >>> Congratulations, Daniel! >>>

[ANNOUNCE] Beam 2.16.0 Released!

The Apache Beam team is pleased to announce the release of version 2.16.0. Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release

[RESULT] [VOTE] Release 2.16.0, release candidate #1

I'm happy to announce that we have unanimously approved this release. There are 8 approving votes, 5 of which are binding: * Ahmet (al...@google.com) * Pablo (pabl...@google.com) * Robert (rober...@google.com) * Kenneth (k...@apache.org) * Jean-Baptiste (j...@nanthrax.net) There are no

Re: [VOTE] Release 2.16.0, release candidate #1

(rober...@google.com) * Kenneth (k...@apache.org) There are no disapproving votes. Next step is to finalize the release (merge the docs/website/blog PRs, publish artifacts). Please let me know if you have any questions. Thanks everyone! Regards, Mark On Fri, Oct 4, 2019 at 4:19 PM Mark Liu wrote

Re: [VOTE] Release 2.16.0, release candidate #1

ablo Estrada wrote: >> >>> Hi all, >>> I looked at https://issues.apache.org/jira/browse/BEAM-8303, and it >>> seems like the user has a workaround - is that correct? >>> If that's the case, then I vote +1. >>> >>> @Max - lmk if you'd

Re: [VOTE] Release 2.16.0, release candidate #1

+1 (forgot to vote) I also triggered Java Nexmark on direct, dataflow, spark and flink runner. Didn't saw performance regression from the dashboard ( https://apache-beam-testing.appspot.com/dashboard-admin) On Fri, Oct 4, 2019 at 8:23 AM Mark Liu wrote: > Thanks for the validation work

Re: [VOTE] Release 2.16.0, release candidate #1

the clear communication for the importance and at >>> the >>> > same time non-blocking status of the issue. >>> > >>> > For the next time, may I suggest asking release manager to do the >>> > merging to the release branch. We do not know wheth

Re: Dockerhub push denied for py3.6 and py3.7 image

n Tue, Oct 1, 2019 at 11:02 AM Pablo Estrada wrote: > >> I'll check for you. One second. >> >> On Tue, Oct 1, 2019 at 10:32 AM Mark Liu wrote: >> >>> Hello Dockerhub Admins, >>> >>> I was able to push Java, Go, py2.7 and py3.5 images t

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

+1 btw, the link (http://python3stament.org) you provided is broken. On Tue, Oct 1, 2019 at 9:44 AM Udi Meiri wrote: > +1 > > On Tue, Oct 1, 2019 at 3:22 AM Łukasz Gajowy > wrote: > >> +1 >> >> wt., 1 paź 2019 o 11:29 Maximilian Michels napisał(a): >> >>> +1 >>> >>> On 30.09.19 23:03, Reza

Re: [UPDATE] Beam 2.16.0 Release Tracking

done. (pull/9667 <https://github.com/apache/beam/pull/9667>, pull/593 <https://github.com/apache/beam-site/pull/593>, pull/9671 <https://github.com/apache/beam/pull/9671/files>) On Fri, Sep 13, 2019 at 12:41 PM Mark Liu wrote: > New nightly snapshot was built and published

Re: [ANNOUNCE] New committer: Alan Myrvold

Congratulations Alan!!! On Fri, Sep 27, 2019 at 12:55 PM Ning Kang wrote: > Congrats Alan! > > On Fri, Sep 27, 2019 at 12:02 PM Ankur Goenka wrote: > >> Congratulations Alan! >> >> On Fri, Sep 27, 2019 at 11:17 AM Yichi Zhang wrote: >> >>> Congrats, Alan! >>> >>> On Fri, Sep 27, 2019 at 10:26

Re: portableWordCountBatch and portableWordCountStreaming failing in Python PreCommit

sed to fail and the failures > are fixed now. > Please rerun the test if your PR is affected. > > On Mon, Sep 16, 2019 at 6:16 PM Mark Liu wrote: > >> Thanks for letting me know. I'll keep tracking on this issue since it's a >> release blocker. Please update here/jira if you

Re: portableWordCountBatch and portableWordCountStreaming failing in Python PreCommit

ch, it will create >>>> *apachebeam/flink-job-server*, while the code is expecting >>>> *jenkins-docker-apache.bintray.io/beam/flink-job-server:latest >>>> <http://jenkins-docker-apache.bintray.io/beam/flink-job-server:latest>* >>>>

Re: [UPDATE] Beam 2.16.0 Release Tracking

AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Idea%2C%20%22Under%20Discussion%22%2C%20%22In%20Implementation%22%2C%20%22Triage%20Needed%22)%20AND%20fixVersion%20%3D%202.16.0%20ORDER%20BY%20priority%20DESC%2C%20updated%20DESC> . On Wed, Sep 11, 2019 at 2:39 PM Mark Liu wrote: &g

[UPDATE] Beam 2.16.0 Release Tracking

Hi all, The release-2.16.0 branch is cut on commit/8f919849766269b504dd17439f698ab97c6d89ad . The next step would be building snapshots and verify release branch.

Re: Possible Python SDK performance regression

estigated ahead of 2.16.0 >> release. >> >> On Fri, Sep 6, 2019 at 6:44 PM Thomas Weise wrote: >> >>> >>> >>> On Fri, Sep 6, 2019 at 6:23 PM Ahmet Altay wrote: >>> >>>> >>>> >>>> On Fri, Sep 6, 2019 at 6

[Reminder] Beam 2.16.0 Release Soon

Hi all, Reminder, the plan to cut the release branch is on 09/11 (less than a week from now)[1]. Please mark all release blocking issues with fix version 2.16[2]. [1] https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7seouanigd0%40group.calendar.google.com [2]

[PROPOSAL] Preparing for Beam 2.16.0 release

for 2.16 please mark their "Fix Version" as 2.16.0 [2]. This tag is already created in JIRA in case you would like to move any non-blocking issues to that version. Any thoughts, comments, objections? Regards. Mark Liu [1] https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7

Re: [PROPOSAL] Standardize Gradle structure in Python SDK

uld imagine right now would be - as suggested above - to split >>>>> pythonPreCommit into something like pythonX_YPrecommit, which then runs >>>>> those different python versions in parallel. Of course, that could be done >>>>> ad infinitum by splitting f

Re: Java 11 compatibility question

Some actions we did for py2 to py3 works: - Check and resolve incompatible dependencies. - Enable py3 lint. - Fill feature gaps between py2 and py3 (e.g. new py3 container, new solution for type hint) - Add unit tests, integration tests and other tests on py3 for coverage. - Release (p3) and

Update on Python Gradle test configuration unification

Hi all, Some refactors are made recently on Python Gradle configurations to unify tests among Py2 and Py3x. More specifically, Py2 tests defined in sdks/python/build.gradle were moved to sdks/python/test-suites

Re: [ANNOUNCE] New committer: Robert Burke

Congratulations Robert! On Thu, Jul 18, 2019 at 9:49 AM 송원욱 wrote: > Congrats Robert! > Wonook > > > 2019년 7월 18일 (목) 오전 6:47, Kyle Weaver 님이 작성: > >> +1 to faster Go SDK iteration! Well-deserved, Rebo >> >> Kyle Weaver | Software Engineer | github.com/ibzib | kcwea...@google.com >> |

Re: pipeline timeout

Hi Chaim, You can checkout PipelineResult class and do something like: result = p.run() result.wait_until_finish(duration=TIMEOUT_SEC) if not PipelineState.is_terminal(result.state): result.cancel()

Re: [ANNOUNCE] New PMC Member: Pablo Estrada

Congratulations, Pablo! *From: *Alexey Romanenko *Date: *Fri, May 17, 2019 at 2:12 AM *To: *dev Congratulations, Pablo! > > On 16 May 2019, at 20:38, Rui Wang wrote: > > Congrats! Congrats! Congrats! > > -Rui > > On Thu, May 16, 2019 at 9:45 AM Udi Meiri wrote: > >> Congrats Pablo! >> >> On

Re: [ANNOUNCE] New committer announcement: Boyuan Zhang

Congrats Boyuan! On Thu, Apr 11, 2019 at 9:53 AM Alexey Romanenko wrote: > > since early 2018 > > 100+ pull requests > > Wow, this is impressive! Great job, congrats! > > > On 11 Apr 2019, at 15:08, Maximilian Michels wrote: > > > > Great work! Congrats. > > > > On 11.04.19 13:41, Robert

Re: [PROPOSAL] Standardize Gradle structure in Python SDK

> the improvement related to this? > - Beyond the proposal, I am assuming you are willing to work on. Just want > to clarify this. In either case, would you need help? > > Thank you, > Ahmet > > On Wed, Mar 27, 2019 at 10:19 AM Mark Liu wrote: > >> Hi Python SDK D

Re: New contributor

Welcome! Mark On Wed, Mar 27, 2019 at 10:09 AM Lukasz Cwik wrote: > Welcome. The getting started[1] and contribution guides[2] are most > useful. I have also added you as a contributor to the JIRA project. > > 1: https://beam.apache.org/get-started/beam-overview/ > 2:

[PROPOSAL] Standardize Gradle structure in Python SDK

Hi Python SDK Developers, You may notice that Gradle files changed a lot recently as parallelization applied to Python tests and more python versions were enabled in testing. There are tricks over the build scripts and tests are grown

Re: [ANNOUNCE] New committer announcement: Mark Liu

;>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Congratulations Mark! >>>>>>>>>>> >>>>>>>>>>> On Sun, Mar 24, 2019 at 10:25 PM Connell O'Callaghan < >>>>&g

Re: Python36/37 not installed on Beam2 and Beam12?

hier slack channel :) ? > > On Wed, Mar 20, 2019 at 6:23 PM Yifan Zou wrote: > >> You could try to ping them in the slack channel >> https://the-asf.slack.com/messages/ if it is really urgent. >> >> On Wed, Mar 20, 2019 at 5:29 PM Mark Liu wrote: >&g

Python36/37 not installed on Beam2 and Beam12?

Hi, I saw occasional py36 tox test failure in beam_PreCommit_Python and beam_Release_NightlySnapshot in cron job as well as PR triggered job . The error is simple:

Re: [BEAM-6835] beam-sdks-python-test-suites-tox-py35:sdist FAILED on clean branch

A fix to your problem is discussed in this thread and is included in my roll-forward PR: https://github.com/apache/beam/pull/8067. On Thu, Mar 14, 2019 at 11:27 AM Ahmet Altay wrote: > PR #8059 reverted a change from yesterday

Re: Python sdist broken?

Thanks for reporting the problem and share your thoughts Michael! Kasia suggested a fix to my dev branch. My roll-forward is out in https://github.com/apache/beam/pull/8067, which contains a fix that excludes any possible build/target/dist in

Re: Python precommit duration is above 1hr

this is largely due to the addition of Python 3 test suites. > > Running tests in parallel is actively being investigated by +Mark Liu > in this Jira ticket [1] and this PR [2]. We will add > other Python 3.6 and 3.7 test suites only to postcommit until then. > > [1] https://issues

Re: PostCommit tests broken

I saw HttpError from the console log in the job you provided above : "error": { "code": 404, "message": "(b8b815bd6683759f): Information about job

Re: [ANNOUNCE] New committer announcement: Michael Luckey

Congrats Michael! On Mon, Mar 4, 2019 at 10:03 AM Joana Filipa Bernardo Carrasqueira < joanafil...@google.com> wrote: > Congratulations Michael!! Welcome! > > On Thu, Feb 28, 2019 at 3:55 PM Daniel Oliveira > wrote: > >> Congrats Michael! >> >> On Thu, Feb 28, 2019 at 3:12 AM Maximilian Michels

Re: Beam Jenkins job summary available in .test-infra/jenkins/REAMDE.md

Glad to hear that! Thanks, Mark On Sat, Feb 16, 2019 at 1:53 PM Maximilian Michels wrote: > Hi Mark, > > That's super useful. I often end up using Jenkins' search which isn't > all that great and finds jobs from all Apache projects. Thank you! > > Cheers, > Max > >

Beam Jenkins job summary available in .test-infra/jenkins/REAMDE.md

TL;DR: Check out .test-infra/jenkins/REAMDE.md for Beam Jenkins job summary! Hi folks, I found it's difficult for me to quickly find particular Jenkins job link or PR trigger phrase during development and PR review. So I

Re: Another new contributor!

Welcome! On Thu, Jan 31, 2019 at 7:23 PM Ankur Goenka wrote: > Welcome Brian! > > On Fri, Feb 1, 2019 at 6:49 AM Mikhail Gryzykhin < > gryzykhin.mikh...@gmail.com> wrote: > >> Welcome to the community! >> >> On Thu, Jan 31, 2019, 16:50 Alex Amato wrote: >> >>> Great to start working with you

Re: Proposal: Portability SDKHarness Docker Image Release with Beam Version Release.

+1 to have an official Beam released container image. Also I would propose to add a verification step to (or after) the release process to do smoke check. Python have ValidatesContainer test that runs basic pipeline using newly built container for verification. Other sdk languages can do similar

Re: Our jenkins beam1 server is down

Thanks you Yifan! Looks like following precommits are affected according to my PR: Java_Examples_Dataflow, Portable_Python, Website_Stage_GCS On Wed, Jan 16, 2019 at 9:25 AM Yifan Zou wrote: > I am looking on it. > > On Wed, Jan 16, 2019 at 8:18 AM Ismaël Mejía wrote: > >> Can somebody PTAL.

Re: [RFC] I made a new tabbed Beam view in Jenkins

That looks great. Thank you! Mark On Tue, Dec 18, 2018 at 1:53 PM Jason Kuster wrote: > Oh, a good fact! Thanks for the info. :) > > On Tue, Dec 18, 2018 at 1:48 PM Alan Myrvold wrote: > >> The _Cron variants of pre-commits are run post-commit, to make it easier >> to tell if the pre-commit

Re: Beam snapshots broken

Looks like the recent failure (like this job ) is related to ':beam-sdks-python:test' change introduced in this PR . `./gradlew

Re: What is Jenkins job "Portable_Python" in PreCommit?

gt;> >>> Eventually we want to run a portable WordCount on PreCommit. We will do >>> some more testing on Jenkins before it becomes an official PreCommit >>> task. >>> >>> Thanks, >>> Max >>> >>> On 29.11.18 19:03, Mark L

Re: What is Jenkins job "Portable_Python" in PreCommit?

ah, thanks Boyuan! Probably I created the PR in a bad timing. Looks like a new PR will fix it. On Thu, Nov 29, 2018 at 9:50 AM Boyuan Zhang wrote: > I believe it's in this pending PR: > https://github.com/apache/beam/pull/7157. > > On Thu, Nov 29, 2018 at 8:36 AM Mark Liu wrote:

What is Jenkins job "Portable_Python" in PreCommit?

Hi guys, I made some changes to Python PreCommit Gradle and then Portable_Python is invoked as a PrecCommit test and failed. However, I can't find where it's defined / generated in Gradle or Jenkins groovy. Does anyone know? My branch is synced to master

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

Thank you Davor for your hard work all the time! And congratulations Kenn!! On Thu, Sep 20, 2018 at 8:47 AM Pablo Estrada wrote: > Thanks Davor for your work on Beam thus far! And congrats Kenn : ) > Best > -P. > > On Thu, Sep 20, 2018 at 2:38 AM Robert Bradshaw > wrote: > >> Congratulations

Re: [Help wanted] Fixing beam_PerformanceTests_Python

I updated the Jira . On

Re: Python performance tests have been broken for a while. [BEAM-5334]

I had some updates in another email thread. Basically, I'm trying to move python benchmarks to Gradle to avoid problematic environment setup. https://github.com/apache/beam/pull/6392 contains the changes. Mark On Fri, Sep 14, 2018 at 10:38 AM Pablo Estrada wrote: > I believe Mark

Re: Failing: beam_PerformanceTests_Python

n! > > > pt., 7 wrz 2018 o 21:03 Mark Liu napisał(a): > >> PostCommit_Python_Verify do run this command which is configured in >> sdks/python/build.gradle >> <https://github.com/apache/beam/blob/master/sdks/python/build.gradle#L192> >> and >&

Re: Failing: beam_PerformanceTests_Python

PostCommit_Python_Verify do run this command which is configured in sdks/python/build.gradle and is a dependency of `:beam-sdks-python:postCommit`

Re: Failing: beam_PerformanceTests_Python

keeps green. Mark On Thu, Sep 6, 2018 at 1:04 PM Mikhail Gryzykhin wrote: > Thank you for looking into this. > > --Mikhail > > Have feedback <http://go/migryz-feedback>? > > > On Thu, Sep 6, 2018 at 11:20 AM Mark Liu wrote: > >> BEAM-5296 <

Re: Failing: beam_PerformanceTests_Python

BEAM-5296 is tracking the previous error. Some debugging efforts are made and summarized in PR-6321 . But I didn't realize test failed in different error now. Mark On Thu, Sep 6,

Re: Python SDK: pytest vs nose

Huge +1 to move off from Nose. The last commit to Nose is two years ago which leaves a lot of holes that makes supporting some Beam infra features painful. Vote on pytest since it's more actively maintained than Nose2 (release once a month vs only one for Nose2 this year) and rich of user

Re: [ANNOUNCEMENT] New committers, May 2018 edition!

Congratulations! On Fri, Jun 1, 2018 at 9:41 AM Robin Qiu wrote: > Congrats to all! > > On Fri, Jun 1, 2018 at 8:42 AM Henning Rohde wrote: > >> Congratulations! >> >> On Fri, Jun 1, 2018 at 7:03 AM Jesse Anderson >> wrote: >> >>> Welcome! >>> >>> On Fri, Jun 1, 2018, 2:02 AM Etienne Chauchot

Re: [ANNOUNCEMENT] New committers, August 2017 edition!

Congrats! Excellent works! On Mon, Aug 14, 2017 at 11:50 PM, Aviem Zur wrote: > Congrats! > > On Mon, Aug 14, 2017 at 6:43 PM Tyler Akidau > wrote: > > > Congrats and thanks all around! > > > > On Sat, Aug 12, 2017 at 12:09 AM Aljoscha Krettek

Re: MergeBot is here!

+1 Awesome work! Thank you Jason!!! Mark On Mon, Jul 10, 2017 at 10:05 AM, Robert Bradshaw < rober...@google.com.invalid> wrote: > +1, this is great! I'll second Ismaël's list requests, especially 1 and 3. > > On Mon, Jul 10, 2017 at 2:09 AM, Ismaël Mejía wrote: > >

Re: Java Cross-JDK Test Available on Jenkins Postcommit!

s reasonable to skip them and focus on other variants in JDK version test. On Fri, Jun 9, 2017 at 3:55 PM, Ted Yu <yuzhih...@gmail.com> wrote: > This is nice. > > Nit: I don't see JDK 1.8 (Oracle) variant. Is this intentional ? > > Thanks > > On Fri, Jun 9, 2017 at 3:49 P

Re: First stable release completed!

Congratulations! On Wed, May 17, 2017 at 1:25 PM, Ismaël Mejía wrote: > Amazing milestone, congrats everyone! > > On Wed, May 17, 2017 at 7:54 PM, Reuven Lax > wrote: > > Sweet! > > > > On Wed, May 17, 2017 at 4:28 AM, Davor Bonaci

Re: Website homepage visual refresh

This is awesome! thanks Jeremy. On Tue, May 16, 2017 at 10:49 AM, Sourabh Bajaj < sourabhba...@google.com.invalid> wrote: > +1 this is great. > > On Tue, May 16, 2017 at 10:18 AM Jesse Anderson > > wrote: > > > Nice work! > > > > On Tue, May 16, 2017 at 10:09 AM

Re: Congratulations Davor!

Congratulation Davor On Thu, May 4, 2017 at 11:09 AM, María García Herrero < mari...@google.com.invalid> wrote: > Wow! Congratulations, Davor! > > On Thu, May 4, 2017 at 10:54 AM, Ahmet Altay > wrote: > > > Congratulations, well deserved! > > > > On Thu, May 4,

Re: [ANNOUNCEMENT] New committers, March 2017 edition!

Congrats to all of them! On Fri, Mar 17, 2017 at 2:24 PM, Neelesh Salian wrote: > Congratulations! > > On Fri, Mar 17, 2017 at 2:16 PM, Kenneth Knowles > wrote: > > > Congrats all! > > > > On Fri, Mar 17, 2017 at 2:13 PM, Davor Bonaci

Sorry for beam_SeedJob Failure Spam

Hi all, I'm working on BEAM-1544 and testing on Jenkins DSL configs now. Need to keep rerun SeedJob to pick up my Jenkins config change each time. Sorry about those failure emails. I think I can remove the notification temporarily after test is done. Thanks, Mark

Re: Release 0.6.0

+1 On Mon, Feb 27, 2017 at 3:28 PM, Dan Halperin wrote: > Sounds great to me! > > On Mon, Feb 27, 2017 at 2:10 PM, Sourabh Bajaj < > sourabhba...@google.com.invalid> wrote: > > > +1 for the new release > > > > On Mon, Feb 27, 2017 at 2:06 PM Davor Bonaci