Re: Labels on PR

2020-02-10 Thread Alex Van Boxel
I've opened a PR and a ticket with INFRA. PR: https://github.com/apache/beam/pull/10824 _/ _/ Alex Van Boxel On Tue, Feb 11, 2020 at 6:57 AM jincheng sun wrote: > +1. Autolabeler seems really cool and it seems that it's simple to > configure and set up. > > Best, > Jincheng > > > > Udi

Re: contributor permission for Beam Jira tickets

2020-02-10 Thread Yixing Zhang
Thank you, Kenneth! On Mon, Feb 10, 2020 at 7:24 PM Kenneth Knowles wrote: > Welcome! I have added you to the Contributors role so you can be assigned > Jira tickets. > > On Mon, Feb 10, 2020 at 4:28 PM Yixing Zhang > wrote: > >> Hi, >> >> This is Yixing from LinkedIn. I'm closely working with

Re: Labels on PR

2020-02-10 Thread jincheng sun
+1. Autolabeler seems really cool and it seems that it's simple to configure and set up. Best, Jincheng Udi Meiri 于2020年2月11日周二 上午2:01写道: > Cool! > > On Mon, Feb 10, 2020 at 9:27 AM Robert Burke wrote: > >> +1 to autolabeling >> >> On Mon, Feb 10, 2020, 9:21 AM Luke Cwik wrote: >> >>> Nice

Re: FnAPI proto backwards compatibility

2020-02-10 Thread Kenneth Knowles
On the runner requirements side: if you have such a list at the pipeline level, it is an opportunity for the list to be inconsistent with the contents of the pipeline. For example, if a DoFn is marked "requires stable input" but not listed at the pipeline level, then the runner may run it without

Re: contributor permission for Beam Jira tickets

2020-02-10 Thread Kenneth Knowles
Welcome! I have added you to the Contributors role so you can be assigned Jira tickets. On Mon, Feb 10, 2020 at 4:28 PM Yixing Zhang wrote: > Hi, > > This is Yixing from LinkedIn. I'm closely working with Xinyu on Samza > runner. Can someone add me as a contributor for Beam's Jira issue

Re: FnAPI proto backwards compatibility

2020-02-10 Thread Brian Hulette
I like the capabilities/requirements idea. Would these capabilities be at a level that it would make sense to document in the capabilities matrix? i.e. could the URNs be the values of "X" Pablo described here [1]. Brian [1]

Re: Sphinx Docs Command Error (:sdks:python:test-suites:tox:pycommon:docs)

2020-02-10 Thread Udi Meiri
I don't have those issues (running on Linux), but a possible workaround could be to remove the "-j 8" flags (2 locations) in generate_pydoc.sh. On Mon, Feb 10, 2020 at 11:06 AM Shoaib Zafar wrote: > Hello Beamers. > > Just curious does anyone having trouble running >

contributor permission for Beam Jira tickets

2020-02-10 Thread Yixing Zhang
Hi, This is Yixing from LinkedIn. I'm closely working with Xinyu on Samza runner. Can someone add me as a contributor for Beam's Jira issue tracker? I would like to create/assign tickets for my work. jira username: YixingZhang Thanks, Yixing Zhang

Re: [DISCUSS] BIP reloaded

2020-02-10 Thread Kenneth Knowles
I jumped into these wiki pages and figured out how Airflow did theirs using the Page Properties table on each BIP [1] and how these automatically update the index using the Page Properties Report [2]. I would consider creating BIPs for ongoing efforts to flesh out these table, to establish the

FnAPI proto backwards compatibility

2020-02-10 Thread Robert Bradshaw
With an eye towards cross-language (which includes cross-version) pipelines and services (specifically looking at Dataflow) supporting portable pipelines, there's been a desire to stabilize the portability protos. There are currently many cleanups we'd like to do [1] (some essential, others nice

Re: Upgrades gcsio to 2.0.0

2020-02-10 Thread Luke Cwik
What prevents the usage of the newer version of Guava? On Mon, Feb 10, 2020 at 2:28 PM Esun Kim wrote: > Hi Beam Developers, > > I'm working on pr/10769 which > upgrades gcsio from 1.9.16 to 2.0.0 which is an intermediate step to get us > to use gcsio

Upgrades gcsio to 2.0.0

2020-02-10 Thread Esun Kim
Hi Beam Developers, I'm working on pr/10769 which upgrades gcsio from 1.9.16 to 2.0.0 which is an intermediate step to get us to use gcsio 2.x which supports gRPC, which potentially gives us better performance. (FYI, gcsio is a driver for Google Cloud

Re: BEAM-8758: Code Review Wanted for PR 10765

2020-02-10 Thread Luke Cwik
I took a look, left relevant comments. On Mon, Feb 10, 2020 at 12:26 PM Tomo Suzuki wrote: > Hi Udi, Luke, and Beam committers, > > Would you review/merge this google-cloud-spanner dependency upgrade? > https://github.com/apache/beam/pull/10765 > > -- > Regards, > Tomo >

BEAM-8758: Code Review Wanted for PR 10765

2020-02-10 Thread Tomo Suzuki
Hi Udi, Luke, and Beam committers, Would you review/merge this google-cloud-spanner dependency upgrade? https://github.com/apache/beam/pull/10765 -- Regards, Tomo

Re: Dynamic timers now supported!

2020-02-10 Thread Kenneth Knowles
I think the (lack of) portability bit may have been buried in this thread. Maybe a new thread about the design for that? Kenn On Sun, Feb 9, 2020 at 11:36 AM Reuven Lax wrote: > FYI, this is now fixed for Dataflow. I also added better rejection so that > runners that don't support this feature

Sphinx Docs Command Error (:sdks:python:test-suites:tox:pycommon:docs)

2020-02-10 Thread Shoaib Zafar
Hello Beamers. Just curious does anyone having trouble running ':sdks:python:test-suites:tox:pycommon:docs' command locally? After rebasing with master recently, I am facing sphinx thread fork error with on my macos mojave, using python 3.7.0. I Tried to add system variable "export

Re: A new reworked Elasticsearch 7+ IO module

2020-02-10 Thread Chamikara Jayalath
On Thu, Feb 6, 2020 at 8:13 AM Etienne Chauchot wrote: > Hi, > > please see my comments inline > On 06/02/2020 16:24, Alexey Romanenko wrote: > > Please, see my comments inline. > > On 6 Feb 2020, at 10:50, Etienne Chauchot wrote: > > 1. regarding version support: ES v2 is no more maintained by

Re: Retest this please access?

2020-02-10 Thread Robert Bradshaw
We're working on that, follow https://issues.apache.org/jira/browse/INFRA-19670 On Mon, Feb 10, 2020 at 9:52 AM Daniel Collins wrote: > > Hello all, > > I'm feeling a bit bad about asking my reviewers to re-run presubmits. How > would I go about getting access to "Retest this please" being

Re: Labels on PR

2020-02-10 Thread Udi Meiri
Cool! On Mon, Feb 10, 2020 at 9:27 AM Robert Burke wrote: > +1 to autolabeling > > On Mon, Feb 10, 2020, 9:21 AM Luke Cwik wrote: > >> Nice >> >> On Mon, Feb 10, 2020 at 2:52 AM Alex Van Boxel wrote: >> >>> Ha, cool. I'll have a look at the autolabeler. The infra stuff is not >>> something

Retest this please access?

2020-02-10 Thread Daniel Collins
Hello all, I'm feeling a bit bad about asking my reviewers to re-run presubmits. How would I go about getting access to "Retest this please" being interpreted as a presubmit trigger on github? Thanks, Daniel

Re: Labels on PR

2020-02-10 Thread Robert Burke
+1 to autolabeling On Mon, Feb 10, 2020, 9:21 AM Luke Cwik wrote: > Nice > > On Mon, Feb 10, 2020 at 2:52 AM Alex Van Boxel wrote: > >> Ha, cool. I'll have a look at the autolabeler. The infra stuff is not >> something I've looked at... I'll dive into that. >> >> _/ >> _/ Alex Van Boxel >> >>

Re: Labels on PR

2020-02-10 Thread Luke Cwik
Nice On Mon, Feb 10, 2020 at 2:52 AM Alex Van Boxel wrote: > Ha, cool. I'll have a look at the autolabeler. The infra stuff is not > something I've looked at... I'll dive into that. > > _/ > _/ Alex Van Boxel > > > On Mon, Feb 10, 2020 at 11:49 AM Ismaël Mejía wrote: > >> +1 >> >> You don't

Beam Dependency Check Report (2020-02-10)

2020-02-10 Thread Apache Jenkins Server
High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue cachetools 3.1.1 4.0.0 2019-12-23

Re: Labels on PR

2020-02-10 Thread Alex Van Boxel
Ha, cool. I'll have a look at the autolabeler. The infra stuff is not something I've looked at... I'll dive into that. _/ _/ Alex Van Boxel On Mon, Feb 10, 2020 at 11:49 AM Ismaël Mejía wrote: > +1 > > You don't need to write your own action, there is already one autolabeler > action [1]. >

Re: Labels on PR

2020-02-10 Thread Ismaël Mejía
+1 You don't need to write your own action, there is already one autolabeler action [1]. INFRA can easily configure it for Beam (as they did for Avro [2]) if we request it. The plugin is quite easy to configure and works like a charm [3]. [1] https://github.com/probot/autolabeler [1]

Re: Labels on PR

2020-02-10 Thread Alexey Romanenko
Great initiative, thanks Alex! I was thinking to add such labels into PR title but I believe that GitHub labels are better since it can be used easily for filtering, for example. Maybe it could be useful to add more granulation for labels, like “release”, “runners”, “website”, etc but I’m

Re: big data blog

2020-02-10 Thread Etienne Chauchot
Yes sure, Here is the link to the spreadsheet for review of the tweet: https://docs.google.com/spreadsheets/d/1mz36njTtn1UJwDF50GdqyZVbX_F0n_A6eMYcxsktpSM/edit#gid=1413052381 thanks all for your encouragement ! Best Etienne On 08/02/2020 08:09, Kenneth Knowles wrote: Nice! Yes, I think we