Re: More metadata in Coder Proto

2020-05-20 Thread Sam Rohde
+Robert Bradshaw who is the reviewer on https://github.com/apache/beam/pull/11503. How does that sound to you? Skip the "is input deterministic" check for GBKs embedded in x-lang transforms? On Wed, May 20, 2020 at 10:56 AM Sam Rohde wrote: > Thanks for your comments, here's a little more to

Re: More metadata in Coder Proto

2020-05-20 Thread Luke Cwik
On Wed, May 20, 2020 at 11:09 AM Sam Rohde wrote: > +Robert Bradshaw who is the reviewer on > https://github.com/apache/beam/pull/11503. How does that sound to you? > Skip the "is input deterministic" check for GBKs embedded in x-lang > transforms? > > On Wed, May 20, 2020 at 10:56 AM Sam Rohde

Re: [ANNOUNCE] New committer: Robin Qiu

2020-05-20 Thread Austin Bennett
Congrats! On Tue, May 19, 2020, 8:32 PM Chamikara Jayalath wrote: > Congrats Robin! > > On Tue, May 19, 2020 at 2:39 PM Rui Wang wrote: > >> Nice! Congrats! >> >> >> >> -Rui >> >> On Tue, May 19, 2020 at 11:13 AM Pablo Estrada >> wrote: >> >>> yoohoo : ) >>> >>> On Tue, May 19, 2020 at 11:03

Re: Event Calendar?

2020-05-20 Thread Tyson Hamilton
+1 a calendar would be nice. On Tue, May 19, 2020 at 3:51 PM Austin Bennett wrote: > Hi All, > > As we have events more often that are more accessible (digital), wondering > whether others see a value of adding a calendar to the website? > > Perhaps related, is it worth updating >

Re: More metadata in Coder Proto

2020-05-20 Thread Luke Cwik
If the CombineGlobally is being returned by the expansion service, the expansion service is on the hook for ensuring that intermediate PCollections/PTransforms/... are constructed correctly. I thought this question was about what to do if you want to take the output of an XLang pipeline and

Re: More metadata in Coder Proto

2020-05-20 Thread Sam Rohde
Thanks for your comments, here's a little more to the problem I'm working on: I have a PR to make GBK a primitive and the aforementioned test_combine_globally was check failing in the run_pipeline method of the DataflowRunner. Specifically what is

Re: More metadata in Coder Proto

2020-05-20 Thread Robert Bradshaw
On Wed, May 20, 2020 at 11:09 AM Sam Rohde wrote: > +Robert Bradshaw who is the reviewer on > https://github.com/apache/beam/pull/11503. How does that sound to you? > Skip the "is input deterministic" check for GBKs embedded in x-lang > transforms? > Yes, I think this is the right situation in

Code Coverage Tracking

2020-05-20 Thread Tyson Hamilton
Hello, I noticed on the github page, there is a badge that reports 100% coverage. This seems suspect, and sure enough after a couple clicks coverall shows that only one file is tracked. A more interesting page is the Builds page [1] that shows the impact of specific PRs. It would be really

Re: Transparency to Beam Digital Summit Planning

2020-05-20 Thread Austin Bennett
Should the link/meeting notes be publicly available? Not just available to individuals plus all of @google? On Wed, May 20, 2020 at 2:06 PM Brittany Hermann wrote: > Hi folks, > > I wanted to provide a few different ways of transparency to you during the > planning of the Beam Digital

Re: [DISCUSS] Dealing with @Ignored tests

2020-05-20 Thread Kyle Weaver
> I think that after 2-3 years being ignored the tests might have already lost their relevance. This is true of all jira issues, and I think consensus on another thread was that we don't want to auto-close issues.

Re: Discussion on Project Idea for Session Of docs 2020

2020-05-20 Thread Kyle Weaver
Hi Divya, Thank you for the introduction and your interest to work on Apache Beam documentation with Season of Docs. To participate in the program you need to follow the guides here [1] [2]. If you are new to the program, we suggest: 1. Start by studying our proposed project ideas and

Transparency to Beam Digital Summit Planning

2020-05-20 Thread Brittany Hermann
Hi folks, I wanted to provide a few different ways of transparency to you during the planning of the Beam Digital Summit. 1) *Beam Summit Status Reports:* I will be sending out weekly Beam Summit Status Reports which will include the goals, attendees, topics discussed, and decisions made every

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-20 Thread Robert Bradshaw
-1, the wheel files seem to be built against the wrong commit. E.g. unzip -p apache_beam-2.21.0-cp35-cp35m-macosx_10_6_intel.macosx_10_9_intel.macosx_10_9_x86_64.macosx_10_10_intel.macosx_10_10_x86_64.whl apache_beam/runners/worker/bundle_processor.py | head -n 40 notice the missing "import

GSoD participation

2020-05-20 Thread Chandan Prakash
Hello community, I am Chandan Prakash , sophomore year student in CS from India. I really want to contribute to the documentation . I have gone through the project ideas . I am new to Apache beam as I have never used it before. Right now, I am exploring Apache beam , runner , SDKs ,etc. But I am

2.22.0 Release Update

2020-05-20 Thread Brian Hulette
Hi everyone, It's time for dueling release branches! The 2.22.0 branch has been cut [1]. - If you notice any release blockers [2] please tag a jira with fix version 2.22.0 and cc me (bhulette). - Please update the change log [3] with any significant changes if you haven't yet. Put up a PR with

Re: Try Beam Katas Today

2020-05-20 Thread Henry Suryawirawan
Yeah there was a recent pull request merged for the md file format change. I checked your repo and it still contains the task.html, so need your help to merge with the latest master. For the answer placeholder, you may refer to this doc

Re: Discussion on Project Idea for Session Of docs 2020

2020-05-20 Thread Divya Sanghi
Follow up ,can anyone please reply On Tue, 19 May 2020, 18:02 Divya Sanghi, wrote: > Hello Aizhamal, > > I am working on Big Data technologies and has hands-on experience on > Flink, Spark, Kafka > and also did POC where I created Docker image of Fink job and ran it on > K8S cluster on the