DataflowRunner | Cross-language

2020-05-21 Thread Paweł Urbanowicz
Hello, community, I found information that Google is working on supporting Dataflow runner for cross-language (https://beam.apache.org/roadmap/connectors-multi-sdk/) Is there any more information about the expected release of this feature? Thanks

Re: [DISCUSS] New process for proposing ApacheBeam tweets

2020-05-21 Thread Aizhamal Nurmamat kyzy
Sounds good! Let's try it out. I sent one post suggestion via the form, let's see how the notification goes for people who are subscribed to the spreadsheet. I'll create a PR with the description of the new process next week. On Mon, May 18, 2020 at 10:58 AM Ahmet Altay wrote: > I think this is

DataflowRunner | Cross-language

2020-05-21 Thread Paweł Urbanowicz
Hello, community, I found information that Google is working on supporting Dataflow runner for cross-language (https://beam.apache.org/roadmap/connectors-multi-sdk/) Is there any more information about the expected release of this feature? Thanks

Re: Try Beam Katas Today

2020-05-21 Thread Rion Williams
Hi Henry, I submitted a pull request related to the Beam Katas that can be found here (https://github.com/apache/beam/pull/11761) and included you as a reviewer. I updated all of the related metadata, generated the course, and tested through it to ensure it worked as expected (and the placehold

deploy_travis.sh ?

2020-05-21 Thread Austin Bennett
Hi All, Was digging into https://github.com/apache/beam-wheels after being reminded of https://issues.apache.org/jira/browse/BEAM-9388 (I recall the original conversation --> https://lists.apache.org/thread.html/r4a7d34e64a34e9fe589d06aec74d9b464d252c516fe96c35b2d6c9ae%40%3Cdev.beam.apache.org%3E

Re: [RESULT][VOTE] Accept the Firefly design donation as Beam Mascot - Deadline Mon April 6

2020-05-21 Thread Aizhamal Nurmamat kyzy
Hello everyone, Julian and I have created this pr[1] to create a page with the model sheet, and links to the mascot image files. Can someone please review? Thanks! Aizhamal [1] https://github.com/apache/beam/pull/11780 On Mon, May 11, 2020 at 10:14 AM Aizhamal Nurmamat kyzy wrote: > @Ismael, th

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Thomas Weise
Please note https://github.com/apache/beam/pull/11777 - another bug we found while trying to upgrade to 2.21 Other than that things look good. On Thu, May 21, 2020 at 4:14 PM Ahmet Altay wrote: > +1 (again, validated with new whl files.) > > What about https://issues.apache.org/jira/browse/BEAM

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Thomas Weise
On Thu, May 21, 2020 at 4:08 PM Robert Bradshaw wrote: > On Thu, May 21, 2020 at 3:55 PM Luke Cwik wrote: > >> The 2.22 release is also being worked on. Rather allow that release pick >> up anything that isn't critical. >> > > +1. The question is whether this will result in broken installs (e.g.

Re: Apache Beam Fixit 2020-06-08

2020-05-21 Thread Valentyn Tymofieiev
Thanks, Tyson. I noticed a few links could be corrected, fixes inline. On Thu, May 21, 2020 at 4:13 PM Tyson Hamilton wrote: > Why > > Google has a Fixit week to improve Engineering Excellence and we want to > use it to improve Apache Beam! > What > > For the week of 2020-06-08 you will see an

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Ahmet Altay
+1 (again, validated with new whl files.) What about https://issues.apache.org/jira/browse/BEAM-10015? Is this a blocker? +Kenneth Knowles +Reuven Lax -- since you are both tagged on the JIRA. On Thu, May 21, 2020 at 4:09 PM Kyle Weaver wrote: > > We *really* need to automate the building an

Apache Beam Fixit 2020-06-08

2020-05-21 Thread Tyson Hamilton
Why Google has a Fixit week to improve Engineering Excellence and we want to use it to improve Apache Beam! What For the week of 2020-06-08 you will see an increased focus from Google engineers on improving Engineering Excellence. We’re asking the community to join in and commit as much, or as li

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Kyle Weaver
> We *really* need to automate the building and deploying of artifacts, rather than have so many manual steps... Agreed. Luckily building wheels is one of only a couple steps that aren't automated yet. Partially related: https://issues.apache.org/jira/browse/BEAM-9388. On Thu, May 21, 2020 at 6:5

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Robert Bradshaw
On Thu, May 21, 2020 at 3:55 PM Luke Cwik wrote: > The 2.22 release is also being worked on. Rather allow that release pick > up anything that isn't critical. > +1. The question is whether this will result in broken installs (e.g. if we don't exclude Flink 1.10.1 and the user tries to use it wit

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Luke Cwik
The 2.22 release is also being worked on. Rather allow that release pick up anything that isn't critical. On Thu, May 21, 2020 at 3:51 PM Robert Bradshaw wrote: > We *really* need to automate the building and deploying of artifacts, > rather than have so many manual steps... > > The new set of w

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Robert Bradshaw
We *really* need to automate the building and deploying of artifacts, rather than have so many manual steps... The new set of wheels look good now. Verified all the hashes and signatures and source tarball contents as well. Ran a couple of test pipelines. I noticed https://github.com/apache/beam/

Re: joining Beam JIRA

2020-05-21 Thread Tyson Hamilton
Hey Ted! Welcome =) On Thu, May 21, 2020 at 10:34 AM Ahmet Altay wrote: > Done. And welcome! > > On Thu, May 21, 2020 at 10:32 AM Ted Romer wrote: > >> Hi, this is Ted Romer at Google ... I'd like to get permission to join >> the JIRA project so that I can assign >> https://issues.apache.org/ji

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Kyle Weaver
Nevermind, uploading the wheels to dist.apache.org is part of ./sign_hash_python_wheels.sh, which I forgot to run. Wheels should be up to date now, PTAL. On Thu, May 21, 2020 at 1:27 PM Kyle Weaver wrote: > > -1, the wheel files seem to be built against the wrong commit. > > Thanks for catching

Re: GSoD participation

2020-05-21 Thread Chandan Prakash
Thanks On Thu, 21 May 2020, 23:04 Kyle Weaver, wrote: > Hi Chandan, sorry about that. Does this link work? > > > https://join.slack.com/t/seasonofdocs/shared_invite/enQtNTc0NDgyOTQ5Nzc4LTliZjVlZjRmNmU5ZmFiNmViNmNiMTM5NTdlNTJiYzIzZTk3MDlhMjM3NzE2MzIxNzIxNmZiMmMzNzRmZTI4NmU > > On Thu, May 21, 202

Re: joining Beam JIRA

2020-05-21 Thread Ahmet Altay
Done. And welcome! On Thu, May 21, 2020 at 10:32 AM Ted Romer wrote: > Hi, this is Ted Romer at Google ... I'd like to get permission to join the > JIRA project so that I can assign > https://issues.apache.org/jira/browse/BEAM-10055 to myself. > > My JIRA username is "tedromer". > > Thanks! > Te

Re: GSoD participation

2020-05-21 Thread Kyle Weaver
Hi Chandan, sorry about that. Does this link work? https://join.slack.com/t/seasonofdocs/shared_invite/enQtNTc0NDgyOTQ5Nzc4LTliZjVlZjRmNmU5ZmFiNmViNmNiMTM5NTdlNTJiYzIzZTk3MDlhMjM3NzE2MzIxNzIxNmZiMmMzNzRmZTI4NmU On Thu, May 21, 2020 at 1:32 PM Chandan Prakash < b18...@students.iitmandi.ac.in> wrot

joining Beam JIRA

2020-05-21 Thread Ted Romer
Hi, this is Ted Romer at Google ... I'd like to get permission to join the JIRA project so that I can assign https://issues.apache.org/jira/browse/BEAM-10055 to myself. My JIRA username is "tedromer". Thanks! Ted

Re: GSoD participation

2020-05-21 Thread Chandan Prakash
Thanks, The link to join slack channel is expired .I am new to slack ,so , it will be helpful for me if I get the slack URL . On Thu, 21 May 2020, 22:13 Kyle Weaver, wrote: > Hi Chandan, > > > Thank you for the introduction and your interest to work on Apache Beam > documentation with Season o

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Kyle Weaver
> -1, the wheel files seem to be built against the wrong commit. Thanks for catching that Robert. I had to rebuild the wheels after some cherry picks. I validated that the wheels in gs://beam-wheels-staging are up to date. They then must not have overwritten the wheels on dist.apache.org properly,

Re: GSoD participation

2020-05-21 Thread Kyle Weaver
Hi Chandan, Thank you for the introduction and your interest to work on Apache Beam documentation with Season of Docs. To participate in the program you need to follow the guides here [1] [2]. If you are new to the program, we suggest: 1. Start by studying our proposed project ideas and e

Re: TextIO. Writing late files

2020-05-21 Thread Reuven Lax
On Tue, May 19, 2020 at 2:02 AM Maximilian Michels wrote: > > This is still confusing to me - why would the messages be dropped as > late in this case? > > Since you previously mentioned that the bug is due to the pane info > missing, I just pointed out that the WriteFiles logic is expected to >

Re: Transparency to Beam Digital Summit Planning

2020-05-21 Thread Brittany Hermann
Hi folks, Sorry about that. This link should give public access now. https://docs.google.com/document/d/11PXOBUbeldgPqz6OlTswCal6SxyX76Bb_ZVKBdwsd7o/edit?usp=sharing Have a great weekend! On Thu, May 21, 2020 at 5:01 AM Maximilian Michels wrote: > +1 for making the notes publicly available. T

Re: Event Calendar?

2020-05-21 Thread Maximilian Michels
Would it make sense to combine it with the Apache Beam release calendar? https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7seouanigd0%40group.calendar.google.com&ctz=America%2FLos_Angeles On 20.05.20 19:27, Tyson Hamilton wrote: > +1 a calendar would be nice.  > > On Tue, May 19, 20

Re: New Dates For Beam Summit Digital 2020

2020-05-21 Thread Maximilian Michels
Thanks Matthias! We realized we want this to be a much more community-driven process. That's why we are planning to be more transparent to give everyone a chance to get involved in the summit. Given that we now have more time, this will be much more feasible. Cheers, Max On 18.05.20 20:00, Matth

Re: Transparency to Beam Digital Summit Planning

2020-05-21 Thread Maximilian Michels
+1 for making the notes publicly available. This list is free to join by anyone. On 21.05.20 00:17, Austin Bennett wrote: > Should the link/meeting notes be publicly available?  Not just available > to individuals plus all of @google?   > > > > On Wed, May 20, 2020 at 2:06 PM Brittany Hermann

Re: [VOTE] Release 2.21.0, release candidate #1

2020-05-21 Thread Ismaël Mejía
Since the current RC has been -1ed maybe we can include BEAM-9887 as part of the next RC, no? It is definitely not a blocker but a nice to have. On Thu, May 21, 2020 at 2:26 AM Robert Bradshaw wrote: > > -1, the wheel files seem to be built against the wrong commit. E.g. > > unzip -p > apache_be