Golang Apache Beam volunteer to help

2020-03-03 Thread Damon Douglas
Hello Robert, I enjoyed meeting some of your colleagues last night at the Seattle Apache Beam Meetup at the new Google building. I found your contact information via https://beam.apache.org/roadmap/go-sdk/. It suggested I contact you to see where I could possibly volunteer to help with the

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288

2020-03-03 Thread Luke Cwik
Looks like the vote is cancelled. On Tue, Mar 3, 2020 at 2:03 PM Ismaël Mejía wrote: > -1 > > It seems we still are adding the conscrypt native libraries as part in > META-INF > > $ jar tvf beam-vendor-grpc-1_26_0-0.3.jar | grep conscrypt > 2218176 Mon Sep 17 10:36:24 CEST 2018 >

Re: Could any committer help trigger tests for my PR?

2020-03-03 Thread Liu Wang
Done. On 2020/03/03 17:48:08, Liu Wang wrote: > https://github.com/apache/beam/pull/10951 > > By the way, I got errors last time which are unrelated to my files. What can > I do about it? > > Thank you! >

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288

2020-03-03 Thread Ismaël Mejía
-1 It seems we still are adding the conscrypt native libraries as part in META-INF $ jar tvf beam-vendor-grpc-1_26_0-0.3.jar | grep conscrypt 2218176 Mon Sep 17 10:36:24 CEST 2018 META-INF/native/libconscrypt_openjdk_jni-linux-x86_64.so 1720832 Mon Sep 17 10:36:24 CEST 2018

Re: Python Static Typing: Next Steps

2020-03-03 Thread Chad Dombrova
> > This probably does not apply yet, does optional mean that opting-in for > all or none of the precommit hooks? Would contributors have a choice of > which pre-commits they can opt-in too? > Yes, once the hook is installed, individual checks are opt-out and the design is clearly built around a

Re: Python Static Typing: Next Steps

2020-03-03 Thread Ahmet Altay
On Tue, Mar 3, 2020 at 11:53 AM Chad Dombrova wrote: > >>> +1. Also would not running dmypy would require all contributors to run a >> process all the time? I do not know if this is desired by existing >> contributors, and I am not sure if it will be friendly to new contributors. >> > >

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288

2020-03-03 Thread Pablo Estrada
+1 (binding) verified hashes On Tue, Mar 3, 2020 at 11:20 AM Luke Cwik wrote: > +1 (binding) > Verified signatures > Verified that there are no conscrypt classes in jar > Verified pom.xml has runtime dependency on conscrypt > > On Tue, Mar 3, 2020 at 10:35 AM Jean-Baptiste Onofré > wrote: > >>

Re: [ANNOUNCE] New Committer: Kamil Wasilewski

2020-03-03 Thread Łukasz Gajowy
Congratulations mate! Well deserved. :) pon., 2 mar 2020 o 17:01 Elias Djurfeldt napisał(a): > Congrats Kamil!! > > On Mon, 2 Mar 2020 at 16:16, Karolina Rosół > wrote: > >> Congratulations Kamil! Well deserved :-) >> >> Karolina Rosół >> Polidea | Project Manager >>

Re: Python Static Typing: Next Steps

2020-03-03 Thread Chad Dombrova
> > >> +1. Also would not running dmypy would require all contributors to run a > process all the time? I do not know if this is desired by existing > contributors, and I am not sure if it will be friendly to new contributors. > Pre-commit git hooks are completely opt-in. Developers who choose

Re: Python Static Typing: Next Steps

2020-03-03 Thread Ahmet Altay
On Tue, Mar 3, 2020 at 11:10 AM Robert Bradshaw wrote: > Nice. > > I still think we should enable it in jenkins and get some experience > with it before we add it to the default pre-commit-hook territory. > +1. Also would not running dmypy would require all contributors to run a process all the

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288

2020-03-03 Thread Luke Cwik
+1 (binding) Verified signatures Verified that there are no conscrypt classes in jar Verified pom.xml has runtime dependency on conscrypt On Tue, Mar 3, 2020 at 10:35 AM Jean-Baptiste Onofré wrote: > +1 (binding) > > Regards > JB > > Le mar. 3 mars 2020 ? 19:31, Luke Cwik a ?crit : > >> Please

Re: Python Static Typing: Next Steps

2020-03-03 Thread Robert Bradshaw
Nice. I still think we should enable it in jenkins and get some experience with it before we add it to the default pre-commit-hook territory. On Tue, Mar 3, 2020 at 10:38 AM Chad Dombrova wrote: > > I tested out dmypy (the mypy daemon) last night and it was completing in > under a second after

Re: Golang Apache Beam volunteer to help

2020-03-03 Thread Robert Burke
Nice to meet you, Damon! Had I not been on a plane last night I'd have been at the event, so I'm sorry I missed you. I'm writing to let you know that I'm interested in chatting, but that I'm currently tying up loose ends before going on vacation without internet for a week (departing on March

Re: Python Static Typing: Next Steps

2020-03-03 Thread Chad Dombrova
I tested out dmypy (the mypy daemon) last night and it was completing in under a second after editing a file and rerunning (usually around 0.6s), which puts it into pre-commit-hook territory. -chad On Tue, Mar 3, 2020 at 1:54 AM Ismaël Mejía wrote: > +1 to do it by default. Great to see the

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288

2020-03-03 Thread Jean-Baptiste Onofré
+1 (binding)RegardsJBLe mar. 3 mars 2020 ? 19:31, Luke Cwik a ?crit :Please review the release of the following artifacts that we vendor: * beam-vendor-grpc-1_26_0Hi everyone,Please review and vote on the release candidate #1 for the version 0.3, as follows:[ ] +1, Approve the release[ ] -1, Do

[VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288

2020-03-03 Thread Luke Cwik
Please review the release of the following artifacts that we vendor: * beam-vendor-grpc-1_26_0 Hi everyone, Please review and vote on the release candidate #1 for the version 0.3, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The

Could any committer help trigger tests for my PR?

2020-03-03 Thread Liu Wang
https://github.com/apache/beam/pull/10951 By the way, I got errors last time which are unrelated to my files. What can I do about it? Thank you!

Re: Java SplittableDoFn Watermark API

2020-03-03 Thread Luke Cwik
On Tue, Mar 3, 2020 at 9:11 AM Ismaël Mejía wrote: > > the unification of bounded/unbounded within SplittableDoFn has always > been a goal. > > I am glad to know that my intuition is correct and that this was > envisioned, the > idea of checkpoints for bounded inputs sounds super really useful.

Re: Java SplittableDoFn Watermark API

2020-03-03 Thread Robert Bradshaw
On Tue, Mar 3, 2020 at 9:11 AM Ismaël Mejía wrote: > > > the unification of bounded/unbounded within SplittableDoFn has always been > > a goal. > > I am glad to know that my intuition is correct and that this was envisioned, > the > idea of checkpoints for bounded inputs sounds super really

Re: Contributor Permission

2020-03-03 Thread Luke Cwik
Welcome, you have been added. On Tue, Mar 3, 2020 at 9:18 AM Fernando Díaz González wrote: > Hi! I work with Beam SQL at Spotify together with Gleb Kanterov. Can > someone add me as a contributor so I can assign myself a ticket I have > created? > > My username is fdiazgon. > > Thanks! >

Contributor Permission

2020-03-03 Thread Fernando Díaz González
Hi! I work with Beam SQL at Spotify together with Gleb Kanterov. Can someone add me as a contributor so I can assign myself a ticket I have created? My username is fdiazgon. Thanks!

Re: Java SplittableDoFn Watermark API

2020-03-03 Thread Ismaël Mejía
> the unification of bounded/unbounded within SplittableDoFn has always been a > goal. I am glad to know that my intuition is correct and that this was envisioned, the idea of checkpoints for bounded inputs sounds super really useful. Eager to try that on practice. An explicit example (with a

Re: [EXTERNAL] Re: Java Build broken

2020-03-03 Thread Pulasthi Supun Wickramasinghe
Thanks, that seems to have fixed the issue. Best Regards, Pulasthi On Tue, Mar 3, 2020 at 5:47 AM Kamil Wasilewski < kamil.wasilew...@polidea.com> wrote: > I had the same problem, it seems that removing Gradle's cache (`rm -rf > ~/.gradle/caches`) solved the issue. > > On Tue, Feb 25, 2020 at

Snowflake connector

2020-03-03 Thread Elias Djurfeldt
Hi all, I've stumbled upon a use case where I might need a SnowflakeIO in Python. Has anyone worked on this before or are there any discussions surrounding it? There is a Snowflake Python library available [1], so looks feasible to implement in Beam. [1]

Re: [EXTERNAL] Re: Java Build broken

2020-03-03 Thread Kamil Wasilewski
I had the same problem, it seems that removing Gradle's cache (`rm -rf ~/.gradle/caches`) solved the issue. On Tue, Feb 25, 2020 at 4:33 PM Pulasthi Supun Wickramasinghe < pulasthi...@gmail.com> wrote: > Hi Stefan, > > Yes, I am also still getting this error on my local setup, However, >

Re: Upcoming Apache Beam meetups in Warsaw

2020-03-03 Thread Kamil Wasilewski
Bumping up. The previous Beam meetup in Warsaw was successful and we'd like to repeat that. It's also a great opportunity to meet and talk with us in our office On Mon, Mar 2, 2020 at 4:20 PM Karolina Rosół wrote: > Hi everyone, > > I'm Project Manager at Polidea and work closely with three

Re: Python Static Typing: Next Steps

2020-03-03 Thread Ismaël Mejía
+1 to do it by default. Great to see the typing work arrive to this maturity milestone. We can also refer to some of the mypy typing docs for newbies on the subject. On Tue, Mar 3, 2020 at 10:15 AM Kamil Wasilewski wrote: > > +1 for enabling mypy as a precommit job > > This however could be a

Re: Python Static Typing: Next Steps

2020-03-03 Thread Kamil Wasilewski
+1 for enabling mypy as a precommit job This however could be a good occasion to rework the current PythonLint job. Since yapf has been introduced, some of the checks made by pylint/flake are now unnecessary and could be dismantled. This would speed-up PythonLint quite a lot. I volunteer to help