Re: Jenkins jobs not running for my PR 10438

Thank you, Luke. Now Java Precommit is green. On Mon, Mar 9, 2020 at 2:21 PM Tomo Suzuki wrote: > Java PreCommit failed due to Flink's UnboundedSourceWrapperTest > (BEAM-9164). > Can somebody retrigger "Run Java PreCommit" for > https://github.com/apache/beam/pull/11063 ? > > > On Mon, Mar 9,

Re: [DISCUSS] @Experimental annotations - processes and alternatives

I have always been unsure if the "kind" is useful. For users, I doubt it is useful. Now I see that it can be helpful to find all the occurrences by using an IDE to find references when you want to delete them. Many of the "kind" enums are not really categories that you can delete all at once. Like

Re: Contributing Twister2 runner to Apache Beam

Good points Kenn. I think we mostly agree on what has been discussed in this thread the pros/cons of having runners on our repository, but this is probably not the best moment in time to change any policy in that aspect. So if nobody objects I think we can proceed. I am OOO this week so with less

Re: [DISCUSS] @Experimental annotations - processes and alternatives

Thanks Kenn for moving this forward. Though, what still buzzes me is - do we have a consensus about what we actually do with different type of annotations? Can we say, for example, that “@Experimental(Experimental.Kind.SOURCE_SINK)” is useless and we can get rid of it easily? Either, since

Re: Jenkins jobs not running for my PR 10438

Java PreCommit failed due to Flink's UnboundedSourceWrapperTest (BEAM-9164). Can somebody retrigger "Run Java PreCommit" for https://github.com/apache/beam/pull/11063 ? On Mon, Mar 9, 2020 at 9:58 AM Tomo Suzuki wrote: > Hi Beam committers, > > 2 of the previous checks didn't succeed. Would

Re: Java SplittableDoFn Watermark API

The current set of watermark estimators in Apache Beam for UnboundedSource are: SQS - tracks the timestamp of the last unacked message (does not report monotonically increasing watermarks and assumes that the system will make sure to lower bound what is being reported) AMP - tracks timestamp of

Re: Snowflake connector

Thank you. Elias and Shashanka, do you think the Python connector (and API) can offer some additional benefits that a Java cross-language connector cannot ? It's fine to develop Java and Python versions if it makes sense but if cross-language

Re: Java SplittableDoFn Watermark API

Thanks for the explanation on Watch + FileIO it is really clear. Extra question related to WatermarkEstimator, is it supposed to be called in pipelines at the same exact moments that getWatermark is today for Unbounded sources? (slightly unrelated) There is an open JIRA for an issue related to

[RESULT] [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.3 for BEAM-9288 RC #3

I'm happy to announce that we have unanimously approved this release. There are 3 approving votes, 3 of which are binding: * Ismaël Mejía * Jean-Baptiste Onofre * Luke Cwik There are no disapproving votes. Thanks everyone! On Thu, Mar 5, 2020 at 1:56 PM Ismaël Mejía wrote: > +1 (binding) > >

Re: Jenkins jobs not running for my PR 10438

Hi Beam committers, 2 of the previous checks didn't succeed. Would you retrigger Run Java PreCommit Run Java_Examples_Dataflow_Java11 PreCommit for https://github.com/apache/beam/pull/11063 ? Regards, Tomo On Fri, Mar 6, 2020 at 9:31 PM Luke Cwik wrote: > Done > > On Fri, Mar 6, 2020 at 10:35

Re: Snowflake connector

Hi all, Me and my colleague Dariusz we are working currently on Java connector and we are planning to use cross-language to add Python as well. The proposal should arrive on dev-list in the nearest future. Also we would be happy to help if needed in current work of yours. Cheers, Kasia On Mon,

Beam Dependency Check Report (2020-03-09)

ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html' does not exist

Re: Snowflake connector

Cool Shashanka! Feel free to tag me in the JIRA and update me on any progress / ponderings. Cheers, Elias On Sat, 7 Mar 2020 at 03:43, Chamikara Jayalath wrote: > Absolutely. Please create a JIRA and coordinate with Elias and any others > that would like to contribute to this. > > Thanks, >