Beam Dependency Check Report (2020-12-07)

2020-12-07 Thread Apache Jenkins Server
High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue chromedriver-binary 87.0.4280.88.0

Implementing ARR_AGG

2020-12-07 Thread Sonam Ramchand
Hi Devs, I have tried to implement the ARR_AGG function for Zetasql dialect by following the STRING_AGG implementation ( https://github.com/apache/beam/pull/11895). Draft PR for ARR_AGG is (https://github.com/apache/beam/pull/13483). When i try to run the test, @Test public void

Re: unsubscribe

2020-12-07 Thread Brian Hulette
Hi Richard, to unsubscribe you should send a message to dev-unsubscr...@beam.apache.org Brian On Sun, Dec 6, 2020 at 2:04 PM Richard Moorhead wrote: > >

Re: [VOTE] Release 2.62.0, release candidate #00

2020-12-07 Thread Chamikara Jayalath
-taxi-20201207-10105-12071011-oij4-harness-6ss0_default(0a07bd35d4a1e02006563901e421445f)"), skipping: failed to "StartContainer" for "sdk-1-0" with ImagePullBackOff: "Back-off pulling image \"apache/beam_java11_sdk:2.26.0\"" [2] https://hub.docker.com/

Re: [VOTE] Release 2.62.0, release candidate #00

2020-12-07 Thread Robert Burke
]. +Emily Ye is looking into this. > > Thanks, > Cham > > [1] > Error: Error syncing pod 0a07bd35d4a1e02006563901e421445f > ("dataflow-kafka-taxi-20201207-10105-12071011-oij4-harness-6ss0_default(0a07bd35d4a1e02006563901e421445f)"), > skipping: failed to "

Re: [VOTE] Release 2.62.0, release candidate #00

2020-12-07 Thread Emily Ye
ror: Error syncing pod 0a07bd35d4a1e02006563901e421445f >> ("dataflow-kafka-taxi-20201207-10105-12071011-oij4-harness-6ss0_default(0a07bd35d4a1e02006563901e421445f)"), >> skipping: failed to "StartContainer" for "sdk-1-0" with ImagePullBackOff: >> "

DRAFT - Beam board report December 2020

2020-12-07 Thread Kenneth Knowles
Hi all, The December board report is due Wednesday. Through this link anyone should be able to comment and make suggestions. Please help me out by adding highlights. https://s.apache.org/beam-draft-report-2020-12 You can read past reports at https://whimsy.apache.org/board/minutes/Beam.html to

Re: [VOTE] Release 2.62.0, release candidate #00

2020-12-07 Thread Robert Burke
Last Friday I re-built and re-pushed the containers that Ahmet found. I'm going to redo that validation and try and get through additional validation today. As it stands I'm back to a +0 due to Ahmets position on the python 3.7 tests. (I'm not familiar with the python suites, so I defer to an

[VOTE] Release 2.26.0, release candidate #1

2020-12-07 Thread Robert Burke
Robert Burke Thu, Dec 3, 8:01 PM (4 days ago) to dev Hi everyone, Please review and vote on the release candidate #1 for the version 2.26.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) Reviewers are encouraged to test their own

Re: Unit tests vs. Integration Tests

2020-12-07 Thread Kyle Weaver
> Can we write the tests to be agnostic as to whether the service is mocked, faked, or real? Then we can run them in various modes. Even better. > I'm a strong believer in "fake don't mock" to the extent that I think mocking these might be counterproductive. Fakes are great too. As long as

Re: Unit tests vs. Integration Tests

2020-12-07 Thread Kenneth Knowles
On Mon, Dec 7, 2020 at 4:03 PM Kyle Weaver wrote: > > Can we write the tests to be agnostic as to whether the service is > mocked, faked, or real? Then we can run them in various modes. > > Even better. > > > I'm a strong believer in "fake don't mock" to the extent that I think > mocking these

Re: Proposal: Redis Stream Connector

2020-12-07 Thread Vincent Marquez
On Fri, Dec 4, 2020 at 12:28 PM Boyuan Zhang wrote: > Hi Vincent, > > 1. Just to be clear, for a streaming pipeline (say, on the dataflow >> runner)it will use the 'residual' result of the SplitRestriction >> (retrieved from trySplit) as the checkpoint, so if the pipeline is stopped >> due to

Re: Any interest in sharding targets?

2020-12-07 Thread Kenneth Knowles
On Tue, Dec 1, 2020 at 9:21 AM Daniel Collins wrote: > > High-level: ensure you have gradle cache enabled so only the first build > is slow. If you encounter nondeterministic or noncached targets upstream of > the module you are editing, that's worth discussing and probably fixing. > > I do have

Add emilymye to JIRA contributers

2020-12-07 Thread Emily Ye
Hi dev@ Just realized I didn't request contributor access to JIRA a while back - would someone be able to add me so I can self-assign my issues? Thank you! Emily

Re: Updating to Calcite 1.26 ... help wanted

2020-12-07 Thread Andrew Pilloud
To answer your initial question, the parser factory can be replaced here: https://github.com/apache/beam/blob/7c43ab6a8df9b23caa7321fddff9a032a71908f6/sdks/java/extensions/sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/JdbcFactory.java#L98 The support from DDL in Beam is a copy of the

Re: [VOTE] Release 2.62.0, release candidate #00

2020-12-07 Thread Robert Burke
2.26.0 [2]. +Emily Ye is looking into this. >>> >>> Thanks, >>> Cham >>> >>> [1] >>> Error: Error syncing pod 0a07bd35d4a1e02006563901e421445f >>> ("dataflow-kafka-taxi-20201207-10105-12071011-oij4-harness-6ss0_default(0a

Re: [VOTE] Release 2.26.0, release candidate #1

2020-12-07 Thread Robert Burke
Turns out no changes required affecting the dataflow artifacts this time around, so Dataflow is cleared for testing. Cheers. Robert Burke 2.26.0 Release Manager On Mon, Dec 7, 2020, 6:03 PM Robert Burke wrote: > > Robert Burke > Thu, Dec 3, 8:01 PM (4 days ago) > to dev > Hi everyone, >

Re: Unit tests vs. Integration Tests

2020-12-07 Thread Kenneth Knowles
On Fri, Dec 4, 2020 at 3:29 PM Brian Hulette wrote: > > > On Wed, Dec 2, 2020 at 5:50 PM Brian Hulette wrote: > >> I guess another question I should ask - is :test supposed to only run >> unit tests? I've been assuming so since many modules have separate >> :integrationTest tasks for *IT tests.