Re: [VOTE] Release 2.26.0, release candidate #1

2020-12-11 Thread Jean-Baptiste Onofre
+1 (binding) Sorry for the delay. Regards JB > Le 10 déc. 2020 à 17:40, Tyson Hamilton a écrit : > > +1 from me. I validated Nexmark performance tests. > > On Tue, Dec 8, 2020 at 7:53 PM Robert Burke > wrote: > I'm +1 on RC1 based on the 7 tests I know I can check

[ANNOUNCE] Beam 2.26.0 Released

2020-12-11 Thread Robert Burke
The Apache Beam team is pleased to announce the release of version 2.26.0. Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release

Re: Usability regression using SDF Unbounded Source wrapper + DirectRunner

2020-12-11 Thread Boyuan Zhang
> From what I've seen, the direct runner initiates a checkpoint after every element output. That seems like the 1 second limit kicks in before the output reaches 100 elements. I think the original purpose for DirectRunner to use a small limit on issuing checkpoint requests is for exercising SDF

Re: Usability regression using SDF Unbounded Source wrapper + DirectRunner

2020-12-11 Thread Steve Niemitz
>From what I've seen, the direct runner initiates a checkpoint after every element output. On Fri, Dec 11, 2020 at 5:19 PM Boyuan Zhang wrote: > Hi Antonio, > > Thanks for the details! Which version of Beam SDK are you using? And are > you using --experiments=beam_fn_api with DirectRunner to

Re: Usability regression using SDF Unbounded Source wrapper + DirectRunner

2020-12-11 Thread Boyuan Zhang
Hi Antonio, Thanks for the details! Which version of Beam SDK are you using? And are you using --experiments=beam_fn_api with DirectRunner to launch your pipeline? For ReadFromKafkaDoFn.processElement(), it will take a Kafka topic+partition as input element and a KafkaConsumer will be assigned

Re: Usability regression using SDF Unbounded Source wrapper + DirectRunner

2020-12-11 Thread Antonio Si
Hi Boyuan, This is Antonio. I reported the KafkaIO.read() performance issue on the slack channel a few days ago. I am not sure if this is helpful, but I have been doing some debugging on the SDK KafkaIO performance issue for our pipeline and I would like to provide some observations. It

[GitHub] [beam-site] lostluck merged pull request #609: Publish 2.26.0 release

2020-12-11 Thread GitBox
lostluck merged pull request #609: URL: https://github.com/apache/beam-site/pull/609 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[RESULT] [VOTE] Release 2.26.0, release candidate #1

2020-12-11 Thread Robert Burke
I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 3 of which are binding: * Robert Bradshaw * Pablo Estrada * Ahmet Altay There are no disapproving votes. Thanks everyone! I'll be working on finalizing the release this afternoon Robert Burke

[GitHub] [beam-site] pabloem commented on pull request #609: Publish 2.26.0 release

2020-12-11 Thread GitBox
pabloem commented on pull request #609: URL: https://github.com/apache/beam-site/pull/609#issuecomment-743380879 LGTM! Feel free to merge whenever is appropriate. This is an automated message from the Apache Git Service. To

Re: [VOTE] Release 2.26.0, release candidate #1

2020-12-11 Thread Ahmet Altay
+1 (binding) On Thu, Dec 10, 2020 at 6:05 PM Robert Burke wrote: > Hello All! > The minimum vote time has elapsed with six +1 votes, two of which are > binding, which is not enough for me to start finalization processes. > > I'm happy to extend the period until the sooner of the 2.27.0 branch