[VOTE] Release 2.24.0, release candidate #1

2020-08-31 Thread Daniel Oliveira
Hi everyone, Please review and vote on the release candidate #1 for the version 2.24.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * JIRA release notes [1],

Adding Twister2 documentation

2020-08-31 Thread Pulasthi Supun Wickramasinghe
Hi Devs. I created two PR's to add the missing Twister2 runner documentation[1] [2], however, would need some guidance on how to fill out the compatibility matrix. 1. Is there some mapping between test classes and entries in the compatibility matrix I can use to crosscheck and tick off

[GitHub] [beam-site] youngoli commented on pull request #607: Publish 2.24.0 release

2020-08-31 Thread GitBox
youngoli commented on pull request #607: URL: https://github.com/apache/beam-site/pull/607#issuecomment-684137042 R: @tvalentyn This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [beam-site] youngoli closed pull request #606: Publish 2.24.0 release

2020-08-31 Thread GitBox
youngoli closed pull request #606: URL: https://github.com/apache/beam-site/pull/606 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: Design rational behind copying via serializing in flink runner

2020-08-31 Thread Brian Hulette
Hi Teodor, I actually forward your message to dev@ before, but I foolishly removed user@ from the distro so I think you weren't able to see it. Sorry about that! +Lukasz Cwik replied there [1]. I'll copy it here and we can keep discussing on this thread: The idea in Beam has always been to make

Contributor permission for Beam Jira tickets

2020-08-31 Thread Deshpande, Omkar
Hello, I would like to update java kafkaio module in beam to support writing headers. Can someone add me as a contributor for Beam's Jira issue tracker? I would like to contribute to this Jira :

Re: [External] Re: Memory Issue When Running Beam On Flink

2020-08-31 Thread David Gogokhiya
I have a very naive question. I know Jan suggested to use 2 successive fixed overlapping windows with offset as a temporary solution to dedup the events. However, I am wondering whether using a single fixed window of length let's say 1 day followed by a deduplicate function is a good

Beam Memory Issue Followup

2020-08-31 Thread David Gogokhiya
Sorry for starting a new thread. I couldn't add a response to the existing thread at [1] for some reason. I have a very naive question related to finding a temporary fix to the memory issue raised in [1]. I know Jan suggested to use 2 successive fixed overlapping windows with offset as a temporary

Design rational behind copying via serializing in flink runner

2020-08-31 Thread Teodor Spæren
Hey! First time posting to a mailing list, hope I did it correctly :) I'm writing a master thesis at the University of Oslo and right now I'm looking at the performance overhead of using Beam with the Flink runnner versus plain Flink. I've written a simple program, a custom source outputing

KinesisIO - aggregation

2020-08-31 Thread Sunny, Mani Kolbe
Hello, Does Beam have plans to support Kinesis records with aggregation[1]? I see some code [2] in the repo related to that. Is it planned for any near future releases? Regards, Mani [1]

Re: cwiki edit permission request

2020-08-31 Thread Ismaël Mejía
Done, it should be good for user 'tobked'. On Mon, Aug 31, 2020 at 1:36 PM Tobiasz Kędzierski wrote: > > Hi, > > may I ask for edit permissions for the Beam cwiki page? > I would like to add information about metrics > > BR > Tobiasz

Beam Dependency Check Report (2020-08-31)

2020-08-31 Thread Apache Jenkins Server
High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue cachetools 3.1.1 4.1.1 2019-12-23

cwiki edit permission request

2020-08-31 Thread Tobiasz Kędzierski
Hi, may I ask for edit permissions for the Beam cwiki page? I would like to add information about metrics BR Tobiasz