Re: [VOTE] Release 2.24.0, release candidate #2

2020-09-02 Thread Daniel Oliveira
This RC was built with the expected version of OpenJDK, so it should fix the issue from the previous RC. Unfortunately Dataflow containers are not yet ready, so there will be some delay before Dataflow can be tested. I'm working on getting that done ASAP and will update this thread once they're re

Re: KinesisIO - aggregation

2020-09-02 Thread Jonothan Farr
KinesisIO works fine for me with aggegated records. Here's where deaggregate() is called in v1: https://github.com/apache/beam/blob/9f4d54a2e60ec45150437c0b050f4c73cca91f36/sdks/java/io/kinesis/src/main/java/org/apache/beam/sdk/io/kinesis/SimplifiedKinesisClient.java#L170 And v2: https://github.

Clear Timer in Java SDK

2020-09-02 Thread Boyuan Zhang
Hi team, I'm looking for something similar to timer.clear() from Python SDK[1] in Java SDK but it seems like we haven't exposed clearing timer API from Java Timer. Does Java SDK have another way to clear a timer or we just haven't worked on this API? [1] https://github.com/apache/beam/blob/master

Re: KinesisIO - aggregation

2020-09-02 Thread Alexey Romanenko
Yes, it’s not supported for now, but, at the first sight, it seems that we just need to call UserRecord.deaggregate() in GetKinesisRecordsResult in case if record is aggregated. > On 2 Sep 2020, at 14:30, Sunny, Mani Kolbe wrote: > > Hi Alexey, > > I am looking for reading Kinesis stream w

RE: KinesisIO - aggregation

2020-09-02 Thread Sunny, Mani Kolbe
Hi Alexey, I am looking for reading Kinesis stream with that has aggregated record. From your reply, I take that it is currently not supported? Could that be solved by adding an uncompression function on the pipeline ? Regards, Mani From: Alexey Romanenko Sent: Tuesday, September 1, 2020 6:04