Re: Beam SQL found limitations

2023-05-22 Thread Alexey Romanenko
Hi Piotr, Thanks for details! I cross-post this to dev@ as well since, I guess, people there can provide more insights on this. A while ago, I faced the similar issues trying to run Beam SQL against TPC-DS benchmark. We had a discussion around that [1], please, take a look since it can be

Re: Difference between sdk.io.aws2.kinesis.KinesisIO vs sdk.io.kinesis.KinesisIO

2023-05-22 Thread Pavel Solomin
Just to add: If you want to try out a pre-release version, you can use SNAPSHOT artifacts. In Maven pom.xml it would look like this: apache.snapshots Apache Development Snapshot Repository

Re: Difference between sdk.io.aws2.kinesis.KinesisIO vs sdk.io.kinesis.KinesisIO

2023-05-22 Thread Moritz Mack
Hi Sachin, Enhanced Fanout for Kinesis will be released with Beam 2.48.0. See the I/O section: https://github.com/apache/beam/blob/master/CHANGES.md#2480---unreleased Best, Moritz On 22.05.23, 14:00, "Sachin Mittal" wrote: Hi, Can anyone tell me if enhanced fanout consumer for kinesis is

Re: Difference between sdk.io.aws2.kinesis.KinesisIO vs sdk.io.kinesis.KinesisIO

2023-05-22 Thread Sachin Mittal
Hi, Can anyone tell me if enhanced fanout consumer for kinesis is released or not. If I see this PR https://github.com/apache/beam/pull/23540 looks like this feature is merged. I also see this issue now closed https://github.com/apache/beam/issues/19967 However I am not able to find the mention