Re: Reading from AWS Kinesis Stream Cross account

2022-11-15 Thread Sankar Subramaniam
From: Moritz Mack Reply to: "user@beam.apache.org" Date: Tuesday, 15 November 2022 at 10:45 To: Alexey Romanenko , "user@beam.apache.org" Subject: Re: Reading from AWS Kinesis Stream Cross account Hi Sankar, First, as Alexey pointed out, please try and migrate to the Beam

Re: Reading from AWS Kinesis Stream Cross account

2022-11-15 Thread Moritz Mack
Hi Sankar, First, as Alexey pointed out, please try and migrate to the Beam AWS SDK v2 as soon as possible. The SDK v1 (including the Kinesis module) has been long deprecated and will be removed some time soon. The AWS API doesn’t support cross-account access for Kinesis using an ARN. This is

Re: Reading from AWS Kinesis Stream Cross account

2022-11-14 Thread Alexey Romanenko
If I’m not mistaken, it’s not supported in the current implementation of KinesisIO. PS: Btw, if you still use KinesisIO connector based on AWS SDK v1 [1] then it’s highly recommended to switch to one based on AWS SDK v2 [2] since former is deprecated. [1]

Reading from AWS Kinesis Stream Cross account

2022-11-11 Thread Sankar Subramaniam
Hello there, Good morning. We are using Apache Beam (Java SDK 2.35.0) in our data pipeline to read from AWS Kinesis Stream using AWS KDA (Kinesis Data Analytics) and so far it’s working fine for few data pipelines. Now we have got a new requirement that AWS KDA (running an application