Thank you for the tips, I will try these out
From: Josh Mahonin
Sent: 18 January 2024 21:07
To: Qing Lim
Cc: Jun Qin ; User
Subject: Re: Use different S3 access key for different S3 bucket
Oops my syntax was a bit off there, as shown in the Hadoop docs, it looks like:
fs.s3a.bucket..
Josh
Oops my syntax was a bit off there, as shown in the Hadoop docs, it looks
like:
fs.s3a.bucket..
Josh
>
oyment/filesystems/s3/#configure-access-credentials
>
>
>
> Thanks
>
>
>
> *From:* Jun Qin
> *Sent:* 18 January 2024 10:51
> *To:* User ; Qing Lim
> *Subject:* Re: Use different S3 access key for different S3 bucket
>
>
>
> Hi Qing
>
> The S3 crede
://nightlies.apache.org/flink/flink-docs-master/docs/deployment/filesystems/s3/#configure-access-credentials
Thanks
From: Jun Qin
Sent: 18 January 2024 10:51
To: User ; Qing Lim
Subject: Re: Use different S3 access key for different S3 bucket
Hi Qing
The S3 credentials are associated with Flink SQL tables.
I
Hi Qing
The S3 credentials are associated with Flink SQL tables.
I assume you are talking about processing/joining from two different tables,
backed up by two different S3 buckets. If so, you can provide different
credentials for different tables, then use the two tables in your pipeline.
Jun
Hi, I am using Flink SQL to create table backed by S3 buckets.
We are not using AWS S3, so we have to use access key and secret for Auth.
My pipeline depends on 2 different buckets, each requires different
credentials, can flink support this?
Qing Lim | Marshall Wace LLP, George House, 131
