Hey Saurav, There’s this feature request open that I think matches what you’re looking for:
“[HADOOP-18562] New configuration for static headers to be added to all S3 requests“ https://issues.apache.org/jira/browse/HADOOP-18562 The good news is that there’s been some activity there recently with a PR up! Danny From: saurav kumar <official30sau...@gmail.com> Date: Wednesday 10 July 2024 at 15:38 To: "user@hadoop.apache.org" <user@hadoop.apache.org> Subject: [EXTERNAL] Confused Deputy Custom Header Support in Hadoop Conf CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe. Hi All, I am using Apache Hadoop with Apache Flink and have a requirement of passing confused deputy headers to all S3 requests being made from within the framework. I was not able to find any config that allows users to pass custom request headers that can be propagated as part of S3 api requests. Is anyone aware of how to achieve this or is there any recommended way to achieve this? If it's not supported yet would be a good candidate for a new request ? References: Supported Configuration : https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/core-default.xml Class which should add request headers as part of each request: https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java Thanks, Saurav Kumar
