Hi Flink Community, I'm trying to use the Apache Flink OpenSearch connector to sink data into an AWS OpenSearch Serverless collection.
I've made some attempts, but my Flink job consistently fails with a 403 Forbidden error when trying to connect to the OpenSearch endpoint. This makes me suspect there might be an issue with how the connector handles signing requests for the AWS IAM authorization that OpenSearch Serverless requires. To rule out a simple permissions issue, I have verified that the IAM role has the correct permissions by creating a standalone OpenSearch client. Using that client, I was able to connect and index documents successfully. This strongly suggests the problem is specific to the Flink connector's interaction with OpenSearch Serverless, and not a general permissions misconfiguration. I couldn't find any specific documentation on using the connector with the serverless version. Has anyone in the community successfully connected Flink to OpenSearch Serverless? If so, could you share what configuration was needed? Or are there any known workarounds for this 403 error? Any help or guidance would be greatly appreciated. Thanks in advance!
