noheton commented on PR #28545:
URL: https://github.com/apache/airflow/pull/28545#issuecomment-1386802509

   Is this related to using S3-compatible object stores?
   Currently our custom X-Com interface using a local minio instance does no 
longer work.
   
   ```python
   import os
   from airflow.models.connection import Connection
   
   from airflow.providers.amazon.aws.hooks.s3 import S3Hook
   
   conn = Connection(
       conn_id="aws_default",
       conn_type="aws",
       login="<REDACTED>",  # Reference to AWS Access Key ID
       password="<REDACTED>",  # Reference to AWS Secret Access Key
       extra={
           # Specify extra parameters here
           "region_name": "eu-central-1",
           "endpoint_url": "http://localhost:9000";,
       },
   )
   
   # Generate Environment Variable Name and Connection URI
   env_key = f"AIRFLOW_CONN_{conn.conn_id.upper()}"
   conn_uri = conn.get_uri()
   print(f"{env_key}={conn_uri}")
   # Test connection
   os.environ[env_key] = conn_uri
   print(conn.test_connection())
   ```
   
   This fails with 
   ```
   [2023-01-18 11:08:08,825] {connection_wrapper.py:303} INFO - AWS Connection 
(conn_id='aws_default', conn_type='aws') credentials retrieved from login and 
password.
   (False, 'An error occurred (InvalidParameterValue) when calling the 
GetCallerIdentity operation: Unsupported action GetCallerIdentity')
   ```
   I get the same message when I try to setup the connection in airflow 
directly.
   
   Currently we're looking into a workaround using boto3 directly, which still 
works fine with minio, but we would prefer to use a more integrated solution.
   
   Thanks for any advice.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to