msinha251 opened a new issue #20186: URL: https://github.com/apache/airflow/issues/20186
### Apache Airflow version 2.2.2 (latest released) ### What happened We are trying to use airflow EMRContainerOperator for EMR on EKS from airflow DAG. And following the the dag from [exmaple_emr_on_eks_dag](https://airflow.apache.org/docs/apache-airflow-providers-amazon/2.2.0/_modules/airflow/providers/amazon/aws/example_dags/example_emr_eks_job.html) DAG is creating the pod on eks cluster but stuck with below airflow ui logs and not proceeding further and after sometime ending up with **timeout** Error from airflow ui logs: `[2021-12-10, 00:10:15 UTC] Airflow Connection: aws_conn_id=aws_default` `[2021-12-10, 00:10:15 UTC] Unable to use Airflow Connection for credentials.` `[2021-12-10, 00:10:15 UTC] Fallback on boto3 credential strategy` `[2021-12-10, 00:10:15 UTC] Creating session using boto3 credential strategy region_name=None` On testing the task with below command from airflow web container, stuck on below and same as above after sometime ending up with timeout: `airflow tasks test emr_eks_pi_job start_job 2021-01-01` Error from airflow tasks test command: `[2021-12-10 00:08:09,139] {base_aws.py:201} INFO - Doing sts_client.assume_role to role_arn=arn:aws:iam::<------------>:role/EmrOnEksRole (role_session_name=airflow_aws_default)` `[2021-12-10 00:08:09,451] {base_aws.py:152} INFO - New credentials expiry_time:2021-12-10T01:08:09+00:00` ### What you expected to happen DAG should run and complete successfully. ### How to reproduce Deploy airflow 2.2.2 Copy the DAG from [exmaple_emr_on_eks_dag](https://airflow.apache.org/docs/apache-airflow-providers-amazon/2.2.0/_modules/airflow/providers/amazon/aws/example_dags/example_emr_eks_job.html) Run the dag or run _airflow tasks test command_ ### Operating System Debian 10 ### Versions of Apache Airflow Providers Airflow: 2.2.2 apache-airflow-providers-amazon==2.2.0 also tried with apache-airflow-providers-amazon==2.3.0 ### Deployment Other ### Deployment details Using EKS and argocd for deplyoment. ### Anything else _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
