wilsonhooi86 commented on issue #55007: URL: https://github.com/apache/airflow/issues/55007#issuecomment-3616231088
Good Day @digvijay-y , may I know which airflow version was this issue resolved? Can we reopen this issue? Recently we are using below airflow provider version but the error still persist. Apache Airflow Provider(s) amazon Versions of Apache Airflow Providers apache-airflow-providers-amazon==9.17.0 Apache Airflow version Airflow 2.10.3 Deployment MWAA Airflow <img width="1433" height="638" alt="Image" src="https://github.com/user-attachments/assets/d1665f68-d8db-4b09-9910-6903622c18f6"; /> ``` ip-100-65-41-135.eu-central-1.compute.internal *** Reading remote log from Cloudwatch log_group: airflow-gtm-core-ostr-dev-euc1-mwaa-environment-public-sandbox-Task log_stream: dag_id=glo-src_can-innomar-prd/run_id=manual__2025-12-05T10_19_50.473718+00_00/task_id=glue_priority_class_1.alt_fund_d/attempt=1.log [Invalid date] {local_task_job_runner.py:123} ▶ Pre task execution logs [Invalid date] {glue.py:220} INFO - Initializing AWS Glue Job: gtm-core-dl-dev-euc1-glue-job-innomar. Wait for completion: True [Invalid date] {glue.py:454} INFO - Checking if job already exists: gtm-core-dl-dev-euc1-glue-job-innomar [Invalid date] {base.py:84} INFO - Retrieving connection 'aws_default' [Invalid date] {glue.py:241} INFO - You can monitor this Glue Job run at: https://console.aws.amazon.com/gluestudio/home?region=eu-central-1#/job/gtm-core-dl-dev-euc1-glue-job-innomar/run/jr_af011a908310600895274468813f904a9bb973c7791f83e9cb15ffe515e0cba0 [Invalid date] {taskinstance.py:288} INFO - Pausing task as DEFERRED. dag_id=glo-src_can-innomar-prd, task_id=glue_priority_class_1.alt_fund_d, run_id=manual__2025-12-05T10:19:50.473718+00:00, execution_date=20251205T101950, start_date=20251205T101955 [Invalid date] {taskinstance.py:340} ▶ Post task execution logs [Invalid date] {base.py:84} INFO - Retrieving connection 'aws_default' [Invalid date] {local_task_job_runner.py:123} ▶ Pre task execution logs [Invalid date] {baseoperator.py:1798} ERROR - Trigger failed: Traceback (most recent call last): File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/jobs/triggerer_job_runner.py", line 558, in cleanup_finished_triggers result = details["task"].result() ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/jobs/triggerer_job_runner.py", line 630, in run_trigger async for event in trigger.run(): File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/providers/amazon/aws/triggers/base.py", line 145, in run async with await hook.get_async_conn() as client: File "/usr/local/airflow/.local/lib/python3.11/site-packages/aiobotocore/session.py", line 25, in __aenter__ self._client = await self._coro ^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/aiobotocore/session.py", line 215, in _create_client client = await client_creator.create_client( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/aiobotocore/client.py", line 82, in create_client client_args = self._get_client_args( ^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/aiobotocore/client.py", line 291, in _get_client_args return args_creator.get_client_args( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/aiobotocore/args.py", line 99, in get_client_args ruleset_resolver = self._build_endpoint_resolver( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/aiobotocore/args.py", line 165, in _build_endpoint_resolver resolver_builtins = self.compute_endpoint_resolver_builtin_defaults( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: ClientArgsCreator.compute_endpoint_resolver_builtin_defaults() missing 2 required positional arguments: 'credentials' and 'account_id_endpoint_mode' [Invalid date] {taskinstance.py:3311} ERROR - Task failed with exception Traceback (most recent call last): File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 767, in _execute_task result = _execute_callable(context=context, **execute_callable_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/models/taskinstance.py", line 733, in _execute_callable return ExecutionCallableRunner( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/utils/operator_helpers.py", line 252, in run return self.func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/airflow/.local/lib/python3.11/site-packages/airflow/models/baseoperator.py", line 1799, in resume_execution raise TaskDeferralError(next_kwargs.get("error", "Unknown")) airflow.exceptions.TaskDeferralError: Trigger failure [Invalid date] {taskinstance.py:1225} INFO - Marking task as UP_FOR_RETRY. dag_id=glo-src_can-innomar-prd, task_id=glue_priority_class_1.alt_fund_d, run_id=manual__2025-12-05T10:19:50.473718+00:00, execution_date=20251205T101950, start_date=20251205T101955, end_date=20251205T102020 [Invalid date] {taskinstance.py:340} ▶ Post task execution logs ``` Thank you. Best Regards, Wilson -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
