EssKayz commented on issue #41359: URL: https://github.com/apache/airflow/issues/41359#issuecomment-3484894225
Experiencing the same on 3.0.6 and 3.1.0, and in addition to the same kind of logs as above referring to imports of `redis.client` failing due to attribute `client` not existing in module `redis` - we also get the following type of error, which seems to coincide with `kombu` as referred in https://github.com/celery/kombu/issues/2096 For now we've circumvented the errors by restarting the tasks, and/or restarting the scheduler container itself -> ``` Traceback (most recent call last): 2025-11-04T09:23:49.017062720Z File "/home/airflow/.local/lib/python3.13/site-packages/airflow/providers/celery/executors/celery_executor_utils.py", line 285, in send_task_to_executor 2025-11-04T09:23:49.017077209Z result = task_to_run.apply_async(args=args, queue=queue) 2025-11-04T09:23:49.017083616Z File "/home/airflow/.local/lib/python3.13/site-packages/celery/app/task.py", line 601, in apply_async 2025-11-04T09:23:49.017090179Z return app.send_task( 2025-11-04T09:23:49.017095688Z ~~~~~~~~~~~~~^ 2025-11-04T09:23:49.017101293Z self.name, args, kwargs, task_id=task_id, producer=producer, 2025-11-04T09:23:49.017106442Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-11-04T09:23:49.017111400Z ...<2 lines>... 2025-11-04T09:23:49.017117835Z **options 2025-11-04T09:23:49.017123467Z ^^^^^^^^^ 2025-11-04T09:23:49.017130394Z ) 2025-11-04T09:23:49.017135817Z ^ 2025-11-04T09:23:49.017140267Z File "/home/airflow/.local/lib/python3.13/site-packages/celery/app/base.py", line 835, in send_task 2025-11-04T09:23:49.017146556Z driver_type = self.producer_pool.connections.connection.transport.driver_type 2025-11-04T09:23:49.017352698Z ^^^^^^^^^^^^^^^^^^ 2025-11-04T09:23:49.017360239Z File "/home/airflow/.local/lib/python3.13/site-packages/celery/app/base.py", line 1486, in producer_pool 2025-11-04T09:23:49.017366293Z return self.amqp.producer_pool 2025-11-04T09:23:49.017371828Z ^^^^^^^^^^^^^^^^^^^^^^^ 2025-11-04T09:23:49.017377328Z File "/home/airflow/.local/lib/python3.13/site-packages/celery/app/amqp.py", line 597, in producer_pool 2025-11-04T09:23:49.017382945Z self.app.connection_for_write()] 2025-11-04T09:23:49.017388518Z ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ 2025-11-04T09:23:49.017393225Z File "/home/airflow/.local/lib/python3.13/site-packages/celery/app/base.py", line 958, in connection_for_write 2025-11-04T09:23:49.017398510Z return self._connection(url or self.conf.broker_write_url, **kwargs) 2025-11-04T09:23:49.017404724Z ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-11-04T09:23:49.017409435Z File "/home/airflow/.local/lib/python3.13/site-packages/celery/app/base.py", line 1009, in _connection 2025-11-04T09:23:49.017422022Z return self.amqp.Connection( 2025-11-04T09:23:49.017428061Z ~~~~~~~~~~~~~~~~~~~~^ 2025-11-04T09:23:49.017434370Z url, 2025-11-04T09:23:49.017440280Z ^^^^ 2025-11-04T09:23:49.017445384Z ...<16 lines>... 2025-11-04T09:23:49.017451074Z ), 2025-11-04T09:23:49.017456489Z ^^ 2025-11-04T09:23:49.017461154Z ) 2025-11-04T09:23:49.017467444Z ^ 2025-11-04T09:23:49.017472361Z File "/home/airflow/.local/lib/python3.13/site-packages/kombu/connection.py", line 201, in __init__ 2025-11-04T09:23:49.017490366Z if not get_transport_cls(transport).can_parse_url: 2025-11-04T09:23:49.017496762Z ~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 2025-11-04T09:23:49.017501868Z File "/home/airflow/.local/lib/python3.13/site-packages/kombu/transport/__init__.py", line 92, in get_transport_cls 2025-11-04T09:23:49.017508112Z _transport_cache[transport] = resolve_transport(transport) 2025-11-04T09:23:49.017514392Z ~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 2025-11-04T09:23:49.017521735Z File "/home/airflow/.local/lib/python3.13/site-packages/kombu/transport/__init__.py", line 77, in resolve_transport 2025-11-04T09:23:49.017529432Z return symbol_by_name(transport) 2025-11-04T09:23:49.017535059Z File "/home/airflow/.local/lib/python3.13/site-packages/kombu/utils/imports.py", line 59, in symbol_by_name 2025-11-04T09:23:49.017541389Z module = imp(module_name, package=package, **kwargs) 2025-11-04T09:23:49.017548595Z File "/usr/python/lib/python3.13/importlib/__init__.py", line 88, in import_module 2025-11-04T09:23:49.017555270Z return _bootstrap._gcd_import(name[level:], package, level) 2025-11-04T09:23:49.017560788Z ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-11-04T09:23:49.017566260Z File "<frozen importlib._bootstrap>", line 1387, in _gcd_import 2025-11-04T09:23:49.017572402Z File "<frozen importlib._bootstrap>", line 1360, in _find_and_load 2025-11-04T09:23:49.017578308Z File "<frozen importlib._bootstrap>", line 1331, in _find_and_load_unlocked 2025-11-04T09:23:49.017584170Z File "<frozen importlib._bootstrap>", line 935, in _load_unlocked 2025-11-04T09:23:49.017589625Z File "<frozen importlib._bootstrap_external>", line 1026, in exec_module 2025-11-04T09:23:49.017595561Z File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed 2025-11-04T09:23:49.017602214Z File "/home/airflow/.local/lib/python3.13/site-packages/kombu/transport/redis.py", line 83, in <module> 2025-11-04T09:23:49.017608422Z import redis 2025-11-04T09:23:49.017613630Z File "/home/airflow/.local/lib/python3.13/site-packages/redis/__init__.py", line 3, in <module> 2025-11-04T09:23:49.017620365Z from redis import asyncio # noqa 2025-11-04T09:23:49.017626303Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-11-04T09:23:49.017631071Z File "/home/airflow/.local/lib/python3.13/site-packages/redis/asyncio/__init__.py", line 1, in <module> 2025-11-04T09:23:49.017637777Z from redis.asyncio.client import Redis, StrictRedis 2025-11-04T09:23:49.017643847Z File "/home/airflow/.local/lib/python3.13/site-packages/redis/asyncio/client.py", line 43, in <module> 2025-11-04T09:23:49.017650325Z from redis.client import ( 2025-11-04T09:23:49.017655501Z ...<4 lines>... 2025-11-04T09:23:49.017668250Z ) 2025-11-04T09:23:49.017673320Z File "/home/airflow/.local/lib/python3.13/site-packages/redis/client.py", line 17, in <module> 2025-11-04T09:23:49.017680386Z from redis.commands import ( 2025-11-04T09:23:49.017686879Z ...<4 lines>... 2025-11-04T09:23:49.017692458Z ) 2025-11-04T09:23:49.017697561Z File "/home/airflow/.local/lib/python3.13/site-packages/redis/commands/__init__.py", line 1, in <module> 2025-11-04T09:23:49.017703425Z from .cluster import READ_COMMANDS, AsyncRedisClusterCommands, RedisClusterCommands 2025-11-04T09:23:49.017709407Z File "/home/airflow/.local/lib/python3.13/site-packages/redis/commands/cluster.py", line 29, in <module> 2025-11-04T09:23:49.017715663Z from .core import ( 2025-11-04T09:23:49.017720976Z ...<15 lines>... 2025-11-04T09:23:49.017726774Z ) 2025-11-04T09:23:49.017738602Z File "/home/airflow/.local/lib/python3.13/site-packages/airflow/sdk/execution_time/timeout.py", line 38, in handle_timeout 2025-11-04T09:23:49.017745729Z raise AirflowTaskTimeout(self.error_message) 2025-11-04T09:23:49.017751654Z airflow.exceptions.AirflowTaskTimeout: Timeout, PID: 153``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
