Shimotsuk1-Rei commented on issue #65708:
URL: https://github.com/apache/airflow/issues/65708#issuecomment-4458166525

   well I think things are the same under v3.1.8 with python3.10, worker logs 
as follow:
   
   worker log
   ```
   [2026-05-14T12:21:08.507917Z] {celery_executor_utils.py:193} INFO - 
[ed8da700-f2f2-48aa-b3b3-8faf4ffa3f49] Executing workload in Celery: 
token='eyJ***' ti=TaskInstance(id=UUID('019e266e-b5e5-7e40-b3ec-a6eba4da280e'), 
dag_version_id=UUID('019ce048-3d97-724d-bcc8-5d02fda96c3b'), 
task_id='upload_result', dag_id='prod_dump_input_set', 
run_id='prod_job_7866110', try_number=1, map_index=-1, pool_slots=1, 
queue='default', priority_weight=2, executor_config=None, 
parent_context_carrier={}, context_carrier={}) 
dag_rel_path=PurePosixPath('prod/dump_input_set.py') 
bundle_info=BundleInfo(name='dags-folder', version=None) 
log_path='dag_id=prod_dump_input_set/run_id=prod_job_7866110/task_id=upload_result/attempt=1.log'
 type='ExecuteTask'
   ```
   
   we can see the TI UUID is: 019e266e-b5e5-7e40-b3ec-a6eba4da280e
   
   worker traceback log
   ```
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/sdk/api/client.py", 
line 226, in finish
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/sdk/execution_time/supervisor.py",
 line 1018, in update_task_state_if_needed
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/tenacity/__init__.py", line 
331, in wrapped_f
        May 14th 2026, 20:21:20.365         return copy(f, *args, **kw)
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/tenacity/__init__.py", line 
371, in iter
        May 14th 2026, 20:21:20.365         response = self._send_handling_auth(
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/httpx/_client.py", line 
1218, in patch
        May 14th 2026, 20:21:20.365         raise self._exception
        May 14th 2026, 20:21:20.365         result = fn(*args, **kwargs)
        May 14th 2026, 20:21:20.365         self.client.task_instances.finish(
        May 14th 2026, 20:21:20.365         raise exc
        May 14th 2026, 20:21:20.365         do = 
self.iter(retry_state=retry_state)
        May 14th 2026, 20:21:20.365         return self.send(request, 
auth=auth, follow_redirects=follow_redirects)
        May 14th 2026, 20:21:20.365       File 
"/usr/python/lib/python3.10/concurrent/futures/_base.py", line 451, in result
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/httpx/_client.py", line 942, 
in _send_handling_auth
        May 14th 2026, 20:21:20.365         
self.client.patch(f"task-instances/{id}/state", content=body.model_dump_json())
        May 14th 2026, 20:21:20.365         result = action(retry_state)
        May 14th 2026, 20:21:20.365         response = 
self._send_handling_redirects(
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/tenacity/__init__.py", line 
473, in __call__
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/httpx/_client.py", line 999, 
in _send_handling_redirects
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/sdk/api/client.py", 
line 887, in request
        May 14th 2026, 20:21:20.365         return get_json_error(response) or 
response.raise_for_status()
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/httpx/_client.py", line 982, 
in _send_handling_redirects
        May 14th 2026, 20:21:20.365         exit_code = process.wait()
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/tenacity/__init__.py", line 
470, in __call__
        May 14th 2026, 20:21:20.365         return super().request(*args, 
**kwargs)
        May 14th 2026, 20:21:20.365         raise err
        May 14th 2026, 20:21:20.365         self.update_task_state_if_needed()
        May 14th 2026, 20:21:20.365         hook(response)
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/httpx/_client.py", line 825, 
in request
        May 14th 2026, 20:21:20.365         return self.__get_result()
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/sdk/execution_time/supervisor.py",
 line 1004, in wait
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/httpx/_client.py", line 914, 
in send
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/sdk/api/client.py", 
line 176, in get_json_error
        May 14th 2026, 20:21:20.365         self._add_action_func(lambda rs: 
rs.outcome.result())
        May 14th 2026, 20:21:20.365     
airflow.sdk.api.client.ServerResponseError: Server returned error
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/sdk/api/client.py", 
line 180, in raise_on_4xx_5xx
        May 14th 2026, 20:21:20.365       File 
"/usr/python/lib/python3.10/concurrent/futures/_base.py", line 403, in 
__get_result
        May 14th 2026, 20:21:20.365       File 
"/home/airflow/.local/lib/python3.10/site-packages/tenacity/__init__.py", line 
393, in <lambda>
        May 14th 2026, 20:21:20.365         return self.request(
        May 14th 2026, 20:21:20.364         supervise(
        May 14th 2026, 20:21:20.364       File 
"/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 
479, in trace_task
        May 14th 2026, 20:21:20.364     [2026-05-14T12:21:20.364122Z] 
{trace.py:285} ERROR - Task 
execute_workload[ed8da700-f2f2-48aa-b3b3-8faf4ffa3f49] raised unexpected: 
ServerResponseError('Server returned error')
        May 14th 2026, 20:21:20.364       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/sdk/execution_time/supervisor.py",
 line 1993, in supervise
        May 14th 2026, 20:21:20.364     Traceback (most recent call last):
        May 14th 2026, 20:21:20.364       File 
"/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 
779, in __protected_call__
        May 14th 2026, 20:21:20.364         R = retval = fun(*args, **kwargs)
        May 14th 2026, 20:21:20.364         return self.run(*args, **kwargs)
        May 14th 2026, 20:21:20.364       File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/providers/celery/executors/celery_executor_utils.py",
 line 202, in execute_workload
   ```
   
   check apiserver log, status 409:
   ```
   
   May 14th 2026, 20:21:20.363 | 
/execution/task-instances/019e266e-b5e5-7e40-b3ec-a6eba4da280e/state | 409
   -- | -- | --
     | May 14th 2026, 20:21:08.707 | 
/execution/task-instances/019e266e-b5e5-7e40-b3ec-a6eba4da280e/rtif | 201
   
     | May 14th 2026, 20:21:08.647 | 
/execution/task-instances/019e266e-b5e5-7e40-b3ec-a6eba4da280e/heartbeat | 204
   
     | May 14th 2026, 20:21:08.622 | 
/execution/task-instances/019e266e-b5e5-7e40-b3ec-a6eba4da280e/run | 200
   
   
   ```
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to