GitHub user mandar14 added a comment to the discussion: Airflow[v2.11.0] Celery
worker CPU starvation
Further inputs,
We removed all dags, only kept hello world dag.
Still pre-task, still take 10-12sec this time frame was previously with a
second.
`[2026-02-18, 11:03:15 IST] {local_task_job_runner.py:123} ▼ Pre task execution
logs
[2026-02-18, 11:03:19 IST] {taskinstance.py:2631} INFO - Dependencies all met
for dep_context=non-requeueable deps
ti=<TaskInstance: hello_world.ingestion_adhoc_test
manual__2026-02-18T11:02:39+05:30 [queued]>
[2026-02-18, 11:03:19 IST] {taskinstance.py:2631} INFO - Dependencies all met
for dep_context=requeueable deps
ti=<TaskInstance: hello_world.ingestion_adhoc_test
manual__2026-02-18T11:02:39+05:30 [queued]>
[2026-02-18, 11:03:19 IST] {taskinstance.py:2884} INFO - Starting attempt 1 of 2
[2026-02-18, 11:03:19 IST] {taskinstance.py:2907} INFO - Executing
<Task(SSHOperator): ingestion_adhoc_test>
on 2026-02-18 05:32:39+00:00
[2026-02-18, 11:03:19 IST] {standard_task_runner.py:72} INFO - Started process
1660900 to run task
[2026-02-18, 11:03:19 IST] {standard_task_runner.py:104} INFO - Running:
['airflow', 'tasks', 'run', 'hello_world', 'ingestion_adhoc_test',
'manual__2026-02-18T11:02:39+05:30', '--job-id', '123383',
'--raw', '--subdir', 'DAGS_FOLDER/hello_world.py',
'--cfg-path', '/tmp/tmptkrhgsui']
_**[2026-02-18, 11:03:19 IST] {standard_task_runner.py:105} INFO - Job 123383:
Subtask ingestion_adhoc_test**_
_**[2026-02-18, 11:03:33 IST] {task_command.py:467} INFO - Running
<TaskInstance: hello_world.ingestion_adhoc_test
manual__2026-02-18T11:02:39+05:30 [running]>
on host dcidpappprr11.idfcbank.com**_
[2026-02-18, 11:03:47 IST] {taskinstance.py:3157} INFO - Exporting env vars:
AIRFLOW_CTX_DAG_OWNER='airflow'
AIRFLOW_CTX_DAG_ID='hello_world'
AIRFLOW_CTX_TASK_ID='ingestion_adhoc_test'
AIRFLOW_CTX_EXECUTION_DATE='2026-02-18T05:32:39+00:00'
AIRFLOW_CTX_TRY_NUMBER='1'
AIRFLOW_CTX_DAG_RUN_ID='manual__2026-02-18T11:02:39+05:30'`
GitHub link:
https://github.com/apache/airflow/discussions/62065#discussioncomment-15844695
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
