zachliu commented on issue #49887:
URL: https://github.com/apache/airflow/issues/49887#issuecomment-2859981811

   i think i've found the problem: as long as `Variable` is used. `lsof` 
results (`type=STREAM (CONNECTED)`) keep growing:
   
   ```python
   """Test"""
   
   # airflow DAG
   
   from airflow.models import Variable
   from airflow.models.dag import DAG
   from airflow.operators.empty import EmptyOperator
   from airflow.timetables.trigger import CronTriggerTimetable
   from pendulum import datetime
   
   LOCAL_TZ = "UTC"
   
   accounts = Variable.get(
       "dummy_accounts",
       default_var=["dummy"],
       deserialize_json=True,
   )
   
   with DAG(
       dag_id="dummy_daily",
       schedule=CronTriggerTimetable("@daily", timezone=LOCAL_TZ),
       start_date=datetime(2025, 5, 1, tz=LOCAL_TZ),
       max_active_runs=3,
       catchup=False,
       tags=["flag"],
   ):
       for account in accounts:
           step_1 = EmptyOperator(task_id=f"{account}_step_1")
           step_2 = EmptyOperator(task_id=f"{account}_step_2")
           step_1 >> step_2
   ```
   
   replace the `Variable` with `accounts = ["dummy", "drummer"]`, everything is 
hunky-dory


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to