Subham-KRLX opened a new pull request, #74048: URL: https://github.com/apache/airflow/pull/74048
Passing large `DagRun.conf` dictionaries through `StartupDetails` causes noticeable latency and memory overhead because the entire object tree is msgpack-encoded in the supervisor and decoded in the task runner. Transporting the configuration as a compact JSON string (`dag_run_conf_json`) and parsing it once in the child task runner avoids traversing and materializing large nested object graphs across the IPC channel. closes: #74025 --- ##### Was generative AI tooling used to co-author this PR? - [X] Yes — Claude (For pr description and code research) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
