GitHub user wjddn279 added a comment to the discussion: Discussion: Preventing COW in LocalExecutor Workers
Yes, I think applying this to other cases that use fork, such as DagFileProcessor, could also provide performance benefits. Since objects loaded in memory initially have a very low probability of being garbage collected, moving them to the permanent generation to reduce GC overhead could have a positive impact in fork scenarios. Of course, this needs testing. Additionally, this approach could potentially prevent [unintended issues caused by GC](https://github.com/apache/airflow/pull/56044) in forked processes. GitHub link: https://github.com/apache/airflow/discussions/58143#discussioncomment-14932922 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
