potiuk commented on PR #56044: URL: https://github.com/apache/airflow/pull/56044#issuecomment-3715261299
> @ wjddn279, do you know if there is any final decision on the approach here? We are also facing the same issue, and by applying your PR changes, it gets fixed. The workaround doesn't seem that intuitive to me, in my opinion, so it's better to have a proper fix. I am all about merging it once rebasing and making green - we know the root cause, we know that gc and forks do not work well together because a) COW and this race condition - and similar approach was used in local executor and benchmarks shown that it's a good idea to deliberately handle gc on forking (and it follows the recommendations that were posted when gc.freeze() has been implemented in 3.7). So I see no issue in following this one up - as long as it's green, rebased and tested. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
