potiuk commented on issue #37131: URL: https://github.com/apache/airflow/issues/37131#issuecomment-1948137100
We are talking unix/posix/os fork here - not any python-level library - same as we do in DagFileProcessor to parse DAGs and TaskRunner already to run our tasks - for very similar reasons, we want to make new process to start doing stuff (importing and running things) but at the same time start from pre-initialized Python interpreter where most of the heap and "common" code is already imported and initialized. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
