ashb edited a comment on issue #5615: [AIRFLOW-5035] Remove multiprocessing.Manager in-favour of Pipes URL: https://github.com/apache/airflow/pull/5615#issuecomment-514799557 @KevinYang21 Yeah, I'm not thrilled with the idea of a performance regression either! Basically the _possible_ regression comes from the fact that `send()`/`recv()` on the pipe will block the sending end once the small internal buffer is filled. Using a Manager had a buffer on the sending side and a thread to push messages in to the pipe as space becomes available.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
