potiuk commented on pull request #11069: URL: https://github.com/apache/airflow/pull/11069#issuecomment-696696014
Looking at the errors/timeouts. I think we still drag too many things with the run method. I am still figuring out how exactly multiprocessing.Process pickles it's `run` parameter. Seems that making the method static did not help. @ashb - I'd love to understand how it works. Maybe you can explain what happens here? This is very interesting, but looks like we are trying to send half ot Airflow objects between the processes with that single run= method. BTW. Did I tell too many times, that I hate multiprocessing? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
