Hello, I would love your help with an issue I have.
Since multi threading isn't great with Python, I would like to create a PythonOperator that utilizes multi processing inside it, in a Producer Consumers design with a Queue. Is that even possible inside a DAG? Will that be supported with an Airflow DAG without causing unwanted behaviors? Does anyone have any experience creating such a DAG? Thank you all, Chen.
