downeyh opened a new issue #13298:
URL: https://github.com/apache/airflow/issues/13298


   **Apache Airflow version**:
   2.0
   
   **Environment**:
   Python3.6
   
   
   **What happened**:
   I used mutiprocessing Process in PythonOperator callable function, but it 
reports an error.
   
     File "/home/xxx/airflow/dags/Gen/SecData.py", line 88, in gen
       w.start()
     File "/usr/lib64/python3.6/multiprocessing/process.py", line 103, in start
       'daemonic processes are not allowed to have children'
   AssertionError: daemonic processes are not allowed to have children
   
   **What you expected to happen**:
   In airflow1.10, I could use multiprocessing in task function, it works well,
   I'm not sure if is't a bug or there are other ways to use multiporcessing in 
PythonOperator task function.
   
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to