GreenGrassBlueOcean edited a comment on issue #13317: URL: https://github.com/apache/airflow/issues/13317#issuecomment-754206670
This issue does also occur when running airflow with multiple nodes and airflow (1.10.11) has one of its nodes run in at higher python version in my case one node is running at 3.8.5. and another at 3.7.7. As indicated here: [(https://stackoverflow.com/questions/23582489/python-pickle-protocol-choice)] pickle protocol: 5 Protocol can only be used in python > 3.8. The remarkable thing however is that some dags run fine (even on the 3.8.5. node), and others have suddenly a problem and do not run at all any more. Did some further research on this particular DAG. It proved to be the case that the process was already manually started on the node (physical login on pc and start from terminal over there). After a reboot of the node the DAG run normal again ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
