Hi everyone, Currently, there is no easy way to manage an Airflow cluster that contains multiple teams and python based DAGS. I submitted the following AIP with a suggestion how to make the venv management part of the Airflow executors lifecycle and would love to get your feedback.
My suggestion should be pretty easy to implement and will help the users with python packages deployments. AIP: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-37+Virtualenv+management+inside+Airflow Issue: https://github.com/apache/airflow/issues/13364 Please let me know if you have any questions or suggestions on how to improve this solution, or if you disagree with my approach. Thanks, Zacharya.
