Anil Kumar created AIRFLOW-2104: ----------------------------------- Summary: Recommendation for Airflow design/architecture Key: AIRFLOW-2104 URL: https://issues.apache.org/jira/browse/AIRFLOW-2104 Project: Apache Airflow Issue Type: Improvement Components: celery, configuration, DagRun Affects Versions: 1.9.0 Reporter: Anil Kumar Fix For: 1.9.0
Hello, We are implementation phase for Apache Airflow and looking for Recommendation on Airflow configuration/structure. Which one will be best # Airflow standalone installation with multi worker nodes or # Airflow running as docker image on Kubernetes Requirement :- We are suppose to schedule a long running ETL process that includes complex unzip/decrypt task, execution of data wrangling UDF's. -- This message was sent by Atlassian JIRA (v7.6.3#76005)