Anil Kumar created AIRFLOW-2104:

             Summary: Recommendation for Airflow design/architecture
                 Key: AIRFLOW-2104
             Project: Apache Airflow
          Issue Type: Improvement
          Components: celery, configuration, DagRun
    Affects Versions: 1.9.0
            Reporter: Anil Kumar
             Fix For: 1.9.0


We are implementation phase for Apache Airflow and looking for Recommendation 
on Airflow configuration/structure.

Which one will be best
 # Airflow standalone installation with multi worker nodes or
 # Airflow running as docker image on Kubernetes

Requirement :-

We are suppose to schedule a long running ETL process that includes complex 
unzip/decrypt task, execution of data wrangling UDF's.

This message was sent by Atlassian JIRA

Reply via email to