potiuk commented on issue #20073: URL: https://github.com/apache/airflow/issues/20073#issuecomment-987004580
I think you just (same story) do not really get the powers it gets you to use Python to define the variations and not "declarative" way. That's a basic misunderstanding of how Airflow works. You ARE supposed to generate multiple DAGs using DAG Factories. This is how in Airflow you define parameterized DAGs. This is the only pattern that will work - and we have the whole tutorial on how to do it: https://airflow.apache.org/docs/apache-airflow/stable/best-practices.html#dynamic-dag-generation The way how you can do it involves storing your parameters in a json file. environment variables, or even generated DAG code. Simply - use your parameters, to generate DAGs, not the other way round. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
