paavanb edited a comment on issue #20073: URL: https://github.com/apache/airflow/issues/20073#issuecomment-986977900
Would love to see this feature! Scheduling DAGs is a killer feature, but without custom parameters, I have to create a new DAG for each set of custom parameters, and schedule them separately. I'm surprised that I can specify custom parameters for manual triggers, but not scheduled ones. For example, suppose I have a data processing DAG that is parameterized by the dataset to pull in (so the task just reads `dag_run.conf`). I'd like to schedule it differently for different datasets. Obviously, I can't infer which dataset to process just based on the cron expression: I might use the same cron schedule for different datasets! Do you know the best way to handle this without having to create a different dag for each possible parameter value? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
