phaneendrareddy345 opened a new issue, #40785: URL: https://github.com/apache/airflow/issues/40785
### Description It would be really great, If we can schedule DAG's based on Upstream Dags. For example, dag_c is dependent on dag_a and dag_b. Instead of using sensors and waiting for these 2 upstream tasks to finish, what if we can simply mention schedule is dependent on dag_a, dag_b something similar to outlets I have implement something similar outside of airflow using GCP BigQuery, Cloud Function and Pub Sub. This is to schedule dags based on table events, that means whenever a specific table gets loaded the respective dependent dag will be triggered, I have created a variable in .py file called __bq_table_dependecies__ to parse the dag dependencies. Similar way to we do this internally with Airflow dag, that would be really helpful, the same feature is available in legacy scheduler like Control M You can watch my youtube video here: https://youtu.be/nLdTAp9n5Gg Blog: https://phaneendrareddyp.medium.com/airflow-custom-event-based-bigquery-table-dependencies-09597727ae35 Please reach out to [email protected] for further discussions and clarifications ### Use case/motivation _No response_ ### Related issues _No response_ ### Are you willing to submit a PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
