GitHub user SuaveCharlie added a comment to the discussion: Dataset aware scheduling - is there a way to reset DAG?
@Amin-Siddique that's exactly what I've done too; task at the start of any Dataset triggered dags that inspects when the dataset was updated and whether it's within an expected tolerance. I'm surprised there isn't more noise about this key flaw of Datasets! GitHub link: https://github.com/apache/airflow/discussions/36618#discussioncomment-12448658 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
