Hi all, I’m not sure if the Astronomer team has already started work on implementing *AIP-76*, but I’ve prepared a proposal for how we could approach the implementation.
The proposal covers: - Extending the asset/event model to support partitions - A normalized schema for asset event partitions - Watermark- and completeness-based scheduling (daily/weekly/monthly and optional rolling windows) - Handling of re-processed partitions You can find the proposal document here: https://docs.google.com/document/d/17RMpjronpNerqHBN-KwNn0jjscrSYJzSDhAakentfd0/edit?usp=sharing I’d appreciate your feedback and review. My suggestion is that we start implementation after the *Airflow 3.1 release.* Looking forward to your thoughts, Hussein
