tokoko commented on PR #19051: URL: https://github.com/apache/airflow/pull/19051#issuecomment-1616106423
@dstandish Hi, has this effort gone anywhere since this PR? I couldn't really find any discussion about the topic other than AIP. If you think this problem is still worth solving, don't you think now the right place to implement this would be extending functionality around datasets? Airflow datasets already sort of have a place to store state (meaning `extra` dictionary) both for current value in `DatasetModel` and historical changes in `DatasetEvent`. There's also already a mechanism for task instances to communicate dataset changes, albeit currently without any state information. Maybe I'm missing something, but seems like some of the heavy lifting necessary for this AIP has already been done with datasets. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
