vincbeck commented on PR #68082: URL: https://github.com/apache/airflow/pull/68082#issuecomment-4994637353
I went through the PR and here is what I think. This is not a replacement or alternative of asset watcher, they serve 2 different purposes: - Asset watcher. Schedule/trigger dags based on external event such as a message in Kafka topic - This PR. Emit events to kafka topic on dag run and task instance state change The name listener is definitely confusing so we should change that. Here are some idea on how we could call it: - Event publisher - Event exporter - Event forwarder - Event reporter Not related but side comment on this one. If we know this is a business case needed by users we should make it a Airflow feature (with providers being able to hook their implementation such as Kafka) as opposed to a Kafka feature. @vikramkoka -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
