xBis7 commented on code in PR #70014: URL: https://github.com/apache/airflow/pull/70014#discussion_r3604191241
########## providers/apache/kafka/docs/configurations-ref.rst: ########## @@ -24,27 +24,41 @@ Highlighted configurations =========================== -The ``[kafka_listener]`` section configures the ``KafkaListenerPlugin``, +The ``[kafka_event_producer]`` section configures the ``KafkaEventProducerPlugin``, which publishes Airflow DagRun and TaskInstance state-change events to a Kafka topic. DagRun and TaskInstance events are separated and enabled by distinct flags. Both event-type flags default to ``False``. -.. _configuration_kafka_listener_activation:kafka: +.. _configuration_kafka_event_producer_use_cases:kafka: -Activating the listener ------------------------ +Common use-cases +---------------- + + * Consume the Kafka events by an external observability or analytics tool and gather info about the state + of multiple Airflow instances without polling their metadata DBs. + * Based on the state of a DagRun, trigger a downstream external system/pipeline (notifications, alerting, + cross-team handoffs) without direct interaction with Airflow. + * Coordinate dags across multiple Airflow instances over a shared Kafka service. Review Comment: Fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
