VikSil commented on issue #43569:
URL: https://github.com/apache/airflow/issues/43569#issuecomment-2466415572
We were able to reproduce the issue with guidance from @potiuk during Man's
hackathon. The environment was set up with Breeze integration to Kafka, and the
environment was started by running:
breeze start-airflow --integration kafka --load-example-dags
--load-default-connections
We also, tried to add Kafka credentials in
`/airflow/scripts/ci/docker-compose/integration-kafka.yml` file.
There appears to be two ways to do it:
1. as suggested
[here](https://docs.mia-platform.eu/docs/fast_data/bucket_storage_support/configuration/kafka_connection_configuration):
KAFKA_USERNAME: 'admin'
KAFKA_PASSWORD: 'secret'
KAFKA_SASL_MECHANISM: SCRAM-SHA-256
2. as suggested
[here](https://docs.informatica.com/integration-cloud/data-integration-connectors/current-version/kafka-connector/kafka-connections/configuring-sasl-plain-authentication-for-a-kafka-broker.html):
KAFKA_SASL_MECHANISM: PLAIN
KAFKA_SASL_JAAS_CONFIG:
"org.apache.kafka.common.security.plain.PlainLoginModule required
username=\"kafka-user\" password=\"kafka-password\";"
With either configuration the Kafka container starts, up and Airflow marks
the `ConsumeFromTopicOperator` task as `success`.
Furthermore, we noticed that the connection to bootstrap server
"hello.com:9092" that we used does not lead anywhere. When entered into the
browser the lookup lasts forever. `https://hello.com/` is a project that has
been discontinued.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
