aIbrahiim commented on issue #30513: URL: https://github.com/apache/beam/issues/30513#issuecomment-5045308280
hey, i dug into the latest postcommit failures a bit and think i found what's going on. looking at recent runs (e.g. https://github.com/apache/beam/actions/runs/29896319687), the job is failing on the cross-language KafkaIO tests with: ``` TimeoutException: Topic xlang_kafkaio_test_... not present in metadata after 60000 ms. ``` so it looks like the Kafka producer can't fetch topic metadata in time (hits the default 60s timeout), which then blows up `KafkaWriter` and takes down the Flink job. feels more like a test infra / Kafka readiness timing issue than an actual Beam code bug. not sure yet what the best fix is — bumping producer timeouts, waiting for Kafka to be ready before the test, making sure topics get created, etc. — happy to help chase that down if someone has a preferred approach. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
