johnjcasey commented on PR #29400: URL: https://github.com/apache/beam/pull/29400#issuecomment-1821286841
You could take one of the tests in KafkaIOIT. You could do something like create a read pipeline, and verify that when consuming from an empty topic, the timeout changes as well. Then, with that pipeline still running, run a pipeline that publishes a lot of data to Kafka to verify it scales the other direction. Its a bit of a tricky test case, so I'm not sure it would be worth it, as I imagine it will end up flaky. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
