Abacn commented on issue #22303: URL: https://github.com/apache/beam/issues/22303#issuecomment-1374949407
Apparently Kafka performance test is failing again after #24879 in. This is because we removed `shuffle=appliance` there and then read from shuffle becomes faster. There are some reports that runner v2 is putting more pressure on kafka, and resulting in higher error rate. Now kafka server is overwhelmed with write requests and making write pipeline fail. This reveals real issue of the code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
