Abacn commented on PR #23305: URL: https://github.com/apache/beam/pull/23305#issuecomment-1306235934
Hi, it looks like the new SparkReceiverIO performance test adds a persistent rabbitMQ server to the io-datastore k8s cluster in the test infrastructure. Then both rabbitmq and kafkaIO requests ~1 GB RAM and Kafka workload fails to initialize since Nov 3 (SparkReceiverIO performance test also fails since then). Can we make rabbitmq server deployment transcient and cleanup in integration test cleanup, as the kafka performance test is doing? If not we should bump the machine type for the k8s cluster. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
