Łukasz Gajowy created BEAM-4041: ----------------------------------- Summary: Performance tests fail due to kubernetes load balancer problems Key: BEAM-4041 URL: https://issues.apache.org/jira/browse/BEAM-4041 Project: Beam Issue Type: Bug Components: testing Reporter: Łukasz Gajowy Assignee: Jason Kuster
Recently, as we added more IOITs to be run on jenkins using kubernetes, some of them started to fail randomly, because they couldn't retrieve LoadBalancer address. Normally obtaining the address took about one minute. Perfkit waits for the address (actively checking for it) for 3 minutes. This should be enough for getting the address, yet it recently started to exceed the 3 minutes limit. I also noticed that this error didn't happen when there were fewer tests. Example logs: https://builds.apache.org/view/A-D/view/Beam/job/beam_PerformanceTests_Compressed_TextIOIT_HDFS/31/console -- This message was sent by Atlassian JIRA (v7.6.3#76005)