Kyle Weaver created BEAM-12905:
----------------------------------
Summary: Garbage collect old Dataproc clusters.
Key: BEAM-12905
URL: https://issues.apache.org/jira/browse/BEAM-12905
Project: Beam
Issue Type: New Feature
Components: testing
Reporter: Kyle Weaver
We use Dataproc clusters for Flink load tests. The tests are configured to
delete the clusters after use, but if something goes wrong with Jenkins the
teardown step might not be run. When this happens, we should do periodic
cleanup in a separate cron job to prevent buildup. Similar to how we delete old
Dataflow jobs inĀ
https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_CancelStaleDataflowJobs.groovy
--
This message was sent by Atlassian Jira
(v8.3.4#803005)