Kyle Weaver created BEAM-12905:
----------------------------------

             Summary: Garbage collect old Dataproc clusters.
                 Key: BEAM-12905
                 URL: https://issues.apache.org/jira/browse/BEAM-12905
             Project: Beam
          Issue Type: New Feature
          Components: testing
            Reporter: Kyle Weaver


We use Dataproc clusters for Flink load tests. The tests are configured to 
delete the clusters after use, but if something goes wrong with Jenkins the 
teardown step might not be run. When this happens, we should do periodic 
cleanup in a separate cron job to prevent buildup. Similar to how we delete old 
Dataflow jobs inĀ 
https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_CancelStaleDataflowJobs.groovy



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to