damccorm opened a new issue, #21191:
URL: https://github.com/apache/beam/issues/21191

   FR to create a solution to clean up lingering GCE, VMs, Dataproc clusters, 
etc.
   
   Some sort of perodic job which runs and deletes leaked GCE VMs would prevent 
the resource concerns caused by failed tests as in: 
   
   https://issues.apache.org/jira/browse/BEAM-12898
   
   Possible solutions:
    * Name all the resources with a convention that represents a TTL. Then the 
resources can be deleted by a cron/periodic job if the TTL has expired
    * Dataproc cluster may have a TTL configuration option itself which the 
flink on dataproc test can use.
   * Similar to how we delete old Dataflow jobs in 
https://github.com/apache/beam/blob/master/.test-infra/jenkins/job_CancelStaleDataflowJobs.groovy
   
    
   
   Imported from Jira 
[BEAM-12903](https://issues.apache.org/jira/browse/BEAM-12903). Original Jira 
may contain additional context.
   Reported by: [email protected].


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to