HansMarcus01 opened a new pull request, #39538: URL: https://github.com/apache/beam/pull/39538
This pull request introduces a new cleanup rule that identifies orphaned subscriptions for the topic related to taxirides. ## Problem detected - An accumulation of over 500 orphaned subscriptions with random names like `taxirides-realtime_beam_-...` was identified, connected to the public, continuous New York taxi topic. ## Solution - **`stale_cleaner.py`**: `PubSubSubscriptionCleaner` was modified to evaluate and mark for deletion subscriptions with the prefix `taxirides-realtime_beam_` that are older than 24 hours, even if they are not in the `detached` state (since the NY taxi topic is permanent and public). - **`test_stale_cleaner.py`**: Unit tests were added to validate this specific taxi-related criterion in isolation, ensuring that other subscriptions remain intact and safe. The document describing the justification for cleaning this resource can be found at the following link: https://gist.github.com/HansMarcus01/101c53d0e9fa6179a5f631b59324df96 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
