timblakely commented on issue #27605: URL: https://github.com/apache/beam/issues/27605#issuecomment-1652337193
> Thanks for reporting! What happens if you delete `gs://blakely_dev/_staging/iteration/1/` ? Note that in GCS there is no concept of directories. there are buckets and objects. / is just a symbol in the object name. Yup, I'm aware :) That does remove all the objects, but doesn't "recursively" work. FYI the `match()` function seems to function slightly differently than the [GCS py client](https://cloud.google.com/python/docs/reference/storage/latest/google.cloud.storage.bucket.Bucket#google_cloud_storage_bucket_Bucket_list_blobs)'s `bucket.list_blobs()` as that takes a `prefix` and `delimiter` that, if the prefix ends with the delimiter, will return both `delimiter`-separated "directories" and the files with that prefix. If no `delimiter` is passed, it matches _all_ files with the prefix, which is what it would seem that `match()` is intending to do (at least from the docstring :). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
