liferoad opened a new issue, #34834:
URL: https://github.com/apache/beam/issues/34834

   ### What happened?
   
   This could be slow:
   
   ```
   
   File
   
"/Users/jinholee/Library/Caches/pypoetry/virtualenvs/moloco-forest-q8jAuzyK-py3.10/lib/python3.10/site-packages/apache_beam/io/gcp/bigquery_read_internal.py",
   line 122, in process
   
   FileSystems.delete(list(gcs_locations))
   
   
   File
   "/usr/local/lib/python3.10/site-packages/apache_beam/io/filesystems.py",
   line 379, in delete
   
   return filesystem.delete(paths)
   
   
   File
   
"/usr/local/lib/python3.10/site-packages/apache_beam/io/gcp/gcsfilesystem.py",
   line 357, in delete
   
   self._gcsIO().delete(path, recursive=True)
   
   
   File
   "/usr/local/lib/python3.10/site-packages/apache_beam/io/gcp/gcsio.py", line
   271, in delete
   
   self._delete_blob(bucket, [blob.name](http://blob.name/))
   
   
   File
   "/usr/local/lib/python3.10/site-packages/apache_beam/io/gcp/gcsio.py", line
   290, in _delete_blob
   
   bucket.delete_blob(
   
   
   File "/usr/local/lib/python3.10/contextlib.py", line 79, in inner
   
   return func(*args, **kwds)
   
   
   File
   "/usr/local/lib/python3.10/site-packages/google/cloud/storage/bucket.py",
   line 1765, in delete_blob
   
   client._delete_resource(
   
   
   File
   "/usr/local/lib/python3.10/site-packages/google/cloud/storage/client.py",
   line 792, in _delete_resource
   
   return self._connection.api_request(
   
   
   File
   "/usr/local/lib/python3.10/site-packages/google/cloud/storage/_http.py",
   line 90, in api_request
   
   return call()
   
   
   File
   
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py",
   line 293, in retry_wrapped_func
   
   return retry_target(
   
   
   File
   
"/opt/apache/beam-venv/beam-venv-worker-sdk-0-0/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py",
   line 144, in retry_target
   
   result = target()
   
   
   File
   "/usr/local/lib/python3.10/site-packages/google/cloud/_http/__init__.py",
   line 482, in api_request
   
   response = self._make_request(
   
   ```
   
   ### Issue Priority
   
   Priority: 2 (default / most bugs should be filed as P2)
   
   ### Issue Components
   
   - [x] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [x] Component: IO connector
   - [ ] Component: Beam YAML
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Infrastructure
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to