liferoad commented on issue #19899: URL: https://github.com/apache/beam/issues/19899#issuecomment-2727019145
Tested this with this using `gs://test`, which I do not have the access: ``` cd sdks/python pip install build && python -m build --sdist scripts/run_integration_test.sh --test_opts apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it \ --kms_key_name "" \ --project manav-jit-test \ --gcs_location gs://test \ --num_workers 2 \ --runner TestDataflowRunner \ --sdk_location /Users/xqhu/Dev/beam/sdks/python/dist/apache_beam-2.64.0.dev0.tar.gz ``` Not we report this with the GCS library: ``` INFO apache_beam.runners.dataflow.internal.apiclient:apiclient.py:670 Starting GCS upload to gs://test/staging-it/beamapp-xqhu-0315215903-804692-bmvgfb43.1742075943.804804/dataflow_python_sdk.tar... WARNING apache_beam.utils.retry:retry.py:313 Retry with exponential backoff: waiting for 9.165690431692092 seconds before retrying stage_file_with_retry because we caught exception: OSError: Could not upload to GCS path gs://test/staging-it/beamapp-xqhu-0315215903-804692-bmvgfb43.1742075943.804804: 403 GET https://storage.googleapis.com/storage/v1/b/test?projection=noAcl&prettyPrint=false: [email protected] does not have storage.buckets.get access to the Google Cloud Storage bucket. Permission 'storage.buckets.get' denied on resource (or it may not exist).. Please verify that credentials are valid, that the specified path exists, and that you have write access to it. Traceback for above exception (most recent call last): File "/Users/xqhu/Dev/beam/sdks/python/apache_beam/utils/retry.py", line 298, in wrapper return fun(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^ File "/Users/xqhu/Dev/beam/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py", line 711, in stage_file_with_retry self.stage_file( File "/Users/xqhu/Dev/beam/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py", line 691, in stage_file raise IOError(( ``` Close this given we do return the Permission error now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
