[
https://issues.apache.org/jira/browse/BEAM-14014?focusedWorklogId=768511&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-768511
]
ASF GitHub Bot logged work on BEAM-14014:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 10/May/22 13:46
Start Date: 10/May/22 13:46
Worklog Time Spent: 10m
Work Description: ryanthompson591 commented on code in PR #17244:
URL: https://github.com/apache/beam/pull/17244#discussion_r869260142
##########
sdks/python/apache_beam/io/gcp/gcsfilesystem.py:
##########
@@ -38,6 +40,15 @@ class GCSFileSystem(FileSystem):
CHUNK_SIZE = gcsio.MAX_BATCH_OPERATION_SIZE # Chuck size in batch operations
GCS_PREFIX = 'gs://'
+ def __init__(self, pipeline_options):
+ super().__init__(pipeline_options)
+ if isinstance(pipeline_options, PipelineOptions):
+ gcs_options = pipeline_options.view_as(GoogleCloudOptions)
+ impersonate_service_account = gcs_options.impersonate_service_account
Review Comment:
I think I need to have it here, otherwise when the impersonated service
tries to upload to a shared directory it won't be able to. Since credentials is
a global variable it's important I set impersonation beforehand.
We can discuss a refactor, but for now, I can't get this to work otherwise.
Issue Time Tracking
-------------------
Worklog Id: (was: 768511)
Time Spent: 3h 50m (was: 3h 40m)
> Support impersonation credentials in Dataflow runner.
> -----------------------------------------------------
>
> Key: BEAM-14014
> URL: https://issues.apache.org/jira/browse/BEAM-14014
> Project: Beam
> Issue Type: Improvement
> Components: runner-dataflow
> Reporter: Valentyn Tymofieiev
> Assignee: Ryan Thompson
> Priority: P2
> Time Spent: 3h 50m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
