DerRidda commented on code in PR #26270:
URL: https://github.com/apache/beam/pull/26270#discussion_r1469709852
##########
sdks/python/apache_beam/io/gcp/bigquery.py:
##########
@@ -2666,11 +2664,10 @@ def _expand_export(self, pcoll):
GoogleCloudOptions).temp_location
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
gcs_location_vp = self.gcs_location
- unique_id = str(uuid.uuid4())[0:10]
def file_path_to_remove(unused_elm):
gcs_location = bigquery_export_destination_uri(
- gcs_location_vp, temp_location, unique_id, True)
+ gcs_location_vp, temp_location, str(uuid.uuid4())[0:10], True)
Review Comment:
@ahmedabu98 That workaround is currently not possible to use with
DIRECT_READ as neither the temp_dataset nor the temp_table can be changed at
runtime, as these are static options and don't use value providers.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
