robertwb commented on code in PR #24536:
URL: https://github.com/apache/beam/pull/24536#discussion_r1050998162
##########
sdks/python/apache_beam/io/gcp/bigquery_file_loads.py:
##########
@@ -515,9 +515,17 @@ def start_bundle(self):
self.bq_io_metadata = create_bigquery_io_metadata(self._step_name)
self.pending_jobs = []
- def process(self, element, job_name_prefix=None,
unused_schema_mod_jobs=None):
- destination = element[0]
- job_reference = element[1]
+ def process(
+ self, element_list, job_name_prefix=None, unused_schema_mod_jobs=None):
+ if isinstance(element_list, tuple):
+ # Allow this for streaming update compatibility while fixing BEAM-24535.
+ self.process_one(element_list)
+ else:
+ for element in element_list:
+ self.process_one(element)
Review Comment:
Yeah, I fixed this, but not it's failing on (unrelated-looking) proto
issues. Trying to run tests again...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
