damccorm commented on a change in pull request #17189:
URL: https://github.com/apache/beam/pull/17189#discussion_r837370692
##########
File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py
##########
@@ -555,13 +566,15 @@ def run_pipeline(self, pipeline, options):
self.job = apiclient.Job(options, self.proto_pipeline)
- # Dataflow Runner v1 requires output type of the Flatten to be the same as
- # the inputs, hence we enforce that here. Dataflow Runner v2 does not
- # require this.
- pipeline.visit(self.flatten_input_visitor())
+ # TODO: Consider skipping these for all use_portable_job_submission jobs.
Review comment:
Cool - thanks for clarifying!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
