[
https://issues.apache.org/jira/browse/BEAM-9692?focusedWorklogId=428689&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-428689
]
ASF GitHub Bot logged work on BEAM-9692:
----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Apr/20 18:13
Start Date: 29/Apr/20 18:13
Worklog Time Spent: 10m
Work Description: ananvay commented on a change in pull request #11452:
URL: https://github.com/apache/beam/pull/11452#discussion_r417515157
##########
File path: sdks/python/apache_beam/runners/dataflow/dataflow_runner.py
##########
@@ -117,13 +117,15 @@ class DataflowRunner(PipelineRunner):
# TODO: Remove the apache_beam.pipeline dependency in
CreatePTransformOverride
from apache_beam.runners.dataflow.ptransform_overrides import
CombineValuesPTransformOverride
from apache_beam.runners.dataflow.ptransform_overrides import
CreatePTransformOverride
- from apache_beam.runners.dataflow.ptransform_overrides import
ReadPTransformOverride
from apache_beam.runners.dataflow.ptransform_overrides import
JrhReadPTransformOverride
+ from apache_beam.runners.dataflow.ptransform_overrides import
ReadPTransformOverride
+ from apache_beam.runners.dataflow.ptransform_overrides import
NativeReadPTransformOverride
- # Thesse overrides should be applied before the proto representation of the
+ # These overrides should be applied before the proto representation of the
# graph is created.
_PTRANSFORM_OVERRIDES = [
- CombineValuesPTransformOverride()
+ CombineValuesPTransformOverride(),
Review comment:
Looking at other parts, seems like this would be the same for both? And
the only difference would be the JRH_PTRANSFORM_OVERRIDES section below (which
basically is JrhReadPTransformOverride)? I'm not sure why that Read override is
needed differently for JRH...
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 428689)
Time Spent: 2h 20m (was: 2h 10m)
> Clean Python DataflowRunner to use portable pipelines
> -----------------------------------------------------
>
> Key: BEAM-9692
> URL: https://issues.apache.org/jira/browse/BEAM-9692
> Project: Beam
> Issue Type: Improvement
> Components: runner-dataflow
> Reporter: Sam Rohde
> Assignee: Sam Rohde
> Priority: Major
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
