[
https://issues.apache.org/jira/browse/BEAM-8850?focusedWorklogId=439418&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-439418
]
ASF GitHub Bot logged work on BEAM-8850:
----------------------------------------
Author: ASF GitHub Bot
Created on: 01/Jun/20 07:59
Start Date: 01/Jun/20 07:59
Worklog Time Spent: 10m
Work Description: dmvk commented on a change in pull request #11857:
URL: https://github.com/apache/beam/pull/11857#discussion_r433094260
##########
File path:
runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkBatchTranslationContext.java
##########
@@ -57,9 +57,12 @@
private AppliedPTransform<?, ?, ?> currentTransform;
+ private final CountingPipelineVisitor countingPipelineVisitor = new
CountingPipelineVisitor();
Review comment:
This is needed in upcoming PR to resolve number of consumers of GBK
transforms, so we can decide whether to materialize the result before sending
downstream.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 439418)
Time Spent: 50m (was: 40m)
> Flink: Batch translation context respects provided PTransform during Input /
> Output lookups.
> --------------------------------------------------------------------------------------------
>
> Key: BEAM-8850
> URL: https://issues.apache.org/jira/browse/BEAM-8850
> Project: Beam
> Issue Type: Sub-task
> Components: runner-flink
> Reporter: David Morávek
> Assignee: David Morávek
> Priority: P2
> Time Spent: 50m
> Remaining Estimate: 0h
>
> Currently batch translation context uses `currentTransform` for input / ouput
> lookups, even though we provide a `PTransform` we want to perform lookup for
> as a parameter.
> We need to introduce a new PipelineVisitor, that would be initialized prior
> translation and build an in-memory PTransform / AppliedPTransform lookup
> table, that can be used by translation context.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
