[
https://issues.apache.org/jira/browse/BEAM-4176?focusedWorklogId=141063&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-141063
]
ASF GitHub Bot logged work on BEAM-4176:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Sep/18 22:01
Start Date: 04/Sep/18 22:01
Worklog Time Spent: 10m
Work Description: lukecwik commented on issue #6328: [BEAM-4176]
enumerate primitive transforms in portable construction
URL: https://github.com/apache/beam/pull/6328#issuecomment-418532499
The shared libraries need to understand all the primitives given to them as
they are required to satisfy the contracts that each primitive has. The code
within QueryablePipeline/ExecutableStage/GreedyPipelineFuser/... make
assumptions around what neighboring primitives exist and how they are
compatible with each other.
The runner can choose to intercept the pipeline before it gives it to the
shared libraries to do fusion/... and update the representation to be
compatible with those libraries or those libraries need to expose hooks for
runner known primitives to describe how they should treat these primitives
(e.g. should they break fusion, or be fusable with the SDK transforms).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 141063)
Time Spent: 18h 20m (was: 18h 10m)
> Java: Portable batch runner passes all ValidatesRunner tests that
> non-portable runner passes
> --------------------------------------------------------------------------------------------
>
> Key: BEAM-4176
> URL: https://issues.apache.org/jira/browse/BEAM-4176
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Ben Sidhom
> Priority: Major
> Attachments: Screen Shot 2018-08-14 at 4.18.31 PM.png, Screen Shot
> 2018-09-03 at 11.07.38 AM.png
>
> Time Spent: 18h 20m
> Remaining Estimate: 0h
>
> We need this as a sanity check that runner execution is correct.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
