[
https://issues.apache.org/jira/browse/BEAM-4176?focusedWorklogId=141065&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-141065
]
ASF GitHub Bot logged work on BEAM-4176:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/Sep/18 22:03
Start Date: 04/Sep/18 22:03
Worklog Time Spent: 10m
Work Description: lukecwik edited a comment on issue #6328: [BEAM-4176]
enumerate primitive transforms in portable construction
URL: https://github.com/apache/beam/pull/6328#issuecomment-418532499
The shared libraries need to understand all the primitives given to them as
they are required to satisfy the contracts that each primitive has. The code
within QueryablePipeline/ExecutableStage/GreedyPipelineFuser/... make
assumptions around what neighboring primitives exist and how they are
compatible with each other.
The pipeline representation can use pardo/read/... primitives which the
runner intercepts during translation *OR* the runner can choose to intercept
the pipeline before it gives it to the shared libraries to do fusion/... and
update the representation to be compatible with those libraries *OR* those
libraries need to expose hooks for runner known primitives to describe how they
should treat these primitives (e.g. should they break fusion, or be fusable
with the SDK transforms).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 141065)
Time Spent: 18.5h (was: 18h 20m)
> Java: Portable batch runner passes all ValidatesRunner tests that
> non-portable runner passes
> --------------------------------------------------------------------------------------------
>
> Key: BEAM-4176
> URL: https://issues.apache.org/jira/browse/BEAM-4176
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Ben Sidhom
> Priority: Major
> Attachments: Screen Shot 2018-08-14 at 4.18.31 PM.png, Screen Shot
> 2018-09-03 at 11.07.38 AM.png
>
> Time Spent: 18.5h
> Remaining Estimate: 0h
>
> We need this as a sanity check that runner execution is correct.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
