[
https://issues.apache.org/jira/browse/BEAM-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16787011#comment-16787011
]
Kyle Weaver commented on BEAM-6327:
-----------------------------------
Alternatively, I could move this logic to an intermediary class that takes a
fuser and a list of known URNs.
One thing I'm a little confused by is
[this|https://github.com/apache/beam/blob/master/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkPipelineRunner.java#L95-L99]:
I thought the fuser was responsible for making executable stages. Why might
executable stages already be present in the pipeline at this point?
> Don't attempt to fuse subtransforms of primitive/known transforms.
> ------------------------------------------------------------------
>
> Key: BEAM-6327
> URL: https://issues.apache.org/jira/browse/BEAM-6327
> Project: Beam
> Issue Type: New Feature
> Components: runner-direct
> Reporter: Robert Bradshaw
> Assignee: Kyle Weaver
> Priority: Major
> Labels: triaged
>
> Currently we must remove all sub-components of any known transform that may
> have an optional substructure, e.g.
> [https://github.com/apache/beam/blob/release-2.9.0/sdks/python/apache_beam/runners/portability/portable_runner.py#L126]
> (for GBK) and [https://github.com/apache/beam/pull/7360] (Reshuffle).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
