[
https://issues.apache.org/jira/browse/BEAM-11196?focusedWorklogId=511540&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-511540
]
ASF GitHub Bot logged work on BEAM-11196:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 13/Nov/20 21:17
Start Date: 13/Nov/20 21:17
Worklog Time Spent: 10m
Work Description: yifanmai commented on a change in pull request #13303:
URL: https://github.com/apache/beam/pull/13303#discussion_r523236945
##########
File path:
sdks/python/apache_beam/runners/portability/fn_api_runner/translations.py
##########
@@ -788,14 +789,14 @@ def get_stage_key(stage):
pcoll_id_remap = {}
remaining_stages = []
for sibling_stages in grouped_eligible_stages.values():
+ if len(sibling_stages) == 1:
+ ineligible_stages.extend(sibling_stages)
Review comment:
KeyWithNone / KeyWithVoid refers to adding None as a key in the
expansion for CombineGlobally
[here](https://github.com/apache/beam/blob/5291b2c88e4371d7e9eb1ac6708dd4dc3bf17f8e/sdks/python/apache_beam/transforms/core.py#L2006-L2008).
Basically this optimizer is finding sibling duplicate KeyWithNone stages with
the same input and eliminating them.
I'm reverting this block because it's not necessary after the other changes
- it was an alternate workaround that I was trying that would also allow the
newly added tests to pass.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 511540)
Time Spent: 1h (was: 50m)
> Composite transform structure not preserved with fusion.
> --------------------------------------------------------
>
> Key: BEAM-11196
> URL: https://issues.apache.org/jira/browse/BEAM-11196
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Robert Bradshaw
> Assignee: Yifan Mai
> Priority: P2
> Fix For: 2.26.0
>
> Time Spent: 1h
> Remaining Estimate: 0h
>
> This causes problems with combiner packing, among other things.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
