[
https://issues.apache.org/jira/browse/BEAM-8657?focusedWorklogId=344041&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-344041
]
ASF GitHub Bot logged work on BEAM-8657:
----------------------------------------
Author: ASF GitHub Bot
Created on: 15/Nov/19 08:00
Start Date: 15/Nov/19 08:00
Worklog Time Spent: 10m
Work Description: HuangLED commented on issue #10109: [BEAM-8657]
Combiner lifting fix for bundle-based direct runner.
URL: https://github.com/apache/beam/pull/10109#issuecomment-554254867
With this PR merged, I tried the test case(
https://github.com/apache/beam/pull/10081)
'LATEST' passes (yes!), but 'EARLIEST' still have issue.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 344041)
Time Spent: 2h (was: 1h 50m)
> Not doing Combiner lifting for data-driven triggers
> ---------------------------------------------------
>
> Key: BEAM-8657
> URL: https://issues.apache.org/jira/browse/BEAM-8657
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: wendy liu
> Assignee: Robert Bradshaw
> Priority: Major
> Time Spent: 2h
> Remaining Estimate: 0h
>
> The test below will always produce empty output, due to combiner lifting,
> which already combines all input values of one shard into one before
> grouping. To fix this, we shall not do Combiner lifting for the data-driven
> triggers.
> l = [window.TimestampedValue(('a', 1), 1),
> window.TimestampedValue(('b', 3), 3),
> window.TimestampedValue(('a', 2), 2),
> window.TimestampedValue(('a', 5), 5),]
> result = (p | Map(lambda x : x) | 'window' >>
> beam.WindowInto(FixedWindows(6), trigger=trigger.AfterCount(2),
> accumulation_mode=trigger.AccumulationMode.DISCARDING) |
> beam.CombinePerKey(combine.Largest(1)))
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
