[
https://issues.apache.org/jira/browse/BEAM-9877?focusedWorklogId=430399&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-430399
]
ASF GitHub Bot logged work on BEAM-9877:
----------------------------------------
Author: ASF GitHub Bot
Created on: 04/May/20 20:20
Start Date: 04/May/20 20:20
Worklog Time Spent: 10m
Work Description: ibzib commented on pull request #11601:
URL: https://github.com/apache/beam/pull/11601#issuecomment-623684159
Java test failing due to BEAM-9164 (known flake).
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 430399)
Time Spent: 1h (was: 50m)
> Eager size estimation of large group-by-key iterables cause expensive /
> duplicate reads
> ---------------------------------------------------------------------------------------
>
> Key: BEAM-9877
> URL: https://issues.apache.org/jira/browse/BEAM-9877
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core
> Reporter: Tudor Marian
> Assignee: Tudor Marian
> Priority: Major
> Time Spent: 1h
> Remaining Estimate: 0h
>
> BatchGroupAlsoByWindowViaIteratorsFn WindowReiterator can cause very
> expensive duplicate reading of data from a (Co-)GroupByKey for hot keys with
> many values due to PCollection size estimation. Instead, it should perform
> lazy estimation like GroupingShuffleReader and GroupingShuffleEntryInterator
> (or perform no estimation at all).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
