Tudor Marian created BEAM-9877:
----------------------------------
Summary: Eager size estimation of large group-by-key iterables
cause expensive / duplicate reads
Key: BEAM-9877
URL: https://issues.apache.org/jira/browse/BEAM-9877
Project: Beam
Issue Type: Bug
Components: sdk-java-core
Reporter: Tudor Marian
BatchGroupAlsoByWindowViaIteratorsFn WindowReiterator can cause very expensive
duplicate reading of data from a (Co-)GroupByKey for hot keys with many values
due to PCollection size estimation. Instead, it should perform lazy estimation
like GroupingShuffleReader and GroupingShuffleEntryInterator (or perform no
estimation at all).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
