[
https://issues.apache.org/jira/browse/BEAM-11910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17319599#comment-17319599
]
Beam JIRA Bot commented on BEAM-11910:
--------------------------------------
This issue is assigned but has not received an update in 30 days so it has been
labeled "stale-assigned". If you are still working on the issue, please give an
update and remove the label. If you are no longer working on the issue, please
unassign so someone else may work on it. In 7 days the issue will be
automatically unassigned.
> Increase subsequent page size for bags after the first
> ------------------------------------------------------
>
> Key: BEAM-11910
> URL: https://issues.apache.org/jira/browse/BEAM-11910
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Sam Whittle
> Assignee: Sam Whittle
> Priority: P2
> Labels: stale-assigned
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> Currently the page size of bags requested from the streaming dataflow backend
> is always 8MB. In pipelines with large bags this can limit throughput as it
> results in more round-trips to the backend. In particular with Streaming
> Engine this is noticable due to increased latency.
> I propose using 8MB for the first bag fetch and then doubling the limit for
> subsequent paginations
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
