[ https://issues.apache.org/jira/browse/BEAM-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123060#comment-17123060 ]
Beam JIRA Bot commented on BEAM-5791: ------------------------------------- This issue is P2 but has been unassigned without any comment for 60 days so it has been labeled "stale-P2". If this issue is still affecting you, we care! Please comment and remove the label. Otherwise, in 14 days the issue will be moved to P3. Please see https://beam.apache.org/contribute/jira-priorities/ for a detailed explanation of what these priorities mean. > Bound the amount of data on the data plane by time. > --------------------------------------------------- > > Key: BEAM-5791 > URL: https://issues.apache.org/jira/browse/BEAM-5791 > Project: Beam > Issue Type: Improvement > Components: runner-dataflow, sdk-java-harness, sdk-py-harness > Reporter: Robert Bradshaw > Priority: P2 > Labels: stale-P2 > Time Spent: 4h > Remaining Estimate: 0h > > This is especially important for Fn API reads, where each element represents > a shard to read and may be very expensive, but many elements may be waiting > in the Fn API buffer. > The need for this will be mitigated with full SDF support for liquid sharding > over the Fn API, but not eliminated unless the runner can "unread" elements > it has already sent. > This is especially important in for dataflow jobs that start out small but > then detect that they need more workers (e.g. due to the initial inputs being > an SDF). -- This message was sent by Atlassian Jira (v8.3.4#803005)