[
https://issues.apache.org/jira/browse/BEAM-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17478177#comment-17478177
]
Luke Cwik commented on BEAM-13684:
----------------------------------
Alternatively consider embedding the state data within the ProcessBundleRequest
similar to what we do with things that flow over the data plane API.
> Consider adding information to ProcessBundleRequest indicating there is no
> existing state
> -----------------------------------------------------------------------------------------
>
> Key: BEAM-13684
> URL: https://issues.apache.org/jira/browse/BEAM-13684
> Project: Beam
> Issue Type: Improvement
> Components: beam-model
> Reporter: Sam Whittle
> Assignee: Luke Cwik
> Priority: P2
>
> This allows for skipping all state fetches made during processing this key,
> preloading the cache with empty values for the key, or extending the cache to
> include this negative state information to avoid fetches as long as no state
> is evicted for the key.
> This is particularly beneficial in sparse key streaming pipelines where such
> new keys are common.
> It could also be used to avoid fetches in batch pipelines where there is no
> persisted state.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
