Sam Whittle created BEAM-13684:
----------------------------------

             Summary: Consider adding information to ProcessBundleRequest 
indicating there is no existing state
                 Key: BEAM-13684
                 URL: https://issues.apache.org/jira/browse/BEAM-13684
             Project: Beam
          Issue Type: Improvement
          Components: beam-model
            Reporter: Sam Whittle


This allows for skipping all state fetches made during processing this key, 
preloading the cache with empty values for the key, or extending the cache to 
include this negative state information to avoid fetches as long as no state is 
evicted for the key.

This is particularly beneficial in sparse key streaming pipelines where such 
new keys are common.

It could also be used to avoid fetches in batch pipelines where there is no 
persisted state.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to