arunpandianp opened a new pull request, #40956: URL: https://github.com/apache/beam/pull/40956
When a work item commit exceeds operational commit size limits in StreamingModeExecutionContext, a KeyCommitTooLargeException is recorded and the commit request is truncated, discarding state updates, timers, and output messages. However, the worker's WindmillStateCache and ReaderCache previously retained the dirty state updates and cached reader for the key. Because Windmill commits the truncation request with CommitStatus.OK, neither onCompleteCommit nor processWork's exception handler would invalidate the caches, leaving uncommitted/stale state in the worker cache. This change invokes invalidateCache() when KeyCommitTooLargeException occurs, ensuring all cached state and readers for the key are invalidated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
