[
https://issues.apache.org/jira/browse/BEAM-13263?focusedWorklogId=695372&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-695372
]
ASF GitHub Bot logged work on BEAM-13263:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 13/Dec/21 21:29
Start Date: 13/Dec/21 21:29
Worklog Time Spent: 10m
Work Description: dmvk commented on a change in pull request #15994:
URL: https://github.com/apache/beam/pull/15994#discussion_r768135907
##########
File path:
runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/state/FlinkStateInternals.java
##########
@@ -215,6 +216,22 @@ public void clearGlobalState() {
}
}
+ public List<ByteBuffer> getGlobalWindowStateKeys() {
Review comment:
`iterateUniqueKeys` doesn't solve the issue then, because you can not
rely on having AT LEAST SOME state for the key either.
For example, for some types of joins you might have cleaned up all state
already before EOW 🤷♂️ (the key is no longer present in the underlying state
backend)
Relying on internal detail that you have under control and that you can test
for is IMO a better option that relying on how users write their DoFns..
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 695372)
Time Spent: 4h 40m (was: 4.5h)
> Support OnWindowExpiration in Flink runner
> ------------------------------------------
>
> Key: BEAM-13263
> URL: https://issues.apache.org/jira/browse/BEAM-13263
> Project: Beam
> Issue Type: New Feature
> Components: runner-flink
> Reporter: Reuven Lax
> Priority: P2
> Time Spent: 4h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
