je-ik commented on a change in pull request #15994:
URL: https://github.com/apache/beam/pull/15994#discussion_r768109523
##########
File path:
runners/flink/src/main/java/org/apache/beam/runners/flink/translation/wrappers/streaming/state/FlinkStateInternals.java
##########
@@ -215,6 +216,22 @@ public void clearGlobalState() {
}
}
+ public List<ByteBuffer> getGlobalWindowStateKeys() {
Review comment:
Ah, my bad.
In the case of memory complexity, I think there are few solutions, that
would not be a sort of overengineering - without the proof there exists a need
of such a complex solution. IMO, the cleanest would be to enhance the Flink
state iteration API to provide appropriate guarantees (e.g. sorted keys), and
deduplicate in-mem until such API is available.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
