Github user alpinegizmo commented on a diff in the pull request:
https://github.com/apache/flink/pull/4011#discussion_r119344615
--- Diff: docs/ops/state_backends.md ---
@@ -88,6 +102,13 @@ that is (per default) stored in the TaskManager data
directories. Upon checkpoin
RocksDB data base will be checkpointed into the configured file system and
directory. Minimal
metadata is stored in the JobManager's memory (or, in high-availability
mode, in the metadata checkpoint).
+The RocksDBStateBackend always performs asynchronous snapshots.
+
+Limitations of the RocksDBStateBackend:
+
+ - As RocksDB's JNI bridge API is based on byte[], the maximum supported
size per key and per value is 2^31 bytes each.
+ IMPORTANT: states that use merge operations in RocksDB (e.g. ListState)
can silently accumulate value sizes > 2^31 bytes and will then fail on their
next retrival. This is currently a limitation of RocksDB JNI.
--- End diff --
retrieval
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
