kien-truong commented on pull request #2680: URL: https://github.com/apache/iceberg/pull/2680#issuecomment-987519246
We have used RocksDB in the past with Flink, and it does require some tuning to avoid OOM. For example, we have to change the memory allocator to `jemalloc`, because the default `glibc` allocator has major memory fragmentation issues with RocksDB. Furthermore, there are also various settings to control the amount of memory allocated to each tree level, index, cache, etc... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
