JingsongLi opened a new pull request, #171: URL: https://github.com/apache/flink-table-store/pull/171
Currently, Sink's MemTable memory is self-managed Heap, and compaction also consumes memory, which is not very easy to use, and the memory problem will be more serious if there are multiple partitions and multiple Buckets in a single task. We need to control the total memory of a single sink task. - Introduce MemoryPoolFactory to share memory for multiple writers - MemoryPoolFactory supports PreemptRunner to preempt memory from other writers (flush other writers, do not flush writer self) - Fix MergeTreeWriter's close, avoid unexpected interrupt exceptions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
