[
https://issues.apache.org/jira/browse/FLINK-14956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984777#comment-16984777
]
zhijiang commented on FLINK-14956:
----------------------------------
I would close this duplicated issue to focus on FLINK-14845 only.
> MemoryMappedBoundedData Compressed Buffer Slicer
> ------------------------------------------------
>
> Key: FLINK-14956
> URL: https://issues.apache.org/jira/browse/FLINK-14956
> Project: Flink
> Issue Type: Improvement
> Components: Runtime / Network
> Reporter: Nicholas Jiang
> Priority: Minor
> Attachments: CPU-IO.png, Compress-Read.png, Compress-Write.png
>
>
> MemoryMappedBoundedData, implementation of BoundedData simply through
> ByteBuffers backed by memory, uses CompressedBufferSlicer which is
> implementation of BoundedData.Reader to slice next buffer with uncompress.
> CompressedBufferSlicer reads BoundedData by LZ4SafeDecompressor decompressing
> byte buffer.When FileChannelMemoryMappedBoundedData tries to write buffer,
> this uses LZ4Compressor to compress buffer to improve I/O performance.
> Compress read process：
> !Compress-Read.png|width=556,height=251!
> Compress write process：
> !Compress-Write.png|width=278,height=261!
> CPU/IO performance comparsion chart：
> !CPU-IO.png|width=416,height=312!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
