[ https://issues.apache.org/jira/browse/FLINK-32870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xintong Song closed FLINK-32870. -------------------------------- Fix Version/s: 1.18.0 Resolution: Fixed - master(1.19): ade583cf80478ac60e9b83fc0a97f36bc2b26f1c - release-1.18: d100ab65367fe0b3d74a9901bcaaa26049c996b0 > Reading multiple small buffers by reading and slicing one large buffer for > tiered storage > ----------------------------------------------------------------------------------------- > > Key: FLINK-32870 > URL: https://issues.apache.org/jira/browse/FLINK-32870 > Project: Flink > Issue Type: Bug > Components: Runtime / Network > Affects Versions: 1.18.0 > Reporter: Yuxin Tan > Assignee: Yuxin Tan > Priority: Major > Labels: pull-request-available > Fix For: 1.18.0 > > > Currently, when the file reader of tiered storage loads data from the disk > file, it reads data in buffer granularity. Before compression, each buffer is > 32K by default. After compressed, the size will become smaller (may less than > 5K), which is pretty small for the network buffer and the file IO. > We should read multiple small buffers by reading and slicing one large buffer > to decrease the buffer competition and the file IO, leading to better > performance. -- This message was sent by Atlassian Jira (v8.20.10#820010)