Yida Wu created IMPALA-11064:
--------------------------------
Summary: Optimizing Temporary File Structure for Batching Reading
Key: IMPALA-11064
URL: https://issues.apache.org/jira/browse/IMPALA-11064
Project: IMPALA
Issue Type: Improvement
Components: Backend
Reporter: Yida Wu
Assignee: Yida Wu
Impala allows spilling to a remote filesystem, like S3. The rate of uploading
the spilled data to the remote filesystem is fast, but the speed of reading
from the remote is slow because each time only one page is read from the remote
filesystem while we do per upload per file.
The task aims to improve the reading performance of the spilling to a remote
filesystem by using batch reading.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)