Yida Wu created IMPALA-10791:
--------------------------------

             Summary: Add Support of Batch Reading for Spilling to Remote FS
                 Key: IMPALA-10791
                 URL: https://issues.apache.org/jira/browse/IMPALA-10791
             Project: IMPALA
          Issue Type: Improvement
          Components: Backend
            Reporter: Yida Wu
            Assignee: Yida Wu


Impala allows spilling to a remote filesystem, like S3. The rate of uploading 
the spilled data to the remote filesystem is fast, but the speed of reading 
from the remote is slow because each time only one page is read from the remote 
filesystem while we do per upload per file.

 

The task aims to improve the reading performance of the spilling to a remote 
filesystem by using batch reading.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to