[
https://issues.apache.org/jira/browse/IMPALA-9828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17212543#comment-17212543
]
Tim Armstrong commented on IMPALA-9828:
---------------------------------------
[~jbapple] yeah exactly - a lot of cloud instances have fairly constrained
local storage so this is a way to allow queries to run to completion when local
storage is exhausted.
Mounting additional non-local block storage like EBS is an alternative, but
then you either need to pre-provision the volumes (requires planning and/or
gets expensive) or come up with some kind of dynamic provisioning scheme
(complex, not portable across cloud providers, etc).
BTW, this approach isn't really limited to S3, it could be extended to any
other storage with a HDFS connector.
> Add support for spilling to S3
> ------------------------------
>
> Key: IMPALA-9828
> URL: https://issues.apache.org/jira/browse/IMPALA-9828
> Project: IMPALA
> Issue Type: Epic
> Components: Backend
> Reporter: Abhishek Rawat
> Assignee: Yida Wu
> Priority: Major
> Fix For: Impala 4.0
>
>
> Epic for spill to S3 support.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
