[
https://issues.apache.org/jira/browse/IMPALA-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on IMPALA-9530 started by Tim Armstrong.
---------------------------------------------
> Allow limiting memory consumed by preaggregation
> ------------------------------------------------
>
> Key: IMPALA-9530
> URL: https://issues.apache.org/jira/browse/IMPALA-9530
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Major
>
> In some cases pre-aggregations can balloon up and consume lots of memory,
> forcing the merge aggregation to spill. This is often OK as long as the
> preaggregation is reducing the input sufficiently, since it reduces the
> amount of data shuffled over the network.
> However in some cases it's preferable to be more conservative with memory and
> just cap the size of the preaggregation to prevent it ballooning too much.
> It would be useful to add a query option to directly limit the memory
> consumption of the preaggregations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
