[
https://issues.apache.org/jira/browse/IMPALA-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Tauber-Marshall reassigned IMPALA-5669:
----------------------------------------------
Assignee: (was: Thomas Tauber-Marshall)
> Partial sort node should have a maximum reservation set by default.
> -------------------------------------------------------------------
>
> Key: IMPALA-5669
> URL: https://issues.apache.org/jira/browse/IMPALA-5669
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 2.10.0
> Reporter: Thomas Tauber-Marshall
> Priority: Major
> Labels: performance, resource-management
>
> A change currently in review, IMPALA-5498, adds a new exec node
> PartialSortNode. Initially, it will just allocate memory up to the query
> memory limit, but once the new buffer management work in IMPALA-3200 goes in,
> it should be modified to operate within a memory constraint.
> PartialSortNode can operate with essentially any amount of memory, with the
> tradeoff that a smaller limit leads to a "lower quality", more random sort.
> We should investigate the performance implications of different limits, and
> consider making the limit configurable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
