[
https://issues.apache.org/jira/browse/IMPALA-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-5669:
----------------------------------
Labels: performance ramp-up resource-management (was: performance
resource-management)
> Partial sort node should have a maximum reservation set by default.
> -------------------------------------------------------------------
>
> Key: IMPALA-5669
> URL: https://issues.apache.org/jira/browse/IMPALA-5669
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 2.10.0
> Reporter: Thomas Tauber-Marshall
> Assignee: Tim Armstrong
> Priority: Major
> Labels: performance, ramp-up, resource-management
>
> A change currently in review, IMPALA-5498, adds a new exec node
> PartialSortNode. Initially, it will just allocate memory up to the query
> memory limit, but once the new buffer management work in IMPALA-3200 goes in,
> it should be modified to operate within a memory constraint.
> PartialSortNode can operate with essentially any amount of memory, with the
> tradeoff that a smaller limit leads to a "lower quality", more random sort.
> We should investigate the performance implications of different limits, and
> consider making the limit configurable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]