[
https://issues.apache.org/jira/browse/IMPALA-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alex Rodoni updated IMPALA-1346:
--------------------------------
Docs Text: (was: Workarounds: increase mem_limit for query or reduce
query size (by processing only a subset of data at a time).)
> Sorter fails with out-of-memory in queries with multiple spilling operators
> ---------------------------------------------------------------------------
>
> Key: IMPALA-1346
> URL: https://issues.apache.org/jira/browse/IMPALA-1346
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 2.0, Impala 2.1, Impala 2.2, Impala 2.3.0
> Reporter: Nong Li
> Assignee: Tim Armstrong
> Priority: Critical
> Labels: resource-management
> Fix For: Impala 2.7.0, Impala 2.6.2
>
>
> An example of this is a join that is spilling followed by a sort (or
> aggregate) that also spills.
> These queries use memory very ineffective causing many of them to fail. The
> blocking
> operator starts accumulating memory and over time, the streaming operator
> will have none left (it is streaming so therefore gives up memory as it
> processes). As streaming operator eventually has too little memory to
> repartition and fails.
> We need coordination within an query.
> *Workaround*
> Increase mem_limit for query or reduce query size (by processing only a
> subset of data at a time).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscr...@impala.apache.org
For additional commands, e-mail: issues-all-h...@impala.apache.org
