Yida Wu created IMPALA-14493:
--------------------------------

             Summary: Capping Memory Usage of Global Admission Service 
                 Key: IMPALA-14493
                 URL: https://issues.apache.org/jira/browse/IMPALA-14493
             Project: IMPALA
          Issue Type: Bug
            Reporter: Yida Wu
            Assignee: Yida Wu


The admission service ({{{}admissiond{}}}) can OOM on high workload because its 
process memory tracker is inaccurate and doesn't account for all memory 
allocations.

Ensuring memory tracker accurately accounts for every allocation could be 
difficult, one simpler solution is to introduce a hard memory cap using 
{{tcmalloc}} statistics, which accurately reflect the true process memory 
usage. If a new query is submitted while {{tcmalloc}} memory usage is over the 
process limit, the query will be rejected immediately to protect from OOM.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to