[ 
https://issues.apache.org/jira/browse/IMPALA-14493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18029902#comment-18029902
 ] 

Michael Smith commented on IMPALA-14493:
----------------------------------------

What kind of things have led to excessive memory use in admissiond?

> Capping Memory Usage of Global Admission Service 
> -------------------------------------------------
>
>                 Key: IMPALA-14493
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14493
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: Yida Wu
>            Assignee: Yida Wu
>            Priority: Major
>
> The admission service ({{{}admissiond{}}}) can OOM on high workload because 
> its process memory tracker is inaccurate and doesn't account for all memory 
> allocations.
> Ensuring memory tracker accurately accounts for every allocation could be 
> difficult, one simpler solution is to introduce a hard memory cap using 
> {{tcmalloc}} statistics, which accurately reflect the true process memory 
> usage. If a new query is submitted while {{tcmalloc}} memory usage is over 
> the process limit, the query will be rejected immediately to protect from OOM.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to