Joe McDonnell created IMPALA-15316:
--------------------------------------

             Summary: Support huge pages when tcmalloc's aggressive decommit is 
off
                 Key: IMPALA-15316
                 URL: https://issues.apache.org/jira/browse/IMPALA-15316
             Project: IMPALA
          Issue Type: Task
          Components: Backend
    Affects Versions: Impala 5.0.0
            Reporter: Joe McDonnell


In IMPALA-14900, we added support for turning off TCMalloc's aggressive 
decommit mode. This came at the cost of disabling madvise_huge_pages for that 
configuration. Without aggressive decommit, TCMalloc could break up huge pages 
and reuse smaller chunks. This could make the memory usage deceptive.

We can support huge pages with aggressive decommit off by mmap them ourselves 
in the SystemAllocator. We would need to track this memory usage and count it 
toward the process limit.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to