[
https://issues.apache.org/jira/browse/IMPALA-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876585#comment-16876585
]
David Rorke edited comment on IMPALA-8733 at 7/2/19 6:08 PM:
-------------------------------------------------------------
One approach to this would be to use mmap+mincore but I'm not sure about the
cost of that (lots of entries for mincore to scan for the very large cache
files). Another option might be mapping the file and then pulling the RSS
value for the mapping from /proc/pid/smaps.
We should try to find an efficient way to do this.
was (Author: drorke):
One approach to this would be to use mmap+mincore but I'm not sure about the
cost of that (lots of entries for mincore to scan for the very large cache
files). Another option might be mapping the file and then pulling the RSS
value for the mapping from /proc/pid/maps.
We should try to find an efficient way to do this.
> Add "bytes in core" metric for data cache
> -----------------------------------------
>
> Key: IMPALA-8733
> URL: https://issues.apache.org/jira/browse/IMPALA-8733
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 3.3.0
> Reporter: David Rorke
> Priority: Major
> Labels: observability
>
> The remote-read data cache is a major consumer of physical memory.
> It would be useful to have a "bytes in core" metric for the cache that
> reports the current in core physical size of the Linux page cache memory for
> the data cache. This is useful for tuning data cache size or analyzing the
> impact of the data cache on host memory use and memory pressure.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
