Impala Public Jenkins has submitted this change and it was merged. Change subject: IMPALA-5658: addtl. process/system-wide memory metrics ......................................................................
IMPALA-5658: addtl. process/system-wide memory metrics This is meant to help understand how the process is using memory, to answer questions like: * Is the Impala daemon using transparent huge pages? * What is the system THP configuration? * What is the RSS of the process? * What is the virtual memory size of the process? Most of these questions can be answered via other command line or monitoring, except for the THP usage by the process, but adding metrics helps consolidate the information in one place. This commit adds a memory maintenance thread that periodically scrapes information from the /proc and /sys filesystems and updates the metrics. The interfaces used are: * /proc/<pid>/smaps, which is a documented interface to get detailed information about mapped memory: https://www.kernel.org/doc/Documentation/filesystems/proc.txt * /sys/kernel/mm/ config values for transparent huge pages Change-Id: I13873e305ba464d11dea0d7244a29ff4f332f1a9 Reviewed-on: http://gerrit.cloudera.org:8080/7472 Reviewed-by: Tim Armstrong <[email protected]> Tested-by: Impala Public Jenkins --- M be/src/common/init.cc M be/src/runtime/exec-env.cc M be/src/util/default-path-handlers.cc M be/src/util/mem-info.cc M be/src/util/mem-info.h M be/src/util/memory-metrics.cc M be/src/util/memory-metrics.h M common/thrift/metrics.json M www/memz.tmpl 9 files changed, 384 insertions(+), 38 deletions(-) Approvals: Impala Public Jenkins: Verified Tim Armstrong: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/7472 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: merged Gerrit-Change-Id: I13873e305ba464d11dea0d7244a29ff4f332f1a9 Gerrit-PatchSet: 7 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Tim Armstrong <[email protected]> Gerrit-Reviewer: Henry Robinson <[email protected]> Gerrit-Reviewer: Impala Public Jenkins Gerrit-Reviewer: Matthew Jacobs <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
