Qifan Chen has uploaded a new patch set (#3). (
http://gerrit.cloudera.org:8080/16220 )
Change subject: WIP CDPD-8989 Improve admission control pool stats logging to
be more explicit
......................................................................
WIP CDPD-8989 Improve admission control pool stats logging to be more
explicit
This work addresses the current limitation in admission controller by
appending the last known memory consumption statistics about a host to
the existing host memory exhaustion message. The message is logged in
impalad.INFO when a query is queued or timed out due to memory pressure
at the host.
This new memory consumption statistics covers the following content:
num_running: the total number of queries running
top_queries: a list of query Ids for up to 5 queries with top memory
consumptions
min: the minimal memory consumption of all running queries
max: the maximal memory consumption of all running queries
total: the total memory consumption of all running queries
average: the average memory consumption of all running queries
One example of the statistics is as follows.
Memory consumed: num_running=2, top_queries=[
dc4fd356433812be:6902546f00000000, c54d5ab3f4773ee8:8fb6a62800000000],
min=12.30 MB, max=12.37 MB, total=24.67 MB, average=12.34 MB
Testing:
TBD
Change-Id: Id995a9d044082c3b8f044e1ec25bb4c64347f781
---
M be/src/runtime/mem-tracker.cc
M be/src/runtime/mem-tracker.h
M be/src/scheduling/admission-controller.cc
M common/thrift/StatestoreService.thrift
4 files changed, 190 insertions(+), 7 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/20/16220/3
--
To view, visit http://gerrit.cloudera.org:8080/16220
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Id995a9d044082c3b8f044e1ec25bb4c64347f781
Gerrit-Change-Number: 16220
Gerrit-PatchSet: 3
Gerrit-Owner: Qifan Chen <[email protected]>
Gerrit-Reviewer: Bikramjeet Vig <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Qifan Chen <[email protected]>
Gerrit-Reviewer: Sahil Takiar <[email protected]>
Gerrit-Reviewer: Tim Armstrong <[email protected]>
