Joe McDonnell created IMPALA-15287:
--------------------------------------
Summary: Add ability to collect performance counters directly in
Impalad
Key: IMPALA-15287
URL: https://issues.apache.org/jira/browse/IMPALA-15287
Project: IMPALA
Issue Type: Improvement
Components: Backend
Affects Versions: Impala 5.0.0
Reporter: Joe McDonnell
Google benchmark has integrated ability to sample performance counters. This
uses a dependency on libpfm to help accomplish this. See
[https://abseil.io/fast/53]
Adding an option like this to Impala itself could provide useful information.
One option would be to have a background thread sampling the counters
periodically (e.g. every 100ms or 250ms), then grab the overlapping daemon
level counters and pull them into the runtime profile. For single-query at a
time benchmarking, this provides useful information at the query level.
The performance metrics that are probably most interesting to start with would
be LLC misses or TLB misses.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
