Internal Jenkins has submitted this change and it was merged.
Change subject: IMPALA-3342: Add thread counters to monitor plan fragment
execution
......................................................................
IMPALA-3342: Add thread counters to monitor plan fragment execution
This change removes the use of total_cpu_timer which incorrectly
monitors the CPU time. Adding THREAD_COUNTERS to measure the user
and sys time in plan fragment execution. This also accounts for the
time spent in the hdfs/kudu scanner and in a blocking join.
Snippet of a query plan with the newly added PlanFragment
THREAD_COUNTERS:
Instance 2b40b101e2626e7a:a3d8f2300000000
- PeakMemoryUsage: 32.02 KB (32784)
- PerHostPeakMemUsage: 430.52 MB (451431312)
- RowsProduced: 1 (1)
- TotalNetworkReceiveTime: 10s379ms
- TotalNetworkSendTime: 0.000ns
- TotalStorageWaitTime: 0.000ns
- TotalWallClockTime: 10s577ms
- SysTime: 8.000ms
- UserTime: 8.000ms
- VoluntaryContextSwitches: 80 (80)
Change-Id: Ifa88aa6f3371fa42d11ecc122f43c7d83623c300
Reviewed-on: http://gerrit.cloudera.org:8080/4633
Reviewed-by: Bharath Vissapragada <[email protected]>
Tested-by: Internal Jenkins
---
M be/src/exec/blocking-join-node.cc
M be/src/exec/hdfs-scan-node.cc
M be/src/exec/kudu-scan-node.cc
M be/src/runtime/plan-fragment-executor.cc
M be/src/runtime/plan-fragment-executor.h
M be/src/runtime/runtime-state.cc
M be/src/runtime/runtime-state.h
7 files changed, 17 insertions(+), 25 deletions(-)
Approvals:
Bharath Vissapragada: Looks good to me, approved
Internal Jenkins: Verified
--
To view, visit http://gerrit.cloudera.org:8080/4633
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: Ifa88aa6f3371fa42d11ecc122f43c7d83623c300
Gerrit-PatchSet: 12
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: anujphadke <[email protected]>
Gerrit-Reviewer: Bharath Vissapragada <[email protected]>
Gerrit-Reviewer: Dan Hecht <[email protected]>
Gerrit-Reviewer: Henry Robinson <[email protected]>
Gerrit-Reviewer: Internal Jenkins
Gerrit-Reviewer: Tim Armstrong <[email protected]>
Gerrit-Reviewer: Yonghyun Hwang
Gerrit-Reviewer: anujphadke <[email protected]>
