Surya Hebbar has uploaded this change for review. (
http://gerrit.cloudera.org:8080/22245
Change subject: IMPALA-13624: Implement textual representation of aggregate
event sequences
......................................................................
IMPALA-13624: Implement textual representation of aggregate event sequences
Currently, within the JSON query profile the event timeline among
fragment instances is expressed in list format, without any form
of summarization.
The representation of event sequences is verbose, and only the first
instance timestamps are printed with default verbosity and all instances
timestamps in case of extended verbosity.
With this format, it becomes difficult to analyze a particular phase
across instances.
With the inclusion of aggregate metrics in the JSON query profile,
it is also possible to display them in a comprehensive format,
which would help in skew analysis or other such cases.
The default verbosity would now print a summary of event sequences in
the following manner instead of just the first instance timestamps.
When no. of instances > 5 -
Node Lifecycle Event Timeline Summary :
- Open Started:
Div. Max Min Avg #Inst. Count
20% 2s133ms 2s000ms 2s050ms 3
40% 2s300ms 2s200ms 2s250ms 4
.... .... .... .... ...
100% 2s850ms 2s900ms 2s875ms 2
- Open Finished: ...
... ... ... ...
When no. of instances <= 5 -
Node Lifecycle Event Timeline :
- Open Started: 2s850ms, 3s850ms, 4s150ms, 5s850ms
- Open Finished: 4s094ms, 5s850ms, 6s150ms, 7s850ms
- First Batch Requested: 8s094ms, 9s850ms, 10s150ms, 11s850ms
- First Batch Returned: ... ... ... ... ... ...
- ... ... ... ... ... ... ... ...
In case of extended verbosity all instance timestamps are printed along
with the summary.
Change-Id: I4bcc0e2e7fccfa8a184cfa8a3a96d68bfe6035c0
---
M be/src/util/runtime-profile.cc
1 file changed, 134 insertions(+), 33 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/45/22245/1
--
To view, visit http://gerrit.cloudera.org:8080/22245
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I4bcc0e2e7fccfa8a184cfa8a3a96d68bfe6035c0
Gerrit-Change-Number: 22245
Gerrit-PatchSet: 1
Gerrit-Owner: Surya Hebbar <[email protected]>
