Andrew Wong has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/12570 )
Change subject: wip KUDU-2353: tool to parse metrics log ...................................................................... wip KUDU-2353: tool to parse metrics log TODO: tests TODO: support gz TODO: remove globs and use variadic args instead? TODO: refactor printing so changing format is easier? TODO: handling of large time deltas a la python script C++ implementation of the metrics log parser script. Unlike the script, this tool can optionally filter based on tablet id for tablet metrics. Here's an example: awong$ ./bin/kudu diagnose parse_metrics ~/diag/kudu-tserver.machine.halxg.cloudera.com.kudu.diagnostics.20190221-142903.0.30353 --simple_metrics=tablet.rows_inserted:inserts --rate_metrics=tablet.rows_inserted:inserts_per_sec --tablet_ids=243ed60f14514acabb0a2c52f7e38ffa --histogram_metrics=server.op_apply_run_time:apply_run_time,tablet.log_append_latency:log_append_time > out.tsv timestamp inserts inserts_per_sec log_append_time_min log_append_time_p50 log_append_time_p75 log_append_time_p99 log_append_time_max apply_run_time_min apply_run_time_p50 apply_run_time_p75 apply_run_time_p99 apply_run_time_max 1550788199331387 121521158 0 1 28 491 2719 471039 232 37375 79359 179199 3653631 1550788259331447 121617428 1604.4983955016046 1 28 491 2719 471039 232 37631 79359 180223 3653631 1550788319331515 121710134 1545.0982488886514 1 28 491 2719 471039 232 37631 79359 180223 3653631 1550788379331691 121803125 1549.8454537866687 1 28 491 2719 471039 232 37631 79359 180223 3653631 1550788439331751 121896633 1558.4651082015585 1 28 491 2719 471039 232 37631 79871 180223 3653631 1550788499331815 121987292 1510.981721619497 1 28 491 2703 471039 232 37631 79871 181247 3653631 1550788559331874 122079150 1530.9651612175915 1 28 491 2703 471039 232 37887 79871 181247 3653631 1550788619332027 122172228 1551.2960441950875 1 28 491 2703 471039 232 37887 79871 181247 3653631 1550788679332089 122265073 1547.4150676710967 1 28 491 2703 471039 232 37887 79871 182271 3653631 1550788739332149 122354189 1485.2651814014853 1 28 491 2703 471039 232 37887 80383 182271 3653631 1550788799332208 122444297 1501.7985232314522 1 28 491 2703 471039 232 37887 80383 183295 3653631 1550788859332269 122539848 1592.5150476097015 1 28 491 2703 471039 232 38143 80383 183295 3653631 1550788920278517 122634368 1550.8747970834891 1 28 491 2703 471039 232 38143 80383 183295 3653631 1550788980278586 122727678 1555.1648782270565 1 28 491 2703 471039 232 38143 80383 184319 3653631 1550789040278643 122818906 1520.4652222247057 1 28 491 2703 471039 232 38143 80895 184319 3653631 1550789100278707 122911042 1535.5983620284137 1 28 491 2703 471039 232 38143 80895 184319 3653631 1550789160278770 123006719 1594.6149923209248 1 28 491 2703 471039 232 38399 80895 184319 3653631 1550789220278833 123099638 1548.6483739192074 1 28 491 2703 471039 232 38399 80895 185343 3653631 1550789280278897 123191451 1530.2150344372965 1 28 491 2703 471039 232 38399 80895 185343 3653631 1550789340278959 123285448 1566.6150478311172 1 28 491 2703 471039 232 38399 81407 185343 3653631 1550789400279014 123377694 1537.4319240207362 1 28 491 2703 471039 232 38399 81407 185343 3653631 1550789460279126 123469437 1529.0471457786612 1 28 491 2703 471039 232 38655 81407 186367 3653631 1550789520279186 123551509 1367.865298801368 1 28 491 2703 471039 232 38655 81407 186367 3653631 1550789580279255 123642034 1508.7482649394951 1 28 491 2703 471039 232 38655 81407 186367 3653631 Change-Id: I8077fb4f6b41fe4b2bd6c877af379ea7a9f415b1 --- M src/kudu/gutil/map-util.h M src/kudu/tools/CMakeLists.txt M src/kudu/tools/diagnostics_log_parser-test.cc M src/kudu/tools/diagnostics_log_parser.cc M src/kudu/tools/diagnostics_log_parser.h M src/kudu/tools/kudu-tool-test.cc M src/kudu/tools/tool_action_diagnose.cc A src/kudu/util/regex.h 8 files changed, 890 insertions(+), 200 deletions(-) git pull ssh://gerrit.cloudera.org:29418/kudu refs/changes/70/12570/2 -- To view, visit http://gerrit.cloudera.org:8080/12570 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: I8077fb4f6b41fe4b2bd6c877af379ea7a9f415b1 Gerrit-Change-Number: 12570 Gerrit-PatchSet: 2 Gerrit-Owner: Andrew Wong <[email protected]>
