[
https://issues.apache.org/jira/browse/IMPALA-10509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286372#comment-17286372
]
ASF subversion and git services commented on IMPALA-10509:
----------------------------------------------------------
Commit a55661d02bff6e02414010fd4cc799b5952ee9ae in impala's branch
refs/heads/master from Riza Suminto
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=a55661d ]
IMPALA-10509: Add tool to visualize Impala query plan from profile
Impala query plan can be huge and complex. It becomes hard to analyze
this complex query plan, its execution summary, and the runtime filter
interactions from the query profile. We need a tool to help visualize
this query plan from a plain text query profile.
This commit adds experimental python3 script plan-graph.py to parse the
text profile into a GraphViz DOT format. The output of this script can
then be converted into an image using dot program or immediately
visualized using program such as ZGRViewer.
The script can produce a graph in the following verbosity levels:
* 0: minimal graph, containing the concise query plan, time spent on
each plan node, and the number of rows produced.
* 1: level 0 graph plus additional runtime filter vertices.
* 2: level 1 graph plus additional description in query plan vertices
such as the plan node parameter, selective predicates, group by
clause, runtime filter info, etc. The runtime filter vertices are
also arranged to a lower position than scan nodes that should
be finished before the runtime filter is published. This is
currently the default verbosity level.
* 3: level 2 graph, but with the scanner to runtime filter dependency
edges explicitly drawn.
Testing:
- Manually test the script against query profiles from TPC-DS runs and
verify that it produces a valid graph visualization.
Change-Id: Ic62e3c2b061dd2b84589336fb9e68fa1eccf76f2
Reviewed-on: http://gerrit.cloudera.org:8080/17077
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Add tool to visualize Impala query plan from text profile
> ---------------------------------------------------------
>
> Key: IMPALA-10509
> URL: https://issues.apache.org/jira/browse/IMPALA-10509
> Project: IMPALA
> Issue Type: Improvement
> Components: Infrastructure
> Affects Versions: Impala 3.4.0
> Reporter: Riza Suminto
> Assignee: Riza Suminto
> Priority: Minor
>
> Impala query plan can be huge and complex.
> It becomes hard to analyze this complex query plan, its execution summary,
> and the runtime filter interactions from the query profile.
> We need tool to help visualize this query plan from plain text query profile.
> One solution is to write a python script to parse the text profile into a
> GraphViz DOT format.
> This DOT file can then be parsed into image using dot program or immediately
> visualize using program such as ZGRViewer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
