Joe McDonnell has uploaded a new change for review. http://gerrit.cloudera.org:8080/5685
Change subject: IMPALA-4341: Add metadata load to planner timeline ...................................................................... IMPALA-4341: Add metadata load to planner timeline This moves the timeline from the Analyzer GlobalState to the AnalysisContext and AnalysisContext.AnalysisResult. When analysis needs to load metadata about missing tables, it marks an event noting that analysis requires metadata. Then, when metadata load completes (or times out), it marks an event noting that metata load completed (or timed out). Keeping the timeline on the AnalysisContext means that it persists across attempts at analysis. On successful analysis, AnalysisContext.AnalysisResult has a reference to the timeline, which is used for the rest of planning. Here is an example output of the planner timeline after this change: Planner Timeline: 5s492ms - Analysis Requires Metadata Load: 42.972ms (42.972ms) - Metadata Load finished: 5s382ms (5s339ms) - Analysis finished: 5s415ms (32.828ms) - Equivalence classes computed: 5s434ms (19.356ms) - Single node plan created: 5s437ms (2.222ms) - Runtime filters computed: 5s438ms (1.666ms) - Distributed plan created: 5s440ms (1.495ms) - Planning finished: 5s492ms (51.933ms) When there is no need to load metadata, the timeline looks like: Planner Timeline: 3.485ms - Analysis finished: 904.409us (904.409us) - Equivalence classes computed: 975.323us (70.914us) - Single node plan created: 1.306ms (331.209us) - Runtime filters computed: 1.335ms (28.773us) - Distributed plan created: 1.582ms (247.204us) - Planning finished: 3.485ms (1.902ms) Change-Id: I6f01a35e5f9f5007a0298acfc8e16da00ef99c6c --- M fe/src/main/java/org/apache/impala/analysis/AnalysisContext.java M fe/src/main/java/org/apache/impala/analysis/Analyzer.java M fe/src/main/java/org/apache/impala/planner/Planner.java M fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java M fe/src/main/java/org/apache/impala/service/Frontend.java 5 files changed, 25 insertions(+), 15 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/85/5685/1 -- To view, visit http://gerrit.cloudera.org:8080/5685 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I6f01a35e5f9f5007a0298acfc8e16da00ef99c6c Gerrit-PatchSet: 1 Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-Owner: Joe McDonnell <joemcdonn...@cloudera.com>