Impala Public Jenkins has submitted this change and it was merged.
Change subject: IMPALA-4341: Add metadata load to planner timeline
......................................................................
IMPALA-4341: Add metadata load to planner timeline
This moves the timeline from the Analyzer GlobalState to the AnalysisContext
and AnalysisContext.AnalysisResult. When analysis needs to load metadata
about missing tables, it marks an event noting the start of metadata load.
Then, when metadata load completes (or times out), it marks an
event noting that metadata load completed (or timed out). Keeping the
timeline on the AnalysisContext means that it persists across attempts at
analysis. AnalysisContext.AnalysisResult has a reference to the timeline,
so that it persists past analyzeStmt and can be used for the rest of
the planning.
Here is an example output of the planner timeline after this change:
Planner Timeline: 4s371ms
- Metadata load started: 41.388ms (41.388ms)
- Metadata load finished: 4s260ms (4s219ms)
- Analysis finished: 4s296ms (35.693ms)
- Equivalence classes computed: 4s315ms (19.062ms)
- Single node plan created: 4s323ms (7.812ms)
- Runtime filters computed: 4s323ms (777.010us)
- Distributed plan created: 4s325ms (1.464ms)
- Planning finished: 4s371ms (46.697ms)
When there is no need to load metadata, the timeline looks like:
Planner Timeline: 13.695ms
- Analysis finished: 2.411ms (2.411ms)
- Equivalence classes computed: 2.653ms (241.733us)
- Single node plan created: 5.641ms (2.987ms)
- Runtime filters computed: 5.726ms (85.204us)
- Distributed plan created: 6.548ms (821.722us)
- Planning finished: 13.695ms (7.147ms)
Change-Id: I6f01a35e5f9f5007a0298acfc8e16da00ef99c6c
Reviewed-on: http://gerrit.cloudera.org:8080/5685
Reviewed-by: Marcel Kornacker <[email protected]>
Tested-by: Impala Public Jenkins
---
M fe/src/main/java/org/apache/impala/analysis/AnalysisContext.java
M fe/src/main/java/org/apache/impala/analysis/Analyzer.java
M fe/src/main/java/org/apache/impala/planner/Planner.java
M fe/src/main/java/org/apache/impala/planner/SingleNodePlanner.java
M fe/src/main/java/org/apache/impala/service/Frontend.java
5 files changed, 23 insertions(+), 15 deletions(-)
Approvals:
Marcel Kornacker: Looks good to me, approved
Impala Public Jenkins: Verified
--
To view, visit http://gerrit.cloudera.org:8080/5685
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: I6f01a35e5f9f5007a0298acfc8e16da00ef99c6c
Gerrit-PatchSet: 3
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-Owner: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins
Gerrit-Reviewer: Lars Volker <[email protected]>
Gerrit-Reviewer: Marcel Kornacker <[email protected]>
