jcamachor commented on a change in pull request #2205:
URL: https://github.com/apache/hive/pull/2205#discussion_r623245003
##########
File path: ql/src/java/org/apache/hadoop/hive/ql/parse/CalcitePlanner.java
##########
@@ -2067,51 +2069,49 @@ public RelNode apply(RelOptCluster cluster,
RelOptSchema relOptSchema, SchemaPlu
// and on top of that we should check that it only contains operators
that
// are supported by the rewriting algorithm.
HiveRelOptMaterializationValidator materializationValidator = new
HiveRelOptMaterializationValidator();
- materializationValidator.validate(calciteGenPlan);
+ materializationValidator.validate(calcitePlan);
setInvalidResultCacheReason(
materializationValidator.getResultCacheInvalidReason());
setInvalidAutomaticRewritingMaterializationReason(
materializationValidator.getAutomaticRewritingInvalidReason());
// 2. Apply pre-join order optimizations
- calcitePreCboPlan = applyPreJoinOrderingTransforms(calciteGenPlan,
- mdProvider.getMetadataProvider(), executorProvider);
-
+ calcitePlan = applyPreJoinOrderingTransforms(calcitePlan,
mdProvider.getMetadataProvider(), executorProvider);
+ if (LOG.isDebugEnabled()) {
+ LOG.debug("Plan after pre-join transformations:\n" +
RelOptUtil.toString(calcitePlan));
+ }
// 3. Materialized view based rewriting
// We disable it for CTAS and MV creation queries (trying to avoid any
problem
// due to data freshness)
if
(conf.getBoolVar(ConfVars.HIVE_MATERIALIZED_VIEW_ENABLE_AUTO_REWRITING) &&
!getQB().isMaterializedView() &&
!ctx.isLoadingMaterializedView() && !getQB().isCTAS() &&
getQB().hasTableDefined() &&
!forViewCreation) {
- calcitePreCboPlan = applyMaterializedViewRewriting(planner,
- calcitePreCboPlan, mdProvider.getMetadataProvider(),
executorProvider);
+ calcitePlan =
+ applyMaterializedViewRewriting(planner, calcitePlan,
mdProvider.getMetadataProvider(), executorProvider);
+ if (LOG.isDebugEnabled()) {
+ LOG.debug("Plan after view-based rewriting:\n" +
RelOptUtil.toString(calcitePlan));
+ }
}
// 4. Apply join order optimizations: reordering MST algorithm
// If join optimizations failed because of missing stats, we continue
with
// the rest of optimizations
if (profilesCBO.contains(ExtendedCBOProfile.JOIN_REORDERING)) {
- calciteOptimizedPlan = applyJoinOrderingTransform(calcitePreCboPlan,
- mdProvider.getMetadataProvider(), executorProvider);
+ calcitePlan = applyJoinOrderingTransform(calcitePlan,
mdProvider.getMetadataProvider(), executorProvider);
+ if (LOG.isDebugEnabled()) {
+ LOG.debug("Plan after join transformations:\n" +
RelOptUtil.toString(calcitePlan));
+ }
} else {
- calciteOptimizedPlan = calcitePreCboPlan;
disableSemJoinReordering = false;
}
// 5. Apply post-join order optimizations
- calciteOptimizedPlan =
applyPostJoinOrderingTransform(calciteOptimizedPlan,
- mdProvider.getMetadataProvider(), executorProvider);
-
- if (LOG.isDebugEnabled() && !conf.getBoolVar(ConfVars.HIVE_IN_TEST)) {
Review comment:
I think the `!conf.getBoolVar(ConfVars.HIVE_IN_TEST)` check was in place
because this was causing some issues in testing mode in the nodes (too much
logging or slow down). That was quite some time ago, maybe not an issue
anymore. No need to change anything but I wanted to leave a note in case we hit
some of these issues in the near future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
