Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/21239 )
Change subject: IMPALA-13043: Implement Join Capability to the Calcite Planner ...................................................................... IMPALA-13043: Implement Join Capability to the Calcite Planner This commit adds the ability to handle joins in the Calcite planner. Some items worth noting: There is extra handling in the ImpalaJoinRel class to deal with outer joins. The AnalyzedTupleIsNullExpr object is needed for processing which derives from TupleIsNullExpr. Normally, expressions are created in the CreateExprVisitor, but the join requires that the TupleIsNullExpr object is wrapped around the expressions retrieved from the inputs. The execution engine requires separation of the equijoin conditions and the non-equijoin conditions. Furthermore, the equijoin conditions are BinaryCompPredicates instead of normal FunctionCallExprs, so the AnalyzedBinaryCompExpr class had to be created. Special processing needed to be coded for runtime filter generators. The conditions needed to be added to the value transfer graph in order to enable the Impala planner logic to create and push these generators. The join also required some rules to be added to the optimizer. If a join is done through the "ON" clause, Calcite is able to place the join condition directly in the Join RelNode. However, if it is in the "WHERE" clause, Calcite creates a Filter RelNode and creates a cross join RelNode object. Therefore, in order to handle "WHERE" joins, we need to implement the rules in the optimizer. Change-Id: I5db097577907d79877f52feff2922000af074ecd Reviewed-on: http://gerrit.cloudera.org:8080/21239 Reviewed-by: Impala Public Jenkins <[email protected]> Reviewed-by: Michael Smith <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- A java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/AnalyzedBinaryCompExpr.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/AnalyzedFunctionCallExpr.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/FunctionResolver.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/RexCallConverter.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/functions/RexLiteralConverter.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ConvertToImpalaRelRules.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaAggRel.java A java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaJoinRel.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaPlanRel.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaProjectRel.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/ImpalaSortRel.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/NodeCreationUtils.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/node/NodeWithExprs.java A java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/phys/ImpalaHashJoinNode.java A java/calcite-planner/src/main/java/org/apache/impala/calcite/rel/phys/ImpalaNestedLoopJoinNode.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/service/CalciteOptimizer.java M java/calcite-planner/src/main/java/org/apache/impala/calcite/type/ImpalaTypeConverter.java M testdata/workloads/functional-query/queries/QueryTest/calcite.test 18 files changed, 896 insertions(+), 46 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified Michael Smith: Looks good to me, but someone else must approve -- To view, visit http://gerrit.cloudera.org:8080/21239 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I5db097577907d79877f52feff2922000af074ecd Gerrit-Change-Number: 21239 Gerrit-PatchSet: 21 Gerrit-Owner: Steve Carlin <[email protected]> Gerrit-Reviewer: Aman Sinha <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Steve Carlin <[email protected]>
