This is an automated email from the ASF dual-hosted git repository.
parthc pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/drill.git.
from ca90229 DRILL-6272: Refactor dynamic UDFs and function initializer
tests to generate needed binary and source jars at runtime
new 0a4a37e DRILL-6321: Lateral Join and Unnest - initial implementation
for parser and planning
new 758a981 DRILL-6321: Lateral Join and Unnest - rules, options, logical
plan supports
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/drill/exec/opt/BasicOptimizer.java | 6 ++
.../physical/base/AbstractPhysicalVisitor.java | 6 ++
.../drill/exec/physical/base/PhysicalVisitor.java | 2 +
.../drill/exec/physical/config/LateralJoinPOP.java | 22 +++-
.../drill/exec/physical/config/UnnestPOP.java | 33 ++++--
.../impl/join/LateralJoinBatchCreator.java | 9 +-
.../physical/impl/unnest/UnnestRecordBatch.java | 16 ++-
.../apache/drill/exec/planner/PlannerPhase.java | 12 ++-
.../apache/drill/exec/planner/RuleInstance.java | 4 +
.../exec/planner/common/DrillCorrelateRelBase.java | 55 ++++++++++
.../exec/planner/common/DrillJoinRelBase.java | 4 +-
...lScreenRelBase.java => DrillUnnestRelBase.java} | 42 ++++----
.../drill/exec/planner/fragment/Materializer.java | 38 +++++++
.../exec/planner/logical/DrillCorrelateRel.java | 60 +++++++++++
...lAggregateRule.java => DrillCorrelateRule.java} | 46 +++-----
.../drill/exec/planner/logical/DrillJoinRel.java | 22 +++-
.../{DrillStoreRel.java => DrillUnnestRel.java} | 31 +++---
.../{DrillValuesRule.java => DrillUnnestRule.java} | 29 +++---
.../drill/exec/planner/physical/CorrelatePrel.java | 89 ++++++++++++++++
.../exec/planner/physical/CorrelatePrule.java | 56 ++++++++++
.../exec/planner/physical/PlannerSettings.java | 10 ++
.../{ComplexToJsonPrel.java => UnnestPrel.java} | 58 ++++++-----
.../{DirectScanPrule.java => UnnestPrule.java} | 34 +++---
.../sql/parser/UnsupportedOperatorsVisitor.java | 9 ++
.../exec/server/options/SystemOptionManager.java | 1 +
.../java-exec/src/main/resources/drill-module.conf | 1 +
.../impl/lateraljoin/TestLateralPlans.java | 116 +++++++++++++++++++++
.../impl/unnest/TestUnnestCorrectness.java | 2 +
.../test/resources/lateraljoin/lateralplan1.json | 95 +++++++++++++++++
.../resources/lateraljoin/nested-customer.json | 114 ++++++++++++++++++++
.../resources/lateraljoin/nested-customer.parquet | Bin 0 -> 3360 bytes
.../data/{Transform.java => LateralJoin.java} | 36 ++++---
.../logical/data/{Transform.java => Unnest.java} | 31 ++----
.../data/visitors/AbstractLogicalVisitor.java | 12 +++
.../logical/data/visitors/LogicalVisitor.java | 5 +
pom.xml | 2 +-
36 files changed, 932 insertions(+), 176 deletions(-)
create mode 100644
exec/java-exec/src/main/java/org/apache/drill/exec/planner/common/DrillCorrelateRelBase.java
copy
exec/java-exec/src/main/java/org/apache/drill/exec/planner/common/{DrillScreenRelBase.java
=> DrillUnnestRelBase.java} (56%)
create mode 100644
exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/DrillCorrelateRel.java
copy
exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/{DrillAggregateRule.java
=> DrillCorrelateRule.java} (52%)
copy
exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/{DrillStoreRel.java
=> DrillUnnestRel.java} (59%)
copy
exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/{DrillValuesRule.java
=> DrillUnnestRule.java} (57%)
create mode 100644
exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/CorrelatePrel.java
create mode 100644
exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/CorrelatePrule.java
copy
exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/{ComplexToJsonPrel.java
=> UnnestPrel.java} (52%)
copy
exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/{DirectScanPrule.java
=> UnnestPrule.java} (57%)
create mode 100644
exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/lateraljoin/TestLateralPlans.java
create mode 100644
exec/java-exec/src/test/resources/lateraljoin/lateralplan1.json
create mode 100644
exec/java-exec/src/test/resources/lateraljoin/nested-customer.json
create mode 100644
exec/java-exec/src/test/resources/lateraljoin/nested-customer.parquet
copy
logical/src/main/java/org/apache/drill/common/logical/data/{Transform.java =>
LateralJoin.java} (68%)
copy
logical/src/main/java/org/apache/drill/common/logical/data/{Transform.java =>
Unnest.java} (67%)
--
To stop receiving notification emails like this one, please contact
[email protected].
