This is an automated email from the ASF dual-hosted git repository.
timothyfarkas pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/drill.git.
from 1058bd9 DRILL-6589: Push transitive closure predicate(s) past
aggregates
add e1f4a63 DRILL-6617: Planner Side changed to propagate
$drill_implicit_field$ information.
add 5aae3e4 DRILL-6618: Unnest changes for implicit column Unnest changes
to do batch processing and produce an extra implicit column for Lateral to keep
mapping between left rows and right output rows
add e9961bf DRILL-6619: Lateral changes for implicit column Lateral
changes to support batch processing from right side. It also fixes memory leak
issue with LimitRecordBatch Added debug logging for Lateral and fixed a memory
related issue in Limit
add 216ae5a DRILL-6616: Batch Processing for Lateral/Unnest
new 8f9d397 DRILL-6617: Changing name of implicit RowId column from
implicitColumn to implicitRIDColumn.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/drill/exec/store/jdbc/JdbcPrel.java | 1 +
.../org/apache/drill/exec/opt/BasicOptimizer.java | 3 +-
.../drill/exec/physical/config/LateralJoinPOP.java | 10 +-
.../drill/exec/physical/config/UnnestPOP.java | 12 +-
.../exec/physical/impl/join/LateralJoinBatch.java | 389 ++++++--
.../exec/physical/impl/limit/LimitRecordBatch.java | 4 +
.../drill/exec/physical/impl/unnest/Unnest.java | 11 +-
.../exec/physical/impl/unnest/UnnestImpl.java | 104 +-
.../physical/impl/unnest/UnnestRecordBatch.java | 31 +-
.../planner/common/DrillLateralJoinRelBase.java | 19 +-
.../drill/exec/planner/common/DrillRelOptUtil.java | 44 +
.../exec/planner/common/DrillUnnestRelBase.java | 1 +
.../DrillProjectPushIntoLateralJoinRule.java | 13 +-
.../drill/exec/planner/physical/AggPrelBase.java | 22 +
.../drill/exec/planner/physical/FilterPrel.java | 10 +
.../drill/exec/planner/physical/HashAggPrel.java | 1 -
.../drill/exec/planner/physical/JoinPrel.java | 1 +
.../exec/planner/physical/LateralJoinPrel.java | 2 +-
.../drill/exec/planner/physical/LimitPrel.java | 27 +-
.../apache/drill/exec/planner/physical/Prel.java | 9 +-
.../drill/exec/planner/physical/ProjectPrel.java | 32 +
.../drill/exec/planner/physical/ScanPrel.java | 1 +
.../drill/exec/planner/physical/ScreenPrel.java | 1 +
.../physical/SelectionVectorRemoverPrel.java | 5 +-
.../drill/exec/planner/physical/SinglePrel.java | 1 +
.../drill/exec/planner/physical/SortPrel.java | 22 +
.../drill/exec/planner/physical/TopNPrel.java | 22 +-
.../drill/exec/planner/physical/UnnestPrel.java | 26 +-
.../visitor/LateralUnnestRowIDVisitor.java | 74 ++
.../exec/planner/physical/visitor/PrelVisitor.java | 1 -
.../planner/sql/handlers/DefaultSqlHandler.java | 3 +
.../impl/join/TestLateralJoinCorrectness.java | 352 ++++---
.../TestLateralJoinCorrectnessBatchProcessing.java | 1007 ++++++++++++++++++++
.../impl/lateraljoin/TestE2EUnnestAndLateral.java | 7 +
.../impl/lateraljoin/TestLateralPlans.java | 23 +-
.../physical/impl/unnest/MockLateralJoinBatch.java | 8 +-
.../impl/unnest/TestUnnestCorrectness.java | 90 +-
.../unnest/TestUnnestWithLateralCorrectness.java | 25 +-
38 files changed, 2034 insertions(+), 380 deletions(-)
create mode 100644
exec/java-exec/src/main/java/org/apache/drill/exec/planner/physical/visitor/LateralUnnestRowIDVisitor.java
create mode 100644
exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/join/TestLateralJoinCorrectnessBatchProcessing.java
