This is an automated email from the ASF dual-hosted git repository.
sorabh pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/drill.git.
from 55ac523 DRILL-6410: Fixed memory leak in flat Parquet reader
new eb80271 DRILL-6788: Intermittent unit test failure
TestDrillbitResilience.failsWhenParsing: Query state should be FAILED (and not
COMPLETED) closes #1499
new d5146c4 DRILL-6766: Lateral Unnest query : IllegalStateException -
rowId in right batch of lateral is smaller than rowId in left batch being
processed Note: Issue was in StreamingAgg where if output from one or multiple
input batch was splitting into multiple output batch, then remaining input
records were discarded after producing first output batch closes #1490
new 216b123 DRILL-6731: Move the BFs aggregating work from the Foreman to
the RuntimeFilter
new de76e13 DRILL-6731: Resolving race conditions in RuntimeFilterSink
Add condition variable to avoid starvation of producer thread while acquiring
queue lock
new 0a3ebc2 DRILL-6731: use thread pool to run the runtime filter
aggregating work closes #1459
The 5 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../org/apache/drill/exec/ops/FragmentContext.java | 8 +-
.../apache/drill/exec/ops/FragmentContextImpl.java | 20 +-
.../physical/impl/aggregate/StreamingAggBatch.java | 74 +++--
.../impl/aggregate/StreamingAggTemplate.java | 56 ++--
.../impl/aggregate/StreamingAggregator.java | 19 +-
.../impl/filter/RuntimeFilterRecordBatch.java | 43 +--
.../exec/physical/impl/join/HashJoinBatch.java | 5 +-
.../exec/physical/impl/join/LateralJoinBatch.java | 4 +-
.../exec/physical/impl/unnest/UnnestImpl.java | 12 +-
.../physical/visitor/RuntimeFilterVisitor.java | 32 +--
.../drill/exec/record/AbstractRecordBatch.java | 10 +-
.../org/apache/drill/exec/work/WorkManager.java | 4 +-
.../exec/work/filter/RuntimeFilterReporter.java | 5 +-
...FilterManager.java => RuntimeFilterRouter.java} | 60 +---
.../drill/exec/work/filter/RuntimeFilterSink.java | 222 +++++++++++++++
.../exec/work/filter/RuntimeFilterWritable.java | 46 ++-
.../apache/drill/exec/work/foreman/Foreman.java | 16 +-
.../impl/agg/TestStreamingAggEmitOutcome.java | 315 ++++++++++++++++++++-
.../drill/exec/server/TestDrillbitResilience.java | 4 +-
.../org/apache/drill/test/OperatorFixture.java | 12 +-
.../apache/drill/test/PhysicalOpUnitTestBase.java | 12 +-
.../java/org/apache/drill/exec/proto/BitData.java | 127 ++++++++-
.../org/apache/drill/exec/proto/SchemaBitData.java | 7 +
.../drill/exec/proto/beans/RuntimeFilterBDef.java | 22 ++
protocol/src/main/protobuf/BitData.proto | 1 +
25 files changed, 940 insertions(+), 196 deletions(-)
rename
exec/java-exec/src/main/java/org/apache/drill/exec/work/filter/{RuntimeFilterManager.java
=> RuntimeFilterRouter.java} (87%)
create mode 100644
exec/java-exec/src/main/java/org/apache/drill/exec/work/filter/RuntimeFilterSink.java
