>From Peeyush Gupta <[email protected]>:
Attention is currently required from: Peeyush Gupta.
Hello Jenkins, Anon. E. Moose #1000171,
I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19527
to look at the new patch set (#2).
Change subject: [ASTERIXDB-3576][EXT] push predicates down to delta tables to
filter row groups
......................................................................
[ASTERIXDB-3576][EXT] push predicates down to delta tables to filter row groups
- user model changes: no
- storage format changes: no
- interface changes: no
Details:
Delta table's data files are essentially Parquet files. Parquet allows
applying a predicate while reading data files to skip row groups.
With this patch we pushdown filters to individual parquet files of the
Delta table to filter row groups. The Predicate class of the Delta Kernel API
is not serializable, so we have added a custom serialization/de-serialization
of Delta kernel APIs Predicates.
Change-Id: I9fa1a84d7be63ada7b9768a81984b2172e7401b3
---
A
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/PredicateSerDe.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaFileRecordReader.java
M
asterixdb/asterix-external-data/src/main/java/org/apache/asterix/external/input/record/reader/aws/delta/DeltaReaderFactory.java
3 files changed, 177 insertions(+), 6 deletions(-)
git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb
refs/changes/27/19527/2
--
To view, visit https://asterix-gerrit.ics.uci.edu/c/asterixdb/+/19527
To unsubscribe, or for help writing mail filters, visit
https://asterix-gerrit.ics.uci.edu/settings
Gerrit-Project: asterixdb
Gerrit-Branch: ionic
Gerrit-Change-Id: I9fa1a84d7be63ada7b9768a81984b2172e7401b3
Gerrit-Change-Number: 19527
Gerrit-PatchSet: 2
Gerrit-Owner: Peeyush Gupta <[email protected]>
Gerrit-Reviewer: Anon. E. Moose #1000171
Gerrit-Reviewer: Jenkins <[email protected]>
Gerrit-Attention: Peeyush Gupta <[email protected]>
Gerrit-MessageType: newpatchset
