Daniel Becker has uploaded a new patch set (#20). ( http://gerrit.cloudera.org:8080/12621 )
Change subject: IMPALA-8253: Parquet delta encoding and decoding. ...................................................................... IMPALA-8253: Parquet delta encoding and decoding. Implemented an encoder and decoder for the Parquet delta encoding (see https://github.com/apache/parquet-format/blob/master/Encodings.md). The coders are not integrated with Impala yet, they provide an interface that Impala could use. Added new methods to BitWriter and BatchedBitReader handling Uleb and ZigZag integers for 64 bits. Also added a benchmark (parquet-delta-benchmark.cc) that compares the space and CPU performance of plain, dictionary and delta encoding. Testing: - Added new tests for the encoder and decoder - Tests covering the additions in BitPacking, BitWriter and BatchedBitReader. Change-Id: Ie7378ac1a490a6c89a0a4349aae86cbc0fbc80f8 --- M be/src/benchmarks/CMakeLists.txt A be/src/benchmarks/parquet-delta-benchmark.cc M be/src/exec/parquet/CMakeLists.txt A be/src/exec/parquet/parquet-delta-coder-test-data.h A be/src/exec/parquet/parquet-delta-coder-test.cc A be/src/exec/parquet/parquet-delta-decoder.cc A be/src/exec/parquet/parquet-delta-decoder.h A be/src/exec/parquet/parquet-delta-encoder.cc A be/src/exec/parquet/parquet-delta-encoder.h M be/src/util/bit-packing-test.cc M be/src/util/bit-packing.cc M be/src/util/bit-packing.h M be/src/util/bit-packing.inline.h M be/src/util/bit-stream-utils.h M be/src/util/bit-stream-utils.inline.h 15 files changed, 4,888 insertions(+), 13 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/21/12621/20 -- To view, visit http://gerrit.cloudera.org:8080/12621 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Ie7378ac1a490a6c89a0a4349aae86cbc0fbc80f8 Gerrit-Change-Number: 12621 Gerrit-PatchSet: 20 Gerrit-Owner: Daniel Becker <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Daniel Becker <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
