Jian Wu has uploaded a new change for review.

  http://gerrit.cloudera.org:8080/3623

Change subject: IMPALA-2328 Parquet scan should use min/max stats
......................................................................

IMPALA-2328 Parquet scan should use min/max stats

Parquet stores min/max stats which can be used to skip reading blocks if
they don't qualify a certain predicate.

This patch create a tuple row which consists of two tuples to store the
min/max value, and evaluate the conjuncts on it. If the [min, max] range
don't qualify the predicate, we can skip this row group.

Change-Id: I91de1f4d0fb2a982d06cd344e41901e3bf3c2cea
---
M be/src/exec/exec-node.cc
M be/src/exec/exec-node.h
M be/src/exec/hdfs-parquet-scanner.cc
M be/src/exec/hdfs-parquet-scanner.h
M be/src/exec/hdfs-scanner.h
M be/src/exprs/anyval-util.cc
M be/src/exprs/anyval-util.h
M be/src/exprs/compound-predicates.cc
M be/src/exprs/compound-predicates.h
M be/src/exprs/expr-context.cc
M be/src/exprs/expr-context.h
M be/src/exprs/expr-value.h
M be/src/exprs/expr.h
M be/src/exprs/literal.h
M be/src/exprs/operators-ir.cc
M be/src/exprs/operators.h
M be/src/exprs/scalar-fn-call.cc
M be/src/exprs/scalar-fn-call.h
M be/src/exprs/slot-ref.cc
M be/src/exprs/slot-ref.h
M be/src/runtime/CMakeLists.txt
A be/src/runtime/minmax-value-test.cc
A be/src/runtime/minmax-value.h
M be/src/runtime/tuple-row.h
M be/src/runtime/types.cc
M be/src/runtime/types.h
A be/src/service/fe-support-common.h
M be/src/service/fe-support.cc
M be/src/udf/udf.h
M be/src/util/symbols-util.cc
30 files changed, 1,341 insertions(+), 152 deletions(-)


  git pull ssh://gerrit.cloudera.org:29418/Impala refs/changes/23/3623/1
-- 
To view, visit http://gerrit.cloudera.org:8080/3623
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-MessageType: newchange
Gerrit-Change-Id: I91de1f4d0fb2a982d06cd344e41901e3bf3c2cea
Gerrit-PatchSet: 1
Gerrit-Project: Impala
Gerrit-Branch: cdh5-trunk
Gerrit-Owner: Jian Wu <[email protected]>

Reply via email to