-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/34666/
-----------------------------------------------------------
(Updated July 8, 2015, 6:04 p.m.)
Review request for hive, chengxiang li and Xuefu Zhang.
Bugs: HIVE-9152
https://issues.apache.org/jira/browse/HIVE-9152
Repository: hive-git
Description
-------
Tez implemented dynamic partition pruning in HIVE-7826. This is a nice
optimization and we should implement the same in HOS.
Diffs (updated)
-----
common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 27f68df
itests/src/test/resources/testconfiguration.properties 4f2de12
ql/if/queryplan.thrift c8dfa35
ql/src/gen/thrift/gen-javabean/org/apache/hadoop/hive/ql/plan/api/OperatorType.java
e18f935
ql/src/java/org/apache/hadoop/hive/ql/exec/OperatorFactory.java f58a10b
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/HiveSparkClientFactory.java
21398d8
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkDynamicPartitionPruner.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/exec/spark/SparkUtilities.java ca0ffb6
ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorSparkPartitionPruningSinkOperator.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java 1de7e40
ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java 2ff3951
ql/src/java/org/apache/hadoop/hive/ql/optimizer/DynamicPartitionPruningOptimization.java
8546d21
ql/src/java/org/apache/hadoop/hive/ql/optimizer/Optimizer.java a7cf8b7
ql/src/java/org/apache/hadoop/hive/ql/optimizer/SparkRemoveDynamicPruningBySize.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/optimizer/physical/Vectorizer.java
ad47547
ql/src/java/org/apache/hadoop/hive/ql/optimizer/spark/SparkPartitionPruningSinkDesc.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/parse/spark/GenSparkProcContext.java
447f104
ql/src/java/org/apache/hadoop/hive/ql/parse/spark/GenSparkUtils.java 7992c88
ql/src/java/org/apache/hadoop/hive/ql/parse/spark/OptimizeSparkProcContext.java
f7586a4
ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkCompiler.java 7f2c079
ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SparkPartitionPruningSinkOperator.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/parse/spark/SplitOpTreeForDPP.java
PRE-CREATION
ql/src/java/org/apache/hadoop/hive/ql/plan/MapWork.java 3217df2
ql/src/java/org/apache/hadoop/hive/ql/plan/TableScanDesc.java 9e9a2a2
ql/src/java/org/apache/hadoop/hive/ql/ppd/SyntheticJoinPredicate.java 363e49e
ql/src/test/queries/clientpositive/spark_dynamic_partition_pruning.q
PRE-CREATION
ql/src/test/queries/clientpositive/spark_dynamic_partition_pruning_2.q
PRE-CREATION
ql/src/test/queries/clientpositive/spark_vectorized_dynamic_partition_pruning.q
PRE-CREATION
ql/src/test/results/clientpositive/spark/spark_dynamic_partition_pruning.q.out
PRE-CREATION
ql/src/test/results/clientpositive/spark/spark_dynamic_partition_pruning_2.q.out
PRE-CREATION
ql/src/test/results/clientpositive/spark/spark_vectorized_dynamic_partition_pruning.q.out
PRE-CREATION
ql/src/test/results/clientpositive/spark/vectorized_dynamic_partition_pruning.q.out
PRE-CREATION
Diff: https://reviews.apache.org/r/34666/diff/
Testing
-------
spark_dynamic_partition_pruning.q, spark_dynamic_partition_pruning_2.q - both
are clone from tez's test.
Thanks,
Chao Sun
