[ https://issues.apache.org/jira/browse/HIVE-9152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14632293#comment-14632293 ]
Lefty Leverenz commented on HIVE-9152: -------------------------------------- Doc note: This adds two configuration parameters (*hive.spark.dynamic.partition.pruning* and *hive.spark.dynamic.partition.pruning.max.data.size*) to HiveConf.java, so they should be documented in Hive on Spark: Getting Started and in the Spark section of Configuration Properties. * doc now or only after merge branch with master? -- [Hive on Spark: Getting Started -- Configuring Hive | https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started#HiveonSpark:GettingStarted-ConfiguringHive] * wait until merge with master -- [Configuration Properties -- Spark | https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-Spark] Hive on Spark: Getting Started might also need general information about dynamic partition pruning. > Dynamic Partition Pruning [Spark Branch] > ---------------------------------------- > > Key: HIVE-9152 > URL: https://issues.apache.org/jira/browse/HIVE-9152 > Project: Hive > Issue Type: Sub-task > Components: Spark > Affects Versions: spark-branch > Reporter: Brock Noland > Assignee: Chao Sun > Labels: TODOC-SPARK > Fix For: spark-branch > > Attachments: HIVE-9152.1-spark.patch, HIVE-9152.10-spark.patch, > HIVE-9152.11-spark.patch, HIVE-9152.12-spark.patch, HIVE-9152.2-spark.patch, > HIVE-9152.3-spark.patch, HIVE-9152.4-spark.patch, HIVE-9152.5-spark.patch, > HIVE-9152.6-spark.patch, HIVE-9152.8-spark.patch, HIVE-9152.9-spark.patch > > > Tez implemented dynamic partition pruning in HIVE-7826. This is a nice > optimization and we should implement the same in HOS. -- This message was sent by Atlassian JIRA (v6.3.4#6332)