[
https://issues.apache.org/jira/browse/HIVE-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ning Zhang updated HIVE-1002:
-----------------------------
Attachment: HIVE-1002.2.patch
Uploading a new patch HIVE-1002.2.patch. Additional changes include:
1) introduce 2 hive parameters: hive.exec.max.dynamic.partitions=1000 (the
total number of DP can be created) and
hive.exec.max.dynamic.partitions.pernode=100 (max # of DP can be created per
mapper/reducer). They are introduced primarily to reduce the load to the
cluster. A fatal error is raised if hive.exec.max.dynamic.partitions.pernode is
reached and the job is killed. The hive.exec.max.dynamic.partitions is checked
after job completed before MoveTask moves the intermediate results to the final
location.
2) introduce hive.exec.default.partition.name=__HIVE_DEFAULT_PARTITION__.
This is used to put tuples whose DP column value is NULL/empty string. For
values containing special characters such as '%', ':', '/', we escape it using
'%' followed by 2 hex code. Unicode larger than 127 will not be escaped.
> multi-partition inserts
> -----------------------
>
> Key: HIVE-1002
> URL: https://issues.apache.org/jira/browse/HIVE-1002
> Project: Hadoop Hive
> Issue Type: New Feature
> Reporter: Zheng Shao
> Assignee: Ning Zhang
> Fix For: 0.6.0
>
> Attachments: HIVE-1002.1.patch, HIVE-1002.2.patch, HIVE-1002.patch
>
>
> We should allow queries like this into a partitioned table:
> {code}
> CREATE TABLE (a STRING, b STRING, c STRING)
> PARTITIONED BY (ds STRING, ts STRING);
> INSERT OVERWRITE TABLE x PARTITION (ds = '2009-12-12')
> SELECT a, b, c, ts FROM xxx;
> {code}
> Basically, allowing users to overwrite multiple partitions at a time.
> The partition values specified in PARTITION part (if any) should be a prefix
> of the partition keys.
> The rest of the partition keys goes to the end of the SELECT expression list.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
