[
https://issues.apache.org/jira/browse/HIVE-11940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sergio Peña updated HIVE-11940:
-------------------------------
Fix Version/s: (was: 1.3.0)
> "INSERT OVERWRITE" query is very slow because it creates one "distcp" per
> file to copy data from staging directory to target directory
> --------------------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-11940
> URL: https://issues.apache.org/jira/browse/HIVE-11940
> Project: Hive
> Issue Type: Bug
> Affects Versions: 1.2.1
> Reporter: Sergio Peña
> Assignee: Sergio Peña
> Fix For: 2.0.0
>
> Attachments: HIVE-11940.1.patch, HIVE-11940.2.patch
>
>
> When hive.exec.stagingdir is set to ".hive-staging", which will be placed
> under the target directory when running "INSERT OVERWRITE" query, Hive will
> grab all files under the staging directory and copy them ONE BY ONE to target
> directory.
> When hive exec.stagingdir is set to "/tmp/hive", Hive will simply do a RENAME
> operation which will be instant.
> This happens with files that are not encrypted.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
