[
https://issues.apache.org/jira/browse/HIVE-10385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507584#comment-14507584
]
Slava Markeyev commented on HIVE-10385:
---------------------------------------
This came up on the mailing list the other week. The use case that several
people seem to have is we use hive to ETL and partition data. We don't
necessarily care about the metastore partitions because the output data gets
moved (at least in my case) after the query is completed. This makes the table
partitions unnecessary.
> Optionally disable partition creation to speedup ETL jobs
> ---------------------------------------------------------
>
> Key: HIVE-10385
> URL: https://issues.apache.org/jira/browse/HIVE-10385
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Reporter: Slava Markeyev
> Priority: Minor
> Attachments: HIVE-10385.patch
>
>
> ETL jobs that create dynamic partitions with high cardinality perform the
> expensive step of metastore partition creation after query completion. Until
> bulk partition creation can be optimized there should be a way of optionally
> skipping this step.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
