[ 
https://issues.apache.org/jira/browse/HIVE-19321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16454674#comment-16454674
 ] 

Sahil Takiar commented on HIVE-19321:
-------------------------------------

Attached a patch based on HIVE-16295 that was close to completing DP support. 
The main issue left is how to deal with the fact that there is no good way to 
determine the modified partitions in {{Hive#loadDynamicPartitions}}

> Dynamic Partitioning Integration with Hadoop's S3A OutputCommitter
> ------------------------------------------------------------------
>
>                 Key: HIVE-19321
>                 URL: https://issues.apache.org/jira/browse/HIVE-19321
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sahil Takiar
>            Priority: Major
>         Attachments: HIVE-19321.1.WIP.patch
>
>
> Filing this as a follow JIRA to HIVE-16295. Adding support for the S3A Output 
> Committer in Dynamic Partitioning queries is non-trivial and much more effort 
> than adding support for regular inserts and ctas queries. So adding DP 
> support will be done in a separate JIRA. See the discussion in HIVE-16295 for 
> more details about why adding DP integration is tricky.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to