[ 
https://issues.apache.org/jira/browse/HIVE-14535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15593127#comment-15593127
 ] 

Sahil Takiar commented on HIVE-14535:
-------------------------------------

Thanks a ton [~gopalv]! Definitely helps a lot, don't want to go down the 
direct write approach if we have already seen users hit issues with it. Could 
you expand a little more on your comment about writing to the same file name? 
Was Hive modified to force each task attempt to write to the same file? In that 
case what was the exact issue with checksum-safety? Was one of the writes 
rejected?

Also, want to understand more how it can lead to data loss? Wouldn't the query 
fail if something like this happens?

> add micromanaged tables to Hive (metastore keeps track of the files)
> --------------------------------------------------------------------
>
>                 Key: HIVE-14535
>                 URL: https://issues.apache.org/jira/browse/HIVE-14535
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>
> Design doc: 
> https://docs.google.com/document/d/1b3t1RywfyRb73-cdvkEzJUyOiekWwkMHdiQ-42zCllY
> Feel free to comment.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to