[ 
https://issues.apache.org/jira/browse/HIVE-16706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sankar Hariappan updated HIVE-16706:
------------------------------------
    Attachment: HIVE-16706.01.patch

Added 01.patch with below changes:
- No source code changes as the issue doesn't exist. 
- There are 2 metastore apis getting called by PartitionIterable during 
bootstrap dump; listPartitionNames (without part_spec) and 
getPartitionsByNames. Both these methods never fail if a table or partition is 
dropped in between. Just return an empty list.
- Added a test case to verify if bootstrap dump fails when we return empty 
string from megastore apis.

Request [~sushanth]/[~thejas] to review the patch!

> Bootstrap REPL DUMP shouldn't fail when a partition is dropped/renamed when 
> dump in progress.
> ---------------------------------------------------------------------------------------------
>
>                 Key: HIVE-16706
>                 URL: https://issues.apache.org/jira/browse/HIVE-16706
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive, repl
>    Affects Versions: 2.1.0
>            Reporter: Sankar Hariappan
>            Assignee: Sankar Hariappan
>              Labels: DR, replication
>         Attachments: HIVE-16706.01.patch
>
>
> Currently, bootstrap REPL DUMP gets the partitions in a batch and then 
> iterate through it. If any partition is dropped/renamed during iteration, it 
> may lead to failure/exception. In this case, the partition should be skipped 
> from dump and also need to ensure no failure of REPL DUMP and the subsequent 
> incremental dump should ensure the consistent state of the table.
> This bug is related to HIVE-16684.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to