[ 
https://issues.apache.org/jira/browse/HIVE-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sushanth Sowmyan updated HIVE-10227:
------------------------------------
    Attachment: HIVE-10227.2.patch

Updating patch after initial feedback from Mithun on adding 
HCatClient.getConfVal, and using that to change how ReplicationTask.create and 
its factory loading works, instead of statically initializing a HiveConf.

Also, added batching semantics for HCatReplicationTaskIterator so that even if 
a user specifies -1 as their max_events, we should not have OOM issues. In 
addition, HCatReplicationTaskIterator always returns max_events entries if 
available, irrespective of whether or not there are max_events relevant events 
in the next eventFrom+max_events events(old behaviour was that it'd return 
at-most max_events events as it simply passed these parameters to the 
metastore). Basically, HCatReplicationTaskIterator has been made more robust, 
and is now the primary interface point to its users.

> Concrete implementation of Export/Import based ReplicationTaskFactory
> ---------------------------------------------------------------------
>
>                 Key: HIVE-10227
>                 URL: https://issues.apache.org/jira/browse/HIVE-10227
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Import/Export
>            Reporter: Sushanth Sowmyan
>            Assignee: Sushanth Sowmyan
>         Attachments: HIVE-10227.2.patch, HIVE-10227.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to