Rakesh Sharma created SQOOP-2585:
------------------------------------
Summary: merging hive tables using sqoop
Key: SQOOP-2585
URL: https://issues.apache.org/jira/browse/SQOOP-2585
Project: Sqoop
Issue Type: New Feature
Reporter: Rakesh Sharma
Assignee: Rakesh Sharma
Sqoop currently doesn't support merging of two hive tables. Implement a new
tool for Sqoop which :
1. merges two hive tables. (This will be most commonly used to merge new
incremental data into an existing hive table)
2. should support both partitioned and non partitioned tables
3. supports merge on composite keys
4. For partitioned tables, merges old partitions and also add new partitions.
5. Supports Text/RC/ORC/Seq file formats
6. Should make sure that only process is performing merge.
7. should be an atomic operation. If it fails at any point , it should revert
the target hive table to its original state.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
