Hello, I've been looking at this recently for moving Hive tables from on-premise clusters to the cloud, but the principle should be the same for your use-case. If you wish to do this in an automated way, some tools worth considering are:
- Hive's built in replication framework: https://cwiki.apache.org/confluence/display/Hive/Replication - Hive's IMPORT/EXPORT primitives: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ImportExport - AirBnB's ReAir replication tool: https://medium.com/airbnb-engineering/reair-easy-to-use-tools-for-migrating-and-replicating-petabyte-scale-data-warehouses-5153f8a433da Elliot. On 8 April 2016 at 23:24, Ashok Kumar <ashok34...@yahoo.com> wrote: > Hi, > > Anyone has suggestions how to create and copy Hive and Spark tables from > Production to UAT. > > One way would be to copy table data to external files and then move the > external files to a local target directory and populate the tables in > target Hive with data. > > Is there an easier way of doing so? > > thanks > > >
