Re: Using Sqoop to get data from Impala/Hive to another Hive table

2017-02-21 Thread Mich Talebzadeh
regardless there is no point using Sqoop for such purpose. it is not really designed for it :) Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw *

Re: Using Sqoop to get data from Impala/Hive to another Hive table

2017-02-21 Thread Jörn Franke
From hive to hive another cluster I would use Hive Import/Export, if possible with Falcon instead of Sqoop. Sqoop always needs to do serialization/deserialization which is fine if the systems are different (e.g. Oracle -> Hive), but if it is the same system then usually it makes sense to use

Re: Using Sqoop to get data from Impala/Hive to another Hive table

2017-02-21 Thread Mich Talebzadeh
thanks Jorn. the idea is to test a big data high availability tool. by ingesting data to the target cluster. I have provisioned aan oracle schema for it so we can use Sqoop to get data into Hive. someone suggested try using sqoop to ingest from a hive table in one cluster to the target cluster.

Re: Using Sqoop to get data from Impala/Hive to another Hive table

2017-02-21 Thread Jörn Franke
Hallo, I have not tried it, but sqoop supports any jdbc driver. However, since the SQL syntax is not necessarily standardized you may face issues or performance problems. Hive itself has a nice import and export tool that supports also the metadata import/export. It can be orchestrated from

Using Sqoop to get data from Impala/Hive to another Hive table

2017-02-21 Thread Mich Talebzadeh
Hi, I have not tried this but someone mentioned that it is possible to use Sqoop to get data from one Impala/Hive table in one cluster to another? The clusters are in different zones. This is to test the cluster. Has anyone done such a thing? Thanks Dr Mich Talebzadeh LinkedIn *