RE: downloading RDBMS table data to Hive with Sqoop import

2015-05-05 Thread Mich Talebzadeh
RDBMS works on the basis of changes written to redo or transaction log before commits. To get a true feed to Hive you will need the committed log deliveries in the form of text delimited files loaded to a hive temporary tables and then inserted to Hive table following the initial load using

Re: downloading RDBMS table data to Hive with Sqoop import

2015-05-05 Thread Bhagwan S. Soni
You have to write a different hql which will handle update and delete, you can not do this direct from sqoop. On Wed, May 6, 2015 at 12:02 AM, Divakar Reddy wrote: > As per my knowledge Sqoop doesn't support updates and deletes. > > We are handling like: > > 1) drop particular data from *partiti

Re: downloading RDBMS table data to Hive with Sqoop import

2015-05-05 Thread Divakar Reddy
As per my knowledge Sqoop doesn't support updates and deletes. We are handling like: 1) drop particular data from *partitioned* (form partitioned Column) table and load it again with conditions in sqoop like --query "select * form xyz where date = '2015-04-02' Thanks, Divakar On Tue, May 5, 201