Re: Approach: Incremental data load from HBASE

2016-12-24 Thread Chetan Khatri
Hello HBase Community, What is suggested approach for Incremental import from HBase to HDFS, like RDBMS to HDFS Sqoop provides support with below script sqoop job --create myssb1 -- import --connect jdbc:mysql://:/sakila --username admin --password admin --driver=com.mysql.jdbc.Driver --query "SE

Re: Approach: Incremental data load from HBASE

2016-12-23 Thread Chetan Khatri
Ted Correct, In my case i want Incremental Import from HBASE and Incremental load to Hive. Both approach discussed earlier with Indexing seems accurate to me. But like Sqoop support Incremental import and load for RDBMS, Is there any tool which supports Incremental import from HBase ? On Wed, De

Approach: Incremental data load from HBASE

2016-12-21 Thread Chetan Khatri
Hello Guys, I would like to understand different approach for Distributed Incremental load from HBase, Is there any *tool / incubactor tool* which satisfy requirement ? *Approach 1:* Write Kafka Producer and maintain manually column flag for events and ingest it with Linkedin Gobblin to HDFS / S