Thanks v much guys. Indeed, I've seen more rich features covered in sqoop2, the integration with oozie sounds v cool as well. will try to ask this in sqoop mailing list again :)
Cheers! Shengjie On 2 Aug 2013, at 11:07, Shahab Yunus <[email protected]> wrote: > Though it is better as Ted suggested to discuss this in Sqoop mailing list > (as Sqoop 2 supposed to be more feature rich) but just to get this out, > Sqoop does support incremental imports if you can come up with a suitable > and compatible strategy. Tha tmigh thelp you if you configure you imports > on some periodic schedule. > > Regards, > Shahab > > > On Thu, Aug 1, 2013 at 10:17 PM, Jay Vyas <[email protected]> wrote: > >> Hbase doesn't have dynamic views on data outside of itself. But you can >> easily re run your sqoop flow to dump information into hbase. >> >> Actually, it might be easier to go with a pure RDBMS solution here since >> nowadays the Slave/master architectures in postgre and MySQL are mature >> enough to handle this sort of thing even for hundreds of thousands of rows.
