Hi Pratik, I had a look at the below references. #1 uses SqoopOptions and finally invoking Sqoop.runTool() method in Java Program.This is since Sqoop 1.x does not have an official Java API. I this is a viable solution for performing an increment update using sqoop ? #2 uses Sqoop 2 Client Java API and is not currently ready for production deployment.Latest cut of Sqoop2 is 1.99.3 (download, documentation). Note that 1.99.3 is not compatible with 1.4.5 and not feature complete, it is not intended for production deployment.I believe that leaves me to use Sqoop 1.x ONLY.
Basically I want to do an increment update using sqoop through Java Program. I was thinking of invoking the entire bin/sqoop import commands with increment mode options from Java code using a ProcessBuilder is a correct option. Or is there is a better way of doing that programatically ? Thanks,-RR From: [email protected] To: [email protected] Subject: RE: Java API to Import Tables from RDBMs to Hive using Sqoop Date: Tue, 16 Sep 2014 10:56:48 +0530 Thanks Pratik, I will have a look into. -RR From: [email protected] Date: Fri, 12 Sep 2014 10:14:08 -0700 Subject: Re: Java API to Import Tables from RDBMs to Hive using Sqoop To: [email protected] This may help youhttp://stackoverflow.com/questions/9229611/how-to-use-sqoop-in-java-program http://devslogics.blogspot.com/2013/09/sqoop-java-client.html ~Pratik On Thu, Sep 11, 2014 at 7:47 PM, Radhe Radhe <[email protected]> wrote: Hello everyone, As per my experience till now I have used the direct *sqoop commands* to import Tables from RDBMs to HiveThe commands itself has a lot more switches and options. Is there an easy way to use JAVA APIs for importing Tables using Sqoop. Need suggestions if it's possible and viable to use a JAVA Program to import tables from RDBMs (dynamically based on the source Tables Metadata) to Hive using Sqoop Thanks,-RR
