Shankar, I created a wiki to explain the sqoop server internals. Wrote another wiki to explain all the sqoop entities we have and their relationship to others. https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+2+(1.99.4)+Entity+Nomenclature+and+Relationships
lmk, if this helps you understand sqoop, feedback and suggestions to improve wiki always welcome Veena Best, *./Vee* On Wed, Jan 21, 2015 at 8:19 AM, Veena Basavaraj <[email protected]> wrote: > Hey Shankar, > > Good point, I do not see a technical guide of the Sqoop Server ( nor a > comprehensive design doc). Please add a doc ticket for it and we can create > one together. > > Here are some quick details that might help you. I am assuming you have > some basic exposure to how tomcat works. > > 1. Sqoop-server uses tomcat web server, it is very bare bones. The main > entry point is the TomcatToolRunner > <https://github.com/apache/sqoop/blob/sqoop2/tomcat/src/main/java/org/apache/sqoop/tomcat/TomcatToolRunner.java> > , > it bootstraps the tomcat and loads all the sqoop related classes into its > class path. > > 2. The main hook for the sqoop server to start is this entry in the > web.xml. Tomcat invokes it callbacks as it bootups and we use the > > contextInitialized callback to initialize all the related code. > > <!-- Listeners --> > > <listener> > > > <listener-class>org.apache.sqoop.server.ServerInitializer</listener-class> > > </listener> > > 3. SqoopServer.initialize() is the main entry point. > > 4. There are a bunch of servlets in web.xml : > https://github.com/apache/sqoop/blob/sqoop2/server/src/main/webapp/WEB-INF/web.xml > > They receive the requests and process it. Each Servlet has its > corresponding handler class that handles the request for that servlet. It > then internally calls the internal sqoop core/ common code. > > All the rest APIs supported are documented here: > http://sqoop.apache.org/docs/1.99.4/RESTAPI.html#id1 > > There is also the Sqoop-client that used to invoke the Sqoop-server > methods via the jersey REST client, Recently it was switched to Hadoop-auth > for adding Kerberos support that are documented herehttps:// > cwiki.apache.org/confluence/display/SQOOP/Security+Guide+On+Sqoop+2 > > > Hope this helps! > > > > > > > > > > Best, > *./Vee* > > On Tue, Jan 20, 2015 at 9:51 PM, SHANKAR REDDY < > [email protected]> wrote: > >> Team, >> Any one can share information about Sqoop server documentation or slides >> should helpful for me. >> >> Thanks in advance. >> >> -Sankar >> > >
