Hi Veena, Thanks for the update. SQOOP-2033 created to accommodate Technical guide of Sqoop server.
Let me go though the Wiki and keep you posted if any questions. -Sankar Thanks, Sankara, M : 510 936 0999 On Wed, Jan 21, 2015 at 4:25 PM, Veena Basavaraj <[email protected]> wrote: > Shankar, > > I created a wiki to explain the sqoop server internals. Wrote another wiki > to explain all the sqoop entities we have and their relationship to others. > > https://cwiki.apache.org/confluence/display/SQOOP/Sqoop+2+(1.99.4)+Entity+Nomenclature+and+Relationships > > lmk, if this helps you understand sqoop, feedback and suggestions to > improve wiki always welcome > > Veena > > > > > Best, > *./Vee* > > On Wed, Jan 21, 2015 at 8:19 AM, Veena Basavaraj <[email protected]> > wrote: > > > Hey Shankar, > > > > Good point, I do not see a technical guide of the Sqoop Server ( nor a > > comprehensive design doc). Please add a doc ticket for it and we can > create > > one together. > > > > Here are some quick details that might help you. I am assuming you have > > some basic exposure to how tomcat works. > > > > 1. Sqoop-server uses tomcat web server, it is very bare bones. The main > > entry point is the TomcatToolRunner > > < > https://github.com/apache/sqoop/blob/sqoop2/tomcat/src/main/java/org/apache/sqoop/tomcat/TomcatToolRunner.java> > , > > it bootstraps the tomcat and loads all the sqoop related classes into its > > class path. > > > > 2. The main hook for the sqoop server to start is this entry in the > > web.xml. Tomcat invokes it callbacks as it bootups and we use the > > > > contextInitialized callback to initialize all the related code. > > > > <!-- Listeners --> > > > > <listener> > > > > > > > <listener-class>org.apache.sqoop.server.ServerInitializer</listener-class> > > > > </listener> > > > > 3. SqoopServer.initialize() is the main entry point. > > > > 4. There are a bunch of servlets in web.xml : > > > https://github.com/apache/sqoop/blob/sqoop2/server/src/main/webapp/WEB-INF/web.xml > > > > They receive the requests and process it. Each Servlet has its > > corresponding handler class that handles the request for that servlet. It > > then internally calls the internal sqoop core/ common code. > > > > All the rest APIs supported are documented here: > > http://sqoop.apache.org/docs/1.99.4/RESTAPI.html#id1 > > > > There is also the Sqoop-client that used to invoke the Sqoop-server > > methods via the jersey REST client, Recently it was switched to > Hadoop-auth > > for adding Kerberos support that are documented herehttps:// > > cwiki.apache.org/confluence/display/SQOOP/Security+Guide+On+Sqoop+2 > > > > > > Hope this helps! > > > > > > > > > > > > > > > > > > > > Best, > > *./Vee* > > > > On Tue, Jan 20, 2015 at 9:51 PM, SHANKAR REDDY < > > [email protected]> wrote: > > > >> Team, > >> Any one can share information about Sqoop server documentation or slides > >> should helpful for me. > >> > >> Thanks in advance. > >> > >> -Sankar > >> > > > > >
