Another great source to get a picture of what is going on is Owen's presentation http://wiki.apache.org/hadoop-data/attachments/HadoopPresentations/attachments/HadoopMapReduceArch.pdf
Naama On Wed, Jul 2, 2008 at 8:41 AM, Ahmad Humayun <[EMAIL PROTECTED]> wrote: > more than glad, that you ppl are finding it helpful :) > > On Tue, Jul 1, 2008 at 1:30 AM, Sangmin Lee <[EMAIL PROTECTED]> wrote: > > > thank you for sharing your valuable doc. > > > > -sangmin > > > > On Tue, Jun 24, 2008 at 7:02 AM, Ahmad Humayun <[EMAIL PROTECTED]> > > wrote: > > > > > When we were looking into Hadoop code....we attempted to make a doc out > > of > > > it....you might want to check it out: > > > http://suraj.lums.edu.pk/~ahmadh/resources/docs/hadoop_call_trace.doc<http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc> > <http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc> > > <http://suraj.lums.edu.pk/%7Eahmadh/resources/docs/hadoop_call_trace.doc > > > > > > > > regards, > > > > > > On Tue, Jun 24, 2008 at 3:09 PM, Naama Kraus <[EMAIL PROTECTED]> > > wrote: > > > > > > > Hi, > > > > > > > > Could you please also specify starting points for getting into the > map > > > > reduce code ? > > > > > > > > Thanks, Naama > > > > > > > > On Mon, Jun 23, 2008 at 10:40 PM, lohit <[EMAIL PROTECTED]> wrote: > > > > > > > > > Following any hadoop dfs related commands to see what code path it > > > takes > > > > > would be a good start. > > > > > Bulk of hdfs code in org.apache.hadoop.dfs package. > > > > > org.apache.hadoop.fs has generic interface/apis, especially > > > > FileSystem.java > > > > > You could follow that and check DistributedFileSystem.java which > > > > > implements/overrides FileSystem apis > > > > > DFSClient.java should be a good start for hdfs client end code. > > > > > On the server side NameNode.java would be a good start. Similarly > > > > > DataNode.java for Data nodes. > > > > > > > > > > Thanks, > > > > > Lohit > > > > > > > > > > ----- Original Message ---- > > > > > From: Sangmin Lee <[EMAIL PROTECTED]> > > > > > To: [email protected] > > > > > Sent: Monday, June 23, 2008 12:32:17 PM > > > > > Subject: Start point for source code > > > > > > > > > > Hi all, > > > > > > > > > > I'm a novice for hadoop code and want to hack hdfs code. > > > > > Can any body point me to the startpoint ? > > > > > > > > > > I appreciate your help in advance. > > > > > > > > > > Cheers, > > > > > Sangmin > > > > > > > > > > > > > > > > > > > > > > -- > > > > oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo > 00 > > > oo > > > > 00 oo 00 oo > > > > "If you want your children to be intelligent, read them fairy tales. > If > > > you > > > > want them to be more intelligent, read them more fairy tales." > (Albert > > > > Einstein) > > > > > > > > > > > > > > > > -- > > > Ahmad Humayun > > > Research Assistant > > > Computer Science Dpt., LUMS > > > http://suraj.lums.edu.pk/~ahmadh <http://suraj.lums.edu.pk/%7Eahmadh>< > http://suraj.lums.edu.pk/%7Eahmadh> < > > http://suraj.lums.edu.pk/%7Eahmadh> > > > +92 321 4457315 > > > > > > > > > -- > Ahmad Humayun > Research Assistant > Computer Science Dpt., LUMS > http://suraj.lums.edu.pk/~ahmadh <http://suraj.lums.edu.pk/%7Eahmadh> > +92 321 4457315 > -- oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo 00 oo "If you want your children to be intelligent, read them fairy tales. If you want them to be more intelligent, read them more fairy tales." (Albert Einstein)
