Hi Bala, A standard benchmark program for mapreduce is terasort, which is included in the hadoop examples jar. You can generate data for it using teragen, which runs a map-only job:
hadoop jar path-to-examples-jar.jar <number of records> <directory to put them in> and then sort the data using terasort: hadoop jar path-to-examples-jar.jar <input directory> <output directory> -Sandy On Mon, Mar 25, 2013 at 4:12 AM, AMARNATH, Balachandar < [email protected]> wrote: > Hello Yanbo Liang,**** > > ** ** > > My issue is that I neither do not have data nor I have an application! I > was looking for an open source benchmark application to test this, > preferably, if the application (or simple test code) is related to image > processing domain**** > > ** ** > > Regards**** > > Bala**** > > ** ** > > ** ** > > ** ** > > *From:* Yanbo Liang [mailto:[email protected]] > *Sent:* 25 March 2013 14:55 > *To:* [email protected] > *Subject:* Re: Any answer ? Candidate application for map reduce**** > > ** ** > > From your description "split the data in to chunks, feed the chunks to > the application, and merge the processed chunks to get A back" is just suit > for the MapReduce paradigm. First you can feed the split chunks to Mapper > and merge the processed chunks at Reducer. Why did you not use MapReduce > paradigm? **** > > 2013/3/25 Raymond Tay <[email protected]>**** > > Hello Bala,**** > > ** ** > > I bumped into your email by chance. **** > > ** ** > > I'm not sure what you are after, really because if you wanted something > like image processing and feature detection then hadoop's mailing list is > probably not the place and you might want to join NVIDIA's or ATI's CUDA / > OpenCL forums.**** > > ** ** > > Hope this helps**** > > Ray**** > > ** ** > > On 25 Mar, 2013, at 1:47 PM, "AMARNATH, Balachandar" < > [email protected]> wrote:**** > > > > **** > > Any answers from anyone of you J**** > > **** > > **** > > Regards**** > > Bala**** > > **** > > *From:* AMARNATH, Balachandar [mailto:[email protected]] > *Sent:* 22 March 2013 10:25 > *To:* [email protected] > *Subject:* Candidate application for map reduce**** > > **** > > Hello,**** > > **** > > I am looking for an sample application (preferably image processing, > feature detection etc) that can be good candidate of map reduce paradigm. > To very specific, I am looking for an open source simple application that > process data and produce some results (A). When you split the data in to > chunks, feed the chunks to the application, and merge the processed chunks > to get A back. Is there any website where can I look into such kind of > benchmark applications ? Any pointers and thoughts will be helpful here.** > ** > > **** > > With thanks and regards**** > > Balachandar**** > > **** > > **** > > **** > > The information in this e-mail is confidential. The contents may not be > disclosed or used by anyone other than the addressee. Access to this e-mail > by anyone else is unauthorised.**** > > If you are not the intended recipient, please notify Airbus immediately and > delete this e-mail.**** > > ** ** > > Airbus cannot accept any responsibility for the accuracy or completeness of > this e-mail as it has been sent over public networks. If you have any > concerns over the content of this message or its Accuracy or Integrity, > please contact Airbus immediately.**** > > All outgoing e-mails from Airbus are checked using regularly updated virus > scanning software but you should take whatever measures you deem to be > appropriate to ensure that this message and any attachments are virus > free.**** > > The information in this e-mail is confidential. The contents may not be > disclosed or used by anyone other than the addressee. Access to this e-mail > by anyone else is unauthorised.**** > > If you are not the intended recipient, please notify Airbus immediately and > delete this e-mail.**** > > Airbus cannot accept any responsibility for the accuracy or completeness of > this e-mail as it has been sent over public networks. If you have any > concerns over the content of this message or its Accuracy or Integrity, > please contact Airbus immediately.**** > > All outgoing e-mails from Airbus are checked using regularly updated virus > scanning software but you should take whatever measures you deem to be > appropriate to ensure that this message and any attachments are virus > free.**** > > ** ** > > ** ** > > The information in this e-mail is confidential. The contents may not be > disclosed or used by anyone other than the addressee. Access to this e-mail > by anyone else is unauthorised. > If you are not the intended recipient, please notify Airbus immediately and > delete this e-mail. > Airbus cannot accept any responsibility for the accuracy or completeness of > this e-mail as it has been sent over public networks. If you have any > concerns over the content of this message or its Accuracy or Integrity, > please contact Airbus immediately. > All outgoing e-mails from Airbus are checked using regularly updated virus > scanning software but you should take whatever measures you deem to be > appropriate to ensure that this message and any attachments are virus free. > >
