You may want to have a look at the following webpage: http://hortonworks.com/blog/introducing-tez-faster-hadoop-processing/
On Wed, Jun 12, 2013 at 12:28 AM, 牛兆捷 <[email protected]> wrote: > Is there any design document about tez? > > 2013/6/12 Arun C Murthy <[email protected]> > > > Take a look at Apache Tez (http://incubator.apache.org/projects/tez.html > ). > > > > I'll warn you that it's a little rough, but works. > > > > Arun > > > > On Jun 10, 2013, at 5:46 PM, Grandl Robert wrote: > > > > > Hi, > > > > > > > > > It is possible to run shuffle phase in memory ? I mean, the mapper to > > write the intermediate output in memory only and the reducer to read it > > from there. So no disk involved for intermediate output. > > > > > > > > > If so, what are the configuration parameters I need to tune ? > > > > > > Thanks, > > > Robert > > > > -- > > Arun C. Murthy > > Hortonworks Inc. > > http://hortonworks.com/ > > > > > > > > > -- > *Sincerely,* > *Zhaojie* > * > * > -- Zhijie Shen Hortonworks Inc. http://hortonworks.com/
