Is there any design document about tez? 2013/6/12 Arun C Murthy <[email protected]>
> Take a look at Apache Tez (http://incubator.apache.org/projects/tez.html). > > I'll warn you that it's a little rough, but works. > > Arun > > On Jun 10, 2013, at 5:46 PM, Grandl Robert wrote: > > > Hi, > > > > > > It is possible to run shuffle phase in memory ? I mean, the mapper to > write the intermediate output in memory only and the reducer to read it > from there. So no disk involved for intermediate output. > > > > > > If so, what are the configuration parameters I need to tune ? > > > > Thanks, > > Robert > > -- > Arun C. Murthy > Hortonworks Inc. > http://hortonworks.com/ > > > -- *Sincerely,* *Zhaojie* * *
