No, I also thought it is a mapper , but It surely is a reducer. all the mappers succeeded and the reducer failed.
Haitao Yao [email protected] weibo: @haitao_yao Skype: haitao.yao.final On 2012-9-16, at 上午10:08, Haitao Yao wrote: > Hi, > I 'v encountered a problem: the job failed because of POSplit retained > too much memory in the reducer. How can I specify more reducers for the spill? > > Here's the screen snapshot of the Heap dump. > <aa.jpg> > > > And here's the snippet of my split script: > > split RawData into AURawData if type == 2, NURawData if type == 1, > InRawData if type == 9, GCData if type == 61, HCData if type == 71, > TutorialRawData if type == 3 or t ype == 15; > > There's 3 similar split clause in my script. The reducer count is always 1. > How can I increase it? > > Thanks. > > > > Haitao Yao > [email protected] > weibo: @haitao_yao > Skype: haitao.yao.final >
