No, I also thought it is a mapper , but It surely is a reducer. all the mappers 
succeeded and the reducer failed.



Haitao Yao
[email protected]
weibo: @haitao_yao
Skype:  haitao.yao.final

On 2012-9-16, at 上午10:08, Haitao Yao wrote:

> Hi,
>       I 'v encountered a problem: the job failed because of POSplit retained 
> too much memory in the reducer. How can I specify more reducers for the spill?
> 
>       Here's the screen snapshot of the Heap dump.
>       <aa.jpg>
> 
> 
> And here's the snippet of my split script:
> 
>       split RawData into AURawData if type == 2, NURawData if type == 1, 
> InRawData if type == 9, GCData if type == 61, HCData if type == 71, 
> TutorialRawData if type == 3 or t    ype == 15;
> 
> There's 3 similar split clause in my script. The reducer count is always 1. 
> How can I increase it?
> 
> Thanks.
> 
> 
> 
> Haitao Yao
> [email protected]
> weibo: @haitao_yao
> Skype:  haitao.yao.final
> 

Reply via email to