pig-user  

Re: Could pig dynamic change the reduce number according the mapper task number ?

Alan Gates
Fri, 13 Nov 2009 09:24:32 -0800


On Nov 12, 2009, at 2:49 PM, Scott Carey wrote:

Is it possible to have a script at least use the default configured Hadoop value? Or is there a way to do that already?

If the user doesn't specify a parallelism Pig doesn't set a value in JobConf for the reduce, which means it will pick up the default for the cluster. Unless cluster administrators change it, the default for the cluster is 1.


Alan.