pig-user  

Setting reducers

Rob Stewart
Tue, 16 Mar 2010 03:35:21 -0700

Hi, quick question:

What is the origin of the formula for specifying the number of reducers for
a Pig job (using PARALLEL).

I have it as:
<number of nodes> * <maximum number of reducers per node> * 0.9

Is there a theory or model behind this formula?

Rob Stewart