Re: disable pipelining in Hadoop

2011-03-12 Thread Allen Wittenauer
(Removing common-dev, because this isn't a dev question.) On Mar 1, 2011, at 6:13 AM, bikash sharma wrote: > Hi, > Is there a way to disable the use of pipelining , i.e., the reduce phase is > started only after the map phase is completed? Set mapred.reduce.slowstart.completed.maps to 1. Be aw

Re: disable pipelining in Hadoop

2011-03-01 Thread Bibek Paudel
On Tue, Mar 1, 2011 at 3:13 PM, bikash sharma wrote: > Hi, > Is there a way to disable the use of pipelining , i.e., the reduce phase is > started only after the map phase is completed? I think this is a hardcoded pipeline and can't be changed. For some recent research work that addresses your q

disable pipelining in Hadoop

2011-03-01 Thread bikash sharma
Hi, Is there a way to disable the use of pipelining , i.e., the reduce phase is started only after the map phase is completed? -bikash