Piyush, On Sat, Apr 7, 2012 at 3:02 AM, Piyush Kansal <piyush.kan...@gmail.com> wrote: > So, do I need to set the number of reducers depending on data size, every > time I want to run MapReduce. Or the Hadoop framework automatically invokes > the required number of reducers at run time?
Plain Apache Hadoop does not auto-set # of reducers. You need to set it manually. However, tools like Pig and Hive have determining ability for the jobs that are planned and launched, and set # of reducers based on data for you. -- Harsh J