The number of map tasks is normally different from the number of reduce tasks. Coding as you planned would limit the flexibility of hadoop.
On Saturday, February 13, 2010, ANKITBHATNAGAR <[email protected]> wrote: > > Hi, > > I was working on a scenario where in I am generating a file in close() > function of my Map implementation. > > Since Map execution are worked concurrently, this file is overwritten. > > I was wondering how to name this file uniquely per map execution basic and > then read in configure() function of reduce. > > I could give a task id as name of the file but dont know how will I read the > same file in configure() as the task id would have changed > > Ankit > -- > View this message in context: > http://old.nabble.com/Pass-the-TaskId-from-map-to-Reduce-tp27575531p27575531.html > Sent from the Hadoop core-user mailing list archive at Nabble.com. > >
