Sharat,

To answer your specific question of:

> Is there any way to generate multiple input splits from the single input file.

Yes there is. Use the NLineInputFormat class, with an N value of 1.
You should then, for a single file of N lines (dupe or not), get N map
tasks.

On Sun, Jun 10, 2012 at 8:32 PM, sharat attupurath <shara...@hotmail.com> wrote:
> Hi,
>
> We are trying to solve the travelling salesman problem using hadoop. our
> input files contain just a single line that has the euclidean coordinates of
> the cities. we need to pass this single line to each mapper who will then
> process that. How can we do this so that we can achieve parallelism in a
> hadoop cluster. Is there any way to generate multiple input splits from the
> single input file.
>
> Thanks
>
> Sharat



-- 
Harsh J

Reply via email to