Re: Stop chained mapreduce.

2011-09-12 Thread Alejandro Abdelnur
Ilyal, The MR output files names follow the pattern part- and you'll have as many as reducers your job had. As you know the output directory, you could do a fs.listStatus() of the output directory and check all the part-* files. Hope this helps. Thanks. Alejandro On Sun, Sep 11, 2011 at 4

Stop chained mapreduce.

2011-09-11 Thread ilyal levin
Hi I created a chained mapreduce program where each job creates a SequenceFile output. My stopping condition is simply to check if the last output file (Type - SequenceFile) is empty. In order to do that i need to use the SequenceFile.Reader and for him to read the data i need the path of the outpu