Yes. The general principle is to label the records coming in with the file that they came from. That can be done in the same data-structure that provides the polymorphism that you want. These labelled records carry their labels so that you can inspect the labels in the reducer and decide what to do. It is also common to sort in some clever way so that you know the order of the labels.
On Tue, Aug 3, 2010 at 2:09 PM, Shannon Quinn <[email protected]> wrote: > Store the Path.getName() of the two separate Paths prior to the job, then > within the Mapper, look up context.getWorkingDirectory().getName() and > compare it to the two variables set before. Whichever one matches, you know > you're working with that specific SequenceFile. > > Would that even work? >
