Re: Generic output key class

2013-02-10 Thread Amit Sela
If I'm running only one MapReduce job then IntWritable output is OK but if I'm running several together and some are Text output, I don't want to have duplicate MapReduce jobs for different output types, I'm trying to find a more generic solution... On Mon, Feb 11, 2013 at 3:18 AM, Michael Segel w

Re: Generic output key class

2013-02-10 Thread Michael Segel
Why not just write out the int as a numeric string? On Feb 10, 2013, at 1:07 PM, Sandy Ryza wrote: > Hi Amit, > > One way to accomplish this would be to create a custom writable > implementation, TextOrIntWritable, that has fields for both. It could look > something like: > > class TextOrI

Re: Generic output key class

2013-02-10 Thread Sandy Ryza
Hi Amit, One way to accomplish this would be to create a custom writable implementation, TextOrIntWritable, that has fields for both. It could look something like: class TextOrIntWritable implements Writable { private boolean isText; private Text text; private IntWritable integer; void

Generic output key class

2013-02-10 Thread Amit Sela
Hi all, Has anyone ever used some kind of a "generic output key" for a mapreduce job ? I have a job running multiple tasks and I want them to be able to use both Text and IntWritable as output key classes. Any suggestions ? Thanks, Amit.