Re: manipulating key in combine phase

2014-01-13 Thread Devin Suiter RDX
key, so mucking with the keys doesn’t **seem** like a good idea. >>> >>> john >>> >>> >>> >>> *From:* Amit Sela [mailto:am...@infolinks.com] >>> *Sent:* Sunday, January 12, 2014 9:26 AM >>> *To:* user@hadoop.apache.org >&

Re: manipulating key in combine phase

2014-01-13 Thread Amit Sela
m...@infolinks.com] >> *Sent:* Sunday, January 12, 2014 9:26 AM >> *To:* user@hadoop.apache.org >> *Subject:* manipulating key in combine phase >> >> >> >> Hi all, >> >> >> >> I was wondering if it is possible to manipulate the key during

Re: manipulating key in combine phase

2014-01-13 Thread Devin Suiter RDX
ilto:am...@infolinks.com] > *Sent:* Sunday, January 12, 2014 9:26 AM > *To:* user@hadoop.apache.org > *Subject:* manipulating key in combine phase > > > > Hi all, > > > > I was wondering if it is possible to manipulate the key during combine: > > > > Say I have

RE: manipulating key in combine phase

2014-01-12 Thread John Lilley
rom: Amit Sela [mailto:am...@infolinks.com] Sent: Sunday, January 12, 2014 9:26 AM To: user@hadoop.apache.org Subject: manipulating key in combine phase Hi all, I was wondering if it is possible to manipulate the key during combine: Say I have a mapreduce job where the key has many qualifiers. I woul

manipulating key in combine phase

2014-01-12 Thread Amit Sela
Hi all, I was wondering if it is possible to manipulate the key during combine: Say I have a mapreduce job where the key has many qualifiers. I would like to "split" the key into two (or more) keys if it has more than, say 100 qualifiers. In the combiner class I would do something like: int coun