RE: How to use the reduce result in next code part

2012-06-10 Thread Liu, Keyan (NSN - CN/Beijing)
, -Original Message- From: ext Harsh J [mailto:ha...@cloudera.com] Sent: Monday, June 11, 2012 11:22 AM To: mapreduce-user@hadoop.apache.org Subject: Re: How to use the reduce result in next code part Hi, Can your rowkey_list requiring logic not be implemented within a single reduce(key, values

Re: How to use the reduce result in next code part

2012-06-10 Thread Jagat Singh
Hello, Just do a quick search for chain map reduce you would get example. Regards, Jagat Singh --- Sent from Mobile , short and crisp. On 11-Jun-2012 8:40 AM, "Liu, Keyan (NSN - CN/Beijing)" wrote: > ** > > Hi All, > > I am using Mapreduce to scan HBase region to get the rowkey_list t

Re: How to use the reduce result in next code part

2012-06-10 Thread Harsh J
Hi, Can your rowkey_list requiring logic not be implemented within a single reduce(key, values) call itself? If you require the whole list before processing, and the whole lists may be small, then collecting their cloned copies in memory is also one way out. On Mon, Jun 11, 2012 at 8:39 AM, Liu,

How to use the reduce result in next code part

2012-06-10 Thread Liu, Keyan (NSN - CN/Beijing)
Hi All, I am using Mapreduce to scan HBase region to get the rowkey_list that related with one query. In Map period, each mapper outputs partial rowkey_list. In reduce period, the reducer will collect and sort all rowkey. If I need to use rowkey_list result of the reduce, how can transport the row

How to use the reduce result in next code part

2012-05-28 Thread Liu, Keyan (NSN - CN/Beijing)
Hi All, I am using Mapreduce to scan HBase region to get the rowkey_list that related with one query. In Map period, the mapper outputs partial rowkey_list. In reduce period, the reducer will collect and sort all rowkey. If I need to use rowkey_list result of reduce, how can transport the rowkey_l