Hadoop 0.21.0's combiner could be cmd and it just solves my problem.Thank all 
of you.Thanks^_^ 


2011-01-21 



xieyeshan 



发件人: Koji Noguchi 
发送时间: 2011-01-19  03:48:31 
收件人: [email protected] 
抄送: 
主题: Re: How to use combiner in hadoop streaming 
 
(Bcc general@. This is for Hadoop project level announcements and
discussions. http://hadoop.apache.org/mailing_lists.html . Using
mapreduce-user@)
Yeshan, 
Which version of hadoop are you using?
Officially, combiner for non-java command was added in 0.21
https://issues.apache.org/jira/browse/HADOOP-4842
but I¹d bet some of those 0.20s have this backported.
Koji
On 1/18/11 12:06 AM, "Harsh J" <[email protected]> wrote:
> Right now, the Combiner has to be a Java Class. A command is
> unacceptable, as noted here:
> http://wiki.apache.org/hadoop/HadoopStreaming
> 
> On Tue, Jan 18, 2011 at 1:30 PM, xieyeshan <[email protected]>
> wrote:
>> hi,all
>> 
>>     I want to use combiner in hadoop streaming, but combiner is not the same
>> as mapper or reducer in streaming.How could I do this?
>>     Thanks!
>> 
>> 
>> Yours,
>> 
>> Yeshan Xie
>> 
>> 2011-01-18
>> 
>> 
>> 
>> xieyeshan
>> 
> 
> 
> 
> --
> Harsh J
> www.harshj.com
> 

Reply via email to