input files

Hadoop usually takes either a single file or a folder as an input parameter. But is it possible to modify it so that it can take list of files(not a folder) as input parameter -- - Deepak Diwakar,

Re: input files

You can add more paths to input using FileInputFormat.addInputPath(JobConf, Path). You can also specify comma separated filenames as input path using FileInputFormat.setInputPaths(JobConf, String commaSeparatedPaths) More details at

Re: Missing lib/native/Linux-amd64-64 on hadoop-0.17.2.tar.gz

hi Could anyone help to re-pack the 0.17.2 with missing lib/native/Linux-amd64-64 ? thanks On Wed, Aug 20, 2008 at 9:31 AM, Yi-Kai Tsai [EMAIL PROTECTED] wrote: But we do have lib/native/Linux-amd64-64 on hadoop-0.17.1.tar.gz and hadoop-0.18.0.tar.gz ? At least for -0.17.1,

Hadoop 0.17.2 released

Hadoop Core 0.17.2 has been released and the website updated. It fixes a couple of critical bugs in the 0.17 branch. It can be downloaded from: http://www.apache.org/dyn/closer.cgi/hadoop/core/ -- Owen

Re: Cannot read reducer values into a list

On Aug 19, 2008, at 4:57 PM, Deepika Khera wrote: Thanks for the clarification on this. So, it seems like cloning the object before adding to the list is the only solution for this problem. Is that right? Yes. You can use WritableUtils.clone to do the job. -- Owen

Re: pseudo-global variable constuction

Thank you very much, Paco and Jason. It works! For any users who may be curious what this may look like in code, here is a small snippet of mine: file: myLittleMRProgram.java package.org.apache.hadoop.examples; public static class Reduce extends MapReduceBase implements ReducerText,

Reminder: Monthly Hadoop User Group Meeting (Bay Area) today

Reminder: The next Hadoop User Group (Bay Area) meeting is scheduled for today, Wednesday, Aug 20th from 6 - 7:30 pm at Yahoo! Mission College, Santa Clara, CA, Building 1, Training Rooms 34. Agenda: Pig Update: Olga Natkovich Hadoop 0.18 and post 0.18 - Sameer Paranjpye Registration and

Know how many records remain?

Hi mailing, Are there any way to know whether the mapper is processing the last record that assigned to this node, or know how many records remain to be processed in this node? Qin

Re: Why is scaling HBase much simpler then scaling a relational db?

On Tue, Aug 19, 2008 at 9:44 AM, Mork0075 [EMAIL PROTECTED] wrote: Can you please explain, why someone should use HBase for horizontal scaling instead of a relational database? One reason for me would be, that i don't have to implement the sharding logic myself. Are there other? A slight

RE: Why is scaling HBase much simpler then scaling a relational db?

Stuart, In general you will get a quicker response to HBase questions by posting them to the HBase mailing list ([EMAIL PROTECTED]) see http://hadoop.apache.org/hbase/mailing_lists.html for how to subscribe. Perhaps the best document on scaling HBase is actually the Bigtable paper:

RE: Cannot read reducer values into a list

Thanks...this works beautifully :) ! Deepika -Original Message- From: Owen O'Malley [mailto:[EMAIL PROTECTED] Sent: Wednesday, August 20, 2008 7:52 AM To: core-user@hadoop.apache.org Subject: Re: Cannot read reducer values into a list On Aug 19, 2008, at 4:57 PM, Deepika Khera wrote:

hadoop 0.18.0 ec2 images?

Are there any publicly available EC2 images for Hadoop 0.18.0 yet? There don't seem to be any in the hadoop-ec2-images bucket.