How slow is it? May the code that reads is relevant too.
Raghu. j2eeiscool wrote:
Hi, I am new to hadoop. We are evaluating HDFS for a reliable, disitrbuted file system use. From the tests (1 name + 1 data, both on different RHEL 4 m/cs, client running on the name node m/c) I have run so far: 1.The writes are very fast. 2.The read is very slow (reading a 68 megs file). Here is the sample code. Any ideas what could be going wrong: public InputStream select(String sKey) throws RecordNotFoundException, IOException { DistributedFileSystem fileSystem = new DistributedFileSystem(); fileSystem.initialize(uri, conf); Path path = new Path(sKey); FSDataInputStream dataInputStream = fileSystem.open(path); return dataInputStream; } Thanx, Taj