Re: Feature request to provide DFSInputStream subclassing mechanism

2013-08-07 Thread Joe Bounour
Hello Jeff Is it something that could go under HCFS project? http://wiki.apache.org/hadoop/HCFS (I might be wrong?) Joe On 8/7/13 10:59 AM, "Jeff Dost" wrote: >Hello, > >We work in a software development team at the UCSD CMS Tier2 Center. We >would like to propose a mechanism to allow one to

Re: Is it me or is the new bootstrap HDFS UI HWX green? (See tip of hadoop-2.3 branch)

2014-01-29 Thread Joe Bounour
Hello I find fascinating how all the HWX folks jumped on Stack (Not taking any side, I am Switzerland/french), many against one As a developer, it seems not a relevant topic, true but to be fair, Hortonwork, Cloudera claims most contributors or other fame so I can see a point where a little sensit

RE: test HDFS

2012-04-23 Thread Joe Bounour
Hello Have you looked at TestDFSIO benchmark http://answers.oreilly.com/topic/460-how-to-benchmark-a-hadoop-cluster/ -Original Message- From: chengyao [mailto:cheng...@inspur.com] Sent: Monday, April 23, 2012 11:22 PM To: hdfs-dev Subject: test HDFS HI. I want to test hdfs. what tools s

Re: data center aware hadoop?

2012-09-21 Thread Joe Bounour
Hello Interesting topic but is it really a general use case? The average HDFS cluster today is lower than 100 nodes , still, it is a lot of stored data. You would have to synchronize petabytes over high latency networks and I would assume, you are using HDFS as an archive (meaning you do not repla