Unzipping from external filesystem to HDFS

2011-08-30 Thread Per Steffensen
. Regards, Per Steffensen

Re: Unzipping from external filesystem to HDFS

2011-08-30 Thread Per Steffensen
e: If you write many many small HDFS files then of course everything will be horribly slow anyways) I had to do something like this once (write files in a tar archive to a sequence file) and java was never the bottleneck. Or do you have massively higher connection to HDFS? best, Stephan On 30.0

HDFS vs software RAID like md(adm)

2011-09-14 Thread Per Steffensen
. http://en.wikipedia.org/wiki/RAID#Software-based_RAID http://en.wikipedia.org/wiki/Mdadm Regards, Per Steffensen

Re: HDFS vs software RAID like md(adm)

2011-09-14 Thread Per Steffensen
David Rosenstrauch skrev: On 09/14/2011 02:02 PM, Per Steffensen wrote: Hi If my goal is to have multiple physical disks seem as one big disk with redundancy built in, why would I use a HDFS cluster among machines with one disk each, instead of using software RAID like md(adm) directly on top

Re: HDFS vs software RAID like md(adm)

2011-09-15 Thread Per Steffensen
s. If you really need a POSIX fs I would recomment you to have a look at DRBD or glusterfs.. Thanks. I will have a look at those. Bye, Norman 2011/9/15 Per Steffensen : David Rosenstrauch skrev: On 09/14/2011 02:02 PM, Per Steffensen wrote: Hi If my goal is to have multipl