Hmmm...OK...
Let me explain my requirements here and see if you all can tell me if
Hadoop provides the functionality I need.
I'm building a highly perfomant, highly available (no less than 4 9's), raw
storage subsystem. It will be write once for the initial dataset (binary
data) but will have the ability to maintain metadata associated to the
binary data. The metadata will be "queryiable" and therefore indexed
(want to use Lucene for this purpose). It must have the ability to store
petrabytes of data. We will use either NetApps or DMX3 storage media.
Please discuss...
"Joydeep Sen
Sarma"
<[EMAIL PROTECTED] To
.com> <[email protected]>
cc
10/15/2007 05:20
PM Subject
RE: HDFS vs. CIFS
Please respond to
[EMAIL PROTECTED]
e.apache.org
Not a valid comparison. CIFS is a remote file access protocol only. HDFS
is a file system (that comes bundled with a remote file access
protocol).
It may be possible to build a CIFS gateway for HDFS.
One interesting point of comparison at the protocol level is the level
of parallelism. Compared to HDFS protocol - CIFS exposes less
parallelism. DFS/CIFS has the concept of junction points that allows
directories from different storage servers to be stitched into one
namespace. There are commercial products that make this easy. However -
this allows parallelism at directory level only - whereas HDFS protocol
allows a single file to be distributed across different servers.
(And as was pointed out - CIFS supports many other file system
operations - ACLs, oplocks and what not that HDFS doesn't).
-----Original Message-----
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]
Sent: Monday, October 15, 2007 12:24 PM
To: [email protected]
Subject: HDFS vs. CIFS
I would like someone to compare and contrast CIFS and HDFS? Or...if
that
is not a valid comparison...please explain to me why it's not a valid
comparison.
Thanks,
Trevor
.
This message and any attachments contain information from Union Pacific
which may be confidential and/or privileged.
If you are not the intended recipient, be aware that any disclosure,
copying, distribution or use of the contents of this message is strictly
prohibited by law. If you receive this message in error, please contact
the sender immediately and delete the message and any attachments.
.
This
message and any attachments contain information from Union Pacific which may be
confidential and/or privileged.
If you are not the intended recipient, be aware that any disclosure, copying,
distribution or use of the contents of this message is strictly prohibited by
law. If you receive this message in error, please contact the sender
immediately and delete the message and any attachments.
