On 02/06/2012 01:41 PM, Andrew Holway wrote:
Hi,
Can anyone tell me about their experiences with 1PB and larger gluster
installations. We are thinking of doing 1PB with 10x 100PB storage
servers and would appreciate some reassurance :). We plan to scale
to....above and beyond....
Greetings Andrew:
We've got a bit of experience in scaling to (many large) bricks for
gluster. The big issues are reliable/working network connections,
RAIDs, etc. Currently you should look carefully at some sort of
replication mechanism (if you are storing 1PB of data, recovery time is
likely important).
100TB bricks aren't a problem (as long as they are built sanely),
though I'd probably suggest subdividing smaller so you can take better
advantage of finer grain parallelism. The issue on design of the bricks
goes to the bandwidth and the height of the storage bandwidth wall (time
required to read/write the entire 100TB). For most designs we see
(cascading arrays with SAS/FC), this is going to be problematic at best.
But thats another story (and we are biased because of what we do).
--
Joseph Landman, Ph.D
Founder and CEO
Scalable Informatics Inc.
email: [email protected]
web : http://scalableinformatics.com
http://scalableinformatics.com/sicluster
phone: +1 734 786 8423 x121
fax : +1 866 888 3112
cell : +1 734 612 4615
_______________________________________________
Gluster-users mailing list
[email protected]
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
