On Wed, Jul 1, 2009 at 11:16 AM, Edward Ned Harvey<[email protected]> wrote:
> I have a bunch of compute servers.  They all have local disks mounted as
> /scratch to use for computation scratch space.  This ensures maximum
> performance on all systems, and no competition for a shared resource during
> crunch time.  At present, all of their /scratch directories are local,
> separate and distinct.  I think it would be awesome if /scratch looked the
> same on all systems.  Does anyone know of a way to “unify” this storage,
> without compromising performance?  Of course, if some files reside on server
> A, and they are requested from server B, then the files must go across the
> network, but I don’t want the files to go across the network unless they are
> requested.  And yet, if you do something like “ls /scratch” you would
> ideally get the same results regardless of which machine you’re on.
>
...
>
> Not sure what else I should look at.  Any ideas?
>

I didn't see AFS mentioned yet. My, admittedly incomplete,
understanding of afs is that it provides a single namespace (directory
tree) to all clients but the files themselves may be stored on a local
or remote server; a bit like Microsoft DFS.

Would this not unify the storage while maintaining local access speeds
for files created locally, and still allow any host/client the ability
to access any file on any server?



-- 
Perfection is just a word I use occasionally with mustard.
--Atom Powers--

_______________________________________________
Tech mailing list
[email protected]
http://lopsa.org/cgi-bin/mailman/listinfo/tech
This list provided by the League of Professional System Administrators
 http://lopsa.org/

Reply via email to