Do you want backups or periodic frozen snapshots of the file system?
Backups can entail some level of version control, so that you or
end-users can get files back on certain points in time, in case of
accidental deletions. Besides 1.5PB is a lot of material, so you may
not want to take full snapshots that often. In that case, a
combination of daily incremental backups using TSM with GPFS's
mmbackup can be a good option. TSM also does a very good job at
controlling how material is distributed across multiple tapes, and
that is something that requires a lot of micro-management if you want
a home grown solution of rsync+LTFS.
On the other hand, you could use gpfs built-in tools such a
mmapplypolicy to identify candidates for incremental backup, and send
them to LTFS. Just more micro management, and you may have to come up
with your own tool to let end-users restore their stuff, or you'll
have to act on their behalf.
Jaime
Quoting Damir Krstic <[email protected]>:
We have implemented 1.5PB ESS solution recently in our HPC environment.
Today we are kicking of backup and disaster recovery discussions so I was
wondering what everyone else is using for their backup?
In our old storage environment we simply rsync-ed home and software
directories and projects were not backed up.
With ESS we are looking for more of a GPFS based backup solution -
something to tape possibly and also something that will have life cycle
feature - so if the file is not touched for number of days, it's moved to a
tape (something like LTFS).
Thanks in advance.
DAmir
************************************
TELL US ABOUT YOUR SUCCESS STORIES
http://www.scinethpc.ca/testimonials
************************************
---
Jaime Pinto
SciNet HPC Consortium - Compute/Calcul Canada
www.scinet.utoronto.ca - www.computecanada.org
University of Toronto
256 McCaul Street, Room 235
Toronto, ON, M5T1W5
P: 416-978-2755
C: 416-505-1477
----------------------------------------------------------------
This message was sent using IMP at SciNet Consortium, University of Toronto.
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
