Hi!
We at Jülich Supercomputing Centre have two ILM managed file systems (GPFS and
HSM from TSM).
#50 mio files + 10 PB data on tape
#30 mio files + 8 PB data on tape
For backup we use mmbackup (dsmc)
for the user HOME directory (no ILM)
#120 mio files => 3 hours get candidate list + x hour backup
We use also mmbackup for the ILM managed filesystem.
Policy: the file must be backed up first before migrated to tape
2-3 hour for candidate list + x hours/days/weeks backups (!!!)
-> a metadata change (e.g. renaming a directory by the user) enforces a new
backup of the files which causes a very expensive tape inline copy!
Greetings from Jülich, Germany
Stephan
On 10/26/15 03:38, Kallback-Rose, Kristy A wrote:
Simon wrote recently in the GPFS UG Blog: "We also got into discussion on
backup and ILM, and I think its amazing how everyone does these things in their
own slightly different way. I think this might be an interesting area for
discussion over on the group mailing list. There's a lot of options and
different ways to do things!”
Yes, please! I’m *very* interested in what others are doing.
We (IU) are currently doing a POC with GHI for DR backups (GHI=GPFS HPSS
Integration—we have had HPSS for a very long time), but I’m interested what
others are doing with either ILM or other methods to brew their own backup
solutions, how much they are backing up and with what regularity, what
resources it takes, etc.
If you have anything going on at your site that’s relevant, can you please
share?
Thanks,
Kristy
Kristy Kallback-Rose
Manager, Research Storage
Indiana University
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher
Geschaeftsfuehrung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
Prof. Dr. Sebastian M. Schmidt
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
