Re: [lustre-discuss] Backup software for Lustre

2017-03-23 Thread Brett Lee
t;>> > >>> > >>> > >>> tar --xattrs-include=lustre.* -xf .tar > >>> > >>> > >>> > >>> This assumes the files were backed up with the --xattrs flag: > >>> > >>> > >>> > >>&

Re: [lustre-discuss] Backup software for Lustre

2017-03-23 Thread Dilger, Andreas
xf .tar >>> >>> >>> >>> This assumes the files were backed up with the --xattrs flag: >>> >>> >>> >>> tar --xattrs -cf .tar >>> >>> >>> >>> Note, that you don’t appear to need t

Re: [lustre-discuss] Backup software for Lustre

2017-03-20 Thread Brett Lee
de=lustre.* -xf .tar > > > > > > > > This assumes the files were backed up with the --xattrs flag: > > > > > > > > tar --xattrs -cf .tar > > > > > > > > Note, that you don’t appear to need to whitelist the Lustre xattrs when >

Re: [lustre-discuss] Backup software for Lustre

2017-03-20 Thread Dilger, Andreas
> > > > > > From: lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on behalf of > "Dilger, Andreas" <andreas.dil...@intel.com> > Date: Monday, 20 March 2017 at 8:11 am > To: Brett Lee <brettlee.lus...@gmail.com> > Cc: Lustre di

Re: [lustre-discuss] Backup software for Lustre

2017-03-19 Thread Brett Lee
> > *From: *lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on > behalf of "Dilger, Andreas" <andreas.dil...@intel.com> > *Date: *Monday, 20 March 2017 at 8:11 am > *To: *Brett Lee <brettlee.lus...@gmail.com> > *Cc: *Lustre discussion <lustre-

Re: [lustre-discuss] Backup software for Lustre

2017-03-19 Thread Cowe, Malcolm J
rett Lee <brettlee.lus...@gmail.com> Cc: Lustre discussion <lustre-discuss@lists.lustre.org> Subject: Re: [lustre-discuss] Backup software for Lustre The use of openat() could be problematic since this precludes storing the xattr before the file is opened. That said, I don't see anywhere in

Re: [lustre-discuss] Backup software for Lustre

2017-03-19 Thread Dilger, Andreas
Actually, looking for someone who uses a commercialized >> approach (that retains user metadata and Lustre extended metadata) and not >> specifically the manual approaches of Chapter 17. >> >> Thanks! >> Mike >> >> Mike Selway | Sr. Tiered Stor

Re: [lustre-discuss] Backup software for Lustre

2017-03-19 Thread Brett Lee
MDT device backups. >>>> At 150MB/s for even >>>> a single SATA drive, this is about 2h/TB, which is reasonable to do >>>> once a week (or more often >>>> for smaller MDTs). >>>> >>>> While using an LVM snapshot of the ld

Re: [lustre-discuss] Backup software for Lustre

2017-03-19 Thread Dilger, Andreas
ck, CO 80104 | >> www.cray.com<http://www.cray.com> >> >> >>> From: Brett Lee >>> [mailto:brettlee.lus...@gmail.com<mailto:brettlee.lus...@gmail.com>] >>> Sent: Monday, February 06, 2017 11:45 AM >>> To: Mike Selway <mse

Re: [lustre-discuss] Backup software for Lustre

2017-03-18 Thread Brett Lee
> > >>> > Would it be difficult to suspend IO and snapshot all the nodes >>> (assuming ZFS). Could you be sure that your MDS and OSS are synchronised? >>> > >>> > On 7 February 2017 at 19:52, Mike Selway <msel...@cray.com> wrote: >>&

Re: [lustre-discuss] Backup software for Lustre

2017-03-18 Thread Dilger, Andreas
ray.com<mailto:msel...@cray.com> >> 146 Castlemaine Ct, Castle Rock, CO 80104 | >> www.cray.com<http://www.cray.com> >> >> >>> From: Brett Lee >>> [mailto:brettlee.lus...@gmail.com<mailto:brettlee.lus...@gmail.com>] >>>

Re: [lustre-discuss] Backup software for Lustre

2017-03-17 Thread Brett Lee
On 7 February 2017 at 19:52, Mike Selway <msel...@cray.com> wrote: >> >> Hello Brett, >> >> >> >>Actually, looking for someone who uses a commercialized >> approach (that retains user metadata and Lustre extended metadata) and not >

Re: [lustre-discuss] Backup software for Lustre

2017-03-15 Thread Dilger, Andreas
6> | >> msel...@cray.com<mailto:msel...@cray.com> >> 146 Castlemaine Ct, Castle Rock, CO 80104 | >> www.cray.com<http://www.cray.com> >> >> >>> From: Brett Lee >>> [mailto:brettlee.lus...@gmail.com<mailto:brettlee.lus...@gmai

Re: [lustre-discuss] Backup software for Lustre

2017-03-14 Thread Brett Lee
>> > >> Mike Selway | Sr. Tiered Storage Architect | Cray Inc. > >> Work +1-301-332-4116 | msel...@cray.com > >> 146 Castlemaine Ct, Castle Rock, CO 80104 | www.cray.com > >> > >> > >>> From: Brett Lee [mailto:brettlee.lus...@gmail

Re: [lustre-discuss] Backup software for Lustre

2017-03-14 Thread Dilger, Andreas
Storage Architect | Cray Inc. >> Work +1-301-332-4116 | msel...@cray.com >> 146 Castlemaine Ct, Castle Rock, CO 80104 | www.cray.com >> >> >>> From: Brett Lee [mailto:brettlee.lus...@gmail.com] >>> Sent: Monday, February 06, 2017 11:45 AM >>> T

Re: [lustre-discuss] Backup software for Lustre

2017-02-07 Thread Andrew Holway
ent:* Monday, February 06, 2017 11:45 AM > *To:* Mike Selway <msel...@cray.com> > *Cc:* lustre-discuss@lists.lustre.org > *Subject:* Re: [lustre-discuss] Backup software for Lustre > > > > Hey Mike, > > > > "Chapter 17" and > > > > http://www.int

Re: [lustre-discuss] Backup software for Lustre

2017-02-07 Thread Mike Selway
.com] Sent: Monday, February 06, 2017 11:45 AM To: Mike Selway <msel...@cray.com> Cc: lustre-discuss@lists.lustre.org Subject: Re: [lustre-discuss] Backup software for Lustre Hey Mike, "Chapter 17" and http://www.intel.com/content/www/us/en/lustre/backup-and-restore-training.html both c

Re: [lustre-discuss] Backup software for Lustre

2017-02-06 Thread Brett Lee
Hey Mike, "Chapter 17" and http://www.intel.com/content/www/us/en/lustre/backup-and-restore-training.html both contain methods to backup & restore the entire Lustre file system. Are you looking for a solution that backs up only the (user) data files and their associated metadata (e.g. xattrs)?

[lustre-discuss] Backup software for Lustre

2017-02-06 Thread Mike Selway
Hello, Anyone aware of and/or using a Backup software package to protect their LFS environment (not referring to the tools/scripts suggested in Chapter 17). Regards, Mike Mike Selway | Sr. Tiered Storage Architect | Cray Inc. Work +1-301-332-4116 |