Re: [lustre-discuss] Do I need Lustre?

2018-04-27 Thread Brett Lee
Hi Neil, One of the considerations in using Lustre should be the I/O patterns of your applications. Lustre excels with large, sequential reads and writes. Another are the costs, to include hardware, software, support, and coming up to speed with Lustre. These components interact. For example,

Re: [lustre-discuss] error while configuring lnet

2017-11-12 Thread Brett Lee
credits=63 concurrent_sends=63 ntx=32768 > credits=32768 fmr_pool_size=8193 > > modprobe: ERROR: could not insert 'ko2iblnd': Invalid argument > > modprobe: ERROR: Error running install command for ko2iblnd > > modprobe: ERROR: could not insert 'ko2iblnd': Operation not permitted >

Re: [lustre-discuss] error while configuring lnet

2017-11-11 Thread Brett Lee
Hi Parag, You may need to confirm that the in-kernel IB and the IB in the kernel module "match" (are compatible). I think that loading the module (`sudo modprobe -v ko2iblnd`) may be sufficient to verify the match (it's been a while, others may correct me). Please indicate which kernel and

Re: [lustre-discuss] new client - failover mds: no connection

2017-10-24 Thread Brett Lee
Hi Thomas, nice to see you have remained active in the Lustre community. To your question, I don't have an answer, but it seems like the timeout may be masking the root issue - perhaps a system or network issue - I always start with hostname resolution. :) On Oct 24, 2017 11:08 AM, "Thomas Roth"

Re: [lustre-discuss] Cannot mount lustre filesystem anymore

2017-04-25 Thread Brett Lee
"No such file or directory." Could that be the cause? Brett -- Protect Yourself Against Cybercrime PDS Software Solutions LLC https://www.TrustPDS.com On Apr 25, 2017 4:25 AM, "Stefano Turolla" wrote: > Dear all, I am a newbie in lustre, I set up a simple

Re: [lustre-discuss] client fails to mount

2017-04-24 Thread Brett Lee
So, the LNet ping is not working, and LNet is running on IB. Have you moved down the stack toward the hardware, running an ibping from a rebooted client to the MGS? Brett -- Protect Yourself Against Cybercrime PDS Software Solutions LLC https://www.TrustPDS.com On

Re: [lustre-discuss] Backup software for Lustre

2017-03-23 Thread Brett Lee
- LUDOC-373 <https://jira.hpdd.intel.com/browse/LUDOC-373> Regards, Brett > Cheers, Andreas > > > On Mon, Mar 20, 2017 at 1:51 AM, Dilger, Andreas < > andreas.dil...@intel.com> wrote: > >> On Mar 19, 2017, at 20:57, Brett Lee <brettlee.lus...@gma

Re: [lustre-discuss] lfs_migrate

2017-03-20 Thread Brett Lee
Hi Eli, I believe that is still the case with lfs_migrate. If otherwise, we'll probably hear soon. You should be able to disable those OSTs while keeping the file system active - via a command on the MDS(s) as well as the clients. My notes have the command as shown below, but please confirm

Re: [lustre-discuss] Backup software for Lustre

2017-03-20 Thread Brett Lee
tps://www.trustpds.com/> On Mon, Mar 20, 2017 at 1:51 AM, Dilger, Andreas <andreas.dil...@intel.com> wrote: > On Mar 19, 2017, at 20:57, Brett Lee <brettlee.lus...@gmail.com> wrote: > > > > Help from down under! :) Thanks Malcolm!! > > > > Using the corre

Re: [lustre-discuss] Backup software for Lustre

2017-03-19 Thread Brett Lee
> > *From: *lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on > behalf of "Dilger, Andreas" <andreas.dil...@intel.com> > *Date: *Monday, 20 March 2017 at 8:11 am > *To: *Brett Lee <brettlee.lus...@gmail.com> > *Cc: *Lustre discussion <lustre-

Re: [lustre-discuss] Backup software for Lustre

2017-03-19 Thread Brett Lee
<andreas.dil...@intel.com> wrote: > I ran a test locally with RHEL 6.8 and the included tar 1.26 using strace, > and tar is properly using mknod+setxattr to restore the "lov" xattr, and > the stripe count and stripe size to be preserved. > > The OST index is not p

Re: [lustre-discuss] Backup software for Lustre

2017-03-18 Thread Brett Lee
://www.TrustPDS.com On Mar 18, 2017 9:28 PM, "Dilger, Andreas" <andreas.dil...@intel.com> wrote: > Do you need to specify --xattrs (or similar) during the restore phase as > well? > > Cheers, Andreas > > On Mar 17, 2017, at 15:12, Brett Lee <brettlee.lus...@gmail.com> wrote

Re: [lustre-discuss] Backup software for Lustre

2017-03-17 Thread Brett Lee
intel.com> wrote: > I believe Zmanda is already using GNU tar (or RHEL tar) for the actual > backup storage? I that case it should already work, since we fixed tar > long ago to backup and restore xattrs in a way that preserves Lustre > layouts. > > Cheers, Andreas > >

Re: [lustre-discuss] Backup software for Lustre

2017-03-14 Thread Brett Lee
ello Brett, > >> > >>Actually, looking for someone who uses a commercialized > approach (that retains user metadata and Lustre extended metadata) and not > specifically the manual approaches of Chapter 17. > >> > >> Thanks! > >> Mike >

Re: [lustre-discuss] Backup software for Lustre

2017-02-06 Thread Brett Lee
Hey Mike, "Chapter 17" and http://www.intel.com/content/www/us/en/lustre/backup-and-restore-training.html both contain methods to backup & restore the entire Lustre file system. Are you looking for a solution that backs up only the (user) data files and their associated metadata (e.g. xattrs)?

Re: [lustre-discuss] many 'ksym' packages required

2016-12-19 Thread Brett Lee
Were there any relevant message during your building of the rpms? Per https://jira.hpdd.intel.com/browse/LU-5614 maybe a missing dependency? like kernel-devel? Brett -- Protect your Information and Identity with PDS PDS Software Solutions LLC https://www.TrustPDS.com

Re: [lustre-discuss] building lustre from source rpms, mellanox OFED, CentOS 6.8

2016-12-16 Thread Brett Lee
Hi Lana, Here's a link: https://wiki.hpdd.intel.com/display/PUB/Building+Lustre+from+Source The first time through may require some clarification (at least it did for me). I'm sure this list can help if clarification is needed. Brett -- Secure your confidential information with PDS 2 PDS

Re: [lustre-discuss] Simple Lustre question

2016-12-12 Thread Brett Lee
i Brett, > > Thanks for this. This all seems reasonable and understandable. Thanks for > your help > > -Ben > > On Dec 13, 2016, at 11:39 AM, Brett Lee <brettlee.lus...@gmail.com> wrote: > > Hi Markham, > > Maybe think of Lustre as a bunch of different components..

Re: [lustre-discuss] Simple Lustre question

2016-12-12 Thread Brett Lee
gt; But it seems I could just run Lustre on one node. > > -Ben > > On Dec 13, 2016, at 11:26 AM, Brett Lee <brettlee.lus...@gmail.com> wrote: > > Proper? Please expand on that. :) > > To get started, you could run Lustre on just one node. > > Brett > --

Re: [lustre-discuss] Simple Lustre question

2016-12-12 Thread Brett Lee
Proper? Please expand on that. :) To get started, you could run Lustre on just one node. Brett -- Secure your confidential information with PDS2 PDS Software Solutions LLC https://www.TrustPDS.com On Dec 12, 2016 7:08 PM, "Markham Benjamin" wrote: > Hello, > > I just

Re: [lustre-discuss] Added OSTs, now lnet errors

2016-12-11 Thread Brett Lee
arnet" <bar...@icecube.wisc.edu> wrote: > Hi Brett, > > > On 12/11/16 4:46 PM, Brett Lee wrote: > >> Steve, It might be the network that LNet is running on. Have you run >> some bandwidth tests without LNet to check for network problems? >>

Re: [lustre-discuss] Added OSTs, now lnet errors

2016-12-11 Thread Brett Lee
Steve, It might be the network that LNet is running on. Have you run some bandwidth tests without LNet to check for network problems? On Dec 11, 2016 3:37 PM, "Steve Barnet" wrote: > Hi all, > > Seeing something very strange. I recently added two OSSes > and 10 OSTs