Re: [lustre-discuss] IPoIB best practises

LNet's (assuming it uses the same fabric), you should be >> able to configure for active/active. >> >> https://wiki.whamcloud.com/display/LNet/Multi-Rail+Overview >> >> This should help with most of the concepts. >> >> -- Lauz >> >> On 16 Jan

Re: [lustre-discuss] IPoIB best practises

gt; This should help with most of the concepts. > > -- Lauz > > On 16 January 2022 11:56:16 GMT, "E.S. Rosenberg" < > esr+lus...@mail.hebrew.edu> wrote: >> >> Hey everyone, >> >> This is probably off-topic but I can't find any doc

[lustre-discuss] IPoIB best practises

Hey everyone, This is probably off-topic but I can't find any documents on the subject and since Lustre uses IPoIB I suspect others here have dealt with this question. If I have a node connected with multiple IB links should each connected IB port have it's own IP address or is there a way

[lustre-discuss] Experience with DDN AI400X

Hi everyone, Haven't been on this list for a while :) At my new job we are considering getting a DDN AI400X system which as far as I understood from them is Lustre for some machine learning nodes. I'm just wondering how nice these play with other lustre systems, am I getting myself a vendor

[lustre-discuss] Allow speed control on LUG videos

Hi all, Could you by any chance allow playback speed control on the LUG 2019 videos (on Vimeo). I would like to watch them at a higher speed. Thanks! Eli ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org

Re: [lustre-discuss] 2.10.5 compiler versions

ntu 18.04) > > Chris Horn > > On 8/30/18, 2:34 PM, "lustre-discuss on behalf of Andreas Dilger" < > lustre-discuss-boun...@lists.lustre.org on behalf of adil...@whamcloud.com> > wrote: > > On Aug 30, 2018, at 13:28, E.S. Rosenberg > wrote: >

[lustre-discuss] 2.10.5 compiler versions

HI everyone, We just succesfully built 2.10.5 on our Debian clients but to do so I had to revert to gcc-7 (from 8), is this a known issue? In general what compilers is building/testing done with? Also I was wondering how is it that the configure script takes longer to run then compiling

[lustre-discuss] Future of Lustre in upstream?

So I had missed this: https://www.linuxjournal.com/content/lustre-filesystem-dropped-linux-418-kernel Until a friend pointed it out. The LWG reports (http://wiki.opensfs.org/Lustre_Working_Group) do still paint a picture of progress so where is the upstream client now? We had been using

Re: [lustre-discuss] 2.10.4 git source link is dead

their > inclination to make retroactive corrections like this. However, the good > news is that 2.10.5 should be out shortly at that will have links that > reflect the current reality. > > > > Peter > > > > *From: *lustre-discuss on > behalf of "E.S. Ros

[lustre-discuss] 2.10.4 git source link is dead

Hi everyone, The link to the 2.10.4 source on http://lustre.org/lustre-2-10-4-released/ https://git.hpdd.intel.com/?p=fs/lustre-release.git;a=commit;h=08876238836886bc6ad9b90c5ff50bdde87e2849 returns 404 - no such project. After some digging it seems the link should be:

Re: [lustre-discuss] MOFED 4.4-1.0.0.0

Does mofed make a big difference vs. in-kernel ofed that is worth the effort? Regards, Eli On Mon, Aug 6, 2018 at 6:08 PM, Alexander I Kulyavtsev wrote: > Hi Megan, > > Standard lustre build works with in-kernel ofed. To use Mellanox ofed you > have to rebuild lustre: > >

Re: [lustre-discuss] LUG 2018

> > *From: *lustre-discuss on > behalf of "E.S. Rosenberg" > *Date: *Wednesday, June 20, 2018 at 1:51 PM > *To: *Andreas Dilger > *Cc: *Alexander I Kulyavtsev , Lustre discussion < > lustre-discuss@lists.lustre.org> > *Subject: *Re: [lustre-discus

Re: [lustre-discuss] LUG 2018

Cheers, Andreas > > On Jun 20, 2018, at 11:25, Alexander I Kulyavtsev wrote: > > > > Slides at: > > http://opensfs.org/lug-2018-agenda/ > > -A. > > > > From: lustre-discuss on > behalf of "E.S. Rosenberg" > > Date: Wednesday,

Re: [lustre-discuss] LUG 2018

I saw the slides which is why I was wondering about the recordings (if there are recordings). On Wed, Jun 20, 2018 at 8:25 PM, Alexander I Kulyavtsev wrote: > Slides at: > http://opensfs.org/lug-2018-agenda/ > -A. > > From: lustre-discuss on behalf > of "E.S. Rosenb

[lustre-discuss] LUG 2018

Hi all, Are the talks online yet? Thanks, Eli ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] lustre 2.5.3 servers and lustre 2.10.4 clients?

Afaik no-one is testing that combination so no-one can say that for certain. HTH, Eli On Wed, May 23, 2018 at 10:57 AM, Chris Roome < chris.ro...@mpimf-heidelberg.mpg.de> wrote: > Hi lustre gurus, > > We have the MGS/MDT and OSSes on lustre 2.5.3 and we would like lustre > clients on CentOS

Re: [lustre-discuss] Do I need Lustre?

We never had a budget sufficient to buy a large SSD-only storage so can't say anything about that. Our NFS filers tend to crumple when users start genuinely running jobs against them and this tends to affect both the jobs and also any other processes/users who are trying to use the filers. Of

Re: [lustre-discuss] lfs data_version $filename

This is just a guess - could it be related to ZFS backends? Allowing for snapshots etc. On Thu, Apr 5, 2018 at 10:53 PM, Ms. Megan Larko wrote: > Greetings List! > > What is the number from the command "lfs data_version $filename " telling > me? > > I do not see

Re: [lustre-discuss] Upgrade to 2.11: unrecognized mount option

Actually that linked article is dated today, so I guess the official mail announcement was still to come! On Wed, Apr 11, 2018 at 7:06 PM, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> wrote: > I'm on lustre-discuss and HPDD-discuss and didn't get it on either. > Thanks anyhow! > &

Re: [lustre-discuss] Upgrade to 2.11: unrecognized mount option

aybe there’s a “which > lists were sent to” issue? > > > >- Patrick > > > > *From: *lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on > behalf of "E.S. Rosenberg" <esr+lus...@mail.hebrew.edu> > *Date: *Wednesday, April 11, 2018 at

Re: [lustre-discuss] Upgrade to 2.11: unrecognized mount option

OT: Did I miss the mail announcing Lustre 2.11 or all the recent 2.11 mails early adapters? Thanks, Eli On Sat, Apr 7, 2018 at 2:58 AM, Dilger, Andreas wrote: > On Apr 6, 2018, at 06:27, Thomas Roth wrote: > > > > Hi all, > > > > (don't know if it isn't

Re: [lustre-discuss] Mixed size OST's

Doesn't PFL also 'solve'/mitigate this issue in the sense that a file doesn't have to remain restricted to the OST(s) it started on? (And as such balancing will even continue as files grow) Regards, Eli On Fri, Mar 16, 2018 at 9:57 PM, Dilger, Andreas wrote: > On Mar

Re: [lustre-discuss] File locking errors.

On Fri, Feb 16, 2018 at 12:00 AM, Colin Faber wrote: > If the mount on the users clients had the various options enabled, and > those aren't present in fstab, you'd end up with such behavior. Also 2.8? > Can you upgrade to 2.10 LTS?? > Depending on when they installed their

Re: [lustre-discuss] Lustre as /home directory

What will your backup/snapshot strategy going to be and how will you implement it? On Thu, Feb 15, 2018 at 5:30 PM, Mark Hahn wrote: > My question is, Is it advisable to have /home in Lustre since users data >> will be of small files (less than 5MB)? >> > > certainly it works,

Re: [lustre-discuss] Making a file system read-only

Hi Cameron, On Mon, Feb 5, 2018 at 10:54 PM, Cameron Harr wrote: > Greetings, > > I'll be retiring a 2.5 ZFS-backed file system in the coming months and > plan on putting it in a "read-only" state for 6 weeks or so to let users > archive or migrate data they want. The optimal,

Re: [lustre-discuss] Do lustre modules detect/act on changes made to parameters

Just noticed this while searching for another lustre related thread. Still an interesting question I think, I'm guessing my above question is basically what lnetctl does? Regards, Eli On Thu, Dec 21, 2017 at 8:31 PM, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> wrote: > Hello again fell

[lustre-discuss] What does your (next) MDT look like?

Hello fellow Lustre users :) Since I didn't want to take the "size of MDT, inode count, inode size" thread too far off-topic I'm starting a new thread. I'm curious how many people are using SSD MDTs? Also how practical is such a thing in a 2.11.x Data On MDT scenario? Is using some type of mix

Re: [lustre-discuss] size of MDT, inode count, inode size

Thanks for the great and informative answer! On Mon, Feb 5, 2018 at 5:19 AM, Dilger, Andreas <andreas.dil...@intel.com> wrote: > On Feb 4, 2018, at 13:10, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > On Sat, Feb 3, 2018 at 4:45 AM, Dilger, Andreas < > a

Re: [lustre-discuss] size of MDT, inode count, inode size

On Sat, Feb 3, 2018 at 4:45 AM, Dilger, Andreas wrote: > On Jan 26, 2018, at 07:56, Thomas Roth wrote: > > > > Hmm, option-testing leads to more confusion: > > > > With this 922GB-sdb1 I do > > > > mkfs.lustre --reformat --mgs --mdt ... /dev/sdb1 > > > >

[lustre-discuss] Fwd: undelete

Re:all -- Forwarded message -- From: E.S. Rosenberg <e...@cs.huji.ac.il> Date: Wed, Jan 24, 2018 at 10:59 PM Subject: Re: [lustre-discuss] undelete To: "Dilger, Andreas" <andreas.dil...@intel.com> Cc: "lustre-discuss@lists.lustre.org" <lustre-d

Re: [lustre-discuss] undelete

metadata and searching the files blindly on multiple OSTs is definitely not an option. Is there any tool to show me the lustre relevant metadata? Thanks, Eli On Tue, Jan 23, 2018 at 4:03 AM, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> wrote: > Dragging the old discussion back up > Fir

Re: [lustre-discuss] Recompiling client from the source doesnot contain lnetctl

Slightly OT: As mentioned in the mail I sent today liblnetconfig.so.2.0.0 is missing from the debs available on https://downloads.hpdd.intel.com/public/lustre/lustre-2.10.2/ubuntu1604/client/ Regards, Eli On Tue, Jan 23, 2018 at 8:35 PM, Alexander I Kulyavtsev wrote: > Andreas,

[lustre-discuss] Some deb issues for 2.10.2

Hi all, Today I played a bit with Lustre 2.10.2 using the debs for Ubuntu 16.04 client and I was trying to use lnetctl which returned the following error: lnetctl: error while loading shared libraries: liblnetconfig.so.2: cannot open shared object file: No such file or directory The reason for

Re: [lustre-discuss] undelete

). Thanks, Eli On Thu, May 4, 2017 at 2:21 AM, Dilger, Andreas <andreas.dil...@intel.com> wrote: > On Apr 27, 2017, at 05:43, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > > > A user just rm'd a big archive of theirs on lustre, any way to recover > it before

Re: [lustre-discuss] Are there any performance hits with the https://access.redhat.com/security/vulnerabilities/speculativeexecution?

The hit is mainly for things that do context switches (which IO is the biggest thing in. On Mon, Jan 8, 2018 at 1:23 PM, Arman Khalatyan wrote: > Ok, We did some tests with the new lustre clients(no patch on servers) > I can confirm like Marek: maximum downgrade is about 40%

Re: [lustre-discuss] Are there any performance hits with the https://access.redhat.com/security/vulnerabilities/speculativeexecution?

There is absolutely no argument from me that the Client side *has* to be patched immediately, my question was only about server side which seems to me to be at a mitigated risk due to the nature of the server. I think we'll be switching to vanilla kernel on client side and seeing how that works

Re: [lustre-discuss] Are there any performance hits with the https://access.redhat.com/security/vulnerabilities/speculativeexecution?

If Phoronix FS-Mark is in any way like Lustre we should be ready for a serious hit it would seem: https://www.phoronix.com/scan.php?page=article=linux-415-x86pti=2 Has anyone built the server against the new kernel yet? Also to what extent would a Lustre system that is essentially a filer be at

Re: [lustre-discuss] Lustre Client in a container

On Mon, Jan 1, 2018 at 12:38 AM, Patrick Farrell wrote: > > > Keeping in mind that the choice of NFS means that you don’t have the POSIX > guarantees provided by Lustre, so simultaneous access to the same files is > dicey unless it’s only reading. > That just means that during the

Re: [lustre-discuss] Designing a new Lustre system

Thanks for all the great answers! Still looking for more info for #4... Thanks again, Eli On Thu, Dec 21, 2017 at 12:26 AM, Mohr Jr, Richard Frank (Rick Mohr) < rm...@utk.edu> wrote: > My $0.02 below. > > > On Dec 20, 2017, at 11:21 AM, E.S. Rosenberg <esr+lus...@mai

[lustre-discuss] Do lustre modules detect/act on changes made to parameters

Hello again fellow lustre users, Can I finetune lustre by modifying values in say: /sys/module/ko2iblnd/parameters/credits /sys/module/ko2iblnd/parameters/peer_credits etc. Or are these 'set in stone' from module loadtime? Thanks, Eli ___ lustre-discuss

[lustre-discuss] Designing a new Lustre system

Hi everyone, We are currently looking into upgrading/replacing our Lustre system with a newer system. I had several ideas I'd like to run by you and also some questions: 1. After my recent experience with failover I wondered is there any reason not to set all machines that are within reasonable

Re: [lustre-discuss] Lustre 2.10.1 + RHEL7 Lock Callback Timer Expired

Did you find the problem? Were there any useful suggestions off-list? On Wed, Nov 29, 2017 at 1:34 PM, Charles A Taylor wrote: > > We have a genomics pipeline app (supernova) that fails consistently due to > the client being evicted on the OSSs with a “lock callback timer >

Re: [lustre-discuss] billions of 50k files

Maybe this would be where multiple MDS + small files on MDS would shine? My 1 millionth of a bitcoin, Eli On Thu, Nov 30, 2017 at 12:31 AM, Brian Andrus wrote: > All, > > I have always seen lustre as a good solution for large files and not the > best for many small files. >

Re: [lustre-discuss] mounting OSTs of failed node on other nodes

drus > > On 11/28/2017 4:35 PM, E.S. Rosenberg wrote: > > Hi everyone, > One of our OSS nodes failed to come back up after a firmware upgrade. > I'd like to mount its' OSTs on one or more of the other OSSs to allow the > filesystem to re

[lustre-discuss] mounting OSTs of failed node on other nodes

Hi everyone, One of our OSS nodes failed to come back up after a firmware upgrade. I'd like to mount its' OSTs on one or more of the other OSSs to allow the filesystem to remain available. Is this possible? Thanks, Eli ___ lustre-discuss mailing list

Re: [lustre-discuss] Lustre and Elasticsearch

Thanks for all the great feedback and answers! On Mon, Nov 27, 2017 at 7:04 AM, Mark Hahn wrote: > Do you or anyone on the list know if/how flock affects Lustre performance? >> > > I'm still puzzled by this: elasticsearch is specifically designed for each > node to have a

Re: [lustre-discuss] Lustre and Elasticsearch

Hi Torsten, Thanks that worked! Do you or anyone on the list know if/how flock affects Lustre performance? Thanks again, Eli On Tue, Nov 21, 2017 at 9:18 AM, Torsten Harenberg < torsten.harenb...@cern.ch> wrote: > Hi Eli, > > Am 21.11.17 um 01:26 schrieb E.S. Rosenberg: > &g

[lustre-discuss] Lustre and Elasticsearch

Hi, A while ago I tried using Lustre as storage target for elasticsearch with no luck, at the time I didn't really have time to look at it. Today I looked at it again. Apparently it tries to run a native locking function that isn't implemented in java: Caused by: java.io.IOException: Function

Re: [lustre-discuss] Does lustre 2.10 client support 2.5 server ?

Hi Biju, The 2.10 client is multi-rail aware while the 2.5 server is not there have been multiple reports on the list and several open bugs that this combination doesn't work. A 2.9 client may work but in general it is my understanding that compatibility is only check 1 version back (so 2.9-2.8

Re: [lustre-discuss] Lustre writing is not happening

Did you find your problem? Do you have messages in syslog/dmesg? What version/distro? Could it be your communication to the OSS is not good? Good luck, Eli On Sat, Oct 28, 2017 at 5:08 PM, Ravi Konila wrote: > Hi > I have newly installed Lustre 2.8 (2 MDSs and 2 OSSs)

Re: [lustre-discuss] 1 MDS and 1 OSS

Maybe someone can answer this in the context of this question, is there any performance gain over classic filers when you are using only a single OSS? On Mon, Oct 30, 2017 at 9:56 AM, Ravi Konila wrote: > Hi Majid > > It is better to go for HA for both OSS and MDS. You

Re: [lustre-discuss] FW: Lustre 2.10.1 released

On Sat, Oct 7, 2017 at 6:39 PM, Patrick Farrell wrote: > Michael, > > In general, yes, and if the kernel versions match, then almost certainly > specifically too. I’ve certainly done it on a Fedora box in the past. > The vanilla kernel client worked well in our short tests of

Re: [lustre-discuss] lustre-dkms-2.10.0 fails to install on kernel 4.4

Shouldn't you use kmod with RHEL? I may be wrong but that is how we installed it On Thu, Aug 17, 2017 at 1:58 AM, Riccardo Veraldi wrote: > hello. > > I am installing lustre-dkms-2.10.0 on RHEL74 running kernel > 4.4.82-1.el7.elrepo.x86_64 > > dkms.conf:

Re: [lustre-discuss] Lustre 2.10 on RHEL6.x?

ng some kind of > support for RHEL 6.x in the 2.10 LTS releases so I think it likely that at > least support for clients will be reintroduced in a future 2.10.x > maintenance release. > > On 8/7/17, 6:34 AM, "lustre-discuss on behalf of E.S. Rosenberg" < > lustre-discuss-boun

Re: [lustre-discuss] Lustre 2.10 on RHEL6.x?

If I'm not mistaken they haven't provided RPMs for RHEL6.x since 2.9... HTH, Eli On Mon, Aug 7, 2017 at 4:33 PM, Steve Barnet wrote: > Hey all, > > I am looking to upgrade from lustre 2.8 to 2.10. I see that > there are no pre-built RPMs for 2.10 on RHEL6.x families.

Re: [lustre-discuss] nodes crash during ior test

OT: Can we create a wiki page or some other form of knowledge pooling on benchmarking lustre? Right now I'm using slides from 2009 as my source which may not be ideal... http://wiki.lustre.org/images/4/40/Wednesday_shpc-2009-benchmarking.pdf OT2: Did I miss the release announcement or was 2.10

Re: [lustre-discuss] Lustre and OFED

ow you've made me unsure of what whether or not my Lustre install is using RDMA, how should I be able to tell (we are definitely using IPoIB/o2ib)? Thanks, Eli > > > > >Harald > > > > > >> > >> -Ben Evans > >> > >> From: lustre-discuss &

Re: [lustre-discuss] Lustre and OFED

again, Eli > > --Jeff > > On Thu, Jul 27, 2017 at 4:55 PM, E.S. Rosenberg < > esr+lus...@mail.hebrew.edu> wrote: > >> Hi all, >> >> How 'needed' is OFED for Lustre? In the LUG talks it is mentioned every >> once in a while and that got me thinking a bit.

[lustre-discuss] Lustre and OFED

Hi all, How 'needed' is OFED for Lustre? In the LUG talks it is mentioned every once in a while and that got me thinking a bit. What things are gained by installing OFED? Performance? Accurate traffic reports? Currently I am using a lustre system without OFED but our IB hardware is from the FDR

Re: [lustre-discuss] set OSTs read only ?

On Thu, Jul 13, 2017 at 5:49 AM, Bob Ball wrote: > On the mgs/mgt do something like: > lctl --device -OST0019-osc-MDT deactivate > > No further files will be assigned to that OST. Reverse with "activate". > Or reboot the mgs/mdt as this is not persistent. "lctl dl" will

Re: [lustre-discuss] LUG 2017 Videos

Great, thanks for all your hard work! On Sun, Jul 9, 2017 at 12:30 AM, Rawlings, Kenrick D wrote: > Videos from LUG 2017 are now online. Robert Ping has made them available > on YouTube and created a playlist with all of the presentation videos: > >

Re: [lustre-discuss] errors 107 in syslog on client 2.8.0

Hi Ekaterina, On Mon, Jun 26, 2017 at 11:04 AM, Ekaterina Popova wrote: > Greetings, > > We've installed lustre client 2.8.0 on Debian 8. Lustre is mounted, it > works, but there are many errors in system logs such as: > > Jun 26 06:42:46 fs0003 kernel:

Re: [lustre-discuss] LUG 2017

to save manual effort. I'll report back on this within the > next day or two. > > Thanks, > Ken > > ___ > From: Dilger, Andreas <andreas.dil...@intel.com> > Sent: Thursday, June 15, 2017 6:49 AM > To: Rawlings, Kenrick D > Cc: E.S. Rosenbe

Re: [lustre-discuss] LUG 2017

> > > *From: *lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on > behalf of "Jones, Peter A" <peter.a.jo...@intel.com> > *Date: *Monday, June 12, 2017 at 10:39 AM > *To: *Colin Faber <colin.fa...@seagate.com>, "E.S. Rosenberg" <

[lustre-discuss] LUG 2017

Hi all, Are the talks going to be posted to Youtube like in the past? I haven't been able to find them so far... Thanks, Eli ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] State of the upstream client

On Wed, May 24, 2017 at 2:23 AM, Dilger, Andreas <andreas.dil...@intel.com> wrote: > On May 23, 2017, at 11:15, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > > > Hi all, > > So I may be asking for something that will anyhow be dealt with at LUG >

[lustre-discuss] State of the upstream client

Hi all, So I may be asking for something that will anyhow be dealt with at LUG 2017 but I actually would like to know. At LUG 2016 there was a talk that sounded very hopeful that the upstream version of lustre was taking leaps and bounds to being in sync with the main Lustre project. Where are

Re: [lustre-discuss] lnetctl & /etc/sysconfig/lnet.conf Usage

On Tue, May 9, 2017 at 9:07 PM, Di Natale, Giuseppe wrote: > Greetings everyone, > > > I am working on a patch to move /etc/sysconfig/lnet.conf to > /etc/lnet.conf. For those interested in the patch, it can be found at > https://review.whamcloud.com/#/c/26971/. > I am no

Re: [lustre-discuss] seclabel

> attributes. In this way Lustre supports seclabel. > In Lustre 2.9, an additional enhancement for SELinux support was landed. > > Which version are you using? > > Cheers, > Sebastien. > > > Le 15 mai 2017 à 14:39, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> a &g

Re: [lustre-discuss] seclabel

Hi Robin, Did you ever solve this? We are considering trying root-on-lustre but that would be a deal-breaker. Thanks, Eli On Sat, Mar 4, 2017 at 9:38 AM, Dilger, Andreas wrote: > On Mar 2, 2017, at 05:55, Robin Humble > wrote: > > > >

Re: [lustre-discuss] lfs_migrate

s > to the new file with "ln -f". > > That is something that has been on the todo list for lfs_migrate for a > while, so if you wanted to implement that in the script and submit a patch > to Gerrit it would be appreciated. > > Cheers, Andreas > > On May 1, 2017, at 06:59,

Re: [lustre-discuss] client fails to mount

n why is unknown. Could be faulty firmware. During the > weekend the system was running fine. > Did anything specific make you look in the switch, or just after all other things were checked you checked there? > > > > > > > On Mon, May 1, 2017 at 2:18 PM, E.S. Rosenberg <

Re: [lustre-discuss] lfs_migrate

n 2.7.0. I was trying to hold out for progressive file layout to land. > > Allen > > -Original Message- > From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On > Behalf Of Dilger, Andreas > Sent: Wednesday, April 12, 2017 8:19 AM > To: Todd, Allen <a

Re: [lustre-discuss] client fails to mount

elp/advice/hints. Good to see how this active > community works! > Indeed. Eli > > > > > On Tue, Apr 25, 2017 at 8:17 PM, E.S. Rosenberg < > esr+lus...@mail.hebrew.edu> wrote: > >> >> >> On Tue, Apr 25, 2017 at 7:41 PM, Oucharek, Doug S < >>

Re: [lustre-discuss] kerberised lustre performance

it is only to authenticate/authorize the client system and not the user that is trying to access files? Thanks, Eli > > Cheers, > Sebastien. > > > Le 27 avr. 2017 à 13:10, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> a > écrit : > > > > Hi everyone, > > I

[lustre-discuss] undelete

A user just rm'd a big archive of theirs on lustre, any way to recover it before it gets destroyed by other writes? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] kerberised lustre performance

Hi everyone, I just saw Sebatians' talk at LUG 2016 (Yes I know I'm a bit behind times) and I was wondering if and how much a performance impact there is from the need to get kerberos tickets before file actions (or is it only mounting?)... https://www.youtube.com/watch?v=zo6b03zxrIs Thanks, Eli

Re: [lustre-discuss] client fails to mount

ping from a working node. Is there a way to > verbose the Lustre logging to see more detail on the LNET level? > >> > >> It is very strange that a rebooted node is able to lctl ping compute > nodes, but fails to lctl ping metadata and storage nodes. > >> > >>

Re: [lustre-discuss] client fails to mount

On Mon, Apr 24, 2017 at 8:13 PM, Strikwerda, Ger wrote: > Hi Raj (and others), > > In which file should i state the credits/peer_credits stuff? > > Perhaps relevant config-files: > > [root@pg-gpu01 ~]# cd /etc/modprobe.d/ > > [root@pg-gpu01 modprobe.d]# ls >

Re: [lustre-discuss] What happens when a file grows

s the size grows, which will largely > avoid this problem. > > Cheers, Andreas > > > On Mar 30, 2017, at 14:59, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > > > Hi all, > > I was wondering about the following scenario: > > > &g

Re: [lustre-discuss] upgrading from 2.5.2 to 2.9

We went 2.5.x > 2.7.0 > 2.8.0 Now I'm eyeing 2.9.0 but as far as I understood it involves going to CentOS 7.x which in and of itself I don't mind but does mean I want to test it on a test setup which I lack currently HTH, Eli On Wed, Mar 29, 2017 at 4:23 PM, Anjana Kar wrote:

[lustre-discuss] What happens when a file grows

Hi all, I was wondering about the following scenario: What happens when a file is created without striping and it gets larger then the available space on the OST that it is on? Does it now fail to write because adding stripes is impossible after a file exists or will the rest of the file get

Re: [lustre-discuss] lfs_migrate

command as shown below, but please confirm via the appropriate Lustre > manual: > > lctl set_param osc.--*.active=0 > > Brett > -- > Protect Yourself Against Cybercrime > PDS Software Solutions LLC > https://www.TrustPDS.com <https://www.trustpds.com/> > > On Mo

[lustre-discuss] how homogenous should a lustre cluster be?

Dear all, How homogenous/not homogenous are your clusters? At the moment all our OSS are identical and running lustrefs (lustre 2.8.0), now that I am taking one OSS offline for hardware maintenance I started wondering if I can bring it back as a ZFS OSS or would that make my lustre blow up?

[lustre-discuss] lfs_migrate

In the man page it says the following: Because lfs_migrate is not yet closely integrated with the MDS, it cannot determine whether a file is currently open and/or in-use by other applications or nodes. That makes it UNSAFE for use on files that might be modified by other applications, since

Re: [lustre-discuss] Using Lustre

These are very general questions that *should* be addressed in generally available documentation but I may be wrong but I think they are. Either way to the best of my knowledge Lustre is currently only supported on Linux, the officially supported distributions are RHEL and its' derivatives. We

[lustre-discuss] What do you use to monitor Lustre

As a continuation to my recent question on traffic compression/caching I was wondering what others use to monitor their Lustre performance Currently I have collectl running on all clients, the data gets shipped by filebeat to an ELK+Grafana stack. Hoping to soon also deploy collectl on the

Re: [lustre-discuss] Traffic compression?

e-discuss <lustre-discuss-boun...@lists.lustre.org> on behalf of "E.S. Rosenberg" <esr+lus...@mail.hebrew.edu> Date: Monday, February 6, 2017 at 3:25 PM To: "lustre-discuss@lists.lustre.org" <lustre-discuss@lists.lustre.org> Subject: [lustre-discuss] Traffic co

[lustre-discuss] Traffic compression?

We started closer monitoring of resources on our cluster and I noticed that there is sometimes a big discrepancy between the read traffic reported by Lustre and the incoming traffic reported by infiniband (which is the interace carrying the Lustre traffic). Currently I have a 4.4GB peak on Lustre

Re: [lustre-discuss] Do 2.9 Client and 2.8 Server play nice

M, "lustre-discuss on behalf of E.S. Rosenberg" < > lustre-discuss-boun...@lists.lustre.org on behalf of > esr+lus...@mail.hebrew.edu> wrote: > > Hi everyone, > > In the past 2.8 Client + 2.7 (or maybe it was 2.5.3) server gave us issues > (servers crashing). > &

[lustre-discuss] Do 2.9 Client and 2.8 Server play nice

Hi everyone, In the past 2.8 Client + 2.7 (or maybe it was 2.5.3) server gave us issues (servers crashing). We would like to be able to move beyond kernel 4.2 on our clients but doing a server upgrade is not really what I want to do right now. Does anyone know/is anyone running 2.9.0 clients

[lustre-discuss] Is anyone using a mixed local/hosted lustre solution

Hi everyone, We are discussing extending our cluster to hosted solutions ("the cloud" for the people who like buzz words), is anyone using a lustre solution that is partially hosted? What are the experiences? Is data moving between the hosted OSTs and local OTSs according to demand? Does it

Re: [lustre-discuss] Distributing locally....

Re:all from the right mail address. You should be able to build debs from the source of lustre it works well for the userland binaries, as far as kernel goes we don't use debs so can't tell you. (debuild and all of that) HTH, Eli On Wed, Nov 2, 2016 at 3:40 PM, Patrick Farrell

Re: [lustre-discuss] Quick ZFS pool question?

On Fri, Oct 7, 2016 at 9:16 AM, Xiong, Jinshan wrote: > > > On Oct 6, 2016, at 2:04 AM, Phill Harvey-Smith < > p.harvey-sm...@warwick.ac.uk> wrote: > > > > Hi all, > > > > Having tested a simple setup for lustre / zfs, I'd like to trey and > replicate on the test system

[lustre-discuss] Using lustre as a filesystem to boot from

Hi all, Is anyone using lustre for network boot? (For the filesystems that are loaded after the kernel is brought in by DHCP/tftp) We are currently using NFS for this but I am wondering if lustre would allow us some more robust features (like programs not crashing on clients when they are

Re: [lustre-discuss] Lustre server/client compatibility

I can only tell you about "the other way around", we updated our clients to 2.8.0 while the server was 2.5.3 and started having kernel panics on the MDS/MGS which was resolved after we also updated the servers to 2.8.0. The way I understand what it says on the website about compatibility 2.8.0

Re: [lustre-discuss] Advice Lustre & ZFS.

Isn't hw raid bounds and leagues faster then any software raid that you're ever going to be putting in? We have lustre OSTs running on RAID6 arrays and MDT/MGT on RAID1 with ldiskfs as filesystem On Thu, Sep 29, 2016 at 5:09 PM, Phill Harvey-Smith < p.harvey-sm...@warwick.ac.uk> wrote: > Hi

Re: [lustre-discuss] Does an updated version exist?

On Sat, Aug 27, 2016 at 12:51 AM, Christopher J. Morrone wrote: > On 08/26/2016 12:48 PM, Oleg Drokin wrote: > > > (it's best to be written by third parties anyway since once you work too > much > > on some code, you take too many things for granted/think they are > obvious, >

Re: [lustre-discuss] refresh file layout error

re-discuss [lustre-discuss-boun...@lists.lustre.org] on behalf > of Patrick Farrell [p...@cray.com] > Sent: Friday, September 04, 2015 4:07 PM > To: lustre-discuss@lists.lustre.org; E.S. Rosenberg; Wahl, Edward > Subject: Re: [lustre-discuss] refresh file layout error > > Martin mi

[lustre-discuss] Does an updated version exist?

I just found this paper: http://wiki.lustre.org/images/d/da/Understanding_Lustre_Filesystem_Internals.pdf It looks interesting but it deals with lustre 1.6 so I am not sure how relevant it still is. Thanks, Eli ___ lustre-discuss mailing list

  1   2   >