Re: [lustre-discuss] ko2iblnd.conf

2024-04-11 Thread Daniel Szkola via lustre-discuss
ted) — Dan Szkola FNAL > On Apr 11, 2024, at 12:36 PM, Andreas Dilger wrote: > > [EXTERNAL] – This message is from an external sender > > > On Apr 11, 2024, at 09:56, Daniel Szkola via lustre-discuss > wrote: >> >> Hello all, >> >> I recently d

[lustre-discuss] ko2iblnd.conf

2024-04-11 Thread Daniel Szkola via lustre-discuss
Hello all, I recently discovered some mismatches in our /etc/modprobe.d/ko2iblnd.conf files between our clients and servers. Is it now recommended to keep the defaults on this module and run without a config file or are there recommended numbers for lustre-2.15.X? The only thing I’ve seen

Re: [lustre-discuss] [EXTERNAL] [BULK] Re: Ongoing issues with quota

2023-10-18 Thread Daniel Szkola via lustre-discuss
lete them? Is there anyway to tell if there are >>>> matching files on the OST(s) that also need to be deleted? >>>> >>>> — >>>> Dan Szkola >>>> FNAL >>>> >>>>> On Oct 10, 2023, at 3:44 PM, Vicker, Da

Re: [lustre-discuss] [EXTERNAL] [BULK] Re: Ongoing issues with quota

2023-10-17 Thread Daniel Szkola via lustre-discuss
ls -a'. If you cd into it or ls >>> it, it's there. Lustre magic. :) >>> >>> -Original Message- >>> From: lustre-discuss >> <mailto:lustre-discuss-boun...@lists.lustre.org>> on behalf of Daniel >>> Szkola via lust

Re: [lustre-discuss] [EXTERNAL] [BULK] Re: Ongoing issues with quota

2023-10-17 Thread Daniel Szkola via lustre-discuss
h 'ls -a'. If you cd into it or ls > it, it's there. Lustre magic. :) > > -Original Message- > From: lustre-discuss <mailto:lustre-discuss-boun...@lists.lustre.org>> on behalf of Daniel Szkola > via lustre-discuss <mailto:lustre-discuss@lists.lustre.org>

Re: [lustre-discuss] Ongoing issues with quota

2023-10-10 Thread Daniel Szkola via lustre-discuss
tly as type > ZFS and see what df -i and find report? > > Cheers, Andreas > >> On Oct 10, 2023, at 22:16, Daniel Szkola via lustre-discuss >> wrote: >> >> OK, I disabled, waited for a while, then reenabled. I still get the same >> numbers. The

Re: [lustre-discuss] Ongoing issues with quota

2023-10-10 Thread Daniel Szkola via lustre-discuss
ar Dan, >> >> I had a similar problem some time ago. We are also using ZFS for MDT and >> OSTs. For us, the used disk space was reported wrong. The problem was fixed >> by switching quota support off on the MGS and then on again. >> >> Cheers, >> Robert >

Re: [lustre-discuss] Ongoing issues with quota

2023-10-09 Thread Daniel Szkola via lustre-discuss
p to 3.6M. > > If that was the case, then I would really, really advise against striping > every directory in the filesystem. That will cause problems far worse than > just inflating the inode quota accounting. > > Cheers, Andreas > >> On Oct 9, 2023, at 22:33, Daniel Sz

Re: [lustre-discuss] Ongoing issues with quota

2023-10-09 Thread Daniel Szkola via lustre-discuss
these numbers and have a fresh count done. — Dan Szkola FNAL > On Oct 4, 2023, at 11:37 AM, Daniel Szkola via lustre-discuss > wrote: > > Also, quotas on the OSTS don’t add up to near 3 million files either: > > [root@lustreclient scratch]# ssh ossnode0 lfs quota -g someg

Re: [lustre-discuss] Ongoing issues with quota

2023-10-04 Thread Daniel Szkola via lustre-discuss
> On Oct 4, 2023, at 8:45 AM, Daniel Szkola via lustre-discuss > wrote: > > No combination of ossnodek runs has helped with this. > > Again, robinhood shows 1796104 files for the group, an 'lfs find -G gid' > found 1796104 files as well. > > So why is the quota com

Re: [lustre-discuss] Ongoing issues with quota

2023-10-04 Thread Daniel Szkola via lustre-discuss
corrected when you umount and fsck the OST's themselves > (not lfsck). At least I recall seeing such messages when fsck'ing on 2.12. > > Best, > > Mark > > On Wed, 4 Oct 2023, Daniel Szkola via lustre-discuss wrote: > > > [EXTERNAL EMAIL] > >

Re: [lustre-discuss] Ongoing issues with quota

2023-10-04 Thread Daniel Szkola via lustre-discuss
and have it regenerate it? Anyone? — Dan Szkola FNAL > On Sep 27, 2023, at 9:42 AM, Daniel Szkola via lustre-discuss > wrote: > > We have a lustre filesystem that we just upgraded to 2.15.3, however this > problem has been going on for some time. > > The quota command

[lustre-discuss] Ongoing issues with quota

2023-09-27 Thread Daniel Szkola via lustre-discuss
We have a lustre filesystem that we just upgraded to 2.15.3, however this problem has been going on for some time. The quota command shows this: Disk quotas for grp somegroup (gid 9544): Filesystemused quota limit grace files quota limit grace /lustre1 13.38T

Re: [lustre-discuss] OST not freeing space for deleted files?

2023-01-12 Thread Daniel Szkola via lustre-discuss
Le 11/01/2023 22:37, « lustre-discuss au nom de Daniel Szkola via > lustre-discuss » lustre-discuss@lists.lustre.org> a écrit : > >CAUTION: This email originated from outside of the organization. Do not > click links or open attachments unless you can confirm the sender and

[lustre-discuss] OST not freeing space for deleted files?

2023-01-11 Thread Daniel Szkola via lustre-discuss
We recently had to take an OSS node that hosts two OSTs out of service to test the hardware as it was randomly power cycling. I migrated all files off of the two OSTs and after some testing we brought the node back into service after recreating the ZFS pools and the two OSTs. Since then it’s

Re: [lustre-discuss] Quota issue after OST removal

2022-10-26 Thread Daniel Szkola via lustre-discuss
le system is still below > the > limit. > > > Obviously your 'somegroup' is at the quota limit on all visible OSTs, so > my guess is that would be the same on the missing two OSTs. > So, either have some data removed or increase the limit. > > Best regards > T

[lustre-discuss] Quota issue after OST removal

2022-10-26 Thread Daniel Szkola via lustre-discuss
Hello all, We recently removed an OSS/OST node that was spontaneously shutting down so hardware testing could be performed. I have no idea how long it will be out, so I followed the procedure for permanent removal. Since then space usage is being calculated correctly, but 'lfs quota' will show