Re: [lustre-discuss] Unable to mount new OST

2021-07-06 Thread Jeff Johnson
David, If it’s brand new DDN I’m sure you paid enough for it to be able to call Alex on his yacht and get this issue sorted out….but I digress. Previously in this thread it appeared that ldiskfs was disjointed over something. To have a new clean ldiskfs format go sideways like that is *highly*

Re: [lustre-discuss] Unable to mount new OST

2021-07-06 Thread David Cohen
Hi Jeff, The logs are clear, the new OST is a brand new DDN pool, no alerts on the physical storage, and no indications of malfunctioning disks in the machines logs After reboot the device dm changes: ls -la /dev/mapper/OST0051 lrwxrwxrwx 1 root root 8 Jul 6 07:59 /dev/mapper/OST0051 -> ../dm-30

Re: [lustre-discuss] Unable to mount new OST

2021-07-06 Thread Jeff Johnson
What devices are underneath dm-21 and are there any errors in /var/log/messages for those devices? (assuming /dev/sdX devices underneath) Run `ls /sys/block/dm-21/slaves` to see what devices are beneath dm-21 On Tue, Jul 6, 2021 at 20:09 David Cohen wrote: > Hi, > The index of the OST is

Re: [lustre-discuss] Unable to mount new OST

2021-07-06 Thread Abdeslam Tahari via lustre-discuss
Hello I think you have a disk problem , bad blocks which is causing the problem , unmount the disk and run e2fsck and repair the bad blocks as well (man e2fsck) Le mar. 6 juil. 2021 à 09:28, David Cohen a écrit : > Thanks Artem, > I already tried that (e2fsck) with no avail. > I even tried

Re: [lustre-discuss] Unable to mount new OST

2021-07-06 Thread David Cohen
Thanks Artem, I already tried that (e2fsck) with no avail. I even tried tunefs.lustre --writeconf --erase-params on the MDS and all the other targets, but the behaviour remains the same. Best regards, David On Tue, Jul 6, 2021 at 10:09 AM Благодаренко Артём < artem.blagodare...@gmail.com>

Re: [lustre-discuss] Unable to mount new OST

2021-07-06 Thread Благодаренко Артём via lustre-discuss
Hello David, > On 6 Jul 2021, at 08:34, David Cohen wrote: > > Jul 6 07:39:19 oss03 kernel: LDISKFS-fs (dm-21): warning: mounting fs with > errors, running e2fsck is recommended It looks like LDISKFS partition is in inconsistent state now. It is better to follow the recommendation and run

Re: [lustre-discuss] Unable to mount new OST

2021-07-05 Thread David Cohen
Thanks Andreas, I'm aware that index 51 actually translates to hex 33 (local-OST0033_UUID). I don't believe that's the reason for the failed mount as it is only an index that I increase for every new OST and there are no duplicates. lctl dk show tens of thousands of lines repeating the same error

Re: [lustre-discuss] Unable to mount new OST

2021-07-05 Thread Andreas Dilger via lustre-discuss
On Jul 5, 2021, at 09:05, David Cohen mailto:cda...@physics.technion.ac.il>> wrote: Hi, I'm using Lustre 2.10.5 and lately tried to add a new OST. The OST was formatted with the command below, which other than the index is the exact same one used for all the other OSTs in the system.

Re: [lustre-discuss] Unable to mount new OST

2021-07-05 Thread Abdeslam Tahari via lustre-discuss
Hello could you submit logs files please Le lun. 5 juil. 2021 à 17:05, David Cohen a écrit : > Hi, > I'm using Lustre 2.10.5 and lately tried to add a new OST. > The OST was formatted with the command below, which other than the index > is the exact same one used for all the other OSTs in the

[lustre-discuss] Unable to mount new OST

2021-07-05 Thread David Cohen
Hi, I'm using Lustre 2.10.5 and lately tried to add a new OST. The OST was formatted with the command below, which other than the index is the exact same one used for all the other OSTs in the system. mkfs.lustre --reformat --mkfsoptions="-t ext4 -T huge" --ost --fsname=local --index=0051