date:20200602

Re: [lustre-discuss] Centos 7.7 upgrade

2020-06-02 Thread Alastair Basden


Hi all,

Thanks - the problem turned out to be the kernel-devel module.

Cheers,
Alastair.

On Tue, 2 Jun 2020, Pascal Suter wrote:


Hi

where you using the rpms from the whamcloud repo?

if so, check if you have installed the kmod-lustre-osd-zfs and 
lustre-osd-zfs-mount packages.


IIRC i had the same errors when the kmod-lustre-osd-zfs package was 
missing on my system.


cheers

Pascal

On 6/2/20 1:20 AM, Alastair Basden wrote:

Hi,

We have just upgraded Lustre servers from 2.12.2 on centos 7.6 to 
2.12.3 on centos 7.7.


The OSSs are on top of zfs (0.7.13 as recommended), and we are using 
3.10.0-1062.1.1.el7_lustre.x86_64


After the update, Lustre will no longer mount - and messages such as:
Jun  2 00:02:44 hostname kernel: LustreError: 158-c: Can't load module 
'osd-zfs'
Jun  2 00:02:44 hostname kernel: LustreError: Skipped 875 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226253:0:(genops.c:397:class_newdev()) OBD: unknown type: osd-zfs
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_config.c:403:class_attach()) Cannot create device 
lustfs-OST0006-osd of type osd-zfs : -19
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_config.c:403:class_attach()) Skipped 881 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:197:lustre_start_simple()) lustfs-OST0006-osd 
attach error -19
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:197:lustre_start_simple()) Skipped 881 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount_server.c:1947:server_fill_super()) Unable to start 
osd on lustfs-ost6/ost6: -19
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount_server.c:1947:server_fill_super()) Skipped 881 
previous similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:1608:lustre_fill_super()) Unable to mount (-19)
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:1608:lustre_fill_super()) Skipped 881 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226253:0:(genops.c:397:class_newdev()) Skipped 887 previous similar 
messages


Does anyone have any ideas?

Thanks,
Alastair.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] patchless server vs. patched server

2020-06-02 Thread Pascal Suter


Hi George

that used to be the case until before 2.10.1, but since 2.10.1 even 
ldiskfs does not require a patch anymore. I have actually updated from a 
patched 2.10.3 to 2.12.4 patchless and i am using ldiskfs for my MDTs  
and ZFS for the OSTs


but i think i just found out why there are still both versions being 
packed.. while i was looking for a link to quote regarding ldiskfs now 
working without a patch, i actually found the announcement of 2.10.1  at 
http://lustre.org/lustre-2-10-1-released/ which states


   "Patchless server build for ldiskfs is now routinely provided. Note 
that the patched kernel version must still be used to make use of 
project quotas"


And here is the document that my question was based upon:

http://wiki.lustre.org/Installing_the_Lustre_Software

it states:

"Note: With the release of Lustre version 2.10.1, it is possible to use 
patchless kernels for Lustre servers running LDISKFS. The patchless 
LDISKFS server distribution does not include a Linux kernel. Instead, 
patchless servers will use the kernel distributed with the operating 
system."


and here is a LUDOC issue regarding documenting this in the official 
lustre documentation:


https://jira.whamcloud.com/browse/LUDOC-435

(amazing what you can find once you know what to look for ;))

i have applied for a lustre.org wiki account to add this missing piece 
of information which should help people to choose better if they want to 
use the patched or patchless kernel. luckily i'm not using the project 
quota feature ;)


cheers

Pascal



On 6/2/20 1:50 PM, George Melikov wrote:

IIRC "patchless server" can only serve ZFS based backends.
So, it you really need ldiskfs - you're stuck with patched kernel for now.
27.05.2020, 18:41, "Pascal Suter" :

Hi all

i am currently upgrading a lustre 2.10.3 to 2.12.4 on CentOS 7.7 and I
am unsure if I should use the patchless or patched server version.
what
is the advantage of still using the patched server version over using
the patchless variant? From an linux sysadmin point of view I
prefer to
use an unpatched kernel and it would seem unnecessary to still
maintain
a patched variant if they both worked the same in the end.

regards

Pascal

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org

http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Sincerely,
George Melikov
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] patchless server vs. patched server

2020-06-02 Thread George Melikov

IIRC "patchless server" can only serve ZFS based backends.So, it you really need ldiskfs - you're stuck with patched kernel for now. 27.05.2020, 18:41, "Pascal Suter" :Hi alli am currently upgrading a lustre 2.10.3 to 2.12.4 on CentOS 7.7 and Iam unsure if I should use the patchless or patched server version. whatis the advantage of still using the patched server version over usingthe patchless variant? From an linux sysadmin point of view I prefer touse an unpatched kernel and it would seem unnecessary to still maintaina patched variant if they both worked the same in the end.regardsPascal___lustre-discuss mailing listlustre-discuss@lists.lustre.orghttp://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org  Sincerely,George Melikov ___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Centos 7.7 upgrade

2020-06-02 Thread Pascal Suter


Hi

where you using the rpms from the whamcloud repo?

if so, check if you have installed the kmod-lustre-osd-zfs and 
lustre-osd-zfs-mount packages.


IIRC i had the same errors when the kmod-lustre-osd-zfs package was 
missing on my system.


cheers

Pascal

On 6/2/20 1:20 AM, Alastair Basden wrote:

Hi,

We have just upgraded Lustre servers from 2.12.2 on centos 7.6 to 
2.12.3 on centos 7.7.


The OSSs are on top of zfs (0.7.13 as recommended), and we are using 
3.10.0-1062.1.1.el7_lustre.x86_64


After the update, Lustre will no longer mount - and messages such as:
Jun  2 00:02:44 hostname kernel: LustreError: 158-c: Can't load module 
'osd-zfs'
Jun  2 00:02:44 hostname kernel: LustreError: Skipped 875 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226253:0:(genops.c:397:class_newdev()) OBD: unknown type: osd-zfs
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_config.c:403:class_attach()) Cannot create device 
lustfs-OST0006-osd of type osd-zfs : -19
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_config.c:403:class_attach()) Skipped 881 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:197:lustre_start_simple()) lustfs-OST0006-osd 
attach error -19
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:197:lustre_start_simple()) Skipped 881 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount_server.c:1947:server_fill_super()) Unable to start 
osd on lustfs-ost6/ost6: -19
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount_server.c:1947:server_fill_super()) Skipped 881 
previous similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:1608:lustre_fill_super()) Unable to mount (-19)
Jun  2 00:02:44 hostname kernel: LustreError: 
226265:0:(obd_mount.c:1608:lustre_fill_super()) Skipped 881 previous 
similar messages
Jun  2 00:02:44 hostname kernel: LustreError: 
226253:0:(genops.c:397:class_newdev()) Skipped 887 previous similar 
messages


Does anyone have any ideas?

Thanks,
Alastair.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] how to mapping of RPC rate to bandwidth/IOPS?

2020-06-02 Thread 肖正刚

Hi all,
we use TBF policy(details:
https://jira.whamcloud.com/secure/attachment/14201/Lustre%20NRS%20TBF%20documentation%200.1.pdf)
to limit rpcrate coming from clients; but I do not know how to mapping of
rpcrate to bandwidth or iops.
For example:
if I set a client's rpcrate=10，how much bandwith or iops the client can
get  in theory?

Any suggestions will help.

Thanks.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Centos 7.7 upgrade

2020-06-02 Thread Alastair Basden


Hi Jeff,

Yes zfs modules are there - at least, I can see the zpools okay.

But, dkms status reports:
lustre-zfs, 2.12.3, 3.10.0-957.10.1.el7_lustre.x86_64, x86_64: installed 
(WARNING! Diff between built and installed module!) (WARNING! Diff between 
built and installed module!) (WARNING! Diff between built and installed 
module!) (WARNING! Diff between built and installed module!) (WARNING! 
Diff between built and installed module!)

spl, 0.7.13, 3.10.0-1062.9.1.el7.x86_64, x86_64: installed
spl, 0.7.13, 3.10.0-957.10.1.el7_lustre.x86_64, x86_64: installed
zfs, 0.7.13, 3.10.0-1062.9.1.el7.x86_64, x86_64: installed
zfs, 0.7.13, 3.10.0-957.10.1.el7_lustre.x86_64, x86_64: installed

So it would seem there might be problems somehwere (though I've just 
checked on an older 7.6 system which is working, and that also gives the 
same warnings).


Seems to be a problem with the osd-zfs module not loading.

Cheers,
Alastair.

On Mon, 1 Jun 2020, Jeff Johnson wrote:


Alastair,

Are you sure you have functioning ZFS modules for that kernel, and that
they are loaded? Are you able to see your zpools? Did you use DKMS for
either ZFS, Lustre or both? If so, what does `dkms status` report?

--Jeff


On Mon, Jun 1, 2020 at 4:21 PM Alastair Basden 
wrote:


Hi,

We have just upgraded Lustre servers from 2.12.2 on centos 7.6 to 2.12.3
on centos 7.7.

The OSSs are on top of zfs (0.7.13 as recommended), and we are using
3.10.0-1062.1.1.el7_lustre.x86_64

After the update, Lustre will no longer mount - and messages such as:
Jun  2 00:02:44 hostname kernel: LustreError: 158-c: Can't load module
'osd-zfs'
Jun  2 00:02:44 hostname kernel: LustreError: Skipped 875 previous similar
messages
Jun  2 00:02:44 hostname kernel: LustreError:
226253:0:(genops.c:397:class_newdev()) OBD: unknown type: osd-zfs
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_config.c:403:class_attach()) Cannot create device
lustfs-OST0006-osd of type osd-zfs : -19
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_config.c:403:class_attach()) Skipped 881 previous similar
messages
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:197:lustre_start_simple()) lustfs-OST0006-osd attach
error -19
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:197:lustre_start_simple()) Skipped 881 previous
similar messages
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount_server.c:1947:server_fill_super()) Unable to start osd
on lustfs-ost6/ost6: -19
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount_server.c:1947:server_fill_super()) Skipped 881 previous
similar messages
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:1608:lustre_fill_super()) Unable to mount  (-19)
Jun  2 00:02:44 hostname kernel: LustreError:
226265:0:(obd_mount.c:1608:lustre_fill_super()) Skipped 881 previous
similar messages
Jun  2 00:02:44 hostname kernel: LustreError:
226253:0:(genops.c:397:class_newdev()) Skipped 887 previous similar messages

Does anyone have any ideas?

Thanks,
Alastair.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org




--
--
Jeff Johnson
Co-Founder
Aeon Computing

jeff.john...@aeoncomputing.com
www.aeoncomputing.com
t: 858-412-3810 x1001   f: 858-412-3845
m: 619-204-9061

4170 Morena Boulevard, Suite C - San Diego, CA 92117

High-Performance Computing / Lustre Filesystems / Scale-out Storage


___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Centos 7.7 upgrade

Re: [lustre-discuss] patchless server vs. patched server

Re: [lustre-discuss] patchless server vs. patched server

Re: [lustre-discuss] Centos 7.7 upgrade

[lustre-discuss] how to mapping of RPC rate to bandwidth/IOPS?

Re: [lustre-discuss] Centos 7.7 upgrade

6 matches

Site Navigation

Mail list logo

Footer information