Re: [lustre-discuss] Lustre Installation Question: 158-c: Can't load module 'osd-zfs'
Did you install the Lustre server RPMs? Your email lists both server and client repositories. Are you using DKMS? Did you install and built lustre-zfs-dkms or lustre-all-dkms packages? It doesn’t appear that you have any Lustre server kernel modules loaded, which makes me suspect you didn’t install or built the server side RPMs or DKMS trees On Tue, Jun 27, 2023 at 21:41 Yao Weng via lustre-discuss < lustre-discuss@lists.lustre.org> wrote: > Hi: > I follow https://wiki.lustre.org/Installing_the_Lustre_Software to > install lustre. > > My kernel is > > $ uname -r > > 4.18.0-477.13.1.el8_8.x86_64 > > I install > > https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/server > > https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/client > > https://downloads.whamcloud.com/public/e2fsprogs/1.47.0.wc2/el8 > > > lsmod | grep lustre > > *lustre* 1048576 0 > > lmv 204800 1 *lustre* > > mdc 282624 1 *lustre* > > lov 344064 2 mdc,*lustre* > > ptlrpc 2490368 7 fld,osc,fid,lov,mdc,lmv,*lustre* > > obdclass 3633152 8 fld,osc,fid,ptlrpc,lov,mdc,lmv,*lustre* > > lnet 704512 7 osc,obdclass,ptlrpc,ksocklnd,lmv,*lustre* > > libcfs266240 11 > fld,lnet,osc,fid,obdclass,ptlrpc,ksocklnd,lov,mdc,lmv, > > *lustre*lsmod | grep zfs > > lsmod | grep zfs > > *zfs* 3887104 0 > > zunicode 335872 1 *zfs* > > zzstd 512000 1 *zfs* > > zlua 176128 1 *zfs* > > zavl 16384 1 *zfs* > > icp 319488 1 *zfs* > > zcommon 102400 2 *zfs*,icp > > znvpair90112 2 *zfs*,zcommon > > spl 114688 6 *zfs*,icp,zzstd,znvpair,zcommon,zavl > > > I am able to create mgs/mdt/ost > > But when I try to mount > > sudo mount.lustre lustre-mgs/mgs /lustre/mnt > > mount.lustre: mount lustre-mgs/mgs at /lustre/mnt failed: No such device > > Are the lustre modules loaded? > > Check /etc/modprobe.conf and /proc/filesystems > > dmesg gives these error > > [76783.604090] LustreError: 158-c: Can't load module 'osd-zfs' > > [76783.606174] LustreError: 223535:0:(genops.c:361:class_newdev()) OBD: > unknown type: osd-zfs > > [76783.607856] LustreError: 223535:0:(obd_config.c:620:class_attach()) > Cannot create device MGS-osd of type osd-zfs : -19 > > [76783.609805] LustreError: > 223535:0:(obd_mount.c:195:lustre_start_simple()) MGS-osd attach error -19 > > [76783.611426] LustreError: > 223535:0:(obd_mount_server.c:1993:server_fill_super()) Unable to start osd > on lustre-mgs/mgs: -19 > > [76783.613457] LustreError: 223535:0:(super25.c:183:lustre_fill_super()) > llite: Unable to mount : rc = -19 > > > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org > -- -- Jeff Johnson Co-Founder Aeon Computing jeff.john...@aeoncomputing.com www.aeoncomputing.com t: 858-412-3810 x1001 f: 858-412-3845 m: 619-204-9061 4170 Morena Boulevard, Suite C - San Diego, CA 92117 High-Performance Computing / Lustre Filesystems / Scale-out Storage ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Lustre Installation Question: 158-c: Can't load module 'osd-zfs'
Hi: I follow https://wiki.lustre.org/Installing_the_Lustre_Software to install lustre. My kernel is $ uname -r 4.18.0-477.13.1.el8_8.x86_64 I install https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/server https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/client https://downloads.whamcloud.com/public/e2fsprogs/1.47.0.wc2/el8 lsmod | grep lustre *lustre* 1048576 0 lmv 204800 1 *lustre* mdc 282624 1 *lustre* lov 344064 2 mdc,*lustre* ptlrpc 2490368 7 fld,osc,fid,lov,mdc,lmv,*lustre* obdclass 3633152 8 fld,osc,fid,ptlrpc,lov,mdc,lmv,*lustre* lnet 704512 7 osc,obdclass,ptlrpc,ksocklnd,lmv,*lustre* libcfs266240 11 fld,lnet,osc,fid,obdclass,ptlrpc,ksocklnd,lov,mdc,lmv, *lustre*lsmod | grep zfs lsmod | grep zfs *zfs* 3887104 0 zunicode 335872 1 *zfs* zzstd 512000 1 *zfs* zlua 176128 1 *zfs* zavl 16384 1 *zfs* icp 319488 1 *zfs* zcommon 102400 2 *zfs*,icp znvpair90112 2 *zfs*,zcommon spl 114688 6 *zfs*,icp,zzstd,znvpair,zcommon,zavl I am able to create mgs/mdt/ost But when I try to mount sudo mount.lustre lustre-mgs/mgs /lustre/mnt mount.lustre: mount lustre-mgs/mgs at /lustre/mnt failed: No such device Are the lustre modules loaded? Check /etc/modprobe.conf and /proc/filesystems dmesg gives these error [76783.604090] LustreError: 158-c: Can't load module 'osd-zfs' [76783.606174] LustreError: 223535:0:(genops.c:361:class_newdev()) OBD: unknown type: osd-zfs [76783.607856] LustreError: 223535:0:(obd_config.c:620:class_attach()) Cannot create device MGS-osd of type osd-zfs : -19 [76783.609805] LustreError: 223535:0:(obd_mount.c:195:lustre_start_simple()) MGS-osd attach error -19 [76783.611426] LustreError: 223535:0:(obd_mount_server.c:1993:server_fill_super()) Unable to start osd on lustre-mgs/mgs: -19 [76783.613457] LustreError: 223535:0:(super25.c:183:lustre_fill_super()) llite: Unable to mount : rc = -19 ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] Question about Install OFED with --with-nvmf
Hi Shuobin- If you peek inside the mlnxofedinstall script, you'll see that it specifically checks for /lustre/ kernels. Do you need to be using the _lustre kernel or would patchless suffice? -Laura ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Question about Install OFED with --with-nvmf
Hi~ I want to use RDMA between sever and storages. I try this and get error as follow: root@172-0-37-44 rdma]# nvme discover -t rdma -a 192.168.11.12 -5 4420 Failed to write to /dev/nvme-fabrics: Invalid argument log message in kernel : 26 20:44:22 172-0-37-44 kernel: nvme fabrics: no handler found for transport rdma. After investigation, it was found that the issue was due to the "OFED" driver not being installed with the "-- with nvmf" option. So I tried the following installation method: ./mlnxofedinstall --add-kernel-support --kmp --with-nvmf but I get this： WARNING: NVMEoF is not supported over kernel 4.18.0-425.3.1.el8_lustre.x86_64, will continue installation without it. so，How should I locate the problem？ Thanks！ ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
