Thank Jeff: My installation steps are step1: set local software provision ( https://wiki.lustre.org/Installing_the_Lustre_Software) I download all rpm from
https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/server https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/client https://downloads.whamcloud.com/public/e2fsprogs/1.47.0.wc2/el8 step 2: Install the Lustre e2fsprogs distribution: sudo yum --nogpgcheck --disablerepo=* --enablerepo=e2fsprogs-wc install e2fsprogs step 3Install EPEL repository support: sudo yum -y install epel-release step 4 Follow the instructions from the ZFS on Linux project <https://openzfs.github.io/openzfs-docs/Getting%20Started/RHEL-based%20distro/index.html> to install the ZFS YUM repository definition. Use the DKMS package repository (the default) sudo dnf install https://zfsonlinux.org/epel/zfs-release-2-3$(rpm --eval "%{dist}").noarch.rpm step 5 Install the Lustre-patched kernel packages. Ensure that the Lustre repository is picked for the kernel packages, by disabling the OS repos: sudo yum --nogpgcheck --disablerepo=base,extras,updates \ --enablerepo=lustre-server install \ kernel \ kernel-devel \ kernel-headers \ kernel-tools \ kernel-tools-libs \ kernel-tools-libs-devel step 6 Generate a persistent hostid on the machine, if one does not already exist. This is needed to help protect ZFS zpools against simultaneous imports on multiple servers. For example: hid=`[ -f /etc/hostid ] && od -An -tx /etc/hostid|sed 's/ //g'` [ "$hid" = `hostid` ] || genhostid step 7 reboot step 8 install lustre and zfs sudo yum --skip-broken --nogpgcheck --enablerepo=lustre-server install \ lustre-dkms \ lustre-osd-zfs-mount \ lustre \ lustre-resource-agents \ lustre-dkms \ zfs step 9 Load the Lustre and ZFS kernel modules to verify that the software has installed correctly sudo modprobe -v zfs sudo modprobe -v lustre On Wed, Jun 28, 2023 at 1:04 AM Jeff Johnson <[email protected]> wrote: > Did you install the Lustre server RPMs? > Your email lists both server and client repositories. > > Are you using DKMS? Did you install and built lustre-zfs-dkms or > lustre-all-dkms packages? > > It doesn’t appear that you have any Lustre server kernel modules loaded, > which makes me suspect you didn’t install or built the server side RPMs or > DKMS trees > > > > On Tue, Jun 27, 2023 at 21:41 Yao Weng via lustre-discuss < > [email protected]> wrote: > >> Hi: >> I follow https://wiki.lustre.org/Installing_the_Lustre_Software to >> install lustre. >> >> My kernel is >> >> $ uname -r >> >> 4.18.0-477.13.1.el8_8.x86_64 >> >> I install >> >> https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/server >> >> https://downloads.whamcloud.com/public/lustre/lustre-2.15.3/el8.8/client >> >> https://downloads.whamcloud.com/public/e2fsprogs/1.47.0.wc2/el8 >> >> >> lsmod | grep lustre >> >> *lustre* 1048576 0 >> >> lmv 204800 1 *lustre* >> >> mdc 282624 1 *lustre* >> >> lov 344064 2 mdc,*lustre* >> >> ptlrpc 2490368 7 fld,osc,fid,lov,mdc,lmv,*lustre* >> >> obdclass 3633152 8 fld,osc,fid,ptlrpc,lov,mdc,lmv,*lustre* >> >> lnet 704512 7 osc,obdclass,ptlrpc,ksocklnd,lmv,*lustre* >> >> libcfs 266240 11 >> fld,lnet,osc,fid,obdclass,ptlrpc,ksocklnd,lov,mdc,lmv, >> >> *lustre*lsmod | grep zfs >> >> lsmod | grep zfs >> >> *zfs* 3887104 0 >> >> zunicode 335872 1 *zfs* >> >> zzstd 512000 1 *zfs* >> >> zlua 176128 1 *zfs* >> >> zavl 16384 1 *zfs* >> >> icp 319488 1 *zfs* >> >> zcommon 102400 2 *zfs*,icp >> >> znvpair 90112 2 *zfs*,zcommon >> >> spl 114688 6 *zfs*,icp,zzstd,znvpair,zcommon,zavl >> >> >> I am able to create mgs/mdt/ost >> >> But when I try to mount >> >> sudo mount.lustre lustre-mgs/mgs /lustre/mnt >> >> mount.lustre: mount lustre-mgs/mgs at /lustre/mnt failed: No such device >> >> Are the lustre modules loaded? >> >> Check /etc/modprobe.conf and /proc/filesystems >> >> dmesg gives these error >> >> [76783.604090] LustreError: 158-c: Can't load module 'osd-zfs' >> >> [76783.606174] LustreError: 223535:0:(genops.c:361:class_newdev()) OBD: >> unknown type: osd-zfs >> >> [76783.607856] LustreError: 223535:0:(obd_config.c:620:class_attach()) >> Cannot create device MGS-osd of type osd-zfs : -19 >> >> [76783.609805] LustreError: >> 223535:0:(obd_mount.c:195:lustre_start_simple()) MGS-osd attach error -19 >> >> [76783.611426] LustreError: >> 223535:0:(obd_mount_server.c:1993:server_fill_super()) Unable to start osd >> on lustre-mgs/mgs: -19 >> >> [76783.613457] LustreError: 223535:0:(super25.c:183:lustre_fill_super()) >> llite: Unable to mount <unknown>: rc = -19 >> >> >> _______________________________________________ >> lustre-discuss mailing list >> [email protected] >> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org >> > -- > ------------------------------ > Jeff Johnson > Co-Founder > Aeon Computing > > [email protected] > www.aeoncomputing.com > t: 858-412-3810 x1001 f: 858-412-3845 > m: 619-204-9061 > > 4170 Morena Boulevard, Suite C - San Diego, CA 92117 > > High-Performance Computing / Lustre Filesystems / Scale-out Storage >
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
