Hello Tung-Han, ZFS 0.7.11 doesn’t compile cleanly with Lustre, yet.
There’s a ticket for adding ZFS 0.7.11 support to lustre: https://jira.whamcloud.com/browse/LU-11393 It has patches for master (pre-2.12) and a separate patch for 2.10. — Nathaniel Clark <[email protected]<mailto:[email protected]>> Senior Engineer Whamcloud / DDN On Sep 24, 2018, at 2:15 PM, Tung-Han Hsieh <[email protected]<mailto:[email protected]>> wrote: Dear All, I am trying to install Lustre version 2.10.5 with ZFS-0.7.11 from source code. After compilation and installation, I tried to load the "lustre" module, but encountered the following error: # modprobe lustre could not load module 'lustre': no such device My procedure of installation is the following: 1. Compile vanilla kernel 3.12.72 downloaded from: https://mirrors.edge.kernel.org/pub/linux/kernel/v3.x/linux-3.12.72.tar.gz 2. Compile spl-0.7.11 downloaded from: https://github.com/zfsonlinux/zfs/releases/download/zfs-0.7.11/spl-0.7.11.tar.gz with the following steps: # ./configure --prefix=/opt/lustre --with-linux=/path/to/linux-3.12.72 # make # make install 3. Compile zfs-0.7.11 downloaded from: https://github.com/zfsonlinux/zfs/releases/download/zfs-0.7.11/zfs-0.7.11.tar.gz with the following steps: # ./configure --prefix=/opt/lustre \ --with-linux=/path/to/linux-3.12.72 \ --with-spl=/path/to/spl-0.7.11 # make # make install 4. Compile lustre downloaded from: https://downloads.whamcloud.com/public/lustre/lustre-2.10.5/sles12sp3/client/SRPMS/lustre-2.10.5-1.src.rpm Then I unpack the SRPM by the command: # rpm2cpio lustre-2.10.5-1.src.rpm | cpio --extract --make-directories and compile it by the following: # ./configure --prefix=/opt/lustre \ --with-linux=/path/to/linux-3.12.72 \ --with-spl=/path/to/spl-0.7.11 \ --with-zfs=/path/to/zfs-0.7.11 \ --with-o2ib=no \ --disable-ldiskfs # make # make install 5. I have made sure the following settings and utilities are correct: - PATH contains /opt/lustre/bin and /opt/lustre/sbin - /sbin/mount.lustre exists. - /sbin/mount.zfs exists. - /usr/sbin/l_getidentity exists. - /usr/sbin/ko2iblnd-probe exists. - /etc/modprobe.d/lustre.conf contains: options lnet networks=tcp - /etc/modprobe.d/ko2iblnd.conf contains: alias ko2iblnd-opa ko2iblnd options ko2iblnd-opa peer_credits=128 peer_credits_hiw=64 credits=1024 concurrent_sends=256 ntx=2048 map_on_demand=32 fmr_pool_size=2048 fmr_flush_trigger=512 fmr_cache=1 install ko2iblnd /usr/sbin/ko2iblnd-probe Then I tried to run "modprobe lustre", it says "no such device" error. I tried to replace Lustre-2.10.5 by Lustre-2.9 downloaded from: https://downloads.whamcloud.com/public/lustre/lustre-2.9.0/sles12sp1/client/SRPMS/lustre-2.9.0-1.src.rpm and proceed exactly the same installation steps. Everything works fine. Could anyone suggest me what have I missed for lustre-2.10.5 ? Or suggest me how to debug. Thanks very much. T.H.Hsieh _______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
_______________________________________________ lustre-discuss mailing list [email protected] http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
