Hi Ray,

I'll throw my 0.02 into the ring:

There are known issues with the Truescale kernel driver in redhat/centos/scilinux 6.6. You should try kernel 2.6.32-504.23.4 or newer. Some details of the bug are in LU-6698 and RHSA-2015-1081.

Further, lustre 2.7+ now applies performance tuning parameters when installed with the ko2iblnd kernel driver (LU-6735). The tuning parameters are likely incompatible with older infiniband HCA adapters. Our experience is they don't work for Truescale IB adapters.

If you are running lustre 2.5 servers and lustre 2.7+ clients these tuning parameters likely will prevent your clients from mounting.

Fortunately you can disable the tuning parameters by modifying the ko2iblnd modprobe config file. On our RHEL6 clients, we removed the line "install ko2iblnd /usr/sbin/ko2iblnd-probe" from file /etc/modprobe.d/ko2iblnd.conf

If you are running 2.7+ servers and 2.7+ clients then I believe this is not an issue (LU-3322).

regards,
chris hunter
[email protected]




Le 03-12-2015 16:13, Ray Muno a ?crit :
I am trying to set up a test deployment of Lustre 2.7.

I pulled RPMS from 
https://urldefense.proofpoint.com/v2/url?u=http-3A__lustre.org_download_&d=AwICAg&c=-dg2m7zWuuDZ0MUcV7Sdqw&r=d_G2h_sZYG4xtHMeKo8QgjDmOcMVdQvYgM-5Dri1AOY&m=rDHVyPCaAhbdHPi5Gl5kTqo8s7e7Z84-RWqvgtBRrWI&s=3CPtgQCox02zqp-KhoiiSt5NJV0SoIiSLCIqRQHONdk&e=
  and installed them
on a
set of server running Scientific Linux 6.6 which seems to be a proper
OS for deployment.  Everything installs and I can format the
filesystems on the MDS (1) and OSS (2) servers. When I try and mount
the OST files systems, I get communication errors. I can "lctl ping"
the servers from each other, but cannot establish communication
between the MDS and OSS.

The installation is on servers connected over Infiniband (Qlogic DDR
4X).

_______________________________________________
lustre-discuss mailing list
[email protected]
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Reply via email to