Hi,

I have lustre 1.6.1 configured with combined MGS/MDS and one OSS.
kernel version is 2.6.9-55.EL_lustre-1.6.1smp
Both OSS and MGS/MDS machines have configured two NID's

options lnet networks=tcp0(eth2),tcp1(eth1)

where
eth2 is in 10.143.0.0/16 network
eth1 is in 10.142.10.0/24 network

OSS
> lctl list_nids
[EMAIL PROTECTED]
[EMAIL PROTECTED]

MDS/MGS
> lctl list_nids
[EMAIL PROTECTED]
[EMAIL PROTECTED]

Client nodes have two interfaces but only one is meant to be used. I have following line in /etc/modprobe.conf
options lnet networks=tcp0(eth1)

eth0 - management interface which is not configured for lustre on this particular client node, IP address: 10.142.4.25 netmask 255.255.255.0 eth1 - data interface configured with lnet, IP address 10.143.4.25 netmask 255.255.0.0

When I do on client node:
> lctl list_nids
[EMAIL PROTECTED]
Which is wrong address.
However
> lctl which_nid node-d25
[EMAIL PROTECTED]
This is right address.

I have following entry in /etc/fstab
[EMAIL PROTECTED]:/home-md /home lustre defaults,nosuid,nodev 0 0

Node is mounting /home correctly and I can write/read to/from lustre without any problem. However I don't understand why list_nids shows wrong NID. Also if I umount /home on the client, in MGS/MDS syslog I see wrong address for umounted client. Aug 20 15:52:25 storage03 kernel: Lustre: MGS: haven't heard from client 8b3ee19c-ffe8-091c-b504-bf2082cca83e (at [EMAIL PROTECTED]) in 227 seconds. I think it's dead, and I am evicting it. Aug 20 17:51:58 storage03 kernel: Lustre: MGS: haven't heard from client 33aaa972-83b9-cf56-a72e-1907d1e3641e (at [EMAIL PROTECTED]) in 227 seconds. I think it's dead, and I am evicting it. Aug 20 17:51:58 storage03 kernel: Lustre: Skipped 1 previous similar message

Also there is no physical connection between ordinary clients and MGS/ MDS, OSS on 10.142.10.0/24 network

I will appreciate if someone can help me find logical explanation for my problem.

Regards

Wojciech Turek
>


Mr Wojciech Turek
Assistant System Manager
University of Cambridge
High Performance Computing service
email: [EMAIL PROTECTED]
tel. +441223763517



_______________________________________________
Lustre-discuss mailing list
[email protected]
https://mail.clusterfs.com/mailman/listinfo/lustre-discuss

Reply via email to