Hello, on a setup with o2ib and ethernet configured on both, lustre servers and clients I'd expect that unplugging the infiniband cable on one of the OSSes would lead the client to switch over to ethernet and continue I/O. Unfortunately this doesn't happen, the client I/O stalls and continues only after the IB cable is plugged back.
Is there anything wrong with the setup? It's with pairwise failover servers, so maybe that's part of the problem? Is the order of failnode arguments correct? Here's what we have: (sorry for the many details...) MGS/MGT are mounted on the same node: Target: MGS Index: unassigned Lustre FS: lustre Mount type: ldiskfs Flags: 0x174 (MGS needs_index first_time update writeconf ) Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr Parameters: [EMAIL PROTECTED],[EMAIL PROTECTED],[EMAIL PROTECTED],[EMAIL PROTECTED] [EMAIL PROTECTED],[EMAIL PROTECTED],[EMAIL PROTECTED],[EMAIL PROTECTED] Target: lustre-MDT0000 Index: 0 Lustre FS: lustre Mount type: ldiskfs Flags: 0x1 (MDT ) Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr Parameters: [EMAIL PROTECTED],[EMAIL PROTECTED],[EMAIL PROTECTED],[EMAIL PROTECTED] [EMAIL PROTECTED],[EMAIL PROTECTED] mdt.group_upcall=/usr/sbin/l_getgroups OST: parameters were rewritten with tunefs.lustre: tunefs.lustre --ost --erase-param [EMAIL PROTECTED],[EMAIL PROTECTED]:[EMAIL PROTECTED],[EMAIL PROTECTED] [EMAIL PROTECTED],[EMAIL PROTECTED] --writeconf /dev/mpath/ost100 Client notices the failed OST path: # lfs check servers lustre-MDT0000-mdc-ffff810007107000 active. error: check 'lustre-OST0000-osc-ffff810007107000': Connection timed out (110) but tries to connect to the failover OSS partner instead of trying the other network: netptune121: LustreError: 11-0: an error occurred while communicating with [EMAIL PROTECTED] The ost_connect operation failed with -19 doss2: LustreError: 137-5: UUID 'lustre-OST0000_UUID' is not available for connect (no target) Thanks in advance for any hint... Best regards, Erich <br><br> _______________________________________________ Lustre-discuss mailing list [email protected] http://lists.lustre.org/mailman/listinfo/lustre-discuss
