Hi Did u upgrade OFED version in some of the servers to v5.x ?
Regards Yaron Daniel 94 Em Ha'Moshavot Rd Lab Services Consultant – Storage and Cloud Petach Tiqva, 49527 IBM Global Markets, Systems HW Sales Israel Phone: +972-3-916-5672 Fax: +972-3-916-5672 Mobile: +972-52-8395593 e-mail: [email protected] Webex: https://ibm.webex.com/meet/yard IBM Israel From: "Wahl, Edward" <[email protected]> To: "gpfsug main discussion list" <[email protected]> Date: 07/09/2021 10:21 PM Subject: [EXTERNAL] Re: [gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR Sent by: [email protected] >-E- Link: ib2s5/U1/P6<-->node152/U1/P1 - Unexpected actual link speed 10 This looks like a bad cable (or port). Trying re-seating the cable on both ends, or replacing it to get to full Link Speed. Re-run ibdiagnet to confirm or use something like 'ibportstate' to check it. Ed Wahl OSC -----Original Message----- From: [email protected] <[email protected]> On Behalf Of Iban Cabrillo Sent: Friday, July 9, 2021 11:57 AM To: gpfsug-discuss <[email protected]> Subject: Re: [gpfsug-discuss] RDMA write error IBV_WC_RETRY_EXC_ERR Thanks both of you, for your fast answer, I just restart the server with the biggest waiters, and seems that every thing is working now Using de ib diag command I see these errors: -E- lid=0x0380 dev=4115 gpfs03/U1/P1 Performance Monitor counter : Value port_xmit_discard : 65535 (overflow) -E- lid=0x0ed0 dev=4115 gpfs01/U2/P1 Performance Monitor counter : Value port_xmit_discard : 65535 (overflow) ...... -E- Link: ib2s5/U1/P6<-->node152/U1/P1 - Unexpected actual link speed 10 (enable_speed1="2.5 or 5 or 10 or FDR10", enable_speed2="2.5 or 5 or 10 or FDR10" ther efore final speed should be FDR10) Regards, I _______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
