Hi
This Is My Config
mmlsconfig | grep verbsRdma
verbsRdma enable
mmlsconfig | grep verbsPorts
verbsPorts mlx4_0/1 mlx4_0/2 mlx4_1/1 mlx4_1/2
ibstat | grep -E "CA|Port"
CA 'mlx4_0'
CA type: MT4099
Port 1:
Port GUID: 0x0002c903001a1571
Port 2:
Port GUID: 0x0002c903001a1572
CA 'mlx4_1'
CA type: MT4099
Port 1:
Port GUID: 0x0002c903001a15c1
Port 2:
Port GUID: 0x0002c903001a15c2
ethtool ib0 |grep "Link detected"
Link detected: yes
ethtool ib1 |grep "Link detected"
Link detected: yes
ethtool ib2 |grep "Link detected"
Link detected: yes
ethtool ib3 |grep "Link detected"
Link detected: yes
ifconfig ib0 |grep inet
inet 192.168.100.3 netmask 255.255.255.0 broadcast 192.168.100.255
ifconfig ib1 |grep inet
Infiniband hardware address can be incorrect! Please read BUGS section in
ifconfig(8).
ifconfig ib2 |grep inet
Infiniband hardware address can be incorrect! Please read BUGS section in
ifconfig(8).
ifconfig ib3 |grep inet
Infiniband hardware address can be incorrect! Please read BUGS section in
ifconfig(8).
ip addr show ib1
8: ib1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65520 qdisc mq state UP qlen
1024
link/infiniband
a0:00:03:00:fe:80:00:00:00:00:00:00:00:02:c9:03:00:1a:15:72 brd
00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
9: ib2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65520 qdisc mq state UP qlen
1024
link/infiniband
a0:00:02:20:fe:80:00:00:00:00:00:00:00:02:c9:03:00:1a:15:c1 brd
00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
10: ib3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65520 qdisc mq state UP
qlen 1024
link/infiniband
a0:00:03:00:fe:80:00:00:00:00:00:00:00:02:c9:03:00:1a:15:c2 brd
00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
Le Thu, 21 Dec 2017 13:00:01 +0100,
<[email protected]> a écrit:
Send gpfsug-discuss mailing list submissions to
[email protected]
To subscribe or unsubscribe via the World Wide Web, visit
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
or, via email, send a message with subject or body 'help' to
[email protected]
You can reach the person managing the list at
[email protected]
When replying, please edit your Subject line so it is more specific
than "Re: Contents of gpfsug-discuss digest..."
Today's Topics:
1. Re: more than one mlx connectx-4 adapter in same host
(Frank Kraemer)
----------------------------------------------------------------------
Message: 1
Date: Thu, 21 Dec 2017 08:07:24 +0100
From: "Frank Kraemer" <[email protected]>
To: [email protected]
Subject: Re: [gpfsug-discuss] more than one mlx connectx-4 adapter in
same host
Message-ID:
<ofe99af1b2.2cca57a0-onc12581fd.00272158-c12581fd.00272...@notes.na.collabserv.com>
Content-Type: text/plain; charset="us-ascii"
David,
We're trying to get 40 gbe connection between Mellanox switches and
Cisco
switches down at the other end of the machine room
The BiDi part seems to be the best given about 30m run on multimode.
However Mellanox support says it's not supported.
Want to use this to get close to IB speeds for GPFS on nodes that aren't
on the IB fabric.
Does anyone have any luck getting 40 or 100 gig at 20-30m when the
switches are different brands?
maybe that's a good reason to get in contact with the team from
Interoptic.
They claim a good expertise for these kind of problems - feedback is
good.
http://packetpushers.net/podcast/podcasts/show-360-all-about-optics-interoptic-sponsored/
https://interoptic.com/
Frank Kraemer
IBM Consulting IT Specialist / Client Technical Architect
Am Weiher 24, 65451 Kelsterbach
mailto:[email protected]
voice: +49-(0)171-3043699 / +4970342741078
IBM Germany
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20171221/31aeae52/attachment-0001.html>
------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
End of gpfsug-discuss Digest, Vol 71, Issue 49
**********************************************
--
Utilisant le logiciel de courrier d'Opera : http://www.opera.com/mail/
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
