Re: Unrecognized Inifiniband HCA

2018-05-10 Thread Justin Clift

On 2018-05-10 10:21, Grzegorz Junka wrote:

On 08/05/2018 23:41, Justin Clift wrote:


That's probably a ConnectX (series 1) Mellanox card.  Those can 
operate in

either Infiniband mode, or Ethernet mode.

Which mode are you wanting it to run in? :)

As a thought, the FreeBSD wiki page has a bit of info:

  https://wiki.freebsd.org/InfiniBand

For that card to be recognised at all, it'll need the mlx4 driver(s) 
to load.


I don't remember the exact one off hand (it's been a while), but some 
searching

online for mlx4 and FreeBSD should turn up the right bits.


Many thanks Justin. This is the first time I am hearing about an
Infiniband card operating in Ethernet mode. These cards come with two
CX4/SFF 8470 ports. It's not possible to connect standard Ethernet
cables that I know of (not even SFP modules). Do you mean that they
can operate in Ethernet mode over the CX4 cable?


Yep. :)

Back in the day when these cards were current tech, CX4 was an 
acceptable

connector for 10GbE.  The Infiniband switches from that era (that I had
access to) were mostly Infiniband only though.

But 10GbE CX4 switches did exist, and can still be found reasonably 
cheaply

on Ebay.  eg:

  * HP ProCurve 6 port CX4 10GBe switch
https://www.ebay.com/itm/152232294328

  * HP ProCurve 48 port 1GbE switch, with 2x 10GbE CX4 ports on the back
https://www.ebay.com/itm/281899832599

One of the good things about those HP ProCurve switches... being 
enterprise

gear they just keep working.  For Years.

From memory, HP still releases firmware security updates for them (for
free) to this day. Unlike (say) Cisco. ;)

Note - As a data point, FreeNAS (based on FreeBSD) includes the 10/40GbE 
driver

for these cards by default.  With FreeNAS they work as 10GbE "out of the
box". :D

Hopefully that helps. :)

+ Justin
___
freebsd-net@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"


Re: Unrecognized Inifiniband HCA

2018-05-08 Thread Justin Clift

On 2018-05-08 21:59, Grzegorz Junka wrote:

Hi All,

pciconf -lv

gives me

none1@pci0:3:0:0:   class=0x0c0600 card=0x000315b3 chip=0x634015b3
rev=0xa0 hdr=0x00
    vendor = 'Mellanox Technologies'
    device = 'MT25408 [ConnectX VPI - IB SDR / 10GigE]'
    class  = serial bus

Does it mean that my card is unrecognized? It supposed to be 10GB x 2
Infiniband PCI-E HCA 500EX-D Dual-Port Card Mellanox Firmware.
Currently the card doesn't show when doing ifconfig. What should I do
to have the proper device name instead of none1 or for the card to
appear in ifconfig?

# kldstat
Id Refs Address    Size Name
 1   28 0x8020 1f67a88  kernel
 2    1 0x82169000 316708   zfs.ko
 3    2 0x8248 cb78 opensolaris.ko
 4    1 0x8248d000 42c28    mps.ko
 5    1 0x82621000 bdb0 if_lagg.ko
 6    1 0x8262d000 3650 ums.ko
 7    1 0x82631000 6679 nullfs.ko
 8    1 0x82638000 bdfe unionfs.ko
 9    2 0x82644000 2094f    mlx5.ko
10    2 0x82665000 103e1    linuxkpi.ko
11    1 0x82676000 15965    mlx5en.ko


That's probably a ConnectX (series 1) Mellanox card.  Those can operate 
in

either Infiniband mode, or Ethernet mode.

Which mode are you wanting it to run in? :)

As a thought, the FreeBSD wiki page has a bit of info:

  https://wiki.freebsd.org/InfiniBand

For that card to be recognised at all, it'll need the mlx4 driver(s) to 
load.


I don't remember the exact one off hand (it's been a while), but some 
searching

online for mlx4 and FreeBSD should turn up the right bits.

Hope that helps. :)

Regards and best wishes,

Justin Clift

___
freebsd-net@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscr...@freebsd.org"