Hi,
hooks are only needed to set connected mode and the correct MTU on the
infiniband link. The problem is bound to the host networking setup procedure.

Here's the hooks:

cat /usr/libexec/vdsm/hooks/before_vdsm_start/10_set_ib0_connected_mode
#!/bin/sh

echo Setting IB connected mode
echo connected > /sys/class/net/ib0/mode
sleep 3
MODE=$(cat /sys/class/net/ib0/mode)
RATE=$(cat /sys/class/infiniband/mlx4_0/ports/1/rate)
echo ib0 is now in $MODE mode with rate $RATE

cat /usr/libexec/vdsm/hooks/after_network_setup/10_set_ib0_connected_mode
#!/bin/sh

echo connected > /sys/class/net/ib0/mode
sleep 3
ip link set mtu 65520 dev ib0

As you can see they work:

[root@node]# systemctl restart vdsmd
[root@node]# ip l sh dev ib0
5: ib0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 65520 qdisc pfifo_fast state UP
mode DEFAULT qlen 256
    link/infiniband 80:00:02:08:fe:80:00:00:00:00:00:00:00:02:c9:03:00:0a:08:c7
brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff
[root@node]# cat /sys/class/net/ib0/mode
connected

In networks tab in the admin portal I've defined a logical network ibstorage
with the correct MTU.

When I attempt to setup host networking vdsm generates the ibstorage device and
a config to bridge it with ib0 but ib0 is not an ethernet device so it cannot be
bridged. With 3.6 the configuration was directly applied to ib0 without any 
bridge.

Thanks

On 07/04/2016 02:58 PM, Yevgeny Zaspitsky wrote:
> Hello,
> 
> What's "couple of vdsm hooks"? Could you provide the source code of those?
> 
> Regards,
> Yevgeny
> 
> On Mon, Jul 4, 2016 at 1:43 PM, Giorgio Biacchi <gior...@di.unimi.it
> <mailto:gior...@di.unimi.it>> wrote:
> 
>     Hi list,
>     I'm trying a test installation of the new Ovirt Node Image and engine 
> before
>     upgrading my 3.6 installation.
> 
>     In my current environment every hypervisor access the NFS shared data 
> domain via
>     infiniband. With a couple of vdsm hooks I was able to set the infiniband 
> link in
>     connected mode and set a MTU of 65520. In my case the infiniband link is 
> used as
>     a common NIC, I don't use RDMA, only IP over infiniband to access the data
>     domain.
> 
>     Now, when I attempt to setup host networking, the system try to bridge the
>     connection "ibstorage" (defined in networks tab) with ib0 device. But a 
> non
>     ethernet device cannot be bridged that way and host networking setup 
> fails.
> 
>     Any idea or suggestion? With 3.6 (node and engine) all was fine.
> 
>     Thanks
>     --
>     gb
> 
>     PGP Key: http://pgp.mit.edu/
>     Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34
>     _______________________________________________
>     Users mailing list
>     Users@ovirt.org <mailto:Users@ovirt.org>
>     http://lists.ovirt.org/mailman/listinfo/users
> 
> 

-- 
gb

PGP Key: http://pgp.mit.edu/
Primary key fingerprint: C510 0765 943E EBED A4F2 69D3 16CC DC90 B9CB 0F34
_______________________________________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Reply via email to