>>I don't know very much about using that specific switch with 10GbE and
>>Ceph. Having said that, Mellanox switches are pretty fast and often
>>used in HPC deployments. I'd expect it should be good from a
>>stability/performance point of view, at least on the IB side. If you
>>aren't familiar with IB, make sure to understand how it differs from
>>Ethernet, especially as it relates to network topology. It's cheap and
>>fast, but not always easy to setup if you've got a lot of existing
>>infrastructure.
Thanks Mark.
Yes, I'm not familiar with IB.
What I have read, is that ipoib is not good for routing, because it don't work
fast with low mtu (1500).
That's why mellanox ethernet switchs seem to be good, because they support
ethernet (so classic ip over ethernet) + infiniband over ethernet (rcoe).
From my understanding is different than pure infiniband switches.
(Ethernet is the priority for now)
my idea was to do something like
qemu-kvm hosts :-----2x10gbit----------> 2x melanox sx1012 <------2x
56gbit-----ceph nodes
|
|
|(ip)
|
external router
mixing traffic from guests vms (ip), and qemu-> ceph nodes (ip or rdma over
ethernet if one day ceph support it)
----- Mail original -----
De: "Mark Nelson" <[email protected]>
À: [email protected]
Envoyé: Lundi 2 Juin 2014 18:39:27
Objet: Re: [ceph-users] mellanox SX1012 ethernet|infiniband switch, somebody
use it for ceph ?
I don't know very much about using that specific switch with 10GbE and
Ceph. Having said that, Mellanox switches are pretty fast and often
used in HPC deployments. I'd expect it should be good from a
stability/performance point of view, at least on the IB side. If you
aren't familiar with IB, make sure to understand how it differs from
Ethernet, especially as it relates to network topology. It's cheap and
fast, but not always easy to setup if you've got a lot of existing
infrastructure.
Mark
On 06/02/2014 11:29 AM, Alexandre DERUMIER wrote:
> Hi,
> I'm looking for a fast and cheap 10gbe ethernet switch.
>
> I just found this:
>
> Mellanox SX1012
> http://www.mellanox.com/page/products_dyn?product_family=163&mtag=sx1012
>
> 48port 10Gbe | 12ports 46gbit for around 5000€.
>
> Seem that infiniband (roce) is also available.
>
>
> Does somebody use it for ceph ? if yes, what about stability|performance ?
>
> with comming rdma support in ceph, it seem to be the perfect solution (and
> price is very good).
>
>
> Regards,
>
> Alexandre Derumier
>
>
> _______________________________________________
> ceph-users mailing list
> [email protected]
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
