;>> therefore
>>> > there is no need to go to Ethernet for that
>>>
>>> > - File system wise, you can have IB file system, and connect
>>> > directly to IB system.
>>>
>>> > - Depends on the distance, yo
dvantages are with much lower latency (switches alone
>> are 3X
>> > lower latency), cost effectiveness (for the same speed, IB switches are
>> > more cost effective than Ethernet) and the In-Network Computing engines
>> > (MPI reduction operations, Tag Matchin
Matching run on the network)
>
> > If you need help, feel free to contact directly.
> >
> > Regards,
> > Gilad Shainer
> >
> > From: Beowulf [mailto:beowulf-boun...@beowulf.org] On Behalf Of John
> Hearns
> > Sent: Thursday, November 26, 2020 3:42 AM
u need help, feel free to contact directly.
>
> Regards,
> Gilad Shainer
>
> From: Beowulf [mailto:beowulf-boun...@beowulf.org] On Behalf Of John Hearns
> Sent: Thursday, November 26, 2020 3:42 AM
> To: Jörg Saßmannshausen ; Beowulf Mailing
> List
Subject: Re: [Beowulf]
Hi Chris,
that is basically what we are planning to do: using RoCE v2 for the Lnet
routers and use InfiniBand for the HPC part of the cluster. As I have
mentioned before, the problem is that the existing Lustre will be in a
different location to where the new facility will be. At least that
> >
> > If you need help, feel free to contact directly.
> >
> >
> >
> > Regards,
> >
> > Gilad Shainer
> >
> >
> >
> > *From:* Beowulf [mailto:beowulf-boun...@beowulf.org] *On Behalf Of *John
> > Hearns
>
On Thursday, 26 November 2020 3:14:05 AM PST Jörg Saßmannshausen wrote:
> Now, traditionally I would say that we are going for InfiniBand. However,
> for reasons I don't want to go into right now, our existing file storage
> (Lustre) will be in a different location. Thus, we decided to go for
, feel free to contact directly.
>
>
>
> Regards,
>
> Gilad Shainer
>
>
>
> *From:* Beowulf [mailto:beowulf-boun...@beowulf.org] *On Behalf Of *John
> Hearns
> *Sent:* Thursday, November 26, 2020 3:42 AM
> *To:* Jörg Saßmannshausen ; Beowulf
> Mailing List
>
To: Jörg Saßmannshausen ; Beowulf Mailing List
Subject: Re: [Beowulf] RoCE vs. InfiniBand
External email: Use caution opening links or attachments
Jorg, I think I might know where the Lustre storage is !
It is possible to install storage routers, so you could route between ethernet
and infiniband
Jorg, I think I might know where the Lustre storage is !
It is possible to install storage routers, so you could route between
ethernet and infiniband.
It is also worth saying that Mellanox have Metro Infiniband switches -
though I do not think they go as far as the west of London!
Seriously
10 matches
Mail list logo
