Hi Josef,
on a cluster using pxe boot and automatic (re) installation of nodes, I
do not think you can do this with IPoIB on an infiniband interface.
On my cluster nodes I have:
- 1Gb ethernet network for OOB
- 10 or 25Gb ethernet for session, automatic deployment and management
- IB HDR100
Simms via slurm-users
*Date: *Monday, 26 February 2024 at 01:13
*To: *Dan Healy
*Cc: *slurm-users@lists.schedmd.com
*Subject: *[slurm-users] Re: Question about IB and Ethernet networks
Hello Daniel,
In my experience, if you have a high-speed interconnect such as
IB, yo
<https://azcollaboration.sharepoint.com/sites/CMU993> |
>
>
>
>
>
> *From: *Jason Simms via slurm-users
> *Date: *Monday, 26 February 2024 at 01:13
> *To: *Dan Healy
> *Cc: *slurm-users@lists.schedmd.com
> *Subject: *[slurm-users] Re: Question about IB and Et
, Analytics & AI and how we can support you by
visiting our Service
Catalogue<https://azcollaboration.sharepoint.com/sites/CMU993> |
From: Jason Simms via slurm-users
Date: Monday, 26 February 2024 at 01:13
To: Dan Healy
Cc: slurm-users@lists.schedmd.com
Subject: [slurm-users] Re: Questio
> Just looking for some feedback, please. Is this OK? Is there a better
way?
> I’m tempted to spec all new HPCs with only a high speed (200Gbps) IB
network,
Well you need Ethernet for OOB management (bmc/ipmi/ilo/whatever)
anyway.. or?
cheers
josef
On 25. 02. 24 21:12, Dan Healy via
Hello Daniel,
In my experience, if you have a high-speed interconnect such as IB, you
would do IPoIB. You would likely still have a "regular" Ethernet connection
for management purposes, and yes that means both an IB switch and an
Ethernet switch, but that switch doesn't have to be anything
