I believe this should be a fully working solution. I see no problem enabling RDMA between a subset of nodes -- just disable verbsRdma on the nodes you want to use plain IP.
-jf On Thu, Dec 9, 2021 at 11:04 AM Walter Sklenka <[email protected]> wrote: > Dear spectrum scale users! > > May I ask you a design question? > > We have an IB environment which is very mixed at the moment ( connecX3 … > connect-X6 with FDR , even FDR10 and with arrive of ESS5000SC7 now also > HDR100 and HDR switches. We still have some big troubles in this fabric > when using RDMA , a case at Mellanox and IBM is open . > > The environment has 3 old Building blocks 2xESSGL6 and 1x GL4 , from where > we want to migrate the data to ess5000 , ( mmdelvdisk +qos) > > Due to the current problems with RDMA we though eventually we could try a > workaround : > > If you are interested there is Maybe you can find the attachment ? > > We build 2 separate fabrics , the ess-IO servers attached to both blue and > green and all other cluster members and all remote clusters only to fabric > blue > > The daemon interfaces (IPoIP) are on fabric blue > > > > It is the aim to setup rdma only on the ess-ioServers in the fabric green > , in the blue we must use IPoIB (tcp) > > Do you think datamigration would work between ess01,ess02,… to ess07,ess08 > via RDMA ? > > Or is it principally not possible to make a rdma network only for a > subset of a cluster (though this subset would be reachable via other > fabric) ? > > > > Thank you very much for any input ! > > Best regards walter > > > > > > > > Mit freundlichen Grüßen > *Walter Sklenka* > *Technical Consultant* > > > > EDV-Design Informationstechnologie GmbH > Giefinggasse 6/1/2, A-1210 Wien > Tel: +43 1 29 22 165-31 > Fax: +43 1 29 22 165-90 > E-Mail: [email protected] > Internet: www.edv-design.at > > > _______________________________________________ > gpfsug-discuss mailing list > gpfsug-discuss at spectrumscale.org > http://gpfsug.org/mailman/listinfo/gpfsug-discuss >
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
