On Fri, Jul 31, 2015 at 7:49 AM, Matt Benjamin <mbenja...@redhat.com> wrote: > Hi Neo, > > On our formerly-internal firefly-based branch, what we did was create > additional Messenger > instances ad infinitum, which at least let you do this, but it's not what > anybody wanted for > upstream or long-term. What's upstream now doesn't let you IIRC describe > that. The rdma_local > parameter like you say is insufficient (and actually a hack). > > What we plan to do (and have in progress) is extending work Sage started on > wip-address, which > will enable multi-homing and identify instances by their transport type(s). > We might put more > information there to help with future topologies. Improved configuration > language to let you > describe your desired network setup would be packaged with that.
This is awesome! could you please point me to your WIP branch ? Also please let know if I could help speed up the dev/test process ? -Neo > > The plan is that an improved situation might arrive as early as J. If we > need an interim method, > now would be a good time to start discussion. > > Matt > > ----- Original Message ----- > From: "kernel neophyte" <neophyte.hacker...@gmail.com> > To: v...@mellanox.com, "raju kurunkad" <raju.kurun...@sandisk.com>, > ceph-devel@vger.kernel.org > Sent: Thursday, July 30, 2015 11:21:06 PM > Subject: Cluster Network & Public Network w.r.t XIO ? > > Hi Vu, Raju, > > I am trying to bring up ceph cluster on a powerful dell server with > two 40Gbe ROCEv2 NIC. > > I have assigned one as my cluster network (would prefer all osd > communications happen on that) and have assigned one as my public n/w. > this works fine for simple messenger case. (ofcourse no rdma) > > but when I try to bring this up on XIO, this gets very complicated, as > in how do I specify two RDMA_LOCAL ? one for cluster n/w and other > for public ? can choose XIO for client to osd communication and simple > for cluster n/w ? > > any thoughts ? > > Thanks, > Neo > -- > To unsubscribe from this list: send the line "unsubscribe ceph-devel" in > the body of a message to majord...@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html -- To unsubscribe from this list: send the line "unsubscribe ceph-devel" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
