Most people forget that it’s not the sequential performance that counts.. it’s the 4K random performance and even for NVMe-SSD’s, a redundant 10G connection between the hosts will be absolutely sufficient.
However split it up in pairs so the one pair takes care of ceph/vsan, the other of the client traffic. Chris Sent from my iPhone > On 12. Dec 2018, at 09:07, Andrija Panic <andrija.pa...@gmail.com> wrote: > > Well, that requires some math I guess, but certainly not less than 10Gbps... > > You need to be aware of client vs replication traffic between storage nodes > (hosts, whatever) and do some math... > > With single NVMe, being able to push 1GB/s at minimum = 8 Gbps ( 8Gbps per > single NVMe device)...and enough clients, I would guess at least 40 Gbps > network makes sense to leverage couple of NVMe per host/storage node. > > Again depends also on client IO requirements as well... Its more an art, > than a science, to make right decision. > > Cheers > > >> On Tue, Dec 11, 2018, 23:09 Fariborz Navidan <mdvlinqu...@gmail.com wrote: >> >> How much is minimum bandwidth requirement for storage network in which all >> underlying devices are NVMe SSD? >> >> On Wed, Dec 12, 2018 at 1:34 AM Andrija Panic <andrija.pa...@gmail.com> >> wrote: >> >>> ScaleIO is supposed to be better/more performant...yep. >>> >>> On Tue, 11 Dec 2018 at 23:00, Ivan Kudryavtsev <kudryavtsev...@bw-sw.com >>> >>> wrote: >>> >>>> Fariborz, you also can use ScaleIO exported through iSCSI if you are ok >>> to >>>> go with local storage. >>>> >>>> вт, 11 дек. 2018 г. в 16:51, Fariborz Navidan <mdvlinqu...@gmail.com>: >>>> >>>>> Something like VMware vSAN >>>>> >>>>> On Wed, Dec 12, 2018 at 1:15 AM Andrija Panic < >> andrija.pa...@gmail.com >>>> >>>>> wrote: >>>>> >>>>>> CEPH ? >>>>>> >>>>>> On Tue, 11 Dec 2018 at 21:37, Fariborz Navidan < >>> mdvlinqu...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hello folks, >>>>>>> Do you know of any good vSAN software working with CloudStack? >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> >>>>>> Andrija Panić >>>>>> >>>>> >>>> >>>> >>>> -- >>>> With best regards, Ivan Kudryavtsev >>>> Bitworks LLC >>>> Cell RU: +7-923-414-1515 >>>> Cell USA: +1-201-257-1512 >>>> WWW: http://bitworks.software/ <http://bw-sw.com/> >>>> >>> >>> >>> -- >>> >>> Andrija Panić >>> >>
