HBase has also had issues with ZK at modest (~couple hundred node) scale when using it to act as an intermediary for heartbeats and to do work assignment.
On Thu, Mar 31, 2016 at 4:33 PM, Tony Kurc <[email protected]> wrote: > My commentary that didn't accompany this - it appears Storm was using > zookeeper in a similar way as the road we're heading down, and it was such > a major bottleneck that they moved key value storage and heartbeating out > into separate services, and then re-engineering (i.e. built Heron). Before > we get too dependent on zookeeper, may be worth learning some lessons from > the crew that built Heron or from a team that learned zookeeper lessons > scale like accumulo. > > On Thu, Mar 24, 2016 at 6:22 PM, Tony Kurc <[email protected]> wrote: > >> I mentioned slides I saw at the meetup about zookeeper perils at scale in >> storm, here are slides, i couldn't find a video after some limited >> searching. >> https://qconsf.com/system/files/presentation-slides/heron-qcon-2015.pdf >>
