The HBase table-backed WAL/queue implementation Steven is talking about won't need any upgrade or patching wrt HBase code. We will however be needing some extra column families and tables.
At the moment we're still in the process of designing and developing a first version. In 2-3 weeks we should have something ready to show. Evert. On Tue, Jun 8, 2010 at 7:09 PM, Andrew Purtell <[email protected]> wrote: > Steven, > > > From: Steven Noels > [...] > > We'll soon (2-3 weeks) be releasing a HBase table-backed > > WAL/queue implementation that binds HBase with SOLR for > > index updates in Lily, but is designed not to be Lily- > > specific or -dependent. I don't know if this is of > > any help for you, but it could be a robust way to > > asynchronously connect to ES (or any other indexing > > service) as well. > > That sounds excellent! > > I have recently been considering options for how to send updates to Solr > over from HBase. Something like what you describe would be an enormous head > start. Would love to take a look. If we can use it I would be happy to help > you out with this, e.g. test, bug fix, enhance to meet our use cases, etc. > > Also, while I would appreciate the help on coprocessors that would come out > of handling this case, I presume your stuff is basically ready now and can > drop in on top of an existing prod HBase install without needing upgrade or > patching. > > - Andy > > > More info at > http://www.slideshare.net/outerthought/learning-lessons-4426942 and > > http://lilycms.org/lily/prerelease/architecture.html > [...] > > > > > >
