Take a look at this library from Huawei. They went a step further to colocate the index with the primary partition. I believe Phoenix uses it for its indexing.
https://github.com/Huawei-Hadoop/hindex On Sun, Dec 22, 2013 at 1:34 PM, Ted Yu <yuzhih...@gmail.com> wrote: > Rajeshbabu is working on HBASE-10222 which adds support of secondary index > to HBASE core. > > FYI > > On Dec 22, 2013, at 2:11 AM, Henning Blohm <henning.bl...@zfabrik.de> > wrote: > > > Lately we have added a secondary index feature to a persistence tier > over HBASE. Essentially we implemented what is described as "Dual-Write > Secondary Index" in http://hbase.apache.org/book/secondary.indexes.html. > I.e. while updating an entity, actually before writing the actual update, > indexes are updated. Lookup via the index ignores stale entries. A > recurring rebuild and clean out of stale entries takes care the indexes are > trimmed and accurate. > > > > None of this was terribly complex to implement. In fact, it seemed like > something you could do generically, maybe not on the HBASE level itself, > but as a toolbox / utility style library. > > > > Is anybody on the list aware of anything useful already existing in that > space? > > > > Thanks, > > Henning Blohm > > > > *ZFabrik Software KG* > > > > T: +49 6227 3984255 > > F: +49 6227 3984254 > > M: +49 1781891820 > > > > Lammstrasse 2 69190 Walldorf > > > > henning.bl...@zfabrik.de <mailto:henning.bl...@zfabrik.de> > > Linkedin <http://www.linkedin.com/pub/henning-blohm/0/7b5/628> > > ZFabrik <http://www.zfabrik.de> > > Blog <http://www.z2-environment.net/blog> > > Z2-Environment <http://www.z2-environment.eu> > > Z2 Wiki <http://redmine.z2-environment.net> > > >
