Coprocessors
------------

                 Key: HBASE-2000
                 URL: https://issues.apache.org/jira/browse/HBASE-2000
             Project: Hadoop HBase
          Issue Type: New Feature
            Reporter: Andrew Purtell


>From Google's Jeff Dean, in a keynote to LADIS 2009 
>(http://www.scribd.com/doc/21631448/Dean-Keynote-Ladis2009, slides 66 - 67): 

BigTable Coprocessors (New Since OSDI'06)

* Arbitrary code that runs run next to each tablet in table
    - As tablets split and move, coprocessor code automatically splits/moves too

* High-level call interface for clients
    - Unlike RPC, calls addressed to rows or ranges of rows

* coprocessor client library resolves to actual locations
    - Calls across multiple rows automatically split into multiple parallelized 
RPCs

* Very flexible model for building distributed services
    -  Automatic scaling, load balancing, request routing for apps

Example Coprocessor Uses

* Scalable metadata management for Colossus (next gen GFS-like file system)

* Distributed language model serving for machine translation system

* Distributed query processing for full-text indexing support

* Regular expression search support for code repository


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to