-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
http://review.hbase.org/r/301/
-----------------------------------------------------------

(Updated 2010-07-12 21:41:44.943871)


Review request for hbase, stack, Karthik Ranganathan, and Kannan Muthukkaruppan.


Changes
-------

Fixes some issues introduced by also having executor services running on the 
RS-side.  Specifically, shutdown hooks to the HBaseExecutorService would 
shutdown and clear all executor pools, rather than just those of the shutting 
down server instance.

Now the map of services is always prefixed with the serverName and during 
shutdown we only actually shutdown those prefixed with the serverName.

More unit tests are now passing, still finish the suite.


Summary
-------

Adds support for priorities and concurrency to regionserver flushing.
- Adds support for RS-side events/handlers/executors
- Adds support for prioritized HBaseEventHandlers
- Flushing now happens through FlushHandler, a new HBaseEventHandler.  There is 
an RS_FLUSHER executor pool that defaults to two threads right now but is also 
checking a conf value.  There is a good bit of documentation in FlushHandler.
- Adds unit test TestFlushHandler.  There is a nicer way to detect when flushes 
finish now for other tests.
- Handling of FS errors is pushed into FlushHandler now.  The changes happening 
with the master rewrite introduce a ServerStatus interface (probably a 
RegionStatus for rs side) that will contain the necessary methods rather than 
using HRegionServer directly as is required for now.
- Something weird not passing in tests with multiple masters and regionservers, 
still working that out.


This addresses bug HBASE-2832.
    http://issues.apache.org/jira/browse/HBASE-2832


Diffs (updated)
-----

  trunk/src/main/java/org/apache/hadoop/hbase/executor/HBaseEventHandler.java 
963507 
  
trunk/src/main/java/org/apache/hadoop/hbase/executor/HBaseExecutorService.java 
963507 
  trunk/src/main/java/org/apache/hadoop/hbase/master/HMaster.java 963507 
  
trunk/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplitThread.java
 963507 
  trunk/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java 
963507 
  trunk/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java 
963507 
  
trunk/src/main/java/org/apache/hadoop/hbase/regionserver/handler/FlushHandler.java
 PRE-CREATION 
  
trunk/src/test/java/org/apache/hadoop/hbase/regionserver/TestFlushHandler.java 
PRE-CREATION 

Diff: http://review.hbase.org/r/301/diff


Testing
-------

Adds TestFlushHandler which passes.  Working on getting unit tests passing now, 
something related to the ExecutorService.


Thanks,

Jonathan

Reply via email to