[
https://issues.apache.org/jira/browse/HBASE-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13449886#comment-13449886
]
Hudson commented on HBASE-6508:
-------------------------------
Integrated in HBase-TRUNK #3310 (See
[https://builds.apache.org/job/HBase-TRUNK/3310/])
HBASE-6659 Port HBASE-6508 Filter out edits at log split time (Revision
1381684)
Result = FAILURE
tedyu :
Files :
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/RegionLoad.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/RequestConverter.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ResponseConverter.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/generated/HBaseProtos.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/generated/RegionServerStatusProtos.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LastSequenceId.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/SplitLogWorker.java
*
/hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
* /hbase/trunk/hbase-server/src/main/protobuf/RegionServerStatus.proto
* /hbase/trunk/hbase-server/src/main/protobuf/hbase.proto
*
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLogFiltering.java
*
/hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLogSplit.java
> [0.89-fb] Filter out edits at log split time
> --------------------------------------------
>
> Key: HBASE-6508
> URL: https://issues.apache.org/jira/browse/HBASE-6508
> Project: HBase
> Issue Type: Improvement
> Components: master, regionserver, wal
> Affects Versions: 0.89-fb
> Reporter: Alex Feinberg
> Assignee: Alex Feinberg
> Fix For: 0.89-fb
>
>
> At log splitting time, we can filter out many edits if we have a conservative
> estimate of what was saved last in each region.
> This patch does the following:
> 1) When a region server flushes a MemStore to HFile, store the last flushed
> sequence id for the region in a map.
> 2) Send the map to master it as a part of the region server report.
> 3) Adds an RPC call in HMasterRegionInterface to allow a region server to
> query the last last flushed sequence id for a region.
> 4) Skips any log entry with sequence id lower than last flushed sequence id
> for the region during log split time.
> 5) When a region is removed from a region server, removed the the entry for
> that region from the map, so that it isn't sent during the next report.
> This can reduce downtime when a regionserver goes down quite a bit.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
