[
https://issues.apache.org/jira/browse/HBASE-16094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15427302#comment-15427302
]
Hudson commented on HBASE-16094:
--------------------------------
FAILURE: Integrated in Jenkins build HBase-Trunk_matrix #1439 (See
[https://builds.apache.org/job/HBase-Trunk_matrix/1439/])
HBASE-16094 Improve cleaning up of proc wals. Makes the proc log cleaner (appy:
rev ce88270340872b43083ee7b79ac3027557597224)
* (edit)
hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/ProcedureStoreTracker.java
* (edit)
hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/store/wal/TestWALProcedureStore.java
* (edit)
hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java
* (edit)
hbase-procedure/src/test/java/org/apache/hadoop/hbase/procedure2/store/TestProcedureStoreTracker.java
* (edit)
hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/ProcedureWALFormat.java
* (edit)
hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/ProcedureWALFile.java
> Procedure v2 - Improve cleaning up of proc wals
> -----------------------------------------------
>
> Key: HBASE-16094
> URL: https://issues.apache.org/jira/browse/HBASE-16094
> Project: HBase
> Issue Type: Sub-task
> Components: proc-v2
> Reporter: Appy
> Assignee: Appy
> Fix For: 2.0.0
>
> Attachments: HBASE-16094.master.001.patch,
> HBASE-16094.master.002.patch, HBASE-16094.master.003.patch,
> HBASE-16094.master.004.patch, HBASE-16094.master.005.patch,
> HBASE-16094.master.006.patch
>
>
> Avoid accumulating too many wals.
> We remove logs in 3 cases:
> - No procedures are running. We can remove all the logs.
> - All procedures are updated/written in the last log. We can remove all the
> logs, aside the active one.
> - Remove log if does not contains “active” procIds
> https://github.com/apache/hbase/blob/master/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/store/wal/WALProcedureStore.java#L865
> The last point, Remove log if does not contains “active” procIds, needs to be
> improved. Basically, even if a log contains state of an active proc, we can
> delete it if a later log contains a newer state.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
