[
https://issues.apache.org/jira/browse/HBASE-8060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-8060:
----------------------------------
Affects Version/s: 0.94.6
Did an ingest test (via LoadTestTool) with occasional forced compactions and
splits with head of 0.94 branch. After a while I turned off the load and waited
for the RS compaction queue to drain. The end result is not what I would
expect, some incorrect accounting across splits looks like:
{noformat}
cluster_test,,1362970176754.cf7153f594b71e71bced63f2f56c8c68.
totalCompactingKVs=16752341, currentCompactedKVs=11696023,
compactionProgressPct=0.0
cluster_test,198ba304c5c6d1fce170ea9ddf956540-2809310,1362970176754.653caa9699cfdaabb880d27b2be23a88.
totalCompactingKVs=16805702, currentCompactedKVs=11748155,
compactionProgressPct=0.0
cluster_test,33333333,1362970196990.cd169cb2b4699c5a8eb22fa8720c57e3.
totalCompactingKVs=15317369, currentCompactedKVs=11711367,
compactionProgressPct=0.0
cluster_test,4cd51e1b30a4a602f48fbdae91b0c94e-6910328,1362970196990.a16adf2670eb27cde0d77bf4be631c7e.
totalCompactingKVs=15314264, currentCompactedKVs=11694850,
compactionProgressPct=0.0
cluster_test,66666666,1362970208081.84222a5d47eda4fed4a5452954f2d34c.
totalCompactingKVs=15848942, currentCompactedKVs=11675591,
compactionProgressPct=0.0
cluster_test,7ff5877e8e1973e8479881e280a215ed-7188496,1362970208081.cc14e23f25e56c783f8496b903a8cfee.
totalCompactingKVs=15860814, currentCompactedKVs=11706594,
compactionProgressPct=0.0
cluster_test,99999999,1362970211112.01bfcb43664bd150379ea9f0794360d4.
totalCompactingKVs=15428253, currentCompactedKVs=11718368,
compactionProgressPct=0.0
cluster_test,b330ffc95fa2d2d53fee5cd100a0b6ef-7925280,1362970211112.fe19eaea03e367f923861fae98f6aed2.
totalCompactingKVs=15406477, currentCompactedKVs=11701519,
compactionProgressPct=0.0
cluster_test,cccccccc,1362970238452.e7d33a01530fc8cfbb457055b390ddc5.
totalCompactingKVs=15884797, currentCompactedKVs=11730784,
compactionProgressPct=0.0
cluster_test,e66be25e571007cd06022edf1662ce78-4552250,1362970238452.ef453b0873b829114ea5096164dd3ef8.
totalCompactingKVs=15888383, currentCompactedKVs=11736683,
compactionProgressPct=0.0
{noformat}
After this test I restarted the other instance. Compaction progress is reported
at 100.00% again. My guess is at the next split this will begin to trend
downward again.
> "Num compacting KVs" diverges from "num compacted KVs" over time
> ----------------------------------------------------------------
>
> Key: HBASE-8060
> URL: https://issues.apache.org/jira/browse/HBASE-8060
> Project: HBase
> Issue Type: Bug
> Components: Compaction, UI
> Affects Versions: 0.95.0, 0.96.0, 0.94.6
> Reporter: Andrew Purtell
> Attachments: screenshot.png
>
>
> I have been running what amounts to an ingestion test for a day or so. This
> is an all-in-one cluster launched with './bin/hbase master start' from
> sources. In the RS stats on the master UI, the "num compacting KVs" has
> diverged from "num compacted KVs" even though compaction has been completed
> from perspective of selection, no compaction tasks are running on the RS. I
> think this could be confusing -- is compaction happening or not?
> Or maybe I'm misunderstanding what this is supposed to show?
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
