[
https://issues.apache.org/jira/browse/HBASE-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Kyle Purtell updated HBASE-25828:
----------------------------------------
Description:
Similar to HBASE-25642, but compaction progress warnings.
Lots of warnings like:
{noformat}
2021-04-30 00:55:15,436 WARN [regionserver/ip-172-31-63-65:8120]
compactions.CompactionProgress: totalCompactingKVs=15589 less than
currentCompactedKVs=21411
{noformat}
{noformat}
2021-04-30 00:55:15,437 WARN [regionserver/ip-172-31-63-65:8120]
compactions.CompactionProgress: totalCompactingKVs=21916 less than
currentCompactedKVs=33328
{noformat}
{noformat}
2021-04-30 00:55:15,438 WARN [regionserver/ip-172-31-63-65:8120]
compactions.CompactionProgress: totalCompactingKVs=89731 less than
currentCompactedKVs=92808
{noformat}
A couple of issues:
- Is there a way to make CompactionProgress more reliable? I seem to recall
this is the second or third time around the block on this.
- This is annoying because compaction progress isn't always accurate, but this
information is not used to determine anything significant, so WARN level is a
bit much. (Or, if this is a real correctness problem, see point above.)
was:
Lots of warnings like:
{noformat}
2021-04-30 00:55:15,436 WARN [regionserver/ip-172-31-63-65:8120]
compactions.CompactionProgress: totalCompactingKVs=15589 less than
currentCompactedKVs=21411
{noformat}
{noformat}
2021-04-30 00:55:15,437 WARN [regionserver/ip-172-31-63-65:8120]
compactions.CompactionProgress: totalCompactingKVs=21916 less than
currentCompactedKVs=33328
{noformat}
{noformat}
2021-04-30 00:55:15,438 WARN [regionserver/ip-172-31-63-65:8120]
compactions.CompactionProgress: totalCompactingKVs=89731 less than
currentCompactedKVs=92808
{noformat}
A couple of issues:
- Is there a way to make CompactionProgress more reliable? I seem to recall
this is the second or third time around the block on this.
- This is annoying because compaction progress isn't always accurate, but this
information is not used to determine anything significant, so WARN level is a
bit much. (Or, if this is a real correctness problem, see point above.)
> CompactionProgress WARNS: "totalCompactingKVs=N less than
> currentCompactedKVs=M"
> --------------------------------------------------------------------------------
>
> Key: HBASE-25828
> URL: https://issues.apache.org/jira/browse/HBASE-25828
> Project: HBase
> Issue Type: Bug
> Affects Versions: 2.4.3
> Reporter: Andrew Kyle Purtell
> Priority: Minor
> Fix For: 3.0.0-alpha-1, 2.5.0, 2.4.4
>
>
> Similar to HBASE-25642, but compaction progress warnings.
> Lots of warnings like:
> {noformat}
> 2021-04-30 00:55:15,436 WARN [regionserver/ip-172-31-63-65:8120]
> compactions.CompactionProgress: totalCompactingKVs=15589 less than
> currentCompactedKVs=21411
> {noformat}
> {noformat}
> 2021-04-30 00:55:15,437 WARN [regionserver/ip-172-31-63-65:8120]
> compactions.CompactionProgress: totalCompactingKVs=21916 less than
> currentCompactedKVs=33328
> {noformat}
> {noformat}
> 2021-04-30 00:55:15,438 WARN [regionserver/ip-172-31-63-65:8120]
> compactions.CompactionProgress: totalCompactingKVs=89731 less than
> currentCompactedKVs=92808
> {noformat}
> A couple of issues:
> - Is there a way to make CompactionProgress more reliable? I seem to recall
> this is the second or third time around the block on this.
> - This is annoying because compaction progress isn't always accurate, but
> this information is not used to determine anything significant, so WARN level
> is a bit much. (Or, if this is a real correctness problem, see point above.)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
