[
https://issues.apache.org/jira/browse/HBASE-14951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15068712#comment-15068712
]
Vladimir Rodionov commented on HBASE-14951:
-------------------------------------------
{quote}
So with 2*, that means that if heap is 31G, then new default is 256 or is it 2*
256? Thanks V.
{quote}
256.
{quote}
I'm concerned about defaults. Users will only consider this option after their
cluster has crashed and burned and won't start because thousands of WAL that
need cleaning up preventing cluster coming back promptly.
{quote}
To be on a safe side we need to decrease default of
*hbase.regionserver.logroll.period* (to, say 10min) and/or to mention this in
release notes. With low *hbase.regionserver.logroll.period*, the maximum number
of wal files will be defined by the total size of memstore (unflushed data),
not by the *hbase.regionserver.maxlogs*. But for majority of applications I do
not see any issue with defaults. Data will be flushed periodically from
memstore, the LogRoller will archive old wals and we will never reach the new
defaults for *hbase.regionserver.maxlogs", unless we put system under extreme
load for prolonged period of time, but in this case, decreasing
*hbase.regionserver.logroll.period* allows us to control runaway wal files.
> Make hbase.regionserver.maxlogs obsolete
> ----------------------------------------
>
> Key: HBASE-14951
> URL: https://issues.apache.org/jira/browse/HBASE-14951
> Project: HBase
> Issue Type: Improvement
> Components: Performance, wal
> Reporter: Vladimir Rodionov
> Assignee: Vladimir Rodionov
> Priority: Minor
> Fix For: 2.0.0, 1.2.0, 1.3.0
>
> Attachments: HBASE-14951-v1.patch, HBASE-14951-v2.patch
>
>
> There was a discussion in HBASE-14388 related to maximum number of log files.
> It was an agreement that we should calculate this number in a code but still
> need to honor user's setting.
> Maximum number of log files now is calculated as following:
> maxLogs = HEAP_SIZE * memstoreRatio * 2/ LogRollSize
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
