[
https://issues.apache.org/jira/browse/IMPALA-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-7674:
----------------------------------
Component/s: Backend
> Impala should compress older log files
> --------------------------------------
>
> Key: IMPALA-7674
> URL: https://issues.apache.org/jira/browse/IMPALA-7674
> Project: IMPALA
> Issue Type: Improvement
> Components: Backend
> Affects Versions: Impala 3.0, Impala 2.12.0, Impala 3.1.0
> Reporter: Zoram Thanga
> Priority: Major
> Labels: supportability
>
> By default, Impala keeps ten log files of each severity level (INFO, WARN,
> ERROR), and the size limit of each is set to 200MB or so. The cleaning or old
> file deletion is controlled by the FLAGS_max_log_files parameter.
> On busy clusters we've found that log deletion can throw away debug
> information too quickly, often making troubleshooting harder than it needs to
> be.
> We can compress the log files to:
> # Reduce the disk space consumption by 10x or more.
> # Keep more log files around for the same disk space budget.
> # Have 10x or more historical diagnostics data available.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
