[
https://issues.apache.org/jira/browse/AMBARI-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aravindan Vijayan updated AMBARI-17949:
---------------------------------------
Description:
Out of disk space issues are seen due to the sheer amount of logs being
produced by hive after addition of metrics. For this, a single change needs to
be done to the log4j properties offered by Ambari to fix this.
In hive-log4j content, the following needs to be added.
{noformat}
# Silence HadoopMetrics2Reporter INFO logs
log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA
{noformat}
This upgrade jira is only for adding the log level changes for Hive components
part of HDP 2.4 stack. Hive components that have been added in HDP2.5 fall into
the category of either not needing this change or using default from stack.
was:
Out of disk space issues are seen due to the sheer amount of logs being
produced by hive after addition of metrics. For this, a single change needs to
be done to the log4j properties offered by Ambari to fix this.
In Hive Config -> "Advanced hive-log4j", the following needs to be added.
# Silence HadoopMetrics2Reporter INFO logs
log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA
-# Silence HadoopMetrics2Reporter INFO logs
log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA
{noformat}
FYI, this upgrade jira is only for adding the log level changes for Hive
components part of HDP 2.4 stack. Hive components that have been added in
HDP2.5 fall into the category of either not needing this change or using
default from stack.
> Disable INFO logs from HadoopMetrics2Reporter for hive on upgrade to 2.5
> ------------------------------------------------------------------------
>
> Key: AMBARI-17949
> URL: https://issues.apache.org/jira/browse/AMBARI-17949
> Project: Ambari
> Issue Type: Bug
> Affects Versions: 2.4.0
> Reporter: Aravindan Vijayan
> Assignee: Aravindan Vijayan
> Priority: Blocker
> Fix For: 2.4.0
>
>
> Out of disk space issues are seen due to the sheer amount of logs being
> produced by hive after addition of metrics. For this, a single change needs
> to be done to the log4j properties offered by Ambari to fix this.
> In hive-log4j content, the following needs to be added.
> {noformat}
> # Silence HadoopMetrics2Reporter INFO logs
> log4j.logger.com.github.joshelser.dropwizard.metrics.hadoop=WARN,DRFA
> {noformat}
> This upgrade jira is only for adding the log level changes for Hive
> components part of HDP 2.4 stack. Hive components that have been added in
> HDP2.5 fall into the category of either not needing this change or using
> default from stack.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
