[
https://issues.apache.org/jira/browse/HADOOP-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Templeton updated HADOOP-12702:
--------------------------------------
Attachment: HADOOP-12702.002.patch
This patch should address all of the issues that I think can be addressed.
{{FileSystemSink}} is now more robust in the face of existing files and allows
multiple daemons on the same host to each have its own log file.
I've added a base test class and an implementation for the local file system.
HDFS-9637 adds an implementation for HDFS. I've also tested this patch in a
4-node cluster.
There is still some javadoc cleanup to do, and there may be a couple of style
and comment issues still. I'll work on those for the next patch.
[~steve_l] and [~vickyuec], review appreciated.
> Add an HDFS metrics sink
> ------------------------
>
> Key: HADOOP-12702
> URL: https://issues.apache.org/jira/browse/HADOOP-12702
> Project: Hadoop Common
> Issue Type: Improvement
> Components: metrics
> Affects Versions: 2.7.1
> Reporter: Daniel Templeton
> Assignee: Daniel Templeton
> Attachments: HADOOP-12702.001.patch, HADOOP-12702.002.patch
>
>
> We need a metrics2 sink that can write metrics to HDFS. The sink should
> accept as configuration a "directory prefix" and do the following in
> {{putMetrics()}}
> * Get yyyyMMddHH from current timestamp.
> * If HDFS dir "dir prefix" + yyyyMMddHH doesn't exist, create it. Close any
> currently open file and create a new file called <hostname>.log in the new
> directory.
> * Write metrics to the current log file.
> * If a write fails, it should be fatal to the process running the sink.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
