[ 
https://issues.apache.org/jira/browse/HADOOP-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994658#comment-14994658
 ] 

Masatake Iwasaki commented on HADOOP-12511:
-------------------------------------------

GangliaSink and GraphiteSink needs key for each metric values. Those sinks make 
the key from name and tags of metrics record. This sometimes results in 
problematic key which contains changing values and white spaces.
{noformat}
[dfs.FSNamesystem.Context=dfs.HAState=active.TotalSyncTimes=20 
.Hostname=centos7.MissingBlocks 0 1446359392]
[dfs.FSNamesystem.Context=dfs.HAState=active.TotalSyncTimes=20 
.Hostname=centos7.MissingReplOneBlocks 0 1446359392]
[dfs.FSNamesystem.Context=dfs.HAState=active.TotalSyncTimes=20 
.Hostname=centos7.ExpiredHeartbeats 0 1446359392]
[dfs.FSNamesystem.Context=dfs.HAState=active.TotalSyncTimes=20 
.Hostname=centos7.TransactionsSinceLastCheckpoint 2 1446359392]
[dfs.FSNamesystem.Context=dfs.HAState=active.TotalSyncTimes=20 
.Hostname=centos7.TransactionsSinceLastLogRoll 1 1446359392]
...
{noformat}

We can put the metrics to InfluxDB in the form like below which is easy to 
query and visualize.
{noformat}
dfs.FSNamesystem,Context=dfs,HAState=active,TotalSyncTimes=20\ 
,Hostname=centos7 
MissingBlocks=0,MissingReplOneBlocks=0,ExpiredHeartbeats=0,TransactionsSinceLastLogRoll=1,...
 1446359392
{noformat}

> Add support for InfluxDB as metrics sink
> ----------------------------------------
>
>                 Key: HADOOP-12511
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12511
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: metrics
>            Reporter: Masatake Iwasaki
>            Assignee: Masatake Iwasaki
>         Attachments: HADOOP-12511.001.patch
>
>
> Add InfluxDBSink to write metrics to InfluxDB. Because [the Line Protocol of 
> InfluxDB|https://influxdb.com/docs/v0.9/write_protocols/line.html] expects 
> data structure similar to MetricsRecord consisting of tags, metric values and 
> timestamp, we can easily map the records to the format. We can use REST API 
> or UDP to send records to InfluxDB.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to